ExecutivePlacements.com ยท 3 hours ago
Data Engineer (AWS EMR)
Chicago, IL
Full-time
Onsite
Senior LevelExecutivePlacements.com is seeking a Senior Data Engineer with expertise in Python and AWS. The role involves driving scalable, real-time data solutions and requires proficiency in big data ecosystems and CI/CD frameworks.
Human ResourcesOnline PortalsRecruiting
Responsibilities
Proficient developer in multiple languages, Python is a must, with the ability to quickly learn new ones
Expertise in SQL (complex queries, relational databases, preferably PostgreSQL, and NoSQL databases - Redis and Elasticsearch)
Extensive big data experience, including EMR, Spark, Kafka/ Kinesis, and optimising data pipelines, architectures, and datasets
AWS expert with hands-on experience in Lambda, Glue, Athena, Kinesis, IAM, EMR/PySpark, Docker
Proficient in CI/CD development using Git, Terraform, and agile methodologies
Comfortable with stream-processing systems (Storm, Spark-Streaming) and workflow management tools (Airflow)
Exposure to knowledge graph technologies (Graph DB, OWL, SPARQL) is a plus
Qualification
Required
AWS
EMR
Python
PySpark
SQL (complex queries, relational databases, preferably PostgreSQL, and NoSQL databases - Redis and Elasticsearch)
Extensive big data experience, including EMR, Spark, Kafka/Kinesis, and optimising data pipelines, architectures, and datasets
AWS expert with hands-on experience in Lambda, Glue, Athena, Kinesis, IAM, EMR/PySpark, Docker
Proficient in CI/CD development using Git, Terraform, and agile methodologies
Comfortable with stream-processing systems (Storm, Spark-Streaming) and workflow management tools (Airflow)
Preferred
Spark
Kafka/Kinesis
Exposure to knowledge graph technologies (Graph DB, OWL, SPARQL)
Company
ExecutivePlacements.com
Online recruitment
Founded in 2011
11-50 employees
Funding
Current Stage
Early StageCompany data provided by crunchbase