OtB Tech LLC · 10 hours ago
AWS Data Engineer
OtB Tech LLC is seeking an AWS Data Engineer to design, develop, and maintain ETL/ELT pipelines using AWS services. The role involves ensuring data quality and security while collaborating with data scientists and stakeholders to deliver reliable datasets.
Responsibilities
Design, develop, and maintain batch and streaming ETL/ELT pipelines using AWS services (Glue, Lambda, Step Functions, etc.)
Implement data ingestion frameworks from diverse sources (APIs, databases, streaming platforms)
Ensure data quality, governance, and security across all pipelines
Build and optimize data lakes and warehouses leveraging Amazon S3, Redshift, Athena, and Lake Formation
Collaborate with data scientists, analysts, and business stakeholders to deliver reliable datasets
Monitor and troubleshoot data workflows, ensuring high availability and performance
Stay updated with emerging AWS technologies and recommend improvements
Qualification
Required
Strong experience with AWS cloud services: S3, Glue, Redshift, EMR, Kinesis, Lambda, DynamoDB, RDS, Athena, SNS, SQS
Proficiency in SQL, Python and PySpark
Knowledge of data modeling, schema design, and performance tuning
Familiarity with CI/CD pipelines and DevOps practices tool (Terraform, CloudFormation)
Experience with security best practices (IAM, encryption, compliance)
Company
OtB Tech LLC
OtB Tech LLC is a leading staffing firm that provides customized workforce solutions to businesses of all sizes.
Funding
Current Stage
Growth StageCompany data provided by crunchbase