Harnham · 18 hours ago
Data Engineer
Harnham is looking for a Lead Data Engineer to lead the design, development, and optimization of a cloud-native data platform on AWS. The role involves mentoring a team of engineers while being hands-on with data pipelines, orchestration, and cloud infrastructure.
Responsibilities
Design, build, and optimize ETL/ELT pipelines using Python/PySpark, SQL, and AWS services (Glue, Redshift, Athena, S3, EMR, Lambda)
Lead data lakehouse/warehouse architecture using Iceberg, Parquet, and Lake Formation
Implement workflow orchestration (Airflow, Step Functions) and CI/CD for data pipelines
Drive data quality, governance, and security ; implement monitoring, alerting, and incident-response frameworks
Optimize compute, storage, and network usage ; perform architecture reviews and tuning
Mentor and guide a team of data engineers; enforce coding standards and best practices
Collaborate with architects and stakeholders to define data models, integration patterns, and platform roadmaps
Enable analytics and ML/AI pipelines by delivering scalable, reliable data products
Qualification
Required
5–7 years of hands-on data engineering; 3+ years in a technical lead role
Strong AWS expertise: S3, Glue, Redshift, Athena, EMR/Spark, Lambda, IAM, Lake Formation
Proficient in Python/PySpark or Scala and advanced SQL
Experience with large-scale ETL/ELT pipelines, data lakes, lakehouses, and warehouses
Expertise in data lakehouse architectures (Iceberg, Parquet) and orchestration (Airflow, Step Functions)
Knowledge of CI/CD, infrastructure-as-code (Terraform/CloudFormation), automated testing, and DevOps practices
Strong understanding of data modeling, governance, security, and metadata management
Experience designing pipelines to support ML/AI workloads
Proven leadership and mentoring skills; able to drive engineering excellence
U.S. work authorization required
Preferred
AWS certifications (Data Analytics – Specialty or Solutions Architect)
Company
Harnham
Harnham has actively chosen to focus on Data and Analytics.
Funding
Current Stage
Growth StageTotal Funding
unknownKey Investors
BGF Ventures
2022-05-01Seed
Recent News
Company data provided by crunchbase