Detroit Labs · 14 hours ago
Senior Data Engineer - Airflow and PySpark (Hybrid)
Auburn Hills, MI
Full-time
Hybrid
Senior Level
$160K/yr - $180K/yr
7+ years expDetroit Labs is a company focused on building digital products and services, and they are seeking an experienced Data Engineer with expertise in Airflow and PySpark. In this role, you will design, develop, and optimize scalable data pipelines and lead data engineering initiatives for an automotive client.
AndroidAppsMobile
Responsibilities
Design, develop, and optimize scalable data pipelines using Python and PySpark for batch and streaming workloads
Build, schedule, and monitor complex workflows using Airflow, ensuring reliability and maintainability
Architect and implement CI/CD pipelines for data engineering projects using GitHub, Docker, and cloud-native solutions (GCP preferred)
Apply test-driven development (TDD) practices and automate unit/integration tests for data pipelines
Implement secure coding best practices and design patterns throughout the development lifecycle
Work closely with Data Architects, QA teams, and business stakeholders to translate requirements into technical solutions
Create and maintain technical documentation, including process/data flow diagrams and system design artifacts
Lead and mentor junior engineers, providing guidance on coding, testing, and deployment best practices
Analyze and resolve technical issues across the data stack, including pipeline failures and performance bottlenecks
Cross-train team members outside the project team (e.g., operations support) for full knowledge coverage
Qualification
Required
7+ years of Data Engineering experience building production-grade data pipelines using Python and PySpark
Experience designing, deploying, and managing Airflow DAGs in enterprise environments
Experience maintaining CI/CD pipelines for data engineering workflows, including automated testing and deployment
Experience with cloud workflows and containerization, using Docker and cloud platforms (GCP preferred) for data engineering workloads
Knowledge and ability to follow twelve-factor design principles
Experience and ability to write object-oriented Python code, manage dependencies, and follow industry best practices
Proficiency with Git for source code management and collaboration (commits, branching, merging, GitHub/GitLab workflows)
Experience working with command lines in Unix/Linux-like environments
Solid understanding of SQL for data ingestion and analysis
Engineering mindset. Able to write code with an eye for maintainability and testability
Collaborative mindset. Comfortable with code reviews, paired programming, and using remote collaboration tools effectively
Detroit Labs is not currently able to hire candidates who will reside outside of the United States during their term of employment
Preferred
GCP preferred for cloud platforms
Benefits
Full medical, dental, vision benefits
401K contribution options
Quarterly outings and events
Paid holidays and vacation time
Parental leave program
Monthly budgets for "team fun" bonding events
Free lunch for various company meetings and Lunch & Learns
Access to our mentorship program and employee resource groups (ERGs)
Volunteer opportunities
All-company remote-friendly activities
Plenty of Detroit Labs swag
Company
Detroit Labs
Detroit Labs, LLC builds Web, iOS, and Android applications for start ups and companies in the United States.
51-200 employees
H1B Sponsorship
Detroit Labs has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (5)
2024 (2)
2023 (2)
2022 (6)
2021 (6)
2020 (3)
Funding
Current Stage
Growth StageLeadership Team
Nathan Hughes
Chief Operating Officer
Company data provided by crunchbase