84.51˚ · 3 hours ago
Senior Data Engineer (P358)
84.51° is a retail data science, insights and media company. As a Senior Data Engineer on our AI Enablement team, you will cultivate strategies and solutions to ingest, store and distribute our big data, focusing on building solutions for monitoring and tracking machine learning and AI solutions.
Responsibilities
Take ownership of features and drive them to completion through all phases of the entire 84.51° SDLC. This includes external facing and internal applications as well as process improvement activities such as:
Lead design of Python and PySpark based solutions
Perform development of cloud based (Azure) ETL solutions
Build and configure cloud infrastructure for all stages of the data development lifecycle
Execute unit and integration testing
Develop robust data QA processes
Collaborate with senior resources to ensure consistent development practices
Provide mentoring to junior resources
Build visualizations in Databricks Apps, Databricks Dashboards and PowerBI
Bring new perspectives to problems and be driven to improve yourself and the way things are done
Qualification
Required
Bachelor's degree in Computer Science, Management Information Systems, Mathematics, Business Analytics or another technically strong program
3+ years proven ability of professional data engineering experience
Strong understanding of Agile Principles (Scrum)
3+ years proven ability of developing with Python and PySpark
Full understanding of ETL concepts and data warehousing concepts
Experience with CI/CD frameworks (GitHub Actions a plus)
Experience with visualization techniques and tools like Databricks dashboards or PowerBI a plus
Languages/Tech stack: Python, PySpark, Terraform, Databricks, GitHub Actions, Azure
Preferred
AKS experience a plus
Dashboard experience a plus
WebApp experience a plus
Benefits
Health: Medical: with competitive plan designs and support for self-care, wellness and mental health. Dental: with in-network and out-of-network benefit. Vision: with in-network and out-of-network benefit.
Wealth: 401(k) with Roth option and matching contribution. Health Savings Account with matching contribution (requires participation in qualifying medical plan). AD&D and supplemental insurance options to help ensure additional protection for you.
Happiness: Paid time off with flexibility to meet your life needs, including 5 weeks of vacation time, 7 health and wellness days, 3 floating holidays, as well as 6 company-paid holidays per year. Paid leave for maternity, paternity and family care instances.