YipitData · 15 hours ago
Data Engineering Lead
United States
Full-time
Remote
Senior Level, Lead/Staff
$215K/yr - $240K/yr
6+ years expYipitData is the leading market research and analytics firm for the disruptive economy, and they are seeking a Data Engineering Lead to join their team. This role involves designing and maintaining large-scale data pipelines and ensuring the integration of emerging technologies to deliver scalable data solutions.
AnalyticsData VisualizationMarket Research
No H1B
Responsibilities
Own the design, build, and optimization of end-to-end data pipelines that power our vendor universe
Establish and enforce best practices in data modeling, orchestration, and system reliability
Collaborate with product, engineering, and business stakeholders to translate requirements into robust, scalable data solutions
Work extensively with Databricks and Airflow for large-scale data processing and orchestration
Troubleshoot and resolve complex pipeline issues to ensure reliability and performance
Contribute to the team’s technical strategy, helping drive improvements in scalability, performance, and efficiency
Lead, mentor, and support engineers through challenges, code reviews, and project execution
Qualification
Required
6+ years of professional experience in Data Engineering or equivalent technical roles (e.g., data architecture, big data development, or ETL engineering)
2+ years of managerial experience, including mentoring, team leadership, and supporting delivery
Strong expertise in SQL and distributed data systems
Proficiency with PySpark and Databricks for processing and scaling large datasets
Hands-on experience with Airflow for pipeline orchestration (Dagster/dbt a plus)
Proven track record of delivering in fast-paced, deadline-driven environments with minimal oversight
Strong problem-solving skills and ability to translate business needs into scalable technical solutions
Excellent communication and collaboration skills with both technical and non-technical stakeholders
Preferred
Experience leveraging AI/ML models, vector search, or Elasticsearch to enhance data pipelines
Familiarity with Django or similar web frameworks to support data-driven applications
Benefits
Flexible work hours
Flexible vacation
Generous 401K match
Parental leave
Team events
Wellness budget
Learning reimbursement
Company
YipitData
YipitData is a market research firm that provides detailed insights and reports based on alternative data.
501-1000 employees
Funding
Current Stage
Late StageTotal Funding
$492.05MKey Investors
CIBC Innovation BankingThe Carlyle GroupHighland Capital Partners
2024-06-12Debt Financing
2021-12-06Series E· $475M
2019-01-01Series D
Leadership Team
Vinicius Vacanti
CEO / Co-Founder
James Moran
Board Member/Co-Founder
Recent News
Norwest
2025-12-30
Company data provided by crunchbase