Elevanta Partners · 14 hours ago
Data Engineering Lead
New York, NY
Full-time
Onsite
Lead/Staff
$160K/yr - $180K/yr
15+ years expElevanta Partners is a Private Equity firm based in New York, seeking an experienced Data Engineering Lead to drive large-scale data initiatives. This hands-on leadership role involves architecting and building modern data platforms on Azure Databricks while managing an offshore delivery team to deliver high-quality, scalable data solutions.
Management Consulting
Hiring Manager
Divya Reddy
Responsibilities
Act as the onsite lead and primary point of contact for data engineering initiatives
Manage and mentor an offshore team of 5–7 data engineers and data testers, ensuring delivery quality and timelines
Architect and implement robust, scalable data pipelines using PySpark and SQL
Define and enforce best practices for data engineering, performance optimization, and data quality
Work closely with data architects and stakeholders to align data solutions with enterprise data architecture
Leverage Unity Catalog for data governance, security, and access control
Collaborate with business users, analysts, and leadership to translate business requirements into technical solutions
Qualification
Required
15+ years of experience delivering large-scale data programs in enterprise environments
Databricks Certified Data Engineer with 5+ years of experience leading Azure Databricks programs
Strong hands-on experience with PySpark, including 5+ years delivering production-grade data pipelines
Solid working knowledge of Unity Catalog and modern data governance practices
Strong understanding of data architecture principles, including data lakes, lakehouse patterns, and ETL/ELT design
Advanced SQL skills for data transformation, analysis, and optimization
Proven experience managing offshore teams of data engineers and data testers
Excellent communication skills with the ability to engage both technical and non-technical stakeholders
Preferred
Experience working on Private Equity or Capital Markets data programs
Exposure to investment, portfolio, deal, or financial data domains
Prior experience in regulated or high-performance data environments
Company
Elevanta Partners
Elevanta Partners is a Go-To-Market advisory services firm led by seasoned industry practitioners.
2-10 employees
Funding
Current Stage
Early StageCompany data provided by crunchbase