Databricks Data Engineer – Senior Consultant jobs in United States
cer-icon
Apply on Employer Site
company-logo

Deloitte · 1 week ago

Databricks Data Engineer – Senior Consultant

Deloitte is a leading consulting firm, and they are seeking a Senior Data Engineer to oversee the design, deployment, and optimization of enterprise-scale data engineering solutions using Databricks. This role focuses on leading innovation in big data architecture and analytics while advising senior stakeholders to ensure data solutions align with business objectives.

AccountingConsultingFinancial ServicesLegalProfessional ServicesRisk Management
check
Growth Opportunities
check
H1B Sponsorednote

Responsibilities

Lead the development, implementation, and scaling of advanced data engineering solutions using Databricks across AWS, Azure, or GCP environments
Establish, document, and promote best-in-class approaches for data architecture, integration, and modelling
Oversee the design, development, and maintenance of robust data pipelines and data architectures that support large-scale, enterprise data needs
Initiate and manage efforts to improve data quality, operational efficiency, and process scalability
Evaluate, pilot, and integrate new big data and analytics technologies, ensuring the organization remains at the cutting edge
Consult on, design, and implement governance, security, and compliance strategies tailored to modern cloud data ecosystems
Lead, coach, and develop teams of data engineers and architects, fostering technical growth and effective project delivery
Communicate technical concepts and business value to diverse stakeholders, including executives, business leads, and technology teams
Oversee the implementation of CI/CD practices with tools such as Azure DevOps, AWS Code Pipeline, Jenkins, TFS, or PowerShell for streamlined deployments and operations

Qualification

DatabricksCloud platforms AWSCloud platforms AzureCloud platforms GCPApache SparkData engineeringData warehousingLakehouse architectureCI/CD pipelinesData quality frameworksStakeholder managementPerformance optimizationTeam leadershipCommunication skills

Required

Bachelor's or Master's degree in Computer Science, Engineering, or a related field (Master's preferred)
5+ years of hands-on experience in data engineering with a strong focus on Databricks, deployed on any major cloud (AWS, Azure, GCP)
Minimum of 5 years Technical Proficiency: Expertise with cloud-native databases, storage solutions, and distributed compute platforms
Deep understanding of Lakehouse architecture, Apache Spark, Delta Lake, and related big data technologies
Advanced skills in data warehousing, 3NF, dimensional modeling, and enterprise-level data lakes
Experience with Databricks components including Delta Live Tables, Autoloader, Structured Streaming, Databricks Workflows, and orchestration tools (e.g., Apache Airflow)
Expertise in designing and supporting incremental data loads and building metadata-driven ingestion/data quality frameworks using PySpark
Hands-on experience with Databricks Unity Catalog and implementing fine-grained security and access control
Proven track record in deploying code and solutions via automated CI/CD pipelines
A minimum of 1 year experience leadership in managing complex, cross-functional data projects and technical teams
Experience with performance optimization of Data engineering pipelines, code, compute resources
Ability to travel up to 50%, on average, based on the work you do and the clients and industries/sectors you serve
Limited immigration sponsorship may be available

Preferred

Comprehensive knowledge of the AWS, Azure, and GCP cloud ecosystems and associated big data stacks is strongly preferred
Demonstrated skill in performance tuning and optimization within Databricks/Apache Spark environments
Stays current with the latest Databricks feature releases and platform enhancements
Exceptional communication and stakeholder management abilities, including comfort interfacing with executive leadership
Experience with Databricks Lakeflow is plus
Experience in AI/ML is plus

Benefits

Discretionary annual incentive program

Company

Deloitte

company-logo
Deloitte is a business consulting company that offers audit, consulting, financial advisory, and tax services.

H1B Sponsorship

Deloitte has a track record of offering H1B sponsorships. Please note that this does not guarantee sponsorship for this specific role. Below presents additional info for your reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (6871)
2024 (4911)
2023 (5604)
2022 (8090)
2021 (5993)
2020 (10388)

Funding

Current Stage
Late Stage

Leadership Team

leader-logo
Anne Muraya
Chief Executive Officer - East Africa
linkedin
leader-logo
Joe Ucuzoglu
Global Chief Executive Officer
linkedin
Company data provided by crunchbase