Senior Databricks Engineer jobs in United States
cer-icon
Apply on Employer Site
company-logo

Tata Consultancy Services · 6 hours ago

Senior Databricks Engineer

positionCharlotte, NC
timeFull-time
remoteOnsite
senioritySenior Level, Lead/Staff
money$110K/yr - $140K/yr
date10+ years exp

Tata Consultancy Services is seeking a hands-on Sr. Databricks Data Engineer to design, develop, and optimize data pipelines and analytics solutions. The ideal candidate will have strong experience in data engineering, ETL development, and production support, ensuring reliable, scalable, and high-performing data operations within Azure environment.

Business Information SystemsConsultingInformation TechnologyIT Management
check
H1B Sponsor Likelynote

Responsibilities

Design, develop, and deploy scalable ETL/ELT data pipelines using Apache Spark, PySpark, and Databricks
Develop and optimize SQL queries for data transformation and analysis
Collaborate with product owners, data architects and analysts to build data models, delta lake structures, and data workflows
Collaborate with data analysts and business teams to deliver actionable insights
Build job orchestration and monitoring solutions
Ensure data quality, performance, and reliability across workflows
Develop and maintain CI/CD pipelines for Databricks notebooks, jobs, and workflows
Work with cloud-based data platforms (Azure preferred)
Provide L2/L3 support for Databricks production jobs, resolving incidents and performance issues
Monitor and troubleshoot Spark jobs, cluster performance, job failures, and resource utilization
Ensure data pipelines meet SLAs and data accuracy standards
Coordinate with infrastructure and DevOps teams to optimize cluster management and costs
Perform root cause analysis (RCA) and implement long-term fixes for recurring issues
Maintain documentation for production jobs, data flows, and incident management procedures

Qualification

DatabricksSparkSQLETL processesData modelingPerformance tuningPythonScalaProblem-solvingCommunication skills

Required

10+ years overall experience in data engineering or related fields
3–5 years hands-on experience with Databricks and Spark
Strong proficiency in SQL and data analysis techniques
Experience with ETL processes, data modeling, and performance tuning
Familiarity with Python or Scala for data engineering tasks
Excellent problem-solving and communication skills
BACHELOR OF COMPUTER SCIENCE

Preferred

Knowledge of insurance industry data
Experience with Power BI or other BI tools

Company

Tata Consultancy Services

twittertwittertwitter
Glassdoor3.8
company-logo
Tata Consultancy Services is a business solutions company that specializes on information technology services and consulting.
dateFounded in 1968
location
Mumbai, Maharashtra, IND
people-size10001+ employees
web-link
http://www.tcs.com

H1B Sponsorship

Tata Consultancy Services has a track record of offering H1B sponsorships. Please note that this does not guarantee sponsorship for this specific role. Below presents additional info for your reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (6564)
2024 (9690)
2023 (8537)
2022 (11159)
2021 (9813)
2020 (11984)

Funding

Current Stage
Public Company
Total Funding
unknown
2004-08-25IPO

Leadership Team

leader-logo
K. Krithivasan
Chief Executive Officer & Managing Director
linkedin
leader-logo
Aarthi Subramanian
President and Chief Operating Officer

Recent News

Calcutta Telegraph
Market valuation of seven of top-10 most valued Indian companies falls by Rs 35,439 crore
2025-12-29
Livemint.com
How Indian IT developed a taste for acquisitions this year
2025-12-29
IndiaTimes
TCS reboot on to become ready for AI-led future: COO Aarthi Subramanian
2025-12-29
Company data provided by crunchbase