Tata Consultancy Services · 2 weeks ago
Azure Databricks Engineer
Parsippany, NJ
Full-time
Onsite
Mid Level
$100K/yr - $140K/yrTata Consultancy Services is seeking a skilled Azure Databricks Engineer to design, develop, and manage end-to-end data pipelines on the Azure Cloud Platform. The role requires proficiency in Azure services and a strong background in SQL, ETL processes, and Python/PySpark for large-scale data processing.
Business Information SystemsConsultingInformation TechnologyIT Management
Responsibilities
Highly skilled Data Engineer with experience in designing, developing and managing end-to-end data pipelines on Azure Cloud Platform
Proficient in Azure Databricks & Unity Catalogs, Data Factory and ADLS, with a strong background in SQL, ETL process and Python/PySpark for large-scale data processing
Demonstrates solid understanding of Medallion Architecture for building scalable and maintainable data solutions
Experienced in Databricks workspace management and azure administration, including cluster configuration, access control
Strong collaborator who effectively translates business and customer requirements into technical solutions with minimal supervision
Qualification
Required
Azure Services: Azure Data Factory (ADF), Azure Databricks, Azure Data Lake Storage
Programming: Pyspark, SQL(Expert), Python
Data Engineering: ELT/ETL pipeline design, ingestion framework, orchestration
Architecture: Medallion Architecture, Delta Lake design
Monitoring & Troubleshooting: Performance tuning, data quality validation, pipeline/jobs failure analysis
Highly skilled Data Engineer with experience in designing, developing and managing end-to-end data pipelines on Azure Cloud Platform
Proficient in Azure Databricks & Unity Catalogs, Data Factory and ADLS, with a strong background in SQL, ETL process and Python/PySpark for large-scale data processing
Demonstrates solid understanding of Medallion Architecture for building scalable and maintainable data solutions
Experienced in Databricks workspace management and azure administration, including cluster configuration, access control
Strong collaborator who effectively translates business and customer requirements into technical solutions with minimal supervision
Preferred
Azure Administration
CI/CD & Devops: Integraton with Azure devOps for ADF pipeline development
Data Governance & Security: Knowledge of data lineage, RBAC
Good understanding of API, FTP/SFTP, Automation & Scripting
Benefits
Discretionary Annual Incentive.
Comprehensive Medical Coverage: Medical & Health, Dental & Vision, Disability Planning & Insurance, Pet Insurance Plans.
Family Support: Maternal & Parental Leaves.
Insurance Options: Auto & Home Insurance, Identity Theft Protection.
Convenience & Professional Growth: Commuter Benefits & Certification & Training Reimbursement.
Time Off: Vacation, Time Off, Sick Leave & Holidays.
Legal & Financial Assistance: Legal Assistance, 401K Plan, Performance Bonus, College Fund, Student Loan Refinancing.
Company
Tata Consultancy Services
Tata Consultancy Services is a business solutions company that specializes on information technology services and consulting.
Founded in 1968
10001+ employees
H1B Sponsorship
Tata Consultancy Services has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (7880)
2024 (9690)
2023 (8537)
2022 (11159)
2021 (9813)
2020 (11984)
Funding
Current Stage
Public CompanyTotal Funding
unknown2004-08-25IPO
Leadership Team
K. Krithivasan
Chief Executive Officer & Managing Director
Aarthi Subramanian
President and Chief Operating Officer
Recent News
Business Standard India
2026-01-09
Company data provided by crunchbase