Senior/Lead Data Engineer jobs in United States
cer-icon
Apply on Employer Site
company-logo

Delta System & Software, Inc. · 6 days ago

Senior/Lead Data Engineer

positionAlpharetta, GA
timeFull-time
remoteHybrid
senioritySenior Level, Lead/Staff
date8+ years exp

Delta System & Software, Inc. is seeking a Senior/Lead Data Engineer to join their team. The role involves designing and implementing data solutions using Azure services and Apache Spark, while collaborating with cross-functional teams to optimize data pipelines and architecture.

CRMInformation TechnologyRoboticsSoftware
badNo H1Bnote
Hiring Manager
Avinash Pathak
linkedin

Responsibilities

8+ years of hands-on data engineering experience in enterprise environments
Strong expertise in Azure services, especially Azure Databricks, Functions, and Azure Data Factory (preferred)
Advanced proficiency in Apache Spark with Python (PySpark)
Strong command over SQL, query optimization, and performance tuning
Deep understanding of ETL/ELT methodologies, data pipelines, and scheduling/orchestration
Hands-on experience with Delta Lake (ACID transactions, optimization, schema evolution)
Strong experience in data modelling (normalized, dimensional, lakehouse modelling)
Experience in both batch processing and real-time/streaming data (Kafka, Event Hub, or similar)
Solid understanding of data architecture principles, distributed systems, and cloud-native design patterns
Ability to design end-to-end solutions, evaluate trade-offs, and recommend best-fit architectures
Strong analytical, problem-solving, and communication skills
Ability to collaborate with cross-functional teams and lead technical discussions

Qualification

Azure servicesApache SparkSQLETL/ELT methodologiesDelta LakeData modellingBatch processingData architecture principlesCI/CD toolsIaC toolsData governance toolsMachine learning supportAnalytical skillsProblem-solving skillsCommunication skillsCollaboration skills

Required

8+ years of hands-on data engineering experience in enterprise environments
Strong expertise in Azure services, especially Azure Databricks, Functions, and Azure Data Factory
Advanced proficiency in Apache Spark with Python (PySpark)
Strong command over SQL, query optimization, and performance tuning
Deep understanding of ETL/ELT methodologies, data pipelines, and scheduling/orchestration
Hands-on experience with Delta Lake (ACID transactions, optimization, schema evolution)
Strong experience in data modelling (normalized, dimensional, lakehouse modelling)
Experience in both batch processing and real-time/streaming data (Kafka, Event Hub, or similar)
Solid understanding of data architecture principles, distributed systems, and cloud-native design patterns
Ability to design end-to-end solutions, evaluate trade-offs, and recommend best-fit architectures
Strong analytical, problem-solving, and communication skills
Ability to collaborate with cross-functional teams and lead technical discussions

Preferred

Experience with CI/CD tools such as Azure DevOps and Git
Familiarity with IaC tools (Terraform, ARM)
Exposure to data governance and cataloging tools (Azure Purview)
Experience supporting machine learning or BI workloads on Databricks

Company

Delta System & Software, Inc.

twittertwittertwitter
company-logo
Delta System & Software is an information technology company offering SAP, ERP, and, e-business solutions.
dateFounded in 2006
location
Mckinney, Texas, USA
people-size51-200 employees
web-link
http://deltassi.com

Funding

Current Stage
Growth Stage

Leadership Team

leader-logo
Pawan Sharma
Founder & CEO (Sr. SAP- FICO S4 HANA Solution Architect)
linkedin
Company data provided by crunchbase