Golden Technology · 11 hours ago
Senior Databricks Engineer
United States
Contract
Remote
Senior Level
5+ years expGolden Technology is seeking a Senior Databricks Engineer with deep hands-on experience in designing and implementing large-scale data solutions on Azure Databricks. The role involves developing data pipelines, implementing automation tools, and managing data architecture solutions to ensure performance and governance.
Information TechnologySkill AssessmentStaffing Agency
Hiring Manager
Jitendra Rao
Responsibilities
Design, develop, and maintain data pipelines and ETL solutions in Azure Databricks using PySpark and Delta Lake
Implement data integration frameworks and API-based ingestion using tools like Apigee or Kong
Analyze, design, and deliver enterprise data architecture solutions focusing on scalability, performance, and governance
Implement automation tools and CI/CD pipelines using Jenkins, Ansible, or Terraform
Troubleshoot production failures and performance bottlenecks — fix partitioning, caching, shuffle, cluster sizing, and Z-ordering issues
Manage Unity Catalog, enforce data security (row/column-level access), and maintain data lineage
Administer Databricks clusters, jobs, and SQL warehouses, optimizing costs through auto-stop, job clusters, and Photon usage
Collaborate with cross-functional teams to drive data strategy and standards across domains
Create and maintain detailed architectural diagrams, interface specs, and data flow documentation
Mentor junior engineers on Databricks, Spark optimization, and Azure data best practices
Qualification
Required
5+ years of experience as a Data Engineer with strong hands-on experience in Azure Databricks and PySpark
Solid understanding of Delta Lake, Z-ordering, partitioning, OPTIMIZE, and ACID transactions
Company
Golden Technology
Golden Technology specializes in training, skill assessment, information technology staffing, project management, and consultancy services.
51-200 employees
H1B Sponsorship
Golden Technology has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2020 (1)
Funding
Current Stage
Growth StageLeadership Team
Chris Guin
Chief Financial Officer
Michael Bryan
Vice President of Sales
Recent News
2026-01-06
Company data provided by crunchbase