Core BTS · 14 hours ago
Sr. Azure Data Engineer - Databricks
Core BTS offers custom talent solutions to help clients meet their evolving technology and business needs. The Senior Data Engineer will take ownership of the architecture and operational maturity of the Azure-based data platform, focusing on data ingestion, transformation, and stakeholder collaboration.
Cyber SecurityInformation TechnologySoftware
Responsibilities
Own the end-to-end architecture and infrastructure of the Azure-based data platform
Design and implement a modern lakehouse architecture to support analytics and reporting
Establish best practices for data engineering, reliability, and operational excellence
Design, build, and maintain API-driven and batch data pipelines
Ingest data from multiple source systems across acquired entities
Orchestrate workflows using Dagster
Ensure pipelines are scalable, resilient, and well-monitored
Transform raw, disparate data into clean, trusted, analytics-ready datasets
Model data for consumption in Power BI (PBI)
Partner with finance and business teams to align data structures with reporting needs
Own data platform operations, including monitoring, alerting, and incident response
Troubleshoot complex data and pipeline issues across ingestion, transformation, and reporting layers
Continuously improve performance, reliability, and cost efficiency
Work closely with the CFO and other senior stakeholders to understand reporting and analytics requirements
Translate business needs into technical solutions
Act as a trusted data engineering partner across the organization
Qualification
Required
Bachelor's degree in information systems, informatics, data science or a related field
5+ years of experience in data engineering, data platform engineering, or data operations
Strong experience in Microsoft Azure data services (greenfield experience strongly preferred)
Hands-on expertise with Python (including DLT and DBT)
Hands-on expertise with Azure DataBricks
Hands-on expertise with APIs, data pipelines, and ingestion frameworks
Hands-on expertise with workflow orchestration (Dagster or similar tools)
Experience building and operating Medallion Architected environments
Strong experience supporting Power BI or similar BI tools
Experience using GitHUB or similar version control tools
Excellent troubleshooting and problem-solving skills across data pipelines and platforms
Influence prioritization of work to minimize technical debt and maintain performance
Ability to work at a detailed level while maintaining the ‘big picture' of the overall business vision
Exceptional communication skills, with ability to interact with key business stakeholders in delivering critical reporting & other data insights
Preferred
Certifications including Microsoft Azure Data Engineer Associate, Databricks Certified Data Engineer, Python Institute Certifications (PCAP, PCPP) or DataCamp Certifications are highly desirable
Company
Core BTS
Core BTS is a customer-centric technology consulting organization dedicated to transforming IT experiences and delivering value to clients.
H1B Sponsorship
Core BTS has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (5)
2023 (1)
2022 (7)
2021 (5)
2020 (12)
Funding
Current Stage
Late StageTotal Funding
unknownKey Investors
Graycliff Partners
2021-11-09Acquired
2006-02-01Private Equity
Recent News
TV Technology
2025-10-31
2025-08-25
2025-04-17
Company data provided by crunchbase