RX2 Solutions · 1 month ago
Databricks Data Engineering Consultant
RX2 Solutions is seeking a Databricks Data Engineering Consultant to support a short-term data platform modernization initiative. The role involves migrating analytical data from Azure Synapse into Databricks and optimizing data structures to enhance reporting and analytics capabilities.
ConsultingHuman ResourcesRecruitingStaffing Agency
Responsibilities
Transfer data tables from Azure Synapse into Databricks using PySpark-based notebooks and pipelines
Deploy solutions into production environments and provide documentation and knowledge sharing for ongoing support
Design and optimize Unity Catalog structures to support reporting and analytics access patterns
Relocate business and transformation logic from Power BI into Databricks to improve scalability and maintainability
Verify migrated data to ensure accuracy, completeness, and alignment with source systems
Implement and support API-enabled writeback processes from Power BI into Databricks
Qualification
Required
Strong hands-on experience with Databricks data engineering using PySpark
Solid understanding of Power BI data models and backend integrations
Direct experience implementing and managing Unity Catalog
Background in building, maintaining, and optimizing data transformation pipelines
Preferred
Exposure to near real-time or operational data sources (e.g., ERP or similar systems) is a plus
Prior experience migrating workloads from Azure Synapse to Databricks is preferred