Rapid Eagle Inc · 1 day ago
Healthcare Data Engineer
United States
Full-time
Remote
Senior Level, Lead/Staff
$55/hr - $80/hr
8+ years expRapideagle is seeking a Healthcare Data Engineer to lead the migration of AWS-hosted PostgreSQL workloads to Databricks Lakehouse architecture. The role involves designing scalable ETL/ELT pipelines and ensuring HIPAA-compliant data handling while collaborating with data teams.
ConsultingE-CommerceInformation TechnologyProject ManagementSoftware
Responsibilities
Lead the migration of AWS-hosted PostgreSQL workloads to Databricks Lakehouse architecture
Design and implement scalable ETL/ELT pipelines using Databricks (PySpark, SQL, Delta Lake) in AWS ecosystem
Work with complex healthcare data formats, including X12 837 claims, EBCDIC files, and other structured/unstructured formats
Implement data masking, profiling, and governance solutions to ensure HIPAA-compliant data handling across ingestion, transformation, and consumption layers
Optimize data pipelines for performance, reliability, and cost-efficiency within the AWS ecosystem
Collaborate with data architects, analysts, and compliance teams to enforce data security best practices
Drive data quality monitoring and reconciliation processes in high-volume, sensitive data environments
Qualification
Required
8+ years of hands-on data engineering experience with strong focus on AWS + Databricks environments
Proven track record of migrating PostgreSQL workloads from AWS to modern lakehouse platforms
Databricks Certified Data Engineer (Associate or Professional)
Experience with healthcare data and regulatory formats including X12 837, HL7, EBCDIC files, etc
Deep expertise in data masking, governance frameworks, and working in HIPAA-regulated environments
Familiarity and working knowledge in adhering to CI/CD processes and practices in a cloud ecosystem
Proficiency in PySpark, SQL, Delta Lake, and data transformation in Databricks
Solid understanding of data ingestion from AWS (S3, Glue, Lambda) into Databricks
Preferred
Familiarity with FHIR, X12 837, HL7, or other clinical data standards
Experience with Unity Catalog and Lakehouse governance frameworks
Knowledge of Agile methodologies and CI/CD practices for data pipelines
This role is healthcare domain-focused, and prior experience working with payers, providers, or healthcare clearinghouses is highly desirable
Benefits
Flexible schedule
Health insurance
Tuition reimbursement
Vision insurance
Company
Rapid Eagle Inc
Rapid Eagle Inc. is one of the premier IT Staffing and Development company with its Head Office in Fremont, CA, USA.
11-50 employees
H1B Sponsorship
Rapid Eagle Inc has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (3)
2024 (6)
2023 (4)
2022 (5)
2021 (4)
2020 (1)
Funding
Current Stage
Early StageCompany data provided by crunchbase