Machinify · 18 hours ago
Sr. Data Engineer | Analytics
United States
Full-time
Remote
Mid, Senior Level
4+ years expMachinify is a leading healthcare intelligence company with expertise across the payment continuum, delivering unmatched value, transparency, and efficiency to health plan clients across the country. As a Data Engineer, you’ll be responsible for transforming raw external data into trusted datasets that drive payment, product, and operational decisions, while collaborating with various teams to build and refine production pipelines.
AnalyticsArtificial Intelligence (AI)Business IntelligenceMachine LearningPredictive AnalyticsSaaS
Responsibilities
Design and implement robust, production-grade pipelines using Python, Spark SQL, and Airflow to process high-volume file-based datasets (CSV, Parquet, JSON)
Lead efforts to canonicalize raw healthcare data (837 claims, EHR, partner data, flat files) into internal models
Own the full lifecycle of core pipelines — from file ingestion to validated, queryable datasets — ensuring high reliability and performance
Onboard new customers by integrating their raw data into internal pipelines and canonical models; collaborate with SMEs, Account Managers, and Product to ensure successful implementation and troubleshooting
Build resilient, idempotent transformation logic with data quality checks, validation layers, and observability
Refactor and scale existing pipelines to meet growing data and business needs
Tune Spark jobs and optimize distributed processing performance
Implement schema enforcement and versioning aligned with internal data standards
Collaborate deeply with Data Analysts, Data Scientists, Product Managers, Engineering, Platform, SMEs, and AMs to ensure pipelines meet evolving business needs
Monitor pipeline health, participate in on-call rotations, and proactively debug and resolve production data flow issues
Contribute to the evolution of our data platform — driving toward mature patterns in observability, testing, and automation
Build and enhance streaming pipelines (Kafka, SQS, or similar) where needed to support near-real-time data needs
Help develop and champion internal best practices around pipeline development and data modeling
Qualification
Required
4+ years of experience as a Data Engineer (or equivalent), building production-grade pipelines
Strong expertise in Python, Spark SQL, and Airflow
Experience processing large-scale file-based datasets (CSV, Parquet, JSON, etc) in production environments
Experience mapping and standardizing raw external data into canonical models
Familiarity with AWS (or any cloud), including file storage and distributed compute concepts
Experience onboarding new customers and integrating external customer data with non-standard formats
Ability to work across teams, manage priorities, and own complex data workflows with minimal supervision
Strong written and verbal communication skills — able to explain technical concepts to non-engineering partners
Comfortable designing pipelines from scratch and improving existing pipelines
Experience working with large-scale or messy datasets (healthcare, financial, logs, etc.)
Experience building or willingness to learn streaming pipelines using tools such as Kafka or SQS
Preferred
Familiarity with healthcare data (837, 835, EHR, UB04, claims normalization)
Company
Machinify
Machinify is a SaaS platform that enables non-technical enterprises to build AI-powered products and processes.
1001-5000 employees
H1B Sponsorship
Machinify has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (12)
2024 (6)
2023 (3)
2022 (3)
2021 (4)
2020 (5)
Funding
Current Stage
Late StageTotal Funding
$12.79MKey Investors
Battery Ventures
2025-01-10Acquired
2018-10-08Series A· $10M
2016-03-15Seed· $2.79M
Leadership Team
Edward Lichty
Strategic Operations
Prasanna Ganesan
EVP & Chief Product Officer
Recent News
2025-12-19
Dallas Morning News
2025-10-24
globallegalchronicle.com
2025-10-24
Company data provided by crunchbase