Apply on Employer Site

Core Specialty Insurance Holdings, Inc. · 9 hours ago

Director Data Engineering - QA Automation

Houston, TX

Full-time

Onsite

Director/Executive

$150K/yr - $180K/yr

15+ years exp

Core Specialty Insurance Holdings, Inc. is seeking a Director of Data Engineering - QA Automation to lead the QA automation strategy for their extensive data environment. This role involves designing and implementing scalable automation frameworks, collaborating with various teams, and mentoring a high-performing QA team to ensure data quality and integrity.

InsuranceMarine Transportation

No H1B

Responsibilities

Define and lead the QA automation strategy for data engineering, analytics, and machine learning initiatives

Architect and implement scalable, reusable automation frameworks for data pipelines, ingestion models, semantic layers, and ML workflows

Collaborate with Data Engineering, Data Science, and DevOps teams to integrate automated testing into CI/CD pipelines

Establish coding standards, architectural patterns, and best practices for test automation across the organization

Develop automated validation for data quality, schema enforcement, lineage tracking, and model performance

Mentor and grow a high-performing QA team with deep domain knowledge in data and analytics

Drive continuous improvement in testing tools, processes, and observability

In addition to the above key responsibilities, you may be required to undertake other duties from time to time as the Company may reasonably require

Qualification

PythonData EngineeringQA AutomationCloud PlatformsAutomation FrameworksCI/CD & DevOpsData Quality ManagementLeadershipCommunicationCollaboration

Required

Bachelor's degree in computer science, data engineering, or related field required

Minimum of 15 years of experience in Data Engineering (hands-on roles)

Minimum of 5 years of experience in a leadership position

Prior QA and automation experience within data engineering space required

Proven experience in testing large-scale data systems and ML workflows

Strong architectural thinking and ability to define scalable testing patterns

Excellent leadership, communication, and cross-functional collaboration skills

Programming Languages: Python (preferred), SQL, Java/Scala (for Spark-based pipelines)

Automation Frameworks: PyTest, Great Expectations, dbt tests, Selenium, Airflow test suites

Data Technologies: Spark, Kafka, Airflow, dbt, Delta Lake, Parquet, Avro

Cloud Platforms: AWS (Glue, S3, Redshift), Azure, GCP (BigQuery, Dataflow), Databricks

Data Warehouses: Snowflake, BigQuery, Redshift

CI/CD & DevOps: GitHub Actions, Jenkins, Docker, Kubernetes

ML Testing: MLflow, TensorFlow Model Analysis, custom validation pipelines

Observability & Monitoring: Monte Carlo, Databand, OpenLineage

SDLC: Agile/SCRUM Frameworks, Kanban, JIRA

Data Quality Management: MS Purview

Preferred

Experience with synthetic data generation and data fuzzing tools

Experience with Data Contracts and the Producer vs. Consumer model

Familiarity with data governance and compliance frameworks (e.g., GDPR, HIPAA)

Exposure to AI-assisted testing platforms

Benefits

Medical, dental, vision, and life insurances

Short and long-term disability

A Company-match of 100% of a 6% contribution 401(k) plan

An Employee Assistance Plan

Health Savings Account

Flexible Spending Account

Health Reimbursement Account

Wellness program

Company

Core Specialty Insurance Holdings, Inc.

Core Specialty, through its subsidiary insurers, offers a diversified range of property, casualty, and marine insurance products for small to mid-sized businesses.

Founded in 2020

Jersey City, New Jersey, USA

1001-5000 employees