Apply on Employer Site

Tomorrow · 1 month ago

Senior Data Engineer - Active TS/SCI with FSP

Chantilly, Virginia, United States

Full-time

Onsite

Senior Level

$180K/yr - $220K/yr

Tomorrow is seeking a highly skilled Senior Data Engineer to support the design, development, and optimization of mission-critical data engineering solutions for a federal program. The role involves extensive experience in the full data lifecycle, including data movement, ingestion, transformation, and modeling in both on-prem and cloud-based environments.

BankingFinanceFinancial ServicesPersonal Finance

No H1B

Security Clearance Required

U.S. Citizen Only

Responsibilities

Develop scalable tools, services, and code to execute complex data engineering tasks involving structured and unstructured data

Design, implement, and maintain robust ETL pipelines using technologies such as Spark, Apache NiFi, Apache Iceberg, and Trino

Ingest and transform data for enterprise-level storage and exploration, ensuring format standardization and compliance with mission objectives

Collaborate with data scientists and mission partners to understand source data and define transformations supporting operational outcomes

Clean, preprocess, and condition data to support downstream analytics, ensuring data quality, integrity, and lineage (pedigree/provenance)

Build services for one-time and recurring data extractions and conversions across local and enterprise repositories

Support cloud-based processing using AWS EMR and Kubernetes, and contribute to OpenSearch integrations

Produce comprehensive documentation including ETL mappings, code usage guidelines, and system access protocols

Coordinate with engineering teams and data stewards to integrate and operationalize new data processing platforms

Participate in Agile development processes and data governance working groups to enhance enterprise data standards and practices

Qualification

ETL pipelinesApache SparkAWS EMRApache NiFiApache IcebergTrinoData modelingData qualityData governanceAgile developmentData transformationData ingestionData preprocessing

Required

TS/SCI with Full Scope Polygraph (FSP) clearance required

Extensive experience in the full data lifecycle, including data movement, ingestion, transformation, and modeling in both on-prem and cloud-based environments

Strong command of ETL pipelines, data formatting tools, and modern data engineering frameworks

Experience developing scalable tools, services, and code to execute complex data engineering tasks involving structured and unstructured data

Experience designing, implementing, and maintaining robust ETL pipelines using technologies such as Spark, Apache NiFi, Apache Iceberg, and Trino

Experience ingesting and transforming data for enterprise-level storage and exploration, ensuring format standardization and compliance with mission objectives

Ability to collaborate with data scientists and mission partners to understand source data and define transformations supporting operational outcomes

Experience cleaning, preprocessing, and conditioning data to support downstream analytics, ensuring data quality, integrity, and lineage (pedigree/provenance)

Experience building services for one-time and recurring data extractions and conversions across local and enterprise repositories

Experience supporting cloud-based processing using AWS EMR and Kubernetes, and contributing to OpenSearch integrations

Ability to produce comprehensive documentation including ETL mappings, code usage guidelines, and system access protocols

Ability to coordinate with engineering teams and data stewards to integrate and operationalize new data processing platforms

Participation in Agile development processes and data governance working groups to enhance enterprise data standards and practices