Lead Data Infrastructure Engineer jobs in United States
cer-icon
Apply on Employer Site
company-logo

Gridmatic · 3 weeks ago

Lead Data Infrastructure Engineer

Gridmatic is a startup focused on decarbonizing the grid through deep learning for energy price forecasting. The Lead Data Infrastructure Engineer will be responsible for scaling and improving the reliability of the data infrastructure that supports the company's machine learning initiatives.

Artificial Intelligence (AI)Clean EnergyEnergy
check
H1B Sponsor Likelynote

Responsibilities

Owning and scaling our data infrastructure by several orders of magnitude. This includes our data pipelines, distributed data processing, and data storage
Building a unified feature store for all our ML models
Efficient storing and loading hundreds of terabytes of weather data for use in AI-based weather models
Processing and storing predictions and evaluation metrics for large-scale forecasting models

Qualification

Data processing pipelinesLarge-scale data storageDistributed systemsSoftware engineeringPythonKubernetesTerraformApache KafkaApache FlinkApache BeamGCPDebuggingData versioningPoint-in-time correctnessEvolving schemasFlyteAirflowTemporalReact/NextJSPostgresBigQueryObservability

Required

Experience building the infrastructure for large-scale data processing pipelines (both batch and streaming) using tools like Spark, Kafka, Apache Flink, and Apache Beam
Experience designing and implementing large-scale data storage systems (feature store, timeseries DBs) for ML use cases
Strong familiarity with relational databases, data warehouses, object storage, timeseries data, and being adept at DB schema design
Experience building data pipelines for external data sources that are observable, debuggable, and verifiably correct
Have dealt with challenges like data versioning, point-in-time correctness, and evolving schemas
Strong distributed systems and infrastructure skills
Comfortable scaling and debugging Kubernetes services, writing Terraform, and working with orchestration tools like Flyte, Airflow, or Temporal
Strong software engineering skills
Being able to write easy-to-extend and well-tested code
4+ years of experience building data infrastructure or data platforms
Experience with ML infrastructure and have worked at companies that use ML for core business functions
You're comfortable with ambiguity and a fast-moving environment, and have a bias for action
You learn and pick up new skills quickly
You're motivated in making a real-world impact on climate and energy

Benefits

Continuing Education Opportunities
Flexible PTO
Medical, Dental and Vision plans with competitive employer contributions
Pre-Tax commuter benefits
$1500/year non profit donation matching program through Millie
Home Office Stipend
401K contribution match up to 4%
Company-paid parental leave
Company Paid Life Insurance
Stock Option Loan Program

Company

Gridmatic

twittertwitter
company-logo
Gridmatic is an AI-enabled power marketer that accelerates the ascent of clean energy.

H1B Sponsorship

Gridmatic has a track record of offering H1B sponsorships. Please note that this does not guarantee sponsorship for this specific role. Below presents additional info for your reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (1)
2024 (1)

Funding

Current Stage
Growth Stage
Total Funding
$46M
2023-01-01Undisclosed· $40M
2021-08-01Undisclosed· $6M

Leadership Team

leader-logo
Matt Wytock
Founder
linkedin
Company data provided by crunchbase