Apply on Employer Site

Greylock Partners · 6 hours ago

Machine Learning Infrastructure Engineer

San Francisco, CA

Full-time

Onsite

Mid, Senior Level

3+ years exp

Greylock Partners is an early-stage investor in numerous successful companies, and they are seeking a Machine Learning Infrastructure Engineer to join one of their consumer AI investments. The role involves building and operating large-scale ML infrastructure for training and inference, while ensuring reliability, performance, and efficiency across the stack.

FinanceFinancial ServicesVenture Capital

H1B Sponsor Likely

Responsibilities

Build and operate large-scale ML infrastructure for training and inference (GPU compute, orchestration, model serving)

Own core systems for data and feature pipelines, model artifacts, experiment tracking, and evaluation

Improve observability and reliability across ML and production systems (monitoring, debugging, incident response, SLAs)

Drive efficiency across the stack (latency, throughput, cost, capacity planning)

Partner closely with researchers/ML engineers/product engineers to unblock shipping

Qualification

ML infrastructureGPU computeKubernetesPythonPyTorchTensorFlowDistributed systemsProduction reliabilityCoding fundamentalsStartup experience

Required

3+ years building large-scale distributed systems infrastructure

2+ years building modern ML systems in industry: ML training and inference systems, large-scale distributed infrastructure, GPU-backed compute, Kubernetes and cloud infrastructure, production reliability

Python + a systems language

PyTorch or TensorFlow

BSCS or equivalent

Strong coding and systems fundamentals (production-grade engineering, not just prototypes)

Owned production ML training and/or serving infrastructure end-to-end (not just model development)

Enjoyed ambiguity while moving quickly with a small team, and you like building 'the system' as much as 'the model'

Preferred

MSCS preferred

Prior startup experience desired

Experience with distributed compute and data systems (scheduler/orchestration, storage, streaming/batch, reliability)

Comfort operating systems in production: on-call mindset, instrumentation, performance tuning, cost discipline

Built internal platforms that improved ML developer velocity (reusable pipelines, tooling, paved roads)

Benefits

Free candidate referrals/introductions to our active investments to help them grow/succeed

Company

Greylock Partners

We are the first partner for founders. Over 80% of our investments are the first check: Pre-Seed, Seed, or Series A. Many start on a whiteboard.

Founded in 1965

Menlo Park, California, USA

51-200 employees

https://www.greylock.com

H1B Sponsorship

Greylock Partners has a track record of offering H1B sponsorships. Please note that this does not guarantee sponsorship for this specific role. Below presents additional info for your reference. (Data Powered by US Department of Labor)

Distribution of Different Job Fields Receiving Sponsorship

Represents job field similar to this job

Trends of Total Sponsorships

2023 (2)

2020 (1)