Sr. Tech Product Manager - Neuron Runtime and Cloud ML Infrastructure, Annapurna Labs jobs in United States
cer-icon
Apply on Employer Site
company-logo

Amazon Web Services (AWS) ยท 4 hours ago

Sr. Tech Product Manager - Neuron Runtime and Cloud ML Infrastructure, Annapurna Labs

Amazon Web Services (AWS) is the world's most comprehensive and broadly adopted cloud platform, and they are seeking a Sr. Tech Product Manager to drive the developer experience for running high-performance ML workloads at scale on AWS Trainium. The role involves owning product strategy, understanding customer deployment challenges, and enabling customers to operate ML workloads effectively through container orchestration and resource management.

Agentic AIConsultingDevOpsInformation TechnologySoftwareWeb Development
check
H1B Sponsor Likelynote

Responsibilities

Own product strategy and roadmap. Guide trade-offs between performance, scalability, and developer experience. Write PRFAQs and PRDs
Understand deployment challenges, orchestration needs, and infrastructure pain points. Represent customer needs in executive prioritization
Drive alignment across Neuron components (Runtime, Kernel Driver, Collective Communication, container infrastructure) and AWS services. Partner with training, inference, and performance PMs. Write user stories and define success metrics
Enable customers (Anthropic, Databricks, AWS teams) to deploy, monitor, and operate ML workloads at scale through container orchestration, resource management, health monitoring, and observability

Qualification

Technical product managementResource management systemsAWS cloud servicesDeveloper toolsDistributed systemsML monitoringLinux systemsHigh-performance computingCommunication

Required

Bachelor's degree or above in computer science, engineering, analytics, mathematics, statistics, IT or equivalent
7+ years of industry experience with at least 5+ years in Technical product management and 3+ years of software development
Experience with technical product management for developer-facing products
Experience with resource management and orchestration systems (such as SLURM and Kubernetes schedulers), including monitoring, observability, and resilience
Excellent written and verbal communication abilities

Preferred

Distributed computing and parallel processing, Collective communication libraries (NCCL, MPI) and communication patterns (all-reduce, all-gather, reduce-scatter)
Experience with Linux systems, kernel development, and device drivers
Deep learning model training and inference deployments at scale; Container orchestration (Kubernetes), computer architecture fundamentals
Developer tools (SDKs, libraries, APIs) with focus on developer experience
Track record of driving developer libraries, open standards, and ecosystem integration
High-performance networking technologies (RDMA, EFA)

Benefits

Health insurance (medical, dental, vision, prescription, Basic Life & AD&D insurance and option for Supplemental life plans, EAP, Mental Health Support, Medical Advice Line, Flexible Spending Accounts, Adoption and Surrogacy Reimbursement coverage)
401(k) matching
Paid time off
Parental leave

Company

Amazon Web Services (AWS)

company-logo
Launched in 2006, Amazon Web Services (AWS) began exposing key infrastructure services to businesses in the form of web services -- now widely known as cloud computing.

H1B Sponsorship

Amazon Web Services (AWS) has a track record of offering H1B sponsorships. Please note that this does not guarantee sponsorship for this specific role. Below presents additional info for your reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (22803)
2024 (21175)
2023 (19057)
2022 (24088)
2021 (12233)
2020 (14881)

Funding

Current Stage
Late Stage
Total Funding
unknown
Key Investors
BIRD Foundation
2025-01-22Grant

Leadership Team

leader-logo
Matt Garman
Chief Executive Officer
linkedin
leader-logo
Anand Desikan
CTO, CXO Advisor, and Enterprise Technologist
linkedin
Company data provided by crunchbase