Amazon · 12 hours ago
Sr. Tech Product Manager - Neuron Runtime and Cloud ML Infrastructure, Annapurna Labs
Cupertino, California, USA
Full-time
Onsite
Senior Level
$174K/yr - $235K/yr
7+ years expAmazon's Annapurna Labs is responsible for building innovation in silicon and software for AWS customers. They are seeking a Technical Product Manager to drive the developer experience for running high-performance ML workloads at scale on AWS Trainium, focusing on product strategy, customer discovery, and technical leadership.
Artificial Intelligence (AI)DeliveryE-CommerceFoundational AIRetail
Responsibilities
Own product strategy and roadmap. Guide trade-offs between performance, scalability, and developer experience. Write PRFAQs and PRDs
Understand deployment challenges, orchestration needs, and infrastructure pain points. Represent customer needs in executive prioritization
Drive alignment across Neuron components (Runtime, Kernel Driver, Collective Communication, container infrastructure) and AWS services. Partner with training, inference, and performance PMs. Write user stories and define success metrics
Enable customers (Anthropic, Databricks, AWS teams) to deploy, monitor, and operate ML workloads at scale through container orchestration, resource management, health monitoring, and observability
Qualification
Required
Bachelor's degree or above in computer science, engineering, analytics, mathematics, statistics, IT or equivalent
7+ years of industry experience with at least 5+ years in Technical product management and 3+ years of software development
Experience with technical product management for developer-facing products
Experience with resource management and orchestration systems (such as SLURM and Kubernetes schedulers), including monitoring, observability, and resilience
Excellent written and verbal communication abilities
Preferred
Distributed computing and parallel processing, Collective communication libraries (NCCL, MPI) and communication patterns (all-reduce, all-gather, reduce-scatter)
Experience with Linux systems, kernel development, and device drivers
Deep learning model training and inference deployments at scale; Container orchestration (Kubernetes), computer architecture fundamentals
Developer tools (SDKs, libraries, APIs) with focus on developer experience
Track record of driving developer libraries, open standards, and ecosystem integration
High-performance networking technologies (RDMA, EFA)
Benefits
Health insurance (medical, dental, vision, prescription, Basic Life & AD&D insurance and option for Supplemental life plans, EAP, Mental Health Support, Medical Advice Line, Flexible Spending Accounts, Adoption and Surrogacy Reimbursement coverage)
401(k) matching
Paid time off
Parental leave
Company
Amazon
Amazon is a tech firm with a focus on e-commerce, cloud computing, digital streaming, and artificial intelligence.
10001+ employees
H1B Sponsorship
Amazon has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (22803)
2024 (21175)
2023 (19057)
2022 (24088)
2021 (12233)
2020 (14881)
Funding
Current Stage
Public CompanyTotal Funding
$8.11BKey Investors
AmazonKleiner Perkins
2023-01-03Post Ipo Debt· $8B
2001-07-24Post Ipo Equity· $100M
1997-05-15IPO
Leadership Team
Douglas J. Herrington
CEO, Worldwide Amazon Stores
Werner Vogels
VP & CTO
Recent News
TechRadar.com
2026-01-16
2026-01-16
Chicago Sun-Times - Business
2026-01-16
Company data provided by crunchbase