Amazon Web Services (AWS) · 12 hours ago
Sr. Tech Product Manager - Neuron Runtime and Cloud ML Infrastructure, Annapurna Labs
Amazon Web Services (AWS) is the world's most comprehensive and broadly adopted cloud platform, and they are seeking a Sr. Tech Product Manager to drive the developer experience for running high-performance ML workloads at scale on AWS Trainium. The role involves owning product strategy, understanding customer deployment challenges, and enabling customers to operate ML workloads effectively through container orchestration and resource management.
Agentic AIConsultingDevOpsInformation TechnologySoftwareWeb Development
Responsibilities
Own product strategy and roadmap. Guide trade-offs between performance, scalability, and developer experience. Write PRFAQs and PRDs
Understand deployment challenges, orchestration needs, and infrastructure pain points. Represent customer needs in executive prioritization
Drive alignment across Neuron components (Runtime, Kernel Driver, Collective Communication, container infrastructure) and AWS services. Partner with training, inference, and performance PMs. Write user stories and define success metrics
Enable customers (Anthropic, Databricks, AWS teams) to deploy, monitor, and operate ML workloads at scale through container orchestration, resource management, health monitoring, and observability
Qualification
Required
Bachelor's degree or above in computer science, engineering, analytics, mathematics, statistics, IT or equivalent
7+ years of industry experience with at least 5+ years in Technical product management and 3+ years of software development
Experience with technical product management for developer-facing products
Experience with resource management and orchestration systems (such as SLURM and Kubernetes schedulers), including monitoring, observability, and resilience
Excellent written and verbal communication abilities
Preferred
Distributed computing and parallel processing, Collective communication libraries (NCCL, MPI) and communication patterns (all-reduce, all-gather, reduce-scatter)
Experience with Linux systems, kernel development, and device drivers
Deep learning model training and inference deployments at scale; Container orchestration (Kubernetes), computer architecture fundamentals
Developer tools (SDKs, libraries, APIs) with focus on developer experience
Track record of driving developer libraries, open standards, and ecosystem integration
High-performance networking technologies (RDMA, EFA)
Benefits
Health insurance (medical, dental, vision, prescription, Basic Life & AD&D insurance and option for Supplemental life plans, EAP, Mental Health Support, Medical Advice Line, Flexible Spending Accounts, Adoption and Surrogacy Reimbursement coverage)
401(k) matching
Paid time off
Parental leave
Company
Amazon Web Services (AWS)
Launched in 2006, Amazon Web Services (AWS) began exposing key infrastructure services to businesses in the form of web services -- now widely known as cloud computing.
H1B Sponsorship
Amazon Web Services (AWS) has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (22803)
2024 (21175)
2023 (19057)
2022 (24088)
2021 (12233)
2020 (14881)
Funding
Current Stage
Late StageTotal Funding
unknownKey Investors
BIRD Foundation
2025-01-22Grant
Leadership Team
Recent News
Business Archives - MobileSyrup
2026-01-17
2026-01-17
Company data provided by crunchbase