Amazon Web Services (AWS) · 1 day ago
Sr. Product Manager - Runtime Infra, AI/ML, Annapurna Labs
Cupertino, CA
Full-time
Onsite
Senior Level, Lead/Staff
$136K/yr - $235K/yr
10+ years expAmazon Web Services (AWS) is seeking a Technical Product Manager for AWS Neuron, the software stack for running deep learning and generative AI workloads on AWS Trainium. The role involves driving product strategy and enhancing the developer experience for high-performance ML workloads, while collaborating with various teams to ensure optimal performance and efficiency in AI training and inference workloads.
ConsultingDevOpsInformation TechnologySoftwareWeb Development
Responsibilities
Own product strategy and roadmap. Guide trade-offs between performance, scalability, and developer experience. Write PRFAQs and PRDs
Understand deployment challenges, orchestration needs, and infrastructure pain points. Represent customer needs in executive prioritization
Drive alignment across Neuron components (Runtime, Kernel Driver, Collective Communication, container infrastructure) and AWS services. Partner with training, inference, and performance PMs. Write user stories and define success metrics
Enable customers (Anthropic, Databricks, AWS teams) to deploy, monitor, and operate ML workloads at scale through container orchestration, resource management, health monitoring, and observability
Qualification
Required
Bachelor's degree in computer science, engineering, analytics, mathematics, statistics, IT or equivalent
10+ years of industry experience with at least 5+ years in Technical product management and 3+ years of software development
Solid knowledge in container orchestration and Kubernetes
Solid knowledge in computer architecture fundamentals and operating systems concepts
Excellent written and verbal communication abilities
Preferred
Experience with Linux systems and kernel development
Track record of driving developer libraries
Experience with Machine Learning accelerators
Experience with concepts such as performance optimization, profiling and tooling
Experience with Deep Learning model training or inference
Experience with distributed computing and parallel processing
Hands on experience with major ML framework: JAX or PyTorch
Familiarity with AWS services and cloud infrastructure engineering
Track record of driving open standards and ecosystem integration
Benefits
Equity
Sign-on payments
Full range of medical, financial, and/or other benefits
Company
Amazon Web Services (AWS)
Launched in 2006, Amazon Web Services (AWS) began exposing key infrastructure services to businesses in the form of web services -- now widely known as cloud computing.
10001+ employees
H1B Sponsorship
Amazon Web Services (AWS) has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (22803)
2024 (21175)
2023 (19057)
2022 (24088)
2021 (12233)
2020 (14881)
Funding
Current Stage
Late StageTotal Funding
unknownKey Investors
BIRD Foundation
2025-01-22Grant
Leadership Team
Matt Garman
Chief Executive Officer
Anand Desikan
CTO, CXO Advisor, and Enterprise Technologist
Recent News
2026-01-03
2026-01-03
2025-12-31
Company data provided by crunchbase