Software Engineer-AI/ML, AWS Neuron Inference jobs in United States
cer-icon
Apply on Employer Site
company-logo

Amazon · 4 months ago

Software Engineer-AI/ML, AWS Neuron Inference

positionSeattle, Washington, USA
timeFull-time
remoteOnsite
seniorityMid, Senior Level
money$129K/yr - $224K/yr
date3+ years exp

Amazon is seeking a Senior Software Engineer for the AWS Neuron Inference team, which focuses on machine learning inference applications. The role involves developing and optimizing core components for large language model inference, working closely with various engineering teams to enhance performance on Neuron devices.

Artificial Intelligence (AI)DeliveryE-CommerceFoundational AIRetail
check
H1B Sponsor Likelynote

Responsibilities

Adapting latest research in LLM optimization to Neuron chips to extract best performance from both open source as well as internally developed models
Working across teams and organizations is key

Qualification

Machine learning modelsSoftware development experienceDesign patternsPyTorchJaxAI acceleration hardwareCode reviewsSource control managementBuild processesTesting

Required

3+ years of non-internship professional software development experience
2+ years of non-internship design or architecture (design patterns, reliability and scaling) of new and existing systems experience
Experience programming with at least one software programming language
Fundamentals of Machine learning models, their architecture, training and inference lifecycles along with work experience on some optimizations for improving the model performance

Preferred

3+ years of full software development life cycle, including coding standards, code reviews, source control management, build processes, testing, and operations experience
Bachelor's degree in computer science or equivalent
Hands-on experience with PyTorch or Jax - preferably involving developing and deploying LLMs in production on GPUs, Neuron, TPU or other AI acceleration hardware

Benefits

Equity
Sign-on payments
Medical
Financial
Other benefits

Company

Amazon

twittertwittertwitter
Glassdoor3.7
company-logo
Amazon is a tech firm with a focus on e-commerce, cloud computing, digital streaming, and artificial intelligence.
dateFounded in 1994
location
Seattle, Washington, USA
people-size10001+ employees
web-link
https://amazon.com

H1B Sponsorship

Amazon has a track record of offering H1B sponsorships. Please note that this does not guarantee sponsorship for this specific role. Below presents additional info for your reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (22803)
2024 (21175)
2023 (19057)
2022 (24088)
2021 (12233)
2020 (14881)

Funding

Current Stage
Public Company
Total Funding
$8.11B
Key Investors
AmazonKleiner Perkins
2023-01-03Post Ipo Debt· $8B
2001-07-24Post Ipo Equity· $100M
1997-05-15IPO

Leadership Team

leader-logo
Douglas J. Herrington
CEO, Worldwide Amazon Stores
linkedin
leader-logo
Werner Vogels
VP & CTO
linkedin

Recent News

The Motley Fool
2 Dominant Tech Stocks to Buy in January and Hold for 5 Years
2026-01-12
The Motley Fool
2 Reasons to Buy Amazon Stock in 2026
2026-01-12
PCMag.com - Technology Product Reviews, News, Prices & Tips
Amazon Plans New Big Box Store in Chicago Suburbs
2026-01-12
Company data provided by crunchbase