Principal Software Engineer, TensorRT-LLM jobs in United States
cer-icon
Apply on Employer Site
company-logo

NVIDIA · 4 hours ago

Principal Software Engineer, TensorRT-LLM

positionUnited States
timeFull-time
remoteRemote
seniorityLead/Staff
money$272K/yr - $431K/yr
date15+ years exp

NVIDIA is hiring experienced principal software engineers for its TensorRT-LLM team. The role involves architecting and guiding the development of robust inferencing software for AI applications, while collaborating across the company to influence the direction of AI Inferencing.

AI InfrastructureArtificial Intelligence (AI)Consumer ElectronicsFoundational AIGPUHardwareSoftwareVirtual Reality
check
Growth Opportunities
check
H1B Sponsor Likelynote
Hiring Manager
Khai N.
linkedin

Responsibilities

Architecting and guiding development of robust inferencing software that can be scaled to multiple platforms for functionality and performance
Performance analysis, optimization and tuning
Closely follow developments in the field of artificial intelligence, and evolve the code design to keep pace
Collaborate across the company to guide the direction of AI Inferencing, working with software, research and product teams

Qualification

PythonC/C++GenAI servingLLM inference frameworksDeep learning frameworksSoftware designPerformance analysisDebuggingTest designCommunication skills

Required

Bachelors, Masters or higher degree in Computer Engineering, Computer Science, Applied Mathematics or related computing focused degree (or equivalent experience)
15+ years of relevant software development experience and 2+ years in an architect/tech lead role
Excellent Python or C/C++ programming and software design skills, including debugging, performance analysis, and test design
Strong understanding of GenAI serving, awareness of the latest developments in deep learning like LLMs
Experience working with LLM inference frameworks like vLLM, SGLang, etc
Experience working with deep learning frameworks like PyTorch, JAX, etc
Excellent written and oral communication skills in English

Preferred

A track record of leading complex software architecture and successful products is highly desired
The ability to work on a fast-paced delivery-focused team is required and excellent interpersonal skills are a must

Benefits

Equity
Benefits

Company

NVIDIA

twittertwittertwitter
Glassdoor4.6
company-logo
NVIDIA is a computing platform company operating at the intersection of graphics, HPC, and AI.
dateFounded in 1993
location
Santa Clara, California, USA
people-size10001+ employees
web-link
https://www.nvidia.com

H1B Sponsorship

NVIDIA has a track record of offering H1B sponsorships. Please note that this does not guarantee sponsorship for this specific role. Below presents additional info for your reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (1877)
2024 (1355)
2023 (976)
2022 (835)
2021 (601)
2020 (529)

Funding

Current Stage
Public Company
Total Funding
$4.09B
Key Investors
ARPA-EARK Investment ManagementSoftBank Vision Fund
2023-05-09Grant· $5M
2022-08-09Post Ipo Equity· $65M
2021-02-18Post Ipo Equity

Leadership Team

leader-logo
Jensen Huang
Founder and CEO
linkedin
leader-logo
Michael Kagan
Chief Technology Officer
linkedin

Recent News

Tech Times
CES 2026 Gaming Gear: Best Monitors, Laptops & Accessories
2026-01-17
The Orlando Sentinel
Stocks waver on Wall Street and remain near records
2026-01-17
Geeky Gadgets
Inside NVIDIA Rubin : Six-Chip AI System Built to Cut Power and Spend
2026-01-17
Company data provided by crunchbase