NVIDIA · 15 hours ago
Senior System Software Engineer – Dynamo Tools
Santa Clara, CA
Full-time
Onsite
Senior Level, Lead/Staff
$184K/yr - $288K/yr
8+ years expNVIDIA is seeking a Senior System Software Engineer to own and advance the AI-Perf analysis framework for benchmarking and analysis of LLMs and deep learning workloads. The role involves leading the design and development of performance tooling while collaborating with researchers and engineers to enhance performance evaluation.
AI InfrastructureArtificial Intelligence (AI)Consumer ElectronicsFoundational AIGPUHardwareSoftwareVirtual Reality
Responsibilities
Lead the design, development, and roadmap of AI-Perf, defining benchmarking methodologies, performance metrics, and reproducible experimental workflows
Build scalable and high-performance features to measure latency, throughput, and efficiency across AI models and distributed systems
Partner with AI researchers, platform teams, and engineers to translate experimental challenges into robust, user-friendly performance tooling
Integrate AI-Perf with the Dynamo Inference Stack, other NVIDIA inference stacks, and open-source inference frameworks, delivering end-to-end performance insights for researchers and production users
Qualification
Required
Bachelor's, Master's, or PhD in Computer Science, Computer Engineering, or related field—or equivalent experience
8+ years of experience in systems software, distributed performance engineering, or AI infrastructure research
Expert-level Python skills, including profiling, optimization, automation, and debugging of complex systems
Deep knowledge of distributed systems concepts, including scalability, concurrency, fault tolerance, and performance trade-offs
Preferred
Experience designing or maintaining performance benchmarking frameworks or tooling for AI/ML systems
Hands-on experience with LLMs and deep learning frameworks such as PyTorch, TensorFlow, TensorRT, or ONNX Runtime
Contributions to open-source or research projects in AI performance, infrastructure, or distributed systems
Experience running large-scale inference experiments across cloud and on-prem environments (AWS, Azure, GCP, bare metal)
Benefits
Equity
Benefits
Company
NVIDIA
NVIDIA is a computing platform company operating at the intersection of graphics, HPC, and AI.
10001+ employees
H1B Sponsorship
NVIDIA has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (1877)
2024 (1355)
2023 (976)
2022 (835)
2021 (601)
2020 (529)
Funding
Current Stage
Public CompanyTotal Funding
$4.09BKey Investors
ARPA-EARK Investment ManagementSoftBank Vision Fund
2023-05-09Grant· $5M
2022-08-09Post Ipo Equity· $65M
2021-02-18Post Ipo Equity
Leadership Team
Jensen Huang
Founder and CEO
Michael Kagan
Chief Technology Officer
Recent News
GlobeNewswire
2026-01-13
2026-01-13
Company data provided by crunchbase