Senior System Software Engineer - AI Performance and Efficiency Tools jobs in United States
cer-icon
Apply on Employer Site
company-logo

NVIDIA · 2 days ago

Senior System Software Engineer - AI Performance and Efficiency Tools

NVIDIA is a leader in AI technology, seeking a Senior System Software Engineer to develop performance and efficiency tools for AI workloads. This role involves building profiling, debugging, and benchmarking tools while collaborating with hardware architects to enhance system capabilities.

Artificial Intelligence (AI)Consumer ElectronicsGPUHardwareSoftwareVirtual Reality
check
Growth Opportunities
check
H1B Sponsor Likelynote

Responsibilities

Build internal profiling and analysis tools for AI workloads at large scale
Build debugging tools for common encountered problems like memory or networking
Create benchmarking and simulation technologies for AI system or GPU cluster
Partner with HW architects to propose new features or improve existing features with real world use cases

Qualification

C++PythonDeep Learning frameworksNVIDIA GPUsCUDA ProgrammingGPU cluster schedulingCustomer-facing communicationProblem-solving skillsContinuous learning

Required

BS+ in Computer Science or related (or equivalent experience) and 5+ years of software development
Strong software skills in design, coding (C++ and Python), analytical, and debugging
Good understanding of Deep Learning frameworks like PyTorch and TensorFlow, distributed training and inference
Knowledge of GPU cluster job scheduling (Slurm or Kubernetes), storage and networking
Experience with NVIDIA GPUs, CUDA Programming and NCCL
Motivated self-starter with strong problem-solving skills and customer-facing communication skills
Passion for continuous learning. Ability to work concurrently with multiple global groups

Preferred

Proven experience in GPU cluster scale continuous profiling & analysis tools/platforms
Solid experience in large AI job performance analysis for training/inference workload
Knowledge of Linux device drivers and/or compiler implementation
Knowledge of GPU and/or CPU architecture and general computer architecture principles

Benefits

Equity
Benefits

Company

NVIDIA is a computing platform company operating at the intersection of graphics, HPC, and AI.

H1B Sponsorship

NVIDIA has a track record of offering H1B sponsorships. Please note that this does not guarantee sponsorship for this specific role. Below presents additional info for your reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (1877)
2024 (1355)
2023 (976)
2022 (835)
2021 (601)
2020 (529)

Funding

Current Stage
Public Company
Total Funding
$4.09B
Key Investors
ARPA-EARK Investment ManagementSoftBank Vision Fund
2023-05-09Grant· $5M
2022-08-09Post Ipo Equity· $65M
2021-02-18Post Ipo Equity

Leadership Team

leader-logo
Jensen Huang
Founder and CEO
linkedin
leader-logo
Michael Kagan
Chief Technology Officer
linkedin
Company data provided by crunchbase