xAI · 2 months ago
Member of Technical Staff, CUDA/GPU Kernel
Palo Alto, CA
Full-time
Onsite
Mid, Senior Level
$180K/yr - $440K/yrxAI is focused on creating AI systems that enhance humanity's understanding of the universe. They are seeking a Member of Technical Staff to develop and optimize low-level CUDA kernels for their inference and training software stack, requiring strong expertise in GPU programming and kernel optimization.
Artificial Intelligence (AI)Foundational AIGenerative AIInformation TechnologyMachine Learning
Responsibilities
Developing and improving low-level CUDA kernel optimizations for state-of-the-art inference and training software stack
Profiling, debugging, and optimizing single and multi-GPU operations using tools such as Nsight
Understanding GPU memory hierarchy and computation capabilities
Implementing the latest methods from the deep learning literature in low-level CUDA kernels
Innovating new ideas that bring us closer to the limits of a GPU
Qualification
Required
Strong communication skills
Experience with CUDA
Experience with CUTLASS
Proficiency in C/C++ and Python binding tools
Experience in developing and improving low-level CUDA kernel optimizations
Experience in profiling, debugging, and optimizing single and multi-GPU operations using tools such as Nsight
Understanding of GPU memory hierarchy and computation capabilities
Ability to implement methods from deep learning literature in low-level CUDA kernels
Ability to innovate new ideas for GPU optimization
Experience building high-performance GeMM CUDA kernels using Tensor cores or CUDA cores
Experience implementing features for attention kernel
Comfortable writing both forward and backward kernels
Ability to optimize for memory-bound and compute-bound operations
Ability to reason about register pressure, shared-memory usage, and GPU utilization
Familiarity with techniques in optimizing inference and training workloads
Experience using pybind to integrate custom-written kernels into a framework
Benefits
Equity
Comprehensive medical, vision, and dental coverage
Access to a 401(k) retirement plan
Short & long-term disability insurance
Life insurance
Various other discounts and perks
Company
xAI
XAI is an artificial intelligence startup that develops AI solutions and tools to enhance reasoning and search capabilities.
Founded in 2023
11-50 employees
H1B Sponsorship
xAI has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (1)
Funding
Current Stage
Late StageTotal Funding
$42.73BKey Investors
Neptune Digital AssetsSpaceXMorgan Stanley
2026-01-06Series E· $20B
2025-12-11Secondary Market· $0.3M
2025-07-13Corporate Round· $5.32B
Leadership Team
Toby Pohlen
Founding Member
Recent News
Analytics Insight: Latest AI, Crypto, Tech News & Analysis
2026-01-19
2026-01-19
2026-01-19
Company data provided by crunchbase