Google · 7 hours ago
Senior Software Engineer, Machine Learning, Kernel
Sunnyvale, CA
Full-time
Onsite
Senior Level
$166K/yr - $244K/yr
5+ years expGoogle is a leading technology company that develops next-generation technologies to change how billions of users connect and interact with information. They are seeking a Senior Software Engineer to optimize machine learning model performance, collaborating with customers and developing custom solutions for large-scale training and inference.
AppsArtificial Intelligence (AI)Cloud StorageSearch EngineSEO
Responsibilities
Optimize ML model architectures and systems for high performance across multiple TPU platforms, including onboard hardware and simulation environments
Enhance model and system performance for both low-latency inference and large-scale distributed training workloads
Develop post-training algorithms, such as quantization and low-level kernel optimizations, to increase inference speed and reduce memory consumption on modern GPU and TPU architectures
Engineer custom kernels to maximize training efficiency for memory-bound large models and I/O-bound fine-tuning processes
Collaborate with ML infrastructure teams, hardware and simulation departments, and Alphabet’s research teams to integrate cross-functional optimizations
Qualification
Required
Bachelor's degree or equivalent practical experience
5 years of experience in C++, Python, and modern deep learning toolkits like PyTorch or JAX
3 years of experience in software development for machine learning model inference or machine learning model training, and 1 year of experience with ML model inference and training optimization on modern GPU/TPU architectures
Preferred
Experience in Kernel development for TPU
Experience in low-level ML model optimization and willingness to learn new architectures and tools
Experience in developing and optimizing large-scale foundation models, including Mixture of Experts (MoE), Diffusion, and Multi-modal architectures
Familiarity with models and their development issues
Understanding of latency, memory, compute, and quality tradeoffs as they apply to ML model architectures, and practical experience in making these tradeoffs
Ability to maintain agility and deliver results in a changing environment
Benefits
Bonus
Equity
Benefits
Company
Google specializes in internet-related services and products, including search, advertising, and software. It is a sub-organization of Alphabet.
10001+ employees
H1B Sponsorship
Google has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (8763)
2024 (8872)
2023 (9682)
2022 (11626)
2021 (9109)
2020 (9785)
Funding
Current Stage
Public CompanyTotal Funding
$26.1MKey Investors
Andy Bechtolsheim
2004-08-19IPO
1999-06-07Series Unknown· $25M
1998-11-01Angel· $1M
Leadership Team
Sundar Pichai
CEO
Thomas Kurian
CEO - Google Cloud
Recent News
The Indian Express
2025-10-08
2025-10-04
2025-10-04
Company data provided by crunchbase