Software Engineer, ML Infrastructure, Vertex AI jobs in United States
cer-icon
Apply on Employer Site
company-logo

Google · 4 hours ago

Software Engineer, ML Infrastructure, Vertex AI

Google is a leading technology company seeking a Software Engineer for their ML Infrastructure team at Vertex AI. In this role, you will develop scalable infrastructure and services that support machine learning models, ensuring high standards of quality and performance.

AppsArtificial Intelligence (AI)Cloud StorageSearch EngineSEO
check
Growth Opportunities
check
H1B Sponsor Likelynote

Responsibilities

Triage product or system issues and debug/track/resolve by analyzing the sources of issues and the impact on hardware, network, or service operations and quality
Partner with research teams and Google DeepMind to productize models and technology on the Vertex AI platform, bridging the gap between research and real-world applications
Design and implement robust cloud APIs and services for model deployment and management, ensuring seamless integration and user experience. This includes monitoring, prober setting, testing, and other critical components for operational excellence
Build infrastructure and services that enable model quality and evaluation processes, ensuring models meet the highest standards of accuracy and robustness
Work closely with product managers to gain deep insights into customer requirements and translate them into actionable product features and enhancements

Qualification

C++Machine learning infrastructureDistributed systemsLarge-scale infrastructureData structuresAlgorithmsBackend infrastructureCollaborationProblem-solvingLeadership qualities

Required

Bachelor's degree or equivalent practical experience
2 years of experience with software development, or 1 year of experience with an advanced degree in an industry setting
2 years of experience with developing large-scale infrastructure, distributed systems or networks, or experience with compute technologies, storage or hardware architecture
Experience with C++, machine learning infrastructure, and distributed systems

Preferred

Master's degree or PhD in Computer Science or related technical fields
2 years of experience with data structures and algorithms
Experience in large-scale data processing that involves image, video, or audio
Experience in backend infrastructure and scalabilities
Experience with ML infrastructure

Benefits

Bonus
Equity
Benefits

Company

Google specializes in internet-related services and products, including search, advertising, and software. It is a sub-organization of Alphabet.

H1B Sponsorship

Google has a track record of offering H1B sponsorships. Please note that this does not guarantee sponsorship for this specific role. Below presents additional info for your reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (8763)
2024 (8872)
2023 (9682)
2022 (11626)
2021 (9109)
2020 (9785)

Funding

Current Stage
Public Company
Total Funding
$26.1M
Key Investors
Andy Bechtolsheim
2004-08-19IPO
1999-06-07Series Unknown· $25M
1998-11-01Angel· $1M

Leadership Team

leader-logo
Sundar Pichai
CEO
linkedin
leader-logo
Thomas Kurian
CEO - Google Cloud
linkedin
Company data provided by crunchbase