AI Software Engineer jobs in United States
cer-icon
Apply on Employer Site
company-logo

Zoom · 17 hours ago

AI Software Engineer

Zoom is dedicated to building a world-class inference infrastructure that powers all of its AI services. As an AI Software Engineer on Zoom’s AI Infra team, you will design, optimize, and scale the runtimes and services that power AI models, improving efficiency and reducing costs across Zoom’s AI stack.

CollaborationInformation TechnologyMessagingSaaSVideo Conferencing
check
H1B Sponsor Likelynote

Responsibilities

Develop and optimize AI runtimes for LLMs, ASR, and MT systems with a focus on performance and cost efficiency
Apply GPU-level optimization techniques including CUDA, kernel fusion, and memory throughput improvements
Implement inference optimizations such as TorchCompile, graph optimization, KV cache, and continuous batching
Build scalable, highly available infrastructure services to support enterprise-grade AI workloads
Optimize models for edge devices (laptops, PCs and mobile devices) as well as large-scale cloud deployments
Continuously improve latency, throughput, and efficiency across serving pipelines
Rapidly integrate and optimize new industry models to stay ahead in AI infrastructure

Qualification

GPU programmingPythonC++PyTorchTensorFlowTransformer modelsCloud platformsAI infrastructureCUDADockerKubernetesMLflowSoft skills

Required

Track record of building scalable, reliable AI infrastructure under real-world production constraints
Strong expertise in GPU programming and optimization (CUDA, kernel-level development)
Deep experience with transformer-based models and inference frameworks (vLLM, TensorRT-LLM, SGLang, ONNX Runtime)
Proficiency in Python and C++ (Java is a plus)
Hands-on experience with PyTorch (TorchCompile, graph-level optimization) and/or TensorFlow
Knowledge of low-level hardware concepts (GPU memory hierarchy, caching, vectorization)
Familiarity with cloud platforms (AWS, GCP, Azure) and AI deployment tools (Docker, Kubernetes, MLflow)

Benefits

A variety of perks, benefits, and options to help employees maintain their physical, mental, emotional, and financial health; support work-life balance; and contribute to their community in meaningful ways.

Company

Zoom

twittertwittertwitter
company-logo
Zoom is a software company that offers a communications platform that connects people through video, voice, chat, and content sharing.

H1B Sponsorship

Zoom has a track record of offering H1B sponsorships. Please note that this does not guarantee sponsorship for this specific role. Below presents additional info for your reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (16)
2024 (178)
2023 (144)
2022 (259)
2021 (86)
2020 (34)

Funding

Current Stage
Public Company
Total Funding
$276M
Key Investors
ARK Investment ManagementSequoia CapitalEmergence Capital
2021-11-04Post Ipo Equity· $130M
2019-04-19Post Ipo Equity
2019-04-18IPO

Leadership Team

leader-logo
Eric Yuan
Founder & CEO
linkedin
leader-logo
Xuedong Huang
Chief Technology Officer
linkedin
Company data provided by crunchbase