Zoom · 17 hours ago
AI Software Engineer
Zoom is dedicated to building a world-class inference infrastructure that powers all of its AI services. As an AI Software Engineer on Zoom’s AI Infra team, you will design, optimize, and scale the runtimes and services that power AI models, improving efficiency and reducing costs across Zoom’s AI stack.
CollaborationInformation TechnologyMessagingSaaSVideo Conferencing
Responsibilities
Develop and optimize AI runtimes for LLMs, ASR, and MT systems with a focus on performance and cost efficiency
Apply GPU-level optimization techniques including CUDA, kernel fusion, and memory throughput improvements
Implement inference optimizations such as TorchCompile, graph optimization, KV cache, and continuous batching
Build scalable, highly available infrastructure services to support enterprise-grade AI workloads
Optimize models for edge devices (laptops, PCs and mobile devices) as well as large-scale cloud deployments
Continuously improve latency, throughput, and efficiency across serving pipelines
Rapidly integrate and optimize new industry models to stay ahead in AI infrastructure
Qualification
Required
Track record of building scalable, reliable AI infrastructure under real-world production constraints
Strong expertise in GPU programming and optimization (CUDA, kernel-level development)
Deep experience with transformer-based models and inference frameworks (vLLM, TensorRT-LLM, SGLang, ONNX Runtime)
Proficiency in Python and C++ (Java is a plus)
Hands-on experience with PyTorch (TorchCompile, graph-level optimization) and/or TensorFlow
Knowledge of low-level hardware concepts (GPU memory hierarchy, caching, vectorization)
Familiarity with cloud platforms (AWS, GCP, Azure) and AI deployment tools (Docker, Kubernetes, MLflow)
Benefits
A variety of perks, benefits, and options to help employees maintain their physical, mental, emotional, and financial health; support work-life balance; and contribute to their community in meaningful ways.
Company
Zoom
Zoom is a software company that offers a communications platform that connects people through video, voice, chat, and content sharing.
H1B Sponsorship
Zoom has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (16)
2024 (178)
2023 (144)
2022 (259)
2021 (86)
2020 (34)
Funding
Current Stage
Public CompanyTotal Funding
$276MKey Investors
ARK Investment ManagementSequoia CapitalEmergence Capital
2021-11-04Post Ipo Equity· $130M
2019-04-19Post Ipo Equity
2019-04-18IPO
Recent News
Crunchbase News
2026-01-23
2026-01-22
2026-01-22
Company data provided by crunchbase