Anyscale · 1 week ago
Software Engineer, Platform Infrastructure (Foundations)
United States
Full-time
Remote
Mid Level
3+ years expAnyscale is a company dedicated to democratizing distributed computing, focusing on the commercialization of Ray, an open-source project for scalable machine learning. They are seeking a Software Engineer for their Infrastructure team to develop tools and infrastructure that simplify the deployment of distributed AI applications in the cloud.
AI InfrastructureArtificial Intelligence (AI)Developer PlatformInformation TechnologyMachine LearningOpen Source
Responsibilities
Design, build, and scale services that orchestrate Ray clusters across cloud and on-prem environments, supporting both VM-based and Kubernetes-based deployments
Optimize control plane components for large-scale, distributed AI/ML workloads
Build intelligent scheduling and resource management systems for heterogeneous compute clusters
Develop features to enhance the reliability, performance, scalability, and observability of Anyscale-managed Ray workloads
Support and optimize accelerator integration (e.g., GPUs, TPUs)
Handle container image management and dependency resolution for distributed workloads
Participate in code reviews, design and architecture discussions
Provide on-call support, working closely with customer and field teams to troubleshoot infrastructure issues
Collaborate with leading distributed systems and machine learning experts to push the boundaries of AI infrastructure
Qualification
Required
Bachelor's degree in Computer Science, Engineering, or equivalent practical experience
3+ years of experience writing high-quality production code
Hands-on experience in building and maintaining highly available, scalable, and performant distributed system
Expertise in cloud-native technologies (AWS, Azure, GCP) and Kubernetes-based deployments
Deep understanding of networking, security, and authentication mechanisms in cloud environment
Familiarity with observability stacks (Prometheus, Grafana etc)
Proficiency in Go and Python
Knowledge of low-level operating system foundations (Linux kernel, file systems, containers)
Company
Anyscale
Anyscale accelerates the development and productionization of any AI app, on any cloud, at any scale.
201-500 employees
H1B Sponsorship
Anyscale has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (33)
2024 (14)
2023 (10)
2022 (10)
2021 (4)
2020 (1)
Funding
Current Stage
Growth StageTotal Funding
$259MKey Investors
Addition,Intel CapitalAddition,Andreessen HorowitzNew Enterprise Associates
2022-08-23Series C· $99M
2021-12-07Series C· $100M
2020-10-21Series B· $40M
Leadership Team
Keerti Melkote
Chief Executive Officer
Robert Nishihara
Co-Founder
Recent News
Dynamic Business
2026-01-23
globalventuring.com
2026-01-12
Company data provided by crunchbase