System Engineer, GPU Fleet jobs in United States
cer-icon
Apply on Employer Site
company-logo

Fluidstack ยท 13 hours ago

System Engineer, GPU Fleet

Fluidstack is building the infrastructure for abundant intelligence, partnering with top AI labs and enterprises. The System Engineer, GPU Fleet will manage and optimize hyperscale GPU compute infrastructure for AI/ML workloads, ensuring high availability and performance through automation and troubleshooting.

Cloud ComputingCloud StorageGenerative AIGPUInformation TechnologyMachine LearningPrivate CloudSoftware
check
H1B Sponsor Likelynote

Responsibilities

Operate and maintain large-scale GPU server fleet (H100, B200, GB200) supporting AI/ML workloads; monitor system health, performance, and utilization to maximize uptime and ensure SLA compliance
Perform hands-on troubleshooting and root cause analysis of complex hardware, firmware, OS, and application issues across GPU clusters; coordinate with vendors and hardware teams to resolve systemic failures
Develop and maintain automation scripts for provisioning, configuration management, monitoring, and remediation at scale
Build and improve tooling for GPU health checks, performance diagnostics, driver validation, and automated recovery
Execute server provisioning, configuration, firmware updates, and OS installation using automation frameworks; manage lifecycle operations including deployment, maintenance, and decommissioning
Participate in 24x7 on-call rotation; respond to production incidents and coordinate resolution with cross-functional teams including datacenter operations, network engineering, and application teams
Lead post-incident reviews, document root causes, and drive continuous improvement initiatives focused on automation, reliability, monitoring, and operational efficiency

Qualification

Linux system administrationGPU infrastructure managementAutomation toolsTroubleshooting skillsShell scriptingHPC cluster managementGPU architecture knowledgeAnalytical skillsCommunication skillsCollaboration skills

Required

Bachelor's degree in Computer Science, Engineering, or related technical field (or equivalent practical experience)
3+ years (System Engineer) or 5+ years (Senior System Engineer) in Linux system administration, datacenter operations, or infrastructure engineering
Strong Linux/Unix fundamentals including system administration, shell scripting (Bash, Python), troubleshooting, and performance tuning
Experience with server hardware architecture, troubleshooting techniques, and understanding of compute, memory, storage, and networking components
Experience in automation and configuration management tools (Ansible, Puppet, Chef, Terraform)
Strong analytical and problem-solving skills with ability to diagnose complex technical issues under pressure
Excellent communication and collaboration skills; ability to work effectively with cross-functional teams

Preferred

Experience managing large-scale GPU infrastructure (NVIDIA H100, A100, B200, GB200) in production environments supporting AI/ML workloads
Deep knowledge of GPU architecture, CUDA toolkit, GPU drivers, monitoring tools (nvidia-smi, DCGM)
Experience with HPC cluster management, job schedulers (Slurm, PBS, LSF), and container orchestration (Kubernetes, Docker)
Proficiency in out-of-band management protocols (IPMI, Redfish, BMC) and firmware management for server hardware
Experience with high-performance networking (InfiniBand, RoCE, RDMA) and network troubleshooting in GPU cluster environments
Familiarity with datacenter operations including rack installations, cabling, power management, and thermal considerations

Benefits

Retirement or pension plan, in line with local norms.
Health, dental, and vision insurance.
Generous PTO policy, in line with local norms.

Company

Fluidstack

twittertwittertwitter
company-logo
FluidStack is an AI cloud platform for frontier labs and startups.

H1B Sponsorship

Fluidstack has a track record of offering H1B sponsorships. Please note that this does not guarantee sponsorship for this specific role. Below presents additional info for your reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (1)
2024 (2)

Funding

Current Stage
Growth Stage
Total Funding
unknown
Key Investors
Seedcamp
2025-06-01Undisclosed
2024-10-01Private Equity
2018-02-01Pre Seed

Leadership Team

leader-logo
Gary Wu
CEO, Co-Founder
linkedin
Company data provided by crunchbase