Software Engineer - Applied Inference jobs in United States
cer-icon
Apply on Employer Site
company-logo

xAI · 5 months ago

Software Engineer - Applied Inference

positionSan Francisco & Palo Alto, CA
timeFull-time
remoteOnsite
seniorityMid Level
money$180K/yr - $440K/yr

xAI is a company focused on creating AI systems that enhance human knowledge. They are seeking a Software Engineer - Applied Inference to ensure the reliability of inference services, develop custom debugging tools, and manage continuous deployment and feature rollout of inference services.

Artificial Intelligence (AI)Foundational AIGenerative AIInformation TechnologyMachine Learning
check
Growth Opportunities
check
H1B Sponsor Likelynote

Responsibilities

Ensure the reliability of inference services, targeting 100% uptime and a 0% error rate
Develop custom debugging tools to trace, replay, and fix all errors or crashes across the entire stack, from cluster orchestration to GPU kernels
Manage the autoscaling, continuous deployment, and feature rollout of inference services
Benchmark and monitor the performance of inference engines under various production workloads
Build CI/CD infrastructure for endpoint deployment, image publishing, and inference engines

Qualification

KubernetesCI/CD infrastructureCustom debugging toolsPrometheusTerraformPrioritization skillsCommunication skillsWork ethic

Required

Strong communication skills
Experience with Kubernetes
Experience with Buildkite / ArgoCD
Experience with Prometheus / Grafana / PagerDuty
Experience with Pulumi / Terraform
Experience with custom debugging and tracing tools
Experience ensuring the reliability of inference services
Experience developing custom debugging tools to trace, replay, and fix errors or crashes
Experience managing autoscaling, continuous deployment, and feature rollout of inference services
Experience benchmarking and monitoring performance of inference engines
Experience building CI/CD infrastructure for endpoint deployment, image publishing, and inference engines
Experience working on large-scale, high-concurrent production serving
Experience working on testing, benchmarking, and reliability of inference services
Experience working on CI/CD infrastructure

Benefits

Equity
Comprehensive medical, vision, and dental coverage
Access to a 401(k) retirement plan
Short & long-term disability insurance
Life insurance
Various other discounts and perks

Company

xAI

twittertwittertwitter
company-logo
XAI is an artificial intelligence startup that develops AI solutions and tools to enhance reasoning and search capabilities.
dateFounded in 2023
location
Palo Alto, California, USA
people-size11-50 employees
web-link
https://x.ai

H1B Sponsorship

xAI has a track record of offering H1B sponsorships. Please note that this does not guarantee sponsorship for this specific role. Below presents additional info for your reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (1)

Funding

Current Stage
Late Stage
Total Funding
$42.73B
Key Investors
Neptune Digital AssetsSpaceXMorgan Stanley
2026-01-06Series E· $20B
2025-12-11Secondary Market· $0.3M
2025-07-13Corporate Round· $5.32B

Leadership Team

leader-logo
Toby Pohlen
Founding Member
linkedin

Recent News

Analytics Insight: Latest AI, Crypto, Tech News & Analysis
Elon Musk’s xAI Hires Hindi & Bengali Speakers, Offers Up to $65/Hour to Localize Grok AI
2026-01-19
Gulf News
Threads just beat X on daily mobile users, new data shows
2026-01-19
TESLARATI
Elon Musk’s xAI brings 1GW Colossus 2 AI training cluster online
2026-01-19
Company data provided by crunchbase