x.ai · 3 months ago
Member of Technical Staff, Model Evaluation
Palo Alto, CA, US
Full-time
Onsite
Mid, Senior Level
$180K/yr - $440K/yrxAI's mission is to create AI systems that can accurately understand the universe and aid humanity in its pursuit of knowledge. The role involves providing complete assessments of models, communicating with teams to improve model quality, and developing evaluation tasks and infrastructure.
Telecom & CommunicationsArtificial Intelligence (AI)SoftwareInternetSchedulingVirtual Assistant
Responsibilities
Provide complete assessment of models
Deep dive into model training and data to identify the weakness point revealed in evaluation
Communicate with modeling and data team to come up with plans to improve model quality
Qualification
Required
Strong communication skills
Experience with Python
Experience with JAX and XLA
Experience with Rust / C++
Experience with Spark
Model assessment and evaluation task development (including public and in-house benchmarking)
Ability to collect data and synthesize data for new evaluations
Experience building infrastructure and framework for easy-to-use model evaluation
Familiarity with inference frameworks like SGlang and vLLM
Ability to provide complete assessment of models
Ability to deep dive into model training and data to identify weaknesses revealed in evaluation
Ability to communicate with modeling and data team to improve model quality
Benefits
Equity
Comprehensive medical, vision, and dental coverage
Access to a 401(k) retirement plan
Short & long-term disability insurance
Life insurance
Various other discounts and perks
Company
x.ai
x.ai is a tool that helps you and your team share ideal availability and schedule meetings.
Founded in 2014
201-500 employees
H1B Sponsorship
x.ai has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (35)
2024 (9)
2023 (2)
Funding
Current Stage
Growth StageTotal Funding
$44.29MKey Investors
Pegasus Tech VenturesTwo Sigma VenturesFirstMark
2021-06-03Acquired
2017-08-14Series B· $10M
2016-04-07Series B· $23M
Recent News
bloomberglaw.com
2025-09-25
2025-08-13
Company data provided by crunchbase