xAI · 17 hours ago
Member of Technical Staff - Enterprise Model Evaluation
xAI is on a mission to create AI systems that accurately understand the universe and aid humanity. The role involves designing and implementing model evaluations that shape how the company measures and improves its models, collaborating with training and product teams to ensure high standards before deployment.
Artificial Intelligence (AI)Foundational AIGenerative AIInformation TechnologyMachine Learning
Responsibilities
Design and implement next-generation evaluation suites beyond traditional benchmarks, creating frameworks that capture real-world utility and performance of Grok in production environments
Coordinate model evaluation efforts and collaborations to ensure comprehensive coverage and fast iterations
Integrate Grok into production systems, gain deep insights into real-world environments, and ensure alignment with user needs and business objectives
Partner with research teams to translate cutting-edge techniques and Grok models into production-ready implementations, optimizing for performance and impact
Qualification
Required
Proven expertise in designing and implementing sophisticated evaluation frameworks for machine learning models, especially LLMs
Experience with statistical analysis, experimental design, and benchmarking AI systems in real-world settings
Strong communication skills
Ability to concisely and accurately share knowledge with teammates
Strong work ethic and prioritization skills
Hands-on contribution to the company's mission
Technical leadership in driving vision and implementation of model evaluations
Benefits
Equity
Comprehensive medical, vision, and dental coverage
Access to a 401(k) retirement plan
Short & long-term disability insurance
Life insurance
Various other discounts and perks
Company
xAI
XAI is an artificial intelligence startup that develops AI solutions and tools to enhance reasoning and search capabilities.
H1B Sponsorship
xAI has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (1)
Funding
Current Stage
Late StageTotal Funding
$42.73BKey Investors
Valor Equity PartnersNeptune Digital AssetsSpaceX
2026-02-02Acquired
2026-01-06Series E· $20B
2025-12-11Secondary Market· $0.3M
Recent News
2026-02-05
2026-02-05
Portugal News
2026-02-05
Company data provided by crunchbase