Apex Systems · 4 days ago
AI Evaluation Engineer
United States
Full-time
Remote
Entry, Mid Level
$100/hr - $110/hrApex Systems is a world-class IT services company that serves thousands of clients across the globe. They are seeking an AI Evaluation Engineer to join their Engineering Team for a 6-month contract, focusing on porting external benchmarks and developing novel model evaluations.
Human ResourcesInformation TechnologyRecruiting
Responsibilities
Porting new external benchmarks to the team ʼ s internal infrastructure so they can be run as part of their evaluation stack for new model releases
Keeping up to date with new evals and benchmarks, pitching the team on porting newly released evals
Performing rigorous quality control for new and existing evals
Implementing novel evaluations to measure dangerous capabilities and safety of frontier models
Qualification
Required
Strong Python coding experience and writing clean code fast
Working in a small team on a large, shared codebase
Experience designing and building model evaluations
Detail-oriented, with tenacity to dig through transcripts to identify and resolve issues
Ability to quickly and independently learn new skills and frameworks
Team player with strong communication skills
Preferred
Demonstrated research experience in the evals space
Experience with agentic evaluations and working with Docker
Benefits
Medical
Dental
Vision
Life
Disability
Other insurance plans that offer an optional layer of financial protection
ESPP (employee stock purchase program)
401K program which allows you to contribute typically within 30 days of starting, with a company match after 12 months of tenure
HSA (Health Savings Account on the HDHP plan)
SupportLinc Employee Assistance Program (EAP) with up to 8 free counseling sessions
Corporate discount savings program
Other discounts
On-demand training program
Access to certification prep
Library of technical and leadership courses/books/seminars once you have 6+ months of tenure
Certification discounts and other perks to associations that include CompTIA and IIBA
Dedicated customer service team for our Consultants that can address questions around benefits and other resources
Certified Career Coach
Company
Apex Systems
Apex Systems, a division of On Assignment, provides organizations with IT staffing solutions to address gaps in their current workforce.
Founded in 1995
1001-5000 employees
H1B Sponsorship
Apex Systems has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (28)
2024 (21)
2023 (35)
2022 (26)
2021 (29)
2020 (38)
Funding
Current Stage
Late StageLeadership Team
Roger Wahman
Chief Technology Officer - SVP
Andrea Schiola
Global Head of Technology Partnerships, SVP, Principal
Recent News
Company data provided by crunchbase