METR ยท 3 weeks ago
(Senior) Research Engineer / Research Scientist
METR is a nonprofit research organization focused on developing scientific methods to assess AI capabilities and risks. They are seeking a Senior Research Engineer or Research Scientist to investigate AI capabilities and improve measurement metrics related to AI progress.
Artificial Intelligence (AI)CharityNon Profit
Responsibilities
Lead a project investigating transcripts as a source of evidence about agent capabilities
Create metrics that speak to the degree of uplift AI agents provide, and collect these metrics from AI R&D-relevant companies
Improve METR's time-horizon metric to make it more externally valid, more interpretable, and more predictive on threat-model relevant capabilities
Design and build experiments testing agent capabilities in the wild
Lead large-scale human-subjects experiments measuring the impacts of AI agents on economically-valuable R&D
Qualification
Required
You can write code
You should be able to quickly write a data analysis script in Python to answer an important question
You're excited to get your hands dirty
You are undaunted by open-ended mandates
You should be able to read, understand, and critique a research proposal
You're a good written communicator
You work fast and are highly reliable
Preferred
Bonus points if you can write a clean PR too
Bonus points if you can write a great paper
Company
METR
METR is a research non-profit that develops evaluations to empirically test AI systems for capabilities that could threaten catastrophic harm to society.
H1B Sponsorship
METR has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (6)
2024 (2)
Funding
Current Stage
Early StageCompany data provided by crunchbase