Apply on Employer Site

Google DeepMind · 1 day ago

Principal Research Engineer, Gemini Evals

Mountain View, CA

Full-time

Onsite

Lead/Staff

10+ years exp

Google DeepMind is a team of scientists and engineers focused on advancing artificial intelligence for public benefit. They are seeking a Principal Research Engineer to lead the development of data pipelines and evaluation frameworks for the Gemini family of models, ensuring their safety and performance through rigorous evaluation and strategic influence.

Artificial Intelligence (AI)Business DevelopmentMachine Learning

Growth Opportunities

Responsibilities

Work on post-training evaluation and fine-tuning of large-scale models to improve performance and safety

Define and champion the technical roadmap for large-scale data and evaluation supporting the Gemini model family and its real-world applications

Drive the research of novel, high-signal evaluation methods (automated, human-in-the-loop, and adversarial) to measure model capabilities, alignment, safety, and trustworthiness

Actively contribute to the broader scientific community by presenting findings on cutting-edge AI evaluation and safety methods

Qualification

Large-scale machine learningData processing pipelinesEvaluation methodologiesLarge language modelsPost-training evaluationTechnical leadershipMentoringCommunication

Required

10+ years of experience in researching engineering, with at least 5 years in a technical leadership role

Experience with large-scale machine learning systems, data processing pipelines and evaluation methodologies

Experience with large language models (LLMs) and their evaluation

Experience in post-training evaluation research

Company

Google DeepMind

Glassdoor4.5

Google DeepMind aims to research and build safe artificial intelligence system to solve intelligence and advance science and humanity. It is a sub-organization of Google.

Founded in 2010

London, England, GBR

501-1000 employees