Principle Research Engineer, Gemini Evals

Google • Mountain View, CA • 1h ago

Snapshot

This role is for a Principle level Research Engineer to lead the strategic development and execution of robust data pipelines, evaluation frameworks, and metric systems for the Gemini family of models and their associated product applications. As a key technical leader and individual contributor, you will apply deep expertise in large-scale machine learning, statistical rigor, and scalable engineering to ensure the safety, performance, and ethical alignment of our frontier AI systems before and after deployment.

About us

Artificial Intelligence could be one of humanity's most useful inventions. At Google DeepMind, we're a team of scientists, engineers, machine learning experts, and more, working together to advance the state of the art in artificial intelligence. We use our technologies for widespread public benefit and scientific discovery, and collaborate with others on critical challenges, ensuring safety and ethics are the highest priority.

This role is part of the Gemini Evaluation research teams. The Gemini Evals team defines success for Gemini, establishes metrics to track progress, and provides clear, actionable insights to guide development. As a Research Engineer on this team, you will be at the forefront of building the data and evaluation systems that ensure the safety and quality of the Gemini family of models.

The Role

As a Principle Research Engineer, you will operate as a technical expert and leader within the Gemini Data and Evaluation team. Your primary focus will be to architect and execute the rigorous evaluation and data systems that underpin all major model release and product launch decisions for Gemini.

This is a highly cross-functional role requiring a blend of deep ML research, world-class software engineering, and strategic influence. You will define the data strategy for critical evaluation campaigns, design novel metrics to measure safety and performance at scale, and mentor a team of engineers and researchers to build high-quality, reproducible systems. You will be accountable for communicating complex evaluation results directly to leadership stakeholders to guide the responsible deployment of our most advanced AI technology.

Key responsibilities

Technical Leadership & Strategy

Work on post-training evaluation and fine-tuning of large-scale models to improve performance and safety.

Define and champion the technical roadmap for large-scale data and evaluation supporting the Gemini model family and its real-world applications

Drive the research of novel, high-signal evaluation methods (automated, human-in-the-loop, and adversarial) to measure model capabilities, alignment, safety, and trustworthiness.

Actively contribute to the broader scientific community by presenting findings on cutting-edge AI evaluation and safety methods.

About You

In order to set you up for success as a at Google DeepMind, we look for the following skills and experience:

10+ years of experience in researching engineering, with at least 5 years in a technical leadership role.

Experience with large-scale machine learning systems, data processing pipelines and evaluation methodologies.

Experience with large language models (LLMs) and their evaluation.

Experience in post-training evaluation research

Google

Go to Apply

Share this job

Similar Jobs

Sr Staff Data Scientist

Palo Alto Networks • Santa Clara, CA • 1h ago

IT & Engineering

Our Mission At Palo Alto Networks® everything starts and ends with our mission: Being the cybersecurity partner of choice, protecting our digital way of life. Our vision is a world where each day is safer and more secure...

1h ago

Go to Apply

Sr. Software Engineer

CommScope, Inc. • Sunnyvale, CA • 1h ago

IT & Engineering

Sr. Software Engineer Req ID: 80371 Location: Sunnyvale, California, United States, 94089 In our 'always on' world, we believe it's essential to have a genuine connection with the work you do. RUCKUS delivers purpose-dri...

1h ago

Go to Apply

Sr Staff Engineer Software (Next Generation Firewall)

Palo Alto Networks • Santa Clara, CA • 1h ago

IT & Engineering

1h ago

Go to Apply

Software Engineer III-Machine Learning Engineer

JPMorgan Chase • Palo Alto, CA • 6h ago

IT & Engineering

As a Software Engineer III/ML Engineer, you have an opportunity to be part of team to build, launch and scale an AI/ML platform for the firm As a Software Engineer III/ML Engineer, you have the chance to shape the future...

6h ago

Go to Apply

Go-to-Market (GTM) Engineer

Sage • San Jose, CA • 9h ago

IT & Engineering

Go-to-Market (GTM) Engineer Job Description: The GTM AI Engineer will play a key role in developing and operationalizing the AI-driven capabilities of our global go-to-market organization. This position combines data eng...

9h ago

Go to Apply

Junior Developer

Vagaro • Pleasanton, CA • 16h ago

IT & Engineering

Junior Developer - Data Intelligence Team (Salesforce Growth Path) About the Role We are seeking a Junior Developer to join our Data Intelligence team. In this role, you will support the development of internal tools, da...

16h ago

Go to Apply

Lead Manufacturing Technician

ThermoFisher Scientific • Sunnyvale, CA • 21h ago

IT & Engineering

Work Schedule Second Shift (Afternoons) Environmental Conditions Able to lift 40 lbs. without assistance, Adherence to all Good Manufacturing Practices (GMP) Safety Standards, Laboratory Setting, Some degree of PPE (Pers...

21h ago

Go to Apply

Test Mechatronics Engineer

Benchmark Space Systems • Pleasanton, CA • 1d ago

IT & Engineering

Job Purpose and Primary Objectives Benchmark Space Systems is looking for an experienced Test Mechatronics Engineer to join our Avionics team. This role will work closely with engineers to design, build, and test the nex...

1d ago

Go to Apply

Mechanical Engineer V

Actalent • Pleasanton, CA • 1d ago

IT & Engineering

Actalent is hiring for a Mechanical Engineer in Pleasanton, CA!! POSITION SUMMARY: Performs complex activities in the testing and sustaining of class II and class III mechanical circulatory support products including Ven...

1d ago

Go to Apply

Production Technician

Aerotek • Fremont, CA • 1d ago

IT & Engineering

Job Title: Production Technician Location: Fremont, CA Shift: Swing Shift (2:00 PM - 10:30 PM, Monday-Friday) About The Company Join a fast-growing clean-tech startup on a mission to revolutionize sustainable agriculture...

1d ago

Go to Apply

Subscribe to get new jobs sent directly to you
(no charge, cancel anytime)

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.