Research Scientist, Multimodal LLMs

Google • Mountain View, CA • 1d ago

Snapshot

The VIVID team at Google DeepMind focuses on cutting-edge research to advance the capabilities of foundation models, to enable personalized, multimodal, and agentic experiences.

Our work spans new modeling approaches, problem definitions, and data, with a strong emphasis on the bridge between perceptual (audio, image, video) and semantic (language, code) modalities. In addition to producing highly-cited research published at top academic venues, our innovations land in flagship models like Gemini, and in Google products used by people every day.

About us

Artificial Intelligence could be one of humanity's most useful inventions. At Google DeepMind, we're a team of scientists, engineers, machine learning experts and more, working together to advance the state of the art in artificial intelligence. We use our technologies for widespread public benefit and scientific discovery, and collaborate with others on critical challenges, ensuring safety and ethics are the highest priority.

The role

We are seeking a highly motivated and talented Research Scientist to join our team at the forefront of multimodal large language model (LLM) research. You will work alongside a world-class team of researchers and engineers to develop and advance the next generation of AI models that can seamlessly integrate and reason across different modalities such as text, images, audio, and video.

Key responsibilities

Develop and implement next-generation agentic reasoning frameworks for multimodal understanding: This core responsibility involves moving beyond single-step inference to design models that can formulate complex plans, critique their own thought processes, and iteratively refine their conclusions. You will explore reinforcement learning (RL) to reward detailed reasoning chains, develop robust self-critique mechanisms for error correction, and integrate tool-use, enabling models to execute code for interactive video analysis and manipulation. Your work will directly address the project's goal of teaching models to solve problems that require deep, @contextual reasoning over extended periods.

Pioneer the extension of visual reasoning from 2D into the 3D domain, enabling a more physically-grounded form of intelligence: Your research will focus on empowering models like Gemini to not just perceive 2D images and videos, but to infer and construct coherent 3D representations of the world from them. You will then leverage this deep spatial understanding to develop novel generative capabilities, such as synthesizing photorealistic views of a scene from new perspectives or allowing for the interactive modification of 3D objects and layouts. This frontier research is crucial for unlocking future applications in robotics, mixed reality, and creating agents that can truly reason about and interact with their physical environment.

Spearhead the creation of novel, challenging benchmarks to rigorously measure progress and define the future of visual reasoning: As models become more capable, existing benchmarks become insufficient. You will be responsible for identifying these gaps and leading the development of the next wave of evaluation datasets that test the limits of multimodal intelligence.

About you

In order to set you up for success as a Research Scientist at Google DeepMind, we look for the following skills and experience:

PhD in Computer Science, Statistics, or a related field.

Strong publication record in top machine learning conferences (e.g., NeurIPS, CVPR, ICML, ICLR, ICCV, ECCV).

Expertise in one or more of the following areas: computer vision, natural language processing, machine learning.

In addition, the following would be an advantage:

Experience with training, evaluating, or interpreting large language models.

Proven ability to design and execute independent research projects.

Excellent communication and collaboration skills.

Extensive experience with deep learning frameworks (e.g. PyTorch, JAX) and large-scale model training.

The US base salary range for this full-time position is between $166,000 USD - 244,000 USD + bonus + equity + benefits. Your recruiter can share more about the specific salary range for your targeted location during the hiring process.

Application deadline: Friday, August 29th at 9:00am PDT

At Google DeepMind, we value diversity of experience, knowledge, backgrounds and perspectives and harness these qualities to create extraordinary impact. We are committed to equal employment opportunities regardless of sex, race, religion or belief, ethnic or national origin, disability, age, citizenship, marital, domestic or civil partnership status, sexual orientation, gender identity, pregnancy, or related condition (including breastfeeding) or any other basis as protected by applicable law. If you have a disability or additional need that requires accommodation, please do not hesitate to let us know.

Google

Go to Apply

Share this job

Similar Jobs

Manager, Product Design, Finance & Supply Chain

ServiceNow, Inc. • Santa Clara, CA • 16min ago

Finance, Accounting & Banking

It all started in sunny San Diego, California in 2004 when a visionary engineer, Fred Luddy, saw the potential to transform how we work. Fast forward to today - ServiceNow stands as a global market leader, bringing innov...

16min ago

Go to Apply

Technical Program Manager, Software Supply Chain Security

Google • Sunnyvale, CA • 16min ago

Management & Administrative

Minimum qualifications: Bachelor's degree in a relevant field, or equivalent practical experience. 8 years of experience managing cross-functional or cross-team projects. Preferred qualifications: Experience in cybersecu...

16min ago

Go to Apply

Demand Planning Manager, Supply Chain

Amazon • Sunnyvale, CA • 22min ago

Management & Administrative

Description The Demand Planning Manager is a lead position within the Accessories supply chain organization. As the Demand Planning Manager, you will collaborate with numerous cross-functional stakeholders to build and d...

22min ago

Go to Apply

Front Desk Coordinator

Aston Carter • Palo Alto, CA • 24min ago

Retail & Hospitality

Job Title: Front Desk Coordinator The position is based in a small, quiet clinic with a dedicated team of 1-2 providers and a total of 5 staff members. The standard schedule is Monday to Friday, 7:00 AM to 3:30 PM, with...

24min ago

Go to Apply

Front Desk Coordinator

Aston Carter • Redwood City, CA • 24min ago

Retail & Hospitality

24min ago

Go to Apply

Customer Service Representative

U-Haul • Fremont, CA • 2h ago

Management & Administrative

Compensation Range: $16.50 to $25.00 Hourly Location: 44511 S Grimmer Bl, Fremont, California 94538 United States of America Are you a people person? Do you love helping others? U-Haul is in search of friendly, motivated...

2h ago

Go to Apply

Android Finance Analyst

Google • Mountain View, CA • 2h ago

Finance, Accounting & Banking

Minimum qualifications: Bachelor's degree in Business, Finance, Economics, Statistics, or another quantitative field, or equivalent practical experience. 4 years of experience in Financial Planning and Analysis (FP&A...

2h ago

Go to Apply

Senior Manager, Global Logistics Analytics and Finance

Danaher Corporation • Sunnyvale, CA • 2h ago

Finance, Accounting & Banking

Bring more to life.Are you ready to accelerate your potential and make a real difference within life sciences, diagnostics and biotechnology?At Cepheid, one of Danaher's 15+ operating companies, our work saves lives-and...

2h ago

Go to Apply

Finance Associate, Infrastructure Data Center

Meta • Menlo Park, CA • 2h ago

Finance, Accounting & Banking

Summary: The Finance & Business Planning (FBP) team is the strategic engine behind Meta's bold investments. We manage the company's entire budget and drive data-informed decisions that shape the future of Meta and ou...

2h ago

Go to Apply

Maintenance Mechanic

Veterans Affairs, Veterans Health Administration • Menlo Park, CA • 4h ago

Retail & Hospitality

Summary The Journeyman Maintenance Mechanic works from written, electronic, and verbal communication as assigned. May perform assignments, which include simultaneous and continuous work, without detailed instructions. Us...

4h ago

Go to Apply

Subscribe to get new jobs sent directly to you
(no charge, cancel anytime)

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.