Applied Scientist, Artificial General Intelligence, AGI Data Services

Amazon • Boston, MA • 4h ago

Description

The Artificial General Intelligence (AGI) team is seeking a dedicated, skilled, and innovative Applied Scientist with a robust background in machine learning, statistics, quality assurance, auditing methodologies, and automated evaluation systems to ensure the highest standards of data quality, to build industry-leading technology with Large Language Models (LLMs) and multimodal systems.

Key job responsibilities

As part of the AGI team, an Applied Scientist will collaborate closely with core scientist team developing Amazon Nova models. They will lead the development of comprehensive quality strategies and auditing frameworks that safeguard the integrity of data collection workflows. This includes designing auditing strategies with detailed SOPs, quality metrics, and sampling methodologies that help Nova improve performances on benchmarks. The Applied Scientist will perform expert-level manual audits, conduct meta-audits to evaluate auditor performance, and provide targeted coaching to uplift overall quality capabilities. A critical aspect of this role involves developing and maintaining LLM-as-a-Judge systems, including designing judge architectures, creating evaluation rubrics, and building machine learning models for automated quality assessment. The Applied Scientist will also set up the configuration of data collection workflows and communicate quality feedback to stakeholders. An Applied Scientist will also have a direct impact on enhancing customer experiences through high-quality training and evaluation data that powers state-of-the-art LLM products and services.

A day in the life

An Applied Scientist with the AGI team will support quality solution design, conduct root cause analysis on data quality issues, research new auditing methodologies, and find innovative ways of optimizing data quality while setting examples for the team on quality assurance best practices and standards. Besides theoretical analysis and quality framework development, an Applied Scientist will also work closely with talented engineers, domain experts, and vendor teams to put quality strategies and automated judging systems into practice.

Basic Qualifications

Master's degree in computer science, mathematics, statistics, machine learning or equivalent quantitative field

Experience programming in Java, C++, Python or related language

Experience with SQL and an RDBMS (e.g., Oracle) or Data Warehouse

Preferred Qualifications

Experience implementing algorithms using both toolkits and self-developed code

Have publications at top-tier peer-reviewed conferences or journals

Amazon is an equal opportunity employer and does not discriminate on the basis of protected veteran status, disability, or other legally protected status.

Our inclusive culture empowers Amazonians to deliver the best results for our customers. If you have a disability and need a workplace accommodation or adjustment during the application and hiring process, including support for the interview or onboarding process, please visit https://amazon.jobs/content/en/how-we-hire/accommodations for more information. If the country/region you're applying in isn't listed, please contact your Recruiting Partner.

The base salary range for this position is listed below. Your Amazon package will include sign-on payments and restricted stock units (RSUs). Final compensation will be determined based on factors including experience, qualifications, and location. Amazon also offers comprehensive benefits including health insurance (medical, dental, vision, prescription, Basic Life & AD&D insurance and option for Supplemental life plans, EAP, Mental Health Support, Medical Advice Line, Flexible Spending Accounts, Adoption and Surrogacy Reimbursement coverage), 401(k) matching, paid time off, and parental leave. Learn more about our benefits at https://amazon.jobs/en/benefits .

USA, WA, BELLEVUE - 136,000.00 - 184,000.00 USD annually

Amazon

Go to Apply

Share this job

Similar Jobs

Human Services Coordinator I

State of Massachusetts • Framingham, MA • 55min ago

Management & Administrative

The Department of Developmental Services (DDS) is excited to offer a career growth opportunity to a motivated and talented individual for the Human Services Coordinator I (HSC I) position at our Middlesex West Area Offic...

55min ago

Go to Apply

Compliance Officer III

State of Massachusetts • Boston, MA • 56min ago

Management & Administrative

Assists Director of Safety and Security to oversee all duties related to Metro Boston Security Team Specialist Department and Metro Boston Transportation services, and Materials Management. Provide direct supervision to...

56min ago

Go to Apply

Administrative Support (Office Support Specialist I) - Southeast Area Office

State of Massachusetts • Brockton, MA • 56min ago

Management & Administrative

The Southeast Area Office (SEA) of the Department of Mental Health (DMH) is seeking a dynamic, self-motivated, and experienced individual who will function as the Office Support Specialistto provide administrative suppor...

56min ago

Go to Apply

Contracted Student Interns, Acton Site Office

State of Massachusetts • Acton, MA • 59min ago

Management & Administrative

As the state's mental health agency, we handle a large volume of sensitive client records. In order to improve the efficiency, security and accessibility of these records, we are requesting the design and implementation...

59min ago

Go to Apply

Contracted Student Interns, North East Area Office

State of Massachusetts • Tewksbury, MA • 59min ago

Management & Administrative

The Department of Mental Health is seeking to hire an intern who will support the Northeast Area (NEA) in: · Collecting, analyzing, and comparing demographic and socioeconomic information for the DMH's services in the No...

59min ago

Go to Apply

Compliance Officer II

State of Massachusetts • Braintree, MA • 1h ago

Management & Administrative

THIS IS NOT AN INVESTIGATOR POSITION The Disabled Persons Protection Commission (DPPC) is an independent agency of the Commonwealth which conducts investigations of abuse and neglect of adults with disabilities; oversees...

1h ago

Go to Apply

Clerk IV, Acton Site Office

State of Massachusetts • Acton, MA • 1h ago

Management & Administrative

The Department of Mental Health is seeking a dynamic and energetic individual to perform clerical and administrative functions within the Acton Site Office. The selected candidate must be flexible, dependable, and intera...

1h ago

Go to Apply

Operations Manager

SRS Distribution Inc. • Malden, MA • 3h ago

Management & Administrative

Position Purpose: The Operations Manager at the Company plays a pivotal role in ensuring the efficient and accurate management of warehouse functions, including the supervision of drivers, loaders, and warehouse staff. T...

3h ago

Go to Apply

Senior Program Operations Manager, NGSR (Tucson, Andover, McKinney, or Huntsville)

RTX Corporation • Andover, MA • 3h ago

Management & Administrative

Date Posted: 2026-05-10 Country: United States of America Location: US-AZ-TUCSON-M09 ~ 3350 E Hemisphere Loop ~ BLDG M09 Position Role Type: Hybrid U.S. Citizen, U.S. Person, or Immigration Status Requirements: Active an...

3h ago

Go to Apply

Environmental Services / Custodial Operations Manager 2

Sodexo • Winchester, MA • 3h ago

Management & Administrative

Role Overview Sodexo is seeking an evening Environmental Services Operations Manager 2 for Winchester Hospital located in Winchester, MA . The Operations Manager will oversee a team of approximately 15 housekeepers on th...

3h ago

Go to Apply

Subscribe to get new jobs sent directly to you
(no charge, cancel anytime)