Applied Scientist (Contract), Artificial General Intelligence

Amazon • Boston, MA • 1d ago

Description

This is currently a 12 month temporary contract opportunity with the possibility to extend to 24 months based on business needs.

The Artificial General Intelligence (AGI) team is seeking a dedicated, skilled, and innovative Applied Scientist with a robust background in machine learning, statistics, quality assurance, auditing methodologies, and automated evaluation systems to ensure the highest standards of data quality, to build industry-leading technology with Large Language Models (LLMs) and multimodal systems.

Key job responsibilities

As part of the AGI team, an Applied Scientist will collaborate closely with core scientist team developing Amazon Nova models. They will lead the development of comprehensive quality strategies and auditing frameworks that safeguard the integrity of data collection workflows. This includes designing auditing strategies with detailed SOPs, quality metrics, and sampling methodologies that help Nova improve performances on benchmarks. The Applied Scientist will perform expert-level manual audits, conduct meta-audits to evaluate auditor performance, and provide targeted coaching to uplift overall quality capabilities. A critical aspect of this role involves developing and maintaining LLM-as-a-Judge systems, including designing judge architectures, creating evaluation rubrics, and building machine learning models for automated quality assessment. The Applied Scientist will also set up the configuration of data collection workflows and communicate quality feedback to stakeholders. An Applied Scientist will also have a direct impact on enhancing customer experiences through high-quality training and evaluation data that powers state-of-the-art LLM products and services.

A day in the life

An Applied Scientist with the AGI team will support quality solution design, conduct root cause analysis on data quality issues, research new auditing methodologies, and find innovative ways of optimizing data quality while setting examples for the team on quality assurance best practices and standards. Besides theoretical analysis and quality framework development, an Applied Scientist will also work closely with talented engineers, domain experts, and vendor teams to put quality strategies and automated judging systems into practice.

Basic Qualifications

Master's degree in engineering, statistics, computer science, mathematics, or a related quantitative field

2+ years of machine learning, statistical modeling, data mining, and analytics techniques experience

3+ years of programming in Java, C++, Python or related language experience

2+ years of building machine learning models or developing algorithms for business application experience

Preferred Qualifications

Ph.D. in engineering, technology, computer science, machine learning, robotics, operations research, statistics, mathematics or equivalent quantitative field

Have publications at top-tier peer-reviewed conferences or journals

4+ years of solving business problems through machine learning, data mining and statistical algorithms experience

Experience with Machine Learning and Large Language Model fundamentals, including architecture, training/inference lifecycles, and optimization of model execution, or experience debugging, profiling, and implementing best software engineering practices in large-scale systems

Amazon is an equal opportunity employer and does not discriminate on the basis of protected veteran status, disability, or other legally protected status.

Our inclusive culture empowers Amazonians to deliver the best results for our customers. If you have a disability and need a workplace accommodation or adjustment during the application and hiring process, including support for the interview or onboarding process, please visit https://amazon.jobs/content/en/how-we-hire/accommodations for more information. If the country/region you're applying in isn't listed, please contact your Recruiting Partner.

The starting pay for this position is listed below. Final starting pay will be based on factors including experience, qualifications, and location. Starting Day 1 of employment, Amazon offers EAP, Mental Health Support, Medical Advice Line, 401(k) matching. Learn more about our benefits at https://hiring.amazon.com/why-amazon/benefits .

USA, MA, Boston - 136,000.00 - 184,000.00 USD annually

USA, WA, Bellevue - 136,000.00 - 184,000.00 USD annually

Amazon

Go to Apply

Share this job

Similar Jobs

C/C++ Software Engineer II - Comms

RTX Corporation • Tewksbury, MA • 1h ago

IT & Engineering

Date Posted: 2026-01-27 Country: United States of America Location: US-MA-TEWKSBURY-TB3 ~ 50 Apple Hill Dr ~ CONCORD BLDG, Tewksbury Tb3 300 Concord Position Role Type: Onsite U.S. Citizen, U.S. Person, or Immigration St...

1h ago

Go to Apply

Assembly Technician - Second Shift

Teledyne • Billerica, MA • 2h ago

IT & Engineering

Be visionary Teledyne Technologies Incorporated provides enabling technologies for industrial growth markets that require advanced technology and high reliability. These markets include aerospace and defense, factory aut...

2h ago

Go to Apply

Assembly Technician

Teledyne • Billerica, MA • 2h ago

IT & Engineering

2h ago

Go to Apply

Engineering Mfg Liaison III

General Atomics • Acton, MA • 2h ago

IT & Engineering

53121BR Company: General Atomics Job Summary: General Atomics (GA), and its affiliated companies, is one of the world's leading resources for high-technology systems development ranging from the nuclear fuel cycle to rem...

2h ago

Go to Apply

Engineering Mentoring and Apprentice Program Lead

RTX Corporation • Tewksbury, MA • 2h ago

IT & Engineering

Date Posted: 2026-01-27 Country: United States of America Location: US-MA-TEWKSBURY-TB3 ~ 50 Apple Hill Dr ~ CONCORD BLDG, Tewksbury Tb3 300 Concord Position Role Type: Hybrid U.S. Citizen, U.S. Person, or Immigration St...

2h ago

Go to Apply

DoD Systems & Technology Roles

Applied Research Solutions • Bedford, MA • 2h ago

IT & Engineering

Description ARS is currently seeking skilled professionals with experience in the Department of Defense (DoD) sector to join our growing team at Hanscom Air Force Base in Bedford, Massachusetts. These roles offer excelle...

2h ago

Go to Apply

Senior Data Scientist (Hybrid)

Eversource Energy • Westwood, MA • 7h ago

IT & Engineering

Eversource will not offer immigration-related sponsorship for this position. Applicants who require immigration sponsorship-either now or in the future-should not apply. This includes, but is not limited to, direct compa...

7h ago

Go to Apply

Sr. Electrical Engineer

Adecco US, Inc. • Boston, MA • 14h ago

IT & Engineering

Job Title: Sr. Electrical Engineer Location: Boston, MA Job Type: Full-Time, Hybrid Schedule (3 days on-site per week) Salary: $120K - $140K Benefits: Medical, Dental, Vision, 401(k) and more Job Summary Adecco Permanent...

14h ago

Go to Apply

Software Engineer

Netapp • Waltham, MA • 14h ago

IT & Engineering

About Us Join our innovative and dynamic Cloud Engineering team at NetApp, where we are dedicated to pushing the boundaries of cloud technology. We are looking for a passionate and experienced Software Development Engine...

14h ago

Go to Apply

Software Engineer

Netapp • Waltham, MA • 14h ago

IT & Engineering

14h ago

Go to Apply

Subscribe to get new jobs sent directly to you
(no charge, cancel anytime)

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.