Software Engineer, GenAI Frameworks

Meta • New York, NY • 1h ago

Summary:

Meta is building the infrastructure and systems that power machine learning at scale across its family of products, including Feed, Reels, Ads ranking, and generative AI services. The Systems ML Engineering team sits at the intersection of ML and systems software, designing and optimizing the training and inference pipelines, distributed execution frameworks, and data processing systems that enable researchers and product teams to iterate quickly and deploy reliably. In this role, you will contribute to the full lifecycle of ML systems software - from designing scalable data pipelines and distributed training infrastructure to optimizing model serving latency and throughput - directly impacting the quality and speed of ML-powered experiences for billions of people.

Required Skills:

Software Engineer, GenAI Frameworks Responsibilities:

Design and implement scalable systems for distributed ML training and inference, including data ingestion pipelines, feature processing, and model serving infrastructure

Develop and optimize ML platform components such as training orchestration, gradient communication, and checkpoint management across large-scale distributed environments

Profile and diagnose performance bottlenecks across the ML stack, including data loading, preprocessing, forward and backward passes, and serving latency

Write automated tests covering expected behaviors, failure modes, and error paths for ML systems components, and build monitoring and alerting for production anomalies

Collaborate with ML researchers and product engineers to translate model requirements into reliable, high-throughput system designs

Own technical design for features and components within ML infrastructure, evaluating trade-offs between throughput, latency, cost, and engineering maintainability

Participate in staged rollouts of ML system changes using feature flagging and A/B testing frameworks, monitoring key metrics and responding to regressions

Contribute to code quality through code reviews, clear technical documentation, and consolidation of duplicative implementations across the ML systems codebase

Support on-call rotations for owned ML infrastructure, investigating production incidents and contributing detailed retrospectives to prevent recurrence

Minimum Qualifications:

Currently has, or is in the process of obtaining a Bachelor's degree in Computer Science, Computer Engineering, relevant technical field, or equivalent practical experience. Degree must be completed prior to joining Meta

2+ years of experience in software engineering with a focus on machine learning systems, distributed systems, or high-performance data infrastructure

Experience writing production-quality code in Python and at least one compiled language such as C++ or Java, including performance-sensitive systems code

Experience designing and implementing components of ML training or inference pipelines, including data preprocessing, model execution, or serving systems

Experience with distributed computing concepts such as data parallelism, model parallelism, or parameter server architectures as applied to ML workloads

Experience writing automated tests, building logging and alerting, and participating in production incident response for large-scale systems

Preferred Qualifications:

Experience optimizing ML workloads for throughput and latency, including profiling GPU or CPU utilization, memory bandwidth, and communication overhead in distributed training or inference settings

Experience adhering to and implementing responsible, ethical AI practices (e.g., risk assessment, bias mitigation, quality and accuracy reviews)

Experience with ML framework internals such as PyTorch or JAX, including custom operator development, execution graph optimization, or compiler integration

Experience with stream or batch data processing systems such as Apache Spark, Flink, or Kafka in the @context of ML feature pipelines

Demonstrated ability to integrate AI tools to optimize/redesign workflows and drive measurable impact (e.g., efficiency gains, quality improvements)

Demonstrated ongoing AI skill development (e.g., prompt/@context engineering, agent orchestration) and staying current with emerging AI technologies

1+ years production experience in GenAI post-training, RLHF, RLVR, comms/collectives, parallelism, accuracy evaluation, and performance profiling

Familiarity with model quantization, mixed-precision training, or other techniques for reducing compute and memory costs in production ML systems

Public Compensation:

$121,992/year to $181,000/year + bonus + equity + benefits

Industry: Internet

Equal Opportunity:

Meta is proud to be an Equal Employment Opportunity and Affirmative Action employer. We do not discriminate based upon race, religion, color, national origin, sex (including pregnancy, childbirth, or related medical conditions), sexual orientation, gender, gender identity, gender expression, transgender status, sexual stereo@types, age, status as a protected veteran, status as an individual with a disability, or other applicable legally protected characteristics. We also consider qualified applicants with criminal histories, consistent with applicable federal, state and local law. Meta participates in the E-Verify program in certain locations, as required by law. Please note that Meta may leverage artificial intelligence and machine learning technologies in connection with applications for employment.

Meta is committed to providing reasonable accommodations for candidates with disabilities in our recruiting process. If you need any assistance or accommodations due to a disability, please let us know at accommodations-ext@meta.com.

Similar Jobs

Sr. Software Engineer

NBC Universal • New York, NY • 1h ago

IT & Engineering

NBCUniversal is one of the world's leading media and entertainment companies. We create world-class content, which we distribute across our portfolio of film, television, and streaming, and bring to life through our glob...

1h ago

Go to Apply

Software Engineer, Simulation

Meta • New York, NY • 1h ago

IT & Engineering

Summary: We are seeking an experienced software engineer to join the MTIA (Meta Training and Inference Accelerator) software team, to work on simulators and other early software development platforms. The simulators you...

1h ago

Go to Apply

Software Engineer

NBC Universal • New York, NY • 1h ago

IT & Engineering

1h ago

Go to Apply

Senior AI Software Engineer

Humana • New York, NY • 1h ago

IT & Engineering

Become a part of our caring community The Senior Software Engineer codes software applications based on business requirements. The Senior Software Engineer work assignments involve moderately complex to complex issues wh...

1h ago

Go to Apply

Software Engineer, LLVM Compiler

Meta • New York, NY • 1h ago

IT & Engineering

Summary: We are seeking a software engineer to join the MTIA LLVM Compiler team, working on the compiler toolchain for Meta's custom silicon AI accelerators. You will be part of our efforts to architect, design, and impl...

1h ago

Go to Apply

Software Engineer, LLVM Compiler

Meta • New York, NY • 1h ago

IT & Engineering

1h ago

Go to Apply

Sr. Software Engineer, Automation Engineering

NBC Universal • New York, NY • 1h ago

IT & Engineering

1h ago

Go to Apply

Lead Software Engineer - AI

Humana • New York, NY • 1h ago

IT & Engineering

Become a part of our caring community The Lead Software Engineer codes software applications based on business requirements. The Lead Software Engineer works on problems of diverse scope and complexity ranging from moder...

1h ago

Go to Apply

Entry Level Technology Summer Analyst - Various Locations - NAELFY27

Accenture • New York, NY • 6h ago

IT & Engineering

Jumpstart your career with Accenture's Technology Summer Analyst Internship! Ready to make an impact? Join Accenture this summer and apply your skills to real-world challenges, helping top companies tackle their biggest...

6h ago

Go to Apply

Entry Level Pest Control Technician - Hazlet, NJ

Viking Termite and Pest Control, Inc. • Hazlet, NJ • 6h ago

IT & Engineering

Hazlet, NJ, USA | Hourly | 19-21 per hour | Full Time Pest Control Technician Competitive Compensation, Great Benefits, Growth Opportunities, Work/Life Balance Looking for a rewarding career, not just another job?Want ha...

6h ago

Go to Apply

Subscribe to get new jobs sent directly to you
(no charge, cancel anytime)