Software Engineer

Meta • United States, United States • 21h ago

Summary:

Meta is seeking a Software Engineer to join our team. The ideal candidate is someone with experience working on maximizing performance of AI models on GPUs or custom silicon. This role involves applying these skills to solve some of the most crucial and exciting problems that exist on the web. The AI Applications Engineering team is dedicated to maximizing training and inference performance of Generative AI (GenAI) and Recommendation models on Meta's Training and Inference Accelerator (MTIA). We employ innovative optimization and parallelization strategies to maximize training throughput for the next generations of GenAI and recommendation models. Additionally, we work cross-functionally with many partner teams to ensure end-to-end performance of large-scale pre-training and inference, enabling us to deliver the next generation of AI experiences more quickly to our users.

Required Skills:

Software Engineer Responsibilities:

Work cross-functionally to co-design models to maximize pre-training and inference efficiency

Applying and driving state-of-the-art optimization techniques to our latest large-scale AI workloads running on Meta's fleet of accelerators including functional development and maintenance

Profiling, analyzing, debugging, and optimizing large-scale workloads on our next-generation training superclusters

Optimization of the underlying processes of the whole vertical stack, from kernels, framework, communication, and firmware to layers and hyperparameters

Set direction and goals for the team related to project impact, capacity, and developer efficiency

Lead large and complex technical efforts across many engineers and teams from zero to one

Minimum Qualifications:

Bachelor's degree in computer science or a related STEM field

Experience programming AI accelerators (e.g. GPUs, custom silicon etc.) using AI frameworks such as PyTorch or similar

Experience developing custom kernels and compiler infrastructure to improve performance using low-level programming models such as CUDA, OpenCL or similar

Minimum 6+ years of experience developing and optimizing performance in modern C/C++

Must obtain work authorization in the country of employment at the time of hire, and maintain ongoing work authorization during employment

Preferred Qualifications:

Experience with training and validating large-scale AI models, including parallelising models across several accelerators

Understanding of multiprocessing, including race conditions and communications between processes

Experience of evaluating model performance, e.g., with profilers and tuning hyperparameters

Thorough understanding of model and data parallelisms such as FSDP, tensor parallelism, model parallelism, expert parallelism, etc

Demonstrated experience of the model life cycle from pre-training and post-training to inference, dataset splits and shuffling, metrics, especially for large language models

Experience of developing, optimizing and validating kernels on GPUs or other accelerators

Industry: Internet

Similar Jobs

Senior Security Engineer

Tech5 Solutions Inc. • Full-time • Hybrid, Virginia, United States • $140k - $150k / year • 2w ago

IT & Engineering Security Engineer System Engineer Network Engineer

Security Engineer Job Tittle: Senior Security Engineer Clearance: Secret Location: Springfield, VA The Security Engineering Team (SET) is required to provide network maintenance and special projects engineering su...

2w ago

Go to Apply

Engineering Technician - Plumbing

MSA PROFESSIONAL SERVICES INC • Mequon, WI • 3min ago

IT & Engineering

JOB REQUIREMENTS: Responsibilities Your Mission Modeling assignments: Draft engineering drawings using BIM (Revit), CAD, or manual skills, ensuring they meet company standards. Construction Services: Be on the front line...

3min ago

Go to Apply

Project Engineer - Transportation

MSA PROFESSIONAL SERVICES INC • Baraboo, WI • 3min ago

IT & Engineering

JOB REQUIREMENTS: Responsibilities What you will do: Lead project planning, budgeting, and quality control Build strong client relationships through meetings and collaboration Design transportation infrastructureroads, b...

3min ago

Go to Apply

Engineering Technician II Civil

MSA PROFESSIONAL SERVICES INC • Baraboo, WI • 3min ago

IT & Engineering

JOB REQUIREMENTS: Responsibilities The work you will do Construction inspection on a variety of municipal projects Quantity verification and Contractor communication Reviewing and understanding design plans Computations,...

3min ago

Go to Apply

Project Engineer Public Works

MSA PROFESSIONALS SERVICES • Milwaukee, WI • 3min ago

IT & Engineering

JOB REQUIREMENTS: Responsibilities The work you will do Client relations including attendance at client meetings and interaction with existing and new clients Project management including project planning, scoping, budge...

3min ago

Go to Apply

S063 Intern Engineering Support

TEXAS DEPARTMENT OF TRANSPORTATION • Fort Worth, TX • 3min ago

IT & Engineering

Must be enrolled in an engineering or related science degree program in an accredited college or university accepted by TX PELS. Assists in transportation engineering support work such as construction or maintenance insp...

3min ago

Go to Apply

Senior Engineering Technician Civil

MSA PROFESSIONAL SERVICES INC • Baraboo, WI • 3min ago

IT & Engineering

3min ago

Go to Apply

Graduate Engineer Public Works

MSA PROFESSIONAL SERVICES, INC. • Appleton, WI • 3min ago

IT & Engineering

JOB REQUIREMENTS: Responsibilities The work you will do Inspect active construction work on municipal water, road/utilities, or wastewater projects Construction staking and site surveys Assist with CAD work and project e...

3min ago

Go to Apply

Project Engineer - Public Works

MSA PROFESSIONAL SERVICES INC • Baraboo, WI • 3min ago

IT & Engineering

3min ago

Go to Apply

Electrical Apprentice

Marietta Electrical JATC • Pomeroy, OH • 5min ago

IT & Engineering

Interest applicants must start the process at either: Washington, Meigs, Noble or Monroe County OhioMeansJobs Centers. After completing the aptitude test the application will need to be brought to the MEJATC Training Cen...

5min ago

Go to Apply

Subscribe to get new jobs sent directly to you
(no charge, cancel anytime)

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.