Software Engineer, Systems ML

Meta • Trenton, NJ • 1h ago

Summary:

Meta is seeking a Software Engineer to join our Systems ML Engineering team, focused on building and optimizing the machine learning infrastructure that powers Meta's products at massive scale. In this role, you will design and develop high-performance ML systems, working across the full stack from model training and inference pipelines to hardware-aware optimizations. You will collaborate with researchers, platform engineers, and product teams to accelerate ML workloads and improve the efficiency of AI infrastructure that serves billions of users.

Required Skills:

Software Engineer, Systems ML Responsibilities:

Design, build, and optimize large-scale ML training and inference systems, including distributed computing frameworks and hardware-accelerated pipelines

Develop and maintain high-performance ML infrastructure components in C++ and Python, ensuring reliability, scalability, and low-latency execution

Identify and resolve performance bottlenecks across the ML stack using profiling, instrumentation, and benchmarking tools

Architect and evaluate trade-offs in ML system design, including memory bandwidth, compute utilization, and I/O throughput

Partner with research and product teams to translate ML model requirements into efficient infrastructure solutions

Define and track system-level metrics and service level objectives to maintain production reliability of ML serving systems

Lead technical design reviews and contribute to engineering standards for ML systems across the organization

Mentor other engineers on ML infrastructure best practices, debugging methodologies, and performance optimization techniques

Drive adoption of AI-augmented development workflows to expand engineering productivity and broaden the scope of deliverables

Contribute to staged rollout strategies using feature flagging and experimentation frameworks to safely deploy ML system changes

Minimum Qualifications:

Bachelor's degree in Computer Science, Computer Engineering, relevant technical field, or equivalent practical experience

6+ years of experience in software engineering with a focus on machine learning systems, AI infrastructure, or high-performance computing

Experience developing and optimizing ML training or inference pipelines using frameworks such as PyTorch, TensorFlow, or equivalent

Experience with distributed computing architectures and large-scale systems design for ML workloads

Experience programming in C++ and Python for performance-critical systems

Experience using profiling and performance analysis tools to identify and resolve bottlenecks in ML or compute-intensive systems

Preferred Qualifications:

Experience optimizing large-scale ranking and recommendation model inference on AI accelerator hardware

Experience with hardware-software co-design, including numerics optimization and SIMD or vectorization techniques

Demonstrated ability to integrate AI tools to optimize/redesign workflows and drive measurable impact (e.g., efficiency gains, quality improvements)

Experience with GPU programming using CUDA, ROCm, or equivalent hardware accelerator kernel development

Experience with ML compiler technologies such as MLIR, LLVM, TVM, XLA, or IREE

Demonstrated ongoing AI skill development (e.g., prompt/@context engineering, agent orchestration) and staying current with emerging AI technologies

Experience adhering to and implementing responsible, ethical AI practices (e.g., risk assessment, bias mitigation, quality and accuracy reviews)

Public Compensation:

$154,003/year to $217,000/year + bonus + equity + benefits

Industry: Internet

Equal Opportunity:

Meta is proud to be an Equal Employment Opportunity and Affirmative Action employer. We do not discriminate based upon race, religion, color, national origin, sex (including pregnancy, childbirth, or related medical conditions), sexual orientation, gender, gender identity, gender expression, transgender status, sexual stereo@types, age, status as a protected veteran, status as an individual with a disability, or other applicable legally protected characteristics. We also consider qualified applicants with criminal histories, consistent with applicable federal, state and local law. Meta participates in the E-Verify program in certain locations, as required by law. Please note that Meta may leverage artificial intelligence and machine learning technologies in connection with applications for employment.

Meta is committed to providing reasonable accommodations for candidates with disabilities in our recruiting process. If you need any assistance or accommodations due to a disability, please let us know at accommodations-ext@meta.com.

Similar Jobs

Ruby Developer - Project Software Engineer III

Deloitte • Philadelphia, PA • 1h ago

IT & Engineering

Our Deloitte AI & Engineering team to transform technology platforms, drive innovation, and help make a significant impact on our clients' success. You'll work alongside talented professionals reimagining and reengin...

1h ago

Go to Apply

Senior Kotlin Software Engineer - DIRECT HIRE - NO THIRD PARTY CANDIDATES

Yoh Services • Philadelphia, PA • 1h ago

IT & Engineering

Open to 100% remote in EST and CSTIdeal profile is someone who has worked as a Tech Lead and managed 3-4 resources or more, mid size company with SaaS @type product focusSenior Software Engineer - ServicesPosition Overvi...

1h ago

Go to Apply

Entry Level Pest Control Technician - Middle Township, NJ

Viking Termite and Pest Control, Inc. • New Jersey, New Jersey • 6h ago

IT & Engineering

Middle Township, NJ, USA | Hourly | 19-21 per hour | Full Time Pest Control Technician Competitive Compensation, Great Benefits, Growth Opportunities, Work/Life Balance Looking for a rewarding career, not just another jo...

6h ago

Go to Apply

Infrastructure Engineer II - Middleware Administrator

Bank of America • Pennington, NJ • 8h ago

IT & Engineering

Infrastructure Engineer II - Middleware Administrator Pennington, New Jersey;Charlotte, North Carolina; Jacksonville, Florida To proceed with your application, you must be at least 18 years of age. Acknowledge ( https://...

8h ago

Go to Apply

TECHNICAL SUPPORT SPECIALIST

Naval Sea Systems Command • Philadelphia, PA • 8h ago

IT & Engineering

Summary This is a public notice flyer to notify interested applicants of anticipated vacancies. Applications will not be accepted through this flyer. Interested applicants must follow the directions in the "How to Apply"...

8h ago

Go to Apply

Senior Data Scientist (Remote)

GovCIO • Trenton, NJ • 8h ago

IT & Engineering

United States Suitability/Public Trust Fully remote Information Technology Overview GovCIO is currently hiring for a Data Scientist to support the Department of Veterans Affais (VA) data Modernization initiative. This po...

8h ago

Go to Apply

Analyst - Business Analyst

Eliassen Group • Trenton, NJ • 9h ago

IT & Engineering

Analyst - Business Analyst Anywhere Type: Consulting Category: Regulatory/Compliance Industry: Financial Services Workplace Type: Remote Standard Hours: Open Reference ID: JN -092026-108565 Date Posted: 09/10/2026 Shortc...

9h ago

Go to Apply

Application Engineer

Actalent • East Brunswick, NJ • 10h ago

IT & Engineering

Job Description: Act as the first line of customer technical support. Conduct initial troubleshooting, gather critical customer application parameters, and diagnose integration issues. Initiate and manage the Return Merc...

10h ago

Go to Apply

INFORMATION TECHNOLOGY SPECIALIST (SYSADMIN/OS)

Naval Sea Systems Command • Philadelphia, PA • 12h ago

IT & Engineering

12h ago

Go to Apply

IT SPECIALIST (NET)

Naval Sea Systems Command • Philadelphia, PA • 12h ago

IT & Engineering

12h ago

Go to Apply

Subscribe to get new jobs sent directly to you
(no charge, cancel anytime)