AI and ML HPC Cluster Engineer

NVIDIA • Santa Clara, CA • 1d ago

NVIDIA is a pioneer in accelerated computing, known for inventing the GPU and driving breakthroughs in gaming, computer graphics, high-performance computing, and artificial intelligence. Our technology powers everything from generative AI to autonomous systems, and we continue to shape the future of computing through innovation and collaboration. Within this mission, our team, Managed AI Superclusters (MARS) builds and scales the infrastructure, platforms, and tools that enable researchers and engineers to develop the next generation of AI/ML systems. By joining us, you'll help design solutions that power some of the world's most advanced computing workloads.

NVIDIA is looking for an AI/ML HPC Cluster Engineer to join our MARS team. You will provide technical engagement and problem solving on the management of large-scale HPC systems including the deployment of compute, networking, and storage. You will be working with a team of passionate and skilled engineers across NVIDIA that are continuously working to provide better tools to build and manage this infrastructure. Ideal candidate is strong in Linux administration, networking, storage, job schedulers, driving improvements, and has the ability to understand researcher computing needs.

What you'll be doing:

Support day-to-day operations of production on-premises and multi-cloud AI/HPC clusters, ensuring system health, user satisfaction, and efficient resource utilization.

Directly administer internal research clusters, conduct upgrades, incident response, and reliability improvements.

Develop and improve our ecosystem around GPU-accelerated computing including developing scalable automation solutions.

Maintain heterogeneous AI/ML clusters on-premises and in the cloud.

Support our researchers to run their workloads including performance analysis and optimizations

Analyze and optimize cluster efficiency, job fragmentation, and GPU waste to meet internal SLA targets.

Support root cause analysis and suggest corrective action. Proactively find and fix issues before they occur.

Triage and support postmortems for reliability incidents affecting users or infrastructure.

Participate in a shared on-call rotation supported by strong automation, clear paths for responding to critical issues, and well-defined incident workflows.

What we need to see:

Bachelor's degree in Computer Science, Electrical Engineering or related field or equivalent experience

Minimum 2 years of experience administering multi-node compute infrastructure

Background in managing AI/HPC job schedulers like Slurm, K8s, PBS, RTDA, BCM (formerly known as Bright), or LSF

Proficient in administering Centos/RHEL and/or Ubuntu Linux distributions

Proven understanding of cluster configuration management tools (Ansible, Puppet, Salt, etc.), container technologies (Docker, Singularity, Podman, Shifter, Charliecloud), Python programming, and bash scripting.

Passion for continual learning and staying ahead of emerging technologies and effective approaches in the HPC and AI/ML infrastructure fields.

Ways to stand out from the crowd:

Background with NVIDIA GPUs, CUDA Programming, NCCL and MLPerf benchmarking

Experience with AI/ML concepts, algorithms, models, and frameworks (PyTorch, Tensorflow)

Experience with InfiniBand with IBOP and RDMA

Understanding of fast, distributed storage systems such as Lustre and GPFS for AI/HPC workloads

Applied knowledge in AI/HPC workflows that involve MPI

Your base salary will be determined based on your location, experience, and the pay of employees in similar positions. The base salary range is 120,000 USD - 189,750 USD.

You will also be eligible for equity and benefits (https://www.nvidia.com/en-us/benefits/) .

Applications for this job will be accepted at least until January 6, 2026.

NVIDIA is committed to fostering a diverse work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.

IT & Engineering

Staff Software Engineer, Borglet Offloads corporatefare_ Google place Sunnyvale, CA, USA; Kirkland, WA, USA; +2 more; +1 more Advanced Experience owning outcomes and decision making, solving ambiguous problems and influe...

15h ago

Go to Apply

Distinguished Engineer, GPU Fleet Operations Automation

NVIDIA • Santa Clara, CA • 15h ago

IT & Engineering

NVIDIA is leading the industry in delivering accelerated computing in cloud and enterprise environments. We're a team of innovative engineers dedicated to solving some of the world's biggest challenges, constantly drivin...

15h ago

Go to Apply

Graveyard Stationary Engineer

ABM Industries • Santa Clara, CA • 21h ago

IT & Engineering

Overview The Overnight Stationary Engineer plays a crucial role in ensuring the safe, efficient, and effective operation of all building systems. This position involves maintaining, troubleshooting, and repairing a wide...

21h ago

Go to Apply

Senior Wet Etch Equipment Engineer, Raxium

Google • Fremont, CA • 21h ago

IT & Engineering

Senior Wet Etch Equipment Engineer, Raxium corporatefare_ Google place Fremont, CA, USA Mid Experience driving progress, solving problems, and mentoring more junior team members; deeper expertise and applied knowledge wi...

21h ago

Go to Apply

LF - Staff Data Engineer

Intuit • Mountain View, CA • 1d ago

IT & Engineering

Overview Come join the Data Solutions Engineering Team as a Staff Data Engineer. We are leveraging big data technologies to gain new insights into our Fintech Data Engineering function using data frameworks, ingestion pi...

1d ago

Go to Apply

Acura Technician

Hendrick Automotive Company • Pleasanton, CA • 2d ago

IT & Engineering

Acura of Pleasanton Location: 4355 Rosewood Dr, Pleasanton, California 94588 Summary: Responsible for identifying necessary vehicle service and performing the repair, service, and/or maintenance work. Supervisory Respons...

2d ago

Go to Apply

Subscribe to get new jobs sent directly to you
(no charge, cancel anytime)

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.