LLMOps Engineer

Steampunk • Mclean, VA • 4h ago

Overview

We are looking for a skilled LLMOps Engineer to help build, operate, and optimize the infrastructure and pipelines that power our predictive and generative AI capabilities. The LLMOps Engineer will work closely with AI Product Engineers, Data Scientists, and senior LLMOps staff to support the deployment, monitoring, and continuous improvement of LLM-based systems. This role is highly technical and hands-on, with opportunities to grow into senior roles through increasing independence, system ownership, and architectural contributions.

Contributions

Implement and maintain core LLM pipelines, including model hosting endpoints, embedding pipelines, retrieval layers, and vector database integrations.

Build automation for model versioning, dataset management, and configuration tracking to support reproducible and reliable GenAI development.

Develop monitoring and observability components for LLM-based applications, including metrics dashboards, alerting, and logging of model outputs and performance.

Collaborate with AI Product Engineers to move proto@types into production environments, supporting scalability, testing, and integration with mission systems.

Assist in configuring and optimizing inference runtimes, containers, and microservices to ensure responsive and cost-efficient model operations.

Contribute to CI/CD pipelines that support automated testing, evaluation workflows, and safe deployment of updated prompts, models, and @context strategies.

Help implement and maintain basic MLSecOps guardrails, such as input validation, prompt protections, and output filtering.

Participate in troubleshooting efforts, root-cause analysis, and issue resolution for operational incidents involving LLM pipelines or infrastructure.

Stay current with emerging tools, libraries, and practices for operationalizing LLMs, including orchestration frameworks and inference accelerators.

Document system workflows, runbooks, and operational best practices to support team knowledge growth and onboarding.

You will contribute to the growth of our AI & Data Exploitation Practice!

Qualifications

Ability to hold a position of public trust with the U.S. government.

Bachelor's or Master's degree in Computer Science, Data Engineering, Machine Learning, or a related field and 5+ years of experience; OR

Master's degree in Computer Science, Data Engineering, Machine Learning, or a related field and 3+ years of experience.

2+ years of experience in software engineering, DevOps, MLOps, cloud engineering, or data engineering, with exposure to LLM or ML model operations.

Proficiency in Python and familiarity with LLM-related tools and frameworks such as Hugging Face Transformers, LangChain, LlamaIndex, or similar.

Experience with containerization (Docker) and basic orchestration using Kubernetes or serverless model hosting environments.

Hands-on knowledge of cloud platforms (AWS, Azure, or GCP), including compute, storage, and networking fundamentals for AI workloads.

Familiarity with CI/CD pipelines, automated testing, and environment provisioning for AI or data systems.

Exposure to vector databases, embedding models, and RAG pattern implementations preferred.

Understanding of modern DevSecOps principles, security basics, and safe handling of data used in AI pipelines.

Strong debugging and problem-solving skills with an ability to collaborate in cross-functional engineering teams.

Strong written and verbal communication skills with the ability to document workflows and explain operational concepts.

Experience working in agile or iterative development environments is a plus.

About steampunk

Steampunk relies on several factors to determine salary, including but not limited to geographic location, contractual requirements, education, knowledge, skills, competencies, and experience. The projected compensation range for this position is $115,000 to $145,000. The estimate displayed represents a typical annual salary range for this position. Annual salary is just one aspect of Steampunk's total compensation package for employees. Learn more about additional Steampunk benefits here.

Identity Statement

As part of the application process, you are expected to be on camera during interviews and assessments. We reserve the right to take your picture to verify your identity and prevent fraud.

Steampunk is a Change Agent in the Federal contracting industry, bringing new thinking to clients in the Homeland, Federal Civilian, Health and DoD sectors. Through our Human-Centered delivery methodology , we are fundamentally changing the expectations our Federal clients have for true shared accountability in solving their toughest mission challenges. As an employee owned company , we focus on investing in our employees to enable them to do the greatest work of their careers - and rewarding them for outstanding contributions to our growth. If you want to learn more about our story, visit http://www.steampunk.com .

Refer a Friend (https://careers-steampunk.icims.com/jobs/7976/llmops-engineer/job?mode=apply&apply=yes&in_iframe=1&hashed=-336029103)

Need help finding the right job?

We can recommend jobs specifically for you!Software Powered by ICIMS (https://careers-steampunk.icims.com/connect?back=intro&findajob=1&in_iframe=1&hashed=-435593565)

Job Location US-VA-McLean

Posted Date 10 hours ago (7/29/2026 12:06 PM)

Job ID 7976

Clearance Requirement Public Trust

Similar Jobs

Senior Mechanical Engineer - CMTA Energy Solutions

CMTA, Inc • Washington, DC • 2h ago

IT & Engineering

CMTA, a Legence company CMTA ( https://www.cmta.com/ ) is one of the fastest growing engineering firms in the U.S., with nationally recognized expertise in sustainable, high-performance building engineering. We are a col...

2h ago

Go to Apply

Senior Mechanical Engineer - CMTA Energy Solutions

CMTA, Inc • Fairfax, VA • 2h ago

IT & Engineering

2h ago

Go to Apply

Senior Data Scientist

Parsons Corporation • Springfield, VA • 4h ago

IT & Engineering

In a world of possibilities, pursue one with endless opportunities. Imagine Next! At Parsons, you can imagine a career where you thrive, work with exceptional people, and be yourself. Guided by our leadership vision of v...

4h ago

Go to Apply

Data Scientist

CACI International • Springfield, VA • 4h ago

IT & Engineering

Job Title: Data Scientist Job Category: Information Technology Time Type: Full time Minimum Clearance Required to Start: TS/SCI with Polygraph Employee Type: Regular Percentage of Travel Required: None Type of Travel: No...

4h ago

Go to Apply

Data Scientist Associate

SAIC • District of Columbia, District of Columbia • 4h ago

IT & Engineering

Description SAIC has an opportunity for a Data Scientist. The role is remote with travel as needed. Drive internal process improvement initiatives by identifying inefficiencies and developing streamlined workflows that r...

4h ago

Go to Apply

Senior UX/UI Designer

Steampunk • Mclean, VA • 4h ago

IT & Engineering

Overview As a Senior UX Design Lead , you willbe responsible forguiding government clients through our Design Intelligenceframework, incorporating human-centered methods to solve complex user experience challenges. You w...

4h ago

Go to Apply

AI & GenAI Data Scientist-Director

PwC • Washington, DC • 4h ago

IT & Engineering

The Opportunity As an AI & GenAI Data Scientist-Director, you will leverage advanced technologies and techniques to design and develop robust data solutions for clients, transforming raw data into actionable insights...

4h ago

Go to Apply

Principal Associate, Data Scientist - Emerging ML

Capital One • Mclean, VA • 5h ago

IT & Engineering

Principal Associate, Data Scientist - Emerging ML Data is at the center of everything we do. As a startup, we disrupted the credit card industry by individually personalizing every credit card offer using statistical mod...

5h ago

Go to Apply

Electrical Engineer

Actalent • Rockville, MD • 5h ago

IT & Engineering

Job Title: Senior Electrical Engineer Job Description The Senior Electrical Engineer designs, develops, and integrates advanced electrical systems that support unmanned and autonomous platforms, including aerial and surf...

5h ago

Go to Apply

Senior Electrical Engineer

WSP USA • Arlington, VA • 5h ago

IT & Engineering

This Opportunity WSP is currently initiating a search for a Senior Electrical Engineer with the potential to work out of Arlington, VA; Virginia Beach, VA; San Antonio, TX; Dallas, TX; Tacoma, WA; Seattle, WA or Denver,...

5h ago

Go to Apply

Subscribe to get new jobs sent directly to you
(no charge, cancel anytime)