AI Engineer - Guardrails and Observability
Charlotte, North Carolina;Pennington, New Jersey; Richmond, Virginia; Plano, Texas; Jersey City, New Jersey
To proceed with your application, you must be at least 18 years of age.
Acknowledge (https://ghr.wd1.myworkdayjobs.com/Lateral-US/job/Charlotte/AI-Engineer---Guardrails-and-Observability_26033399)
Bank of America employees are required to meet all posting eligibility requirements prior to applying for any new position.
Acknowledge (https://ghr.wd1.myworkdayjobs.com/Lateral-US/job/Charlotte/AI-Engineer---Guardrails-and-Observability_26033399)
Refer a friend
To proceed with your application, you must be at least 18 years of age.
Acknowledge (https://ghr.wd1.myworkdayjobs.com/Lateral-US/job/Charlotte/AI-Engineer---Guardrails-and-Observability_26033399)
Bank of America employees are required to meet all posting eligibility requirements prior to applying for any new position.
Acknowledge (https://ghr.wd1.myworkdayjobs.com/Lateral-US/job/Charlotte/AI-Engineer---Guardrails-and-Observability_26033399)
Job Description:
At Bank of America, we are guided by a common purpose to help make financial lives better through the power of every connection. We do this by driving Responsible Growth and delivering for our clients, teammates, communities and shareholders every day.
Being a Great Place to Work and providing a culture of caring is core to how we drive Responsible Growth. We are intentional about fostering an inclusive workplace where every teammate has the opportunity to succeed, build a career and contribute to our shared success. This includes attracting and developing exceptional talent, recognizing and rewarding performance, and supporting our teammates' physical, emotional, and financial wellness through affordable, competitive and flexible benefits.
We value the unique perspectives individuals bring from all backgrounds and career paths - whether shaped by military service, community college education, or a wide range of work and life experiences. These journeys foster resilience, leadership and innovation, strengthening our workforce and positively impact the communities we serve.
Bank of America is committed to an in-office culture that supports collaboration, engagement, and career development. Our approach includes clear in-office expectations, while providing an appropriate level of flexibility based on role-specific responsibilities and business needs.
At Bank of America, you can build a successful career with opportunities to learn, grow, and make an impact. Join us!
Job Description:
This role centers on engineering and operating third-party applications end to end within an on-premises OpenShift platform. The position supports GenAI operations, including guardrails and observability for LLM and RAG-based applications across the enterprise. The engineer will deploy and support vendor platforms such as Galileo and LangSmith, monitor AI application quality and safety, maintain model evaluation workflows, and provide operational support in a fast-paced environment.
The domain is GenAI operations: the applications you run provide guardrails and observability for LLM- and RAG-powered systems across the enterprise. You will work with these vendor tools to monitor application quality, safety, and performance-tracking metrics such as attribution, grounding, prompt-injection detection, tone, bias, and PII handling-and surface them through dashboards and alerting. Where the platform uses model-based evaluation (LLMs-as-Judges and specialized/small language models), you will help operationalize, calibrate, and maintain those workflows.
Because the AI landscape changes quickly, the ideal engineer learns new tools and environments fast, brings a pragmatic build-and-operate mindset, and can lead cross-functional work to move initiatives forward.
Responsibilities:
Develop, deploy, and operate vendor applications in an on-premises OpenShift environment.
Build and maintain APIs and integrations connecting vendor guardrail and observability platforms to enterprise GenAI applications.
Monitor application performance, safety, latency, throughput, and guardrail metrics.
Implement and maintain model-based evaluation workflows, including annotation and calibration processes.
Utilize orchestration frameworks such as LangChain for guardrail checks, prompt management, and scoring workflows.
Build observability dashboards and alerting solutions.
Troubleshoot production issues and optimize performance, scalability, and resilience.
Contribute to emerging AI evaluation and guardrail strategies for agentic workflows.
Lead and mentor engineers while driving cross-functional initiatives and engineering best practices.
Required Qualifications:
Bachelor's or Master's degree in Computer Science, Data Science, MIS, or related field, or equivalent experience.
10+ years of software engineering experience building and scaling production applications.
Strong Python development experience, including common ML and data libraries.
Hands-on experience with OpenShift or Kubernetes in production environments.
Experience deploying and supporting LLM or RAG-based applications.
Understanding of AI risks, agent behavior, and governance frameworks.
Experience integrating third-party platforms and supporting vendor applications.
Experience with OpenAI APIs, LangChain, and GenAI development frameworks.
Knowledge of inference performance optimization and scalability.
Experience implementing AI guardrails, observability, and model evaluation processes.
Experience working in Agile environments.
Proven ability to lead technical initiatives and influence stakeholders.
Strong analytical, problem-solving, and communication skills.
Desired Qualifications:
Experience delivering technology solutions within large, regulated enterprise environments, preferably financial services.
Experience with annotation pipelines, feedback loops, fine-tuning, and alignment techniques.
Familiarity with prompt lifecycle management and versioning.
Experience with Galileo, LangSmith, Splunk, or similar observability platforms.
Familiarity with LlamaIndex, Haystack, or other GenAI frameworks.
Experience with evaluation and guardrails for agentic AI workflows.
Self-directed, collaborative working style across engineering teams.
Skills:
Application Development
Automation
Influence
Solution Design
Technical Strategy Development
Architecture
Business Acumen
DevOps Practices
Result Orientation
Solution Delivery Process
Analytical Thinking
Collaboration
Data Management
Risk Management
Test Engineering
Shift:
1st shift (United States of America)
Hours Per Week:
40
Bank of America and its affiliates consider for employment and hire qualified candidates without regard to race, religious creed, religion, color, sex, sexual orientation, genetic information, gender, gender identity, gender expression, age, national origin, ancestry, citizenship, protected veteran or disability status or any factor prohibited by law, and as such affirms in policy and practice to support and promote the concept of equal employment opportunity, in accordance with all applicable federal, state, provincial and municipal laws. The company also prohibits discrimination on other bases such as medical condition, marital status or any other factor that is irrelevant to the performance of our teammates.
View your "Know your Rights (https://www.eeoc.gov/sites/default/files/2023-06/22-088\EEOC\KnowYourRights6.12.pdf) " poster.
View the LA County Fair Chance Ordinance (https://dcba.lacounty.gov/wp-content/uploads/2024/08/FCOE-Official-Notice-Eng-Final-8.30.2024.pdf) .
Bank of America aims to create a workplace free from the dangers and resulting consequences of illegal and illicit drug use and alcohol abuse. Our Drug-Free Workplace and Alcohol Policy ("Policy") establishes requirements to prevent the presence or use of illegal or illicit drugs or unauthorized alcohol on Bank of America premises and to provide a safe work environment.
Bank of America is committed to an in-office culture with specific requirements for office-based attendance and which allows for an appropriate level of flexibility for our teammates and businesses based on role-specific considerations. Should you be offered a role with Bank of America, your hiring manager will provide you with information on the in-office expectations associated with your role. These expectations are subject to change at any time and at the sole discretion of the Company. To the extent you have a disability or sincerely held religious belief for which you believe you need a reasonable accommodation from this requirement, you must seek an accommodation through the Bank's required accommodation request process before your first day of work.
This communication provides information about certain Bank of America benefits. Receipt of this document does not automatically entitle you to benefits offered by Bank of America. Every effort has been made to ensure the accuracy of this communication. However, if there are discrepancies between this communication and the official plan documents, the plan documents will always govern. Bank of America retains the discretion to interpret the terms or language used in any of its communications according to the provisions contained in the plan documents. Bank of America also reserves the right to amend or terminate any benefit plan in its sole discretion at any time for any reason.
Investment products offered through MLPF&S and insurance and annuity products offered through MLLA:
Are Not FDIC Insured Are Not Bank Guaranteed May Lose Value
Are Not Deposits Are Not Insured by Any Federal Government Agency Are not a condition to Any Banking Service or Activity
Merrill Lynch, Pierce, Fenner & Smith Incorporated (also referred to as "MLPF&S" or "Merrill") makes available certain investment products sponsored, managed, distributed or provided by companies that are affiliates of Bank of America Corporation ("BofA Corp."). MLPF&S is a registered broker-dealer, registered investment adviser, Member SIPC and a wholly owned subsidiary of BofA Corp. Insurance and annuity products are offered through Merrill Lynch Life Agency Inc., a licensed insurance agency and wholly owned subsidiary of Bank of America Corporation.
Trust, fiduciary and investment management services are provided by Bank of America, N.A., Member FDIC and wholly owned subsidiary of Bank of America Corporation ("BofA Corp.").
Bank of America Private Bank is a division of Bank of America, N.A.
Banking products are provided by Bank of America, N.A. and affiliated banks, Members FDIC and wholly owned subsidiaries of Bank of America Corporation.
© 2026 Bank of America Corporation. All rights reserved.
