Principal Software Engineer - LLM, AI, AWS, RAG

JPMorgan Chase • Wilmington, DE • 2d ago

If you are looking for a game-changing career, working for one of the world's leading financial institutions, you've come to the right place.

As a Principal Software Engineer at JPMorgan Chase within the Corporate Sector - AI/ML Data Platforms team, you provide expertise and engineering excellence as an integral part of an agile team to enhance, build, and deliver trusted market-leading technology products in a secure, stable, and scalable way. Leverage your advanced technical capabilities and collaborate with colleagues across the organization to promote best-in-class outcomes across various technologies to support one or more of the firm's portfolios.

Job responsibilities

Build AI enabled consumer centric and business use-case products using LLMs, RAG, Agents

Design, develop software solutions, and technical troubleshooting with ability to think beyond routine or conventional approaches to build solutions or break down technical problems.

Develops secure high-quality production code, and reviews and debugs code written by others.

Develops innovative AI/ML solutions for the LLM Suite platform utilizing public cloud architecture and modern standards, specifically with Azure, AWS using both commercial and open source models

Leads communities of practice across Software Engineering to drive awareness and use of new and leading-edge technologies.

Influences leaders and senior stakeholders across business, product, and technology teams

Creates durable, reusable software frameworks that are leveraged across teams and functions.

Adds to team culture of diversity, equity, inclusion, and respect.

Required qualifications, capabilities, and skills

Formal training or certification on software engineering concepts and 10+ years applied experience

Hands on experience of Large Language Model (LLM) techniques, including Agents, Planning, Reasoning, and other related methods.

Hands-on experience delivering system design, application development, testing, load testing, scaling, resiliency of AI Solutions

Cloud native experience with AWS, Azure

Proficient in building scalable, resilient, secure systems with AI models and distribute compute technologies.

Ability to present and effectively communicate with Senior Leaders and Executives

In-depth experience with /Ranking, Recommender systems, RAG (Similarity Search), Agent systems, and other advanced methodologies.

Experience in Computer Science, Computer Engineering, Mathematics, or a related technical field.

Preferred qualifications, capabilities, and skills

Experience with JAX, Ray, MLFlow, and/or other distributed training frameworks.

Familiarity with NL 2SQL systems

Experience with fine-tuning LLMs for specific usecases

JPMorganChase, one of the oldest financial institutions, offers innovative financial solutions to millions of consumers, small businesses and many of the world's most prominent corporate, institutional and government clients under the J.P. Morgan and Chase brands. Our history spans over 200 years and today we are a leader in investment banking, consumer and small business banking, commercial banking, financial transaction processing and asset management.

We offer a competitive total rewards package including base salary determined based on the role, experience, skill set and location. Those in eligible roles may receive commission-based pay and/or discretionary incentive compensation, paid in the form of cash and/or forfeitable equity, awarded in recognition of individual achievements and contributions. We also offer a range of benefits and programs to meet employee needs, based on eligibility. These benefits include comprehensive health care coverage, on-site health and wellness centers, a retirement savings plan, backup childcare, tuition reimbursement, mental health support, financial coaching and more. Additional details about total compensation and benefits will be provided during the hiring process.

We recognize that our people are our strength and the diverse talents they bring to our global workforce are directly linked to our success. We are an equal opportunity employer and place a high value on diversity and inclusion at our company. We do not discriminate on the basis of any protected attribute, including race, religion, color, national origin, gender, sexual orientation, gender identity, gender expression, age, marital or veteran status, pregnancy or disability, or any other basis protected under applicable law. We also make reasonable accommodations for applicants' and employees' religious practices and beliefs, as well as mental health or physical disability needs. Visit our FAQs for more information about requesting an accommodation.

JPMorgan Chase & Co. is an Equal Opportunity Employer, including Disability/Veterans

Base Pay/Salary

Jersey City,NJ $204,250.00 - $285,000.00 / year; New York,NY $204,250.00 - $285,000.00 / year

Similar Jobs

Buildings and Systems Engineering Specialist

UPS • West Chester, PA • 5h ago

IT & Engineering

Before you apply to a job, select your language preference from the options available at the top right of this page. Explore your next opportunity at a Fortune Global 500 organization. Envision innovative possibilities,...

5h ago

Go to Apply

R&D Product Development Engineer

J&J Family of Companies • West Chester, PA • 5h ago

IT & Engineering

At Johnson & Johnson,?we believe health is everything. Our strength in healthcare innovation empowers us to build a?world where complex diseases are prevented, treated, and cured,?where treatments are smarter and les...

5h ago

Go to Apply

Electrical Reliability Engineer

Monroe Energy • Trainer, PA • 7h ago

IT & Engineering

Job Descriptions: Key Role Description Takes ownership of the plant power system by providing electrical technical expertise and engineering support for all electrical equipment and distribution systems. Ensures a strong...

7h ago

Go to Apply

Senior Engineer-AI Inference

Bank of America • Newark, DE • 16h ago

IT & Engineering

Senior Engineer-AI Inference Addison, Texas;Charlotte, North Carolina; Kennesaw, Georgia; Newark, Delaware To proceed with your application, you must be at least 18 years of age. Acknowledge Refer a friend To proceed wit...

16h ago

Go to Apply

Software Engineer III- AI/RAG

Bank of America • Newark, DE • 16h ago

IT & Engineering

Software Engineer III- AI/RAG Addison, Texas;Charlotte, North Carolina; Kennesaw, Georgia; Newark, Delaware To proceed with your application, you must be at least 18 years of age. Acknowledge Refer a friend To proceed wi...

16h ago

Go to Apply

Sr Architect-AI/ML/GenAI

Bank of America • Newark, DE • 16h ago

IT & Engineering

Sr Architect-AI/ML/GenAI Addison, Texas;Charlotte, North Carolina; Kennesaw, Georgia; Newark, Delaware To proceed with your application, you must be at least 18 years of age. Acknowledge Refer a friend To proceed with yo...

16h ago

Go to Apply

Information Technology Intern

Arora Engineers Inc. • Chadds Ford, PA • 1d ago

IT & Engineering

Reference #: 369084 Job Details Job Location AEI - Chadds Ford - [7CFD] - Chadds Ford, PA Position Type Full-Time/Part-Time Education Level Not Specified Job Category Information Technology Description We are seeking a m...

1d ago

Go to Apply

Director, Global Technology Solutions

Arora Engineers Inc. • Chadds Ford, PA • 1d ago

IT & Engineering

Reference #: 369037 Job Details Job Location ATG - Chadds Ford - Chadds Ford, PA Education Level 4 Year Degree Travel Percentage Up to 25% Job Category Information Technology Description Overall Responsibility: This high...

1d ago

Go to Apply

Senior Engineer - Electrical Power System Studies (EHV Focus) Job Details | Black & Veatch Family of Companies

Black & Veatch • Wilmington, DE • 1d ago

IT & Engineering

Senior Engineer - Electrical Power System Studies (EHV Focus) Date: Jul 28, 2025 Location: Dallas, TX, US US Phoenix, AZ, US Cary, NC, US Overland Park, KS, US Ann Arbor, MI, US Houston, TX, US Company: Black & Veatc...

1d ago

Go to Apply

Electrical Reliability Engineer Share

Monroe Energy, LLC • Marcus Hook, PA • 1d ago

IT & Engineering

Reference #: 900636 Job Description Key Role Description Takes ownership of the plant power system by providing electrical technical expertise and engineering support for all electrical equipment and distribution systems...

1d ago

Go to Apply

Subscribe to get new jobs sent directly to you
(no charge, cancel anytime)

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.