AI Platform Engineer

NYU Rory Meyers College of Nursing • New York, NY • 28min ago

Position Summary

The AI Platform Engineer is a senior technical individual contributor responsible for building, operating, and continuously improving the shared infrastructure and platform services that enable secure, reliable, and scalable use of artificial intelligence across New York University (NYU). This position develops and maintains the core technical foundation supporting NYU's enterprise AI capabilities-including cloud infrastructure, model gateways and routing, APIs, identity and access management (IAM), automated deployment pipelines, observability, usage/cost telemetry, and overall platform reliability. Working within architectural patterns established by the AI Solutions Architect and adhering to institutional security and technology standards, the AI Platform Engineer translates AI architecture into production-ready infrastructure and reusable platform capabilities. This role is highly hands-on and is expected to build, automate, and operate infrastructure directly.

Qualifications

Required Education:

Bachelor's Degree Bachelor's degree in Computer Science, Engineering, Information Technology, or a related quantitative field, or an equivalent combination of education and experience.

Required Experience:

3+ years of progressive experience in platform engineering, cloud engineering, DevOps/SRE, software engineering, or related infrastructure engineering roles, with direct experience operating production cloud services at scale.

Preferred Experience:

3+ years Experience configuring and managing Portkey or comparable enterprise AI gateways and LLM proxy systems. Familiarity with specialized AI observability and evaluation frameworks (e.g., LangSmith, Phoenix, Arize, Traceloop). Experience with FinOps practices applied specifically to token-based consumption and AI workloads. Experience delivering and supporting infrastructure services in a large, federated, higher-education, research institution, or similarly decentralized enterprise environment.

Required Skills, Knowledge and Abilities:

Cloud Infrastructure: Deep experience with AWS cloud services and cloud-native architecture (experience with AWS Bedrock is highly desirable). Infrastructure-as-Code: Demonstrated proficiency with Terraform, AWS CloudFormation, or equivalent IaC tools. Containers & Orchestration: Hands-on experience with Docker and Kubernetes (EKS) or AWS ECS. Automation & CI/CD: Hands-on experience building and supporting CI/CD pipelines (e.g., GitHub Actions, GitLab CI, Jenkins) and modern source control strategies. APIs & Security: Strong foundation in API design, gateway management, authentication mechanisms (OAuth2, OIDC), service-to-service communication, IAM, secrets management (e.g., AWS Secrets Manager, HashiCorp Vault), and cloud network security. Observability: Practical experience setting up metrics, logging, distributed tracing, and alerting tools (e.g., Prometheus, Grafana, Datadog, AWS CloudWatch, OpenTelemetry). Programming Languages: Proficiency in Python and/or modern programming languages used for automation and platform tooling. GenAI / LLM Domain Expertise: Practical working knowledge of LLM APIs, foundation models, token-based usage models, model routing/gateways, streaming responses, rate limiting, and the operational constraints/latency characteristics of Generative AI services.

Additional Information

In compliance with NYC's Pay Transparency Act, the annual base salary range for this position is USD $170,000.00 to USD $190,000.00. New York University considers factors such as (but not limited to) scope and responsibilities of the position, candidate's work experience, education/training, key skills, internal peer equity, as well as, market and organizational considerations when extending an offer. This pay range represents base pay only and excludes any additional items such as incentives, bonuses, clinical compensation, or other items.

NYU aims to be among the greenest urban campuses in the country and carbon neutral by 2040. Learn more at nyu.edu/nyugreen.

NYU is an Equal Opportunity Employer and is committed to a policy of equal treatment and opportunity in every aspect of its recruitment and hiring process without regard to age, alienage, caregiver status, childbirth, citizenship status, color, creed, disability, domestic violence victim status, ethnicity, familial status, gender and/or gender identity or expression, marital status, military status, national origin, parental status, partnership status, predisposing genetic characteristics, pregnancy, race, religion, reproductive health decision making, sex, sexual orientation, unemployment status, veteran status, or any other legally protected basis. All interested persons are encouraged to apply at all levels.

Share this job (https://uscareers-nyu.icims.com/jobs/17052/ai-platform-engineer/job?mode=apply&apply=yes&in_iframe=1&hashed=-336115631)

Need help finding the right job?

We can recommend jobs specifically for you!

Posting Number2026-17052

Posted Date44 minutes ago(11/11/2026 4:17 PM)

Location : LocationUS-NY-New York

Hybrid Remote Work ClassificationHybrid: 60% to 80% Onsite

DepartmentArtificial Intelligence

School/DivisionNYU IT (WS1170)

Lockheed Martin • Uniondale, NY • 20h ago

IT & Engineering

Standard Job Description At Lockheed Martin we keep people safe and solve the world's most complex challenges. Our people are some of the greatest minds in the industry and truly make Lockheed Martin a great place to wor...

20h ago

Go to Apply

Associate, Mechanical Engineering

L3Harris • Clifton, NJ • 21h ago

IT & Engineering

21h ago

Go to Apply

Structural Engineering Associate (Ph.D.)

Exponent • New York, NY • 22h ago

IT & Engineering

Structural Engineering Associate (Ph.D.)ID2026-2673LocationUS-NY-New YorkPracticeCivil and Structural EngineeringPosition TypeFull-timePosted Salary RangeUSD $117,000.00 - USD $145,000.00 /Yr.Workplace TypeOn-SiteAbout E...

22h ago

Go to Apply

Java Lead Software Engineer

JPMorgan Chase • Jersey City, NJ • 22h ago

IT & Engineering

Java Lead Software Engineer Jersey City, NJ, United States Job Information Job Identification 210807488 Job Category Software Engineering Business Unit Consumer & Community Banking Posting Date 11/10/2026, 09:44 PM L...

22h ago

Go to Apply

Director, Lead Software Engineer

Morgan Stanley Services Group Inc. • Jersey City, NJ • 22h ago

IT & Engineering

Experience Required -Requires five (5) years of experience in the position offered or five (5) years as a Software Engineer, Consultant, Programmer Analyst, or a related occupation. Minimum Education Required -Requires a...

22h ago

Go to Apply

Senior Software Engineer

Capgemini • New York, NY • 22h ago

IT & Engineering

Senior Software Engineer Choosing Capgemini means choosing a company where you will be empowered to shape your career in the way you'd like, where you'll be supported and inspired by a collaborative community of colleagu...

22h ago

Go to Apply

Subscribe to get new jobs sent directly to you
(no charge, cancel anytime)