Senior AI Engineer (Hybrid in NYC or CT)

Insight Global • New York, NY • 1h ago

Job Description

We are looking for a highly motivated, creative Senior AI Engineer who thrives in a fast-paced environment who takes ownership from concept to production. In this role, you will work closely with product managers and AI platform engineers to turn evolving ideas into secure, scalable, and logically sound AI-powered features.

You will be expected to operate with minimal supervision, make excellent technical trade-off decisions, and balance speed with engineering discipline. This role is ideal for an engineer who can adapt quickly, respond to changing priorities, and still deliver high-quality, production solutions where end users are already actively engaging with agentic experiences!

Key Responsibilities

AI Feature Development & Ownership

Partner with a cross-functional team of engineers, data scientists, technical program managers, and product managers to deliver AI-powered products that change how productively customers and employees conduct their work.

Design and implement the Agentic AI workflows from orchestration for reasoning, decomposing user requests, planning and managing tasks to agents, MCPs, tools and new agentic frameworks like A2UI that enable and scale such production workflows securely with considerations for error and exception handling and human-in-the-loop feedback.

Implement verification layers, citations, and security guardrails to ensure agents operate more predictably and safely under similar circumstances, akin to treating prompts as unverified code and model outputs as untrusted that requires validation

Translate rapidly evolving product needs and frequent pivots into clear technical designs and working implementations.

Build advanced Retrieval-Augmented Generation (RAG) pipelines and MCP and tool use capabilities, allowing agents to query databases, call internal APIs, and synthesize data from disparate sources

Lead technical direction and collaborate with different groups to define the roadmap for AI orchestration for internal and external facing agentic workflows

Take end-to-end ownership of features, including experimentation, iteration, deployment, and operational support.

Rapidly proto@type and iterate while ensuring production implementations remain robust and maintainable.

Collaboration & Product Partnership

Partner closely with product managers to continuously refine feature scope, user experience, and technical feasibility.

Collaborate with AI platform engineers to leverage shared infrastructure, tooling, and standards.

Provide technical input that helps teams navigate tradeoffs in a dynamic, fast-moving delivery environment.

Act as a bridge between shifting product direction and stable technical execution.

Mentor other engineers and raise the bar for AI engineering practices across the organization.

Engineering Rigor & Security

Ensure AI solutions are secure by design, even as requirements and priorities change.

Build systems that are logically sound, testable, and resilient under continuous iteration.

Apply strong software engineering practices, including testing, versioning, monitoring, and documentation.

Identify and mitigate risks related to model behavior, performance, reliability, and misuse.

AI Systems & Integration

Develop and integrate AI solutions using modern techniques such as LLMs, retrieval-augmented generation (RAG), agents, MCPs and APIs.

Implement prompt engineering, evaluation strategies, and feedback loops to improve AI quality over time.

Integrate AI capabilities into existing applications, services, and workflows.

Monitor and continuously improve model behavior, latency, cost, and user outcomes in production.

We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.

Skills and Requirements

Able to work hybrid in either NYC, NY or Stamford, CT

7+ years of professional software engineering experience, with significant experience building AI-enabled systems.

Strong proficiency in Python and experience integrating AI/ML or LLM-based services, Javascript or Typescript frameworks for UI rendering.

Demonstrated ability to operate independently and make high-quality technical decisions in fast-paced environments.

Experience delivering production systems amid changing priorities and frequent pivots.

Strong understanding of software design, APIs, distributed systems, database queries on RDMS, data warehouses and cloud architectures.

Solid grasp of security, data privacy, and access control considerations in AI systems.

Similar Jobs

Data Scientist

CVS Health • New York, NY • 1h ago

IT & Engineering

We're building a world of health around every individual - shaping a more connected, convenient and compassionate health experience. At CVS Health®, you'll be surrounded by passionate colleagues who care deeply, innovate...

1h ago

Go to Apply

Research Engineer, GenMedia

Google • New York, NY • 2h ago

IT & Engineering

Snapshot Join the GenMedia team where we research and develop cutting-edge machine learning models for billions of Google users. We are working on the intersection of video understanding and generation and contribute to...

2h ago

Go to Apply