Developersummit
  • HOME
  • CALL FOR PAPERS
  • BUY TICKETS
  • CONTACT
  • INSIGHTS
  • ONDEMAND
saltmarch

GIDS news media, articles, insights and virtual events educate and illuminate its audiences so they can be fully prepared to deal with the new realities at work and in their professions.

Saltmarch On-Demand
Media

Our Experts

Videos On Demand

Insights

Call for Papers

Connect

About Us

Privacy Policy

Terms & Conditions

Code of Conduct

Contact Us

Subscribe to Developersummit

Get the latest event updates, and insights from today's leading voices.

© 2026-2027 Saltmarch. All rights reserved.

When Healthy Agents Fail: 12 Patterns from Production
RegisterTwitterLinkedInFacebook

< session />

When Healthy Agents Fail: 12 Patterns from Production

Thu, January 1AI-NativePlatform Engineering & DevOps

Production AI agent systems can appear healthy by every traditional operational measure while delivering a steadily degrading user experience. Latency remains low, tool execution succeeds, databases remain healthy, and dashboards stay green. Yet users report responses becoming increasingly vague, hesitant, and less useful over time.

The problem is not operational failure. It is behavioural degradation.

Traditional reliability patterns such as circuit breakers, caching, retries, and distributed tracing were designed to detect systems that stop working. They are far less effective at detecting systems that continue functioning while their behaviour deteriorates.

This session examines five production incidents from LangGraph-based agent systems that exposed a gap between infrastructure health and user experience. Attendees will see how unbounded memory injection reduced response quality over multi-turn conversations without triggering alerts, how semantic caching served confidently incorrect answers, why OAuth refresh races emerged under concurrent streaming workloads, how conventional circuit-breaker strategies increased cloud costs, and how observability broke down once requests crossed into Server-Sent Events (SSE).

Rather than treating these as isolated incidents, the session extracts a set of production patterns for operating AI agents. These patterns address concerns that rarely appear in tutorials or benchmarks, including memory lifecycle management, cache correctness, streaming-safe authentication, latency-aware failure handling, and observability across protocol boundaries.

Throughout the session, attendees will work directly from production artifacts, including incident logs, quality metrics, traces, latency distributions, authentication failures, dashboards, and code. Every lesson is grounded in a real failure, the investigation that followed, and the engineering changes required to prevent recurrence.

Attendees will leave with practical patterns, operational metrics, and architectural guardrails that can be applied across agent platforms, including LangGraph, CrewAI, AutoGen, and custom orchestration systems. The focus is on the production realities of keeping AI agents reliable when infrastructure health and user experience no longer tell the same story.

What You Will Learn:

  • How behavioural degradation can emerge even when traditional operational metrics remain healthy
  • Production patterns for memory management, cache correctness, authentication, failure handling, and observability
  • Practical lessons drawn from real incidents, investigations, and remediation efforts in production agent systems

Who Should Attend:

  • AI engineers
  • Platform engineers
  • SREs and reliability engineers
  • Staff and principal engineers
  • Architects building agent-based systems
  • Technical leads responsible for production AI systems
  • Teams operating LangGraph, CrewAI, AutoGen, or custom agent platforms

< speaker_info />

About the speaker

Tuhin Sharma

Tuhin Sharma

Technical Advisor, Data & AI, Red Hat

Tuhin Sharma is Senior Principal Data Scientist at Redhat in the Data & AI team. Prior to that, he worked at Hypersonix as an AI architect and at IBM Watson as Data Scientist. He also co-founded and has been CEO of Binaize (backed by Techstars), a website conversion intelligence product for e-commerce SMBs. He received a master's degree from IIT Roorkee and a bachelor's degree from IIEST Shibpur in Computer Science. He loves to code and collaborate on open-source projects. He is one of the top 20 contributors of pandas. He has 4 research papers and 5 patents in the fields of AI and NLP. He is a reviewer of the IEEE MASS conference, Springer nature and Packt publication in the AI track. He writes deep learning articles for O'Reilly in collaboration with the AWS MXNET team. He is a regular speaker at prominent AI conferences like O'Reilly Strata & AI, PyCon, PyData, ODSC, GIDS, Devconf, Datahack Summit etc.

Soham Dutta

Soham Dutta

Principal Software Engineer, Red Hat

Soham is a Principal Engineer at Red Hat, where he builds agentic AI systems that survive the jump from demo to production. Based in Bangalore, he owns the full stack, from React front-ends through vLLM serving on Kubernetes, with reliability, observability, and security built in from day one.

Soham's production work, from enabling AI for multi-tenant data infrastructure to open-source agentic templates now running across Red Hat's Data & AI organization, reflects a rare cross-domain fluency across backend, security, and AI/ML. A published author and speaker, Soham cuts through the hype on what it actually takes to run AI at scale: closing the demo-to-production gap, taming cascading failures in multi-agent systems, and the engineering discipline that turns fragile prototypes into systems you can trust.

Related Talks

Designing Codebases for Coding Agents

Designing Codebases for Coding Agents

Ragunath Jawahar
What Breaks When Research Agents Go to Production?

What Breaks When Research Agents Go to Production?

Sarang Kulkarni
Designing Reliable Systems Around Unreliable Predictions

Designing Reliable Systems Around Unreliable Predictions

Ivar Grimstad

On-Demand Talks

All On-Demand »