Agents in the Wild: Where Research Meets Deployment
Grace Hui Yang, Pranav N. Venkit, Hooman Sedghamiz, Enrico Santus, Victor Dibia, Ioana Baldini
Why It Matters
What makes this one worth your time
Understanding the deployment challenges and solutions for agentic systems is crucial for AI engineers and researchers aiming to implement these systems in real-world applications.
The paper explores the deployment challenges of agentic systems and offers practical solutions through case studies.
Summary
The paper discusses the transition of agentic systems based on large language models from research to deployment, focusing on challenges such as robustness, safety, and reliability. It presents case studies in pharmaceutical discovery and financial systems to analyze design patterns and mitigation strategies for failure modes.
Key contributions
- Analysis of deployment challenges for agentic systems.
- Presentation of case studies in pharmaceutical and financial domains.
- Discussion of practical mitigation strategies for deployment failures.
Notable insights
- The use of case studies to derive common design patterns for successful deployment.
- Practical mitigation strategies like verification pipelines and human-in-the-loop supervision are emphasized.
Possible limitations
- Not stated in the abstract
Abstract
arXiv:2607.19336v1 Announce Type: new Abstract: Agentic systems large language model (LLM) based architectures capable of reasoning, planning, acting, and coordinating with tools and other agents are rapidly transitioning from research prototypes to production scale deployments across domains such as software engineering, scientific discovery, and finance. While academic work has emphasized benchmarks and algorithmic innovation, deployment raises new challenges around robustness, safety, and reliability. This tutorial brings together researchers and practitioners to explore advances in reasoning and planning, multi agent coordination, and evaluation, highlighting open challenges arising from deployment experience. Through applied case studies in pharmaceutical discovery and financial systems, we analyze common design patterns that make agentic systems successful, and discuss practical mitigation strategies for failure modes, such as verification pipelines, fallback mechanisms, and human in the loop supervision. Attendees will gain a comprehensive view of the field along with concrete design patterns, evaluation checklists, and templates for safe and reliable deployment across industries.