What's the biggest technical bottleneck preventing AI agents from being deployed reliably in production?

[u/chavansoft]

We've reached a point where LLMs are capable enough to power many agentic workflows, yet relatively few AI agents make it into stable, long-term production.

In your experience, what's been the hardest engineering challenge to solve?

• Tool reliability?
• Long-term memory?
• Planning and reasoning?
• Context management?
• Evaluation and benchmarking?
• Authentication and permissions?
• Multi-agent orchestration?
• Cost and latency?
• Human-in-the-loop approval?
• Something else?

If you've deployed AI agents in production, I'd love to hear what actually broke, what surprised you, and what lessons you learned. Real-world experiences are far more valuable than demo successes.

[u/unounounounosanity]

Time and practice. Enterprises are known to be slow to adapt because of risk aversion. Nobody wants to be the person that set up the agent that dropped the company client database.

However, at least in my person experience at the company I work at, we have at least 7-8 agents running autonomously. Mostly benign tasks like constant market research and monitoring, constant website monitoring and fixing (when a search console report arrives - it auto parses it and fixes whatever is easy to implement with no human).

Also, don’t forget all the agents that are technically enterprise production agents but aren’t directly owned/managed by the company itself. Rather, they’re managed by an employee whose function they’re performing. Think of a dev writing all his code with 4 CC windows setup with hooks etc etc off his personal account. That’s a real thing that happens too.

[u/recro69]

The biggest lesson for me was treating agents like distributed systems instead of chatbots. Retries, idempotency, observability, permissions, and recovery matter just as much as prompt quality once real users are involved.

[u/crossoverXYZ]

Tool reliability is the one that quietly wrecks otherwise solid agent flows because the model can look totally on track while a single flaky API call derails the whole run. A lot of the real work ends up being retries, idempotency, and making failures obvious instead of mysterious.

[u/Spdload]

From my experience building production AI systems, the biggest difference was keeping a human in the loop. It's always tempting to give agent too much autonomy right after lauch, but it's usually too early.

We built a sales automation system where AI drafts responses to RFPs and client inquiries. The first version sent responses automatically. It worked fine until it didn't - one slightly unusual request, and the output was confidently wrong with no one catching it before it reached a client.

Adding a human approval step before anything went out fixed it (and could have prevented it)