The Next AI Challenge Is Not Intelligence. It’s Resilience.

Last week I caught myself getting frustrated with an AI assistant. It was slower than usual. It didn’t quite follow my prompts. My first reaction was simple: “The AI isn’t working.” Then I realised something…

My first reaction was simple: “The platform must be having issues.”

But then I had another thought. What if this was no different from arriving at the office on a Monday morning and discovering that a key team member was unavailable? Work slows down. Priorities shift. Someone else steps in. Quality may fluctuate. The organization adapts.

And that’s when it struck me: We are no longer just deploying software. We are building a digital workforce.

For decades, we treated software as predictable. It either worked or it didn’t. AI is different. An AI agent can perform exceptionally well one day and struggle the next. It can be affected by model updates, changing data, unavailable services or simply a lack of context.

That doesn’t mean the technology is failing. It means we are entering a world where software behaves less like a machine and more like a colleague. Yet we still manage it like traditional software.

The conversation around Agentic AI is mainly about capabilities: reasoning, autonomy, orchestration and automation. But the next challenge is not only making agents smarter. It is making organizations ready for them.

Every manager understands that teams need support, monitoring and backup plans. Critical roles need ownership, quality checks and continuity measures. Why would AI be any different? As organizations become increasingly dependent on AI, resilience becomes just as important as intelligence.

It doesn’t take much imagination.

You’re preparing a proposal for a strategic customer. The deadline is tomorrow. Half the content is generated by AI, but your organization’s token budget has been exhausted. Additional capacity won’t be approved until next week.

Or imagine your customer service team relies on AI to draft responses. Overnight, a model update changes the quality of the answers. Nothing is technically broken, but customer satisfaction starts to decline.

Or perhaps an AI agent responsible for reviewing contracts suddenly takes twice as long because an external service is experiencing high latency. Procurement doesn’t stop. The business simply waits longer.

None of these are software failures. They are operational challenges. The future of AI will not only be defined by how intelligent our agents become, but by how resilient our organizations are when those agents don’t perform as expected.

Because the real question is not:

“The question isn’t whether your AI works. It’s whether your business still works when your AI doesn’t perform as expected.”