Article · Governance & Risk

AI Risks for Business: Which Ones Are Real and How to Govern Them

Arkatai 7 min

The AI risks for business that matter are not the science-fiction ones. They are five mundane things: an agent that makes a mistake nobody notices, a vendor dependency you cannot see until it hurts, data that leaves through the wrong door, a compliance gap that surfaces in an inspection, and a system that decays because no one maintains it. None of them is solved by trusting that the model “is very good”. Each has a mechanism, and each has a control that governs it.

I have put agents to work in real operations, and my starting point with any board is always the same. Risk is not eliminated, it is bounded and made visible. An operation run by people carries risk too, and you do not shut it down for that, you put controls on it. With agents it is the same, with one advantage and one trap. The advantage is that much of that control can be encoded and applied on every execution. The trap is that, if you do not design it, the system looks fine for months and then fails silently.

The silent error

A person who is unsure asks. A poorly governed agent does not: it applies the rule it has and moves on. If that rule is wrong, or the case falls outside what was foreseen, it produces a plausible, wrong result, at the speed and volume of a machine. That is the most expensive risk I see, because it does not announce itself: there is no alarm, there is a deviation that accumulates.

You govern it three ways. With evaluations before real work: test cases with known answers and quality thresholds, so you know where it errs before it errs on a customer. With escalation to a person on cases that exceed its mandate, instead of forcing an answer. And with traceability, so a deviation can be caught and reconstructed. An agent that executes without letting you measure its accuracy is not a productive agent: it is a liability that has not yet come due.

Simple match✓ gets real workClassify✓ gets real workEdge caseescalatesExceptionescalatesquality thresholdaccuracy measured per task
The silent error is governed by measuring: each task is evaluated against a quality threshold, and whatever misses it escalates to a person instead of running blind.

Vendor dependency

Two things get blurred here, and they should not. Depending on a model provider is tolerable: the models from Anthropic, OpenAI or Google are increasingly a utility, contracted through an API and swapped if another performs better on your task. The real risk is subtler: that your operation gets encoded inside one vendor’s or one product’s primitives, so switching means rebuilding the system.

That risk is governed with architecture. The rules, permissions, traces and integrations that define your operation must be able to live independently of whichever model sits underneath. It is the difference between renting capacity and being tied to it, and it is one reason I separate what is platform from what is your operating architecture from day one. I develop this in buy vs build for enterprise AI, where the question is not only who does it, but what you take with you if you leave.

Data leakage

An agent works with information: it reads it from your systems, puts it in a prompt, sends it to a model, records it in a trace. Every one of those steps is a door through which data can end up where it should not. The risk is not theoretical: an over-broad permission, a log without access control, or a personal data point sent to a service with no legal basis is enough to turn a productivity gain into a legal problem.

You govern it with least privilege and data hygiene. The agent accesses only what its function needs, with its own scoped credentials, as I detail in agent permissions and controls. Traces and prompts are treated as what they are, data to protect, minimize and retain deliberately. The defensive side —attacks, prompt injection, exfiltration— belongs to AI agent security, and the legal side to data privacy and GDPR.

Regulatory non-compliance

Putting an agent in charge of decisions about orders, people or money drops you, like it or not, into regulated territory. The European AI framework introduces obligations by the risk level of the use, data protection law applies from the first prompt that contains personal data, and your own sector may add requirements. The risk here is twofold: breaching without knowing it, and being unable to prove you comply even when you do.

You govern it with documentation and traceability by design, not as a patch after an inspection. What the agent does, with what data, under what controls, with what human oversight. If that is written down and recorded, you answer an auditor with facts. I have summarized what the European framework means for anyone deploying agents in the EU AI Act and AI agents, and how compliance is shown case by case in auditing AI agent decisions.

Decay without maintenance

The most common mistake I see in boards is treating deployment as a project with an end date. An agent system is not a build you hand over: it is an operation you maintain. Models change, your process changes, your data changes, and evaluations that ran green yesterday can run red today with no one watching. An agent without maintenance decays like any machine without it, except the breakdown makes no noise.

You govern it with a cycle, not a project: measure continuously, re-evaluate every time a component changes, and put someone in charge of making that happen. It is the same pattern by which so many pilots die on the way to production, which I analyze in why enterprise AI pilots fail. The demo is the easy part. Sustained reliability is the construction job, and the job does not end.

How these risks line up

None of these risks is a reason not to use agents, just as operational risk is not a reason not to have an operation. They are a reason to govern it. The table sums up the map:

RiskMechanismHow it is governed
Silent errorApplies a bad rule at machine speedEvaluations, human escalation, traces
Vendor dependencyOperation tied to a vendor’s primitivesModel-independent architecture, clean exit
Data leakageBroad permissions, uncontrolled prompts and tracesLeast privilege, data hygiene, security
Non-complianceRegulated use with no documentation or proofDocumentation and traceability by design
DecaySystem left unmaintained after deploymentContinuous measurement and re-evaluation

The full framework I use to order these controls is in AI agent governance, with the NIST AI Risk Management Framework as the public reference to contrast it against, and the review I run before accepting a deployment is in prepare your company for agents. If you want the ground where these risks materialize, it is in a real operation run with agents; and if you want the starting point, it is in AI agents for business.

Frequently Asked Questions

What is the biggest AI risk for a business?

The silent error: an agent that applies a wrong rule plausibly, at machine speed and volume, with no one noticing until the deviation is large. It is governed with evaluations that measure accuracy, escalation to a person on edge cases, and traceability to catch and correct. Do not trust model quality, measure it.

Is it dangerous to depend on an AI provider?

Depending on the model is tolerable, because models are swapped through an API. The risk is that your operation gets encoded inside a vendor’s or product’s primitives, so switching means rebuilding the system. You bound it by keeping your rules, traces and integrations independent of the model, and by agreeing a clean exit in the contract.

Can a mid-sized company take on these risks without a large technical team?

Yes, if it governs them rather than ignoring them. The question is not team size but who owns the evaluations, permissions, traces and maintenance. That work can be built in-house or contracted as a managed operation, but it cannot be skipped: a deployment without it looks fine until it stops being fine.

How do I know if my agents are decaying?

If you cannot answer, that is your answer: you lack continuous measurement. A healthy system re-evaluates every time the model, process or data changes, and keeps the history of that measurement. Without that cycle, decay is invisible, and you discover it when a customer or an auditor points it out.