Safe agents: permissions, sandboxes, reviews and the art of saying no
Autonomy does not become trustworthy because a system may do more. It becomes trustworthy when it knows what it may not do.

An agent is impressive when it does more than answer: it sorts files, prepares information, starts steps or continues a process. That is exactly why good design does not begin with the longest task list. It begins with a boundary. What may this system do in this situation, what effect may it cause—and when must it stop?
The difference between an assistant and an agent is not intelligence, but effect. An assistant suggests; an agent changes. Once a system can change the world, the question of boundaries becomes the most important design question — more important than any additional capability.
Permissions are not a detail
Every capability of an agent is also a way to change something. Reading, writing, sending, deleting and running are not merely technical verbs. They have different consequences. When those consequences are not separated, a convenient automation receives too much room—and the difference becomes visible only after a mistake has already had an effect.
Start with the smallest useful permission. An agent that should organise material does not also need to publish. An agent that prepares a draft needs no approval to make a binding decision. Permissions grow with observed reliability and clear necessity—not with the wish to do everything in one pass.
A useful distinction is between reading and changing permissions. Reading is rarely dangerous, as long as the data allows it. Changing and sending leave the protected space. Granting the two kinds separately lets you give an agent plenty of context without at the same time allowing it plenty of effect.
Boundaries keep mistakes small
A sandbox is first of all a way of thinking: work is tried in a bounded space. Inputs, interim outcomes and rules can become visible there without every attempt immediately causing real consequences. The question is not only: Can the agent complete this task? It is also: Where can it complete it so that a mistake remains manageable?
The smallest safe environment is often surprisingly simple. Sample material rather than the original set, drafts rather than publication, a copy rather than a permanent change. This separation creates a second chance. It lets a workflow teach you before it receives reach.
A sandbox is not a cage but a practice ground. Its purpose is not to keep the agent small, but to give it a place where reliability can become visible. Only once a workflow repeatedly works well in the bounded space is there a reason to give it more reach.
Review is a working step, not distrust
People should not repeat every click. But they should decide at the points where context, responsibility and consequences meet. A good review point is concrete: Should this information be used? Does this change make sense? May this result go outside?
A review becomes weak when, at the end of a long process, it demands only „yes" or „no". Smaller hand-offs work better: the agent summarises what it did, names its basis, shows unresolved uncertainty and proposes the next step. The human then decides from a readable situation rather than from fatigue.
The best review point sits before the effect, not after it. A check that only takes hold once an email has been sent or a file deleted is not a check but a notice of damage. Place the review where a decision is still reversible.
No belongs to quality
A safe system should not stop only when it fails. It must also pause when something is unclear. Missing information, conflicting instructions, unexpected data or an effect outside the agreed frame are good reasons to ask. That is not weakness. It is a precise form of competence.
● Members only
Read the full article and download all files with a membership.
Unlock full article + downloads → Subscribe0 comments
● Loading comments…