Agent safety
Computer-use agents can operate old software. Safety has to lead the design.
How computer-using AI expands automation to browser-based work—and how to control credentials, approvals, and failure risk.
October 12, 2026 · 7 min read
The short version
Use computer control when an API is unavailable, constrain the environment, and require approval before consequential actions.
01
The interface becomes an integration layer.
Many businesses still depend on portals and desktop tools with limited APIs. Computer-use agents can interpret a visual interface and interact through clicks and typing, opening a path to automate work that traditional integrations cannot reach.
That flexibility is also the risk. A visual agent can encounter unexpected pop-ups, changed layouts, malicious page content, and ambiguous states. It needs a stronger control model than a script that talks to a stable, documented API.
02
Prefer APIs; use the screen for the last mile.
Structured APIs are faster to validate, easier to observe, and less sensitive to interface changes. Computer use is most valuable when the necessary system offers no practical integration, or when a small visual step sits between otherwise structured parts of a workflow.
A hybrid design can keep data processing and decisions in controlled services, then use the computer agent for the minimum required interaction. This reduces the time spent in an unpredictable environment.
03
Build a permission boundary before the happy path.
The agent should operate with the least access needed for its task. Separate read-only exploration from actions that change records. Purchases, messages, deletions, submissions, and account changes should stop for policy or human approval.
- —Use dedicated accounts and limited roles rather than a person’s full-access session.
- —Allowlist the sites, applications, and actions the workflow needs.
- —Treat page content as untrusted input that cannot grant permission.
- —Record screenshots, actions, tool results, and approval decisions for review.
- —Make retries idempotent so a recovered session cannot repeat a transaction.
04
Reliability is an operating process.
Computer-use systems need scenario tests that include changed layouts, partial completion, expired sessions, permission errors, and deceptive on-screen text. Monitoring should focus on whether the intended state changed—not only whether the agent reached the end of its run.
The right first deployment is a low-risk, high-friction process with a clear success check. Once the team trusts the logs, escalation path, and approval model, the system can take on more consequential work deliberately.
Continue reading
Related analysis
AI strategy
AI agents or workflow automation? Choose the simpler system first.
A practical decision framework for choosing between deterministic automation, AI-assisted workflows, and autonomous agents.
Infrastructure
What MCP changes for business software—and what it does not.
Model Context Protocol can standardize how AI systems connect to tools and data. Here is the business case without the protocol hype.