Claude 3.5 Sonnet Gets Hands. It Drives Your Mouse And Keyboard. The Autonomy Gap Just Narrowed.
Anthropic has released Claude 3.5 Sonnet with a computer-use API that allows the model to control a mouse, keyboard, and browser as a human user would. The system is positioned as a tool for small teams to automate repetitive desktop tasks, data entry, and web research without additional headcount. This represents a shift from conversational AI to agentic AI, where the model acts on graphical interfaces rather than only generating text.
The mechanism here is embodied AI agency, the ability of a language model to translate its reasoning into physical input events on a computing device. The mental model to grasp is that the browser becomes the model's workspace rather than its output channel. This matters because most software was built for human visual and motor interaction, not API calls. Claude is essentially pretending to be a human user, which means it can operate any software a human can, but also inherits every limitation of human-style interaction, including slowness and error recovery.
Anthropic released Claude 3.5 Sonnet with the computer-use capability, targeting small teams that need to automate desktop workflows. The feature is available through their API, as announced on the company's official news page.
- Visit anthropic.com and locate the Claude 3.5 Sonnet announcement to review the computer-use API documentation. Read the description of how Claude interacts with mouse and keyboard inputs.
- If you have API access, try a simple instruction such as asking Claude to open a browser, navigate to a news site, and report the top headline. Observe how it issues step-by-step actions rather than a single command.
- If you lack API access, use Claude's public chat interface and ask it to write out, step by step, what it would click and type to complete a task on your computer. Compare its plan to how you would actually perform the task. The gap between the plan and the execution is what the computer-use API is designed to close.