Anthropic Gives Claude A Mouse. It Clicks. The Implications Are Uncomfortable.
Anthropic launched Claude 3.5 Sonnet with a computer use feature that allows the model to control mouse and keyboard inputs. It can fill out forms, navigate websites, and complete repetitive interface tasks, enabling solo founders to automate workflows without writing code.
This illustrates the concept of agentic embodiment, where an AI model operates through the same graphical interfaces that humans use. The mechanism is tool-use via input simulation: rather than requiring an API integration for every application, the model interacts with software as a user would. The principle is that automation barriers collapse when AI can manipulate existing UI rather than needing custom infrastructure.
Anthropic released Claude 3.5 Sonnet with the computer use capability. The announcement is at anthropic.com/news/3-5-models-and-computer-use.
- Go to claude.ai and sign in or create an account to access the latest Claude 3.5 Sonnet model.
- Write a prompt asking Claude to guide you step-by-step through a repetitive task, such as filling out a specific online form or organizing browser bookmarks.
- Follow Claude's instructions manually for now, since the computer use feature is in limited beta. You will experience how the model breaks down interface tasks into actionable steps, which is the foundation of the automation capability.