2026-05-24 BREAKTHROUGHS☾ PM
Anthropic Gives Claude 3.5 Sonnet Direct Control of Your Desktop
📰 THE BRIEF
Claude 3.5 Sonnet now moves the mouse, clicks UI elements, and types text through a new computer-use API released October 2024. The model receives screenshots as input and outputs mouse coordinates plus keyboard actions. No code or external scripts are required.
💡 WHY IT MATTERS
Users stop treating the model as a text generator and start treating it as a replaceable worker that performs clicks and keystrokes. Workflow design shifts from prompt crafting to task decomposition and verification loops.
👥 WHO'S DOING IT
Anthropic's own research team demonstrated the feature on the public beta at anthropic.com/news/3-5-models-and-computer-use. Early testers report completing invoice data entry in 40 percent less time than manual entry.
⚡ TRY IT
- Visit console.anthropic.com and enable the computer-use preview for your account.
- Send a task such as 'Open Excel and enter last week's sales figures from this CSV' in the API call.
- Review the model's action log and approve or correct each mouse movement before execution.