2026-05-29 BREAKTHROUGHS☾ PM
Claude 3.5 Sonnet Now Operates Your Desktop Directly
📰 THE BRIEF
Anthropic released Claude 3.5 Sonnet with a computer use feature. The model receives screenshots and outputs mouse clicks plus keystrokes to control spreadsheets, browsers, and file systems on the user's actual machine. No custom code or API scripting is required.
💡 WHY IT MATTERS
This forces users to stop treating AI as a text interface alone. They must now design tasks around observable screen states and explicit action sequences. The workflow shifts from prompting to supervising an autonomous desktop agent.
👥 WHO'S DOING IT
Anthropic documented the feature in its October 2024 release notes. Early enterprise testers report completing multi step spreadsheet reconciliation that previously required human assistants.
⚡ TRY IT
- Visit console.anthropic.com and enable the computer use beta for your workspace.
- Provide the model with a goal such as update row three of budget.xlsx with Q3 figures.
- Watch the agent move the cursor and type; confirm each action or stop execution at any step.