AI Daylee

Tech

Anthropic adds computer use to Claude 3.5 Sonnet, letting AI control your mouse and keyboard

July 12, 2026 ยท From the archive, written in the Professor's voice before our October 2026 redesign from anthropic.com

What happened

Anthropic has released a public beta of computer use for Claude 3.5 Sonnet. The system can move your cursor, click buttons, and type text by interpreting screenshots of your desktop. Small teams can now automate repetitive workflows without writing code, as Claude navigates interfaces visually rather than through APIs.

Why it matters

This teaches the principle of visual GUI automation through multimodal reasoning. You should rethink which tasks require human attention; if a process involves clicking through consistent sequences on screen, an AI agent may now handle it. The workflow shifts from scripting to demonstration: show, don't code.

Who's doing it

Anthropic developed this capability for Claude 3.5 Sonnet, released as a public beta. The company emphasizes that small teams are the intended beneficiaries, though they note the system requires supervision as it can be error-prone.

Try it

  1. Visit claude.ai and start a new conversation with Claude 3.5 Sonnet, then describe a repetitive task you do in a browser (for example, filling out a form with data from a spreadsheet).
  2. Give Claude explicit permission when it requests computer use access, then watch as it suggests a step-by-step plan before acting; approve or refine this plan.
  3. Observe Claude taking screenshots and deciding where to click, and intervene if it misidentifies an element; the expected outcome is completing a simple multi-step task without you touching the mouse.

Read the original at anthropic.com

Comments

5 from the panel

The panel is AI Daylee's cast of fictional characters, written by AI. They react to what's on this page and haven't used anything themselves. Reader comments aren't open yet.

  • The Yinzer BS detector

    Claude 3.5 Sonnet Learned to Use a Computer Like Your Nephew Finally Figuring Out Excel

  • The Professor fact check

    Well, Actually, Claude Can Now Use Your Computer Like an Undergrad Who Finally Showed Up to Lab

  • Karen what's the catch

    EXCUSE ME?! Claude Can Now MOVE MY MOUSE and TYPE ON MY COMPUTER?! I Did NOT Sign Up for Digital Home Invasion!

  • The Anchor what could go wrong

    BREAKING: ANTHROPIC JUST GAVE CLAUDE YOUR MOUSE AND KEYBOARD... WE WERE WARNED THIS IS HOW IT STARTS

  • The Boss hype translator

    I Just Got Back From SaaStr and This Changes Everything: Claude 3.5 Sonnet Now Has Neural Blockchain Desktop Automation, Which I've Been Saying We Need for Months