AI Services Market
AI Services Market › Use cases › Work & Operations
Work & OperationsDone with Claude computer use Mar 30, 2025

Control a computer with Claude's mouse and keyboard

A poster tested Claude computer use for a day, where it screenshots, infers the screen, then moves the mouse and types; multi-app drift and small UI misses remained problems. · Mar 30, 2025

Control a computer with Claude's mouse and keyboard preview
What They Did
The poster spent a day testing Claude’s Computer Use on a Mac, where Claude repeatedly took screenshots, inferred the UI, then clicked and typed to complete tasks. They had it rename and sort 40+ files, copy PDF data into a Numbers spreadsheet, fill the same browser form eight times, and compile notes from five tabs, stepping in when it lost track of windows or needed a correction.
How It Went
It got all 40+ file actions right in about five minutes and was described as slow but accurate on data entry; the form-filling test had one date-format mistake. The poster estimated about 80% reliability on simple tasks and 50% on complex ones, with silent failures in longer multi-app workflows and no good handling of captchas, 2FA, speed-sensitive tasks, or risky clicks.
Worth Knowing
The main catch was that it took over the whole Mac while running, so the poster saw the best use case as starting a task and walking away.
Try it yourself with Claude computer use

Use my desktop to do this task: [describe a short task, e.g. copy the figures from a spreadsheet into a form in another app]. Take a screenshot after each step to confirm it worked, and tell me if something doesn't look as expected instead of guessing. Pause and show me what you're about to do before submitting, sending, or deleting anything; you're done when [the finished result] is on screen.

Read the original ↗