Anthropic’s new AI tool can now control your mouse and do basic stuff on your computer for you.
The tool, available via the 3.5 Sonnet API, lets users give multi-step instructions for tasks by controlling the mouse, typing, and viewing screenshots, though it has limitations with rapid changes, drag-and-drop, and occasional errors.
Have any of you tried this out yet?