All work
Wisp
A menu-bar assistant that sees the screen, teaches an app step by step and can click through tasks for you.
- Status
- In development
- Type
- macOS assistant ยท Tools and open source
- Platforms
- macOS 14 and later
The problem
Learning a new desktop app means pausing a video tutorial every ten seconds. Most assistants can explain a screen but not point at the button.
What we built
- A native Swift menu-bar app with a quick bar at the cursor
- Teach mode: one step at a time, with a ring pulsing on the exact button to press
- Do mode: screenshot, plan and click until the task is done, with Esc to stop
- Live meeting captions, translation and a written memo afterwards
- Runs on the Claude or Codex command-line tools, so it needs no API key
How it fits together
- Screen and accessibilityWhat is on screen
- PlannerNext step and target
- ActionsPoint, click, type
Built with
Swift
Apple
Claude