All work

Wisp

A menu-bar assistant that sees the screen, teaches an app step by step and can click through tasks for you.

Status
In development
Type
macOS assistant ยท Tools and open source
Platforms
macOS 14 and later

The problem

Learning a new desktop app means pausing a video tutorial every ten seconds. Most assistants can explain a screen but not point at the button.

What we built

  • A native Swift menu-bar app with a quick bar at the cursor
  • Teach mode: one step at a time, with a ring pulsing on the exact button to press
  • Do mode: screenshot, plan and click until the task is done, with Esc to stop
  • Live meeting captions, translation and a written memo afterwards
  • Runs on the Claude or Codex command-line tools, so it needs no API key

How it fits together

  1. Screen and accessibilityWhat is on screen
  2. PlannerNext step and target
  3. ActionsPoint, click, type

Built with

  • SwiftSwift
  • AppleApple
  • ClaudeClaude