Back to Devoured - November 12, 2026
DEVOURED
Screen Recording as a Prompt (Website)

Screen Recording as a Prompt (Website)

Design Xannotate
Annotate allows developers to record their screen and speak instructions, generating structured input for AI coding agents like Cursor or Claude.
What: The tool, Annotate, captures screen video, allows for on-screen drawing/pointing, and records voice narration to create a multi-modal prompt for AI models using MCP (Model Context Protocol).
Why it matters: AI agents are notoriously bad at interpreting static screenshots, leading to hallucination; providing a temporal stream of user actions and voice intent improves agent reliability for UI changes.
Decoder
  • MCP (Model Context Protocol): An open-source standard created by Anthropic that allows AI models to connect securely to local or remote data sources, including folders, databases, and development tools.
Original article

Don't type, just point and speak.

Record your screen, draw or point at what matters, say the change. Drop the session into Cursor, Claude, or Codex — free, local by default, no long prompt to write.

Three steps. No prompt draft.

  1. Record your screen

    Capture one window or every display in a single session.

  2. Point and speak

    Draw in the UI and say what you want changed. Skip the written brief.

  3. Hand off to your agent

    Open the session in Cursor, Claude, or Codex and let it take the next step.

Built for agents that read folders, not guess from screenshots

Mark the exact UI

Pen, rectangle, and text — so the agent knows which button you mean.

Fewer tokens, clearer intent

Agent reads the recording via MCP — frames and speech, not a giant video dump.

Multi-monitor in one take

App on one display, editor on the other — captured together.

Talk through the change

Your voice is transcribed and lined up with what was on screen when you said it.

“Make this button match the sidebar colour…”

Handoff where you already work

Open the session in Cursor, Claude Code, or Codex — no new chat app.

A screenshot can't show what changed.

Static shots lose clicks, timing, and what you said. Annotate keeps the motion so your agent sees the full story.

Frames, gestures, and speech stay in sync — so the agent follows what you meant, not what one still frame happened to show.

Local by default. Cloud is optional.

Frames and transcripts stay on your machine unless you turn Cloud on. Cloud copies expire after 30 days. The local recording is never deleted by expiry.

Next time the task is hard to explain, show it.

Explore all 61 articles in today's digest

Fresh dev news, AI-digested daily. Never miss a trend at devoured.fyi