DEVOURED
Vision agents miss work they can't see and cost 45x more - browser-use skipped 3 of 4 reviews below the fold until Reflex added a 14-step UI walkthrough.
What: Palash Awasthi at Reflex benchmarked browser-use 0.12 (vision agent) against auto-generated HTTP endpoints on the same admin panel task. Vision agent initially failed, finding 1 of 4 pending reviews (3 were below the fold), required a 14-step walkthrough to complete, then consumed 551k input tokens over 17 minutes across 53 steps. API agent with Claude Sonnet: 8 calls, 12k tokens, 20 seconds. Reflex 0.9 auto-generates endpoints from Python event handlers.
Why it matters: Vision agents became the default for internal tool automation because writing custom APIs for 20+ apps was too expensive, not because vision is better. Reflex is betting auto-generation flips the cost equation - if API engineering drops to zero, paying 45x ongoing token costs for vision makes no sense for apps you control.
Decoder
- MCP (Model Context Protocol): Anthropic's protocol for connecting LLMs to external data sources and tools, alternative to custom REST APIs for agent integration
- browser-use: Open-source Python library for vision-based browser automation where agents take screenshots and execute clicks to operate web UIs without APIs
- Reflex: Python web framework that renders to React, v0.9 adds plugin to auto-generate HTTP endpoints from backend event handlers
Original article
Vision agents are the default for operating web apps that don't expose APIs. Most teams default to vision agents because the alternative, writing an MCP or REST surface, is too expensive to build. The cost of the vision approach is treated as a fixed price. Current vision agents require detailed prompts to succeed in tasks, and they are still prone to making mistakes. Better vision models reduce error rates, but they do not reduce the number of screenshots required to reach the relevant data, each of which is worth thousands of input tokens.
Explore all 66 articles in today's digest
Fresh dev news, AI-digested daily. Never miss a trend at devoured.fyi