Back to Devoured - November 17, 2026
DEVOURED
Building Interfaces that Understand What We Want to Do

Building Interfaces that Understand What We Want to Do

Design Agustin Barrientos
Chrome is prototyping a private Decisions API that allows browsers to run small on-device models for intent classification without cloud latency or costs.
What: Agustin Barrientos details the experimental Chrome Decisions API, which uses models like Gemma 4 to perform classification tasks locally on a user's CPU, effectively turning user input into predefined site actions.
Why it matters: Running decision models on-device changes the cost-benefit analysis of AI integration; it allows for real-time interface adjustments (like auto-selecting search filters) while respecting user privacy by keeping data off servers.
Takeaway: Try it by enabling 'chrome://flags/#decisions-api' in Chrome 157+ to see how local models can handle intent classification.
Deep dive
  • Chrome Decisions API: Allows websites to run local decision models (e.g., Gemma 4) for intent classification.
  • Performance: EmbeddingGemma models offer classification in tens of milliseconds, suitable for real-time interaction.
  • Cloud Fallback: Recommends a hybrid approach: local-first via Chrome API, falling back to cloud APIs (Gemini, OpenAI) for broader support.
  • Model Types: Supports boolean (true/false), choice (categorical), and score (1-5 scale) classifications.
  • Security/Privacy: Data remains on-device when using local models, avoiding PII transmission to cloud providers.
  • Comparison: Tested 8 models; Jev and Gemini Decision 1 perform best on accuracy, but Chrome's local API offers zero-cost scaling.
Decoder
  • Deterministic: A system that always produces the same output given the same input; traditional software is deterministic, whereas generative AI is probabilistic.
  • Decision Model: A specialized AI model that classifies inputs into a fixed set of predefined options (unlike generative AI which writes free-form text).
  • Polyfill: A piece of code that provides modern functionality on older browsers or environments that do not support it natively.
  • Flag: A hidden configuration setting in Chrome used to enable experimental features that aren't yet stable.
Original article

Full article content is not available for inline reading.

Read the original article →

Explore all 44 articles in today's digest

Fresh dev news, AI-digested daily. Never miss a trend at devoured.fyi