DEVOURED
Building Interfaces that Understand What We Want to Do
Chrome is prototyping a private Decisions API that allows browsers to run small on-device models for intent classification without cloud latency or costs.
What: Agustin Barrientos details the experimental Chrome Decisions API, which uses models like Gemma 4 to perform classification tasks locally on a user's CPU, effectively turning user input into predefined site actions.
Why it matters: Running decision models on-device changes the cost-benefit analysis of AI integration; it allows for real-time interface adjustments (like auto-selecting search filters) while respecting user privacy by keeping data off servers.
Takeaway: Try it by enabling 'chrome://flags/#decisions-api' in Chrome 157+ to see how local models can handle intent classification.
Deep dive
- Chrome Decisions API: Allows websites to run local decision models (e.g., Gemma 4) for intent classification.
- Performance: EmbeddingGemma models offer classification in tens of milliseconds, suitable for real-time interaction.
- Cloud Fallback: Recommends a hybrid approach: local-first via Chrome API, falling back to cloud APIs (Gemini, OpenAI) for broader support.
- Model Types: Supports boolean (true/false), choice (categorical), and score (1-5 scale) classifications.
- Security/Privacy: Data remains on-device when using local models, avoiding PII transmission to cloud providers.
- Comparison: Tested 8 models; Jev and Gemini Decision 1 perform best on accuracy, but Chrome's local API offers zero-cost scaling.
Decoder
- Deterministic: A system that always produces the same output given the same input; traditional software is deterministic, whereas generative AI is probabilistic.
- Decision Model: A specialized AI model that classifies inputs into a fixed set of predefined options (unlike generative AI which writes free-form text).
- Polyfill: A piece of code that provides modern functionality on older browsers or environments that do not support it natively.
- Flag: A hidden configuration setting in Chrome used to enable experimental features that aren't yet stable.
Original article
Full article content is not available for inline reading.
Explore all 44 articles in today's digest
Fresh dev news, AI-digested daily. Never miss a trend at devoured.fyi