Back to Devoured - July 27, 2026
DEVOURED
Introducing Classifiers, now in beta

Introducing Classifiers, now in beta

AI OpenRouter
OpenRouter introduced asynchronous classifiers that categorize LLM requests by task type or department without adding latency to the inference path.
What: OpenRouter's new Classifiers feature allows developers to define a taxonomy of up to 8 dimensions, a classification prompt, a model, and a sampling rate. The categorization runs asynchronously after the inference is complete, allowing users to analyze usage patterns or agent complexity without impacting request performance.
Why it matters: This tool enables fine-grained observability into LLM workflows, moving beyond simple token counts to understanding the specific business tasks—such as coding or analysis—that drive infrastructure costs.
Decoder
  • Inference: The process of running data through a trained model to generate predictions or responses.
  • Asynchronous: Processes that run in the background, independent of the main program flow, ensuring they do not block or slow down the primary execution.
Original article

Introducing Classifiers, now in beta.

Tag inference in your workspace by task type, department, agent complexity, or whatever you care about. Then filter your logs or visualize your Activity.

Here's our internal model spread across task types.

A classifier is four things: a taxonomy of up to 8 dimensions, a classification prompt, a model to apply it, and a sampling rate.

We include six presets you can use to start quickly. Classification runs async after each request, so it adds zero latency to your inference path.

Here's our own internal inference, grouped by task family and model.

Analysis and coding dominate, and you can see exactly which model is absorbing each one.

Invert the grouping to e.g. see where GPT 5.6 Sol is being used the most.

Classifiers can work even with prompt logging disabled, and attach on each individual generation for full inspectability.

Create one in your workspace, or read the docs: openrouter.ai/docs/guides/features/classifiers

More info in our blog: openrouter.ai/blog/announcements/classifiers/

Explore all 65 articles in today's digest

Fresh dev news, AI-digested daily. Never miss a trend at devoured.fyi