DEVOURED
Perplexity Decider
Perplexity has released Decider v1.3 and Decider Flash v1.3, specialized decision models designed to outperform generalist LLMs at classification and routing tasks.
What: Decider v1.3 and the distilled Decider Flash v1.3 support binary, multi-class, and scoring tasks. Inspired by TypeSafe AI's Jev, these models use bidirectional attention and a new 'locate' feature for PII detection and extractive question answering, outperforming previous baselines on domain-specific classification and reranking.
Why it matters: This marks a move away from 'one model fits all' strategies; for tasks like moderation, routing, and filtering, specialized classifiers provide significantly lower latency and cost than generative LLMs by avoiding token-by-token generation.
Takeaway: If you are currently using LLMs for classification, moderation, or reranking, evaluate Decider v1.3 or Decider Flash v1.3 to improve accuracy while potentially reducing inference costs.
Deep dive
- Decision Models: Optimized for classification and routing rather than text generation.
- Performance: Decider v1.3 achieves 91.6% accuracy on 63 classification tasks, beating production baselines.
- Locate Feature: A new adapter-based mechanism to extract specific spans of text for NER and PII tasks without needing a generative pass.
- Architecture: Uses a decision head on top of strong generative backbones (Qwen3-27B).
- Training: Three-stage process including fine-grained LoRA adaptation and KL-divergence-based distillation for the Flash version.
- Deployment: Available via API, Hugging Face, and OpenRouter.
Decoder
- Bidirectional Attention: A mechanism allowing the model to look at both preceding and subsequent tokens simultaneously, which is typically disabled in autoregressive models but helpful for classification.
- Pointwise Reranking: Assessing relevance by scoring individual query-document pairs independently rather than comparing documents against each other.
- nDCG@10: Normalized Discounted Cumulative Gain, a metric for ranking quality that measures how effectively the top 10 retrieved results match the user's intent.
Original article
Full article content is not available for inline reading.
Explore all 57 articles in today's digest
Fresh dev news, AI-digested daily. Never miss a trend at devoured.fyi