Inkling-Small
Thinking Machines launched Inkling-Small, a 276B-parameter mixture-of-experts model that matches its larger predecessor's reasoning capabilities at a fraction of the compute cost.
Deep dive
- Inkling-Small uses a Mixture-of-Experts (MoE) architecture with 276B total parameters and 12B active.
- Features include native multimodal reasoning (audio/image) and variable thinking effort.
- Training utilized on-policy distillation from the larger Inkling model.
- Outperforms the larger Inkling on specific agentic coding and reasoning benchmarks.
- Exhibits 31.6% accuracy on Humanity's Last Exam (HLE) text-only tests.
- Built to support agentic tool use and programmatic image inspection (cropping/zooming).
- Includes safety post-training aligned with established internal specifications.
- Available for fine-tuning and chat via the Tinker platform.
Decoder
- Mixture-of-Experts (MoE): A neural network architecture that activates only a subset of parameters for each input, allowing for high performance with lower compute requirements.
- On-policy distillation: A training method where a smaller 'student' model learns by imitating the outputs of a larger, pre-trained 'teacher' model during reinforcement learning phases.
- Humanity's Last Exam (HLE): A challenging benchmark designed to test AI reasoning capabilities, including tasks that require complex, multi-step problem solving.
Original article
Today, we are releasing Inkling-Small, an efficient open-weights model that achieves comparable performance to Inkling at a quarter of its size.
Inkling-Small is a Mixture-of-Experts transformer with 276B total parameters, 12B active, trained on NVIDIA GB300 NVL72 systems. Like Inkling, it features native reasoning over audio and images, variable thinking effort, a context window of up to 1M tokens, and well-rounded performance across a range of benchmarks.
Inkling-Small vs Inkling
- Inkling-Small: 276B total, 12B active
- Inkling: 975B total, 41B active
Compared to Inkling, Inkling-Small achieves comparable performance with much less compute. Across agentic tool use (Terminal-Bench 2.1), reasoning (HLE text-only, no tools), and instruction following (IFBench) benchmarks, Inkling-Small is more efficient than Inkling and competitive with other models in its weight class. Furthermore, its variable thinking effort lets users easily adapt it to target their use case, balancing cost and performance.
We are releasing the full weights of Inkling-Small. We’re also making it available for fine-tuning on Tinker, and for text, image, and audio chat on Tinker Playground.
Capabilities
As we build our model family, we are always iterating on our approach. Inkling-Small began training after its larger counterpart, which let us improve its training process. For example, we made changes to Inkling-Small’s pre-training data mix and machine learning recipe. Additionally, we post-trained an earlier checkpoint, Inkling-Small (preview), in part using on-policy distillation with Inkling as the teacher. Starting from that checkpoint, we continued scaling agentic coding RL for two weeks. With these improvements, Inkling-Small surpassed Inkling on reasoning and agentic coding benchmarks. Inkling maintains an advantage on knowledge coverage and factuality.
Reasoning and Agentic Tasks
Inkling-Small matches or exceeds Inkling on reasoning and agentic tasks. On Humanity’s Last Exam it scores 31.6%, ahead of Inkling’s 29.7%, and the advantage holds at every thinking budget: Inkling-Small’s test-time compute curves sit above Inkling’s throughout. On SWEBench-Verified it exceeds 80%.
Across many reasoning and agentic benchmarks, Inkling-Small at max reasoning effort has a strong performance-token tradeoff when compared to open weights models in its weight class.
Inkling-Small also runs smoothly across a variety of coding and agent harnesses, making it a cost-efficient choice for coding and tool-use workflows.
Multimodality
Like Inkling, we crafted Inkling-Small for audio intelligence, making it a good candidate for real-world audio applications. We also improved its ability to use Python for visual tasks. The model can combine visual reasoning with operations such as cropping, zooming, and programmatic image inspection, improving usability on documents and charts where relevant information may be small or difficult to inspect directly.
Inkling-Small uses the same natively multimodal encoder-free architecture as Inkling. Audio is represented as dMel spectrograms, while images are divided into 40×40-pixel patches and transformed using a four-layer hMLP. Both are transformed via a light-weight embedding layer and processed jointly with text tokens. Inkling-Small nearly matches Inkling across most multimodal evaluations at a lower cost. It retains strong performance on visual reasoning, chart and diagram understanding, mathematical visual question answering, speech understanding, and longer-form audio reasoning.
Epistemics
Inkling-Small was trained similarly to Inkling on epistemics, focusing on calibration, instruction following, and resistance to censorship. Inkling-Small matches Inkling’s performance on forecasting. Calibration involved RL against proper scoring rules on a large corpus of real-world forecasting questions, improving its ability to express appropriate confidence and produce calibrated forecasts under uncertainty.
Safety
Inkling-Small inherited the same safety post-training recipe as Inkling, with built-in safeguards covering our internal spec of safety. These include everyday human-AI interactions as well as dual-use capabilities. Inkling-Small also underwent the same pre-deployment testing process, comprising both internal evaluations and red-teaming by trusted external partners.
On StrongREJECT, which measures whether models refuse unambiguously harmful requests, Inkling-Small is on par with Inkling, and matches the performance of existing open-weights models. On FORTRESS, which measures safety in settings spanning crime, violence, and dual-use risks, it is competitive in both refusal and over-refusal.
Benchmarking Inkling-Small
Like Inkling, we benchmarked Inkling-Small on a broad range of capabilities. All evals run at effort 0.99 and temperature 1.0. All coding evals run with 256K max-token trajectory limit, similar to Inkling.
To improve consistency, we rely on externally reported evaluations for both internal and external models when applicable.
Try Inkling-Small on Tinker
Tinker customers have seen firsthand that the right fine-tuned model can outperform closed models on a variety of tasks, and do so faster and cheaper. We believe Inkling-Small’s combination of broad performance and efficiency will make it easy to experiment with and test in real applications, and we’re excited to see what developers build with it.
Inkling and Inkling-Small are available on Tinker with a limited-time discount and can be chatted with on the Tinker Playground using text, image, and audio. All other models on Tinker and checkpoints are also now available on Tinker Playground, billed at the rates listed on our pricing page.
Inkling-Small was made in pursuit of our mission to build AI that extends human will and judgment. It’s a capable and efficient model, and an important stepping stone for us as we continue our work.
Fresh dev news, AI-digested daily. Never miss a trend at devoured.fyi