Back to Devoured - November 18, 2026
DEVOURED
Weight-Space Programming builds neural networks like a 1990s researcher

Weight-Space Programming builds neural networks like a 1990s researcher

AI Notesbylex
Weight-Space Programming reveals that frontier models can construct effective neural networks by 'hand-coding' weights using classical pre-deep-learning techniques.
What: Researchers used Claude Fable 5.2 to write weights for neural networks on image classification tasks. The model ignored modern training methods, instead recreating 1990s-era computer vision approaches like feature detectors, templates, and naive Bayes-style logic.
Why it matters: This demonstrates that LLMs have an internalized, foundational understanding of classical engineering methods that can outperform standard deep learning methods on certain constrained tasks.
Deep dive
  • Claude Fable 5.2 successfully built an MNIST classifier without traditional gradient-based training.
  • The model utilized hand-crafted features such as Sobel-like edge detectors and corner detectors.
  • Final classification was achieved through log-odds scoring, simulating a naive Bayes approach.
  • In a Go test, the model compiled a rule-based engine into weights that outperformed standard reinforcement learning models.
  • Success on simple tasks like MNIST was high, but hand-crafted features struggled with complex datasets like Cats vs. Dogs.
Decoder
  • Weight-Space Programming (WSP): A technique where an LLM is prompted to directly write or edit the numerical parameters (weights) of a neural network rather than providing training data for backpropagation.
  • MNIST: A classic, 10-class dataset of handwritten digits often used to benchmark basic machine learning models.
  • Sobel filter: An early computer vision technique used for edge detection in images by calculating the intensity gradient.
Original article

Full article content is not available for inline reading.

Read the original article →

Explore all 55 articles in today's digest

Fresh dev news, AI-digested daily. Never miss a trend at devoured.fyi