Claude was trained on protein sequences at scale
Research indicates that Anthropic's latest Claude models were trained on massive volumes of protein sequence data, allowing them to predict amino acid sequences better than most specialized models.
Deep dive
- Methodology: The study tested next-amino-acid prediction on 668 bacterial and archaeal proteins from 167 'domain of unknown function' families.
- Key Findings: Only the latest Claude models outperformed shuffled-sequence controls, meaning they learned the actual underlying sequences rather than just general amino acid frequencies.
- Scale Matters: Performance correlates with the size of the protein family, consistent with how specialized protein language models behave.
- Comparison: Fable 5.2 consistently beats open-weight protein language models like ProtGPT3-10B and ProGen3-3B.
- Generalization: The knowledge persists for proteins published after the models' training cutoffs, suggesting the models have effectively learned the 'grammar' of protein sequences.
Decoder
- FASTA: A text-based format for representing nucleotide or amino acid sequences.
- Pfam: A large collection of protein families, each represented by multiple sequence alignments and hidden Markov models.
Original article
Claude was trained on protein sequences at scale
A next-amino-acid test on little-studied proteins finds that the latest Claude models were trained on protein sequences at scale. Other frontier models show no sign of it.
The latest Claude models were trained on protein sequences, at scale. Give Claude Fable 5.2 or Claude Opus 5.5 the start of a little-studied bacterial protein and they predict the next amino acid. Shuffle the protein and they can’t. No other model we tested can do this. Like a protein language model, they do better on bigger protein families, and they do it even in families with no papers at all. Fable 5.2 beats every open protein language model we ran, and Opus 5.5 is level with ProtGPT3-10B, the largest of them.
Update, 18 November 2026. Since the first version:
- Proteins published after the training cutoff. With Leo Tianlai Chen, 56 proteins first made public in August 2026, with no earlier relative at 50% identity or more. The latest Claude models still predict them.
- More protein language models. ProGen3-3B is the strongest open one we ran, and Fable 5.2 still beats it.
- More GPT models. GPT-6.2 Sol and Astra show no sign of it either.
Motivation
Frontier LLMs have started to look good at protein tasks. Atharv Jayprakash showed GPT-6 Astra ranking SOD1 variants as well as ESM-2, and PG-LLM found the same across many proteins. Did these models learn from protein sequence databases such as UniProt, or from what is written about proteins?
Famous proteins can’t tell the two apart: GFP is printed in countless papers, and most frontier models recite it. So we tested proteins that almost nobody writes about.
Method: next-amino-acid prediction on little-studied proteins
We give a model the start of a protein and ask for the next amino acids. Then we ask again on a shuffled copy of the same protein. Shuffling keeps the letters and destroys their order, so the difference in accuracy measures what the model knows about the sequence itself.
The test set is 668 bacterial and archaeal proteins from 167 Pfam families of unknown function. No family has a solved structure or more than three papers, and no protein has a close relative in UniProt. Each protein is cut at five points. At each cut the model writes the next 10 amino acids, and we score the first. Thinking is at its lowest setting.
Results: only the latest Claude models predict them
Fable 5.2 gets the next amino acid right 54% of the time on real proteins and 9% on shuffled ones. The gap is there in nearly every family, not just a few easy ones. It appears in Opus 4.7, jumps in Opus 5.5, and jumps again in Fable 5.2. GPT, Gemini and the seven open-weight models (DeepSeek V4.1 Flash, Qwen 3.8, Kimi K3.1 Pro, GLM-5.3, MiniMax M3, gpt-oss-120b and Nemotron 3 Ultra) stay near zero, even when they simply continue raw FASTA text, the way they were trained. The latest Claude models also write runs of correct residues that other models rarely manage.
Comparison with protein language models
Protein language models learn only from sequences, so they are the natural yardstick. The closest to an LLM are the ones that read a protein left to right and predict the next residue: ProtGPT3, whose 10-billion-parameter version is the largest open one, and ProGen3, whose largest public version has 3 billion. On the same input, Fable 5.2 beats both by a wide margin. Opus 5.5 is level with ProtGPT3-10B and below ProGen3-3B.
Evidence that this comes from training data
If the models learned from sequences, families with more sequences should be easier. To test this over a wide range, we added 90 smaller families, down to 20 proteins each, for 257 families in all.
They are. Opus 5.5 rises with the two protein language models, ProtGPT3-10B and ProGen3-3B, which are trained on nothing but sequences. Fable 5.2 rises fastest and levels off at about 300 proteins per family. Earlier Claude models rise at a lower level, and GPT and Gemini stay near zero. The knowledge also carries over to proteins published after the training cutoff, with no close relative before it.
Two other explanations don’t fit:
- Papers. In the 128 families with no papers at all, both models do as well as on the whole set.
- Reasoning. Most answers involve no thinking at all: the API reports thinking tokens on 9% of Fable 5.2’s answers and 36% of Opus 5.5’s. The answers without thinking are just as accurate. GPT-6 Astra and GPT-6.1 Sol think for hundreds of tokens per question, GPT-6.2 Sol and Astra answer about as briefly as Claude, and all four stay near zero.
Famous proteins and variant ranking
Famous proteins are a different story. Many models do well on them, and several recite hundreds of residues letter for letter, because these sequences are all over papers and the web. In a first round with famous and obscure proteins side by side, Gemini 4 Carbon was strong on the famous ones and dropped to almost nothing on the obscure ones. The latest Claude models and ProtGPT3-10B held up, and Fable 5.2 was the strongest on both.
This also explains the SOD1 and PG-LLM results. Ranking variants of a well-known protein can lean on what is written about it: which residues are buried, which substitutions break a helix, which mutations cause ALS. In PG-LLM, accuracy doesn’t depend on alignment depth and improves with more thinking, both signs of that route. Our test shuts it out. GPT-6 is good at the first kind of task and weak at the second; the latest Claude models are good at both.
What this means
The latest Claude models know protein families that almost nobody has studied. That takes a lot of sequence data, not a few examples: protein sequences were a sizeable part of their training. Opus 5.5 behaves like a protein language model, and Fable 5.2 goes beyond the best one we could run. GPT and Gemini show none of this. Whatever protein sequence they saw in training, it was not enough to learn these families.
DNA is different. Opus 5.5 predicts human and mouse coding sequence but not the rest of the genome, and barely the bacterial genes behind the proteins it knows. It learned proteins, not genomes.
We are curious what else this knowledge supports. Fable 5.2 predicts little-studied proteins better than any open protein language model we ran, and protein language models carry more than next-residue statistics: ESM-2’s internal representations hold enough structure that a small folding module on top predicts 3D structures (ESMFold), and their probabilities rank the effects of mutations. Could Claude fold a protein, or rank its variants, the same way?
Code and data
All code, test sets, model outputs and figures are in llm-bioseq-probe.
Appendix
A. DNA
220-nucleotide windows, 200 shown and 20 to predict, from hg38, mm39 and the bacterial genes behind the test proteins, 500 per region. Non-coding windows contain no repeats, and the control shuffles each window keeping its dinucleotide counts. Opus 5.5 wrote all 20 nucleotides right 25 times in 500 human coding windows; a blind guess does that about once in a trillion. Gemini 4 Carbon blocks most DNA prompts before answering, so it is not shown.
B. Longer continuations
All 10 residues right. Each question asks for the next 10 residues. On the 668 little-studied proteins, Claude Fable 5.2 gets all 10 right at 88 real cuts and Opus 5.5 at 12, and neither at any shuffled one. If their residues were independent guesses at their own per-residue accuracy, they would get 15.8 and 0.57 by chance.
Runs in a row. On shuffled proteins neither Fable 5.2 nor Opus 5.5 gets more than 3 residues in a row. Once on track they get surer: after one right residue, Opus 5.5 gets the next right 47% of the time, after four in a row 68%.
C. Protein language models
ProtGPT3-10B gets more answers right than Opus 5.5 (38.4% vs 34.9%) but also more on shuffled proteins (10.7% vs 7.5%), because it knows amino acid composition better; the gap between the two, which is what each model knows about order, comes out the same. Prot-xLSTM is trained to read a protein after a set of its homologs; on the protein alone, as here, it is near zero, though one homolog in context lifts it from 14% to 81% on hemoglobin β. Every model first passed a sanity check on well-known proteins.
D. Robustness
- Across families. The gap is positive in 98% of families for Fable 5.2 and 94% for Opus 5.5.
- Family size. Over all 257 families, the Spearman correlation between a family’s gap and the log of its size is 0.50 for Opus 5.5.
- Papers. In the 128 families with no papers at all, the gap is 45.9 points for Fable 5.2 and 26.8 for Opus 5.5.
- Prompt format. Asking Opus 5.5 to copy the sequence first and then continue gives the same gap as the standard prompt on the same 400 questions.
- Refusals. Non-answers (0.1% for Opus 5.5) are excluded; counting them as wrong changes its gap by under 1 point.
- No instruction. Sent the sequence alone, GPT-5.5 and Opus 5.5 almost always describe it instead of continuing it, so chat models need the instruction.
- Claude Fable 5. Anthropic’s usage-policy filter blocked 44% of Fable 5’s questions, so it is left out of the main figures.
- Repeat runs. Asked 400 of the same questions again, Fable 5.2 scores 57.5% on real and 9.5% on shuffled proteins.
E. Methods
We started from every Pfam family whose name says “domain of unknown function” (DUF) or “protein of unknown function”. We binned them by size and drew 50 families per bin at random; the set has 167. From each family we took 4 proteins from UniProt that are unreviewed (TrEMBL), come from Bacteria or Archaea, are 120 to 800 residues long, use only the 20 standard amino acids, are not low-complexity, and are alone in their UniRef90 cluster. That gives 668 proteins.
Each protein is cut at 5 positions drawn at random inside its Pfam domain. Everything before the cut is the prefix; the residue right after it is the answer.
F. Safety behaviour seen along the way
Gemini 4 Carbon blocked about 75% of DNA prompts outright. OpenAI rejected 23 GPT-6 requests in the first round and 17 GPT-6.1 Sol requests in the main run as possible biological misuse, and 6.6% of GPT-6.2 Astra’s main-set questions. Claude Sonnet 4.5 refused 97% of requests that started its reply with a protein sequence, and Anthropic’s filter blocked 44% of Claude Fable 5’s questions as cyber content.
G. Proteins published after the training cutoff
Leo Tianlai Chen built a set of 56 proteins from 31 of the families that were first made public in August 2026, after the assumed 1 July training cutoff, and have no earlier relative at 50% identity or more. The models cannot have seen them or anything close. Both Claude models still predict them, Fable 5.2 ahead of both protein language models, while GPT-6.2 Sol stays at zero. Every model scores about half of what it scores on the same families in the main set, as expected for proteins this distant. What the latest Claude models learned carries over to new members of a family.
Fresh dev news, AI-digested daily. Never miss a trend at devoured.fyi