DEVOURED
Google Introduces WikiSkill for Persistent Agent Learning
Google's WikiSkill framework improves AI agent performance by systematically storing and refining successful execution workflows into a persistent, accessible wiki.
What: WikiSkill separates raw agent experience from executable skills, using a knowledge-base wiki to build upon past iterations. Experiments show that smaller models using this framework can outperform significantly larger models that lack evolved skills, and these skills are transferable across different model families.
Why it matters: This approach addresses the volatility of agentic workflows by treating successful task execution as durable knowledge rather than transient, unorganized log history.
Deep dive
- WikiSkill co-evolves agent skills alongside a centralized, persistent wiki.
- Decouples raw execution logs, compiled knowledge, and finalized skills.
- Demonstrates that larger models gain disproportionate utility from evolved skills.
- Smaller models equipped with WikiSkill often surpass larger models that rely on zero-shot or non-evolved approaches.
- Evolved skills are model-agnostic and show high cross-model transferability.
- Persistent knowledge accumulation acts as a critical bottleneck for performance; without it, skill evolution stagnates.
Decoder
- Agent skills: Modularized sequences of actions and knowledge that allow AI agents to perform specialized tasks repeatedly without needing to re-reason from scratch.
- Ablation studies: The process of systematically removing components of a system to evaluate the specific contribution of each part to the final performance.
Original article
WikiSkill: Compiling Agent Experience into Persistent Knowledge for Skill Evolution
Agent skills package specialized knowledge and workflows into reusable resources that extend AI agent capabilities. Recent work automatically discovers such skills from agent experience, which enables agents to progressively adapt through interaction. However, the insights that guide skill development typically remain scattered across optimization histories, limiting their systematic reuse across iterations. We introduce WikiSkill, a framework that co-evolves agent skills with a persistent knowledge base (wiki). At a high level, WikiSkill separates raw execution experience, accumulated knowledge, and executable skills, while continuously consolidating experience into the wiki, which subsequent skill updates can build on. Across diverse benchmarks and models, WikiSkill consistently outperforms state-of-the-art skill-evolution methods and improves over no-skill baselines in most model-benchmark settings. We find that skill evolution complements model scaling: larger models generally benefit more from evolved skills, while smaller models with skills can outperform substantially larger models without them. We also find that evolved skills transfer effectively across models and model families, and skills evolved by other models can outperform self-evolved skills. Finally, our ablation studies confirm that persistent knowledge accumulation in the wiki is critical for effective skill evolution. These results demonstrate the benefits of systematically accumulating and refining agent experience for developing reusable and transferable skills.
Explore all 65 articles in today's digest
Fresh dev news, AI-digested daily. Never miss a trend at devoured.fyi