elvis@omarsar0 · X持续学习领域投入多但进展缓慢。CL-Bench（持续学习基准）在六个由专家验证、包含共享可学习结构的领域上测试，发现简单的上下文学习（ICL）基线优于专门为记忆管理构建的系统。该基准引入增益指标以隔离真正学习效果，结果显示智能体常过度拟合即时观察或未能跨实例复用知识。研究指出，若普通ICL基线超过你的记忆架构，则该架构增加的是开销而非学习。论文：arxiv.org/abs/2606.05661。
// Continual Learning Bench //
One of the research areas with lots of investments is continual learning.
While there are many efforts， there is very little progress in measuring it.
So the big question is， do dedicated memory systems actually make agents learn from experience？
Continual Learning Bench says not yet. Across six expert-validated domains with shared learnable structure， naive in-context learning outperforms systems purpose-built for memory management.
CL-Bench introduces a gain metric that isolates genuine learning from prior capability， then shows agents frequently overfit to immediate observations or fail to reuse knowledge across instances.
If a plain ICL baseline beats your memory architecture， the architecture is adding overhead rather than learning.
Paper： https：//arxiv.org/abs/2606.05661
Learn to build effective AI agents in our academy： https：//academy.dair.ai/