收录解读
这篇论文延续 self-evolving agents 的关键问题:技能不是一次性 prompt,也不是静态工具库,而是需要生命周期管理的能力对象。
Dynamic Skill Lifecycle Management 的价值在于把 skill acquisition 从“学会一个技能”推进到“管理一组会变化的技能”。这对长期 agent 更关键,因为技能会过时、冲突、冗余或需要替换。
它值得正式收录,因为本库已经收 Skill1 并 watchlist SkillOS;这篇补的是 lifecycle 视角,能和 skill curation、memory validity、agent self-improvement 形成体系。
它没有更高,是因为当前仍需要证明生命周期策略能在真实开放环境中长期提升,而不是只在受控 RL 任务中有效。
原始摘要与中文对照
中文对照翻译
大型语言模型智能体越来越依赖外部技能来解决复杂任务,其中技能作为模块化单元,将其能力扩展到仅凭参数记忆所能支持的范围之外。现有方法假设外部技能要么作为持久指导积累,要么内化到策略中,最终导致零技能推理。我们认为这种假设过于严格,因为在有限的参数容量和技能之间不均匀的边际贡献下,最优的活跃技能集是非单调的,并且依赖于任务和阶段。在这项工作中,我们提出了SLIM,一个用于智能体强化学习(RL)的动态技能生命周期管理框架,它将活跃的外部技能集视为一个与策略学习共同更新的动态优化变量。具体来说,SLIM通过留一技能验证来估计每个活跃技能的边际外部贡献,然后应用三个生命周期操作:保留高价值技能,淘汰在充分暴露后贡献变得微不足道的技能,以及在持续失败揭示能力覆盖不足时扩展技能库。实验表明,SLIM在ALFWorld和SearchQA上平均优于最佳基线7.1个百分点。结果进一步表明,策略学习和外部技能保留并非相互排斥:一些技能被策略吸收,而另一些则继续提供外部价值,支持SLIM作为基于技能的智能体RL的更通用范式。代码可在https://github.com/ejhshen/SLIM获取。
原始摘要
Large language model agents increasingly rely on external skills to solve complex tasks, where skills act as modular units that extend their capabilities beyond what parametric memory alone supports. Existing methods assume external skills either accumulate as persistent guidance or internalized into the policy, eventually leading to zero-skill inference. We argue this assumption is overly restrictive, since with limited parametric capacity and uneven marginal contribution across skills, the optimal active skill set is non-monotonic, task- and stage-dependent. In this work, we propose SLIM, a framework of dynamic Skill LIfecycle Management for agentic reinforcement learning (RL), which treats the active external skill set as a dynamic optimization variable jointly updated with policy learning. Specifically, SLIM estimates each active skill’s marginal external contribution through leaveone-skill-out validation, then applies three lifecycle operations: retaining highvalue skills, retiring skills whose contribution becomes negligible after sufficient exposure, and expanding the skill bank when persistent failures reveal missing capability coverage. Experiments show that SLIM outperforms the best baselines by an average of 7.1% points across ALFWorld and SearchQA. Results further indicate that policy learning and external skill retention are not mutually exclusive: some skills are absorbed into the policy, while others continue to provide external value, supporting SLIM as a more general paradigm for skill-based agentic RL. Code is available at https://github.com/ejhshen/SLIM.