ai-digest.dev
last updated 1 h ago
TrainingarXiv cs.AI 19 d ago

Curriculum Reinforcement Learning Can Incentivize Reasoning Capacity in LLMs Beyond the Base Model

The paper introduces a boundary-aware Curriculum Reinforcement Learning (RL) approach designed to enhance the reasoning capacity of large language models (LLMs) beyond their base capabilities. By utilizing pass@k sampling to identify reasoning capacity boundaries and applying targeted teacher guidance, this method achieves significant improvements in performance metrics, with an average pass@256 score increase of 9.8 percentage points over base models like Qwen, Llama, and DeepSeek, and 10.3 percentage points over conventional Vanilla RLVR. This advancement is crucial for practitioners seeking to develop LLMs that can continually extend their reasoning abilities.

reinforcement learningcurriculum learningllmrelevance 0.00 · engagement 0.00
Read at source ↗← all news
Curriculum Reinforcement Learning Can Incentivize Reasoning Capacity in LLMs Beyond the Base Model — AI News Digest