Fact-Augmented Lookahead Planning for LLM Agents
The paper introduces LWM-Planner, a fact-augmented lookahead planning framework designed to enhance the performance of LLM agents in complex, partially observable environments through in-context learning. By extracting and validating task-critical facts post-episode, the framework enables recursive, depth-limited lookahead planning that conditions action proposals and state-value estimations on these facts, leading to improved cumulative returns on benchmarks like FrozenLake, CrafterMini, and ALFWorld compared to existing methods such as ReAct and Reflexion. This approach is significant for practitioners as it demonstrates a method for enhancing LLM agent performance without requiring parameter updates, leveraging experience-derived knowledge for more effective planning.