Reward-Centered ReST-MCTS: A Robust Decision-Making Framework for Robotic Manipulation in High Uncertainty Environments

The paper introduces Reward-Centered ReST-MCTS, a decision-making framework designed to enhance Monte Carlo tree search (MCTS) for robotic manipulation in uncertain environments. It decomposes feedback into multiple channels—rule, heuristic, neural, and value estimation—allowing for improved search bias and robustness against challenges such as sparse rewards and noisy transitions. This framework is significant for AI practitioners as it provides a structured approach to improving decision-making in high-uncertainty scenarios without necessitating a fully differentiable policy.