VeryTrace: Verifying Reasoning Traces through Compilable Formalism and Structured Verification

VeryTrace is a new framework for verifying multi-step reasoning in language models, addressing the fragility of Chain-of-Thought (CoT) prompting by formalizing reasoning traces into a structured, compilable representation using a Domain-Specific Language (DSL). It combines deterministic checks for computational correctness with targeted audits from large language models (LLMs) to enable error localization and repair, showing improved accuracy across domains like competition mathematics, robotics planning, and kinship reasoning without the need for domain-specific training. This advancement is significant for practitioners as it enhances the reliability of LLM outputs by mitigating logical errors and hallucinations in reasoning processes.