ReTreVal: Reasoning Tree with Validation and Cross-Problem Memory for Large Language Models
Researchers introduce ReTreVal, a training-free framework that enables large language models to learn from failures across multiple problems without fine-tuning. By implementing adaptive tree exploration, typed-failure backtracking, and cross-problem memory, ReTreVal achieves significant performance improvements on mathematical and knowledge reasoning tasks, allowing a 32B model to match much larger systems.