| # Step-level Value Preference Optimization for Mathematical Reasoning | |
| This is the official repository for paper [Step-level Value Preference Optimization for Mathematical Reasoning](https://arxiv.org/abs/2406.10858). It is extracted from our internal corporate codebase. As a result, there may be slight differences when reproducing the numbers reported in our paper, but they should be very close. | |
| The implementation of SVPO is based on [AlphaMath](https://arxiv.org/abs/2405.03553), such as MCTS and Step-level beam search (SBS). | |
| Therefore, we provide the [code](https://github.com/MARIO-Math-Reasoning/Super_MARIO) of step-level preference pairs construction in this repository to facilitate reproduction. | |
| ## Citation | |
| SVPO | |
| ``` | |
| @misc{chen2024steplevel, | |
| title={Step-level Value Preference Optimization for Mathematical Reasoning}, | |
| author={Guoxin Chen and Minpeng Liao and Chengxi Li and Kai Fan}, | |
| year={2024}, | |
| eprint={2406.10858}, | |
| archivePrefix={arXiv}, | |
| primaryClass={cs.CL} | |
| } | |
| ``` | |
| AlphaMATH | |
| ``` | |
| @misc{chen2024alphamath, | |
| title={AlphaMath Almost Zero: process Supervision without process}, | |
| author={Guoxin Chen and Minpeng Liao and Chengxi Li and Kai Fan}, | |
| year={2024}, | |
| eprint={2405.03553}, | |
| archivePrefix={arXiv}, | |
| primaryClass={cs.CL} | |
| } | |
| ``` | |