Hugging Face's logo
Papers
arxiv:2505.14852

EasyMath: A 0-shot Math Benchmark for SLMs

Published on May 20
Upvote
2
Authors:
Drishya Karki ,
Michiel Kamphuis ,

Abstract

Evaluation of small language models on the EasyMath benchmark shows accuracy and consistency improve with model size and training, while chain-of-thought marginally enhances performance.

AI-generated summary

EasyMath is a compact benchmark for practical math reasoning in small language models. It covers thirteen categories, from basic arithmetic and order of operations to word problems, algebraic expressions, edge cases, and omits specialist topics. We tested 23 models (14M to 4B parameters) using exact, numerical, and symbolic checks on free-form answers in a zero-shot setting. Accuracy rises with size and training, chain-of-thought adds modest gains, and consistency improves at scale.

View arXiv page View PDF Add to collection

Community

Sign up or log in to comment

Models citing this paper 0

No model linking this paper

Cite arxiv.org/abs/2505.14852 in a model README.md to link it from this page.

Datasets citing this paper 0

No dataset linking this paper

Cite arxiv.org/abs/2505.14852 in a dataset README.md to link it from this page.

Spaces citing this paper 0

No Space linking this paper

Cite arxiv.org/abs/2505.14852 in a Space README.md to link it from this page.

Collections including this paper 0

No Collection including this paper

Add this paper to a collection to link it from this page.