Commit
·
f7f8342
1
Parent(s):
a371849
Adding Evaluation Results
Browse filesThis is an automated PR created with https://huggingface.co/spaces/Weyaxi/open-llm-leaderboard-results-pr
The purpose of this PR is to add evaluation results from the Open LLM Leaderboard to your model card.
If you encounter any issues, please report them to https://huggingface.co/spaces/Weyaxi/open-llm-leaderboard-results-pr/discussions
README.md
CHANGED
@@ -357,3 +357,17 @@ USER: Let’s assume they all share the same mother and father. Now explain with
|
|
357 |
ASSISTANT: If Sally has three brothers then that means she has six siblings altogether. Each brother has two sisters, which means that there are twelve female relatives in her family - one for each of her brothers and herself. Since there are only six females in the entire family, that means that Sally’s mother has no other children than her own three sons - so she can’t be the mother of any of the sisters. So all those sisters have to belong to one of the brothers, and since they are shared by two brothers, then each brother has a single sister. Therefore, there is only one sister for Sally, making the final answer 1.
|
358 |
```
|
359 |
- pretty sure that reasoning isn't correct, and the final answer of having 1 sister is a lucky guess
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
357 |
ASSISTANT: If Sally has three brothers then that means she has six siblings altogether. Each brother has two sisters, which means that there are twelve female relatives in her family - one for each of her brothers and herself. Since there are only six females in the entire family, that means that Sally’s mother has no other children than her own three sons - so she can’t be the mother of any of the sisters. So all those sisters have to belong to one of the brothers, and since they are shared by two brothers, then each brother has a single sister. Therefore, there is only one sister for Sally, making the final answer 1.
|
358 |
```
|
359 |
- pretty sure that reasoning isn't correct, and the final answer of having 1 sister is a lucky guess
|
360 |
+
|
361 |
+
# [Open LLM Leaderboard Evaluation Results](https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard)
|
362 |
+
Detailed results can be found [here](https://huggingface.co/datasets/open-llm-leaderboard/details_TheBloke__manticore-13b-chat-pyg-GPTQ)
|
363 |
+
|
364 |
+
| Metric | Value |
|
365 |
+
|-----------------------|---------------------------|
|
366 |
+
| Avg. | 46.49 |
|
367 |
+
| ARC (25-shot) | 57.85 |
|
368 |
+
| HellaSwag (10-shot) | 81.07 |
|
369 |
+
| MMLU (5-shot) | 47.56 |
|
370 |
+
| TruthfulQA (0-shot) | 47.77 |
|
371 |
+
| Winogrande (5-shot) | 75.93 |
|
372 |
+
| GSM8K (5-shot) | 8.49 |
|
373 |
+
| DROP (3-shot) | 6.8 |
|