Update README.md
Browse files
README.md
CHANGED
@@ -73,10 +73,11 @@ This repository provides large language models developed by [Swallow-LLM](https:
|
|
73 |
| Llama 3 heron brain 8B v0.3 | 0.3580 | 0.6563 | 0.5686 | 0.3726 | 0.9002 | 0.6213 | 0.5777 | 0.6409 | 0.3720 | 0.5631 |
|
74 |
| Llama 3 Swallow 8B Instruct | 0.3720 | 0.6557 | 0.5861 | 0.3648 | 0.9002 | 0.6315 | 0.5959 | 0.6391 | 0.4238 | 0.5743 |
|
75 |
| Llama 3.1 Swallow 8B Instruct | 0.3900 | **0.6488** | **0.6151** | **0.3553** | 0.8912 | 0.6237 | 0.6050 | 0.6417 | 0.3787 | 0.5722 |
|
76 |
-
| 最高スコア | 0.4280 | 0.6994 | 0.6465 | 0.3783 | 0.9037 | 0.7419 | 0.7453 | 0.6928 | 0.6360 | 0.6321 |
|
77 |
|
|
|
78 |
|
79 |
-
|Model|coding|extraction|humanities|math|reasoning|roleplay|stem|writing|JMTAvg|
|
|
|
80 |
| RakutenAI-7B-chat | 0.2475 | 0.3522 | 0.4692 | 0.2140 | 0.3926 | 0.4427 | 0.3977 | 0.4434 | 0.3699 |
|
81 |
| Qwen2-7B-Instruct | 0.4635 | 0.6909 | 0.6857 | 0.5970 | 0.5042 | 0.6667 | 0.5353 | 0.6808 | 0.6030 |
|
82 |
| Qwen2.5-7B-Instruct | 0.5111 | 0.7489 | 0.6913 | 0.5742 | 0.4851 | 0.6810 | 0.5350 | 0.6810 | **0.6134** |
|
|
|
73 |
| Llama 3 heron brain 8B v0.3 | 0.3580 | 0.6563 | 0.5686 | 0.3726 | 0.9002 | 0.6213 | 0.5777 | 0.6409 | 0.3720 | 0.5631 |
|
74 |
| Llama 3 Swallow 8B Instruct | 0.3720 | 0.6557 | 0.5861 | 0.3648 | 0.9002 | 0.6315 | 0.5959 | 0.6391 | 0.4238 | 0.5743 |
|
75 |
| Llama 3.1 Swallow 8B Instruct | 0.3900 | **0.6488** | **0.6151** | **0.3553** | 0.8912 | 0.6237 | 0.6050 | 0.6417 | 0.3787 | 0.5722 |
|
|
|
76 |
|
77 |
+
## MT-Bench JA
|
78 |
|
79 |
+
| Model | coding | extraction | humanities | math | reasoning | roleplay | stem | writing | JMTAvg |
|
80 |
+
|-------|--------|------------|------------|------|-----------|----------|------|---------|--------|
|
81 |
| RakutenAI-7B-chat | 0.2475 | 0.3522 | 0.4692 | 0.2140 | 0.3926 | 0.4427 | 0.3977 | 0.4434 | 0.3699 |
|
82 |
| Qwen2-7B-Instruct | 0.4635 | 0.6909 | 0.6857 | 0.5970 | 0.5042 | 0.6667 | 0.5353 | 0.6808 | 0.6030 |
|
83 |
| Qwen2.5-7B-Instruct | 0.5111 | 0.7489 | 0.6913 | 0.5742 | 0.4851 | 0.6810 | 0.5350 | 0.6810 | **0.6134** |
|