Text Generation
Transformers
Safetensors
English
Japanese
llama
conversational
text-generation-inference
Taishi-N324 commited on
Commit
aa75147
·
verified ·
1 Parent(s): 4bd49fa

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +3 -2
README.md CHANGED
@@ -73,10 +73,11 @@ This repository provides large language models developed by [Swallow-LLM](https:
73
  | Llama 3 heron brain 8B v0.3 | 0.3580 | 0.6563 | 0.5686 | 0.3726 | 0.9002 | 0.6213 | 0.5777 | 0.6409 | 0.3720 | 0.5631 |
74
  | Llama 3 Swallow 8B Instruct | 0.3720 | 0.6557 | 0.5861 | 0.3648 | 0.9002 | 0.6315 | 0.5959 | 0.6391 | 0.4238 | 0.5743 |
75
  | Llama 3.1 Swallow 8B Instruct | 0.3900 | **0.6488** | **0.6151** | **0.3553** | 0.8912 | 0.6237 | 0.6050 | 0.6417 | 0.3787 | 0.5722 |
76
- | 最高スコア | 0.4280 | 0.6994 | 0.6465 | 0.3783 | 0.9037 | 0.7419 | 0.7453 | 0.6928 | 0.6360 | 0.6321 |
77
 
 
78
 
79
- |Model|coding|extraction|humanities|math|reasoning|roleplay|stem|writing|JMTAvg|
 
80
  | RakutenAI-7B-chat | 0.2475 | 0.3522 | 0.4692 | 0.2140 | 0.3926 | 0.4427 | 0.3977 | 0.4434 | 0.3699 |
81
  | Qwen2-7B-Instruct | 0.4635 | 0.6909 | 0.6857 | 0.5970 | 0.5042 | 0.6667 | 0.5353 | 0.6808 | 0.6030 |
82
  | Qwen2.5-7B-Instruct | 0.5111 | 0.7489 | 0.6913 | 0.5742 | 0.4851 | 0.6810 | 0.5350 | 0.6810 | **0.6134** |
 
73
  | Llama 3 heron brain 8B v0.3 | 0.3580 | 0.6563 | 0.5686 | 0.3726 | 0.9002 | 0.6213 | 0.5777 | 0.6409 | 0.3720 | 0.5631 |
74
  | Llama 3 Swallow 8B Instruct | 0.3720 | 0.6557 | 0.5861 | 0.3648 | 0.9002 | 0.6315 | 0.5959 | 0.6391 | 0.4238 | 0.5743 |
75
  | Llama 3.1 Swallow 8B Instruct | 0.3900 | **0.6488** | **0.6151** | **0.3553** | 0.8912 | 0.6237 | 0.6050 | 0.6417 | 0.3787 | 0.5722 |
 
76
 
77
+ ## MT-Bench JA
78
 
79
+ | Model | coding | extraction | humanities | math | reasoning | roleplay | stem | writing | JMTAvg |
80
+ |-------|--------|------------|------------|------|-----------|----------|------|---------|--------|
81
  | RakutenAI-7B-chat | 0.2475 | 0.3522 | 0.4692 | 0.2140 | 0.3926 | 0.4427 | 0.3977 | 0.4434 | 0.3699 |
82
  | Qwen2-7B-Instruct | 0.4635 | 0.6909 | 0.6857 | 0.5970 | 0.5042 | 0.6667 | 0.5353 | 0.6808 | 0.6030 |
83
  | Qwen2.5-7B-Instruct | 0.5111 | 0.7489 | 0.6913 | 0.5742 | 0.4851 | 0.6810 | 0.5350 | 0.6810 | **0.6134** |