type
Browse files
README.md
CHANGED
@@ -114,13 +114,13 @@ pipe = setup_pipeline(llm_path, use_8bit=True)
|
|
114 |
|
115 |
| Model | MMLU Score |
|
116 |
| --- | --- |
|
117 |
-
| llama3.
|
118 |
| ichigo-llama3.1-s-v0.3: phase 3 | 63.79 |
|
119 |
| ichigo-llama3.1-s-v0.3: phase 2 | 63.08 |
|
120 |
| ichigo-llama3.1-s-base-v0.3 | 42.11 |
|
121 |
| mini-ichigo-llama3.2-3B-s-instruct | **58.60** |
|
122 |
| mini-ichigo-llama3.2-3B-s-base | 59.61 |
|
123 |
-
| llama3.
|
124 |
|
125 |
|
126 |
**[AudioBench](https://arxiv.org/abs/2406.16020) Eval**:
|
|
|
114 |
|
115 |
| Model | MMLU Score |
|
116 |
| --- | --- |
|
117 |
+
| llama3.1-instruct-8b | 69.40 |
|
118 |
| ichigo-llama3.1-s-v0.3: phase 3 | 63.79 |
|
119 |
| ichigo-llama3.1-s-v0.3: phase 2 | 63.08 |
|
120 |
| ichigo-llama3.1-s-base-v0.3 | 42.11 |
|
121 |
| mini-ichigo-llama3.2-3B-s-instruct | **58.60** |
|
122 |
| mini-ichigo-llama3.2-3B-s-base | 59.61 |
|
123 |
+
| llama3.1-s-instruct-v0.2 | 50.27 |
|
124 |
|
125 |
|
126 |
**[AudioBench](https://arxiv.org/abs/2406.16020) Eval**:
|