Update README.md
Browse files
README.md
CHANGED
|
@@ -13,6 +13,7 @@ should probably proofread and complete it, then remove this comment. -->
|
|
| 13 |
# Meta-Llama-3-8B-Instruct_derta_100step
|
| 14 |
|
| 15 |
This model is a fine-tuned version of [meta-llama/Meta-Llama-3-8B-Instruct](https://huggingface.co/meta-llama/Meta-Llama-3-8B-Instruct) on the [Evol-Instruct](https://huggingface.co/datasets/WizardLMTeam/WizardLM_evol_instruct_70k) and [BeaverTails](https://huggingface.co/datasets/PKU-Alignment/BeaverTails) dataset.
|
|
|
|
| 16 |
|
| 17 |
## Model description
|
| 18 |
|
|
|
|
| 13 |
# Meta-Llama-3-8B-Instruct_derta_100step
|
| 14 |
|
| 15 |
This model is a fine-tuned version of [meta-llama/Meta-Llama-3-8B-Instruct](https://huggingface.co/meta-llama/Meta-Llama-3-8B-Instruct) on the [Evol-Instruct](https://huggingface.co/datasets/WizardLMTeam/WizardLM_evol_instruct_70k) and [BeaverTails](https://huggingface.co/datasets/PKU-Alignment/BeaverTails) dataset.
|
| 16 |
+
The model is continued to train 100 steps with DeRTa on LLaMA3-8B-Instruct.
|
| 17 |
|
| 18 |
## Model description
|
| 19 |
|