Update README.md

README.md

@@ -1,12 +1,28 @@
 ---
+license: other
+base_model: meta-llama/Meta-Llama-3-8B
 library_name: transformers
 tags:
 - 4-bit
 - AWQ
 - text-generation
 - autotrain_compatible
+- generated_from_trainer
+- axolotl
 - endpoints_compatible
 pipeline_tag: text-generation
+model-index:
+- name: out
+  results: []
+datasets:
+- cognitivecomputations/Dolphin-2.9
+- teknium/OpenHermes-2.5
+- m-a-p/CodeFeedback-Filtered-Instruction
+- cognitivecomputations/dolphin-coder
+- cognitivecomputations/samantha-data
+- microsoft/orca-math-word-problems-200k
+- Locutusque/function-calling-chatml
+- internlm/Agent-FLAN
 inference: false
 quantized_by: Suparious
 ---
@@ -15,7 +31,26 @@ quantized_by: Suparious
 - Model creator: [cognitivecomputations](https://huggingface.co/cognitivecomputations)
 - Original model: [dolphin-2.9.1-llama-3-8b](https://huggingface.co/cognitivecomputations/dolphin-2.9.1-llama-3-8b)
 
+<img src="https://cdn-uploads.huggingface.co/production/uploads/63111b2d88942700629f5771/ldkN1J0WIDQwU4vutGYiD.png" width="600" />
 
+## Model Summary
+
+Dolphin 2.9.1 Llama 3 8b 🐬
+
+Curated and trained by Eric Hartford, Lucas Atkins, and Fernando Fernandes, and Cognitive Computations
+
+Discord: https://discord.gg/8fbBeC7ZGx
+
+We have retrained our LLama-3-8b fine tune to address behavioral issues in the initial 2.9 dataset. Specifically, Systemchat was causing the model to be *too* reliant on the system prompt. Additionally, it had an occasional quirk that would cause the model to overly reference the system prompt. We also found generation length was at times not sufficient for any given task. We identified the culprit as Ultrachat. Accounting for these concerns, we removed systemchat and ultrachat from the dataset. It is otherwise identical to dolphin-2.9.
+
+Our appreciation for the sponsors of Dolphin 2.9.1:
+- [Crusoe Cloud](https://crusoe.ai/) - provided excellent on-demand 8xL40S node
+
+This model is based on Llama-3-8b, and is governed by [META LLAMA 3 COMMUNITY LICENSE AGREEMENT](LICENSE)
+
+The base model has 8k context, and the full-weight fine-tuning was with 4k sequence length.
+
+It took 1.5 days on an 8x L40S provided by Crusoe Cloud
 
 ## How to use