Update README.md
Browse files
README.md
CHANGED
@@ -19,6 +19,18 @@ language:
|
|
19 |
|
20 |
This LlaMa model was trained 2x faster with [Unsloth](https://github.com/unslothai/unsloth) and Huggingface's TRL library.
|
21 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
22 |
# Pipeline
|
23 |
```py
|
24 |
import torch
|
|
|
19 |
|
20 |
This LlaMa model was trained 2x faster with [Unsloth](https://github.com/unslothai/unsloth) and Huggingface's TRL library.
|
21 |
|
22 |
+
# First, download requirements with following code:
|
23 |
+
```py
|
24 |
+
import os
|
25 |
+
if "COLAB_" not in "".join(os.environ.keys()):
|
26 |
+
!pip install unsloth
|
27 |
+
else:
|
28 |
+
!pip install --no-deps bitsandbytes accelerate xformers==0.0.29.post3 peft trl triton cut_cross_entropy unsloth_zoo
|
29 |
+
!pip install sentencepiece protobuf datasets huggingface_hub hf_transfer
|
30 |
+
!pip install --no-deps unsloth
|
31 |
+
!pip install snac
|
32 |
+
```
|
33 |
+
|
34 |
# Pipeline
|
35 |
```py
|
36 |
import torch
|