Update README.md
Browse files
README.md
CHANGED
@@ -60,7 +60,7 @@ Along with the open weights, all training scripts and configuration files are ma
|
|
60 |
|
61 |
### Description
|
62 |
|
63 |
-
Transformer-based decoder-only language model that has been pre-trained from scratch on
|
64 |
The pre-training corpus contains text in 35 European languages and code.
|
65 |
|
66 |
### Hyperparameters
|
|
|
60 |
|
61 |
### Description
|
62 |
|
63 |
+
Transformer-based decoder-only language model that has been pre-trained from scratch on 11.675 trillion tokens of highly curated data.
|
64 |
The pre-training corpus contains text in 35 European languages and code.
|
65 |
|
66 |
### Hyperparameters
|