Update README.md
Browse files
README.md
CHANGED
@@ -27,7 +27,7 @@ But hey, that’s where this model comes in! 🚀 It opens up exciting opportuni
|
|
27 |
|
28 |
Here’s what powers this model (we went with [RoBERTa](https://arxiv.org/abs/1907.11692)):
|
29 |
|
30 |
-
1️⃣ **vocab_size** =
|
31 |
2️⃣ **max_position_embeddings** = 514
|
32 |
3️⃣ **num_attention_heads** = 12
|
33 |
4️⃣ **num_hidden_layers** = 6
|
|
|
27 |
|
28 |
Here’s what powers this model (we went with [RoBERTa](https://arxiv.org/abs/1907.11692)):
|
29 |
|
30 |
+
1️⃣ **vocab_size** = 25,000
|
31 |
2️⃣ **max_position_embeddings** = 514
|
32 |
3️⃣ **num_attention_heads** = 12
|
33 |
4️⃣ **num_hidden_layers** = 6
|