Added note on lm head warning
Browse files
README.md
CHANGED
@@ -118,4 +118,5 @@ tensor([[0.7161, 0.4021],
|
|
118 |
[0.4525, 0.7370]])
|
119 |
"""
|
120 |
|
121 |
-
```
|
|
|
|
118 |
[0.4525, 0.7370]])
|
119 |
"""
|
120 |
|
121 |
+
```
|
122 |
+
*Note: When running the above a warning will appear indicating that lm_head.weight was not used. This layer is only for token prediction and is not required for embedding extraction, so the warning safely be ignored.*
|