jealk commited on
Commit
ce4dbfa
·
verified ·
1 Parent(s): f141add

Added note on lm head warning

Browse files
Files changed (1) hide show
  1. README.md +2 -1
README.md CHANGED
@@ -118,4 +118,5 @@ tensor([[0.7161, 0.4021],
118
  [0.4525, 0.7370]])
119
  """
120
 
121
- ```
 
 
118
  [0.4525, 0.7370]])
119
  """
120
 
121
+ ```
122
+ *Note: When running the above a warning will appear indicating that lm_head.weight was not used. This layer is only for token prediction and is not required for embedding extraction, so the warning safely be ignored.*