Hugging Face's logo

mpiorczynski
/
relu-bert-base-uncased

Fill-Mask
Transformers
PyTorch
Safetensors
English
bert
Model card Files Community
1
mpiorczynski commited on
Commit
7a2410c
·
1 Parent(s): 6ff890b

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +1 -1
README.md CHANGED
@@ -8,4 +8,4 @@ tags:
8
  - fill-mask
9
  library_name: transformers
10
  ---
11
- This model is derived from the bert-base-uncased checkpoint by replacing the GELU with ReLU and further pre-trained through several iterations to adapt it to the change of the activation function.
 
8
  - fill-mask
9
  library_name: transformers
10
  ---
11
+ This model is derived from the bert-base-uncased checkpoint by replacing the GELU with ReLU activation function and further pre-trained through several iterations to adapt it to the change of the activation function.