Hugging Face
Models
Datasets
Spaces
Community
Docs
Enterprise
Pricing
Log In
Sign Up
Spaces:
Duplicated from
MohamedRashad/arabic-tokenizers-leaderboard
wissamantoun
/
arabic-tokenizers-leaderboard
like
0
Running
App
Files
Files
Community
Fetching metadata from the HF Docker repository...
a9aadc2
arabic-tokenizers-leaderboard
Ctrl+K
Ctrl+K
2 contributors
History:
6 commits
MohamedRashad
Refactor tokenize_text function to include better tokenization for Arabic Text
a9aadc2
about 1 year ago
.gitattributes
Safe
1.52 kB
initial commit
about 1 year ago
README.md
Safe
269 Bytes
initial commit
about 1 year ago
app.py
Safe
8.04 kB
Refactor tokenize_text function to include better tokenization for Arabic Text
about 1 year ago
requirements.txt
Safe
54 Bytes
Add sentencepiece to requirements.txt
about 1 year ago