Hugging Face
Models
Datasets
Spaces
Community
Docs
Enterprise
Pricing
Log In
Sign Up
Spaces:
yhavinga
/
dutch-tokenizer-arena
like
8
Running
App
Files
Files
Community
1
Fetching metadata from the HF Docker repository...
814ee6b
dutch-tokenizer-arena
/
tokenizer
Ctrl+K
Ctrl+K
3 contributors
History:
7 commits
xu-song
add compress rate
814ee6b
about 1 year ago
chinese_sptokenizer_patch.py
Safe
27 Bytes
add compress rate
about 1 year ago
sptokenizer_patch.py
Safe
2.82 kB
add compress rate
about 1 year ago
tiktoken_patch.py
Safe
2.97 kB
add compress rate
about 1 year ago
tokenizer_patcher.py
Safe
211 Bytes
add compress rate
about 1 year ago
