Hugging Face
Models
Datasets
Spaces
Buckets
Docs
Enterprise
Pricing
Website
Tasks
HuggingChat
Collections
Languages
Organizations
Community
Blog
Posts
Daily Papers
Hardware
Learn
Discord
Forum
GitHub
Solutions
Team & Enterprise
Hugging Face PRO
Enterprise Support
Inference Providers
Inference Endpoints
Storage Buckets
Log In
Sign Up
ibizaca
/
cro-bpe-48k
Like
3
HuggingFaceFW/fineweb-2
classla/ParlaSpeech-HR
coastalcph/multi_eurlex
Croatian
cro-bpe
tokenizers
tokenizer
bpe
byte-level-bpe
tiktoken
croatian
License:
apache-2.0
Model card
Files
Files and versions
xet
Community
Copy to bucket
main
cro-bpe-48k
5.72 MB
Ctrl+K
Ctrl+K
1 contributor
History:
4 commits
ibizaca
Set library_name to cro-bpe and keep the tokenizers tag
5dfe8db
verified
8 days ago
.gitattributes
Safe
1.52 kB
initial commit
10 days ago
README.md
Safe
5.1 kB
Set library_name to cro-bpe and keep the tokenizers tag
8 days ago
config.json
Safe
2.05 kB
Add config.json copy of tiktoken.json for download stats
8 days ago
cro-bpe-48k.tiktoken
Safe
831 kB
Add cro-bpe-48k
10 days ago
evaluation.json
Safe
80.1 kB
Add cro-bpe-48k
10 days ago
merges.txt
Safe
481 kB
Add cro-bpe-48k
10 days ago
special_tokens_map.json
Safe
1.64 kB
Add cro-bpe-48k
10 days ago
tiktoken.json
Safe
2.05 kB
Add cro-bpe-48k
10 days ago
tokenizer.json
Safe
3.5 MB
Add cro-bpe-48k
10 days ago
tokenizer_config.json
Safe
1.84 kB
Add cro-bpe-48k
10 days ago
training_config.json
Safe
6.82 kB
Add cro-bpe-48k
10 days ago
vocab.json
Safe
808 kB
Add cro-bpe-48k
10 days ago
