Hugging Face
Models
Datasets
Spaces
Buckets
new
Docs
Enterprise
Pricing
Website
Tasks
HuggingChat
Collections
Languages
Organizations
Community
Blog
Posts
Daily Papers
Hardware
Learn
Discord
Forum
GitHub
Solutions
Team & Enterprise
Hugging Face PRO
Enterprise Support
Inference Providers
Inference Endpoints
Storage Buckets
Log In
Sign Up
Compactbot
/
compactlm-5m
Like
0
Text Generation
Safetensors
English
compactlm
tiny-lm
tiny
slm
small-language-model
sub-1m
from-scratch
License:
apache-2.0
Model card
Files
Files and versions
xet
Community
9
Copy to bucket
new
refs/pr/9
compactlm-5m
27.6 MB
Ctrl+K
Ctrl+K
1 contributor
History:
22 commits
Compactbot
Fix over-stated quality claims: model is first-sentence-coherent then loops, not "fluent/on-topic"
d8528fd
verified
11 days ago
.gitattributes
Safe
1.52 kB
initial commit
12 days ago
README.md
4.04 kB
Fix over-stated quality claims: model is first-sentence-coherent then loops, not "fluent/on-topic"
11 days ago
config.json
400 Bytes
Add architecture config (4,912,992 params)
11 days ago
eval_compactlm5m.py
Safe
3.07 kB
Add exact eval script (val PPL + generation + degeneracy check) (#4)
12 days ago
eval_fresh.json
Safe
6.23 kB
Add fresh eval results (val ppl + 15 samples + degeneracy check)
12 days ago
model.safetensors
27 MB
xet
Add model weights (27 MB F32 safetensors)
11 days ago
tokenizer.json
555 kB
Add BPE tokenizer (8192 vocab)
11 days ago
train_compactlm5m.py
Safe
13.6 kB
Add exact training script (defines CompactLM class) (#3)
12 days ago