APEX Quants (GGUF)
Collection
MoE models quantized with the APEX Quantization technique ( https://github.com/mudler/apex-quant ) • 48 items • Updated • 149
Joe
Joe57005
AI & ML interests
Small language models and practical use of AI.
Recent Activity
repliedto Banaxi-Tech's post 15 days ago
We're excited to release BananaAll, our SLM Super App.
It allows you to do EVERYTHING you need to do to trains SLMs in a single app, no terminal, no 30 chrome tabs.
The train tab allows you to train models, select datasets from presets, and use other ones with auto mapping, model size slider, it automatically generates a training script for you.
Then after you've trained the model or want to compare it to competitors, the evaluation tab, run ARC EASY, ARC Challenge, Hellaswag, PIQA, Arithmark 3, BananaMind Base Bench and more! Simple Results screen.
And lastly the inference tab, run your trained models or others.
Normally you would need seperate apps or scripts for that, but the BananaAll Super App lets you do all of that in a single app.
We also trained a small 2.5M parameter model on 200M tokens of Fineweb edu, The results: BananaMind Base Bench 854 and 53% on PIQA. On only 200M tokens.
Check it out at https://github.com/BananaMind/BananaAll. updated a collection 17 days ago
Architectures to watch updated a collection 17 days ago
Good for home automationOrganizations
None yet
upvoted a collection 6 months ago
upvoted an article 12 months ago
Article
Projected Abliteration
grimjim
• • 47 upvoted a collection about 1 year ago