AtAndDev/UVOX-Magpie-xLAM-Supernova-8B
0.7B • Updated • 5
alkinun
AtAndDev
AI & ML interests
decentralize
Recent Activity
liked a dataset about 5 hours ago
common-pile/project_gutenberg_filtered liked a dataset about 15 hours ago
IFM/Pretrain-Behaviors reacted to juiceb0xc0de's post with 🔥 about 15 hours ago
Dude, Where's My Update? I'll tell you where! ~97.6% of my BF16 parameter coordinates didn't move at all, and the ones that did overshot by ~1.33x.
It's nice to do research that doesn't end in disproving yourself once again and moving on to the next subject once in awhile.
Back to the topic, if you've ever wondered why most of your weights are basically ghosting you nearly every step when you store your weights at bf16, Dude, I Measured It.
https://huggingface.co/blog/juiceb0xc0de/intended-and-realized-updates-in-bf16-fine-tuning#dude-wheres-my-updateOrganizations
AtAndDev/Magpie-xLAM-Supernova-8B
Text Generation • 8B • Updated • 16 • 1
AtAndDev/UVOX-xLAM-2-8B
0.7B • Updated • 6
AtAndDev/UVOX-96k-Llama-32-3B-Instruct
Audio-Text-to-Text • 49.6M • Updated • 5
AtAndDev/UVOX-40k-Llama-32-3B-Instruct
Audio-Text-to-Text • 49.6M • Updated • 7
AtAndDev/UVOX-12k-Llama-32-3B-Instruct
Audio-Text-to-Text • 49.6M • Updated • 8
AtAndDev/UVOX-95k-Llama-3.2-1B-Instruct
Audio-Text-to-Text • 46.1M • Updated • 4
AtAndDev/UVOX-90k-Llama-3.2-1B-Instruct
Audio-Text-to-Text • 46.1M • Updated • 7
AtAndDev/UVOX-50k-Llama-3.2-1B-Instruct
Audio-Text-to-Text • 46.1M • Updated • 7
AtAndDev/UVOX-5k-Llama-3.2-1B-Instruct
Audio-Text-to-Text • 46.1M • Updated • 4
AtAndDev/UVOX-Qwen3-4B-Instruct-2507
Audio-Text-to-Text • 47.2M • Updated • 5
AtAndDev/SelfCoder-v0.0
Text Generation • 4B • Updated • 6
AtAndDev/lora_model
Updated
AtAndDev/marco-qwq-7B
Text Generation • 8B • Updated • 8
AtAndDev/Ogno-Monarch-Neurotic-9B-Passthrough
Text Generation • 9B • Updated • 82
AtAndDev/Ogno-Monarch-Neurotic-7B-Dare-Ties
Text Generation • 7B • Updated • 60
AtAndDev/Marcoro14-7B-Slerp
Text Generation • 7B • Updated • 13
AtAndDev/CapybaraMarcoroni-7B
Text Generation • 7B • Updated • 61
AtAndDev/ShortKing-3b-v0.2
Text Generation • 3B • Updated • 19 • 2
AtAndDev/ShortKing-1.4b-v0.1
Text Generation • 1B • Updated • 27 • 2