AwakeningOS/VISTA-24M
Text Generation • 24.3M • Updated
AwakeningOS
AwakeningOS
·
AI & ML interests
Small language models, efficient LLM architectures, home-GPU training, open-source model development, and AI-assisted architecture research.
Recent Activity
published a model about 1 hour ago
AwakeningOS/VISTA-24M updated a model about 1 hour ago
AwakeningOS/VISTA-24M updated a model 13 days ago
AwakeningOS/ARO-BabyLM-1B-CooldownOrganizations
None yet
published a
model about 1 hour ago
updated a
model about 1 hour ago
updated a
model 13 days ago
published 2
models 14 days ago
updated a
model 14 days ago
reacted to Enderchef's post with ❤️ about 2 months ago
Post
4357
Introducing GCI-Bench, Glint Research's first benchmark!
This 5000-question bench benchmarks attention and gradients; it gives a prompt and unrelated filler parts. The goal is to benchmark if the model understands and attends to the important parts more than the unimportant parts.
I've already benchmarked on the top 5 models on our Leaderboard(Glint2, Supra 50M, Glint1.3, GPT S 5M, GPT X2 125M)
Pending benchmark status at OpenEvals/README#2
https://huggingface.co/datasets/Glint-Research/GCI_Bench
This 5000-question bench benchmarks attention and gradients; it gives a prompt and unrelated filler parts. The goal is to benchmark if the model understands and attends to the important parts more than the unimportant parts.
I've already benchmarked on the top 5 models on our Leaderboard(Glint2, Supra 50M, Glint1.3, GPT S 5M, GPT X2 125M)
Pending benchmark status at OpenEvals/README#2
https://huggingface.co/datasets/Glint-Research/GCI_Bench
- 7 replies