OLMo-2-1B Midtrained
Collection
OLMo2-1B Midtrained checkpoints used for the experiments in our paper "Sharpness-Aware Pretraining Mitigates Catastrophic Forgetting" • 5 items • Updated
Ishaan Watts
WattsIshaan
AI & ML interests
Machine Learning, NLP
Recent Activity
updated a collection 11 days ago
OLMo-2-1B Midtrained updated a model 11 days ago
WattsIshaan/OLMo-2-1B-Midtrain-50B-AdamW-20percent updated a collection 11 days ago
OLMo-2-1B MidtrainedOrganizations
None yet
updated a
collection 11 days ago
updated a
model 11 days ago
updated a
collection 11 days ago
updated a
model 11 days ago
published 2
models 11 days ago
updated a
collection 11 days ago
updated 3
models 11 days ago
published 3
models 11 days ago
updated a
collection 28 days ago