🏗️ Building on HF

Stefan Iancu PRO

stefaniancu

2 9

AI & ML interests

main builder @rostlabs

Recent Activity

upvoted a collection 25 days ago

rost-1b

reacted to Hoglet-33's post with 👍 about 1 month ago

We are announcing the first generation of the Pebble model family! These are the models we are releasing: - Pebble 10M - Pebble 25M - Pebble 50M Each model will use a Mamba-Transformer 3:1 hybrid architecture and will be pretrained on 25 billion tokens before IFT and SFT. Depending on development time and resources, we may also release: - Pebble 5M - Pebble 75M - Pebble 1M (possibly) We hope you're excited and enjoy the models! Follow for more: @Hoglet-33 https://huggingface.co/basically-ai

liked a model about 1 month ago

rostlabs/rost-1b-instruct-v2

View all activity

Organizations

upvoted a collection 25 days ago

rost-1b

Collection

4 items • Updated Aug 24 • 1

reacted to Hoglet-33's post with 👍 about 1 month ago

Post

3080

We are announcing the first generation of the Pebble model family!

These are the models we are releasing:

- Pebble 10M
- Pebble 25M
- Pebble 50M

Each model will use a Mamba-Transformer 3:1 hybrid architecture and will be pretrained on 25 billion tokens before IFT and SFT.

Depending on development time and resources, we may also release:

- Pebble 5M
- Pebble 75M
- Pebble 1M (possibly)

We hope you're excited and enjoy the models!

Follow for more:
@Hoglet-33