Post
1,988
๐๐ง๐ญ๐ซ๐จ๐๐ฎ๐๐ข๐ง๐ ๐งฌ ๐
๐ข๐ง๐๐๐๐: ๐ญ๐ก๐ ๐๐๐ฌ๐ญ ๐๐๐ญ๐๐ฌ๐๐ญ ๐ญ๐จ ๐ญ๐๐๐๐ก ๐๐ง๐ฒ ๐ฅ๐๐ง๐ ๐ฎ๐๐ ๐ ๐ฆ๐จ๐๐๐ฅ ๐๐๐.
Training Qwen3-14B on it produces Carbon-X, the strongest open model on DNA benchmarks, on par with GPT-6.1 Sol.
It contains:
- Midtraining: 300B+ tokens of genomic sequences, papers and web pages mixing DNA with text
- SFT: 200K samples, from variant effect prediction to sequence question answering
- RL: 98K prompts with verifiable rewards
Data, models and the full recipe are open.
HuggingFaceBio/FineDNA
Enjoy this late Halloween treat! ๐
Training Qwen3-14B on it produces Carbon-X, the strongest open model on DNA benchmarks, on par with GPT-6.1 Sol.
It contains:
- Midtraining: 300B+ tokens of genomic sequences, papers and web pages mixing DNA with text
- SFT: 200K samples, from variant effect prediction to sequence question answering
- RL: 98K prompts with verifiable rewards
Data, models and the full recipe are open.
HuggingFaceBio/FineDNA
Enjoy this late Halloween treat! ๐
