Basically just Qwen if they knew how to avoid MoE collapse

#22
by tabbytobias2 - opened

I would say qwen is better at general knowledge. At least on my testing, it hallucinates a lot but it is good at coding

I would say qwen is better at general knowledge. At least on my testing, it hallucinates a lot but it is good at coding

Are you running FP8 i noticed no real issues

Sign up or log in to comment