Remek/basal-1.0-4.5B
Text Generation • 5B • Updated • 1.16k • 5
Calibrated typed-decision models for Polish (and English): one forward pass, probabilities over the allowed answers. Engine: github.com/rkinas/basal
Note Main model, bf16, with early-exit heads
Note Lite model: 2.5x throughput
Note ModelOpt FP8 for vLLM
Note ModelOpt NVFP4 for vLLM (Blackwell, throughput)
Note ModelOpt FP8 for vLLM
Note ModelOpt NVFP4 for vLLM (Blackwell)
Explore benchmark scores for Polish and English decision models
Note Scores only (Polish, English, speed)