Edit Models filters

Showing models from

Inference Optimization

Tasks

Text Generation

Image-Text-to-Text

Parameters

Libraries

Transformers.js

Apps

Inference Providers

Hardware

Add your hardware

Models

493

Base only

Active filters: inference-optimization

inference-optimization/Meta-Llama-3-8B-Instruct-spinquantR1R2R4-nvfp4-gptq

5B • Updated Apr 22 • 11

inference-optimization/Meta-Llama-3-8B-Instruct-spinquantR1R2R4-nvfp4-qmod

5B • Updated Apr 22 • 13

inference-optimization/Meta-Llama-3-8B-Instruct-spinquantR1R2R4-w4a16-qmod

2B • Updated Apr 22 • 8

inference-optimization/Meta-Llama-3-8B-Instruct-spinquantR1R2R4-w4a16-gptq

2B • Updated Apr 22 • 10

inference-optimization/Qwen3.6-35B-A3B-NVFP4

Updated Apr 23 • 19

inference-optimization/DeepSeek-V4-Flash-5layers-nvfp4moe

20B • Updated Apr 28 • 26

inference-optimization/ctest-Qwen3-8B-speculator.dflash

2B • Updated May 5 • 31

inference-optimization/DeepSeek-V4-Flash-bf16

inference-optimization/DeepSeek-V4-Flash-bf16-NVFP4-FP8-BLOCK

inference-optimization/laguna-xs-bf16-eagle3-ckpt0

0.4B • Updated May 1 • 1

inference-optimization/ctest-Qwen3.5-9B-speculator.dflash

2B • Updated May 5 • 33

inference-optimization/peagle-gemma4

2B • Updated May 6 • 11

inference-optimization/qwen3-8b-peagle-speculators

inference-optimization/DSV4-tiny-empty

3B • Updated Sep 14 • 1.5k • 1

inference-optimization/final-ctest-Qwen3-8B-speculator.dflash

2B • Updated May 13 • 30

inference-optimization/Gemma4_SWA_DFLASH

4B • Updated May 19 • 19

inference-optimization/ctest-Qwen3.5-9B-subset-397-speculator.dflash

2B • Updated May 20 • 24

inference-optimization/gemma-4-1B-0.8B-tiny

1B • Updated Sep 14 • 1.35k • 2

inference-optimization/Qwen3-1.6B-A0.9B

Text Generation • 2B • Updated May 24 • 12.6k • 4

inference-optimization/Gemma4-DFlash-SWA-Causal-Nemo-Cascade

4B • Updated May 26 • 19

inference-optimization/Laguna-XS.2-speculator.dflash-Qwen235B-ckpt3

0.6B • Updated Jun 1 • 22

inference-optimization/Laguna-XS.2-speculator.dflash-Qwen235B-ckpt1

0.6B • Updated May 29 • 21

inference-optimization/dflash-DeepSeek-V4-Flash-speculators-50k

2B • Updated May 29 • 70

inference-optimization/Laguna-XS.2-speculator.dflash-Qwen235B-ckpt2

0.6B • Updated May 29 • 24

inference-optimization/ctest-Qwen3.6-27B-speculator-regen.dflash

3B • Updated Jun 3 • 33 • 1

inference-optimization/DFlash-SWA-Causal-Qwen3-8B-Magpie-Ultrachat

2B • Updated Jun 5 • 21

inference-optimization/Laguna-XS.2-speculator.dflash-Qwen235B-ckpt4

0.6B • Updated Jun 1 • 21

inference-optimization/Laguna-XS.2-speculator.dflash-Qwen235B-ckpt6

0.6B • Updated Jun 2 • 24

inference-optimization/DFlash-SWA-Causal-Qwen3-8B-PerfectBlend

2B • Updated Jun 5 • 25

inference-optimization/ctest-Qwen3.5-9B-sliding-window-speculator.dflash

2B • Updated Jun 3 • 25