Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

25,558

Base only

Active filters: llama-cpp

sabafallah/bge-reranker-v2-m3-Q4_K_M-GGUF

Text Ranking • 0.6B • Updated Apr 2, 2025 • 67 • 2

firoz123/codegemma-2b-Q4_K_M-GGUF

3B • Updated Apr 25, 2025 • 34 • 1

Aldaris/Qwen3-8B-Q4_K_M-GGUF

Text Generation • 8B • Updated Apr 29, 2025 • 9.05k • 7

Bouquets/StrikeGPT-R1-Zero-8B

8B • Updated Jun 12, 2025 • 65 • 9

Nitrals-Quants/Nemotron-15b-Thinker-v0.1-Q4_K_M-GGUF

15B • Updated May 9, 2025 • 15 • 2

decerto/Qwen2.5-VL-7B-Instruct-abliterated-Q4_K_M-GGUF

Image-Text-to-Text • 8B • Updated Jun 1, 2025 • 578 • 4

Growcompany/SmolLM2-360M-Q4_K_M-GGUF

0.4B • Updated Aug 19, 2025 • 20 • 1

kozynthetaquito/Dolphin-Mistral-24B-Venice-Edition-exl2-6bpw-Q4_K_M-GGUF

Text Generation • Updated Oct 16, 2025 • 138 • 1

straino/Qwen3-Coder-30B-A3B-Instruct-AWQ-4bit-Q4_K_M-GGUF

Text Generation • 31B • Updated Dec 9, 2025 • 546 • 3

ServiceNow-AI/Apriel-1.6-15b-Thinker-GGUF

14B • Updated Dec 16, 2025 • 257 • 17

enacimie/Qwen3-0.6B-Q4_K_M-GGUF

Text Generation • 0.8B • Updated Dec 23, 2025 • 936 • 4

H1coM/llama-joycaption-beta-one-hf-llava-Q4_K_M-GGUF

Image-Text-to-Text • 8B • Updated Jan 8 • 78 • 2

solarkyle/GLM-4.7-Flash-GGUF

Text Generation • 30B • Updated Jan 20 • 211 • 6

jinaai/jina-embeddings-v5-text-small-text-matching

Sentence Similarity • 0.6B • Updated Apr 15 • 117k • 13

jinaai/jina-embeddings-v5-text-nano-retrieval-GGUF

Sentence Similarity • 0.2B • Updated Feb 27 • 6.29k • 4

aashish1904/Qwen3.5-2B-Base-GGUF

Text Generation • 2B • Updated Mar 2 • 875 • 3

Tesslate/OmniCoder-9B-GGUF

9B • Updated Mar 12 • 13.6k • 347

mtrpires/Qwen3.5-35B-A3B-IQK-RPi5-16GB

Text Generation • 35B • Updated Mar 28 • 136 • 1

Abiray/gemma-4-E4B-it-heretic-GGUF

Any-to-Any • 8B • Updated Apr 4 • 14.5k • 37

sillykiwi/Qwen3-4B-Cybersecurity-Heretic-16bit-Q4_K_M-GGUF

Text Generation • 4B • Updated Apr 3 • 2.22k • 22

EchoLabs33/Zamba2-7B-Instruct-v2-GGUF

Text Generation • 11B • Updated Apr 14 • 84 • 2

Abiray/gemma-4-31B-Claude-4.6-Opus-Reasoning-Distilled-GGUF

Text Generation • 31B • Updated Apr 6 • 986 • 12

cloudbjorn/gemma-4-31B-Opus-4.6-Reasoning-GGUF

Text Generation • 31B • Updated Apr 12 • 184 • 3

NidAll/supergemma4-e4b-abliterated-Q4_K_M-GGUF

Text Generation • 8B • Updated Apr 17 • 1.17k • 28

prism-ml/Ternary-Bonsai-4B-gguf

Text Generation • 4B • Updated Jun 10 • 7.58k • 35

barozp/Qwen3.6-28B-REAP20-A3B-GGUF

Text Generation • 28B • Updated Apr 19 • 6.1k • 82

whoya/Huihui-Qwen3.6-35B-A3B-Claude-4.7-Opus-abliterated-Q4_K_M-GGUF

Text Generation • 35B • Updated Apr 22 • 102 • 2

whoya/Huihui-Qwen3.6-35B-A3B-Claude-4.7-Opus-abliterated-Q5_K_M-GGUF

Text Generation • 35B • Updated Apr 22 • 247 • 1

audarai/Audar-ASR-V1-Turbo

Automatic Speech Recognition • 2B • Updated Aug 20 • 5.31k • 17

FinnTheAI/Kimi-K2.6-SmartQuant-GGUF

Text Generation • 1T • Updated Jun 8 • 112 • 3