Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

23,723

Base only

Active filters: llama-cpp

barozp/Qwen3.6-28B-REAP20-A3B-GGUF

Text Generation • 28B • Updated Apr 19 • 14.1k • 28

spiritbuun/buun-Qwen3.6-chat_template

Updated 8 days ago • 37

prism-ml/Ternary-Bonsai-8B-gguf

Text Generation • 8B • Updated Apr 20 • 15.8k • 90

Abiray/gemma-4-12b-it-GGUF

Any-to-Any • 12B • Updated 1 day ago • 1.87k • 11

gaston-parravicini/LFM2.5-8B-A1B-Uncensored-Gaston-GGUF

Text Generation • 8B • Updated 6 days ago • 4.84k • 11

prism-ml/Bonsai-8B-gguf

Text Generation • 8B • Updated Apr 18 • 58.2k • 708

prism-ml/Ternary-Bonsai-4B-gguf

Text Generation • 4B • Updated Apr 20 • 2.12k • 12

prithivMLmods/Holo-3.1-9B-GGUF

Image-Text-to-Text • 9B • Updated 3 days ago • 2.08k • 4

prithivMLmods/Qwen3.5-9B-MTP-GGUF

Image-Text-to-Text • 9B • Updated 4 days ago • 4.18k • 4

prithivMLmods/Qwen3.6-35B-A3B-MTP-GGUF

Image-Text-to-Text • 36B • Updated 4 days ago • 3.51k • 3

hugging-quants/Llama-3.2-1B-Instruct-Q4_K_M-GGUF

Text Generation • 1B • Updated Sep 25, 2024 • 43.5k • 23

nocturne23/gemma-3-12b-it-Q4_K_M-GGUF

Image-Text-to-Text • 12B • Updated Mar 13, 2025 • 3.36k • 7

AlicanKiraz0/BaronLLM-v2-OffensiveSecurityLLM-Q8

15B • Updated Aug 21, 2025 • 387 • 27

ggml-org/Qwen3-Reranker-0.6B-Q8_0-GGUF

Text Ranking • 0.6B • Updated Oct 3, 2025 • 32.4k • 21

prism-ml/Bonsai-4B-gguf

Text Generation • 4B • Updated Apr 18 • 7.31k • 46

deadbydawn101/gemma-4-E4B-Agentic-Opus-Reasoning-GeminiCLI-GGUF

Text Generation • 8B • Updated Apr 16 • 7.61k • 16

Youssofal/Qwen3.6-35B-A3B-Abliterated-Heretic-GGUF

Text Generation • 35B • Updated Apr 16 • 9.63k • 28

prism-ml/Ternary-Bonsai-1.7B-gguf

Text Generation • 2B • Updated Apr 20 • 3.34k • 17

Youssofal/Kimi-K2.6-Abliterated-Heretic-GGUF

Text Generation • Updated Apr 21 • 16

ISTA-DASLab/Qwen3-8B-GGUF-GSQ

Text Generation • 8B • Updated 18 days ago • 225 • 3

hiiamboris/Darwin-28B-Coder-Q4_K_M-GGUF

Text Generation • 27B • Updated 15 days ago • 609 • 5

Surpem/Supertron2.1-0.6B-GGUF

Text Generation • 0.6B • Updated 9 days ago • 280 • 3

prithivMLmods/Qwen3.5-4B-MTP-GGUF

Image-Text-to-Text • 4B • Updated 4 days ago • 4.81k • 3

fraQtl/Qwen3.6-35B-A3B-Hi-Fi-MTP-runtime

Text Generation • Updated 6 days ago • 590 • 2

prithivMLmods/Qwen3.5-0.8B-MTP-GGUF

Image-Text-to-Text • 0.8B • Updated 4 days ago • 2.32k • 2

ijohn07/Holo-3.1-4B-Q6_K-GGUF

Image-Text-to-Text • 5B • Updated 3 days ago • 250 • 2

pabloreyespo/Llama-3.1-70B-LatamGPT-SFT-1.0-GGUF

71B • Updated 1 day ago • 164 • 3

noxinc/Llama-3-portuguese-Tom-cat-8b-instruct-Q4_K_M-GGUF-PTBR

Text Generation • 8B • Updated May 7, 2024 • 96 • 1

V15h/PLLaMa-7b-instruct-Q4_K_M-GGUF

7B • Updated Jun 23, 2024 • 9 • 1

zhezhe/gemma-2-9b-it-Q4_K_M-GGUF

Text Generation • 9B • Updated Jul 8, 2024 • 1.01k • 8