Edit Models filters

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

26,394

Full-text search

Active filters: llama-cpp

LocoreMind/LocoOperator-4B

Text Generation • 4B • Updated 8 days ago • 3.26k • 263

ruv/ruvltra-claude-code

Text Generation • 0.5B • Updated Jan 20 • 11.1k • 129

alexdenton/Qwen3.5-35B-A3B-heretic-GGUF

35B • Updated 6 days ago • 3.36k • 9

LocoreMind/LocoOperator-4B-GGUF

4B • Updated 8 days ago • 2.01k • 9

jwest33/qwen3.5-9b-null-space-abliterated-GGUF

9B • Updated about 15 hours ago • 7

mradermacher/LocoOperator-4B-GGUF

4B • Updated 8 days ago • 820 • 7

HeYujie/Qwen3.5-35B-A3B-abliterated-GGUF

Image-Text-to-Text • 35B • Updated 4 days ago • 2.41k • 5

Ex0bit/Qwen3.5-PRISM-Dynamic-Quant-GGUF

Text Generation • 0.8B • Updated about 23 hours ago • 4

AlicanKiraz0/Cybersecurity-BaronLLM_Offensive_Security_LLM_Q6_K_GGUF

Text Generation • 8B • Updated Jun 4, 2025 • 619 • 141

Edge-Quant/Nanbeige4.1-3B-Q4_K_M-GGUF

Text Generation • 4B • Updated 21 days ago • 11.1k • 34

InquiringMinds-AI/LongCat-Flash-Lite-GGUF

Text Generation • 69B • Updated about 10 hours ago • 555 • 3

huihui-ai/BaronLLM_Offensive_Security-abliterated-GGUF

Text Generation • 8B • Updated Jun 11, 2025 • 623 • 33

AlicanKiraz0/BaronLLM-v2-OffensiveSecurityLLM-Q8

15B • Updated Aug 21, 2025 • 261 • 16

ijohn07/Qwen3-Coder-30B-A3B-Instruct-FP8-Q4_K_M-GGUF

Text Generation • 31B • Updated 28 days ago • 1.03k • 2

jinaai/jina-embeddings-v5-text-small-retrieval

Sentence Similarity • 0.6B • Updated 1 day ago • 139k • 10

jinaai/jina-embeddings-v5-text-nano-clustering

Feature Extraction • 0.2B • Updated 5 days ago • 15.9k • 5

Xlnk/ruvltra-claude-code

Text Generation • 0.5B • Updated 22 days ago • 198 • 7

jinaai/jina-embeddings-v5-text-small-retrieval-GGUF

Sentence Similarity • 0.6B • Updated 7 days ago • 6.1k • 5

alexdenton/Qwen3.5-27B-heretic-GGUF

27B • Updated 6 days ago • 792 • 2

aashish1904/Qwen3.5-0.8B-GGUF

Text Generation • 0.8B • Updated 1 day ago • 339 • 2

jfer1015/Mistral-7B-Instruct-v0.3-Q4_K_M-GGUF

7B • Updated Jun 24, 2024 • 3.09k • 6

elyza/Llama-3-ELYZA-JP-8B-GGUF

8B • Updated Jun 26, 2024 • 2.69k • 72

Nehal07/Mistral-Nemo-Instruct-2407-Q4_K_M-GGUF

12B • Updated Aug 4, 2024 • 49 • 1

Such0442/coedit-xl-composite-Q4_K_M-GGUF

3B • Updated Aug 10, 2024 • 14 • 1

Lucy-in-the-Sky/Mistral-Nemo-Instruct-2407-Q2_K-GGUF

12B • Updated Aug 25, 2024 • 23 • 1

Triangle104/Meta-Llama-3.1-8B-Instruct-abliterated-Q6_K-GGUF

8B • Updated Nov 25, 2024 • 24 • 1

Triangle104/Mistral-Nemo-Instruct-2407-abliterated-Q4_K_S-GGUF

12B • Updated Nov 16, 2024 • 20 • 1

hugging-quants/Llama-3.2-1B-Instruct-Q8_0-GGUF

Text Generation • 1B • Updated Sep 25, 2024 • 533k • 44

Triangle104/magnum-v4-12b-Q4_K_M-GGUF

Text Generation • 12B • Updated Oct 31, 2024 • 86 • 1

Triangle104/magnum-v4-12b-Q8_0-GGUF

Text Generation • 12B • Updated Oct 24, 2024 • 161 • 2