MoE models quantized with the APEX Quantization technique ( https://github.com/mudler/apex-quant )
mudler
mudler
AI & ML interests
APEX quants, LocalAI Creator ( https://localai.io )
Website: https://mudler.pm, llama.cpp fan
Recent Activity
updated a model about 17 hours ago
mudler/Carnice-Qwen3.6-MoE-35B-A3B-APEX-GGUF published a model about 18 hours ago
mudler/Carnice-Qwen3.6-MoE-35B-A3B-APEX-GGUF updated a model 1 day ago
mudler/Qwen3.6-35B-A3B-APEX-GGUFOrganizations
Fine-tuned models for LocalAI finetuned by me
-
LocalAI-io/LocalAI-functioncall-phi-4-v0.3
Text Generation • Updated • 14 • 8 -
LocalAI-io/LocalAI-functioncall-llama3.2-1b-v0.4
Text Generation • 1B • Updated • 7 -
LocalAI-io/Mirai-Nova-Llama3-LocalAI-8B-v0.1
Text Generation • 8B • Updated • 8 • 1 -
LocalAI-io/LocalAI-Llama3-8b-Function-Call-v0.2
Text Generation • 8B • Updated • 13 • 10
MoE models quantized with the APEX Quantization technique ( https://github.com/mudler/apex-quant )
Fine-tuned models for LocalAI finetuned by me
-
LocalAI-io/LocalAI-functioncall-phi-4-v0.3
Text Generation • Updated • 14 • 8 -
LocalAI-io/LocalAI-functioncall-llama3.2-1b-v0.4
Text Generation • 1B • Updated • 7 -
LocalAI-io/Mirai-Nova-Llama3-LocalAI-8B-v0.1
Text Generation • 8B • Updated • 8 • 1 -
LocalAI-io/LocalAI-Llama3-8b-Function-Call-v0.2
Text Generation • 8B • Updated • 13 • 10
models 47
mudler/Carnice-Qwen3.6-MoE-35B-A3B-APEX-GGUF
35B • Updated • 5
mudler/Qwen3.6-35B-A3B-APEX-GGUF
35B • Updated • 45.5k • 51
mudler/gemma-4-26B-A4B-it-APEX-GGUF
25B • Updated • 199k • 43
mudler/MiniMax-M2.7-APEX-GGUF
Updated • 3.1k • 8
mudler/Carnice-MoE-35B-A3B-APEX-GGUF
35B • Updated • 4.59k • 10
mudler/Gemopus-4-26B-A4B-it-Preview-APEX-GGUF
25B • Updated • 5.44k • 6
mudler/Step-3.5-Flash-APEX-GGUF
197B • Updated • 1.44k • 2
mudler/Qwopus-MoE-35B-A3B-APEX-GGUF
35B • Updated • 4.68k • 9
mudler/Huihui3.5-67B-A3B-APEX-GGUF
67B • Updated • 2.58k • 1
mudler/Qwen3.5-397B-A17B-APEX-GGUF
396B • Updated • 1.77k • 3