inference-optimization/Qwen3-Next-80B-A3B-Instruct_mtp_speculator
Text Generation • 2B • Updated • 58
Inference Optimization
community
AI & ML interests
None defined yet.
Recent Activity
View all activity
inference-optimization/Mistral3_speculator_dummy
2B • Updated • 25
inference-optimization/Phi-4-reasoning-vision-15B-FP8-dynamic
15B • Updated • 2
inference-optimization/Qwen3-235B-A22B-Thinking-2507.w4a16
32B • Updated • 11
inference-optimization/Qwen3-235B-A22B-Instruct-2507.w4a16
32B • Updated • 12
inference-optimization/Qwen3-32B-from-Qwen3-235B_resps-speculators.eagle3-ckpt0
2B • Updated • 79
inference-optimization/gpt-oss-120b-from-qwen235b-ckpt5-speculator.eagle3
0.9B • Updated • 94
inference-optimization/gpt-oss-120b-from-qwen235b-ckpt4-speculator.eagle3
0.9B • Updated • 65
inference-optimization/gpt-oss-120b-ckpt4-speculator.eagle3
0.9B • Updated • 31
inference-optimization/gpt-oss-120b-ckpt3-speculator.eagle3
0.9B • Updated • 49
inference-optimization/Qwen3-Coder-Next.w4a16
Text Generation • 12B • Updated • 1.55k
inference-optimization/Llama-3.2-3B-Instruct_7_bits_mode_heuristic
3B • Updated • 19
inference-optimization/Llama-3.2-3B-Instruct_7_bits_mode_noise
3B • Updated • 17
inference-optimization/Llama-3.2-3B-Instruct_7_bits_mode_hybrid
3B • Updated • 19
inference-optimization/Llama-3.2-3B-Instruct_6.5_bits_mode_heuristic
3B • Updated • 20
inference-optimization/Llama-3.2-3B-Instruct_6.5_bits_mode_noise
3B • Updated • 20
inference-optimization/Llama-3.2-3B-Instruct_6.5_bits_mode_hybrid
3B • Updated • 18
inference-optimization/Llama-3.2-3B-Instruct_6_bits_mode_heuristic
3B • Updated • 19
inference-optimization/Llama-3.2-3B-Instruct_6_bits_mode_noise
3B • Updated • 19
inference-optimization/Llama-3.2-3B-Instruct_6_bits_mode_hybrid
3B • Updated • 18
inference-optimization/Llama-3.2-3B-Instruct_5.5_bits_mode_heuristic
3B • Updated • 19
inference-optimization/Llama-3.2-3B-Instruct_5.5_bits_mode_noise
3B • Updated • 19
inference-optimization/Llama-3.2-3B-Instruct_5.5_bits_mode_hybrid
3B • Updated • 20
inference-optimization/Llama-3.2-3B-Instruct_5_bits_mode_heuristic
3B • Updated • 20
inference-optimization/Llama-3.2-3B-Instruct_5_bits_mode_noise
3B • Updated • 20
inference-optimization/Llama-3.2-3B-Instruct_5_bits_mode_hybrid
3B • Updated • 19
inference-optimization/Llama-3.2-1B-Instruct_7_bits_mode_noise
1B • Updated • 36
inference-optimization/Llama-3.2-1B-Instruct_6.5_bits_mode_noise
1B • Updated • 37
inference-optimization/Llama-3.2-1B-Instruct_6.5_bits_mode_hybrid
1B • Updated • 37
inference-optimization/Llama-3.2-1B-Instruct_6_bits_mode_noise
1B • Updated • 36