nm-testing/tinysmokellama-3.2
354k • Updated
• 72.2k
LLM Compressor testing
-
-
nm-testing/llama2.c-stories42M-pruned2.4
Updated • 1.21k -
nm-testing/tinyllama-fp8-dynamic-compressed
1B • Updated • 519 -
nm-testing/tinyllama-w4a16-compressed
0.3B • Updated • 829 -
nm-testing/tinyllama-w8a8-compressed
1B • Updated • 986 -
nm-testing/tinyllama-w8a16-dense
1B • Updated • 709 -
nm-testing/TinyLlama-1.1B-Chat-v1.0-FP8-Dynamic-compressed
1B • Updated • 561 -
nm-testing/TinyLlama-1.1B-Chat-v1.0-FP8-Dynamic-uncompressed
1B • Updated • 262 -
nm-testing/TinyLlama-1.1B-Chat-v1.0-W4A16-G128-compressed
0.3B • Updated • 161 -
nm-testing/TinyLlama-1.1B-Chat-v1.0-W4A16-G128-uncompressed
1B • Updated • 102 -
nm-testing/TinyLlama-1.1B-Chat-v1.0-W8A8-Dynamic-Per-Token-compressed
1B • Updated • 161 -
nm-testing/TinyLlama-1.1B-Chat-v1.0-W8A8-Dynamic-Per-Token-uncompressed
1B • Updated • 104 -
nm-testing/TinyLlama-1.1B-Chat-v1.0-W8A16-G128-compressed
0.4B • Updated • 543 -
nm-testing/TinyLlama-1.1B-Chat-v1.0-W8A16-G128-uncompressed
1B • Updated • 275