IST Austria Distributed Algorithms and Systems Lab

university

https://ist.ac.at/en/research/alistarh-group/

https://github.com/IST-DASLab

AI & ML interests

None defined yet.

Recent Activity

helcig updated a model about 6 hours ago

ISTA-DASLab/lossless-lm-dev

softmax authored a paper about 2 months ago

WUSH: Near-Optimal Adaptive Transforms for LLM Quantization

BlackSamorez new activity about 2 months ago

ISTA-DASLab/Meta-Llama-3.1-70B-Instruct-AQLM-PV-2Bit-1x16:VLLM error

View all activity

Papers

WUSH: Near-Optimal Adaptive Transforms for LLM Quantization

CAGE: Curvature-Aware Gradient Estimation For Accurate Quantization-Aware Training

View all Papers

ISTA-DASLab 's models 147

ISTA-DASLab/Mistral-7B-v0.1-AQLM-PV-2Bit-1x16-hf

Text Generation • 1B • Updated May 30, 2024 • 4

ISTA-DASLab/SOLAR-10.7B-Instruct-v1.0-GPTQ-4bit

Text Generation • 11B • Updated May 20, 2024

ISTA-DASLab/Llama-3-8B-Instruct-GPTQ-4bit

Text Generation • 8B • Updated May 16, 2024 • 1 • 1

ISTA-DASLab/Meta-Llama-3-70B-Instruct-AQLM-2Bit-1x16

Text Generation • 11B • Updated May 13, 2024 • 15 • 20

ISTA-DASLab/Phi-3-mini-4k-instruct-AQLM-1x16

Text Generation • 0.7B • Updated May 8, 2024 • 3

ISTA-DASLab/Phi-3-mini-128k-instruct-AQLM-1x16

Text Generation • 0.7B • Updated May 8, 2024 • 8 • 1

ISTA-DASLab/Meta-Llama-3-70B-AQLM-2Bit-1x16

Text Generation • 11B • Updated May 4, 2024 • 8 • 14

ISTA-DASLab/Meta-Llama-3-8B-Instruct

Text Generation • 8B • Updated Apr 23, 2024 • 3

ISTA-DASLab/c4ai-command-r-plus-AQLM-2Bit-1x16

Text Generation • 16B • Updated Apr 21, 2024 • 11 • 10

ISTA-DASLab/Mistral-7B-Instruct-v0.2-AQLM-2Bit-2x8

Text Generation • 2B • Updated Apr 13, 2024 • 83 • 3

ISTA-DASLab/c4ai-command-r-v01-AQLM-2Bit-1x16

Text Generation • 6B • Updated Apr 13, 2024 • 6 • 10

ISTA-DASLab/Mistral-7B-v0.1-AQLM-2Bit-1x16-hf

Text Generation • 1B • Updated Mar 11, 2024 • 19 • 2

ISTA-DASLab/Llama-2-70b-AQLM-2Bit-2x8-hf

Text Generation • 18B • Updated Mar 11, 2024 • 16 • 1

ISTA-DASLab/Llama-2-70b-AQLM-2Bit-1x16-hf

Text Generation • 9B • Updated Mar 11, 2024 • 28 • 6

ISTA-DASLab/Llama-2-13b-AQLM-2Bit-1x16-hf

Text Generation • 2B • Updated Mar 11, 2024 • 35

ISTA-DASLab/Llama-2-7b-AQLM-2Bit-8x8-hf

Text Generation • 2B • Updated Mar 11, 2024 • 30

ISTA-DASLab/Llama-2-7b-AQLM-2Bit-2x8-hf

Text Generation • 2B • Updated Mar 11, 2024 • 60 • 2

ISTA-DASLab/Llama-2-7b-AQLM-2Bit-1x16-hf

Text Generation • 1B • Updated Mar 11, 2024 • 67 • 5

ISTA-DASLab/Mixtral-8x7b-AQLM-2Bit-1x16-hf

Text Generation • 7B • Updated Mar 11, 2024 • 15 • 23

ISTA-DASLab/gemma-2b-AQLM-2Bit-2x8-hf

Text Generation • 1B • Updated Mar 10, 2024 • 16 • 4

ISTA-DASLab/gemma-2b-AQLM-2Bit-1x16-hf

Text Generation • 0.8B • Updated Mar 10, 2024 • 10 • 6

ISTA-DASLab/Mixtral-8x7B-Instruct-v0_1-AQLM-2Bit-1x16-hf

Text Generation • 7B • Updated Feb 27, 2024 • 14 • 18

ISTA-DASLab/Llama-2-13b-AQLM-4Bit-2x16-hf

Text Generation • Updated Feb 10, 2024 • 49

ISTA-DASLab/Llama-2-70b-AQLM-4Bit-2x16-hf

Text Generation • 18B • Updated Feb 10, 2024 • 10

ISTA-DASLab/switch-c-2048_qmoe

Updated Oct 25, 2023 • 2 • 4

ISTA-DASLab/switch-large-128_qmoe

Updated Oct 25, 2023

ISTA-DASLab/switch-base-128_qmoe

Updated Oct 25, 2023 • 1 • 1