How to use the quantized version
#2
by rene-hof - opened
I tried to use the model in InvokeAI and also ran it with the diffuser code you provided. In both cases, the full FP16 model is loaded.
Can you give any hints on how to use the model in quantized version?
Thanks in advance
