| --- |
| license: other |
| license_name: flux-1-dev-non-commercial-license |
| license_link: https://huggingface.co/black-forest-labs/FLUX.1-dev/blob/main/LICENSE.md |
| base_model: |
| - black-forest-labs/FLUX.1-dev |
| --- |
| |
| ## Model Details |
|
|
| This model card is for mxfp8 quantization of [black-forest-labs/FLUX.1-dev](https://huggingface.co/black-forest-labs/FLUX.1-dev/blob/main/LICENSE.md) based on [intel/auto-round](https://github.com/intel/auto-round). |
| The quantized model is not able to be published due to license limitation. Please follow the INC example README to generate and evaluate the low precision model. |
|
|
| ## How to Use |
|
|
| The step-by-step README of quantization and evaluation can be found in [Intel Neural Compressor Examples](https://github.com/intel/neural-compressor/blob/master/examples/pytorch/diffusion_model/diffusers/flux/README.md). |
|
|
| ## Evaluate Results |
|
|
| | Task | backend | BF16 | MXFP8 | |
| |:-----------:|:-------:|:-------:|:-------:| |
| | CLIP | vllm | 26.0515 | 26.0494 | |
| | CLIP-IQA | vllm | 0.9545 | 0.9553 | |
| | ImageReward | vllm | 1.0133 | 1.0214 | |
|
|
| ## Ethical Considerations and Limitations |
|
|
| The model can produce factually incorrect output, and should not be relied on to produce factually accurate information. |
| Because of the limitations of the pretrained model and the finetuning datasets, it is possible that this model could generate lewd, biased or otherwise offensive outputs. |
|
|
| Therefore, before deploying any applications of the model, developers should perform safety testing. |
|
|
| ## Caveats and Recommendations |
|
|
| Users (both direct and downstream) should be made aware of the risks, biases and limitations of the model. |
|
|
| Here are a couple of useful links to learn more about Intel's AI software: |
|
|
| - [Intel Neural Compressor](https://github.com/intel/neural-compressor) |
| - [AutoRound](https://github.com/intel/auto-round) |
|
|
| ## Disclaimer |
|
|
| The license on this model does not constitute legal advice. |
| We are not responsible for the actions of third parties who use this model. |
| Please consult an attorney before using this model for commercial purposes. |
|
|
