Instructions to use lycui/CFSynthesis with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Diffusers
How to use lycui/CFSynthesis with Diffusers:
pip install -U diffusers transformers accelerate
import torch from diffusers import DiffusionPipeline # switch to "mps" for apple devices pipe = DiffusionPipeline.from_pretrained("lycui/CFSynthesis", dtype=torch.bfloat16, device_map="cuda") prompt = "Astronaut in a jungle, cold color palette, muted colors, detailed, 8k" image = pipe(prompt).images[0] - Champ
How to use lycui/CFSynthesis with Champ:
# No code snippets available yet for this library. # To use this model, check the repository files and the library's documentation. # Want to help? PRs adding snippets are welcome at: # https://github.com/huggingface/huggingface.js
- Notebooks
- Google Colab
- Kaggle
| license: apache-2.0 | |
| tags: | |
| - champ | |
| # Model Sources | |
| <!-- Provide the basic links for the model. --> | |
| - **Repository:** [zju3dv/CFSynthesis](https://github.com/zju3dv/CFSynthesis) | |
| - **Paper:** [https://arxiv.org/abs/2412.11067](https://arxiv.org/abs/2412.11067) | |
| # Directory Structure | |
| ```shell | |
| ./PROJECT_ROOT/ | |
| |-- ckpts | |
| | |-- denoising_unet.pth | |
| | |-- guidance_encoder_depth.pth | |
| | |-- guidance_encoder_dwpose.pth | |
| | |-- guidance_encoder_normal.pth | |
| | |-- guidance_encoder_semantic_map.pth | |
| | |-- reference_unet.pth | |
| |-- control_v11p_sd15_openpose | |
| | |-- diffusion_pytorch_model.bin | |
| |-- image_encoder | |
| | |-- config.json | |
| | `-- pytorch_model.bin | |
| |-- sd-vae-ft-mse | |
| | |-- config.json | |
| | |-- diffusion_pytorch_model.bin | |
| | `-- diffusion_pytorch_model.safetensors | |
| `-- stable-diffusion-v1-5 | |
| |-- feature_extractor | |
| | `-- preprocessor_config.json | |
| |-- model_index.json | |
| |-- unet | |
| | |-- config.json | |
| | `-- diffusion_pytorch_model.bin | |
| `-- v1-inference.yaml | |
| ``` | |
| # Reference | |
| Thanks to the following projects and authors: | |
| * [1] [runwayml](https://huggingface.co/runwayml). [Stable Diffusion v1-5](https://huggingface.co/runwayml/stable-diffusion-v1-5). | |
| * [2] [stabilityai](https://huggingface.co/stabilityai). [sd-vae-ft-mse](https://huggingface.co/stabilityai/sd-vae-ft-mse) | |
| * [3] [bdsqlsz](https://huggingface.co/bdsqlsz). [image_encoder](https://huggingface.co/bdsqlsz/image_encoder) |