mingyi456/Chroma1-Flash-DF11-ComfyUI

Update: I have uploaded an updated version of this model, that should further reduce disk size and VRAM usage by ~82 MB. This is because I missed out on compressing a small portion of the model (the distilled_guidance_layers) in my original upload. There is no need to download again if you are not having any issues with the older version, but please either update to the latest version of my DF11 custom node fork, or update the patched pattern_dict as shown below if you are still using the official node. I apologize for my earlier oversight.

For more information (including how to compress models yourself), check out https://huggingface.co/DFloat11 and https://github.com/LeanModels/DFloat11

Feel free to request for other models for compression as well, although compressing models that do not use the Flux architecture might be slightly tricky for me.

How to Use

ComfyUI

Install my own fork of the DF11 ComfyUI custom node: https://github.com/mingyi456/ComfyUI-DFloat11-Extended. After installing the DF11 custom node, use the provided workflow json, or simply replace the "Load Diffusion Model" node of an existing Chroma workflow with the "DFloat11 Model Loader" node. If you run into any issues, feel free to leave a comment. The workflow is also embedded in the below png image.

diffusers

Refer to this model instead.

Compression Details

This is the pattern_dict for compressing Chroma-based models in ComfyUI:

pattern_dict_comfyui = {
    r"distilled_guidance_layer\.layers\.\d+": (
        "in_layer",
        "out_layer"        
    ),
    r"double_blocks\.\d+": (
        "img_attn.qkv",
        "img_attn.proj",
        "img_mlp.0",
        "img_mlp.2",
        "txt_attn.qkv",
        "txt_attn.proj",
        "txt_mlp.0",
        "txt_mlp.2",
    ),
    r"single_blocks\.\d+": (
        "linear1",
        "linear2",
    ),
}