Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

ControlNet with Flux just doesn't work. #2508

Open
ibobak opened this issue Dec 28, 2024 · 1 comment
Open

ControlNet with Flux just doesn't work. #2508

ibobak opened this issue Dec 28, 2024 · 1 comment

Comments

@ibobak
Copy link

ibobak commented Dec 28, 2024

No matter of which ControlNet model I am trying to use, it just doesn't work.

Preprocessing works fine: I see open pose, i see canny, I see depth - preprocessing just works fine. However, even if I check the item "ControlNet is more important"

Sometimes it doesn't recognize the model - like with this one:
https://huggingface.co/Shakker-Labs/FLUX.1-dev-ControlNet-Union-Pro/tree/main

image

Sometimes, as with this one
https://huggingface.co/XLabs-AI/flux-controlnet-depth-v3
I am getting this exception:

[Unload] Trying to free 4287.94 MB for cuda:0 with 1 models keep loaded ... Current free memory is 5708.84 MB ... Done.████████████████████████| 30/30 [00:50<00:00,  1.20s/it]
*** Error running postprocess_batch_list: /home/ihor/ai/stable-diffusion-webui-forge/extensions-builtin/sd_forge_controlnet/scripts/controlnet.py
    Traceback (most recent call last):
      File "/home/ihor/ai/stable-diffusion-webui-forge/modules/scripts.py", line 916, in postprocess_batch_list
        script.postprocess_batch_list(p, pp, *script_args, **kwargs)
      File "/home/ihor/ai/stable-diffusion-webui-forge/venv/lib/python3.10/site-packages/torch/utils/_contextlib.py", line 115, in decorate_context
        return func(*args, **kwargs)
      File "/home/ihor/ai/stable-diffusion-webui-forge/extensions-builtin/sd_forge_controlnet/scripts/controlnet.py", line 567, in postprocess_batch_list
        self.process_unit_after_every_sampling(p, unit, self.current_params[i], pp, *args, **kwargs)
    KeyError: 0

well, I tried several ones, but you know, when I worked with automatic1111 and with SDXL, everything worked just fine. But as soon as I switced to Forge and Flux (and downloaded flux-compatible controlnets), I am unlucky to make them working here.
Thanks in advance.

@ErmMonzon
Copy link

There is no support for Flux Controlnet yet. There is plans to work on it but not sure how far along they are. SDXL and SD1.5 Controlnet works fine.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants