Annotators not working. No error messages, it runs but the outputs are not right

[sooolee]

Hi! It would be great if someone can share some insights.

I updated the ControlNet version, and downloaded the models correctly (using 'downloading', not through the links) and place them in the correct folder along with the yaml files. I'm currently only using Canny, Depth, Normal, Scrabble, so downloaded only these models.

When I run it though, the annotator outputs are rather random. It's not really reading the given images. I don't get any error messages, but the outputs (preview) are wrong. It used to work fine with the previous version.

Any ideas about where things could have gotten wrong? Thanks in advance!

[lllyasviel]

update and restart completely

[sooolee]

Thanks for the reply! However, I did that - update the extension, and re-start from the terminal. Also deleted the extension, and re-installed several times, followed by extension update and restart. Didn't work.

One thing though. I installed Auto1111 in Linux, cloud server. I didn't restart the instance. Would that be a problem?

[revolverocelot1]

are you sure, for me its working fine. can you give the error message or its just blanked

[lllyasviel]

screenshots?

[sooolee]

extension up to date:

But the output is not right:

And no error message (after running the above):

[sooolee]

Under the following path:

pth and yaml files:

[sooolee]

But the annotator folder seems a bit messy. I didn't touch this part, but in some running, it created 'downloads' folder for leres and midas.

[ljleb]

Yes this folder is now expected to hold annotator model weights by default, IIUC it is unrelated to the problem you are facing.

[lllyasviel]

why is this even possible? big-endian vs little-endian linux?

[lllyasviel]

perhaps it is fixed here #945

[sooolee]

Thanks for looking into this. Unfortunately, now I get an error message. I tried this time a simple txt2img with ControlNet. The error message is:
"RuntimeError: mat1 and mat2 shapes cannot be multiplied (154x1024 and 768x320)"

Same error message when I use img2img with ControlNet. I use Ubuntu 22.10 (GNU/Linux 5.19.0-1018-gcp x86_64). I haven't had time to try some more recently. But I will try to see if there is anything wrong on my end.

[TheOnlyHolyMoly]

Yes, I have had the same runtime error on img2img. I thought it was because of missing size match between reference image and control net image, but I havent figured it out fully.

[lllyasviel]

hello we provided option to use previous version.

See also "Use Previous Version" in the readme

[JoshuaJewell]

I was having a similar issue on one instance of Firefox and found that opening the UI on Chromium was able to fix the problem. I might look at what settings specifically are causing an issue since it runs perfectly fine with Firefox on another computer.

Here I used the inbuilt painting tool on ControlNet and it seems that despite images not entering the annotator correctly, it is still performing the correct operation but only on information introduced inside the UI.