[enhancement]: Fp8 Flux Control Net Union Request

[boricuapab]

Is there an existing issue for this?

• I have searched the existing issues

Contact Details

No response

What should this feature add?

Hi,

I would like to request if this converted fp8 of the flux union control net could be supported as it has a 3 gig file size and should allow for faster inferring of generations particularly using the blur and open pose as those aren't officially available from bfl.

On a 16 gig vram pc with 64 gigs ram, the 6 gig one falls into shared vram which slows down generation drastically

This is the fp converted version of the flux started union model

https://huggingface.co/boricuapab/FLUX.1-dev-Controlnet-Union-fp8/tree/main

These are the speeds I get using the 6 gig model

I tried using the fp8 converted model but am running into this error

Alternatives

No response

Additional Content

No response

[Agiltech-com-au]

100%. good luck with the app without FP8. even on 24GB vram flux.. your asking for trouble to try use lots of control nets and full size model. and snhell is crap quality and doesn't work.