Don't "fix" diffusers version in requirements.txt, use >=

[NeedsMoar]

Since there are a lot of nodes for comfy, it'd be better to do
diffusers>=0.21.4
than
diffusers~=0.21.4

Any time this node updates, it breaks some other node that uses yet another newer thing from diffusers which is under slightly less stupidly rapid development than comfy itself.

For right now I'm just going to remove this node, and keep track of whether it gets worked on and integrated to the point of not needing diffusers.