Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add sdxl lora extracts as "lite" models to the api #164

Open
Efreak opened this issue Jan 14, 2024 · 0 comments
Open

Add sdxl lora extracts as "lite" models to the api #164

Efreak opened this issue Jan 14, 2024 · 0 comments
Labels
enhancement New feature or request

Comments

@Efreak
Copy link
Contributor

Efreak commented Jan 14, 2024

discussed on discord:

Efreak

It might be worth considering adding some of the ffusion SDXL model lora extracts to horde. If they work close enough to the models they're based on, they could be used as separate models from the API with only an additional ~500-600mb each (plus the base model, which is either SDXL ffusion base; I'm not clear which) instead of 4-8gb for full SDXL models. Besides the likely-popular nsfw models, they've got extracts for Faetastic, nightvision, dynavision. Dreamshaper, counterfeit, animagine, and a bunch of realism models. Most of those named have been requested iirc (possible exception of counterfeit and Faetastic).

db0

Can you explain what is going on here exactly? Are these Loras to apply to basic sdxl to simulate finetunes like dreamshaper or something?

rcnz

Basically they are extracting the difference between the fine-tune and the base model and putting it in lora form. You then apply the lora to the base model and you're off laughing. Doing a lora that way takes the 6.5gb model down to a 450-2000mb lora depending on extraction technique, and the distance between base and finetune

spinagon

It's not exact, but does approximate model style

rcnz

the ffusion ones at 500mb are more approximate, some of the higher dimension ones (128+) come out at 2gb and are pretty much identical
but a 2gb lora would break horde systems lol

Tazlin

maybe when we work in LCM's as a special exceptions we can leave it flexible enough to support something like this too

Efreak

This is why I suggested adding them as models, not as loras. Call it dynavision lite or some such
It would be a compromise between having models you want on horde and not having to download too many giant 6gb SDXL models
As long as the quality is high enough

@tazlin tazlin added the enhancement New feature or request label Jan 14, 2024
@tazlin tazlin moved this to Under Consideration in AI-Horde Feature Requests Jan 14, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
Status: Under Consideration
Development

No branches or pull requests

2 participants