Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Lumina 2 and Gemma 2 model loading #12

Merged
merged 1 commit into from
Feb 16, 2025

Conversation

rockerBOO
Copy link

@rockerBOO rockerBOO commented Feb 15, 2025

https://huggingface.co/Alpha-VLLM/Lumina-Image-2.0/blob/main/text_encoder/config.json
https://huggingface.co/Alpha-VLLM/Lumina-Image-2.0/blob/main/transformer/config.json

I made a fp8 version of gemma 2 and lumina 2 on https://huggingface.co/rockerBOO/Lumina-Image-2.0-fp8_e4m3fn to test with.

                    INFO     Building Lumina                                                                               lumina_util.py:31
                    INFO     Loading state dict from /home/rockerboo/sd/models/lumina-image-2.safetensors                  lumina_util.py:35
                    INFO     Loaded Lumina: <All keys matched successfully>                                                lumina_util.py:40
                    INFO     Building Gemma2                                                                               lumina_util.py:70
                    INFO     Loading state dict from /home/rockerboo/sd/text_encoders/gemma-2-2b.safetensors              lumina_util.py:112
2025-02-15 15:02:34 INFO     Loaded Gemma2: <All keys matched successfully>                                               lumina_util.py:124
                    INFO     Building AutoEncoder                                                                          lumina_util.py:49
                    INFO     Loading state dict from /mnt/900/vae/ae.safetensors                                           lumina_util.py:54
                    INFO     Loaded AE: <All keys matched successfully>                                                    lumina_util.py:59

I converted their .pth file into safetensors here https://huggingface.co/rockerBOO/lumina-image-2/blob/main/lumina-image-2.safetensors

Related: kohya-ss#1927

@sdbds sdbds merged commit 6965a01 into sdbds:lumina Feb 16, 2025
1 check passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants