Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[BOUNTY - $500] FLUX Support #461

Open
AlexCheema opened this issue Nov 15, 2024 · 6 comments
Open

[BOUNTY - $500] FLUX Support #461

AlexCheema opened this issue Nov 15, 2024 · 6 comments
Assignees
@ZhihaoAIRobotic @varshith15

Comments

@AlexCheema
Copy link
Contributor

Add support for this model with the MLX backend: https://huggingface.co/black-forest-labs/FLUX.1-dev

There's already an example of FLUX using MLX here: https://github.com/ml-explore/mlx-examples/blob/main/flux/flux/model.py
@AlexCheema AlexCheema changed the title FLUX Support [BOUNTY - $500] FLUX Support Nov 15, 2024
@varshith15
Copy link
Contributor

varshith15 commented Nov 15, 2024 •
edited
Loading

it is able to run on my 32gb mac :)
can i take this up @AlexCheema ? wanted to explore sd, flux for the longest, this will be a really good chance

@AlexCheema
Copy link
Contributor Author

it is able to run on my 32gb mac :) can i take this up @AlexCheema ? wanted to explore sd, flux for the longest, this will be a really good chance

It should be, definitely at Q4. Assigned - good luck!

@ZhihaoAIRobotic
Copy link

Want to participate too!

@AlexCheema
Copy link
Contributor Author

Want to participate too!

Sure, if you and @varshith15 agree to work together I will award the full $500 to both of you.

@varshith15
Copy link
Contributor

@ZhihaoAIRobotic im down, lets talk on discord :)

@ZhihaoAIRobotic
Copy link

No problem :)

vishwamartur added a commit to vishwamartur/exo that referenced this issue Nov 25, 2024
@vishwamartur
Add FLUX support with MLX backend
7d96b2e 
Related to exo-explore#461

Add support for the FLUX model with the MLX backend.

* **New Model Class**: Add `exo/inference/mlx/models/flux.py` to define the `FluxModel` and `Model` classes for the FLUX model.
* **Inference Engine Update**: Modify `exo/inference/mlx/sharded_inference_engine.py` to include necessary imports for the FLUX model.
* **Testing**: Add `exo/inference/mlx/test_sharded_flux.py` to include tests for the FLUX model, ensuring proper integration and functionality.
* **Documentation**: Update `README.md` to include instructions for using the FLUX model with the MLX backend, along with usage examples.
@vishwamartur vishwamartur mentioned this issue Nov 25, 2024
Closed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@ZhihaoAIRobotic ZhihaoAIRobotic

@varshith15 varshith15

Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
3 participants
@ZhihaoAIRobotic @varshith15 @AlexCheema