MLX-my-repo - a no-code way to create MLX quants (Q4/ Q8) #1130
Vaibhavs10
started this conversation in
Show and tell
Replies: 1 comment
-
Nice - thanks @Vaibhavs10. Helps us upload-speed-poors as well. |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
Hi all,
I'm VB, I am a GPU Poor in residence at Hugging Face and a big fan of MLX. Recently we put together a Space that allows you to create MLX quants directly on the Hugging Face Hub without the need to download anything or setup an environment.
The space is available here: https://huggingface.co/spaces/mlx-community/mlx-my-repo 🔥
Note: We don't keep a log of who creates what quants, so it's privacy first and you can even create private model checkpoints too!
This is an initial version with a bit of rough edges, but keen to hear your feedback on this. 🤗
Beta Was this translation helpful? Give feedback.
All reactions