Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Detailed specification of the computer hardware to run 236B DeepSeek-Coder-V2 #108

Open
atomlayer opened this issue Nov 1, 2024 · 1 comment

Comments

@atomlayer
Copy link

Local 236B DeepSeek-Coder-V2: Running its Q4_K_M version using only 21GB VRAM and 136GB DRAM

Can you provide more detailed specifications of the computer hardware?
What kind of processor is needed, how many channels should RAM have?
What type of RAM was used? DDR5?

I want to try to get this up and running, but I'm afraid I'll spend money on computer hardware that I won't be able to do anything with.

@bitbottrap
Copy link

Hold off. There are some issues that would need to be addressed before I'd spend money on a computer specifically dedicated to this software. The default configuration works well but its limited output would not be ideal for the common coding use case for this model. Efforts to increase output by changing some configuration values in code have encountered crashes and other limitations. It looks like it'd be really great once running.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants