You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Local 236B DeepSeek-Coder-V2: Running its Q4_K_M version using only 21GB VRAM and 136GB DRAM
Can you provide more detailed specifications of the computer hardware?
What kind of processor is needed, how many channels should RAM have?
What type of RAM was used? DDR5?
I want to try to get this up and running, but I'm afraid I'll spend money on computer hardware that I won't be able to do anything with.
The text was updated successfully, but these errors were encountered:
Hold off. There are some issues that would need to be addressed before I'd spend money on a computer specifically dedicated to this software. The default configuration works well but its limited output would not be ideal for the common coding use case for this model. Efforts to increase output by changing some configuration values in code have encountered crashes and other limitations. It looks like it'd be really great once running.
Can you provide more detailed specifications of the computer hardware?
What kind of processor is needed, how many channels should RAM have?
What type of RAM was used? DDR5?
I want to try to get this up and running, but I'm afraid I'll spend money on computer hardware that I won't be able to do anything with.
The text was updated successfully, but these errors were encountered: