Skip to content

Commit

Permalink
update mistral scores
Browse files Browse the repository at this point in the history
  • Loading branch information
@ganler
ganler authored Mar 5, 2024
1 parent 6aab5c3 commit 4e8ad28
Showing 1 changed file with 1 addition and 0 deletions.
1 change: 1 addition & 0 deletions mbpp.csv
View file
Original file line number Diff line number Diff line change
Expand Up @@ -4,6 +4,7 @@ GPT-3.5-Turbo (Nov 2023),82.5,69.7,True,NONE,https://openai.com/blog/new-models-
claude-3-opus (Mar 2024),86.5,69.2,True,NONE,https://www.anthropic.com/news/claude-3-family
claude-3-sonnet (Mar 2024),82.0,66.4,True,NONE,https://www.anthropic.com/news/claude-3-family
Gemini Pro 1.0,72.9,57.9,True,NONE,https://deepmind.google/technologies/gemini/
Mistral Large (Mar 2024),70.2,56.4,True,NONE,https://mistral.ai/news/mistral-large/
WizardCoder-Python-34B-V1.0,73.2,59.9,True,NONE,https://huggingface.co/WizardLM/WizardCoder-Python-34B-V1.0
DeepSeek-Coder-33B-instruct,78.7,66.7,True,NONE,https://huggingface.co/deepseek-ai/deepseek-coder-33b-instruct
DeepSeek-Coder-6.7B-base,70.2,56.6,False,NONE,https://huggingface.co/deepseek-ai/deepseek-coder-6.7b-base
Expand Down

0 comments on commit 4e8ad28

Please sign in to comment.