Skip to content

Commit

Permalink
update latest models results
Browse files Browse the repository at this point in the history
  • Loading branch information
Henrychur committed May 31, 2024
1 parent a0e7a22 commit ee54143
Showing 1 changed file with 3 additions and 0 deletions.
3 changes: 3 additions & 0 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -96,8 +96,11 @@ Here we show the main results of models' performance on MMedBench. For more deta
| ChatDoctor | 7B | 2023.4 | ✗ | trainset | 43.52 | 43.26 | 25.63 | 18.81 | 62.50 | 43.44 | 39.53 |
| PMC-LLaMA | 7B | 2023.4 | ✗ | trainset | 47.53 | 42.44 | 24.12 | 20.74 | 62.11 | 43.29 | 40.04 |
| Mistral | 7B | 2023.10 | ✗ | trainset | 61.74 | 71.10 | 44.72 | 48.71 | 74.22 | 63.86 | 60.73 |
| MEDITRON | 7B | 2023.11 | ✗ | trainset |55.46 | 61.88 | 40.20 | 35.05 | 67.58 | 53.28 | 52.24|
| InternLM 2 | 1.8B | 2024.2 | ✗ | trainset |38.49 |64.1 |32.16|18.01|53.91|36.83|40.58|
| InternLM 2 | 7B | 2024.2 | ✗ | trainset | 57.27 | 77.55 | 47.74 | 41.00 | 68.36 | 59.59 | 58.59 |
| BioMistral | 7B | 2024.2 | ✗ | trainset |57.82 | 71.54 |37.19 |47.27 |69.92 | 60.98 | 57.45|
| Llama 3 | 8B | 2024.4 | ✗ | trainset |63.86 | 78.23 |48.24 |50.80 |71.48 | 64.15 | 62.79|
| MMedLM (Ours) | 7B | - | ✓ | trainset | 49.88 | 70.49 | 46.23 | 36.66 | 72.27 | 54.52 | 55.01 |
| MMedLM 2(Ours) | 7B | - | ✓ | trainset | 61.74 | 80.01 | 61.81 | 52.09 | 80.47 | 67.65 | 67.30 |
| MMedLM 2(Ours) | 1.8B | - | ✓ | trainset | 45.40 | 66.78 | 42.21 | 25.56 | 69.14 | 43.40 | 48.75 |
Expand Down

0 comments on commit ee54143

Please sign in to comment.