Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

reproduce the LLaVA-NeXT-Video 7B scores #503

Open
junho-jo opened this issue Jan 16, 2025 · 1 comment
Open

reproduce the LLaVA-NeXT-Video 7B scores #503

junho-jo opened this issue Jan 16, 2025 · 1 comment

Comments

@junho-jo
Copy link

reference: https://lmms-lab.github.io/posts/lmms-eval-0.2/,

In the section of "Alignment Check for Video Datasets", there are LLaVA-Next-Video-7B scores in the benchmark table.
Could you share the corresponding model checkpoint link? I'm very confused with the naming of version..

  1. https://huggingface.co/lmms-lab/LLaVA-NeXT-Video-7B
  2. https://huggingface.co/lmms-lab/LLaVA-Video-7B-Qwen2

And also the scripts for evaluation?

@giobin
Copy link

giobin commented Jan 20, 2025

i have the same issue. Difficult to understand exactly which checkpoint and model_name to use to reproduce those results

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants