Reproducing REC results

[ryohachiuma]

Hi, @machuofan

I tried to reproduce REC results on the RefCOCOg dataset.
I downloaded the model weights from here and followed the instructions at here by running the following command.

python torchrun --nnodes=1 --nproc_per_node=8 groma/eval/eval_rec.py --model-name ./groma-7b-finetune --img-prefix /workspace/dataset/MSCOCO/train2017 --ann-file ./rec_refcocog_val.json

However, i got the results below. Am i missing sth?

rec_refcocog_val.json
[email protected] accu: 0.21956699346405228
m_iou: 0.20178459516537736
missing percentage: 0.0

Thanks in advance