Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Question about eval chart-to-table on ChartQA #24

Open
GoGoJoestar opened this issue Oct 22, 2024 · 0 comments
Open

Question about eval chart-to-table on ChartQA #24

GoGoJoestar opened this issue Oct 22, 2024 · 0 comments

Comments

@GoGoJoestar
Copy link

GoGoJoestar commented Oct 22, 2024

I want eval the chart-to-table task on ChartQA, but I could't find the annotations file of ChartQA_OCR mentioned in accessory/single_turn_eval_multitask.py

'chartqa_ocr': '/mnt/petrelfs/share_data/path1/path/ChartQA-main/ChartQA-Dataset/test/annotations2.json',

Where can I get this annotations file? And is there a script or document for chart-to-table reasoning and metric (RMS F1 in the chart-ast papar) calculation to follow?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant