Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

evaluation results of InternVL2_5-2B on GSM8K dosen't match with that in paper. #951

Open
lynshwoo2022 opened this issue Mar 11, 2025 · 0 comments

Comments

@lynshwoo2022
Copy link

lynshwoo2022 commented Mar 11, 2025

In table 13 of your paper ”Expanding Performance Boundaries of Open-Source Multimodal Models with Model, Data, and Test-Time Scaling” shows that the result of InternVL2_5-2B on GSM8K(4-shot) is about 55, but I tried on myself which only gets around 37.

I'm thinking if it's the prompt i use on InternVL2_5-2B is not the most effective. Could you please show me some examples activating and guiding InternVL2_5 to generate the best answer?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant