Requesting Addition to Vidore Leaderboard
#3
by
pranshuchaurasia
- opened
Hello LlamaIndex team,
I've been evaluating the vdr-2b-multi-v1 model using the Vidore benchmark, but I noticed that the model's score hasn't been uploaded to the Vidore leaderboard yet. Would it be possible to add the vdr-2b-multi-v1 score to the Vidore leaderboard for comparison with other models?
Also, I wanted to confirm the correct value for the --model-class parameter when running the benchmark. During my testing, I used "biqweb2" as the model class, but I'm not sure if this is correct. Could you please confirm the appropriate model class to use when benchmarking vdr-2b-multi-v1 with Vidore benchmark?
Thank you for your help and for making this model available to the community!