khhuiyh commited on
Commit
8cf1090
·
1 Parent(s): 113764f

Update file/result.csv

Browse files
Files changed (1) hide show
  1. file/result.csv +8 -3
file/result.csv CHANGED
@@ -1,4 +1,9 @@
1
  Model,Overall Acc.,Dynamic Perception,State Transitions Perception,Camera Movement Perception,Explanatory Reasoning,Counterfactual Reasoning,Predictive Reasoning,Comparison Reasoning,Reasoning with External Knowledge,Description
2
- [Flan-T5](https://huggingface.co/google/flan-t5-xl),27.7,27.3,28.6,23,29,32.8,31.8,20.5,31.8,33
3
- [BLIP-2](https://github.com/salesforce/LAVIS),46.4,49.7,36.7,59.1,53.9,49.2,42.3,43.2,36.7,55.7
4
- [VideoChat](https://github.com/OpenGVLab/Ask-Anything),37.6,39,33.7,47.1,43.8,34.9,40,32.8,34.6,42.3
 
 
 
 
 
 
1
  Model,Overall Acc.,Dynamic Perception,State Transitions Perception,Camera Movement Perception,Explanatory Reasoning,Counterfactual Reasoning,Predictive Reasoning,Comparison Reasoning,Reasoning with External Knowledge,Description
2
+ BLIP-2,0.3,0.0,0.0,0.0,0.0,1.5,0.0,0.0,0.0,0.0
3
+ InstructBLIP,7.9,6.5,12.5,21.1,6.3,7.6,0.0,0.0,26.3,0.0
4
+ Qwen-VL,7.0,4.3,6.2,21.1,7.5,4.5,12.5,3.3,5.3,0.0
5
+ LLaVA-1.5,8.5,10.9,9.4,5.3,8.8,3.0,6.2,10.0,15.8,33.3
6
+ GPT-4V,22.2,28.3,25.0,10.5,30.0,22.7,18.8,20.0,21.1,0.0
7
+ Video-ChatGPT,6.7,2.2,6.2,15.8,11.2,4.5,3.1,0.0,15.8,0.0
8
+ VideoChat,13.4,8.7,9.4,31.6,11.2,16.7,9.4,6.7,26.3,33.3
9
+ Video-LLaMA,11.2,4.3,6.2,21.1,13.8,10.6,12.5,3.3,26.3,0.0