Jeongwon Choi
commited on
Update README.md
Browse files
README.md
CHANGED
@@ -71,12 +71,13 @@ text = """\
|
|
71 |
|
72 |
### **[Ko LM Eval Harnesss](https://github.com/Beomi/ko-lm-evaluation-harness)**
|
73 |
|
74 |
-
| Task |
|
75 |
-
| :--------------- |
|
76 |
-
| kobest_boolq |
|
77 |
-
| kobest_copa |
|
78 |
-
| kobest_hellaswag |
|
79 |
-
| kobest_sentineg |
|
|
|
80 |
|
81 |
### **[Ko-LLM-Leaderboard](https://huggingface.co/spaces/upstage/open-ko-llm-leaderboard)**
|
82 |
|
|
|
71 |
|
72 |
### **[Ko LM Eval Harnesss](https://github.com/Beomi/ko-lm-evaluation-harness)**
|
73 |
|
74 |
+
| Task | 0-shot | 5-shot | 10-shot | 50-shot |
|
75 |
+
| :--------------- | ----------: | -------------: | -------------: | -----------: |
|
76 |
+
| kobest_boolq | 0.389066 | 0.912924 | 0.912808 | 0.906428 |
|
77 |
+
| kobest_copa | 0.744865 | 0.747742 | 0.768856 | 0.785896 |
|
78 |
+
| kobest_hellaswag | 0.455793 | 0.443909 | 0.465783 | 0.472771 |
|
79 |
+
| kobest_sentineg | 0.584156 | 0.947082 | 0.962216 | 0.954657 |
|
80 |
+
| **Average** | **0.54347** | **0.76291425** | **0.77741575** | **0.779938** |
|
81 |
|
82 |
### **[Ko-LLM-Leaderboard](https://huggingface.co/spaces/upstage/open-ko-llm-leaderboard)**
|
83 |
|