Hugging Face's logo

Spaces:
hmteams
/
README
Running

App Files Community
stefan-it commited on
Commit
bde9424
·
1 Parent(s): 849fd2f

readme: add results for German and French NewsEye dataset

Browse files
Files changed (1) hide show
  1. README.md +17 -11
README.md CHANGED
@@ -27,20 +27,26 @@ We test our pretrained language models on various datasets from HIPE-2020, HIPE-
27
  shows an overview of used datasets.
28
 
29
  | Language | Datasets
30
- |----------|----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|
31
- | English | [AjMC](https://github.com/hipe-eval/HIPE-2022-data/blob/main/documentation/README-ajmc.md) - [TopRes19th](https://github.com/hipe-eval/HIPE-2022-data/blob/main/documentation/README-topres19th.md) |
32
- | German | [AjMC](https://github.com/hipe-eval/HIPE-2022-data/blob/main/documentation/README-ajmc.md) |
33
- | French | [AjMC](https://github.com/hipe-eval/HIPE-2022-data/blob/main/documentation/README-ajmc.md) - [ICDAR-Europeana](https://github.com/stefan-it/historic-domain-adaptation-icdar) - [LeTemps](https://github.com/hipe-eval/HIPE-2022-data/blob/main/documentation/README-letemps.md) |
34
- | Finnish | [NewsEye](https://github.com/hipe-eval/HIPE-2022-data/blob/main/documentation/README-newseye.md) |
35
- | Swedish | [NewsEye](https://github.com/hipe-eval/HIPE-2022-data/blob/main/documentation/README-newseye.md) |
36
- | Dutch | [ICDAR-Europeana](https://github.com/stefan-it/historic-domain-adaptation-icdar) |
 
 
 
 
 
 
37
 
38
  Results:
39
 
40
- | Model | English AjMC | German AjMC | French AjMC | Finnish NewsEye | Swedish NewsEye | Dutch ICDAR | French ICDAR | French LeTemps | English TopRes19th | Avg. |
41
- |---------------------------------------------------------------------------|--------------|--------------|--------------|-----------------|-----------------|--------------|--------------|----------------|--------------------|-----------|
42
- | hmBERT (32k) [Schweter et al.](https://ceur-ws.org/Vol-3180/paper-87.pdf) | 85.36 ± 0.94 | 89.08 ± 0.09 | 85.10 ± 0.60 | 77.28 ± 0.37 | 82.85 ± 0.83 | 82.11 ± 0.61 | 77.21 ± 0.16 | 65.73 ± 0.56 | 80.94 ± 0.86 | 80.63 |
43
- | hmTEAMS (Ours) | 86.41 ± 0.36 | 88.64 ± 0.42 | 85.41 ± 0.67 | 79.27 ± 1.88 | 82.78 ± 0.60 | 88.21 ± 0.39 | 78.03 ± 0.39 | 66.71 ± 0.46 | 81.36 ± 0.59 | **81.87** |
44
 
45
  # Acknowledgements
46
 
 
27
  shows an overview of used datasets.
28
 
29
  | Language | Datasets
30
+ |----------|----------------------------------------------------|
31
+ | English | [AjMC] - [TopRes19th] |
32
+ | German | [AjMC] - [NewsEye] |
33
+ | French | [AjMC] - [ICDAR-Europeana] - [LeTemps] - [NewsEye] |
34
+ | Finnish | [NewsEye] |
35
+ | Swedish | [NewsEye] |
36
+ | Dutch | [ICDAR-Europeana] |
37
+
38
+ [AjMC]: https://github.com/hipe-eval/HIPE-2022-data/blob/main/documentation/README-ajmc.md
39
+ [NewsEye]: https://github.com/hipe-eval/HIPE-2022-data/blob/main/documentation/README-newseye.md
40
+ [TopRes19th]: https://github.com/hipe-eval/HIPE-2022-data/blob/main/documentation/README-topres19th.md
41
+ [ICDAR-Europeana]: https://github.com/stefan-it/historic-domain-adaptation-icdar
42
+ [LeTemps]: https://github.com/hipe-eval/HIPE-2022-data/blob/main/documentation/README-letemps.md
43
 
44
  Results:
45
 
46
+ | Model | English AjMC | German AjMC | French AjMC | German NewsEye | French NewsEye | Finnish NewsEye | Swedish NewsEye | Dutch ICDAR | French ICDAR | French LeTemps | English TopRes19th | Avg. |
47
+ |---------------------------------------------------------------------------|--------------|--------------|--------------|----------------|----------------|-----------------|-----------------|--------------|--------------|----------------|--------------------|-----------|
48
+ | hmBERT (32k) [Schweter et al.](https://ceur-ws.org/Vol-3180/paper-87.pdf) | 85.36 ± 0.94 | 89.08 ± 0.09 | 85.10 ± 0.60 | 39.65 ± 1.01 | 81.47 ± 0.36 | 77.28 ± 0.37 | 82.85 ± 0.83 | 82.11 ± 0.61 | 77.21 ± 0.16 | 65.73 ± 0.56 | 80.94 ± 0.86 | 76.98 |
49
+ | hmTEAMS (Ours) | 86.41 ± 0.36 | 88.64 ± 0.42 | 85.41 ± 0.67 | 41.51 ± 2.82 | 83.20 ± 0.79 | 79.27 ± 1.88 | 82.78 ± 0.60 | 88.21 ± 0.39 | 78.03 ± 0.39 | 66.71 ± 0.46 | 81.36 ± 0.59 | **78.32** |
50
 
51
  # Acknowledgements
52