lbourdois commited on
Commit
8fe89a4
·
verified ·
1 Parent(s): aa92ff9

Improve language tag

Browse files

Hi! As the model is multilingual, this is a PR to add other languages than English to the language tag to improve the referencing. Note that 29 languages are announced in the README, but only 13 are explicitly listed. I was therefore only able to add these 13 languages.

Files changed (1) hide show
  1. README.md +76 -76
README.md CHANGED
@@ -1,76 +1,76 @@
1
- ---
2
- base_model:
3
- - Qwen/Qwen2.5-Coder-7B
4
- - Qwen/Qwen2.5-Math-7B
5
- - Qwen/Qwen2.5-7B-Instruct
6
- - Qwen/Qwen2.5-7B
7
- library_name: transformers
8
- tags:
9
- - mergekit
10
- - merge
11
- language:
12
- - zho
13
- - eng
14
- - fra
15
- - spa
16
- - por
17
- - deu
18
- - ita
19
- - rus
20
- - jpn
21
- - kor
22
- - vie
23
- - tha
24
- - ara
25
- ---
26
- # nthehai01/Qwen2.5-7B-Instruct-Math-Code-task-arithmetic
27
-
28
- This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).
29
-
30
- ## Performance
31
- | Metric |Value|
32
- |---------------------------------|----:|
33
- |GSM8k (zero-shot) |86.20|
34
- |HellaSwag (zero-Shot) |49.91|
35
- |MBPP (zero-shot) |55.20|
36
-
37
- ## Merge Details
38
- ### Merge Method
39
-
40
- This model was merged using the [Task Arithmetic](https://arxiv.org/abs/2212.04089) merge method using [Qwen/Qwen2.5-7B](https://huggingface.co/Qwen/Qwen2.5-7B) as a base.
41
-
42
- ### Models Merged
43
-
44
- The following models were included in the merge:
45
- * [Qwen/Qwen2.5-Coder-7B](https://huggingface.co/Qwen/Qwen2.5-Coder-7B)
46
- * [Qwen/Qwen2.5-Math-7B](https://huggingface.co/Qwen/Qwen2.5-Math-7B)
47
- * [Qwen/Qwen2.5-7B-Instruct](https://huggingface.co/Qwen/Qwen2.5-7B-Instruct)
48
-
49
- ### Configuration
50
-
51
- The following YAML configuration was used to produce this model:
52
-
53
- ```yaml
54
- base_model: Qwen/Qwen2.5-7B
55
- dtype: bfloat16
56
- merge_method: task_arithmetic
57
- parameters:
58
- lambda: 0.5676097213578511
59
- normalize: 1.0
60
- slices:
61
- - sources:
62
- - layer_range: [0, 28]
63
- model: Qwen/Qwen2.5-7B
64
- - layer_range: [0, 28]
65
- model: Qwen/Qwen2.5-Math-7B
66
- parameters:
67
- weight: 0.5215841338521604
68
- - layer_range: [0, 28]
69
- model: Qwen/Qwen2.5-Coder-7B
70
- parameters:
71
- weight: 0.13680114132969845
72
- - layer_range: [0, 28]
73
- model: Qwen/Qwen2.5-7B-Instruct
74
- parameters:
75
- weight: 0.8507353075455186
76
- ```
 
1
+ ---
2
+ base_model:
3
+ - Qwen/Qwen2.5-Coder-7B
4
+ - Qwen/Qwen2.5-Math-7B
5
+ - Qwen/Qwen2.5-7B-Instruct
6
+ - Qwen/Qwen2.5-7B
7
+ library_name: transformers
8
+ tags:
9
+ - mergekit
10
+ - merge
11
+ language:
12
+ - zho
13
+ - eng
14
+ - fra
15
+ - spa
16
+ - por
17
+ - deu
18
+ - ita
19
+ - rus
20
+ - jpn
21
+ - kor
22
+ - vie
23
+ - tha
24
+ - ara
25
+ ---
26
+ # nthehai01/Qwen2.5-7B-Instruct-Math-Code-task-arithmetic
27
+
28
+ This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).
29
+
30
+ ## Performance
31
+ | Metric |Value|
32
+ |---------------------------------|----:|
33
+ |GSM8k (zero-shot) |86.20|
34
+ |HellaSwag (zero-Shot) |49.91|
35
+ |MBPP (zero-shot) |55.20|
36
+
37
+ ## Merge Details
38
+ ### Merge Method
39
+
40
+ This model was merged using the [Task Arithmetic](https://arxiv.org/abs/2212.04089) merge method using [Qwen/Qwen2.5-7B](https://huggingface.co/Qwen/Qwen2.5-7B) as a base.
41
+
42
+ ### Models Merged
43
+
44
+ The following models were included in the merge:
45
+ * [Qwen/Qwen2.5-Coder-7B](https://huggingface.co/Qwen/Qwen2.5-Coder-7B)
46
+ * [Qwen/Qwen2.5-Math-7B](https://huggingface.co/Qwen/Qwen2.5-Math-7B)
47
+ * [Qwen/Qwen2.5-7B-Instruct](https://huggingface.co/Qwen/Qwen2.5-7B-Instruct)
48
+
49
+ ### Configuration
50
+
51
+ The following YAML configuration was used to produce this model:
52
+
53
+ ```yaml
54
+ base_model: Qwen/Qwen2.5-7B
55
+ dtype: bfloat16
56
+ merge_method: task_arithmetic
57
+ parameters:
58
+ lambda: 0.5676097213578511
59
+ normalize: 1.0
60
+ slices:
61
+ - sources:
62
+ - layer_range: [0, 28]
63
+ model: Qwen/Qwen2.5-7B
64
+ - layer_range: [0, 28]
65
+ model: Qwen/Qwen2.5-Math-7B
66
+ parameters:
67
+ weight: 0.5215841338521604
68
+ - layer_range: [0, 28]
69
+ model: Qwen/Qwen2.5-Coder-7B
70
+ parameters:
71
+ weight: 0.13680114132969845
72
+ - layer_range: [0, 28]
73
+ model: Qwen/Qwen2.5-7B-Instruct
74
+ parameters:
75
+ weight: 0.8507353075455186
76
+ ```