elihoole commited on
Commit
fa30ff1
·
verified ·
1 Parent(s): 68528f2

Model save

Browse files
Files changed (2) hide show
  1. README.md +52 -26
  2. tokenizer.json +2 -16
README.md CHANGED
@@ -1,45 +1,71 @@
1
-
2
  ---
3
- language: en
4
- license: mit
5
- datasets:
6
- - your_dataset_name
7
  tags:
8
- - text-classification
9
- - bert
10
- - query-classification
11
  metrics:
12
- - accuracy: 0.975925925925926
13
- - f1: 0.975935077462957
 
 
 
 
 
14
  ---
15
 
16
- # BERT Fine-tuned for Query Classification
 
 
 
17
 
18
- This model is a fine-tuned version of [bert-base-uncased](https://huggingface.co/answerdotai/ModernBERT-base) on a query classification dataset.
 
 
 
 
 
 
19
 
20
  ## Model description
21
 
22
- The model was fine-tuned on queries to classify them into specific categories.
 
 
 
 
23
 
24
  ## Training and evaluation data
25
 
26
- The model was trained on [describe your dataset here].
27
 
28
  ## Training procedure
29
 
30
- The model was trained with the following hyperparameters:
31
- - Learning rate: 2e-05
32
- - Batch size: 8
33
- - Number of epochs: 5
34
- - Optimizer: AdamW
35
- - Weight decay: 0.01
36
 
37
- ## Evaluation results
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
38
 
39
- The model achieved the following results on the validation set:
40
- - Accuracy: 0.9759
41
- - F1 Score: 0.9759
42
 
43
- ## Uses and limitations
44
 
45
- [Discuss the intended uses and limitations of your model]
 
 
 
 
 
1
  ---
2
+ library_name: transformers
3
+ license: apache-2.0
4
+ base_model: answerdotai/ModernBERT-base
 
5
  tags:
6
+ - generated_from_trainer
 
 
7
  metrics:
8
+ - accuracy
9
+ - f1
10
+ - precision
11
+ - recall
12
+ model-index:
13
+ - name: modern-bert-finetuned-query-classification
14
+ results: []
15
  ---
16
 
17
+ <!-- This model card has been generated automatically according to the information the Trainer had access to. You
18
+ should probably proofread and complete it, then remove this comment. -->
19
+
20
+ # modern-bert-finetuned-query-classification
21
 
22
+ This model is a fine-tuned version of [answerdotai/ModernBERT-base](https://huggingface.co/answerdotai/ModernBERT-base) on an unknown dataset.
23
+ It achieves the following results on the evaluation set:
24
+ - Loss: 0.1256
25
+ - Accuracy: 0.9759
26
+ - F1: 0.9759
27
+ - Precision: 0.9763
28
+ - Recall: 0.9759
29
 
30
  ## Model description
31
 
32
+ More information needed
33
+
34
+ ## Intended uses & limitations
35
+
36
+ More information needed
37
 
38
  ## Training and evaluation data
39
 
40
+ More information needed
41
 
42
  ## Training procedure
43
 
44
+ ### Training hyperparameters
 
 
 
 
 
45
 
46
+ The following hyperparameters were used during training:
47
+ - learning_rate: 2e-05
48
+ - train_batch_size: 8
49
+ - eval_batch_size: 8
50
+ - seed: 42
51
+ - optimizer: Use OptimizerNames.ADAMW_TORCH with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
52
+ - lr_scheduler_type: linear
53
+ - num_epochs: 5
54
+
55
+ ### Training results
56
+
57
+ | Training Loss | Epoch | Step | Validation Loss | Accuracy | F1 | Precision | Recall |
58
+ |:-------------:|:-----:|:----:|:---------------:|:--------:|:------:|:---------:|:------:|
59
+ | No log | 1.0 | 315 | 0.1474 | 0.9648 | 0.9647 | 0.9649 | 0.9648 |
60
+ | 0.1965 | 2.0 | 630 | 0.1226 | 0.9704 | 0.9704 | 0.9718 | 0.9704 |
61
+ | 0.1965 | 3.0 | 945 | 0.1192 | 0.9741 | 0.9742 | 0.9757 | 0.9741 |
62
+ | 0.0426 | 4.0 | 1260 | 0.1250 | 0.9741 | 0.9741 | 0.9742 | 0.9741 |
63
+ | 0.0042 | 5.0 | 1575 | 0.1256 | 0.9759 | 0.9759 | 0.9763 | 0.9759 |
64
 
 
 
 
65
 
66
+ ### Framework versions
67
 
68
+ - Transformers 4.51.3
69
+ - Pytorch 2.6.0+cu124
70
+ - Datasets 3.5.1
71
+ - Tokenizers 0.21.1
tokenizer.json CHANGED
@@ -1,21 +1,7 @@
1
  {
2
  "version": "1.0",
3
- "truncation": {
4
- "direction": "Right",
5
- "max_length": 128,
6
- "strategy": "LongestFirst",
7
- "stride": 0
8
- },
9
- "padding": {
10
- "strategy": {
11
- "Fixed": 128
12
- },
13
- "direction": "Right",
14
- "pad_to_multiple_of": null,
15
- "pad_id": 50283,
16
- "pad_type_id": 0,
17
- "pad_token": "[PAD]"
18
- },
19
  "added_tokens": [
20
  {
21
  "id": 0,
 
1
  {
2
  "version": "1.0",
3
+ "truncation": null,
4
+ "padding": null,
 
 
 
 
 
 
 
 
 
 
 
 
 
 
5
  "added_tokens": [
6
  {
7
  "id": 0,