jacob-danner commited on
Commit
569d194
·
verified ·
1 Parent(s): 664a2e5

feat: set n classification heads to 8

Browse files
Files changed (1) hide show
  1. README.md +9 -6
README.md CHANGED
@@ -16,7 +16,7 @@ should probably proofread and complete it, then remove this comment. -->
16
 
17
  This model is a fine-tuned version of [openai-gpt](https://huggingface.co/openai-gpt) on an unknown dataset.
18
  It achieves the following results on the evaluation set:
19
- - Loss: 1.6326
20
 
21
  ## Model description
22
 
@@ -35,7 +35,7 @@ More information needed
35
  ### Training hyperparameters
36
 
37
  The following hyperparameters were used during training:
38
- - learning_rate: 0.0006786313884221838
39
  - train_batch_size: 64
40
  - eval_batch_size: 64
41
  - seed: 42
@@ -47,10 +47,13 @@ The following hyperparameters were used during training:
47
 
48
  | Training Loss | Epoch | Step | Validation Loss |
49
  |:-------------:|:-----:|:----:|:---------------:|
50
- | 1.932 | 1.0 | 12 | 1.6346 |
51
- | 1.65 | 2.0 | 24 | 1.6288 |
52
- | 1.6441 | 3.0 | 36 | 1.6408 |
53
- | 1.6397 | 4.0 | 48 | 1.6326 |
 
 
 
54
 
55
 
56
  ### Framework versions
 
16
 
17
  This model is a fine-tuned version of [openai-gpt](https://huggingface.co/openai-gpt) on an unknown dataset.
18
  It achieves the following results on the evaluation set:
19
+ - Loss: 0.3986
20
 
21
  ## Model description
22
 
 
35
  ### Training hyperparameters
36
 
37
  The following hyperparameters were used during training:
38
+ - learning_rate: 5.38312346311055e-05
39
  - train_batch_size: 64
40
  - eval_batch_size: 64
41
  - seed: 42
 
47
 
48
  | Training Loss | Epoch | Step | Validation Loss |
49
  |:-------------:|:-----:|:----:|:---------------:|
50
+ | 1.5016 | 1.0 | 12 | 1.1160 |
51
+ | 0.8736 | 2.0 | 24 | 0.7228 |
52
+ | 0.4681 | 3.0 | 36 | 0.4849 |
53
+ | 0.2851 | 4.0 | 48 | 0.4339 |
54
+ | 0.1733 | 5.0 | 60 | 0.3113 |
55
+ | 0.1108 | 6.0 | 72 | 0.3303 |
56
+ | 0.0841 | 7.0 | 84 | 0.3986 |
57
 
58
 
59
  ### Framework versions