aitechguy commited on
Commit
9c764c7
·
verified ·
1 Parent(s): c060837

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +43 -1
README.md CHANGED
@@ -16,4 +16,46 @@ tags:
16
  - medical
17
  - chemistry
18
  - biology
19
- ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
16
  - medical
17
  - chemistry
18
  - biology
19
+ ---
20
+
21
+ # aitechguy/distilbert_base_uncased_ner
22
+
23
+ This model is a fine-tuned version of [distilbert-base-uncased](https://huggingface.co/distilbert-base-uncased) on an unknown dataset.
24
+ It achieves the following results on the evaluation set:
25
+ - Train Loss: 3.5619
26
+ - Validation Loss: 3.5082
27
+ - Epoch: 0
28
+
29
+ ## Model description
30
+
31
+ More information needed
32
+
33
+ ## Intended uses & limitations
34
+
35
+ More information needed
36
+
37
+ ## Training and evaluation data
38
+
39
+ More information needed
40
+
41
+ ## Training procedure
42
+
43
+ ### Training hyperparameters
44
+
45
+ The following hyperparameters were used during training:
46
+ - optimizer: {'name': 'AdamWeightDecay', 'learning_rate': {'module': 'transformers.optimization_tf', 'class_name': 'WarmUp', 'config': {'initial_learning_rate': 2e-05, 'decay_schedule_fn': {'module': 'keras.optimizers.schedules', 'class_name': 'PolynomialDecay', 'config': {'initial_learning_rate': 2e-05, 'decay_steps': -996, 'end_learning_rate': 0.0, 'power': 1.0, 'cycle': False, 'name': None}, 'registered_name': None}, 'warmup_steps': 1000, 'power': 1.0, 'name': None}, 'registered_name': 'WarmUp'}, 'decay': 0.0, 'beta_1': 0.9, 'beta_2': 0.999, 'epsilon': 1e-08, 'amsgrad': False, 'weight_decay_rate': 0.01}
47
+ - training_precision: mixed_float16
48
+
49
+ ### Training results
50
+
51
+ | Train Loss | Validation Loss | Epoch |
52
+ |:----------:|:---------------:|:-----:|
53
+ | 3.5619 | 3.5082 | 0 |
54
+
55
+
56
+ ### Framework versions
57
+
58
+ - Transformers 4.35.0
59
+ - TensorFlow 2.14.0
60
+ - Datasets 2.14.6
61
+ - Tokenizers 0.14.1