File size: 1,131 Bytes
7934b29 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 |
# ASR with CTC Models
This directory contains example scripts to train ASR models using Connectionist Temporal Classification Loss.
Currently supported models are -
* Character based CTC model
* Subword based CTC model
# Model execution overview
The training scripts in this directory execute in the following order. When preparing your own training-from-scratch / fine-tuning scripts, please follow this order for correct training/inference.
```mermaid
graph TD
A[Hydra Overrides + Yaml Config] --> B{Config}
B --> |Init| C[Trainer]
C --> D[ExpManager]
B --> D[ExpManager]
C --> E[Model]
B --> |Init| E[Model]
E --> |Constructor| F1(Change Vocabulary)
F1 --> F2(Setup InterCTC if available)
F2 --> F3(Setup Adapters if available)
F3 --> G(Setup Train + Validation + Test Data loaders)
G --> H(Setup Optimization)
H --> I[Maybe init from pretrained]
I --> J["trainer.fit(model)"]
```
During restoration of the model, you may pass the Trainer to the restore_from / from_pretrained call, or set it after the model has been initialized by using `model.set_trainer(Trainer)`. |