File size: 81 Bytes
5fa1a76
1
A tokenizer converts your input into a format that can be processed by the model.