Spaces:
Sleeping
Sleeping
File size: 130 Bytes
6bc66e8 |
1 2 3 4 5 6 7 |
import pickle
with open("tokenizer.pkl", "wb") as handle:
pickle.dump(tokenizer, handle, protocol=pickle.HIGHEST_PROTOCOL)
|