metadata
license: mit
tags:
- chess
- pgn
- tokenizer
pretty_name: PGN Tokenizer
source_datasets:
- InterwebAlchemy/pgn-dataset-including-special-tokens
task_categories:
- token-classification
task_ids:
- parsing
PGN Tokenizer
This is a Byte Pair Encoding (BPE) tokenizer for chess Portable Game Notation (PGN).