Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
Spaces:
nvidia
/
Plan2Align-NV
like
0
Sleeping
App
Files
Files
Community
1
Fetching metadata from the HF Docker repository...
main
Plan2Align-NV
/
laser
/
tools-external
/
moses-tokenizer
/
tokenizer
Ctrl+K
Ctrl+K
3 contributors
History:
1 commit
KuangDW
add laser tool
2aebc50
24 days ago
basic-protected-patterns
Safe
178 Bytes
add laser tool
24 days ago
deescape-special-chars.perl
Safe
631 Bytes
add laser tool
24 days ago
detokenizer.perl
Safe
12.5 kB
add laser tool
24 days ago
lowercase.perl
Safe
285 Bytes
add laser tool
24 days ago
normalize-punctuation.perl
Safe
1.91 kB
add laser tool
24 days ago
remove-non-printing-char.perl
Safe
451 Bytes
add laser tool
24 days ago
tokenizer.perl
Safe
16.8 kB
add laser tool
24 days ago
