tokenizer / app.py

Commit History

Fix tokenize_text function to correct token end index and remove unused 'supervision' package from requirements.txt
c4a8604

wjm55 commited on

Refactor tokenize endpoint to use Pydantic model for request validation and update README.md examples to reflect changes in API usage
032494e

wjm55 commited on

Implement initial project structure and setup
c8497a7

wjm55 commited on