refactor: Simplify main function by removing unnecessary indentation ada166c mebubo commited on Oct 6, 2024
fix: Pass tokenizer to calculate_log_probabilities function to resolve error c6407ad mebubo commited on Oct 5, 2024
refactor: Modularize code by creating functions for model loading and processing 8e36e52 mebubo commited on Oct 5, 2024
feat: add filtering for low probability words based on log probability threshold b2b409d mebubo commited on Oct 4, 2024
refactor: separate text processing logic into a new module for better organization 6735ae4 mebubo commited on Oct 4, 2024
mebubo
commited on
