Commit History

Added possibility of changing model and entity types in config file
bce761b

seanpedrickcase commited on

Added capability to redact all redactions with the same text based on the selected row. Rerranged buttons on review page a little. Improved page navigation efficiency.
c4e3724

seanpedrickcase commited on

Updated gradio version. Minor changes to redactor function sequence. Minor formatting and wording changes.
5a21738

seanpedrickcase commited on

Corrected a couple of bugs. Now Textract whole document API call outputs will load also the input PDF into the app
10f46e9

seanpedrickcase commited on

Minor changes for cost codes, package updates. Added pyproject.toml file
47a3a80

seanpedrickcase commited on

Now local OCR outputs can be saved to file and reloaded to save preparation time. Bug fixing in logs and tabular data redaction. Update to documentation
f93e49c

seanpedrickcase commited on

Improved logging format a little. Now possible to save logs to DynamoDB
0042e78

seanpedrickcase commited on

Improved efficiency of review page navigation, especially for large documents. Updated user guide
93b4c8a

seanpedrickcase commited on

Now loads in 'convert_textract_outputs_to_ocr_results' button whether textract_api options enabled or not
a56b9b0

seanpedrickcase commited on

Added button to convert Textract API outputs to ocr_output files easily. Corrected Textract job file location
46bf91e

seanpedrickcase commited on

Added compatibility with gradio_image_annotation for passing through id and text properties to annotator. Corrected csv location for Textract api calls. Other minor changes
52c1a90

seanpedrickcase commited on

Minor function documentation changes. Requirements update for new Gradio and version of Gradio annotator that allows for saving preferred redaction format and to include box id
f6e6d80

seanpedrickcase commited on

Corrected RUN_AWS_FUNCTIONS environment variable reference when downloading cost codes
818efbc

seanpedrickcase commited on

Made changes to hopefully resolve issue with downloading cost centre details from S3 to container
1418017

seanpedrickcase commited on

Fixed issue where S3 cost codes are defined but not local cost code location
7b345c3

seanpedrickcase commited on

Fixed issue in Docker containers built locally without correct folder permissions. Improved config file. Updated Gradio version to fix issue with selecting filtered rows. Minor bug fixes.
a33b955

seanpedrickcase commited on

Implemented Textract document API calls and associated output tracking/download. Fixes to config and cost code implementation. General minor bug fixes.
ed5f8c7

seanpedrickcase commited on

Added workaround to issue with selectdata and dataframes for filtered dataframes. Rearranged some components.
4276db1

seanpedrickcase commited on

Fixed s3 load for allow list and cost codes
e4c7d3c

seanpedrickcase commited on

Major update. General code revision. Improved config variables. Dataframe based review frame now includes text, items can be searched and excluded. Costs now estimated. Option for adding cost codes added. Option to extract text only.
0ea8b9e

seanpedrickcase commited on

Fixed manual entry for allow, deny, and full page redaction lists
0e1a4a7

seanpedrickcase commited on

More config options. Fixed some bugs with removing elements from review page and Adobe export. Some UI rearrangements
6319afc

seanpedrickcase commited on

Added features to review dataframe to filter and exclude features based on text. Text should now appear consistently in review_df (for boxes not modified). Larger spacy model returned to use. Gradio upgrade.
66e145d

seanpedrickcase commited on

Now redact on whole PDF mediabox size (larger than viewable size sometimes), then converted back to cropbox size for print and Adobe review. Improved some error raising and app flow
08a3ec3

seanpedrickcase commited on

Fixed minor bug with bottom previous page button
c6b043a

seanpedrickcase commited on

Integrated AWS Comprehend and fuzzy matching functions with tabular data redaction.
ff290e1

seanpedrickcase commited on

Allowed for output files to be saved into user-specific folders. Added deny list capability to xlsx/csv file redaction
dacc782

seanpedrickcase commited on

Allowed for Textract and Comprehend API calls through AWS keys. File preparation function incorporated into main redaction function to avoid needing user to 'check in' during redaction process
391712c

seanpedrickcase commited on

changed back log files output box visibility to False
35a1591

seanpedrickcase commited on

Fixed issues with log file list picking up logs from other file runs. Updated packages.
42180e4

seanpedrickcase commited on

Added concurrency limit to run options. Trying again to load in zoom/rotate options from gradio_image_annotator fork.
dea568f

seanpedrickcase commited on

Laid groundwork for passing in AWS API keys. Duplicate pages option should now work for pages with no text.
7907ad4

seanpedrickcase commited on

Zoom and rotate features from forked gradio_annotation package. Fixed csv/xlsx redaction. Updated guide on creating exe.
20d940b

seanpedrickcase commited on

Updated documentation with an advanced user guide detailing new features.
fcbaca7

seanpedrickcase commited on

Fuzzy match implementation for deny list. Added option to merge multiple review files. Review files from redaction step should now include text.
bde6e5b

seanpedrickcase commited on

Added capabilities to export to and import from Adobe .xfdf files
6b28cfa

seanpedrickcase commited on

Added tab to be able to compare pages across multiple documents and redact duplicates
a265560

seanpedrickcase commited on

Ensured the text ocr outputs have no line breaks at end. Multi-line custom text searches now possible. Files for review sent from redact button. Fixed image redaction (not review yet). Can get user pool details from headers. Gradio update.
cb349ad

seanpedrickcase commited on

Corrected large image reduction code
3518b67

seanpedrickcase commited on

Dropdown choices for redactions are now listed correctly
3187788

seanpedrickcase commited on

Moved review components to give more space for page. Extended zoom limits. Existing redaction labels should now appear in new redaction box dropdown.
a9dcd2e

seanpedrickcase commited on

Corrected image resizing method for instances where the image is very large.
0c2987b

seanpedrickcase commited on

App should now resize images that are too large before sending to Textract. Textract now more robust to failure. Improved reliability of json conversion to review dataframe
143e2cc

seanpedrickcase commited on

You can now have output redaction boxes in grey according to an environment variable. Review files are now saved every time page is changed.
c3a8cd7

seanpedrickcase commited on

Greatly improved regex for direct matching with custom entities
6ac4be4

seanpedrickcase commited on

Uploaded pdfs with review files will now include all pages that don't have redactions. Slightly improved deny list matching.
613b1b4

seanpedrickcase commited on

Fixed bug where pages suggested for whole redaction are one lower than requested
e8681e8

seanpedrickcase commited on

Update app layout, user guide, and Gradio upgrade.
1b13393

seanpedrickcase commited on

Adapted text join options to review file to be more resilient to changes in image size. Added possibility of using client secret with AWS login
c9e23cb

seanpedrickcase commited on