Trenton Holmes
ddef90d96e
Adds specific handling for CCITT Group 4, which pikepdf decodes, but not correctly
2022-10-11 13:51:14 -07:00
Trenton H
c888b3dfd3
In case pikepdf fails to convert an image to a PIL image, fall back to converting pages to PIL images
2022-10-11 13:51:13 -07:00
Trenton H
0c08b16402
Catch the new error raised by redis when it can't find the broker and stub out the call for testing
2022-10-10 14:21:42 -07:00
Trenton H
4994df2e3c
Fixes usage of a depracated logger method
2022-10-10 14:20:19 -07:00
Trenton H
e88d911984
Account for plusses in the OCR language setting
2022-10-10 08:58:23 -07:00
Trenton H
2d71415ede
Allows disabling NLTK, adds it as a consideration for low power devices
2022-10-10 08:58:23 -07:00
Trenton Holmes
a78d44ec5f
Changes the NLTK language to be based on the Tesseract OCR language, with fallback to the default processing
2022-10-10 08:58:23 -07:00
Trenton H
0bc13c2a72
Allows configuration of the NLTK processing language
2022-10-10 08:58:23 -07:00
Trenton Holmes
70b1988a55
Fixes the download and usage of the downloaded data
2022-10-10 08:58:23 -07:00
Trenton Holmes
3c12f13df2
Missed one mock
2022-10-10 08:58:23 -07:00
Trenton Holmes
d334eec321
Mock out the nltk portions so the data doesn't need to be downloaded
2022-10-10 08:58:23 -07:00
Trenton Holmes
66884ea035
Updates the pre-processing of document content to be much more robust, with tokenization, stemming and stop word removal
2022-10-10 08:58:23 -07:00
shamoon
3b1f5668f5
Merge pull request #1648 from paperless-ngx/feature-use-celery
...
Feature: Transition to celery for background tasks
2022-10-10 00:07:55 -07:00
Trenton Holmes
397179ebe9
Fixes is_relative_to not being availible for 3.8
2022-10-09 17:43:58 -07:00
Trenton Holmes
3b5a7fbd65
If the original file containing a barcode was in the temporary scratch dir, move the split files to consume dir
2022-10-09 17:43:58 -07:00
Trenton H
406dae1fca
Enable some testing against a real email server to hopefully catch things earlier
2022-10-07 18:28:11 -07:00
Trenton H
6c269391d5
Fixes handling of gmail label extension to IMAP
2022-10-07 18:28:11 -07:00
Trenton Holmes
d13ca98223
Enables some basic live testing against a tika server with actual sample documents to catch some more errors mocking won't catch
2022-10-07 18:06:06 -07:00
shamoon
962d0bc57b
Merge pull request #1692 from paperless-ngx/feature-frontend-update-checking
...
Feature: frontend update checking settings
2022-10-05 13:46:32 -07:00
Michael Shamoon
f587e36744
Use text mime type for csv files for browser preview
...
Co-Authored-By: Trenton H <797416+stumpylog@users.noreply.github.com>
Co-Authored-By: bin101 <12427722+bin101@users.noreply.github.com>
2022-10-04 13:01:06 -07:00
Trenton H
8111723130
Fixes migration error if some tasks are defined already
2022-10-04 07:56:40 -07:00
shamoon
60a67fd279
Merge branch 'dev' into feature-use-celery
2022-10-03 18:00:54 -07:00
Trenton H
5ad0d7303d
Fixes up some issues with the migrations and type mismatches
2022-10-03 13:18:25 -07:00
Jens van Almsick
d89443b31d
fix: csv recognition by consumer
...
paperless-ngx detects the file format via the mime-type based on the response of python-magic which rely on the response of the file command.
In version 5.39 (which is shipped with debian bullseye and I think many more non-rolling distributions) of the file command a *.csv will be detected as "application/csv" instead of "text/csv" as in newer versions.
2022-10-02 16:09:07 -07:00
Michael Shamoon
5c39f058ad
add id to document duplicate error message
2022-10-02 10:27:45 -07:00
Trenton Holmes
a19fbf919d
When a document is a duplicate, include the title of the existing document in the fail message
2022-10-02 10:27:45 -07:00
Michael Shamoon
4dac5fa02d
Fix python + frontend tests
2022-09-30 18:32:21 -07:00
Michael Shamoon
f0cd10e960
Better migration of update checking settings, offer reload, strip backend_setting from db
2022-09-30 14:03:59 -07:00
Michael Shamoon
4eaeac3610
Frontend update checking settings
2022-09-30 12:30:23 -07:00
Trenton H
16980e0c1d
Changes MariaDB encoding to use utf8mb4
2022-09-29 13:53:44 -07:00
Trenton H
4621c1a83a
Fix logger location tag
...
Co-authored-by: shamoon <4887959+shamoon@users.noreply.github.com>
2022-09-28 11:02:34 -07:00
Trenton H
62872bce9d
Updates how task_args and task_kwargs are parsed, adds testing to cover everything I can think of
2022-09-28 10:40:55 -07:00
Michael Shamoon
aa7b2690cb
Add related_document and direct link from task UI
2022-09-27 20:50:26 -07:00
Michael Shamoon
8c6d67bddf
Filter out old migrated tasks
2022-09-27 19:41:23 -07:00
Michael Shamoon
e60a1e55f4
Add document name & error result parsing to PaperlessTask serializer
2022-09-27 19:40:24 -07:00
Trenton H
a96ac56c2b
Ensures all existing one to one fields are nulled before altering the field
2022-09-27 14:17:42 -07:00
Trenton H
fe697f009c
Fixes migration order back to the right way
2022-09-27 13:55:31 -07:00
Trenton H
e8d237ac7c
Finalizes what the PaperlessTask will look like to the frontend
2022-09-27 12:44:01 -07:00
Michael Shamoon
0bc4c947cf
Merge pull request #1666 from paperless-ngx/fix/1664
2022-09-27 09:34:34 -07:00
Michael Shamoon
b894f4ad1c
Allow PAPERLESS_OCR_CLEAN=none
2022-09-27 08:48:04 -07:00
Trenton H
71c558eba7
Bumps version numbers to 1.9.2
2022-09-27 08:06:35 -07:00
Trenton Holmes
09287701ae
Transitions the backend to celery and celery beat
2022-09-26 11:25:34 -07:00
Trenton H
4032b5afe6
Fixes a missing option for OCR mode and incorrect clean mode
2022-09-26 11:05:19 -07:00
Michael Shamoon
36c21abd62
v1.9.0
2022-09-26 07:54:10 -07:00
Paperless-ngx Translation Bot [bot]
8571edab6a
New Crowdin updates ( #1607 )
...
* bugfix: increase delay
partially reverts 86358d556162e4c6112238821937f7856749f157
re-implements 4fbabe43ea12811864e9676b04d82a82b38e799d
Signed-off-by: Florian Brandes <florian.brandes@posteo.de>
* New translations messages.xlf (Finnish) [ci skip]
Signed-off-by: Florian Brandes <florian.brandes@posteo.de>
Co-authored-by: Florian Brandes <florian.brandes@posteo.de>
2022-09-16 15:45:17 -07:00
Trenton H
13465fcfda
Fixes grammar in comment
...
Co-authored-by: Florian <florian.brandes@posteo.de>
2022-09-16 09:08:16 -07:00
Trenton Holmes
b21f64de8a
Updates how barcodes are detected, using pikepdf images, instead of converting each page to an image
2022-09-16 09:08:16 -07:00
Trenton H
61bb45124a
Fixes an issue where the consume directory wasn't included in the permissions fix at Docker entry
2022-09-16 07:52:33 -07:00
Trenton H
d69617727f
Merge pull request #1596 from paperless-ngx/fix/1590-barcodes
...
Fix: Double barcode separation creates empty file
2022-09-15 14:18:01 -07:00
Trenton Holmes
33a4a273a3
Fixes the seperation of files by barcode, during the case where 2 barcodes appear back to back
2022-09-14 14:00:37 -07:00