280 Commits

Author	SHA1	Message	Date
Trenton H	cb271deb8f	Fixes the returning of a set, change to a list instead (#4442)	2023-10-25 16:18:13 -07:00
Trenton H	612e6341a3	Ensures all old connections are closed in certain longer running locations (#4265)	2023-09-25 12:52:22 -07:00
Trenton H	085e6da1f2	Handle when INotify fails to import but the polling is set to 0 still (#4230)	2023-09-20 14:04:42 -07:00
Trenton H	ec9ebd3026	Allow the user the specifiy the zip file name (#4189)	2023-09-15 16:33:28 -07:00
Trenton H	81b9f2d4e0	Cleans up the docs, adds validation of the process count, include the test descriptions	2023-09-12 08:17:12 -07:00
Trenton H	a03a745295	Adds multiprocessing to the fuzzy matching for a speedup	2023-09-12 08:17:12 -07:00
shamoon	ce8bf90663	Add progress bar to document_fuzzy_match	2023-09-12 08:17:12 -07:00
Trenton Holmes	e2ae919a84	Implements a new command for fuzzy matching document content and reporting potential duplicates	2023-09-12 08:17:12 -07:00
Trenton Holmes	650c816a7b	Removes support for Python 3.8 and lower from the code base	2023-09-10 11:42:59 -07:00
Trenton H	d532913d56	Unlocks all things which were locked due to ARMv7, etc	2023-09-08 11:21:43 -07:00
Kamil Kosek	b238ba054d	Enhancement: add --id-range for document_retagger (#4080) ... --------- Co-authored-by: Trenton H <797416+stumpylog@users.noreply.github.com>	2023-09-08 17:33:24 +00:00
Trenton H	9f5d47c320	Fixes issues with copy2 or copystat and SELinux see #3665	2023-07-22 06:27:49 -07:00
shamoon	bbd4659fbf	Include global and object-level permissions in export / import ... adds test for transaction	2023-06-23 23:33:36 -07:00
shamoon	243598ae50	Exclude consumer & AnonymousUser users from export manifest	2023-05-30 20:51:25 -07:00
Trenton Holmes	b7577038a0	Replace usages of os.rename with shutil.move to properly handle cases where the source and dest arent't on the same filesystem	2023-05-01 07:28:52 -07:00
Trenton H	6f163111ce	Upgrades black to v23, upgrades ruff	2023-04-26 09:35:27 -07:00
Trenton H	3bcbd05252	Fixes ruff not running isort against the codebase	2023-04-26 09:35:27 -07:00
Trenton H	a2d4d16867	Make the importer a little more robust against some types of errors	2023-04-26 07:08:50 -07:00
Trenton H	ce41ac9158	Configures ruff as the one stop linter and resolves warnings it raised	2023-04-01 17:03:52 -07:00
Trenton H	3c2bbf244d	Creates a data model for the document consumption, allowing stronger typing of arguments and setting of some information about the file only once	2023-04-01 11:05:34 -07:00
Trenton H	4a5f21dd87	Limit the number of threads waiting for files to be ready during polling	2023-03-21 07:46:57 -07:00
shamoon	bf8ae22f3f	Rename comments --> notes	2023-03-18 13:59:17 -07:00
Trenton H	c422a081bf	Be sure the scratch directory exists before using it as temporary directory	2023-03-01 07:13:31 -08:00
Trenton H	c08f0054da	Updates ignore path filtering so files in a folder in an ignored folder will be ignored correctly	2023-02-16 09:05:11 -08:00
Trenton H	06e2500443	Moves the mktime call into the if block where it is used, preventing exceptions during rare cases	2023-02-02 07:25:32 -08:00
Matthieu Helleboid	02a40055f5	replace --use-filename-prefix with --use-folder-prefix	2023-01-24 11:06:49 -08:00
Matthieu Helleboid	aeecc10e45	sort exporter option by alphabetical order	2023-01-24 11:06:49 -08:00
Matthieu Helleboid	2b3edbaa46	use pathlib glob	2023-01-24 11:06:49 -08:00
Matthieu Helleboid	270f8677a7	add document comments to dedicated manifest file when using 'split-manifest'	2023-01-24 11:06:49 -08:00
Matthieu Helleboid	20763e7c26	Fix split_manifest default value	2023-01-24 11:06:49 -08:00
Matthieu Helleboid	b33ba4c902	fix json serialization bug after migration after to Pathlib)	2023-01-24 11:06:49 -08:00
Matthieu Helleboid	fae5e834b9	fix bug on administration exporter when using -d, --delete option	2023-01-24 11:06:49 -08:00
Matthieu Helleboid	4cb4bd13ad	add split-manifest option to administration exporter	2023-01-24 11:06:49 -08:00
Matthieu Helleboid	896304ccaa	add prefix option to administration exporter	2023-01-24 11:06:49 -08:00
Matthieu Helleboid	9ae186e6f9	add no-archive and no-thumbnail options to administration exporter and importer	2023-01-24 11:06:49 -08:00
Trenton H	b25f083687	Updates the exporter to use pathlib and add a few more tests for coverage	2023-01-14 06:33:12 -08:00
Trenton Holmes	a6b7beaf6b	Adds option to allow a user to export directory to a zipfile	2022-12-04 16:38:25 -08:00
Michael Shamoon	91a2dedfec	Celery JSON serializable object for override_tag_ids	2022-11-07 07:41:23 -08:00
Trenton Holmes	9247300230	Transitions the backend to celery and celery beat	2022-09-26 11:25:34 -07:00
Michael Shamoon	15d074d39c	Include storage path in exporter + tests	2022-09-11 07:39:35 -07:00
Quinn Casey	44e596b0c4	Merge pull request #1451 from paperless-ngx/feature-better-redo-ocr ... Feature: Even better re-do of OCR	2022-08-25 17:01:54 -07:00
shamoon	2b1c8c8d9a	Merge pull request #1375 from tim-vogel/add_comments ... Feature: document comments	2022-08-25 11:48:31 -07:00
shamoon	bb951ad860	Merge pull request #1421 from paperless-ngx/feature-consumer-event-driven ... Feature: Event driven consumer	2022-08-25 08:16:47 -07:00
Michael Shamoon	0f4b118b61	Basic verification of Comment export & exporter comment tuple fix ... From oprhaned commits b1855a4b7a 53f21574fd Co-Authored-By: Trenton Holmes <797416+stumpylog@users.noreply.github.com>	2022-08-24 14:24:10 -07:00
Michael Shamoon	d5018af2a3	python code style	2022-08-23 19:20:08 -07:00
tim-vogel	817882ff6f	add comment function	2022-08-23 19:19:21 -07:00
Trenton Holmes	ab761e837c	Implements a better re-do of OCR by making the document archiver function common. Actually creates updated file now	2022-08-21 18:20:59 -07:00
Trenton Holmes	c8e838e3a0	Adds the storage paths to the re-tagger command	2022-08-21 18:01:19 -07:00
Trenton Holmes	ad1f5ae081	Corrects the timeout's interaction with files waiting to be consumed	2022-08-14 17:47:59 -07:00
Trenton Holmes	86358d5561	Attempts to make production consumer more event driven while still allowing unit testing	2022-08-14 17:47:59 -07:00