83 Commits

Author	SHA1	Message	Date
Trenton H	3bcbd05252	Fixes ruff not running isort against the codebase	2023-04-26 09:35:27 -07:00
Trenton H	ce41ac9158	Configures ruff as the one stop linter and resolves warnings it raised	2023-04-01 17:03:52 -07:00
Trenton H	3c2bbf244d	Creates a data model for the document consumption, allowing stronger typing of arguments and setting of some information about the file only once	2023-04-01 11:05:34 -07:00
Trenton H	4a5f21dd87	Limit the number of threads waiting for files to be ready during polling	2023-03-21 07:46:57 -07:00
Trenton H	c08f0054da	Updates ignore path filtering so files in a folder in an ignored folder will be ignored correctly	2023-02-16 09:05:11 -08:00
Trenton H	b25f083687	Updates the exporter to use pathlib and add a few more tests for coverage	2023-01-14 06:33:12 -08:00
Michael Shamoon	91a2dedfec	Celery JSON serializable object for override_tag_ids	2022-11-07 07:41:23 -08:00
Trenton Holmes	9247300230	Transitions the backend to celery and celery beat	2022-09-26 11:25:34 -07:00
Trenton Holmes	ad1f5ae081	Corrects the timeout's interaction with files waiting to be consumed	2022-08-14 17:47:59 -07:00
Trenton Holmes	86358d5561	Attempts to make production consumer more event driven while still allowing unit testing	2022-08-14 17:47:59 -07:00
Trenton Holmes	3aca576a0d	Includes the actual OSError string in the log, instead of assuming it's a busy file	2022-07-11 11:57:02 -07:00
Trenton Holmes	f07cfd4f51	Adds configuration variable to the inotify debounce timing	2022-05-15 11:48:12 -07:00
Trenton Holmes	7cbb73be7a	Minor improvements for quality of life	2022-05-09 12:05:29 -07:00
Trenton Holmes	2414dad656	Adds additional checking for both inotify and polling around document still being busy before consuming it	2022-04-10 12:21:34 -07:00
Trenton Holmes	1771d18a21	Runs the pre-commit hooks over all the Python files	2022-03-11 11:34:28 -08:00
kpj	fc695896dd	Format Python code with black	2022-02-27 15:26:41 +01:00
Daniel Albers	3ebe6d5aef	Make ignores configurable ... Adds config file setting PAPERLESS_CONSUMER_IGNORE_PATTERNS.	2021-08-18 22:23:18 +02:00
jonaswinkler	f8afbae2cd	ignore macOS specific files	2021-05-19 19:56:01 +02:00
jonaswinkler	bac4a63cc8	run the polling file change checks on individual threads to speed up queueing of new files	2021-02-21 12:43:55 +01:00
jonaswinkler	0453787d38	increased default delay when waiting for file changes with polling	2021-02-21 12:14:54 +01:00
jonaswinkler	ed0b1fe115	better exception logging	2021-02-11 22:16:41 +01:00
jonaswinkler	431d4fd8e4	rework most of the logging	2021-02-05 01:10:29 +01:00
jonaswinkler	bdc247ce49	code style	2021-02-02 23:58:25 +01:00
jonaswinkler	227f7b6946	revert a change	2021-01-21 22:29:47 +01:00
jonaswinkler	08046cb83f	revert changes for #351	2021-01-20 11:56:09 +01:00
jonaswinkler	5355f2b027	fixes #351	2021-01-19 14:43:55 +01:00
jonaswinkler	81dee38e4a	fixes #300	2021-01-09 01:54:51 +01:00
jonaswinkler	0a0d462938	tags from folders: case insensitive	2020-12-09 00:07:22 +01:00
jonaswinkler	74a99cf330	removed slugs entirely, since their only purpose was purely cosmetic anyway.	2020-12-09 00:04:37 +01:00
jonaswinkler	834352130c	checking file types against parsers in the consumer.	2020-12-01 15:26:05 +01:00
jayme-github	fa9a5cc247	Create tags from sub directories ... The names of sub directories in the consumer directory will be added as tags for the document to be consumed. To enable this, set: PAPERLESS_CONSUMER_RECURSIVE=1 PAPERLESS_CONSUMER_SUBDIRS_AS_TAGS=1 Fixes #50	2020-11-30 14:22:35 +01:00
jonaswinkler	60ac1ddbb9	fix warnings about unclosed files.	2020-11-27 13:19:58 +01:00
jonaswinkler	20c1139632	inotify: cleanup descriptor when done	2020-11-27 13:12:34 +01:00
jonaswinkler	d04b54140c	moved consumption dir check into the correct spot	2020-11-27 13:12:13 +01:00
jonaswinkler	d5ec762954	couple changes to the consumer.	2020-11-26 18:55:05 +01:00
jonaswinkler	75390693b9	Apparently there was a very good reason to use inotify. fixes #46 complete with test cases for inotify and polling.	2020-11-26 17:57:03 +01:00
Jonas Winkler	d8e27600be	workaround for a bug in django-q: task results with too long names would not show up in the result lists.	2020-11-22 13:53:19 +01:00
Jonas Winkler	b44f8383e4	code cleanup	2020-11-21 14:03:45 +01:00
Jonas Winkler	2e97672b30	removed unused code.	2020-11-18 00:54:51 +01:00
Jonas Winkler	fef6dd38f9	Merge branch 'dev' into mail_rework	2020-11-17 00:23:10 +01:00
Jonas Winkler	70d8e8bc56	added more testing	2020-11-16 23:16:37 +01:00
Jonas Winkler	31c4167535	added option for polling	2020-11-16 18:52:13 +01:00
Jonas Winkler	8dca459573	first version of the new consumer.	2020-11-16 18:26:54 +01:00
Jonas Winkler	0b1637da62	first implementation of the mail rework	2020-11-15 23:56:22 +01:00
Jonas Winkler	2e04ba1c04	code style fixes	2020-11-12 21:09:45 +01:00
Jonas Winkler	09651e0011	on_modified not needed for the consumer.	2020-11-12 10:41:47 +01:00
Jonas Winkler	917ee62f81	fixes #30	2020-11-12 09:30:04 +01:00
Jonas Winkler	9f29dc2863	updated consumer: now using watchdog	2020-11-01 23:07:54 +01:00
Jonas Winkler	c596fe6782	unified data folders	2020-10-26 00:35:24 +01:00
Johann Bauer	22c7f309a7	Warn if consume directory contains subdirectories ... .	2020-01-04 01:09:54 +01:00