1169 Commits

Author SHA1 Message Date
Erik Arvstedt
cc22204e5a Simplify ignoring docs 2018-05-11 14:05:29 +02:00
Erik Arvstedt
f56ec70aad Ensure docs have been unmodified for some time before consuming
Previously, the second mtime check for new files usually happened right
after the first one, which could have caused consumption of docs that
were still being modified.

We're now waiting for at least FILES_MIN_UNMODIFIED_DURATION (0.5s).

This also cleans up the logic by eliminating the consumer.stats attribute
and the weird double call to consumer.run().

Additionally, this a fixes memory leak in consumer.stats where paths could be
added but never removed if the corresponding files disappeared from
the consumer dir before being considered ready.
2018-05-11 14:05:29 +02:00
Erik Arvstedt
0db6ed225b Refactor: extract fn try_consume_file
The main purpose of this change is to make the following commits more
readable.
2018-05-11 14:05:28 +02:00
Erik Arvstedt
312a6a91b5 Use os.scandir instead of os.listdir
It's simpler and better suited for use cases introduced in later commits.
2018-05-11 14:05:25 +02:00
Erik Arvstedt
2c64e70754 Consume documents in order of increasing mtime
This increases overall usability, especially for multi-page scans.
Previously, the consumption order was undefined (see os.listdir())
2018-05-11 14:04:37 +02:00
Erik Arvstedt
9320230100 Refactor: extract fn 'make_dirs' 2018-05-11 14:04:36 +02:00
Erik Arvstedt
8ebe52a7db Fix list out of bounds error in mail message parsing
Check list length before accessing the first two elements of
'dispositions'.
The list may have only a single element ('inline') or may be empty in
mailformed emails.
2018-05-11 14:04:36 +02:00
Erik Arvstedt
260ce7d75c Set default empty PAPERLESS_EMAIL_SECRET
Previously, if the user didn't set PAPERLESS_EMAIL_SECRET, Paperless
failed with an error in check_body() because self.SECRET was None.
2018-05-11 14:04:31 +02:00
Erik Arvstedt
d5e56095ac Mail fetching: Only catch internal errors
Previously, all errors raised during mail fetching were silently caught
and printed without backtrace.

To increase robustness and ease debugging, we now fail with a backtrace
on unexpected errors.
2018-05-11 14:01:09 +02:00
Erik Arvstedt
8033f97ec3 Increase link area in documents listing
Increase the link area to include the whole visual header.

Fixes #335
2018-05-11 13:50:09 +02:00
Daniel Quinn
1522af2ea5 Clean up test formatting a bit 2018-04-22 16:28:21 +01:00
Daniel Quinn
b7d321286f Remove old Python style 2018-04-22 16:28:03 +01:00
Daniel Quinn
fe5d55d2d1 Don't explode on invalid dates 2018-04-22 16:27:43 +01:00
CkuT
0c28a5329c Fix LogEntry user when PAPERLESS_DISABLE_LOGIN is set to true 2018-04-17 21:03:18 +02:00
Daniel Quinn
85fa861ce7 Remove the hard-coding of the thumbnail URL 2018-04-13 20:18:16 +01:00
Erik Arvstedt
363b8ff9aa Fix runtime warning when adding log entries
LogEntry.action_time expects a Django timezone object instead of a builtin datetime.

This fixes a runtime warning of the following kind:
RuntimeWarning: DateTimeField LogEntry.action_time received a naive datetime (2018-03-28 20:53:01.714173) while time zone support is active.
2018-03-30 00:15:52 +02:00
Daniel Quinn
fd85f49397 Merge pull request #326 from CkuT/new_document_list
New imported documents list
2018-03-19 12:50:18 +00:00
Daniel Quinn
748128c8c3 Remove last remnants of PAPERLESS_SHARED_SECRET 2018-03-18 14:08:41 +00:00
Daniel Quinn
245027767d Remove superfluous import 2018-03-18 14:08:29 +00:00
CkuT
9bf3454cbf Add test case 2018-03-13 19:27:59 +01:00
CkuT
53214b7993 Use datetime.now() instead of document.created for LogEntry action_time 2018-03-13 19:09:48 +01:00
CkuT
feab3e5dfc Add LogEntry after document consumption
See #319
2018-03-11 17:09:43 +01:00
Daniel Quinn
19209ba5af Run a --oneshot loop twice
This was necessary since the first loop only ever collects file
statistics so that the second run can be sure about "readiness".
2018-03-03 18:43:20 +00:00
Daniel Quinn
13452ba33b Clean up docstring to be properly rst 2018-03-03 18:43:20 +00:00
Ovv
340855cd87 Help & documentation 2018-03-03 18:43:20 +00:00
Ovv
2262a6ec28 use tmp dir 2018-03-03 18:43:20 +00:00
Ovv
b10c2c770c style & test 2018-03-03 18:43:20 +00:00
Ovv
d89dbbe537 Configuration cli argument for document_consumer 2018-03-03 18:43:20 +00:00
Daniel Quinn
3570896620 Add another db_index hack for MySQL 2018-02-20 11:17:11 +00:00
Daniel Quinn
4f726e1991 Monitor return codes of calls to convert and unpaper
...and handle the failures nicely.  Addresses #303.
2018-02-18 16:02:27 +00:00
Daniel Quinn
caf44146db Style and removal of Python 2.7 stuff 2018-02-18 15:55:55 +00:00
Daniel Quinn
345bc97c8c Updated for style and to add a --use-first option 2018-02-08 20:03:29 +00:00
Dashie
3df9ea3b26 Fix line length 2018-02-08 19:34:48 +00:00
Dashie
73a9a23860 Add manager command to re-tag documents without correspondent 2018-02-08 19:34:48 +00:00
Daniel Quinn
e89d1a428e Remove superfluous code 2018-02-04 13:27:26 +00:00
Daniel Quinn
5cc10a282b Use paperless- instead of paperless for tempdir name
This is purely aesthetic.
2018-02-03 14:49:17 +00:00
Daniel Quinn
648e7b6d4f No need to explicitly extend object 2018-02-03 14:49:01 +00:00
Daniel Quinn
910a08f8c9 Fix DeprecationWarning as-per ishirav's advice 2018-02-03 14:48:14 +00:00
Wolf-Bastian Pöttner
21fc51c09a Add support for a heuristic that extracts the document date from its text 2018-01-28 19:37:10 +01:00
Daniel Quinn
24ddc681cd Merge pull request #256 from ddddavidmartin/add_financial_year_filter
Add financial year documents filter
2018-01-21 18:23:45 +01:00
pzl
7a01005989 small typo in exporter thumbnail filename 2018-01-19 14:28:46 -05:00
Daniel Quinn
d70d38aef6 Change date fields to actual date fields #278 2018-01-06 19:21:49 +00:00
Daniel Quinn
b30b112b8b Add a smarter work-around for the change-list-results hack 2018-01-06 18:47:01 +00:00
Daniel Quinn
17bdfa0f49 Add a note for future development 2018-01-06 18:30:33 +00:00
Daniel Quinn
0d9d7460c6 Fix tests to run on boxes with post-consume-scripts set 2018-01-06 17:23:24 +00:00
Daniel Quinn
964b8ddb82 Add encoding declaration 2018-01-06 17:23:07 +00:00
Daniel Quinn
17d46d83db Use double quotes by default 2018-01-06 17:22:57 +00:00
Daniel Quinn
36359a7334 Clean up CSS for #272 2018-01-06 15:57:25 +00:00
ishirav
a3492fdc87 break long lines (pep8) 2017-12-23 07:39:40 +02:00
ishirav
9af7a00f82 break long lines (pep8) 2017-12-23 06:59:48 +02:00