73 Commits

Author SHA1 Message Date
shamoon
e224aac200 Enhancement: always place search term first in autocomplete results (#6142) 2024-03-21 19:03:17 +00:00
Trenton H
c33c7ec2fa Fixes a corrupted index not being handled by whoosh.create_in (#5950) 2024-02-29 00:07:17 +00:00
Trenton H
1d3f525f92 Ensure all creations of directories create the parents too (#5711) 2024-02-10 11:02:40 -08:00
Trenton H
1d0c0aa57e Replaces deprecated Django with standard library (#5262) 2024-01-05 21:20:38 -08:00
shamoon
5e361b0e81 Enhancement: shared icon & shared by me filter (#4859) 2023-12-19 20:45:04 +00:00
Adam Bogdał
5f279eb945 Fix: Don't attempt to parse none objects during date searching 2023-12-14 07:39:49 -08:00
Trenton H
80c38908a1 Fix: Removes the FieldParser plugin from autocomplete searches (#4934) 2023-12-11 10:21:58 -08:00
Adam Bogdał
068bd5b288 Fix: Convert search dates to UTC in advanced search (#4891)
* Index documents using local timezone

* Add local date parser
2023-12-11 09:32:43 -08:00
shamoon
a792bf1ca1 Feature: Implement custom fields for documents (#4502)
Adds custom fields of certain data types, attachable to documents and searchable

Co-Authored-By: Trenton H <797416+stumpylog@users.noreply.github.com>
2023-11-05 17:27:23 -08:00
shamoon
3dac2d9b41 Update index.py 2023-06-04 10:41:45 -07:00
jayme-github
16a0a7c73a Feature: Allow to filter documents by original filename and checksum (#3485)
* Allow to filter documents by original filename and checksum

This adds filters for the original filename and checksum of documents to
be able to to lazy checks if the file is already stored in paperless.

* Add tests for DelayedQuery

* Add checksum and original_filename to whoosh index and DelayedQuery

* Refactored DelayedQuery to reduce duplicate code
* Choose icontains for checksums as whoosh has no exact match query term
* Bumped index version

* Revert whoosh filtering logic to simpler structure, remove redundant tests

Revert "Revert whoosh filtering logic to simpler structure, remove redundant tests"

This reverts commit 86792174bfbc697f42b72c4b39ee9eba483bb425.

---------

Co-authored-by: shamoon <4887959+shamoon@users.noreply.github.com>
2023-06-04 10:34:27 -07:00
shamoon
5a579ccf1c Merge pull request #3359 from paperless-ngx/feature-fix-autocomplete-respect-perms
Fix: respect permissions for autocomplete suggestions
2023-05-12 13:35:45 -07:00
shamoon
4a0d6c733d Respect permissions for autocomplete suggestions 2023-05-11 14:43:25 -07:00
shamoon
ae0ae3d8db Apply code suggestions
Co-Authored-By: Trenton H <797416+stumpylog@users.noreply.github.com>
2023-05-09 19:48:19 -07:00
shamoon
4d84a0a87b Re-work filter editor, bulk editor & reset buttons 2023-05-09 19:48:04 -07:00
shamoon
2a65235e66 Support owner API query vars 2023-05-08 15:34:14 -07:00
shamoon
31080cec5c Fix note sorting, testing, bump search index version 2023-05-04 02:07:48 -07:00
shamoon
6b5fc2cb15 fix __in filtering 2023-05-04 02:07:16 -07:00
shamoon
902ae3597e Respect superuser for advanced queries, test coverage for object perms 2023-04-27 15:51:34 -07:00
shamoon
789527caf1 Include multi object queries in whoosh searcher 2023-04-27 08:06:55 -07:00
Trenton H
aabcc9a1c4 Upgrades black to v23, upgrades ruff 2023-04-26 09:35:27 -07:00
Trenton H
30655f1b73 Fixes ruff not running isort against the codebase 2023-04-26 09:35:27 -07:00
Trenton H
d2c02b9102 Configures ruff as the one stop linter and resolves warnings it raised 2023-04-01 17:03:52 -07:00
shamoon
5108bbc192 Rename comments --> notes 2023-03-18 13:59:17 -07:00
shamoon
e6d6efa903 Merge branch 'dev' into feature-permissions 2023-02-03 14:23:50 -08:00
Trenton H
cdd213b0e6 Detect and reset invalid ASNs to 0 during indexing with a loud error to the user 2023-02-03 08:31:45 -08:00
Trenton H
d35eb8d7bc Fixes relative date Whoosh queries and adds testing to ensure it remains working with multiple timezones 2023-01-31 12:53:46 -08:00
Michael Shamoon
9812e38bc5 Merge branch 'dev' into feature-permissions 2023-01-24 14:10:45 -08:00
Michael Shamoon
624675f7c9 Use 32bit integer for asn, unsigned Whoosh NUMERIC field
Co-Authored-By: Trenton H <797416+stumpylog@users.noreply.github.com>
2023-01-24 10:13:05 -08:00
Michael Shamoon
edc92b9d92 Merge branch 'dev' into feature-permissions 2023-01-05 19:45:12 -08:00
Michael Shamoon
7d6dc5c954 Support comment search 2023-01-04 19:06:06 -08:00
Michael Shamoon
dbca9cf671 Merge branch 'dev' into feature-permissions 2022-12-29 20:12:42 -08:00
Michael Shamoon
c0c36aeae3 support tags__id__none for advanced search 2022-12-17 19:49:17 -08:00
Michael Shamoon
b28040952c Support owner and object permissions for advanced queries 2022-12-12 22:40:31 -08:00
Markus
dd3b5c129c Feature: Dynamic document storage pathes (#916)
* Added devcontainer

* Add feature storage pathes

* Exclude tests and add versioning

* Check escaping

* Check escaping

* Check quoting

* Echo

* Escape

* Escape :

* Double escape \

* Escaping

* Remove if

* Escape colon

* Missing \

* Esacpe :

* Escape all

* test

* Remove sed

* Fix exclude

* Remove SED command

* Add LD_LIBRARY_PATH

* Adjusted to v1.7

* Updated test-cases

* Remove devcontainer

* Removed internal build-file

* Run pre-commit

* Corrected flak8 error

* Adjusted to v1.7

* Updated test-cases

* Corrected flak8 error

* Adjusted to new plural translations

* Small adjustments due to code-review backend

* Adjusted line-break

* Removed PAPERLESS prefix from settings variables

* Corrected style change due to search+replace

* First documentation draft

* Revert changes to Pipfile

* Add sphinx-autobuild with keep-outdated

* Revert merge error that results in wrong storage path is evaluated

* Adjust styles of generated files ...

* Adds additional testing to cover dynamic storage path functionality

* Remove unnecessary condition

* Add hint to edit storage path dialog

* Correct spelling of pathes to paths

* Minor documentation tweaks

* Minor typo

* improving wrapping of filter editor buttons with new storage path button

* Update .gitignore

* Fix select border radius in non input-groups

* Better storage path edit hint

* Add note to edit storage path dialog re document_renamer

* Add note to bulk edit storage path re document_renamer

* Rename FILTER_STORAGE_DIRECTORY to PATH

* Fix broken filter rule parsing

* Show default storage if unspecified

* Remove note re storage path on bulk edit

* Add basic validation of filename variables

Co-authored-by: Markus Kling <markus@markus-kling.net>
Co-authored-by: Trenton Holmes <holmes.trenton@gmail.com>
Co-authored-by: Michael Shamoon <4887959+shamoon@users.noreply.github.com>
Co-authored-by: Quinn Casey <quinn@quinncasey.com>
2022-05-19 14:42:25 -07:00
Trenton Holmes
6635fa5f0d Runs the pre-commit hooks over all the Python files 2022-03-11 11:34:28 -08:00
kpj
c56cb25b5f Format Python code with black 2022-02-27 15:26:41 +01:00
jonaswinkler
4daab1809d only show score when sorting by score 2021-05-15 17:25:49 +02:00
jonaswinkler
4f62fc81c6 disable reverse sorting by score 2021-05-15 17:11:26 +02:00
jonaswinkler
7da4d39bb9 sorting for full text queries 2021-05-15 13:58:11 +02:00
jonaswinkler
1a376dbc41 fix some issues with the search index 2021-04-05 21:53:07 +02:00
jonaswinkler
f36b1c2b9d more testing 2021-04-04 01:19:07 +02:00
jonaswinkler
3d88f16e8f disable sorting for now 2021-04-03 21:49:31 +02:00
jonaswinkler
9c97c6902c fix date filtering for full text search 2021-04-03 21:02:13 +02:00
jonaswinkler
5b49524d51 lots of changes for the new unified search 2021-03-17 22:25:22 +01:00
jonaswinkler
4698c6ade1 some initial attempts to merge search and document list 2021-03-07 13:16:23 +01:00
jonaswinkler
d1f206b4cd some search index optimizations 2021-02-15 13:26:36 +01:00
jonaswinkler
555e37958f better exception logging 2021-02-11 22:16:41 +01:00
jonaswinkler
e5a7dc0cc7 rework most of the logging 2021-02-05 01:10:29 +01:00
jonaswinkler
03f8db481e update index after bulk edit operations #195 2020-12-27 17:05:35 +01:00