shamoon
014eafe3d1
Incremental llm index update, add scheduled llm index task
2025-05-19 14:31:35 -07:00
shamoon
422efb2235
Fix ollama, fix RAG
...
[ci skip]
2025-05-19 14:31:27 -07:00
shamoon
58f3b7be0a
llamaindex vector index, llmindex mangement command
2025-05-19 14:31:27 -07:00
shamoon
0b079f57ed
Partially Revert "Chore(deps): Bump the small-changes group across 1 directory with 6 updates ( #9921 )"
...
This partially reverts commit 1fe166e014ebde9a6fb6861819efa7e705175cd6.
2025-05-19 12:20:05 -07:00
dependabot[bot]
1fe166e014
Chore(deps): Bump the small-changes group across 1 directory with 6 updates ( #9921 )
...
* Chore(deps): Bump the small-changes group across 1 directory with 6 updates
Bumps the small-changes group with 6 updates in the / directory:
| Package | From | To |
| --- | --- | --- |
| [concurrent-log-handler](https://github.com/Preston-Landers/concurrent-log-handler ) | `0.9.25` | `0.9.26` |
| [django](https://github.com/django/django ) | `5.1.8` | `5.2.1` |
| [django-auditlog](https://github.com/jazzband/django-auditlog ) | `3.0.0` | `3.1.2` |
| [drf-spectacular-sidecar](https://github.com/tfranzel/drf-spectacular-sidecar ) | `2025.4.1` | `2025.5.1` |
| [ocrmypdf](https://github.com/ocrmypdf/OCRmyPDF ) | `16.10.0` | `16.10.1` |
| [setproctitle](https://github.com/dvarrazzo/py-setproctitle ) | `1.3.5` | `1.3.6` |
Updates `concurrent-log-handler` from 0.9.25 to 0.9.26
- [Release notes](https://github.com/Preston-Landers/concurrent-log-handler/releases )
- [Changelog](https://github.com/Preston-Landers/concurrent-log-handler/blob/master/CHANGELOG.md )
- [Commits](https://github.com/Preston-Landers/concurrent-log-handler/compare/0.9.25...0.9.26 )
Updates `django` from 5.1.8 to 5.2.1
- [Commits](https://github.com/django/django/compare/5.1.8...5.2.1 )
Updates `django-auditlog` from 3.0.0 to 3.1.2
- [Release notes](https://github.com/jazzband/django-auditlog/releases )
- [Changelog](https://github.com/jazzband/django-auditlog/blob/master/CHANGELOG.md )
- [Commits](https://github.com/jazzband/django-auditlog/compare/v3.0.0...v3.1.2 )
Updates `drf-spectacular-sidecar` from 2025.4.1 to 2025.5.1
- [Commits](https://github.com/tfranzel/drf-spectacular-sidecar/compare/2025.4.1...2025.5.1 )
Updates `ocrmypdf` from 16.10.0 to 16.10.1
- [Release notes](https://github.com/ocrmypdf/OCRmyPDF/releases )
- [Changelog](https://github.com/ocrmypdf/OCRmyPDF/blob/main/docs/release_notes.md )
- [Commits](https://github.com/ocrmypdf/OCRmyPDF/compare/v16.10.0...v16.10.1 )
Updates `setproctitle` from 1.3.5 to 1.3.6
- [Changelog](https://github.com/dvarrazzo/py-setproctitle/blob/master/HISTORY.rst )
- [Commits](https://github.com/dvarrazzo/py-setproctitle/compare/version-1.3.5...version-1.3.6 )
---
updated-dependencies:
- dependency-name: concurrent-log-handler
dependency-version: 0.9.26
dependency-type: direct:production
update-type: version-update:semver-patch
dependency-group: small-changes
- dependency-name: django
dependency-version: 5.2.1
dependency-type: direct:production
update-type: version-update:semver-minor
dependency-group: small-changes
- dependency-name: django-auditlog
dependency-version: 3.1.2
dependency-type: direct:production
update-type: version-update:semver-minor
dependency-group: small-changes
- dependency-name: drf-spectacular-sidecar
dependency-version: 2025.5.1
dependency-type: direct:production
update-type: version-update:semver-minor
dependency-group: small-changes
- dependency-name: ocrmypdf
dependency-version: 16.10.1
dependency-type: direct:production
update-type: version-update:semver-patch
dependency-group: small-changes
- dependency-name: setproctitle
dependency-version: 1.3.6
dependency-type: direct:production
update-type: version-update:semver-patch
dependency-group: small-changes
...
Signed-off-by: dependabot[bot] <support@github.com>
* Fix log matches related to newlines, add newlines to stdout.writelines
* Fix disable api remote auth test, Django 5.2 no longer uses process_request
---------
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: shamoon <4887959+shamoon@users.noreply.github.com>
2025-05-19 11:03:02 -07:00
Trenton H
f4413e0a08
Fix: Always clean up INotify ( #9359 )
2025-03-11 10:01:00 -07:00
shamoon
2d52226732
Enhancement: system status report sanity check, simpler classifier check, styling updates ( #9106 )
2025-02-26 22:12:20 +00:00
Sebastian Steinbeißer
e560fa3be0
Chore: Enable ruff FBT ( #8645 )
2025-02-07 09:12:03 -08:00
dependabot[bot]
20ec8cb57b
Chore(deps-dev): Bump the development group with 2 updates ( #8841 )
...
* Chore(deps-dev): Bump the development group with 2 updates
Bumps the development group with 2 updates: [ruff](https://github.com/astral-sh/ruff ) and [mkdocs-material](https://github.com/squidfunk/mkdocs-material ).
Updates `ruff` from 0.8.6 to 0.9.2
- [Release notes](https://github.com/astral-sh/ruff/releases )
- [Changelog](https://github.com/astral-sh/ruff/blob/main/CHANGELOG.md )
- [Commits](https://github.com/astral-sh/ruff/compare/0.8.6...0.9.2 )
Updates `mkdocs-material` from 9.5.49 to 9.5.50
- [Release notes](https://github.com/squidfunk/mkdocs-material/releases )
- [Changelog](https://github.com/squidfunk/mkdocs-material/blob/master/CHANGELOG )
- [Commits](https://github.com/squidfunk/mkdocs-material/compare/9.5.49...9.5.50 )
---
updated-dependencies:
- dependency-name: ruff
dependency-type: direct:development
update-type: version-update:semver-minor
dependency-group: development
- dependency-name: mkdocs-material
dependency-type: direct:development
update-type: version-update:semver-patch
dependency-group: development
...
Signed-off-by: dependabot[bot] <support@github.com>
* Update .pre-commit-config.yaml
* Run new ruff format
---------
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: shamoon <4887959+shamoon@users.noreply.github.com>
2025-01-21 19:22:25 +00:00
Trenton H
6804c92861
Fix: Include email and webhook objects in the export ( #8790 )
2025-01-17 13:00:59 -08:00
Sebastian Steinbeißer
935d077836
Chore: Switch from os.path to pathlib.Path ( #8325 )
...
---------
Co-authored-by: shamoon <4887959+shamoon@users.noreply.github.com>
2025-01-06 12:12:27 -08:00
shamoon
7d182ab894
Enhancement: prune audit logs and management command ( #8416 )
2024-12-03 19:28:27 +00:00
shamoon
0fc1860d4c
Enhancement: use stable unique IDs for custom field select options ( #8299 )
2024-12-02 04:15:38 +00:00
dependabot[bot]
00485138f9
Chore(deps-dev): Bump the development group with 4 updates ( #8352 )
...
Bumps the development group with 4 updates: [ruff](https://github.com/astral-sh/ruff ), [pytest-httpx](https://github.com/Colin-b/pytest_httpx ), [pytest-rerunfailures](https://github.com/pytest-dev/pytest-rerunfailures ) and [mkdocs-material](https://github.com/squidfunk/mkdocs-material ).
Updates `ruff` from 0.7.3 to 0.8.0
- [Release notes](https://github.com/astral-sh/ruff/releases )
- [Changelog](https://github.com/astral-sh/ruff/blob/main/CHANGELOG.md )
- [Commits](https://github.com/astral-sh/ruff/compare/0.7.3...0.8.0 )
Updates `pytest-httpx` from 0.33.0 to 0.34.0
- [Release notes](https://github.com/Colin-b/pytest_httpx/releases )
- [Changelog](https://github.com/Colin-b/pytest_httpx/blob/develop/CHANGELOG.md )
- [Commits](https://github.com/Colin-b/pytest_httpx/compare/v0.33.0...v0.34.0 )
Updates `pytest-rerunfailures` from 14.0 to 15.0
- [Changelog](https://github.com/pytest-dev/pytest-rerunfailures/blob/master/CHANGES.rst )
- [Commits](https://github.com/pytest-dev/pytest-rerunfailures/compare/14.0...15.0 )
Updates `mkdocs-material` from 9.5.44 to 9.5.46
- [Release notes](https://github.com/squidfunk/mkdocs-material/releases )
- [Changelog](https://github.com/squidfunk/mkdocs-material/blob/master/CHANGELOG )
- [Commits](https://github.com/squidfunk/mkdocs-material/compare/9.5.44...9.5.46 )
---
updated-dependencies:
- dependency-name: ruff
dependency-type: direct:development
update-type: version-update:semver-minor
dependency-group: development
- dependency-name: pytest-httpx
dependency-type: direct:development
update-type: version-update:semver-minor
dependency-group: development
- dependency-name: pytest-rerunfailures
dependency-type: direct:development
update-type: version-update:semver-major
dependency-group: development
- dependency-name: mkdocs-material
dependency-type: direct:development
update-type: version-update:semver-patch
dependency-group: development
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-12-01 18:56:54 -08:00
shamoon
9c1561adfb
Change: change update content to handle archive disabled ( #8315 )
2024-11-20 20:01:13 +00:00
Kevin Doren
827121808a
Enhancement: Add --compare-json option to document_exporter to write json files only if changed ( #8261 )
2024-11-19 07:20:24 -08:00
shamoon
e94a92ed59
Feature: two-factor authentication ( #8012 )
2024-11-18 18:34:46 +00:00
shamoon
aac04e73b9
Fix: correct serializing of auth tokens for export ( #8100 )
2024-10-29 17:02:32 +00:00
shamoon
28fdb170bf
Fix: handle uuid fields created under mariadb and Django 4 ( #8034 )
2024-10-28 13:54:16 +00:00
shamoon
0d96cd03d5
Fix: disable custom field signals during import in 2.13.0 ( #8065 )
2024-10-27 18:43:24 -07:00
shamoon
7649903d3c
Enhancement / fix: include social accounts and api tokens in export ( #8016 )
2024-10-26 06:51:22 -07:00
Trenton H
e6f59472e4
Chore: Drop Python 3.9 support ( #7774 )
2024-09-26 12:22:24 -07:00
Trenton H
91585a1fa6
Prefer the metadata JSON file over the version JSON file ( #7048 )
2024-06-20 12:49:54 -07:00
Trenton H
d9002005b1
Feature: Allow encrypting sensitive fields in export ( #6927 )
...
Co-authored-by: shamoon <4887959+shamoon@users.noreply.github.com>
2024-06-09 14:41:18 +00:00
Trenton H
085447e7c4
Feature: Allow a data only export/import cycle ( #6871 )
2024-06-01 18:22:59 -07:00
Trenton H
622f624132
Chore: Change the code formatter to Ruff ( #6756 )
...
* Changing the formatting to ruff-format
* Replaces references to black to ruff or ruff format, removes black from dependencies
2024-05-18 02:26:50 +00:00
Trenton H
d4d0604da2
Moves additional auditlog imports into protected blocks ( #6638 )
2024-05-08 09:04:32 -07:00
shamoon
0f8b2e69c9
Change: enable auditlog by default, fix import / export ( #6267 )
2024-04-04 18:51:15 +00:00
shamoon
d4963b9cbe
Fix: document_renamer fails with audit_log enabled ( #6175 )
2024-03-24 07:26:25 -07:00
grembo
76064178f5
Fix: inotify read timeout not in ms ( #5876 )
...
* Fix inotify read timeout
This was off by a factor of 1000, leading to a lot more invocations
of the loop body than necessary.
* Incorporate review feedback
2024-02-26 00:46:47 +00:00
Trenton H
13201dbfff
Ensure all creations of directories create the parents too ( #5711 )
2024-02-10 11:02:40 -08:00
Trenton H
4813a7bc70
Chore: Adds additional rules for Ruff linter ( #5660 )
2024-02-05 21:46:59 +00:00
Trenton H
2aea220c6d
Ensure the scratch directory exists before consuming this source ( #5579 )
2024-01-28 09:07:04 -08:00
luzpaz
58bf9c552b
Documentation: Fix typos with automated tool ( #5319 )
...
---------
Co-authored-by: shamoon <4887959+shamoon@users.noreply.github.com>
2024-01-08 16:58:41 +00:00
Trenton H
8da2535a65
Fix: zip exports not respecting the --delete option ( #5245 )
2024-01-04 19:58:58 +00:00
shamoon
3b6ce16f1c
Feature: Workflows ( #5121 )
2024-01-03 08:19:19 +00:00
Trenton H
061f33fb05
Feature: Allow setting backend configuration settings via the UI ( #5126 )
...
* Saving some start on this
* At least partially working for the tesseract parser
* Problems with migration testing need to figure out
* Work around that error
* Fixes max m_pixels
* Moving the settings to main paperless application
* Starting some consumer options
* More fixes and work
* Fixes these last tests
* Fix max_length on OcrSettings.mode field
* Fix all fields on Common & Ocr settings serializers
* Umbrellla config view
* Revert "Umbrellla config view"
This reverts commit fbaf9f4be30f89afeb509099180158a3406416a5.
* Updates to use a single configuration object for all settings
* Squashed commit of the following:
commit 8a0a49dd5766094f60462fbfbe62e9921fbd2373
Author: shamoon <4887959+shamoon@users.noreply.github.com>
Date: Tue Dec 19 23:02:47 2023 -0800
Fix formatting
commit 66b2d90c507b8afd9507813ff555e46198ea33b9
Author: shamoon <4887959+shamoon@users.noreply.github.com>
Date: Tue Dec 19 22:36:35 2023 -0800
Refactor frontend data models
commit 5723bd8dd823ee855625e250df39393e26709d48
Author: Adam Bogdał <adam@bogdal.pl>
Date: Wed Dec 20 01:17:43 2023 +0100
Fix: speed up admin panel for installs with a large number of documents (#5052 )
commit 9b08ce176199bf9011a6634bb88f616846150d2b
Author: shamoon <4887959+shamoon@users.noreply.github.com>
Date: Tue Dec 19 15:18:51 2023 -0800
Update PULL_REQUEST_TEMPLATE.md
commit a6248bec2d793b7690feed95fcaf5eb34a75bfb6
Author: shamoon <4887959+shamoon@users.noreply.github.com>
Date: Tue Dec 19 15:02:05 2023 -0800
Chore: Update Angular to v17 (#4980 )
commit b1f6f52486d5ba5c04af99b41315eb6428fd1fa8
Author: shamoon <4887959+shamoon@users.noreply.github.com>
Date: Tue Dec 19 13:53:56 2023 -0800
Fix: Dont allow null custom_fields property via API (#5063 )
commit 638d9970fd468d8c02c91d19bd28f8b0796bdcb1
Author: shamoon <4887959+shamoon@users.noreply.github.com>
Date: Tue Dec 19 13:43:50 2023 -0800
Enhancement: symmetric document links (#4907 )
commit 5e8de4c1da6eb4eb8f738b20962595c7536b30ec
Author: shamoon <4887959+shamoon@users.noreply.github.com>
Date: Tue Dec 19 12:45:04 2023 -0800
Enhancement: shared icon & shared by me filter (#4859 )
commit 088bad90306025d3f6b139cbd0ad264a1cbecfe5
Author: Trenton H <797416+stumpylog@users.noreply.github.com>
Date: Tue Dec 19 12:04:03 2023 -0800
Bulk updates all the backend libraries (#5061 )
* Saving some work on frontend config
* Very basic but dynamically-generated config form
* Saving work on slightly less ugly frontend config
* JSON validation for user_args field
* Fully dynamic config form
* Adds in some additional validators for a nicer error message
* Cleaning up the testing and coverage more
* Reverts unintentional change
* Adds documentation about the settings and the precedence
* Couple more commenting and style fixes
---------
Co-authored-by: shamoon <4887959+shamoon@users.noreply.github.com>
2023-12-29 15:42:56 -08:00
Trenton H
7289c4ea56
Feature: Allow deletion of documents via the fuzzy matching command ( #4957 )
...
* Adds new flag allowing deletion of one of a document pair which is over the match ratio
* Documents the new command option
2023-12-17 18:37:38 -08:00
Trenton H
be2de4f15d
Fixes export of custom field instances during a split manifest export ( #4984 )
2023-12-14 19:23:39 -08:00
shamoon
90f90dc9b4
Fix: export consumption templates & custom fields in exporter ( #4825 )
2023-12-04 21:33:15 -08:00
Trenton H
ca355d5855
Adds additional warnings during an import if it might fail due to reasons ( #4814 )
2023-12-05 03:39:59 +00:00
Josiah Outram Halstead
a320bfa425
Fix: Add missing spaces to document retagger help string ( #4674 )
2023-11-24 07:25:38 -08:00
frozenbrain
a14796cf90
Fix: Delay consumption after MODIFY inotify events ( #4626 )
2023-11-19 14:18:43 -08:00
Trenton H
a94e5d2e47
Only delete the ContentTypes and Permissions once, not the loop ( #4623 )
2023-11-17 12:24:49 -08:00
Trenton H
caddcaf807
Forces JSON files to be written as UTF-8, and disables the ensure ASCII option which escapes non-ASCII chars ( #4574 )
2023-11-13 14:18:21 -08:00
Trenton H
e8527ba723
Chore: Cleanup command arguments and standardize process count handling ( #4541 )
...
Cleans up some command help text and adds more control over process count for command with a Pool
2023-11-09 11:46:37 -08:00
Trenton H
cb271deb8f
Fixes the returning of a set, change to a list instead ( #4442 )
2023-10-25 16:18:13 -07:00
Trenton H
612e6341a3
Ensures all old connections are closed in certain longer running locations ( #4265 )
2023-09-25 12:52:22 -07:00
Trenton H
085e6da1f2
Handle when INotify fails to import but the polling is set to 0 still ( #4230 )
2023-09-20 14:04:42 -07:00
Trenton H
ec9ebd3026
Allow the user the specifiy the zip file name ( #4189 )
2023-09-15 16:33:28 -07:00
