10359 Commits

Author SHA1 Message Date
shamoon
f92982217f
Truncate similar docs content 2025-06-28 05:53:40 -07:00
shamoon
701b254b86
Fix paperless_ai logging 2025-06-28 05:53:40 -07:00
shamoon
a092dd3ab0
token limiting 2025-06-28 05:53:40 -07:00
shamoon
9fdfdf9b48
Update AI docs 2025-06-28 05:53:40 -07:00
shamoon
81bacec484
Cover app config changes 2025-06-28 05:53:40 -07:00
shamoon
5b13e3594e
Mock auto-trigger llm index 2025-06-28 05:53:24 -07:00
shamoon
3f051fb27b
Fix / cleanup ai indexing test 2025-06-28 05:53:07 -07:00
shamoon
d1294c4183
Doh, add tests in new module 2025-06-28 05:53:07 -07:00
shamoon
ca87f43262
Coverage for llmindex tasks 2025-06-28 05:53:06 -07:00
shamoon
c20273f46f
Cover llmindex in system status 2025-06-28 05:53:06 -07:00
shamoon
48d0315cc4
Add llmindex to systemstatus 2025-06-28 05:53:06 -07:00
shamoon
553bfeb9fc
Auto-trigger llmindex rebuild when enabled 2025-06-28 05:53:06 -07:00
shamoon
1b9d775508
Use PaperlessTask for llmindex 2025-06-28 05:51:43 -07:00
shamoon
c75ec8dfc3
Create llmindex if doesnt exist on update run 2025-06-28 05:51:43 -07:00
shamoon
f8890bd14a
Move ai to its own module 2025-06-28 05:51:42 -07:00
shamoon
8fc77d92a9
Better respect perms for ai suggestions 2025-06-28 05:51:42 -07:00
shamoon
92837f86c0
Refactor load_or_build_index 2025-06-28 05:51:42 -07:00
shamoon
4b43e39fbb
Update chat view decorators 2025-06-28 05:51:42 -07:00
shamoon
51a89b0cde
Cover matching 2025-06-28 05:51:42 -07:00
shamoon
6536a9c874
Cover partial indexing 2025-06-28 05:51:42 -07:00
shamoon
1e04ce1e57
Refactor and consolidate rag / embedding and tests 2025-06-28 05:51:42 -07:00
shamoon
199f328999
indexing cleanup and tests 2025-06-28 05:51:41 -07:00
shamoon
495a6fe2fe
Use partial reindex for bulk updates 2025-06-28 05:51:41 -07:00
shamoon
03f183712b
Unify prompts, cover 2025-06-28 05:51:41 -07:00
shamoon
f8c6989eaf
Incremental llm index update, add scheduled llm index task 2025-06-28 05:51:41 -07:00
shamoon
5c0903b6da
Some cleanup, typing 2025-06-28 05:51:41 -07:00
shamoon
d49982a5ba
Handle doc updates, refactor 2025-06-28 05:51:41 -07:00
shamoon
db0dc337bd
Chat coverage 2025-06-28 05:51:41 -07:00
shamoon
fd1554fb96
Tests for rest of RAG 2025-06-28 05:51:41 -07:00
shamoon
404dbae431
Chat component and service coverage 2025-06-28 05:51:40 -07:00
shamoon
0f1aee3a3c
Real doc ID updating 2025-06-28 05:51:40 -07:00
shamoon
3f8dbc630a
Sweet chat animation, cursor 2025-06-28 05:51:40 -07:00
shamoon
5180651400
Only show chat if enabled 2025-06-28 05:51:40 -07:00
shamoon
f0ac80a08a
Fix partial length in chat 2025-06-28 05:51:40 -07:00
shamoon
d439b58aaf
Fix gzip breaks streaming and flush stream 2025-06-28 05:51:40 -07:00
shamoon
37745e846d
Fix openai api key, config settings saving 2025-06-28 05:51:40 -07:00
shamoon
9c00b48dc7
Try rewriting with httpclient 2025-06-28 05:51:40 -07:00
shamoon
bdaae882a6
Extremely basic chat component 2025-06-28 05:51:39 -07:00
shamoon
37e1290e00
Just use the built-in ollama LLM class of course 2025-06-28 05:51:39 -07:00
shamoon
183d369350
Fix naming 2025-06-28 05:51:39 -07:00
shamoon
d431f1af15
Trim nodes 2025-06-28 05:51:39 -07:00
shamoon
b4ea2b7521
Backend streaming chat 2025-06-28 05:51:39 -07:00
shamoon
46df529c3a
Fixup some tests 2025-06-28 05:51:39 -07:00
shamoon
3ed877b301
Just some docs
[ci skip]
2025-06-28 05:51:39 -07:00
shamoon
1e79795fbf
Unify, respect perms
[ci skip]
2025-06-28 05:51:38 -07:00
shamoon
cee5a3b62d
Individual doc chat
[ci skip]
2025-06-28 05:51:38 -07:00
shamoon
0807e32278
Super basic doc chat
[ci skip]
2025-06-28 05:51:38 -07:00
shamoon
6bdf396083
Better encapsulate backends, use llama_index OpenAI 2025-06-28 05:51:38 -07:00
shamoon
5c88a7207d
Add backend settings to frontend config
[ci skip]
2025-06-28 05:51:38 -07:00
shamoon
3e8a9958a5
Tweak ollama timeout, prompt
[ci skip]
2025-06-28 05:51:38 -07:00