3558 Commits

Author SHA1 Message Date
shamoon
2ba5c0c391
Merge migrations 2025-06-28 05:53:40 -07:00
shamoon
1367453d2c
Add fallback parsing for invalid ai responses 2025-06-28 05:53:40 -07:00
shamoon
f92982217f
Truncate similar docs content 2025-06-28 05:53:40 -07:00
shamoon
701b254b86
Fix paperless_ai logging 2025-06-28 05:53:40 -07:00
shamoon
a092dd3ab0
token limiting 2025-06-28 05:53:40 -07:00
shamoon
81bacec484
Cover app config changes 2025-06-28 05:53:40 -07:00
shamoon
5b13e3594e
Mock auto-trigger llm index 2025-06-28 05:53:24 -07:00
shamoon
3f051fb27b
Fix / cleanup ai indexing test 2025-06-28 05:53:07 -07:00
shamoon
ca87f43262
Coverage for llmindex tasks 2025-06-28 05:53:06 -07:00
shamoon
c20273f46f
Cover llmindex in system status 2025-06-28 05:53:06 -07:00
shamoon
48d0315cc4
Add llmindex to systemstatus 2025-06-28 05:53:06 -07:00
shamoon
553bfeb9fc
Auto-trigger llmindex rebuild when enabled 2025-06-28 05:53:06 -07:00
shamoon
1b9d775508
Use PaperlessTask for llmindex 2025-06-28 05:51:43 -07:00
shamoon
c75ec8dfc3
Create llmindex if doesnt exist on update run 2025-06-28 05:51:43 -07:00
shamoon
f8890bd14a
Move ai to its own module 2025-06-28 05:51:42 -07:00
shamoon
8fc77d92a9
Better respect perms for ai suggestions 2025-06-28 05:51:42 -07:00
shamoon
92837f86c0
Refactor load_or_build_index 2025-06-28 05:51:42 -07:00
shamoon
4b43e39fbb
Update chat view decorators 2025-06-28 05:51:42 -07:00
shamoon
51a89b0cde
Cover matching 2025-06-28 05:51:42 -07:00
shamoon
6536a9c874
Cover partial indexing 2025-06-28 05:51:42 -07:00
shamoon
1e04ce1e57
Refactor and consolidate rag / embedding and tests 2025-06-28 05:51:42 -07:00
shamoon
199f328999
indexing cleanup and tests 2025-06-28 05:51:41 -07:00
shamoon
495a6fe2fe
Use partial reindex for bulk updates 2025-06-28 05:51:41 -07:00
shamoon
03f183712b
Unify prompts, cover 2025-06-28 05:51:41 -07:00
shamoon
f8c6989eaf
Incremental llm index update, add scheduled llm index task 2025-06-28 05:51:41 -07:00
shamoon
5c0903b6da
Some cleanup, typing 2025-06-28 05:51:41 -07:00
shamoon
d49982a5ba
Handle doc updates, refactor 2025-06-28 05:51:41 -07:00
shamoon
db0dc337bd
Chat coverage 2025-06-28 05:51:41 -07:00
shamoon
fd1554fb96
Tests for rest of RAG 2025-06-28 05:51:41 -07:00
shamoon
d439b58aaf
Fix gzip breaks streaming and flush stream 2025-06-28 05:51:40 -07:00
shamoon
37745e846d
Fix openai api key, config settings saving 2025-06-28 05:51:40 -07:00
shamoon
bdaae882a6
Extremely basic chat component 2025-06-28 05:51:39 -07:00
shamoon
37e1290e00
Just use the built-in ollama LLM class of course 2025-06-28 05:51:39 -07:00
shamoon
183d369350
Fix naming 2025-06-28 05:51:39 -07:00
shamoon
d431f1af15
Trim nodes 2025-06-28 05:51:39 -07:00
shamoon
b4ea2b7521
Backend streaming chat 2025-06-28 05:51:39 -07:00
shamoon
46df529c3a
Fixup some tests 2025-06-28 05:51:39 -07:00
shamoon
1e79795fbf
Unify, respect perms
[ci skip]
2025-06-28 05:51:38 -07:00
shamoon
cee5a3b62d
Individual doc chat
[ci skip]
2025-06-28 05:51:38 -07:00
shamoon
0807e32278
Super basic doc chat
[ci skip]
2025-06-28 05:51:38 -07:00
shamoon
6bdf396083
Better encapsulate backends, use llama_index OpenAI 2025-06-28 05:51:38 -07:00
shamoon
3e8a9958a5
Tweak ollama timeout, prompt
[ci skip]
2025-06-28 05:51:38 -07:00
shamoon
b1b2d03644
Fix ollama, fix RAG
[ci skip]
2025-06-28 05:51:38 -07:00
shamoon
2c4b8c9afe
RAG into suggestions 2025-06-28 05:51:38 -07:00
shamoon
0a19a5500c
llamaindex vector index, llmindex mangement command 2025-06-28 05:51:37 -07:00
shamoon
06b0817cc2
Use password and select config fields 2025-06-28 05:51:37 -07:00
shamoon
3051ea5fbb
Use a frontend config 2025-06-28 05:51:37 -07:00
shamoon
c3175c2cd6
Pass AI enabled to frontend 2025-06-28 05:51:37 -07:00
shamoon
c416bca3df
Test views, caching 2025-06-28 05:51:36 -07:00
shamoon
b8dc6665dc
Invalidate llm suggestion cache on doc save 2025-06-28 05:51:36 -07:00