10292 Commits

Author SHA1 Message Date
shamoon
aa97a57160
Merge migrations again 2025-05-24 11:47:31 -07:00
shamoon
bda16bcced
Fix merge conflict 2025-05-24 11:47:31 -07:00
shamoon
eb55ca9429
Merge migrations 2025-05-24 11:47:30 -07:00
shamoon
c623f38322
Add fallback parsing for invalid ai responses 2025-05-24 11:47:30 -07:00
shamoon
d1515ba59f
Truncate similar docs content 2025-05-24 11:47:30 -07:00
shamoon
826070b599
Fix paperless_ai logging 2025-05-24 11:47:29 -07:00
shamoon
8afa0404f4
token limiting 2025-05-24 11:47:29 -07:00
shamoon
78a11d84d1
Update AI docs 2025-05-24 11:47:29 -07:00
shamoon
b84663b5de
Cover app config changes 2025-05-24 11:47:28 -07:00
shamoon
d046afead5
Mock auto-trigger llm index 2025-05-24 11:47:28 -07:00
shamoon
3c0fdb88cf
Fix / cleanup ai indexing test 2025-05-24 11:47:28 -07:00
shamoon
1fed105c1e
Doh, add tests in new module 2025-05-24 11:47:27 -07:00
shamoon
677155ca05
Coverage for llmindex tasks 2025-05-24 11:47:27 -07:00
shamoon
7e90773e7f
Cover llmindex in system status 2025-05-24 11:47:27 -07:00
shamoon
97f72238a2
Add llmindex to systemstatus 2025-05-24 11:47:26 -07:00
shamoon
5e1c532f83
Auto-trigger llmindex rebuild when enabled 2025-05-24 11:47:26 -07:00
shamoon
3a703790fc
Use PaperlessTask for llmindex 2025-05-24 11:47:26 -07:00
shamoon
0dd990a45b
Create llmindex if doesnt exist on update run 2025-05-24 11:47:25 -07:00
shamoon
03173e83e5
Move ai to its own module 2025-05-24 11:47:25 -07:00
shamoon
0948599513
Better respect perms for ai suggestions 2025-05-24 11:47:25 -07:00
shamoon
9f81cd7ce5
Refactor load_or_build_index 2025-05-24 11:47:24 -07:00
shamoon
30181c43cf
Update chat view decorators 2025-05-24 11:47:24 -07:00
shamoon
589ba08fae
Cover matching 2025-05-24 11:47:24 -07:00
shamoon
73c1dea59b
Cover partial indexing 2025-05-24 11:47:23 -07:00
shamoon
046c153b71
Refactor and consolidate rag / embedding and tests 2025-05-24 11:47:23 -07:00
shamoon
6d5e83601f
indexing cleanup and tests 2025-05-24 11:47:22 -07:00
shamoon
93ffe14eac
Use partial reindex for bulk updates 2025-05-24 11:47:22 -07:00
shamoon
a16525fbbe
Unify prompts, cover 2025-05-24 11:47:22 -07:00
shamoon
6ee6a37816
Incremental llm index update, add scheduled llm index task 2025-05-24 11:47:22 -07:00
shamoon
8852965117
Some cleanup, typing 2025-05-24 11:47:21 -07:00
shamoon
17451ba34a
Handle doc updates, refactor 2025-05-24 11:47:21 -07:00
shamoon
a747f76693
Chat coverage 2025-05-24 11:47:20 -07:00
shamoon
f368390aca
Tests for rest of RAG 2025-05-24 11:47:20 -07:00
shamoon
31dcff6cee
Chat component and service coverage 2025-05-24 11:47:20 -07:00
shamoon
075dfbe369
Real doc ID updating 2025-05-24 11:47:19 -07:00
shamoon
348d175d42
Sweet chat animation, cursor 2025-05-24 11:47:19 -07:00
shamoon
9c3249f1f1
Only show chat if enabled 2025-05-24 11:47:19 -07:00
shamoon
1e1ebed70c
Fix partial length in chat 2025-05-24 11:47:18 -07:00
shamoon
51b92084a5
Fix gzip breaks streaming and flush stream 2025-05-24 11:47:18 -07:00
shamoon
33f0cc2373
Fix openai api key, config settings saving 2025-05-24 11:47:18 -07:00
shamoon
ebb72126db
Try rewriting with httpclient 2025-05-24 11:47:17 -07:00
shamoon
afd4d7ca76
Extremely basic chat component 2025-05-24 11:47:17 -07:00
shamoon
db4433281c
Just use the built-in ollama LLM class of course 2025-05-24 11:47:17 -07:00
shamoon
97b129ca3d
Fix naming 2025-05-24 11:47:16 -07:00
shamoon
4c91f43f5a
Trim nodes 2025-05-24 11:47:16 -07:00
shamoon
d5f1a8e7f7
Backend streaming chat 2025-05-24 11:47:16 -07:00
shamoon
1622ea046c
Fixup some tests 2025-05-24 11:47:15 -07:00
shamoon
5267d93c62
Just some docs
[ci skip]
2025-05-24 11:47:15 -07:00
shamoon
ba4149f92b
Unify, respect perms
[ci skip]
2025-05-24 11:47:15 -07:00
shamoon
15b3b17c5e
Individual doc chat
[ci skip]
2025-05-24 11:47:14 -07:00