starred/minne
1
0
Fork 0
mirror of https://github.com/perstarkse/minne.git synced 2026-08-30 15:17:12 +02:00
Code Issues Packages Projects Releases 10 Wiki Activity
410 Commits 4 Branches 19 Tags
76fcdcd6cea6b383a67bfab65e5996965f06c637
Commit Graph
100 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
Per Stark 76fcdcd6ce chore: index slicing and lowercase errors 2026-05-27 12:41:26 +02:00
Per Stark cd0b0368a0 chore: tightening and removing super fn 2026-05-27 11:23:39 +02:00
Per Stark 48985a61d3 chore: clippy and nix fmt 2026-05-27 11:23:08 +02:00
Per Stark 056f116885 perf: avoid small own clones and intermediate Vec allocations 
- Derive Copy on 6 small enums (MessageRole, TaskState, StorageKind, EmbeddingBackend, PdfIngestMode, KnowledgeEntityType)
- Change create_ingestion_payload files param from Vec<FileInfo> to &[FileInfo]
- Remove 5 intermediate Vec allocations (4 embedding serialization + 1 format_history) using write! loop
- Remove 7 unnecessary .clone() calls exposed by Copy derive
 2026-05-27 10:28:08 +02:00
Per Stark ffea0ef126 fix: html-router dependency of json-stream-parser 2026-05-27 09:59:26 +02:00
Per Stark dd9ee22670 refactor: json-stream-parser aligned to clippy standard 2026-05-27 09:07:38 +02:00
Per Stark 017d6c5ba9 chore: additional clippy fixes after rebasing 2026-05-27 07:37:18 +02:00
Per Stark 12f989b3a1 fix: pin surrealdb 2026-05-26 20:21:40 +02:00
Per Stark 82e0619850 clippy: evaluations crate 2026-05-26 20:21:25 +02:00
Per Stark 1bf93f0125 perf: pre-allocate collections with known capacity in hot paths 
- Use with_capacity for chunk_by_source, results, per_entity_traces,
  and selected_chunks in assemble() where bound is known
- Pre-allocate tokens/terms vectors in normalize_fts_query and
  extract_keywords based on input length
- Pre-allocate neighbor_ids, seen, and ordered in graph expansion
  based on relationship count
 2026-05-26 20:21:25 +02:00
Per Stark b8f7c826b4 perf: offload blocking calls to spawn_blocking 
- Move headless_chrome PDF rasterization from async context to
  spawn_blocking, keeping tokio worker threads responsive.
- Switch RerankerPool from tokio::sync::Mutex to std::sync::Mutex
  and run TextRerank::rerank inside spawn_blocking, since the
  rerank call is CPU-bound with no .await points.
 2026-05-26 20:21:25 +02:00
Per Stark fe68194e4f lint: inherit workspace clippy config in json-stream-parser and evaluations 
Both crates were missing the [lints] workspace = true directive,
bypassing workspace clippy rules (unwrap_used, expect_used, etc.).
 2026-05-26 20:21:25 +02:00
Per Stark d76f86f56f refactor: simplify and improve testing for initialization 2026-05-26 20:21:24 +02:00
Per Stark 5ce7a76c75 clippy: adhere to pedantic clippy, uniform test error handling 2026-05-26 20:21:13 +02:00
Per Stark e0068ebe26 chore: remove unused clap dep and fix test_session_table name 
- Remove clap dependency from retrieval-pipeline (RetrievalStrategy
  already has FromStr/Display; evaluations uses clap directly)
- Rename session table from test_session_table to session
 2026-05-26 20:14:29 +02:00
Per Stark 7c718712c9 refactor: replace Box<dyn Error> with anyhow::Result 
- ingestion_pipeline::run_worker_loop returns anyhow::Result<()>
- api_router::ApiState::new returns anyhow::Result<Self>
- html_router::HtmlState::new_with_resources is infallible, returns Self
- main/server/worker binary entry points return anyhow::Result<()>
 2026-05-26 20:14:11 +02:00
Per Stark 9affc0b05b refactor: extract serde helpers from stored_object! macro 
Move FlexibleIdVisitor, deserialize_flexible_id, and four datetime serde helpers
from repeating inside every macro expansion into a shared
common/src/storage/types/serde_helpers.rs module.

14 macro invocations × 6 items = ~84 fewer redundant function definitions.
Fragile cross-module imports (file_info::deserialize_flexible_id etc.)
are updated to point to the canonical module.
 2026-05-26 20:12:54 +02:00
Per Stark d0d00469e9 chore: devenv inconsistency, spawn server manually in dev 2026-02-15 18:31:43 +01:00
Per Stark 611d7217e6 release: 1.0.2 2026-02-15 11:57:04 +01:00
Per Stark 87459e1189 test: minio to devenv, improved testing s3 and relationships 2026-02-15 08:52:56 +01:00
Per Stark 6c5297ec6e chore: dep updates & kv-mem separation to test feature 
docker builder update
 2026-02-15 08:51:48 +01:00
Per Stark f5d72b66b0 test: add admin auth integration coverage 2026-02-14 23:11:35 +01:00
Per Stark 93ac56ebc7 feat: caching chat history & dto 2026-02-14 19:43:34 +01:00
Per Stark c6e499e5dc fix: harden html responses and cache chat sidebar data 
Use strict template response handling and sanitized template user context, then add an in-process conversation archive cache with mutation-driven invalidation for chat sidebar renders.
 2026-02-14 17:47:14 +01:00
Per Stark ffae16bc84 fix: simplified admin checking 2026-02-13 23:04:01 +01:00
Per Stark d1b3e9b23a fix: name harmonization of endpoints & ingestion security hardening 2026-02-13 22:36:00 +01:00
Per Stark 545a5dc9f3 fix: redact ingestion payload logs and update changelog 2026-02-13 12:06:18 +01:00
Per Stark 91f3ab231c fix: parameterize storage-layer queries and add injection tests 2026-02-12 21:42:46 +01:00
Per Stark f3d4625a3e fix: border in navigation 2026-02-12 20:39:36 +01:00
Per Stark 822eaa5688 fix: browser back navigation from chat windows 
addenum
 2026-02-12 20:32:06 +01:00
Per Stark 3b58582963 fix: references bug 
fix
 2026-02-11 22:02:40 +01:00
Per Stark 45da7bacf3 release: 1.0.1 2026-02-11 15:39:28 +01:00
Per Stark ebba45c129 docs: updated domain name 2026-02-11 15:17:03 +01:00
Per Stark 6d996f7775 fix: gracefully handle old users 2026-02-11 07:50:19 +01:00
Per Stark 99fdb0fc8d docs: updated readme 2026-01-18 18:48:53 +01:00
Per Stark 0887d2b07f dev: devenv processes 2026-01-18 18:45:30 +01:00
Per Stark 599709c4cd fix: edge case when deleting content 
nit
 2026-01-18 18:45:21 +01:00
Per Stark 2f069ef7b8 design: better dark mode 2026-01-17 23:31:05 +01:00
Per Stark 60087e10fb refactor: additional responsibilities to middleware, simplified handlers 
fix
 2026-01-17 21:07:25 +01:00
Per Stark 3c16c17472 theme: obsidian-prism 2026-01-17 08:45:47 +01:00
Per Stark a9a37b2468 feat: s3 storage backend 2026-01-16 23:38:47 +01:00
Per Stark 8e9978540e feat: add user theme preference 
- Add theme field to User model (common)
- Create migration for theme field
- Add theme selection to Account Settings (html-router)
- Implement server-side theme rendering in base template
- Update JS for system/preference theme handling
- Remove header theme toggle for authenticated users
 2026-01-16 13:54:07 +01:00
Per Stark 336de2c0fb docs: addenum 2026-01-14 22:24:23 +01:00
Per Stark 5b16e88991 refactor: extendable templates 
refactor: simplification

refactor: simplification
 2026-01-13 22:18:00 +01:00
Per Stark 534d0f8c31 fix: allow for multiple templates directories 2026-01-12 21:25:12 +01:00
Per Stark f782812f21 fix: updating models in admin view 2026-01-12 21:01:53 +01:00
Per Stark 8664abdf01 release: 1.0.0 
fix: cargo dist
 2026-01-11 20:35:01 +01:00
Per Stark 07421fdb18 fix: schemafull and textcontent 2026-01-02 15:41:22 +01:00
Per Stark b933ba35cd docs: more complete and correct 2025-12-24 23:36:58 +01:00
Per Stark 58e560be9d chore: wording 2025-12-22 23:03:33 +01:00
Per Stark 97ce77c574 fix: never block fts, rely on rrf 2025-12-22 22:56:57 +01:00
Per Stark 589257e721 fix: migrating embeddings to new dimensions 
changing order
 2025-12-22 22:39:14 +01:00
Per Stark b4b2ab8974 fix: ordering of index creation 2025-12-22 21:59:35 +01:00
Per Stark f95e14df25 docs: evaluations instructions and readme refactoring 2025-12-22 18:55:47 +01:00
Per Stark a4d6aa88fa fix: migrations 
schemafull
 2025-12-22 18:32:08 +01:00
Per Stark 97b8c39065 fix: admin page sorted 2025-12-21 21:35:52 +01:00
Per Stark 0bd91d16c1 Merge branch 'main' into benchmarks 2025-12-20 23:09:16 +01:00
Per Stark ca8b37f0dc changelog 2025-12-20 23:03:06 +01:00
Per Stark 86270de873 tidying stuff up, dto for search 2025-12-20 22:30:31 +01:00
Per Stark 90bac299a3 passed wide smoke check 2025-12-10 13:54:08 +01:00
Per Stark 032630c083 faster index creation 2025-12-09 21:32:23 +01:00
Per Stark 8121e04125 retrieval simplfied 2025-12-09 20:35:42 +01:00
Per Stark 192e6480e0 benchmarks: fin 2025-12-08 21:57:53 +01:00
Per Stark e77f2d51e8 beir-rff 2025-12-08 20:39:12 +01:00
Per Stark 1fccf3ab59 dataset: beir 2025-12-04 17:50:35 +01:00
Per Stark 6c458c97ce retrieval: hybrid search, linear fusion 2025-12-04 12:48:59 +01:00
Per Stark a56eb3ed7c release: 0.2.7 2025-12-04 12:25:46 +01:00
Per Stark c60efb2af7 benchmarks: ready for hybrid revised 2025-12-03 11:38:07 +01:00
Per Stark 5e5053039a fix: removed stale embeddings handler 2025-11-29 20:07:48 +01:00
Per Stark 38cb2e5e24 fix: all tests now in sync 2025-11-29 18:59:08 +01:00
Per Stark abf0223bd2 ndcg fix 2025-11-29 16:24:09 +01:00
Per Stark 888c055fee refactored to clap, mrr and ndcg 2025-11-28 21:26:51 +01:00
Per Stark 06344cc108 fix: index creation at init 2025-11-26 21:49:20 +01:00
Per Stark 05bdaac672 evals: v3, ebeddings at the side 
additional indexes
 2025-11-26 15:15:10 +01:00
Per Stark 6611bf3645 retrieval-pipeline: v1 2025-11-19 12:58:27 +01:00
Per Stark de47dc7a2f fix: add dockerfile changes related to retrieval-pipeline 2025-11-18 22:51:48 +01:00
Per Stark 57d1b54ca2 benchmarks: v2 
Minor refactor
 2025-11-18 22:51:06 +01:00
Per Stark 97d35a8982 retrieval-pipeline: v0 2025-11-18 22:46:35 +01:00
Per Stark 73e709153a upsert relationship and creation 2025-11-18 21:18:09 +01:00
Per Stark 6f08429faa benchmarks: v1 
Benchmarking ingestion, retrieval precision and performance
 2025-11-18 11:50:15 +01:00
Per Stark c7be7c1889 design: improved admin page, new structure 2025-11-04 20:42:24 +01:00
Per Stark fae82434e9 fix: added cargo lock to crane build 2025-11-04 12:59:32 +01:00
Per Stark 7f30c8ff6e Merge branch 'main' into development 2025-11-03 12:48:04 +01:00
Per Stark 911e830be5 Merge branch 'development' of github.com:perstarkse/minne into development 2025-11-03 12:40:36 +01:00
Per Stark 3196e65172 fix: improved storage manager, prep for s3 2025-11-03 12:39:15 +01:00
Per Stark ac22098d0d release: 0.2.6 
dist update

fix new workflow

fix

mkdir

moved to dist

fix only dir

dont verify sha files

fix verify ci part

fix

no checking anymore
 2025-11-01 21:26:06 +01:00
Per Stark 017fc8b00b Merge pull request #5 from josephleee/patch-1 
Update README.md
 2025-10-31 13:40:06 +01:00
Per Stark b0deabaf3f release: 0.2.6 2025-10-31 13:38:11 +01:00
Per Stark 56a1dfddb8 fix: updated docker container for reranking 2025-10-29 12:04:39 +01:00
Per Stark 863b921fb4 fix: updated nix build to work with reranking deps 2025-10-28 22:28:45 +01:00
Per Stark f13791cfcf fix: better default naming of relationships 2025-10-27 20:46:00 +01:00
Per Stark 75c200b2ba fix: update graph view when changes in knowledge store 2025-10-27 18:22:15 +01:00
Per Stark 1b7c24747a fix: in memory object store handler for testing 2025-10-27 17:03:03 +01:00
Per Stark 241ad9a089 fix: scratchpad tz aware datetime 2025-10-27 14:00:22 +01:00
Per Stark 72578296db feat: reranking with fastembed added 2025-10-27 13:05:10 +01:00
Per Stark a0e9387c76 docs: updated readme 2025-10-24 23:34:18 +02:00
Per Stark 798b1468b6 release: 0.2.5 2025-10-24 22:13:08 +02:00
Per Stark 3b805778b4 feat: scratchpad 
additional improvements

changelog

fix: wording
 2025-10-22 22:29:41 +02:00
Per Stark 07b3e1a0e8 refactor: implemented state machine for ingestion pipeline, improved performance 
changelog

additional moving around

moved files around a bit
 2025-10-20 13:08:00 +02:00
Per Stark 83d39afad4 refactor: implemented state machines for retrieval pipeline, improved tracing 2025-10-19 09:18:17 +02:00