Commit Graph

5 Commits

Author SHA1 Message Date
55e27f5194 v0.4.0: semantic retrieval — REPL TDD + literate prose
Some checks failed
Deploy (Gitea) / deploy (push) Failing after 3s
RED proofs (pre-v0.4.0):
- SEMANTIC_SCORE never appears in context output (foveal-vector = nil)
- Context suite: 9/0 (no trigram test)
- SHA-256 hashing default — cryptographically blind to similarity

GREEN proofs (v0.4.0):
- Trigram 'authentication' vs 'authenticate' → 0.80 similarity
- Trigram 'authentication' vs 'banana' → 0.00 similarity
- Default provider: :trigram (lexical overlap, zero dependencies)
- Context suite: 12/0 (new test-semantic-retrieval-trigram)
- SHA-256 preserved as explicit :sha256 provider (integrity-only)

Prose:
- system-model-embedding.org: explains why SHA-256 is blind (avalanche
  property) and why trigrams capture lexical overlap (shared 'aut','uth',
  'the','hen',...). Documents :trigram, :sha256, :local, :openai backends.
- core-context.org: documents the one-line foveal-vector wiring fix and
  how it activates the dormant semantic retrieval path. Explains the
  full pipeline: trigram embed → memory-object-vector →
  context-awareness-assemble → context-object-render → cosine similarity.
2026-05-06 19:39:30 -04:00
11254b56ec v0.4.0: semantic retrieval activation — wire foveal-vector + trigram Jaccard
Some checks failed
Deploy (Gitea) / deploy (push) Failing after 2s
1. Wire :foveal-vector into context-awareness-assemble: pass the foveal
   node's embedding vector to context-object-render. Previously always
   nil → similarity always 0.0 → no semantic boosting.

2. Replace default :hashing (SHA-256) with :trigram (character-trigram
   Jaccard). SHA-256 is a cryptographic hash with the avalanche property
   — one-bit input differences produce entirely different outputs. Useless
   for similarity. Trigram bloom filter (128-dim) captures lexical overlap
   in pure Lisp with zero external dependencies:
   - 'authentication' vs 'authenticate' → 0.80 similarity
   - 'authentication' vs 'banana' → 0.00 similarity

3. Rename old embedding-backend-hashing → embedding-backend-sha256
   (integrity-only, explicit opt-in). Add embedding-backend-trigram.

4. Add test-semantic-retrieval-trigram: related texts > 0.75, unrelated < 0.3.

Test: 97/0 across 13 suites (context 12/0, embedding 12/0)
2026-05-06 19:04:17 -04:00
717d63d84a v0.3.0: finish Async Embedding Gateway — mark-vector-stale, cron, defskill, ROADMAP updates
Some checks failed
Deploy (Gitea) / deploy (push) Failing after 3s
- Add mark-vector-stale(id, content): sets :vector to :pending, queues for re-embed
- Register cron job (embed-all-pending every 10m on :reflex tier via orchestrator)
- Add defskill :passepartout-system-model-embedding (priority 70)
- Remove embedding from topological-sort exclusion list in core-skills
- Export mark-vector-stale in core-defpackage
- Contract: items 4 (mark-vector-stale) and 5 (cron registration)
- Test: test-mark-vector-stale (5 checks)
- ROADMAP: mark Context Manager, Async Embedding Gateway, TUI Experience as DONE
- All v0.3.0 items now complete. Total: 5 suites, 85 checks, 0 failures
2026-05-05 18:24:08 -04:00
cd86509e3a v0.3.0 finish: TUI tests, embedding wiring, gateway :configured, focus commands, export cleanup
Some checks failed
Deploy (Gitea) / deploy (push) Failing after 2s
- TUI: Fix stale contract (remove handle-return/*incoming-msgs*), rewrite
  10->13 tests (38 checks, 100% pass). Export missing symbols from TUI
  package. Fix view-chat contract arity.
- Gateway messaging: Add :configured key to registry (boolean, nil default).
  Fix contract to match (vault-based, not env-var-based).
- Async Embedding Gateway: Add *embedding-backend* var, embeddings-compute
  function. Modify ingest-ast to populate vectors on new objects.
  Add EMBEDDING_PROVIDER env var support. Add Contract + 4 tests (8 checks).
- Context Manager: Add /focus, /scope, /unfocus commands to TUI on-key
  handler. Commands degrade gracefully when context-manager not loaded.
- Export hygiene: Remove 30+ ghost exports (undefined symbols). Remove
  duplicate/mismatched names. Exports now match actual definitions.
2026-05-05 17:42:03 -04:00
908936d4d3 rename gateway-* → system-model-* + gateway-messaging, de-ollama, add system-model-explorer
- Rename gateway-provider → system-model-provider (generic :local provider, no hardcoded ollama)
- Rename gateway-llm → system-model (model-request dispatcher)
- Rename system-embedding-gateway → system-model-embedding
- Rename gateway-manager → gateway-messaging (public api renamed to messaging-*)
- Add system-model-explorer (model discovery via OpenRouter API, cached, per-slot recommendations)
- Fix skill loader export: replace prefix-matching with fbound/boundp-based export (20 skills now export)
- Add model-router to skill-loader exclusion list (loaded via CLI)
- De-ollama: remove hardcoded assumed-available patterns from provider pipeline
- Default cascade: cloud-only (openrouter, openai, groq, gemini, deepseek, nvidia, anthropic)
- Env example: add LOCAL_BASE_URL, fix cascade order
- All org files updated with architectural prose (literate programming)
2026-05-04 09:58:59 -04:00