memex/notes/org-skill-provider-ollama.org

SKILL: Ollama Provider Agent (Universal Literate Note)

• Overview
• Phase A: Demand (PRD)
  • 1. Purpose
  • 2. User Needs
  • 3. Success Criteria
    • Local API Connectivity
    • Model Specification (llama3)
    • Response Extraction Verification
• Phase B: Blueprint (PROTOCOL)
  • 1. Architectural Intent
  • 2. Semantic Interfaces
• Phase D: Build (Implementation)
  • Local Execution
• Registration

Overview

The Ollama Provider Agent enables the use of local, privacy-preserving LLM models. It integrates with a local Ollama instance to ensure system functionality and sovereignty without external internet connectivity.

Phase A: Demand (PRD)

1. Purpose

Define the interface for communication with a local Ollama daemon.

2. User Needs

• Sovereignty: Fallback backend independent of cloud providers.
• Performance: Efficient local network interaction.
• Simplicity: Deterministic, non-streaming text generation.

3. Success Criteria

TODO Local API Connectivity

TODO Model Specification (llama3)

TODO Response Extraction Verification

Phase B: Blueprint (PROTOCOL)

1. Architectural Intent

Interfaces for executing neural completion requests via the local Ollama API.

2. Semantic Interfaces

(defun execute-ollama-request (prompt system-prompt)
  "Executes a completion request via local Ollama.")

Phase D: Build (Implementation)

Local Execution

(defun execute-ollama-request (prompt system-prompt)
  (let ((url "http://host.docker.internal:11434/api/generate")
        (model "llama3"))
    ;; Physical local call logic (mocked for refactor)
    (format nil "Executing local Ollama request on ~a" model)))

Registration

(defskill :skill-provider-ollama
  :priority 100
  :trigger (lambda (context) nil)
  :neuro (lambda (context) nil)
  :symbolic (lambda (action context) action))