Pluggable AI providers (any open-standard or commercial AI) #5
Loading…
Add table
Add a link
Reference in a new issue
No description provided.
Delete branch "feature/server-ai-providers"
Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?
Transcription and summarisation each target a configured provider: open-standard (OpenAI-compatible / local faster-whisper / Ollama) or commercial (OpenAI, Anthropic via the official SDK, Gemini via its OpenAI endpoint). Config-driven, self-hostable, no lock-in. See docs/ai-providers.md. Modules byte-compile; ingest wiring + local faster-whisper execution land in M5.
Lets the owner point transcription and summarisation at any AI: an open-standard endpoint (OpenAI-compatible / local faster-whisper / Ollama) or a commercial API (OpenAI, Anthropic, Gemini). Config-driven, self-hostable, no lock-in. What changed: - server/app/providers/: provider layer. - base.py: Transcriber/Summariser protocols + shared summary prompt + tolerant JSON parser (uniform Summary shape across providers). - summary.py: OpenAICompatibleSummariser (any /chat/completions - OpenAI, Groq, OpenRouter, LocalAI, LM Studio, vLLM, Ollama /v1) and AnthropicSummariser (Claude via the official anthropic SDK; Messages API has no OpenAI-compatible endpoint). - transcription.py: OpenAICompatibleTranscriber (/audio/transcriptions - OpenAI, Groq, self-hosted whisper server) and LocalWhisperTranscriber (faster-whisper, execution wired in M5). - factory.py: builds the configured providers with per-provider defaults (anthropic -> claude-opus-4-8, openai_compatible -> gpt-4o-mini, ollama -> llama3.1). - config.py + .env.example: transcription_provider / llm_provider selectors + base_url, key, model settings; local faster-whisper and Ollama kept as the self-hosted defaults. - main.py: /health now reports the resolved provider names (no secrets). - requirements.txt: httpx drives all HTTP providers; anthropic + faster-whisper are optional, only for their respective providers. - docs/ai-providers.md: config recipes for OpenAI, Groq, Anthropic, Gemini, LocalAI, LM Studio, Ollama, self-hosted whisper. - state/: DECISIONS, ARCHITECTURE, TODO updated. Why: - The user asked to connect the device to any open standard AI or commercial one; this is also the core differentiator vs Plaud's locked cloud. Notes: - Anthropic provider uses the official SDK and defaults to claude-opus-4-8 (per the claude-api guidance). AI deps are optional per chosen provider. Modules byte-compile cleanly; end-to-end wiring into the ingest pipeline lands with M5. Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>