feat(coding-agent): add llama.cpp router integration

2026-07-17 16:24:21 +02:00
parent 5124c61b25
commit f1a466b19d
17 changed files with 1347 additions and 9 deletions
@@ -8,6 +8,7 @@ Pi supports subscription-based providers via OAuth and API key providers via env
 - [API Keys](#api-keys)
 - [Auth File](#auth-file)
 - [Cloud Providers](#cloud-providers)
+- [llama.cpp](#llamacpp)
 - [Custom Providers](#custom-providers)
 - [Resolution Order](#resolution-order)

@@ -274,6 +275,12 @@ export GOOGLE_CLOUD_LOCATION=us-central1

 Or set `GOOGLE_APPLICATION_CREDENTIALS` to a service account key file.

+## llama.cpp
+
+Pi supports the llama.cpp router server. Configure it with `/login llama.cpp`, manage loaded models with `/llama`, and select a loaded model with `/model`.
+
+See [llama.cpp](llama-cpp.md) for server setup, model directory layout, environment variables, and command usage.
+
 ## Custom Providers

 **Via models.json:** Add Ollama, LM Studio, vLLM, or any provider that speaks a supported API (OpenAI Completions, OpenAI Responses, Anthropic Messages, Google Generative AI). See [models.md](models.md).