ton/pi_harness
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

feat(coding-agent): add Hugging Face llama search

Browse Source
This commit is contained in:
Mario Zechner
2026-07-17 17:13:39 +02:00
parent f1a466b19d
commit 3da591ab74
6 changed files with 458 additions and 25 deletions
Download Patch File Download Diff File Expand all files Collapse all files
packages/coding-agent/docs/llama-cpp.md
+3 -1
View File
@@ -73,9 +73,11 @@ Run:
- Select an unloaded model to load it.
- Select a loaded model to unload it.
- Select **Download model…** and enter `owner/repository[:quant]` to download from Hugging Face.
- Select **Download model…**, search Hugging Face, then choose a repository and quantization. Exact `owner/repository[:quant]` values also work.
- Press Escape during a load or download to confirm cancellation.
Hugging Face search uses `HF_TOKEN` when set, then checks `$HF_TOKEN_PATH`, `$HF_HOME/token`, `$XDG_CACHE_HOME/huggingface/token`, and `~/.cache/huggingface/token`. Search also works without authentication, subject to lower rate limits. Pi warns before downloading gated repositories and links to their access page. The llama.cpp server performs the download, so its process must also have `HF_TOKEN` when the selected repository requires access.
If other models are loaded, Pi asks whether to unload them first or keep them loaded. Pi does not silently unload models and never deletes model files. The router may be shared with other clients, so `/llama` always displays the router's current state.
Only loaded models appear in `/model`. After loading a model, run `/model` to select it for the current Pi session.