Skip to content

project

LlamaStash

A Rust tool for running local language models, combining a terminal UI, CLI, daemon and OpenAI-compatible proxy over backends such as llama.cpp and vLLM, with presets and named launches for session management.

Current clusters