Llama Swap

https://llama-swap.wiki
Llama swap is used by thousands of users for reliable for on demand loading of AI backends like llama cpp vLLM Whisper and

https://www.kdnuggets.com › how-to-run-multiple-llms...
It s an open source proxy server that s super lightweight just a single binary and it lets you switch between multiple local LLMs

https://swap.defillama.com
We execute swaps directly against the router of each aggregator so there s no difference between a swap executed directly from

https://github.com › mostlygeek › llama-swap › blob › main › README.md
Run multiple generative AI models on your machine and hot swap between them on demand llama swap works with any OpenAI

https://betterstack.com › community › guides › ai › llama-swap
Llama swap is a lightweight Go binary that acts as a reverse proxy in front of llama cpp and other local LLM

https://ai.miraheze.org › wiki › Llama-swap
Llama swap is an open source proxy server written in Go that manages on demand hot swapping of large language

https://www.opensourcealternatives.to › item › llama-swap
Run multiple local AI models with on demand hot swapping via an OpenAI Anthropic compatible proxy MIT licensed

https://local-ai.net › solutions › llama-swap
A small proxy that sits in front of llama cpp and compatible servers and swaps models in and out on demand so a

https://www.glukhov.org › llm-hosting › llama-swap
Llama swap is a lightweight proxy server built around a simple operational model one binary one YAML config file no dependencies