Skip to content

Tag: sysadmin

All the articles with the tag "sysadmin".

Ollama Keep Alive: Unload Models from VRAM

Ollama Keep Alive: Unload Models from VRAM

· Updated:

Ollama holds models in VRAM after every request. Set keep_alive, force an unload through the API, and cap how many models stay resident at once.