Tag: ai

Ollama keeps models in VRAM after every request. Control GPU usage with keep_alive, force-unload via the API, and check memory to stop the reload cycle.

Self-hosting a ChatGPT alternative? Open WebUI owns local Ollama models; LibreChat handles Claude, GPT, Gemini, and more. Setup, RAG, and trade-offs compared.

Piper vs Coqui TTS compared: speed, voice quality, Docker setup, and Home Assistant integration. Run offline neural TTS on your own hardware, no cloud fees.

Write prompts that get useful results — role prompting, few-shot examples, chain-of-thought, and the patterns that work across any LLM.

ComfyUI, Fooocus, A1111, and Forge compared for local AI image generation — which to pick based on your GPU, Docker comfort level, and workflow needs.

Text Generation Web UI vs KoboldCpp: setup, model formats, samplers, APIs, and performance compared so you can pick the right local LLM frontend fast.

Two ways to route LLM traffic across providers — OpenRouter as a hosted gateway, LiteLLM as a self-hosted proxy. Which one fits your home lab in 2026?

Local LLMs can call tools, query APIs, and run code if you set them up right. Function calling on Ollama and llama.cpp explained — patterns that actually work.

Gemma 4 vs Qwen3.6: sizes, reasoning, coding benchmarks, and which model you should actually pull for your home lab rig.

AnythingLLM is the closest thing to a real private NotebookLM you can self-host. Workspaces, RAG, agents, document chat — running locally on Ollama in 20 minutes.

Model Context Protocol turns your LLM into a tool-using agent — file access, APIs, your home lab. Build your first MCP server in under 50 lines of Python.

Most RAG demos look great until you ship them. Ragas measures faithfulness, context precision, answer relevancy — the metrics that actually predict user trust.