Topic
AI & LLMs
Models you can run on your own hardware, prompt patterns that ship, agent frameworks that don't catch fire, and the awkward questions nobody answers in the breathless launch posts. Ollama, vLLM, llama.cpp, LocalAI, plus the quieter stuff — embeddings, RAG, evals, and figuring out when the cloud API is actually the right answer. If you'd rather understand the trade-offs than chase benchmarks, you'll feel at home here.
71 articles in this topic.
Featured posts
-
Stop Feeding the AI Your Whole Repo
Comparing context-mode, code-review-graph, token-savior, and claude-context — MCP tools that stop AI coding agents from reading your whole codebase blind.
10 min read -
RTK vs snip vs lean-ctx: Token Killers
RTK, snip, and lean-ctx filter your AI coding agent's output before it burns context tokens. I run RTK daily — here's the one I'd actually switch to.
12 min read -
Hailo-8 vs Coral: AI Accelerators for the Edge
Hailo-8 vs Google Coral: which edge AI accelerator actually wins for Frigate NVR, Whisper transcription, and local home lab inference workloads in 2026?
11 min read -
AI Swarm Audited My 840-Post Blog
I pointed a parallel swarm of AI agents at 840 technical posts to fact-check and refresh them — the architecture, the token bill, and the guardrails.
12 min read -
Used GPU Buying Guide for Home Lab LLMs
Your no-BS guide to buying a used GPU for local LLM inference in 2026. Budget tiers from $200 to $1500 plus, real VRAM math, and tips to dodge the scams.
12 min read -
Claude Code in a Homelab Workflow
Claude Code puts an agentic AI assistant in your terminal for real homelab work — compose files, bash, Ansible, systemd. The honest take on cost and data.
12 min read
All AI & LLMs articles
- Stop Feeding the AI Your Whole Repo
- RTK vs snip vs lean-ctx: Token Killers
- Hailo-8 vs Coral: AI Accelerators for the Edge
- AI Swarm Audited My 840-Post Blog
- Used GPU Buying Guide for Home Lab LLMs
- Claude Code in a Homelab Workflow
- Self-Host a Local AI Coding Workhorse
- Give Your AI Agent a Cheap Intern
- Claude Code + SearXNG: Private Web Search
- Dify: Visual Agent Workflows
- CUDA vs ROCm vs CPU: Running AI on Whatever GPU You've Got
- Exploring the Diverse World of LLM Models
- Key Parameters of Large Language Models
- LangGraph vs CrewAI vs AutoGen: AI Agent Frameworks for Mere Mortals
- Large Language Model Formats and Quantization
- LiteLLM & vLLM: One API to Rule All Your Models
- Local Vision LLMs Worth Running in 2026
- Ollama Beyond the Basics: Model Management, Custom Models, and Optimization
- Ollama Memory Management: Why Models Keep Loading
- Open WebUI vs LibreChat: Self-Hosted ChatGPT Alternatives Compared
- Piper vs Coqui: Text-to-Speech on Your Own Hardware (Because AWS Polly Charges Per Character Like It's 1999 SMS)
- Prompt Engineering for Generative AI 101
- Stable Diffusion vs ComfyUI vs Fooocus: AI Image Generation at Home
- Text Generation Web UI vs KoboldCpp: Power User LLM Interfaces
- OpenRouter vs LiteLLM
- Function Calling in Local LLMs
- Gemma 4 vs Qwen3.6
- AnythingLLM as Knowledge Base
- MCP Servers: Tools for LLMs
- RAG Evaluation with Ragas
- LLM Distillation Explained
- Open WebUI Tools, Functions & Pipelines: Extend Your Local LLM
- Self-Supervised Learning Explained
- Ollama Model Management: Beyond ollama run
- Continue.dev vs Cody vs Tabby: AI Code Help Without the Cloud
- LangGraph vs CrewAI vs AutoGen: AI Agents Without the Hype
- n8n + LLM: Building Automations That Actually Think
- Qdrant vs Weaviate vs Chroma: Vector DB Showdown
- CUDA vs ROCm vs CPU: Running AI on Whatever GPU You've Got
- LangGraph vs CrewAI vs AutoGen: AI Agent Frameworks for Mere Mortals
- Whisper & Faster-Whisper: Self-Hosted Speech-to-Text That Actually Works
- LiteLLM & vLLM: One API to Rule All Your Models
- RAG on a Budget: Building a Knowledge Base with Ollama & ChromaDB
- LangChain vs LlamaIndex: RAG Framework Showdown
- The Embedding Model Choice Nobody Explains
- GPU Memory Math: Will This Model Actually Fit?
- Beyond RAG: When a Virtual Filesystem Works Better
- Running Gemma 4 Locally with Ollama
- 1-Bit LLMs: The Quantization Endgame
- AMD Lemonade: Local LLM Serving for AMD GPUs
- When to Use Structured Output (JSON Mode) in LLMs
- Using AI to Find Security Bugs in Your Code
- LLM Temperature and top_p Explained Without the Math
- LLM Backends: vLLM vs llama.cpp vs Ollama
- RAG Chunking: Why Chunk Size Is Everything
- System Prompts: The LLM Feature Most People Ignore
- LLM Quantization: Q4_K_M Isn't Always the Best Choice
- Running Multiple Ollama Models Without Running Out of RAM
- Context Window vs Token Limit: Not the Same Thing
- RAG on a Budget: Building a Knowledge Base with Ollama & ChromaDB
- Stable Diffusion vs ComfyUI vs Fooocus: AI Image Generation at Home
- n8n + LLM: Building Automations That Actually Think
- LLM Fine-Tuning for Mortals: LoRA, QLoRA, and Your Gaming GPU
- Whisper & Faster-Whisper: Self-Hosted Speech-to-Text That Actually Works
- Continue.dev vs Cody vs Tabby: AI Code Assistants That Live on Your Machine
- Flowise vs Langflow: Build AI Pipelines Without Writing a Novel
- n8n vs Node-RED: Automate Everything Without Learning to Code (Much)
- Prompts for Image Generation in Stable Diffusion
- Ollama: Powerful Language Models on Your Own Machine
- Unleash the Power of LLMs with LocalAI
- Machine Learning models (AI)