Tag: llm

RAG Chunking: Why Chunk Size Is Everything

RAG breaks documents into chunks. But what chunk size? Too small and context is lost. Too large and semantic search fails. Here's how to pick.

System Prompts: The LLM Feature Most People Ignore

System prompts are your secret weapon. How they work, why they matter more than you think, and 5 patterns that actually change model behavior.

LLM Quantization: Q4_K_M Isn't Always the Best Choice

Q4_K_M is the default, but it's not magic. When Q3, Q5, or Q6 makes sense. How to benchmark quantization tradeoffs on your hardware.

Running Multiple Ollama Models Without Running Out of RAM

Ollama can load one model at a time on limited hardware. How to switch between models, use CPU offloading, and manage VRAM intelligently.

Context Window vs Token Limit: Not the Same Thing

What's the actual difference between context window and token limit? Why one model says 8K and another says 128K. A practical breakdown.

RAG on a Budget: Building a Knowledge Base with Ollama & ChromaDB

Learn how to build a local RAG system using Ollama and ChromaDB for free. Step-by-step guide with Docker Compose, Python code, chunking strategies, and real-world examples.

n8n + LLM: Building Automations That Actually Think

Connect n8n to Ollama or any local LLM to build smart automations that classify, summarize, and triage — not just shuffle data around blindly.

LLM Fine-Tuning for Mortals: LoRA, QLoRA, and Your Gaming GPU

Learn LLM fine-tuning with LoRA and QLoRA on a consumer GPU. Practical guide covering dataset prep, Hugging Face, Unsloth, VRAM needs, and common pitfalls.

Whisper & Faster-Whisper: Self-Hosted Speech-to-Text That Actually Works

Run OpenAI Whisper or Faster-Whisper locally with Docker. Better privacy, zero API costs, and surprisingly good accuracy — even on a potato CPU.

Continue.dev vs Cody vs Tabby: AI Code Assistants That Live on Your Machine

Compare Continue.dev, Cody, and Tabby — three self-hosted AI code assistants that keep your code private, cost nothing per token, and work offline.

Flowise vs Langflow: Build AI Pipelines Without Writing a Novel

Flowise vs Langflow compared: self-hosted, Docker-ready visual LLM workflow builders. Build no-code AI pipelines, RAG chatbots, and more — without losing your mind.

n8n vs Node-RED: Automate Everything Without Learning to Code (Much)

n8n vs Node-RED: self-host your own Zapier killer. Compare workflow automation tools, Docker setup guides, and real examples for 2026.