Tag: machine learning

RAG Chunking: Why Chunk Size Is Everything

RAG breaks documents into chunks. But what chunk size? Too small and context is lost. Too large and semantic search fails. Here's how to pick.

LLM Quantization: Q4_K_M Isn't Always the Best Choice

Q4_K_M is the default, but it's not magic. When Q3, Q5, or Q6 makes sense. How to benchmark quantization tradeoffs on your hardware.

RAG on a Budget: Building a Knowledge Base with Ollama & ChromaDB

Learn how to build a local RAG system using Ollama and ChromaDB for free. Step-by-step guide with Docker Compose, Python code, chunking strategies, and real-world examples.

Stable Diffusion vs ComfyUI vs Fooocus: AI Image Generation at Home

Compare Stable Diffusion (A1111 & Forge), ComfyUI, and Fooocus for local AI image generation. GPU requirements, Docker setups, workflows, and beginner picks explained.

LLM Fine-Tuning for Mortals: LoRA, QLoRA, and Your Gaming GPU

Learn LLM fine-tuning with LoRA and QLoRA on a consumer GPU. Practical guide covering dataset prep, Hugging Face, Unsloth, VRAM needs, and common pitfalls.

Whisper & Faster-Whisper: Self-Hosted Speech-to-Text That Actually Works

Run OpenAI Whisper or Faster-Whisper locally with Docker. Better privacy, zero API costs, and surprisingly good accuracy — even on a potato CPU.

Machine Learning models (AI)

Supervised, unsupervised, reinforcement learning — the ML model landscape explained without drowning in math or hype.