LLM Fine-Tuning for Mortals: LoRA, QLoRA, and Your Gaming GPU
Fine-tune an LLM on your gaming GPU with LoRA and QLoRA: dataset prep, Hugging Face, Unsloth, VRAM math, a full walkthrough, and mistakes that waste your afternoon.
All the articles with the tag "llm".
Fine-tune an LLM on your gaming GPU with LoRA and QLoRA: dataset prep, Hugging Face, Unsloth, VRAM math, a full walkthrough, and mistakes that waste your afternoon.
Master Ollama with Modelfiles, GPU tuning, API usage, and performance tricks. Stop running 70B models on 8GB VRAM and wondering why everything is slow.
Run OpenAI Whisper or Faster-Whisper locally with Docker. Better privacy, zero API costs, and surprisingly good accuracy, even on a potato CPU.
Compare Continue.dev, Cody, and Tabby, three self-hosted AI code assistants that keep your code private, cost nothing per token, and work offline.
CUDA vs ROCm for AI on Linux: NVIDIA's easy path, AMD's emotional journey, and why CPU inference isn't dead yet. Real Docker setups included.
Flowise vs Langflow compared: self-hosted, Docker-ready visual LLM workflow builders. Build no-code AI pipelines, RAG chatbots, and more, without losing your mind.
You're paying $20/month to Zapier for two HTTP requests. n8n and Node-RED replace it for free: Docker setup, real workflows, and a head-to-head comparison.
Temperature, top-p, top-k, context length, LLM inference parameters explained so you stop guessing why the model gives weird output.
Write prompts that get useful results, role prompting, few-shot examples, chain-of-thought, and the patterns that work across any LLM.
GGUF, GGML, AWQ, GPTQ, LLM file formats and quantization levels explained: trade-offs between model quality, size, and inference speed.
LLaMA, Mistral, Falcon, GPT, the LLM landscape is crowded. Compare model families, sizes, licensing, and what each is actually good for.
Ollama makes running local LLMs dead simple, pull a model, start the server, and get a private ChatGPT running on your own hardware.