Tag: llm

CUDA vs ROCm for AI on Linux: NVIDIA's easy path, AMD's emotional journey, and why CPU inference isn't dead yet. Real Docker setups included.

LLaMA, Mistral, Falcon, GPT — the LLM landscape is crowded. Compare model families, sizes, licensing, and what each is actually good for.

Temperature, top-p, top-k, context length — LLM inference parameters explained so you stop guessing why the model gives weird output.

Confused by AI agent frameworks? Compare LangGraph, CrewAI, and AutoGen with real Python examples, a no-nonsense breakdown, and zero hype. Pick the right one.

GGUF, GGML, AWQ, GPTQ — LLM file formats and quantization levels explained: trade-offs between model quality, size, and inference speed.

LiteLLM proxies every LLM — local or cloud — behind one OpenAI-compatible endpoint. Pair it with vLLM for GPU-backed serving and ditch the SDK sprawl.

Pixtral, Qwen3-VL, and Gemma 4 compared for local multimodal use in 2026. LLaVA is dead; here's what to run in Ollama for OCR, screenshots, and vision tasks.

Master Ollama with Modelfiles, GPU tuning, API usage, and performance tricks. Stop running 70B models on 8GB VRAM and wondering why everything is slow.

Ollama keeps models in VRAM after every request. Control GPU usage with keep_alive, force-unload via the API, and check memory to stop the reload cycle.

Self-hosting a ChatGPT alternative? Open WebUI owns local Ollama models; LibreChat handles Claude, GPT, Gemini, and more. Setup, RAG, and trade-offs compared.

Write prompts that get useful results — role prompting, few-shot examples, chain-of-thought, and the patterns that work across any LLM.

Text Generation Web UI vs KoboldCpp: setup, model formats, samplers, APIs, and performance compared so you can pick the right local LLM frontend fast.