Quantization: Making LLMs Smaller Without Making Them Stupid
What LLM quantization is, how GPTQ, AWQ, QLoRA, and GGUF work, and how to choose the right method for local inference, GPU serving, or fine-tuning.
Posts tagged "local-ai"
8 posts
VSCode Agents Window: An AI Harness Inside Visual Studio Code
VS Code's Agents Window is not just a UI: it's a multi-engine harness hosting Copilot CLI, Claude, and cloud agents. How the IDE became an operating system for software engineering agents.
Running SDD Workflows with Local Copilot
How Copilot CLI hosts OpenSpec and Spec Kit flows on local hardware: propose, apply, archive. Why bounded inference cost makes specification-driven iteration practical.
Copilot Instructions, Agents, and Skills: The Missing Control Layer
How custom instructions, AGENTS.md, and skills give your local Copilot the context it needs to stop making stupid mistakes.
MCP Is How Local Copilot Becomes Useful
How MCP servers turn a local LLM into a real agent: test runners, linters, semantic search, and why tool access compensates for weaker reasoning.
How I Set Up GitHub Copilot CLI on Local Hardware
The complete setup guide: vLLM and llama.cpp configs, environment variables, the dual-mode trick, debugging /v1/models, every failure mode, and why owning the runtime changes the equation.
Local LLMs Under the Hood
Text becomes tokens, tokens become vectors, vectors consume memory, and memory pressure adds latency. A complete breakdown of the LLM inference pipeline.
Mayday! Mayday! We're Running Out of Fuel!
Running out of tokens? Will you be part of this new form of slavery or will join the local ai rebellion? Your AI. Your rules.