» Tag
local-ai
6 postsHeadroom: browser tool measures your GPU's true bandwidth ceiling for local AI
Headroom is a no-account WebGPU browser tool measuring real GPU bandwidth ceilings and driver bugs for local AI inference performance.
Speculative Decoding: The Free Speedup Most Local LLM Setups Skip
Speculative decoding speeds up local LLM inference 1.5-2.5x with identical output; 2026 saw it built into models via multi-token prediction.
Local Motion Brings Local LLM Agents to Cursor and VS Code
Local Motion auto-picks a compatible local coding model on Mac, manages memory, and links to Cursor via tunnel or runs fully local inside VS Code.
CommitBrief — AI code reviews, right in your terminal
A provider-agnostic, local-first CLI that reviews your staged changes, a historic range, or a whole GitHub pull request. Zero telemetry, no server. Free and open source.
commitbrief.comLocal AI Pipelines: Why Some Workloads Should Never Leave
Privacy, cost, and latency push certain AI tasks off the cloud and onto local hardware. A practical local AI pipeline using Ollama and faster-whisper.
DFlash in llama.cpp: 4.44x Faster Local Inference on Qwen 3.6 27B
DFlash, merged into llama.cpp, uses block-diffusion drafting to boost Qwen 3.6 27B inference speed, hitting 4.44x at 36K context with near-lossless quality.
Xllama: Local LLM Chat and Image Generation on Xbox Series S
Xllama is a UWP app for Xbox Series S enabling local LLM chat and image generation.