» Tag
cpu
16 postsConfidential Computing: Protecting Data in Use on CPU and GPU Systems
Confidential computing enhances data protection in AI data centers. It safeguards sensitive information on CPU and GPU systems.
Frontier-class LLM Inference on a Laptop CPU
cpubrrr surpasses llama.cpp on Apple M4 Max CPU for frontier-class LLMs.
Catch your local LLM falling back to CPU
Picchio is a Python file that checks your local LLM setup, showing if the GPU really did the work.
CommitBrief — AI code reviews, right in your terminal
A provider-agnostic, local-first CLI that reviews your staged changes, a historic range, or a whole GitHub pull request. Zero telemetry, no server. Free and open source.
commitbrief.comSigLIP 2 Text Embedding Server on CPU with Rust and ONNX
The CPU-only SigLIP 2 text embedding server, built with Rust and ONNX, is ideal for live queries when GPU resources are limited.
Arm's AGI CPU: A New Era for Data Centers
Arm introduced the AGI CPU at Hot Chips 2026. Designed for data centers, this CPU offers high performance and energy efficiency.
llama.cpp CPU Offload Optimizations
Explore CPU offload optimizations for llama.cpp: disable CUDA graphs and target FFN sub-layers.