» Tag
cpu
21 postsFlux: Compile an LLM to Your Hardware and Serve It
Flux creates the optimal plan for LLM inference on your hardware.
Confidential Computing: Protecting Data in Use on CPU and GPU Systems
Confidential computing enhances data protection in AI data centers. It safeguards sensitive information on CPU and GPU systems.
Frontier-class LLM Inference on a Laptop CPU
cpubrrr surpasses llama.cpp on Apple M4 Max CPU for frontier-class LLMs.
CommitBrief — AI code reviews, right in your terminal
A provider-agnostic, local-first CLI that reviews your staged changes, a historic range, or a whole GitHub pull request. Zero telemetry, no server. Free and open source.
commitbrief.comCatch your local LLM falling back to CPU
Picchio is a Python file that checks your local LLM setup, showing if the GPU really did the work.
CPU Performance Engineering: Key Insights for Optimization
Comprehensive guide on CPU performance engineering. Insights on speed optimization and microarchitecture.
SigLIP 2 Text Embedding Server on CPU with Rust and ONNX
The CPU-only SigLIP 2 text embedding server, built with Rust and ONNX, is ideal for live queries when GPU resources are limited.
RAI: CPU-only LLM Inference Engine Built in Pure Rust
RAI is a CPU-only LLM inference engine in Rust, providing high performance without GPU dependencies.
Spectre Bug Returns, This Time Haunting JIT Engines
The Spectre vulnerability reemerges, threatening JIT engines with new attack vectors. Researchers highlight risks of sensitive data leakage.
Arm's AGI CPU: A New Era for Data Centers
Arm introduced the AGI CPU at Hot Chips 2026. Designed for data centers, this CPU offers high performance and energy efficiency.
llama.cpp CPU Offload Optimizations
Explore CPU offload optimizations for llama.cpp: disable CUDA graphs and target FFN sub-layers.