» Tag
gpu
82 postsThe Sustained Performance Gap: Why Laptop Boost Clocks Don't Hold
Why laptop boost clocks fade under sustained load: thermal throttling, PL1/PL2 power limits, and GPU TGP tricks explained for engineers and buyers.
AMD Unveils Instinct MI455X: CDNA 5 and Helios Take Aim at Nvidia
AMD's CDNA 5-based Instinct MI455X and 72-GPU Helios rack-scale system offer a serious new challenge to Nvidia's Rubin platform in AI data centers.
FFmpeg's av1_vulkan Encoder: Does Your GPU Really Support AV1?
A hands-on look at FFmpeg 8.x's av1_vulkan encoder: probing driver support, running a first encode, benchmarking against SVT-AV1, and deploying it in containers.
CommitBrief — AI code reviews, right in your terminal
A provider-agnostic, local-first CLI that reviews your staged changes, a historic range, or a whole GitHub pull request. Zero telemetry, no server. Free and open source.
commitbrief.comCAKE: Compiler-Agent Co-Design Lets AI Write Faster GPU Kernels
CAKE pairs AI coding agents with a hardware-explicit compiler IR, beating tuned GPU kernel baselines on B200 with verifiable, evolving toolchains.
Text Diffusion vs Autoregressive Models: The Real GPU Cost Math
A grounded comparison of text diffusion and autoregressive LLMs on GPU utilization, latency, batching economics, and real-world enterprise costs.
Meta Rebuilds BLOB Storage to Cut GPU Stalls in AI Training
Meta redesigned its BLOB-storage architecture with unified metadata and direct-to-client streaming to eliminate GPU stalls in AI training.
Bw24: From-Scratch Rust+CUDA LLM Engine Tuned for RTX 50 Blackwell
Bw24 is a from-scratch Rust+CUDA LLM inference engine tuned for RTX 50-series Blackwell GPUs, hitting up to 2.3x speculative decoding gains over llama.cpp.
Hardware Knobs Let GPUs Dynamically Throttle AI Model Performance
Four GPU microarchitecture knobs enable fine-grained, low-cost hardware throttling of AI performance as a runtime safety mechanism.
LLM Inference Latency: Why Memory Bandwidth Beats FLOPS
Why LLM inference speed depends on GPU memory bandwidth, not FLOPS. Real tok/s benchmarks across GPUs, quantization levels, and batch sizes.
Benchmarking Inference Energy Costs of LLM: A LLaMA Study
Researchers benchmark LLaMA model sizes on V100 and A100 GPUs to analyze the energy and compute costs of LLM inference at scale.