» Tag
gpu
82 postsInside NVIDIA Exemplar Cloud: Closing 8-12% AI Training Performance Gaps
How NVIDIA diagnosed 8-12% AI training performance gaps on H100 and GB200 NVL72 clusters using perf, Nsight Systems, SMMU tuning, and NUMA fixes.
SkyPilot and Hugging Face bring zero-egress storage to multi-cloud AI
SkyPilot and Hugging Face add a zero-egress storage backend, letting AI teams run GPU workloads on any cloud while data stays on the Hub.
Speculative Decoding: The Free Speedup Most Local LLM Setups Skip
Speculative decoding speeds up local LLM inference 1.5-2.5x with identical output; 2026 saw it built into models via multi-token prediction.
CommitBrief — AI code reviews, right in your terminal
A provider-agnostic, local-first CLI that reviews your staged changes, a historic range, or a whole GitHub pull request. Zero telemetry, no server. Free and open source.
commitbrief.comZML/LLMD Alpha: One LLM Server Across CUDA, ROCm, TPU, Metal
ZML/LLMD alpha runs LLaMa, Gemma, Qwen and Mistral models across NVIDIA, AMD, TPU, Intel and Apple Metal in one server, with DFlash speeding up inference.
The Cost of Irregularity: CUDA C++, Rust, and Triton
A comparison of CUDA C++, Rust, and Triton in GPU programming. Performance differences in irregular workloads are analyzed.
From CUDA to MLX: K-Search Optimizes for Apple Silicon
K-Search translates CUDA optimizations into MLX for Apple Silicon, marking a key advancement for GPU kernels in AI.
XY: A Fast and Customizable GPU-Accelerated Plotting Library
XY is a fast, interactive Python charting library accelerated by GPU.
Qwen3.6-35B-A3B on 4× Intel Arc Pro B70: Achieving 200 tok/s
The Qwen3.6-35B-A3B model offers four optimized configurations with 4 Intel Arc Pro B70 GPUs, balancing performance and flexibility.
GPU-Accelerated Clustering Solution for Financial Instruments
Optimize the clustering process of financial instruments using GPU-accelerated matrix factorization with AdaptGrow.
Craton Bolt: A Pure Rust, JIT-Compiled GPU SQL Engine
Craton Bolt is a Rust-based JIT-compiled GPU SQL engine that generates a new NVIDIA PTX kernel for each query at runtime.