» Tag
gpu
18 postsTesting LLM Concurrency on Consumer Hardware (RTX 5060)
LLM concurrency tests on RTX 5060 yield crucial insights for engineers.
Co-Designing AI Model Attention for Fast, Interactive Long-Context Inference
Explore practical guidelines for optimizing AI model attention and inference efficiency.
Kernel 7.2: RK3588 media, smarter GPU memory management
Linux kernel 7.2 brings key improvements, including RK3588 support and Rust-based GPU memory management.
CommitBrief — AI code reviews, right in your terminal
A provider-agnostic, local-first CLI that reviews your staged changes, a historic range, or a whole GitHub pull request. Zero telemetry, no server. Free and open source.
commitbrief.comDeepSeek-V4-Flash 0731: Full Precision Lossless Performance Test
DeepSeek-V4-Flash-0731 can be run at full precision with 176 GB memory. The project focuses on efficiency and performance testing.
672 GB VRAM with 7x RTX PRO 6000 Blackwell: More GPUs or 1 TB RAM?
Design for Kimi K3 project with 672 GB VRAM and 7x RTX PRO 6000 GPUs. Should we choose more GPUs or 1 TB of RAM?
Fine-Grained Shader Validation in Three.js
Three.js has introduced a new system for testing shader results, evaluating TSL expressions through WebGPU and WebGL2.
Run Massive-Scale UMAP in Minutes Using Multiple GPUs
Accelerate UMAP with NVIDIA cuML using multiple GPUs for improved efficiency on large datasets.
Wallr: A Native Wayland Wallpaper Engine
Wallr is a Wayland wallpaper engine offering GPU-driven transition effects. It allows customization with 11 different effects.