» Tag

cuda

14 posts

Jul 30, 20267.60
WISP: A CUDA Engine for Streaming 744B+ Parameter MoE Models on Consumer Hardware
WISP is a CUDA engine for streaming 744B+ parameter MoE models on consumer hardware.
cuda inference machinelearning models
Jul 28, 20267.61
Ninfer: High-performance single-GPU inference
NInfer offers a high-performance C++/CUDA inference engine for RTX 5090.
cuda engineering gpu inference
Jul 31, 20267.10
Anatomy of a CUDA Binary
Explore the structure of CUDA binaries and EIATTR encoding. Learn about Nvidia's undocumented features.
binary compilers cuda nvidia
Ad
CommitBrief — AI code reviews, right in your terminal
A provider-agnostic, local-first CLI that reviews your staged changes, a historic range, or a whole GitHub pull request. Zero telemetry, no server. Free and open source.
commitbrief.com
Jul 6, 20267.00
Raising the baseline for the `nvptx64-nvidia-cuda` target
Rust 1.97 increases the PTX ISA and GPU architecture for `nvptx64-nvidia-cuda`, making older driver compatibility impossible.
compilers cuda gpu nvidia