» Tag
gpu
6 postsFFmpeg's av1_vulkan Encoder: Does Your GPU Really Support AV1?
A hands-on look at FFmpeg 8.x's av1_vulkan encoder: probing driver support, running a first encode, benchmarking against SVT-AV1, and deploying it in containers.
ffmpegav1vulkangpuBenchmarking Inference Energy Costs of LLM: A LLaMA Study
Researchers benchmark LLaMA model sizes on V100 and A100 GPUs to analyze the energy and compute costs of LLM inference at scale.
llmllamagpuenergy-efficiencyDFlash in llama.cpp: 4.44x Faster Local Inference on Qwen 3.6 27B
DFlash, merged into llama.cpp, uses block-diffusion drafting to boost Qwen 3.6 27B inference speed, hitting 4.44x at 36K context with near-lossless quality.
llama.cppspeculative-decodinglocal-aiqwenBuilding a Multimodal Vector Search Platform for Product Catalogs
How a recommendation team built a multimodal vector search platform with Qdrant, tuned HNSW settings, and optimized GPU usage for embedding millions of products.
vector-searchembeddingsqdrantmachine-learningAI Inference Engineering: Inside the Prefill-Decode Split
A technical look at how LLM inference splits into compute-bound prefill and memory-bound decode phases, and the optimization techniques engineers use to scale them.
aiinferencellmgpuRust 1.97, nvptx64-nvidia-cuda hedefinde taban seviyeyi yükseltiyor
Rust 1.97, nvptx64-nvidia-cuda derleme hedefi için minimum PTX ISA 7.0 ve SM 7.0 gereksinimini getiriyor; eski GPU ve CUDA sürücü desteği kaldırılıyor.
rustcudanvidiagpu