» Tag
rdna3
1 postsCustom Vulkan Engine Beats llama.cpp by 1.44x for One Model on RDNA3
A hand-written Vulkan inference engine for one model on RDNA3 GPUs decodes 1.44x faster than llama.cpp with token-exact output parity.
» Tag
A hand-written Vulkan inference engine for one model on RDNA3 GPUs decodes 1.44x faster than llama.cpp with token-exact output parity.