672 GB VRAM with 7x RTX PRO 6000 Blackwell: More GPUs or 1 TB RAM?
Design for Kimi K3 project with 672 GB VRAM and 7x RTX PRO 6000 GPUs. Should we choose more GPUs or 1 TB of RAM?
A system has been designed for the Kimi K3 project featuring 672 GB of VRAM using an AMD Ryzen Threadripper PRO 9995WX and seven RTX PRO 6000 GPUs. The goal is to reach 1.5 TB of memory, leading to two main paths: adding more GPUs or increasing system RAM. This decision is crucial for engineers as it balances cost and performance requirements.