ml-infrastructure

ZML/LLMD Alpha: One LLM Server Across CUDA, ROCm, TPU, Metal

ZML/LLMD alpha runs LLaMa, Gemma, Qwen and Mistral models across NVIDIA, AMD, TPU, Intel and Apple Metal in one server, with DFlash speeding up inference.