metal

Apple Silicon macOS VMs Get 11-16x Faster LLM Inference via Llama.cpp

Cua's Metal capability shim delivers 11-16x faster llama.cpp LLM inference in macOS VMs on Apple Silicon, with open benchmarks and source.