inference

Benchmarking Inference Energy Costs of LLM: A LLaMA Study

Researchers benchmark LLaMA model sizes on V100 and A100 GPUs to analyze the energy and compute costs of LLM inference at scale.