» Tag
ai-infrastructure
4 postsJuly 2026
Benchmarking Inference Energy Costs of LLM: A LLaMA Study
Researchers benchmark LLaMA model sizes on V100 and A100 GPUs to analyze the energy and compute costs of LLM inference at scale.
llmllamagpuenergy-efficiencyOptical Scale-Up Architecture Is Settled, Manufacturing Is the Bottleneck
OCI MSA members like AMD, Nvidia and Meta have settled the architecture for optical scale-up in AI clusters. The real challenge now lies in laser manufacturing.
ai-infrastructureoptical-networkingco-packaged-opticssemiconductor-manufacturingA Production Checklist for Rolling Out Open-Weight AI Models
A practical rollout guide for teams adopting open-weight AI models, covering task contracts, eval sets, routing layers, and output validation.
aiopen-weight-modelsllm-opsai-infrastructureScaling LLM Usage with LiteLLM: Monitoring, Quotas and Spend
Midas engineers explain how they built a unified LiteLLM gateway to centralize LLM observability, spend tracking, and per-environment quotas.
llmlitellmobservabilitykubernetes