» Tag
inference
4 postsJuly 2026
Benchmarking Inference Energy Costs of LLM: A LLaMA Study
Researchers benchmark LLaMA model sizes on V100 and A100 GPUs to analyze the energy and compute costs of LLM inference at scale.
llmllamagpuenergy-efficiencyOpenAI and Broadcom Unveil Jalapeño, an LLM Inference Chip
OpenAI and Broadcom unveiled Jalapeño, a custom LLM inference chip built in nine months, set for gigawatt-scale data center deployment starting in 2026.
aihardwareopenaibroadcomFinal Token Preference Optimization Tackles Reasoning Model Doom Loops
Antidoom uses Final Token Preference Optimization to fix repetitive doom loops in reasoning models, cutting loop rates sharply in LFM2.5 and Qwen3.5 without broad model degradation.
llmreasoning-modelsfine-tuningpreference-optimizationAI Inference Engineering: Inside the Prefill-Decode Split
A technical look at how LLM inference splits into compute-bound prefill and memory-bound decode phases, and the optimization techniques engineers use to scale them.
aiinferencellmgpu