» Tag
ai-infrastructure
14 postsOptical Scale-Up Architecture Is Settled, Manufacturing Is the Bottleneck
OCI MSA members like AMD, Nvidia and Meta have settled the architecture for optical scale-up in AI clusters. The real challenge now lies in laser manufacturing.
HubSpot's AI Infrastructure Behind 20 Billion Vectors
HubSpot manages 20+ billion vectors with its Qdrant-based VaaS platform, evolving from Helm to a Kubernetes Operator architecture for scale and reliability.
A Production Checklist for Rolling Out Open-Weight AI Models
A practical rollout guide for teams adopting open-weight AI models, covering task contracts, eval sets, routing layers, and output validation.
CommitBrief — AI code reviews, right in your terminal
A provider-agnostic, local-first CLI that reviews your staged changes, a historic range, or a whole GitHub pull request. Zero telemetry, no server. Free and open source.
commitbrief.comScaling LLM Usage with LiteLLM: Monitoring, Quotas and Spend
Midas engineers explain how they built a unified LiteLLM gateway to centralize LLM observability, spend tracking, and per-environment quotas.