» Tag
scaling
8 postsScaling Live Audio: Insights from QUIC and MoQ Relays
Key insights from scaling Tula Spaces for live audio and lessons for engineers.
Kimi K3: A Scaling Experiment Beyond the 2.8T Model
Kimi K3 presents a scaling experiment that surpasses the 2.8T model. Insights on expert routing and load balancing are discussed.
The End of Cheap Data: Rethinking the Scaling Laws
The shift from cheap passive data to interaction data is crucial for AI. Engineers must focus on creating high-quality environments for effective learning.
CommitBrief — AI code reviews, right in your terminal
A provider-agnostic, local-first CLI that reviews your staged changes, a historic range, or a whole GitHub pull request. Zero telemetry, no server. Free and open source.
commitbrief.comInside vLLM: Anatomy of a High-Throughput LLM Inference System
Explore the core components and features of vLLM's high-throughput LLM inference system.
CTA-Pipelining: A Latency-Oriented Scaling Method for Multi-GPU Systems
CTA-pipelining enhances performance in multi-GPU systems by focusing on latency-oriented scaling.
Retrofitting Fanout into 13-Year-Old Notification Architecture
Patreon revamped its notification pipeline using a two-stage fanout system.
LLM-Style Scaling Laws Apply to Sensor Data as Well
Scaling laws for LLMs also apply to wearable models, presenting new startup opportunities.
Scaling 4,400 Pages Without Breaking: Static Site Experience
A static site with 3,400 hotel listings generates 4,400 HTML pages. Insights on scaling challenges and solutions are provided.