» Tag
rate-limiting
7 posts7 lessons from building a hard spending cap for LLM APIs
Why LLM API bills silently explode: retry storms, inconsistent token reporting, streaming blind spots, and race conditions in spending caps.
Rate Limiting at Scale: Choosing the Right Throttling Algorithm
Why in-memory rate limiting silently breaks under horizontal scaling, and how token bucket, sliding window and fixed window algorithms trade off in production.
Half My Traffic Was Bots: A 4-Day Layered Defense Stack
A developer discovered headless bots executing JS made up half his traffic, then built a 4-day, five-layer defense using robots.txt, ISR, Redis, and Vercel BotID.
CommitBrief — AI code reviews, right in your terminal
A provider-agnostic, local-first CLI that reviews your staged changes, a historic range, or a whole GitHub pull request. Zero telemetry, no server. Free and open source.
commitbrief.comGrudge: A Decaying Score Sketch for Multi-Tenant Systems
Grudge is a constant-memory Go library that decays per-key feedback scores without per-key state, enabling scalable rate limiting and abuse detection.
Syncing Bank Transactions with Open Banking APIs in Production
A production-focused guide to PSD2 open banking sync: consent flows, token refresh, pagination, deduplication, and rate-limit handling with code examples.
Your Hugging Face download isn't stuck — you're being rate-limited
Learn about rate limiting in Hugging Face downloads and how to resolve it.
How GitHub's forgotten security rules ended up blocking real users
GitHub reveals how temporary incident-response rules left in place kept quietly blocking legitimate users, highlighting the need for lifecycle management and observability in defense systems.