» Tag
cost optimization
19 postsPrompt caching raised my bill — the write premium I missed
Turning on prompt caching increased costs due to a hidden write premium (~1.25x) versus cheap reads (~0.1x). Here's the fix and what to monitor.
Guarding BigQuery Costs From Autonomous Data Agents
Autonomous data agents can rack up huge BigQuery bills through unchecked trial-and-error queries; dry-run scan checks and token budgets keep runs safe.
Why price per 1M tokens is a misleading AI metric
Comparing AI models by price per 1M tokens can mislead teams. Tokenizer differences and chain-of-thought efficiency matter far more than the sticker price per token.
CommitBrief — AI code reviews, right in your terminal
A provider-agnostic, local-first CLI that reviews your staged changes, a historic range, or a whole GitHub pull request. Zero telemetry, no server. Free and open source.
commitbrief.comClaude Code Orchestration: 96% Performance at 46% of Cost
Anthropic's Fable-Sonnet orchestration pattern now runs natively in Claude Code: 96% performance at 46% cost. Details plus the pilotfish package inside.
Code or Diffusion: A Field Guide to Programmatic Image Generation
Generating diagrams and charts as code instead of diffusion cuts costs and produces testable, diffable, version-controlled image assets.
Token Governor: The Smart Gateway That Cuts LLM Costs
Token Governor re-engineers LLM prompts to spend the fewest tokens needed, acting as a governing gateway that works with Anthropic, OpenAI, Gemini and any compatible provider.
Warner Chappell Cuts Cloud Costs by 50% With AI Embeddings
Warner Chappell replaced brittle SQL matching with in-memory AI embeddings, cutting cloud costs 50% and boosting royalty-matching output by 65%.
Why Does Your LLM Bill Grow Even When Traffic Doesn't?
LLM costs can rise even when user traffic stays flat. Learn why tracking tokens per operation, not raw requests, reveals hidden cost drivers in production.
Foreman: A Self-Hosted, Cost-Aware LLM Gateway for Coding Agents
Foreman is an open-source, self-hosted gateway between coding agents and LLM providers that routes by cost, preserves prompt caching, and logs every spend.