» Tag
ci-cd
39 postsWe gated CI on six LLM eval frameworks — only two survived
An eight-month CI test of six LLM eval frameworks found only Promptfoo and DeepEval reliable as merge-queue gates, thanks to deterministic checks.
Reliable Browser Testing Is About State, Not Clicking
Reliable browser testing depends on managing dynamic forms, parallel CI, feature flags, and multi-tenant permissions—state control matters more than clicks.
Testing a Pyxel Config Tool Against Silent State Drift
How a browser-based Pyxel config tool defends against state drift using schema freshness checks, real-schema bounds tests, and CI-driven API introspection.
CommitBrief — AI code reviews, right in your terminal
A provider-agnostic, local-first CLI that reviews your staged changes, a historic range, or a whole GitHub pull request. Zero telemetry, no server. Free and open source.
commitbrief.comHow Anthropic bakes security into its Claude-driven dev lifecycle
A look at how Anthropic embeds AI-driven security checks across coding, CI review, and deployment in its Claude-based dev lifecycle.
Clipper Speeds Docker Builds 7x With Lazy Layer Pulling
Clipper, a custom BuildKit driver, exports cache mounts that ephemeral CI runners discard and skips unused runtime files, cutting Docker build times up to 7x.
Synapse Lets AI Flag False Positives, Never Delete Findings
Synapse's two-model AI triage flags false positives in security scans without deleting findings, preserving gate reliability and audit trails.
Wattage: An Offline Token-Cost Profiler and CI Gate for AI Agents
Wattage profiles AI agent token spend from OTel traces, prices waste in dollars, and gates CI on cost regressions — open-source and offline.
Epistemic Engine verifies AI code and predicts what will break
Epistemic Engine is an open-source Python tool that verifies AI-generated code and forecasts future failures using deterministic git-history analysis.
voidguard: A Static Scanner That Catches Tests That Verify Nothing
voidguard is an open-source static scanner that flags tests, type checks, and CI conditions that pass while verifying nothing.
Testing LLMs Like Software: A Promptfoo Deep Dive for QA
A production-level guide to testing LLM systems with Promptfoo: versioned evals, deterministic checks, judge-model bias, and provider benchmarking.