» Tag
testing
87 postsA Green Test Suite Isn't Proof: Authority Gaps Slipped Past 16/16
A 16/16 passing test suite hid three critical gaps in an authority model. Why a green scoreboard alone was never sufficient proof.
We gated CI on six LLM eval frameworks — only two survived
An eight-month CI test of six LLM eval frameworks found only Promptfoo and DeepEval reliable as merge-queue gates, thanks to deterministic checks.
Spec Forge: Adversarially Certifying Specs as Behaviorally Complete
Spec Forge is a Claude Code skill that adversarially certifies specifications as behaviorally complete before any code is written.
CommitBrief — AI code reviews, right in your terminal
A provider-agnostic, local-first CLI that reviews your staged changes, a historic range, or a whole GitHub pull request. Zero telemetry, no server. Free and open source.
commitbrief.comTesting a Pyxel Config Tool Against Silent State Drift
How a browser-based Pyxel config tool defends against state drift using schema freshness checks, real-schema bounds tests, and CI-driven API introspection.
Developer audits his own SaaS starter kit like a hostile buyer
NuxtForge's creator audited his own Nuxt + NestJS SaaS starter kit as a skeptical buyer, uncovering a dead test runner, boot failures, and a login bug before launch.
hwatu: A Warm-Daemon Verification Browser for AI Coding Agents
hwatu offers a warm-daemon verification browser for AI agents, running one-call, sub-40ms visual and behavioral page checks.
Google's Adam Bender on the Future of Software Engineering
Google's Adam Bender explains why AI speeds up programming but not software engineering, and what teams must fix first.
voidguard: A Static Scanner That Catches Tests That Verify Nothing
voidguard is an open-source static scanner that flags tests, type checks, and CI conditions that pass while verifying nothing.
A Test-Matrix Approach to Debugging JavaScript Regular Expressions
A four-axis test-matrix method for debugging JavaScript regex bugs involving Unicode, flags, capture groups, and RegExp state.
Probelock: A Lockfile for LLM Tool-Calling Capabilities
Probelock measures an LLM's tool-calling capabilities with deterministic tests and halts CI when a model, quantization, or runtime swap causes a regression.