» Tag
ci-cd
41 postsPromptLedger v0.7 adds CI regression gates for prompt evaluation
PromptLedger v0.7 adds evaluation runs, metric comparisons, and policy-based regression gates for CI-safe prompt releases.
Why Using AI to Catch Design-Code Drift Is the Wrong Fix
AI-generated UI code is drifting from design systems, and using another AI model to catch it brings non-deterministic, costly and unexplainable results—here's a deterministic alternative.
Statgate: Statistically Calibrated Gates for LLM Evaluations
Statgate offers statistically calibrated gates that reduce false positives in LLM evaluations.
CommitBrief — AI code reviews, right in your terminal
A provider-agnostic, local-first CLI that reviews your staged changes, a historic range, or a whole GitHub pull request. Zero telemetry, no server. Free and open source.
commitbrief.comuv audit tested: fast but narrower gate than pip-audit
Astral's uv package manager gained uv audit and UV_MALWARE_CHECK. Hands-on testing against pip-audit reveals what these experimental security gates actually catch.
Fender: a Docker socket proxy that removes Docker Hub lock-in
Fender sits between the Docker CLI and daemon, transparently rewriting image references to your chosen registries—no Dockerfile or CI script changes required.
Building a Deterministic Merge Gate for AI-Generated Code
A POSIX shell gate checks AI-generated patches before merge: size budgets, sensitive path ownership, and Git diff hygiene, independent of the model that wrote the code.
Contract-Testing API Emails in GitHub Actions Pipelines
A practical guide to why email tests break in CI and how to contract-test API-triggered emails in GitHub Actions using run-scoped inboxes.
Why Your LLM-as-Judge Gate Flips Between Runs
Same code, same input, different LLM judge score: why CI gates flap between runs, and how temperature, model pinning, k-sampling and quantization fix it.
Your LLM Judge Needs a Regression Test Suite
rubric-bench v0.1 is an open-source tool that regression-tests LLM judges against golden sets, catching grading drift in CI before it reaches production.
Severity, Not Flat Pass-Rate, Should Gate Agent Evals
severity_gate.py is an offline, stdlib-only CI tool that gates agent eval runs by failure severity instead of a flat pass-rate, returning SHIP, REVIEW, or BLOCK.