» Tag
ci-cd
39 postsStatgate: Statistically Calibrated Gates for LLM Evaluations
Statgate offers statistically calibrated gates that reduce false positives in LLM evaluations.
uv audit tested: fast but narrower gate than pip-audit
Astral's uv package manager gained uv audit and UV_MALWARE_CHECK. Hands-on testing against pip-audit reveals what these experimental security gates actually catch.
Fender: a Docker socket proxy that removes Docker Hub lock-in
Fender sits between the Docker CLI and daemon, transparently rewriting image references to your chosen registries—no Dockerfile or CI script changes required.
CommitBrief — AI code reviews, right in your terminal
A provider-agnostic, local-first CLI that reviews your staged changes, a historic range, or a whole GitHub pull request. Zero telemetry, no server. Free and open source.
commitbrief.comBuilding a Deterministic Merge Gate for AI-Generated Code
A POSIX shell gate checks AI-generated patches before merge: size budgets, sensitive path ownership, and Git diff hygiene, independent of the model that wrote the code.
Contract-Testing API Emails in GitHub Actions Pipelines
A practical guide to why email tests break in CI and how to contract-test API-triggered emails in GitHub Actions using run-scoped inboxes.
Why Your LLM-as-Judge Gate Flips Between Runs
Same code, same input, different LLM judge score: why CI gates flap between runs, and how temperature, model pinning, k-sampling and quantization fix it.
Your LLM Judge Needs a Regression Test Suite
rubric-bench v0.1 is an open-source tool that regression-tests LLM judges against golden sets, catching grading drift in CI before it reaches production.
Severity, Not Flat Pass-Rate, Should Gate Agent Evals
severity_gate.py is an offline, stdlib-only CI tool that gates agent eval runs by failure severity instead of a flat pass-rate, returning SHIP, REVIEW, or BLOCK.
A Run ID Pattern for Stable React Auth Email Tests
Flaky React auth email tests usually stem from missing correlation, not timing. A typed run id pattern ties UI state, API, and inbox checks together for reliable assertions.
Branching Databases Like Code: A CI/CD Pattern for Lakebase at Glaspoort
Glaspoort enhances data management with a CI/CD model for Lakebase database changes.