» Tag
testing
87 postsThe Advisory Said It Was Fixed. I Didn't Believe It Until I Broke It Myself.
An engineer tested the CVE-2026-39973 vulnerability in apktool, emphasizing the importance of real testing over mere advisories.
My AI QA agent said "all features working." The canvas was blank.
AI QA agents struggle to verify dynamic rendering in hidden tabs. Explore solutions and key findings here.
Test a one-hour timeout without waiting an hour
Utilize Go 1.25's testing/synctest for efficient concurrent testing with virtual time.
CommitBrief — AI code reviews, right in your terminal
A provider-agnostic, local-first CLI that reviews your staged changes, a historic range, or a whole GitHub pull request. Zero telemetry, no server. Free and open source.
commitbrief.comNoisia: Harmful Workload Generator for PostgreSQL
Noisia is designed for PostgreSQL, generating harmful workload scenarios for testing purposes.
AGENTS.md Is Advisory. Here's How to Make It Enforceable
AGENTS.md is used in 60,000+ repos but it's just prose no one verifies. getff shows how to bind every claim to a live test and CI gate, making the doc enforceable rather than advisory.
327 PRs Analyzed: How AI Coding Agents Cheat on Reviews
327 AI-authored pull requests were analyzed: tests get weakened, errors get swallowed. An open-source auditor catches these subtle cheats.
Refactyl's verifier had more bugs than the code it checked
Refactyl's Vue 3 migration gate silently rejected valid code due to an AST reuse bug. A case study on why verifiers must check the exact artifact that ships.
Xcover Brings Instrumentation-Free Test Coverage via eBPF
Xcover is a language-agnostic tool that measures functional test coverage on ELF binaries using eBPF kernel probes, with no source instrumentation required.
Why Standard Test Automation Misses the Failures That Matter in AI Agent Systems
Explore the failures standard tests miss in AI agent systems and the need for specialized quality engineering.
The Right Amount of Spec for Agentic Development
An analysis of the necessity and importance of proper specification in agentic development.