» Tag
bias
7 postsMechanistic View Reveals How Bias Lives Inside LLM Judges
Study shows LLM-as-judge bias is encoded in activation geometry, enabling causal steering and better failure prediction than text-based methods.
Engineering notes: making an AI system tell the truth
How NicheIQ rebuilt its AI idea-evaluation pipeline to fix self-scoring bias, failed self-refinement loops, and reach an honest No-Go verdict.
AI More Likely Than Humans to Develop Biases in Hiring
AI systems are developing biases in hiring that could surpass human biases. New research sheds light on this concerning trend.
CommitBrief — AI code reviews, right in your terminal
A provider-agnostic, local-first CLI that reviews your staged changes, a historic range, or a whole GitHub pull request. Zero telemetry, no server. Free and open source.
commitbrief.comLLM Evaluators Exhibit Bias Across Languages
Research shows LLM evaluators are biased in multilingual contexts, favoring lower-resource languages.
Comparing LLM Evaluation Frameworks: Measuring Model Performance
Learn to evaluate LLM applications with RAGAS, DeepEval, and Promptfoo. Address biases effectively in your designs.
The Audience of One Problem: Trusting Your AI Visibility Test
Explore the pitfalls of testing your AI visibility from your own session. Learn how to create a clean testing environment.
Anchoring Bias in LLM-as-a-Judge Systems: Prior Scores Compromise Evaluation
This study explores how prior scores in LLM-as-a-Judge systems affect evaluations, emphasizing the need for careful context engineering.