» Tag
llm
472 postsPXQ format revives Pascal/Volta GPUs: +88% prefill on a $150 Tesla P100
PXQ format and custom CUDA kernels in ik_llama.cpp fork pxq_llama deliver major prefill/decode speedups on Tesla P100, V100 and GTX 1080 Ti GPUs.
Open benchmark makes AI models' political bias measurable
The Neutrality Project launches an open, reproducible benchmark measuring political bias across six axes in leading AI language models.
Hugging Face Discloses Breach Driven by an Autonomous AI Agent
Hugging Face discloses a breach by an autonomous AI agent, detected via LLM-based analysis after commercial models blocked forensic work.
CommitBrief — AI code reviews, right in your terminal
A provider-agnostic, local-first CLI that reviews your staged changes, a historic range, or a whole GitHub pull request. Zero telemetry, no server. Free and open source.
commitbrief.comBuilding APIs for AI Agents: A Practical Playbook
How crmkit's agent-first API design reshapes conventions: text over JSON, short IDs, bulk operations, and self-documenting endpoints.
When an LLM's Training Data Expires: Fixing a Car Pricing Engine
An AI car-pricing engine broke because its LLM recalled stale exchange rates, revealing risks of mandatory retrieval and cache provenance in LLM apps.
Why Coding Agents Improve More From Harness Design Than Models
LangChain pushed a coding agent to Terminal-Bench's top 5 without changing the model — the gains came entirely from harness design.
TormentNexus AI Skill Registry Reaches 5,776 Modules
TormentNexus' AI skill registry hits 5,776 modules, enabling chainable automation for code review, Terraform generation, and database migrations.
A Decade of Vision-Language Models: Why Easy Benchmarks Mask Real Progress
A decade-long study finds vision-language model progress is real but hidden by easy benchmarks; only spatial reasoning errors remain unsolved.
VoltMem: A Volatility-Aware Memory Layer for LLM Agents
VoltMem adds domain-specific volatility priors to LLM agent memory, resolving stale-vs-stable fact conflicts that flat memory layers like Mem0 miss.
Claude Code's Prompt Cache Cost Depends on How You Launch It
Claude Code prompt-cache costs vary by launch path: measurements reveal a large fixed overhead and a subagent fan-out cost multiplier.