» Tag
llm
535 postsMy Local LLM Scored 6/6 but Was Wrong Every Time
Discover the difference between answer format and value in local LLM evaluations.
Kdrant 1.1 and Kmemo 1.0: Qdrant Client and LLM Cache Innovations
Kdrant 1.1 and Kmemo 1.0 introduce a Qdrant client and an innovative LLM cache.
Axiom UI: An Open-Source UI Library Designed for LLMs
Axiom UI is an open-source UI library optimized for LLMs, featuring 12 components available on npm.
CommitBrief — AI code reviews, right in your terminal
A provider-agnostic, local-first CLI that reviews your staged changes, a historic range, or a whole GitHub pull request. Zero telemetry, no server. Free and open source.
commitbrief.comTTFT Benchmark: Comparison of LLM Gateway and OpenRouter
LLM Gateway is 35% faster than OpenRouter. Explore TTFT benchmark results and their importance for engineers.
Proxy for OpenAI Codex and Claude Code: Use Any LLM with Them
Use opencodex as a universal proxy for OpenAI Codex and Claude Code with any LLM.
LLM Context Profiler: A Tool for Tracking Context Usage by Agents
ContextSpy analyzes LLM API requests to track and optimize context usage.
I Built a Simple Tool to Observe My AI Agents' Activities
Otterscope, a tool I built for monitoring small LLM agents, offers an efficient and user-friendly solution for observing agent activities.
Can LLMs Achieve Deep Understanding of Computer Architecture Papers?
Exploring the ability of large language models to deeply understand computer architecture papers through the Gauntlet pipeline, which shows significant advantages in analysis.
LLM Evaluations for Developer Tools: Useful, Correct, Safe
How to evaluate LLM features in developer tools across correctness, usefulness, and safety.
Why DB Connections Are Not Held During Slow LLM Calls
Not holding DB connections during LLM calls enhances performance in AI systems. We explore this using the Honcho example.