» Tag
llm
536 postsNew study finds language models memorize about 3.6 bits per parameter
Researchers unveil a method to measure LLM memorization capacity, finding GPT-style models store roughly 3.6 bits of information per parameter, with implications for grokking and scaling.
Subtext Visualizes an LLM's Internal Reasoning in Real Time
Subtext is an open-source tool that applies Anthropic's Jacobian lens to visualize a local LLM's internal representations live during conversation.
Layer-First Pattern Cuts LLM Overload in Map Generation
RidgeText stores map layers server-side instead of passing raw GeoJSON to the LLM, cutting tool-call context from roughly 125,000 tokens down to about 150.
CommitBrief — AI code reviews, right in your terminal
A provider-agnostic, local-first CLI that reviews your staged changes, a historic range, or a whole GitHub pull request. Zero telemetry, no server. Free and open source.
commitbrief.comEncoding Team Standards into AI Instructions
Why senior engineers' tacit knowledge causes inconsistency in AI-assisted development, and how it can be turned into executable, versioned instructions.
Building a Model-Agnostic Vulnerability Discovery Harness
Project Glasswing details a model-agnostic security harness that scans 128 repos across a fleet, avoiding lock-in to any single frontier AI model.
Scaling LLM Usage with LiteLLM: Monitoring, Quotas and Spend
Midas engineers explain how they built a unified LiteLLM gateway to centralize LLM observability, spend tracking, and per-environment quotas.
I built a C++20 LLM gateway using io_uring
Details on the C++20 LLM gateway llmbridge developed at Kottos AI, focusing on performance improvements.
Arrowproof: Verify LLM-Generated Architecture Diagrams Against Code
Arrowproof verifies architecture diagrams drawn by LLMs against actual code imports.
Improving 25 Square Packing Upper Bounds Through Evolutionary LLM Search
Explore how LLM-driven evolutionary search broke 25 square packing records. Discover new methods and algorithms used in this innovative process.
Full-fabric VHDL LLM Inference Engine: Runs Qwen3.5-class
The full-fabric VHDL LLM inference engine runs Qwen3.5-class transformer inference on FPGA.