» Tag
llm
535 postsRunning Kimi K3, a 2.8T-Parameter MoE Model, on an M1 Mac
Deltafin runs Kimi K3, a 2.8T-parameter MoE model, on a 64GB M1 Mac via full local install or expert streaming, no cluster required.
Ctxdiff Brings Git-Style Diffing to LLM Agent Context Windows
Ctxdiff is a local-first, open-source tool that applies git-style diffing to LLM agent context windows, turn by turn.
Static Scanner Finds 30 Unguarded Destructive Actions in AI Agent Frameworks
An open-source scanner analyzed 25 AI agent frameworks and confirmed 30 cases where models can delete data, deploy, or send webhooks unauthorized.
CommitBrief — AI code reviews, right in your terminal
A provider-agnostic, local-first CLI that reviews your staged changes, a historic range, or a whole GitHub pull request. Zero telemetry, no server. Free and open source.
commitbrief.comToolgz cuts LLM tool-definition tokens by ~80% without accuracy loss
Toolgz reduces LLM tool-definition token usage by ~80% while preserving accuracy, validated across 420 runs on four frontier models.
28.9M Parameter LLM Runs Fully On-Device on an $8 Microcontroller
An 28.9M parameter LLM runs entirely offline on an $8 ESP32-S3 chip using Google's Per-Layer Embeddings technique for flash-based storage.
@ttsc/graph: A Compiler-Built Code Graph MCP for AI Agents
@ttsc/graph is an MCP server using the TypeScript compiler's own type-check to build a code graph, cutting AI agent token use by about 90%.
Agent-Native Software Engineering: Why Specs Alone Aren't Enough
Coding agents fail less at writing code than at holding architectural context. A look at spec-driven development's limits and what comes next.
Are AI Labs Gaming the Pelican-on-a-Bicycle Benchmark?
A statistical study generates 1,008 SVGs across 7 LLMs to test whether AI labs are secretly optimizing for the famous pelican-on-a-bicycle benchmark.
GPT-5.6 vs Claude Fable 5: Benchmarking Physical AI Simulation
JuliaHub compares GPT-5.6 and Claude Fable 5 in its Dyad agent on five physical modeling problems, revealing cost, speed, and validation trade-offs.
LLM-Assisted Formal Verification Uncovers Two Critical nftables Bugs
Basis used LLM-guided formal verification in Rocq to audit Linux's nftables optimizer, uncovering two critical bugs since 2022.