» Tag
llm
535 postsAvoid Putting an LLM Behind an MCP Server
Explore the issues of placing LLMs behind MCP servers and their importance for engineers. Focus on speed and efficiency.
Context Engineering with Dex Horthy
Explore context engineering with Dex Horthy in our latest podcast episode. Learn about LLM context limitations and software development automation.
Hardware-Friendly LLM Design: AI Model Co-Design
How to balance accuracy, throughput, and interactivity in AI model design? Key insights into hardware-friendly LLM design.
CommitBrief — AI code reviews, right in your terminal
A provider-agnostic, local-first CLI that reviews your staged changes, a historic range, or a whole GitHub pull request. Zero telemetry, no server. Free and open source.
commitbrief.comStop Using LangChain for Simple LLM Tasks
Discover the benefits of using the Raw Anthropic SDK over LangChain for cost savings and clarity.
Previous-Token Prediction Based LLM Near-Exact Prompt Reconstruction
A new approach for prompt reconstruction in LLMs using previous-token prediction is introduced.
ts-rust: An Experimental Rust Port of the TypeScript 7 Compiler
ts-rust is an experimental Rust port of the TypeScript 7 compiler, offering a fast and effective type checker.
Infinite-Parameter LLMs: Generating and Adapting Weights from Live Data
The Infinite-Parameter LLM enables language models to learn from live data, enhancing adaptability and performance.
Bobbin: Pentest with a Local LLM, Keeping Target Data Secure
Bobbin enables secure code reviews with local LLMs, ensuring sensitive data remains private during penetration testing.
When LLMs Outperform Statistical Models in Insurance Pricing
Research highlights how LLMs can outperform traditional models in insurance pricing under limited data conditions.
Co-Designing AI Models Using Speculative Decoding
Explore how speculative decoding accelerates LLM inference while maintaining accuracy. Five guidelines for optimizing draft length are provided.