» Tag
llama
6 postsNo Fine-Tuning: Facts Hand-Wired Directly Into Llama-3.1-8B's Weights
A mechanistic-interpretability method hand-wires facts into Llama-3.1-8B's weights without fine-tuning, LoRA, or RAG — with a live neuron visualizer.
Benchmarking Inference Energy Costs of LLM: A LLaMA Study
Researchers benchmark LLaMA model sizes on V100 and A100 GPUs to analyze the energy and compute costs of LLM inference at scale.
Llama.cpp PR Boosts Q2_0 Performance 3.0–3.6x on x86 CPUs
The new llama.cpp PR enhances Q2_0 performance on x86 CPUs by 3.0–3.6x. Learn more.
CommitBrief — AI code reviews, right in your terminal
A provider-agnostic, local-first CLI that reviews your staged changes, a historic range, or a whole GitHub pull request. Zero telemetry, no server. Free and open source.
commitbrief.comLlamafile vs vLLM: Two Ways to Serve a Local Model
Explore the differences between Llamafile and vLLM for serving local models and their respective advantages.
Compiling llama.cpp on Debian 12/13 and Cross Compiling for ARM64
Learn how to compile llama.cpp natively and cross-compile for ARM64 on Debian 12/13.
llama.cpp CPU Offload Optimizations
Explore CPU offload optimizations for llama.cpp: disable CUDA graphs and target FFN sub-layers.