» Tag
transformers
14 postsTransformers vLLM Backend Now Matches Native Inference Speed
The transformers vLLM backend now matches native inference speed via torch.fx graph analysis and automatic kernel fusion for LLMs.
Transformer Transformer: A Unified Model for Robot Co-Design
A diffusion transformer that generates and validates complete robot embodiments from motion demos, using unified RoboTokens across robot classes.
Kimi Linear: Hybrid Attention Architecture Beats Full Attention
Kimi Linear's KDA module outperforms full attention, cutting KV cache by 75% and boosting throughput 6x at 1M context.
CommitBrief — AI code reviews, right in your terminal
A provider-agnostic, local-first CLI that reviews your staged changes, a historic range, or a whole GitHub pull request. Zero telemetry, no server. Free and open source.
commitbrief.comRandomized KV-Cache Eviction Enables Verifiable Error Certificates
A new paper shows randomized KV-cache eviction, unlike deterministic top-k, enables verifiable per-step error certificates for LLM serving.
Anthropic Discovers a Global Workspace Inside Language Models
Anthropic's new J-lens technique uncovers an internal region in Claude-like models that behaves like the brain's global workspace of consciousness.
Inside LLM 'private thoughts': J-Space isn't consciousness, it's control
Researchers spot J-Space, an internal workspace in transformers guiding reasoning. Not consciousness, but a practical clue for AI developers and safety.
Compiler Converts Computation Graphs to Vanilla Transformer Weights
Generate transformer weights from computation graphs with a compiler, no training needed.
Meta Launches Muse Glimmer: Local, Agentic, Multimodal, and Open Source
Meta's new Muse Glimmer model is a multimodal AI solution designed for local use cases.
I Trained a 30M-Parameter LLM from Scratch: The Scaling "Floor" Was a Mirage
A 30M parameter language model was trained from scratch, aiming to deepen understanding of transformers.
Building a Multi-Horizon Crypto Prediction System with Transformers
Explore the engineering story of crypto prediction with Transformers. Lessons on transparency and reliability with real metrics.