Today's Top Engineering Stories: Inkling-Small 276B Model Launch, CPU LLM Prompt Hacks, and GitHub's 15x Speedup
Thinking Machines released Inkling-Small, a 276-billion-parameter open-source AI model that outperforms its larger predecessor on several benchmarks, cutting compute requirements and cost for enterprises. Meanwhile, OpenAI engineers detailed the multi-layered agent loop behind Codex and ChatGPT Work, showing how a harness, API, and inference layer work together and how reducing duplicated work across iterations can significantly lower latency and cost.
NVIDIA’s AI Red Team identified four universal failure modes after six months of assessing AI agents: missing access controls, tools that allow arbitrary code execution, absent network egress restrictions, and plaintext secrets. Their tests showed that even with LLM-based review or allowlists, command-line tools remain high-risk when attacker-influenced input can trigger malicious execution.
In performance engineering, an engineer running a CPU-first llama.cpp server found that reformatting prompts outperformed coarser quantization: Q4_0 gave a 37% speedup but caused factual errors in 25% of answers, while prompt reformatting preserved accuracy and boosted prefill speed. GitHub’s Blackbird code search team achieved a 15x speedup in case-folding by removing an ASCII fast-path optimization that accidentally blocked compiler vectorization. A detailed breakdown of Docker build caching revealed three distinct caches with separate invalidation rules, and showed that manifest-first layer ordering drastically reduces rebuild times when source code changes.
On the robotics front, OpenNeoData published the largest tactile-robotics dataset yet: over 200,000 trajectories and 5,000 hours of visuotactile data across six embodiments, accompanied by two models pretrained on tactile input at scale. Other teams sidestepped expensive sensors entirely—one infers contact fields from 500,000 hours of human video, while others use affordable hardware to make tactile sensing more accessible.
In creative defenses against AI scraping, ShieldFont introduced an open-source web font that uses OpenType GSUB rules to serve human readers the original text while giving scrapers a semantically different but fluent decoy, raising the collective cost of large-scale ingestion. In hardware hacking, an engineer reverse-engineered the Attack Shark X86 keyboard protocol by patching the vendor’s Electron app to log HID reports, reconstructing the full 64-byte feature report protocol and enabling configuration from Linux.
Finally, ZeroFS shipped a native Rust kernel module that replaces its FUSE-based client, speaking the 9P2000.L.Z protocol directly and integrating with netfslib to eliminate userspace round trips for network filesystem operations.
» Statistics
- Posts
- 29
- Reads
- 2
- Avg. score
- 7.6
» Most read
- Why reformatting prompts beats quantization for CPU LLM inference
- Tactile Data for Robots: Five Approaches, One Unanswered Cost Question
- I Have Trained a Model to Predict My Blood Sugar
- ZeroFS adds a native Rust Linux kernel module, bypassing FUSE
- ShieldFont: A Web Font That Makes AI Scraping Costly
- Ratchet 0.3.1: CDI-native Job Scheduler Now Runs on Quarkus, JVM, and Native
- Why removing an optimization made GitHub's case-folding 15x faster
- Progress in Compiling Linux with gccrs
- New Defcon Badges Feature Open-Source Chip as Security Key
- Request for Spawn() API in JavaScript Threads
» Top scored
- Why reformatting prompts beats quantization for CPU LLM inference
- Tactile Data for Robots: Five Approaches, One Unanswered Cost Question
- ShieldFont: A Web Font That Makes AI Scraping Costly
- ZeroFS adds a native Rust Linux kernel module, bypassing FUSE
- NVIDIA Outlines Four Controls for Securing AI Agents
- Why removing an optimization made GitHub's case-folding 15x faster
- The physics of Docker build caching: three caches, one wave
- How one engineer reverse engineered the Attack Shark keyboard protocol
- Inside OpenAI's Agent Loop: How Harness, API, and Inference Cut Costs
- Thinking Machines Launches Inkling Small Open Source AI Model