» Tag
machinelearning
75 postsWiFi Weight Streaming for LLM on ESP32
Run Llama-2 architecture on ESP32 via WiFi streaming. RAM usage remains flat, while generation is limited by network bandwidth.
OpenAI's GPT-Red: A Super Hacker LLM for Enhanced Model Security
OpenAI's GPT-Red is a super-hacker LLM that automates security testing, enhancing model defenses against cyber threats.
Giving AI Assistants a Personality: Role, Boundaries, and Awareness
Learn about AI chatbot configuration and the importance of behavioral boundaries.
CommitBrief — AI code reviews, right in your terminal
A provider-agnostic, local-first CLI that reviews your staged changes, a historic range, or a whole GitHub pull request. Zero telemetry, no server. Free and open source.
commitbrief.comMemGhost: Attacker Model Plants Persistent False Memories via Email
MemGhost successfully injects persistent false memories into OpenClaw and Claude Code SDK agents using just one email.
Coding Agents Anticipate Future Edits
Discover how coding agents can predict future code edits, enhancing mechanistic interpretability.
TurboQuant: Four Months After Google's 6x VRAM Claim
Google's TurboQuant algorithm aimed for a 6x memory reduction, but official code is still not released.
The Wrong Number: Origin Part 19
In Origin Part 19, misconfigurations and overlaps in training data were uncovered.
Understanding NVIDIA DGX Spark Environment: From API to GPU, Week 1
Get essential information and commands to start working in the NVIDIA DGX Spark environment. Learn the details of the first week.
I enhanced my Shahed drone detector with multi-sensor Kalman fusion
Sharing my experiences with multi-sensor fusion using Kalman filters for the Shahed-136 detector.
Porting vLLM's Serving Stack to C++20: A 66 MiB Binary Without Python
The C++20 port of vLLM results in a 66 MiB binary without Python dependencies, achieving comparable speeds at high concurrency.