An LLM Runtime Booting from USB: NightRun
NightRun is an LLM runtime that boots from USB, operating without an OS. It is written in Rust.
NightRun is an LLM runtime that boots from USB and operates without a conventional operating system. Written in Rust, this application is directly initiated by the machine's firmware, loading the language model entirely into RAM. It runs on x86_64 PCs and the Raspberry Pi 5.
This synthesis was produced from its source by AI; there is no human editor or manual review step. How we work