EULLM: EU-Sovereign LLM Engine for Windows, Linux, and Mac
EULLM is an open-source LLM engine aimed at EU sovereignty, achieving 10 tok/s on ARM CPU without GPU.
EULLM is an open-source, Rust-based inference engine that operates without Python or Docker. It currently supports Linux x64, Windows x64, and macOS, with experimental ARM64 support. Recent tests show a 35B MoE model running on an ARM CPU without GPU at 10 tok/s, marking a significant step towards reducing GPU dependency in EU AI infrastructure.