Camelid: Local AI Inference in Rust with Multiple Interfaces
Camelid enables local AI inference in Rust with multiple interfaces, running GGUF models directly.
Camelid provides a local web interface that allows you to run GGUF models directly on your hardware. This system operates as a single Rust binary, eliminating the need for Python or Docker, and offers various interfaces including a desktop app, browser chat, and HTTP API. The local-first approach ensures data privacy while hardware acceleration enhances performance.