SigLIP 2 Text Embedding Server on CPU with Rust and ONNX
The CPU-only SigLIP 2 text embedding server, built with Rust and ONNX, is ideal for live queries when GPU resources are limited.
The SigLIP 2 embedding server, built with Rust and ONNX Runtime, operates solely on CPU for live text queries when GPU resources are limited. It provides an OpenAI-compatible embeddings endpoint, allowing existing clients to connect without needing a specific SigLIP 2 wrapper. This setup is crucial for efficiently managing workloads where GPU availability is constrained.