» Tag
cpu-inference
1 postsColibri lets 744B-parameter GLM-5.2 run on just 25GB of RAM
Colibri is a single-file C engine that runs GLM-5.2's 744B MoE model on 25GB RAM with no GPU, streaming experts from NVMe on demand.
» Tag
Colibri is a single-file C engine that runs GLM-5.2's 744B MoE model on 25GB RAM with no GPU, streaming experts from NVMe on demand.