« All posts

Catch your local LLM falling back to CPU

Picchio is a Python file that checks your local LLM setup, showing if the GPU really did the work.

Picchio is a Python file designed to check local LLM setups. This tool helps users determine if the GPU is truly engaged and at what speed it operates. By analyzing model files, users can see the performance differences between GPU and CPU.