« All posts

Support for GBNF Grammar Added for Local Models

Support for GBNF grammar has been added for local models, ensuring strict output validation.

While working with a local model, it became necessary to create a compatible structure for a GBNF grammar file. This new structure prevents the model from producing outputs in incorrect formats, ensuring reliable results. GBNF provides a way to enforce strict output validation in local models.