Gbnf checker + validator

[supersteves]

Hi there,

Currently I'm using a gbnf file I've generated myself and the only way I currently have to test it is to ask the LLM to mirror what I say and then see if it emits the same content. Fairly flaky at best.

I'd like to (a) validate my gbnf by running some command (rather than wait for and try to spot a stderr message on the console)
and (b) test whether my input test directly fits the grammar, without invoking the LLM.

I've been through https://github.com/ggerganov/llama.cpp/blob/master/grammars/README.md which isn't entirely clear on some aspects of character escaping (I found the answer in the parser code),
and I've seen https://github.com/ggerganov/llama.cpp/tree/master/examples/gbnf-validator but have no idea how to build/run this.

Any help or pointers would be much appreciated.

[edwin0cheng]

It is called llama-gbnf-validator, and you don't need to build it separately.

[supersteves]

Duh, my bad. Wasn't using my own build. make llama-gbnf-validator at the top level, and I'm good. Thanks.