Inference for custom trained finetuned models

[Capt4in-Levi]

Help regarding loading custom trained models

Hi, is it possible to add support for inference of Keras Models?

[OlivierDehaene]

As long as you can export weights with the correct layout to Safetensors, yes.

[Capt4in-Levi]

I see, is there any documentation for loading the models from a local directory? Any argument to pass for offline/local models? It is looking for URL when I passed the local directory path to --model-id