[FEATURE] Allow Config of Local LLM to use with AI Chat feature

[moringaman]

I love the fact that we can now use an Open Ai api key within the new Ai Chat feature but also think that it would be great if you could add support for using an LLM hosted locally for this also. I like many developers use things like Ollama to run various models locally and this would be a great cost saving alternative, which would allow us to use models which have been trained on our own codebases.

I also wouldn't have thought that this would be that big a lift for the RunJs team.

Thanks :-)

[lukehaas]

Thanks @moringaman. I'd like to provide local LLM support at some point.

I also wouldn't have thought that this would be that big a lift for the RunJs team.

This might be true if there were a RunJS team 😅