Consdier adding an AI chatbot, trained with frameworks, to provide suggestions

[mattaereal]

What content are you looking to add?

A simple AI chatbot, trained with frameworks, to help people access the information better.

Why do you think it is important?

Despite having tags, or filtering by roles, it could be a good idea to explore better ways to instruct or guide users to much more digested information.

Can you cite resources where to base the content from?

It's not exactly content, more like an improvement to the UI/UX.

[Robert-MacWha]

Are you after better search or direct instruction?

For better search — just incorporating fuzzy search could work to improve UX (thought it seems like mdbook may not support this yet?).

I would worry about resource requirements for running a LLM. I don't think any of the local ones are small enough to fit in a browser while being actually useful, and renting out AWS to run our own fine-tuned model seems like it would be costly.

[mattaereal]

Maybe we can postpone this a few months or years until a small LLM can be implemented cheap and easily. Fuzzy search would be ideal, not a replacement for this but a great idea.

I haven't been able to find something quick to implement yet