Allow to configure provider from traitlets/command line

[krassowski]

Problem

Currently individual models may receive additional arguments using AIExtension.model_parameters. This only works if one wants to customize one specific model, not all models of a given provider (e.g. setting a proxy URL for all of them).

Proposed Solution

Add AIExtension.provider_parameters with precedence lower than AIExtension.model_parameters.

Additional context

None

[dlqqq]

@krassowski I feel like this issue would be solved if we simply allowed glob expressions matching model IDs to be specified in the allowlist, denylist, and as keys in model_parameters. That way, we don't need 2 traitlets for every configuration field (one model-scoped and one provider-scoped), which I think could be confusing for operators.

I think it's important to recognize that operator personas (e.g. sysadmins) are often less experienced with Jupyter AI than user personas, so ideally, we shouldn't require them to understand the distinction between providers & models when configuring their deployments.

What do you think about implementing model ID globs for traitlets in v3? I can open an issue for that if it seems like a good feature to have in v3.

[krassowski]

Yes, that would work and sounds like indeed less work to maintain - thank you! A regex or a glob would be sufficient.

[krassowski]

Feel free to rename this issue if you prefer that over opening a new one.