You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Currently the prompt style is created on model generation and cannot easily be changed.
However it would make sense to update the system prompt for each generation. to offer more flexibility.
While the PromptStyle format is defined for each supported model architecture, there is no need to enforce the system prompt text itself.
Therefore I suggest an extension to the PromptStyle class to update the system prompt
The text was updated successfully, but these errors were encountered:
Thanks for the suggestion. This is a reasonable extension. Unfortunately, I currently don't have the capacity to work on it, but maybe my colleagues can weigh in here.
Currently the prompt style is created on model generation and cannot easily be changed.
However it would make sense to update the system prompt for each generation. to offer more flexibility.
While the
PromptStyle
format is defined for each supported model architecture, there is no need to enforce the system prompt text itself.Therefore I suggest an extension to the
PromptStyle
class to update the system promptThe text was updated successfully, but these errors were encountered: