Logging/Dumping common_params
#10085
Unanswered
stellarpower
asked this question in
Q&A
Replies: 1 comment
-
Okay, maybe I answered my own question. The yaml log directory CLI flag appears to be outputting (at least some of) this stuff. |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
Hi,
Is there an easy way to dump all the parameters that are in play (i.e. the common_params struct), before the first user input is received?
I am noticing a significant discrepancy between using the server and the CLI in conversation mode, with a minimal set of CLI flags (i.e. -ngl, model path, etc., no custom prompt), and also leaving the server setup at the default settings. I'd assumed the CLI's defaults would more or less be the same as the server's, but the model is massively more noisy and tries to run ahead of itself from the CLI whilst it's more on-point in the web interface.
For now I can set some breakpoints and look at the structs, I know there is logic that parameters are edited in-place at certain locations, but if there's no flag for something like this this currently, it'd be nice to be able to dump all the settings out to the console so that I can diff them easily and work out what is different between the two example applications. Bonus points would be in JSON in a way I can also load in, but based on the code I've seen I expect that might be a lot of work without refactoring it.
Thanks!
Beta Was this translation helpful? Give feedback.
All reactions