You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Hi all and thanks for the this very useful package ! It could be helpful to get in addition to the islipschitzcont attribute, another attribute that gives the value of the global Lipschitz constant, e.g. 2 for your scaling of the L2 loss, 1/4 for the logistic loss, etc. If I am not wrong, this is not featured yet in the package ?
This could be particularly useful for some first-order optimization algorithms in ML, where theoretically optimal learning rates can be automatically tuned using Lipschitz constants (and strong convexity constants as well).
If this is welcomed I could try a PR that implements this.
Best !
The text was updated successfully, but these errors were encountered:
Hi all and thanks for the this very useful package ! It could be helpful to get in addition to the islipschitzcont attribute, another attribute that gives the value of the global Lipschitz constant, e.g. 2 for your scaling of the L2 loss, 1/4 for the logistic loss, etc. If I am not wrong, this is not featured yet in the package ?
This could be particularly useful for some first-order optimization algorithms in ML, where theoretically optimal learning rates can be automatically tuned using Lipschitz constants (and strong convexity constants as well).
If this is welcomed I could try a PR that implements this.
Best !
The text was updated successfully, but these errors were encountered: