Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Lipschitz constants for Lipschitz losses ? #148

Open
stephanegaiffas opened this issue Aug 15, 2021 · 1 comment
Open

Lipschitz constants for Lipschitz losses ? #148

stephanegaiffas opened this issue Aug 15, 2021 · 1 comment

Comments

@stephanegaiffas
Copy link

Hi all and thanks for the this very useful package ! It could be helpful to get in addition to the islipschitzcont attribute, another attribute that gives the value of the global Lipschitz constant, e.g. 2 for your scaling of the L2 loss, 1/4 for the logistic loss, etc. If I am not wrong, this is not featured yet in the package ?

This could be particularly useful for some first-order optimization algorithms in ML, where theoretically optimal learning rates can be automatically tuned using Lipschitz constants (and strong convexity constants as well).

If this is welcomed I could try a PR that implements this.

Best !

@juliohm
Copy link
Member

juliohm commented May 22, 2022

@stephanegaiffas can you draft a PR with a proposal? We will be happy to review it.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

2 participants