Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[FEA] Train a model with multiple optimizers #308

Open
sararb opened this issue Mar 29, 2022 · 0 comments
Open

[FEA] Train a model with multiple optimizers #308

sararb opened this issue Mar 29, 2022 · 0 comments

Comments

@sararb
Copy link
Contributor

sararb commented Mar 29, 2022

🚀 Feature request

Train different parts of the model with different optimizers.

Motivation

The feature request is mainly motivated by the implementation of the Wide&Deep model that jointly trains the wide and deep components with two different optimization algorithms.

Your contribution

TensorFlow Recommenders supports the CompositeOptimizer class that allows different optimizers to be applied to different subsets of the model's variables. Following the same structure, we can define a MultiBlockOptimizers class that allows different optimizers to be applied to different subsets of the model’s blocks.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

1 participant