You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Update the input block to support the pre-trained embeddings:
Add a module to extract pre-trained embeddings
Show an example of how to transform pre-trained embeddings before aggregating them with the other trainable embeddings in the model. Such as Layer Normalization or MLP layer.
Update DLRM, DeepFM, etc to include an optional projection layer for combining pretrained embeddings with the other embeddings in the model.
Implement and evaluate different aggregation methods to combine pre-trained embeddings with the other trainable embeddings.
Add an example demonstrating support for pretrained embeddings for DLRM or another non session based model. Artificial example? KDD cup?
Constraints
Dataloader should support fixed-size 3D tensors.
Dataloader needs to add a tag to the pre-trained embeddings so that the T4R input module can differentiate between trainable features and pre-trained embeddings.
The text was updated successfully, but these errors were encountered:
Update the input block to support the pre-trained embeddings:
Add a module to extract pre-trained embeddings
Show an example of how to transform pre-trained embeddings before aggregating them with the other trainable embeddings in the model. Such as
Layer Normalization
orMLP layer
.Update DLRM, DeepFM, etc to include an optional projection layer for combining pretrained embeddings with the other embeddings in the model.
Implement and evaluate different aggregation methods to combine pre-trained embeddings with the other trainable embeddings.
Add an example demonstrating support for pretrained embeddings for DLRM or another non session based model. Artificial example? KDD cup?
Constraints
The text was updated successfully, but these errors were encountered: