Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Pytorch implementation #1

Open
bratao opened this issue Nov 22, 2020 · 2 comments
Open

Pytorch implementation #1

bratao opened this issue Nov 22, 2020 · 2 comments

Comments

@bratao
Copy link

bratao commented Nov 22, 2020

Are you planning in any near future an pytorch implementation?
I'm super curious to try LMU in my torch projects!

@arvoelke
Copy link

arvoelke commented Nov 22, 2020

Thanks for letting us know this is wanted! We are currently tracking pytorch support here: nengo/keras-lmu#8 -- and in particular there is a pytorch version of the LMU here: https://github.com/bjkomer/pytorch-legendre-memory-unit but it does not yet support all of the bells-and-whistles, such as multiple memory vectors operating in parallel. The location and name of this repo may also change, but hope this helps as a start. If you have any specific issues or questions the Nengo forum may also be a helpful resource.

@bratao
Copy link
Author

bratao commented Nov 22, 2020

Hi @arvoelke I just tested the https://github.com/AbdouJaouhar/LMU-Legendre-Memory-Unit implementation for my academic research ( ultra long sequence labeling in Legal texts) and the results were fantastic. Slight better than my actual state of art, SRU.
The https://github.com/bjkomer/pytorch-legendre-memory-unit unfortunately archived a much worse result.

I will be waiting anxiously for a more featured and maintained implementation 😍

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Development

No branches or pull requests

2 participants