Train Evo in hyena-dna pytorch lighting framework

[GUOSHU-COOL]

Dear HazyResearch team，
I am trying to train Evo，but I noticed that Evo does not support a training code，so I thought Hyena-DNA might be similar to Evo, so I attempted to adapt Evo model to the Hyena-DNA Pytorch Lighting training framework. However I am finding it quite difficult，and I'm unsure whether it's because I haven't found the right approach or it's inherently challenging.

Additionally I have a question about the difference between Evo and Hyena-DNA: why does Evo use 'stripedhyena' package but Hyena-DNA doesn't? I would also appreciate any examples of how to train Evo using this framework , or other frameworks like Hugging Face.

[Zymrael]

The full pretraining code for Evo will be released in the next month or two, I'd recommend waiting for that

stripedhyena is an inference package that implements efficient cached generation with different Hyena layers