Stacked/multilayer LSTM with Attention

[lcheong2020]

My model consists of a multi-layer LSTM, an attention layer and a linear layer for binary classification. I need the stacked LSTMs and attention layer to achieve decent performance for a relatively complex task. I'm chugging through your detailed explanation for issue #8 (thank you!) for attention layer.

How would I propagate back the scores through the stacked LSTMs? Any guidance and advice would be much appreciated.