The general idea when working with sequences is to break down the problem into a smaller decisions.
LSTM blog post [1] .
References
[1]
Christopher Olah (2015). Understanding LSTM Networks. http://colah.github.io/posts/2015-08-Understanding-LSTMs/.