~/blog/tutorials/deep-learning

Advanced

Jul 3, 20268 min read

Bidirectional RNN — Architecture & Intuition

Every LSTM and GRU covered so far processes a sequence in one direction — left to right, using only what's already been seen. That's the right constraint for ge…

Tutorial

Jul 3, 20268 min read

Encoder-Decoder (Seq2Seq) — In-depth Intuition

Every architecture covered so far — classification, tagging, even bidirectional context — assumes there's a natural one-to-one or fixed relationship between inp…

Tutorial

Jul 3, 20268 min read

Problems with Encoder-Decoder

The seq2seq architecture from the previous post works — and was a genuine breakthrough for machine translation when it appeared. But it has a specific, well-doc…