Chapter 12 Multilayer RNN

Part 1 (2020)
1

Hi Everyone,

in Chapter 12 there is a pictorial representation of a multilayer RNN, which I’ve been trying to rebuild.
grafik

I am a little confused about the green dotted arrows. In the previous representaions green arrows were embeddings. But here an embedding wouldn’t make much sense since the output of the previous linear layers isn’t categorial. So are those dotted green arrows supposed to be linear layers?

Regards

2

To my understanding the arrows are simply a representation of the weights. In that sense whether those are embedding weights or other it shouldn’t make much difference.

3

Hi ml0101,
I am pretty sure the green arrow represents the hidden state of the first RNN. It is used as the input sequence to the next layer, which has its own hidden state and output calculation.

HTH,
:slightly_smiling_face:

4

Thanks for your replies. Got it to run now :slight_smile: