dm.cs.tu-dortmund.de/en/mlbits/neural-nlp-architectures/
Basic Architectures for NLP – Lecture Notes
RGB]{0,155,170}{= \sigma (W_z \cdot [x_t\circ h_{t-1}] + b_z)}\\ \textcolor[RGB]{0,155,170}{h_t} & \textcolor[RGB]{0,155,170}{= (1-z_t) \odot h_{t-1} + z_t \odot \tilde{h}_t} \end{align*}\]
Sequence-t [...] [ BeSiFr94 ; Hoch91 ]
\[\begin{align*} h_t & = \tanh (W_h \cdot h_{t-1} + W_x \cdot x_t + b_h)\\ & = \tanh (W_{hx} \cdot [ h_{t-1} \circ x_t ] + b_h)\\ y_t & = W_y \cdot h_{t} \end{align*}\]
\(\equiv\) [...] \textcolor[RGB]{0,155,170}{= \sigma (W_o \cdot [y_{t-1} \circ x_t] + b_o)}\\ \textcolor[RGB]{0,155,170}{i_t} & \textcolor[RGB]{0,155,170}{= \sigma (W_i \cdot [y_{t-1} \circ x_t] + b_i)}\\ \textcolor[RGB]{0,155 …
