dm.cs.tu-dortmund.de/mlbits/sequential-models-maximum-entropy-models/
Maximum Entropy Markov Models (MEMM) – Lecture Notes
Bias Problem [ LaMcPe01 ]
In \(y_1\) , \(y_1\rightarrow y_2\) is most likely
In \(y_2\) , \(y_2\rightarrow y_2\) is most likely
\(P(\textcolor[RGB]{132,184,24}{y_1,y_1,y_1,y_1}) = .4\cdot .45 \cdot .5 = 0 [...] max}_{y^{(*)} } P(y^{(1)},\ldots, y^{(T)} \vert x^{(1)},\ldots, x^{(T)} ) & = \operatorname {arg\, max}_{y^{(*)} } \tfrac {P(y^{(1)},\ldots, y^{(T)}, x^{(1)},\ldots, x^{(T)}) }{P(x^{(1)},\ldots, x^{(T)} )} [...] r[RGB]{0,155,170}{y_1,y_2,y_1,y_2}) = .6\cdot .2 \cdot .5 = 0.06\)
\(P(\textcolor[RGB]{191,2,127}{y_1,y_1,y_2,y_2}) = .4\cdot .55 \cdot .3 = 0.066\)
Most likely path: always \(y_1\)
Average outgoing weight …