Consider the Markov modulated random walk in the figure below. The random variables Yn in this example take on only a single value for each transition, that value being 1 for all transitions from...

Consider the Markov modulated random walk in the figure below. The random variables Yn in this example take on only a single value for each transition, that value being 1 for all transitions from state 1, 10 for all transitions from state 2, and 0 otherwise. ϵ > 0 is a very small number, say ϵ
^-6.