1. A Markov chain has state space Z = {0, 1, 2, 3, 4} and transition matrix (1) Determine the minimal closed sets. (2) Check, whether inessential states exist. 2. A Markov chain has state space Z =...

1. A Markov chain has state space Z = {0, 1, 2, 3, 4} and transition matrix

(1) Determine the minimal closed sets.

(2) Check, whether inessential states exist.

2. A Markov chain has state space Z = {0, 1, 2, 3} and transition matrix

Determine the classes of essential and inessential states.