Let All other transition rates are 0. a) Solve the steady-state equations and show that p i = 2 -i-1 for all i ≥ 0. b) Find the transition probabilities for the embedded Markov chain and show that the...

All other transition rates are 0.

a) Solve the steady-state equations and show that p_i
= 2^-i-1
for all i ≥ 0.

b) Find the transition probabilities for the embedded Markov chain and show that the chain is null recurrent.

c) For any state i, consider the renewal process for which the Markov process starts in state i and renewals occur on each transition to state i. Show that, for each i 1, the expected inter-renewal interval is equal to 2.

d) Show that the expected number of transitions between each entry into state i is infinite. Explain why this does not mean that an infinite number of transitions can occur in a finite time.