A fair die is tossed repeatedly. The maximum of the first n outcomes is denoted by Xn. Is {Xn: n = 1, 2,...} a Markov chain? Why or why not? If it is a Markov chain, calculate its transition probability matrix, specify the classes, and determine which classes are recurrent and which are transient.
Already registered? Login
Not Account? Sign up
Enter your email address to reset your password
Back to Login? Click here