A farmer is considering the optimal course of action for his farm each year. The two options are to fertilize the farm and not to fertilize the farm. Optimality is defined such that the farmer will...

A farmer is considering the optimal course of action for his farm each year. The two options are to fertilize the farm and not to fertilize the farm. Optimality is defined such that the farmer will realize the highest expected revenue at the end of 4 years. The conditions (or states) of the farm are good (state 1), fair (state 2), and poor (state 3). If P_k
and R_k
(k = 1, 2), which represent the transition probability matrix and the reward function matrix respectively, are given by