Home > Markov Chains > Chapter Test >
     
Markov Chains
Chapter Test

1 .       Is the following matrix a transition matrix for a Markov chain problem?

9m3q1.gif 



2 .       Write a transition matrix based on the following information:
Among the faculty at a university, 70% of the faculty who order the university's yearbook one year will order it again the next year. 90% of the faculty who do not order the yearbook one year will also not order it the next year. 



3 .       Consider a Markov chain with transition matrix 9m3q3.gif
Note that two states are possible; let's call them state A and state B, so that, for example, the probability that a person moves from state A in one month to state B in the next month is 0.7. Suppose that in January, the population is evenly divided between states A and B. Find the state matrix which gives the distribution between states A and B in March. 



4 .       Is the transition matrix 9m3q4.gif a regular transition matrix? 



5 .       Which of the following is the steady state matrix for the transition matrix 9m3q5.gif 



6 .       What is the initial augmented matrix you would use in attempting to solve for the steady state matrix for 9m3q6.gif 



7 .       Which of the following is the steady state matrix for the transition matrix 9m3q7.gif 



8 .       Which of the following is true about the transition matrix 9m3q8.gif 



9 .       For the absorbing Markov chain with transition matrix 9m3q9.gif what is the average number of steps that an element in state 2 will spend in state 2 before it reaches an absorbing state? 



10 .       For the absorbing Markov chain with transition matrix 9m3q10.gif what is the probability that an element originally in state 1 will go to absorbing state 4? 



11 .       What is the steady state matrix for the transition matrix is 9m3q11.gif 



12 .       If the initial state matrix is (1/3 1/3 1/3) and the transition matrix is 9m3q12.gif then what Is the state matrix after 4 steps? 



13 .       For the absorbing Markov chain whose transition matrix is 9m3q13.gif find the fundamental matrix, F. 



14 .       For the absorbing Markov chain whose transition matrix is 9m3q14.gif what is the probability that an element originally in state 1 will go to absorbing state 4? 



15 .       If the initial state matrix is (0.4 0 0.6) and the transition matrix is 9m3q15.gif then what is the state matrix after 2 steps? 



Answer choices in this exercise are randomized and will appear in a different order each time the page is loaded.





Copyright © 1995-2008, Pearson Education, Inc., publishing as Pearson Prentice Hall Legal and Privacy Terms