You can change the elements of the transition matrix or the initial state of the system. Below is given the result of the computation for periods 1 to 10. The adopted approach is to have the stochastic matrix with rows adding up to 1, rather than columns. The dots stand for the market share of the different cloud providers. Disclaimer: The transition matrix is built just for the sake of the example and does not represent real user preferences.