SMS dit: Markov chains: models, algorithms and applications