The definition of “markov chains” is written on demand for people. Open this page in a browser to read it.