The definition of “markov chain” is written on demand for people. Open this page in a browser to read it.