摘要：
马尔科夫链是一个具备马尔科夫性的随机过程。马尔科夫性是指：系统在下一步所处状态的条件概率仅与系统当前的状态相关，与系统以前的状态无关。A Markov chain is a sequence of random variables X1, X2, X3, ... with the Markov property, namely that, given the present state, the future and past states are independent. Formally,The possible values of Xi form a countable set S ca 阅读全文