We introduce Markov chains -- a very beautiful and very useful kind of stochastic process -- and discuss the Markov property, transition matrices, and statio...
harvard, statistics, stat, math, probability, markov chains, markov property, transition matrices, stationary distribution