Markov Chain


#1

Nice blog post with interactive diagrams:

http://setosa.io/blog/2014/07/26/markov-chains/index.html

See the chain as following cycles, except you can get “stuck” in a cycle with various probabilities.


#2

i was searching this and also Markov process :smile:
Markov process i think is the algorithm definition and Markov chain is a part (chain) of the process.
Is interesting to think at it like at the weather process used in video game, actually sometime i was thinking how they can show 5 day sun and 2 days rain but almost never rain sun rain sun rain sun.
actually at first i thought was pattern randomized.

http://www.bewersdorff-online.de/amonopoly/ monopoly as Markov chain

turn bayesian into markovian
http://blog.codinghorror.com/markov-and-you/


#3

Thanks for the info!


#4

markov chain is also interesting for be used in Artificial Intelligence chatbot.