I have a basic understanding of Markov Chains but I’m curious as to how they’re used in artificial intelligence. My main two guesses are:
1.) They are used to make decisions (eg. Markov decision process) - By factoring in an action component to the Markov Chain you can use Markov Chains to make decisions in situations where that decision won’t have a definite outcome but will instead adjust the probability of outcomes.
2.) They are used to evaluate the world (eg. Markov Chain Monte Carlo) - As the way the world develops at a high level can seem probabilistic, Markov Chains may allow us to determine possible ways the world will develop.
I know the answer could be both, neither or “right answer, wrong reason” but it’d be great to know not just what they can do but what it is that the AI community is most excited about in terms of what they can do.
Can anyone shed any light on this? Or direct me to a good resource that will do so in their stead?
For a concrete example of Markov models in AI, take a look at the Viterbi search algorithm, which is heavily used in speech and natural language recognition.
I have a basic understanding of Markov Chains but I’m curious as to how they’re used in artificial intelligence. My main two guesses are:
1.) They are used to make decisions (eg. Markov decision process) - By factoring in an action component to the Markov Chain you can use Markov Chains to make decisions in situations where that decision won’t have a definite outcome but will instead adjust the probability of outcomes.
2.) They are used to evaluate the world (eg. Markov Chain Monte Carlo) - As the way the world develops at a high level can seem probabilistic, Markov Chains may allow us to determine possible ways the world will develop.
I know the answer could be both, neither or “right answer, wrong reason” but it’d be great to know not just what they can do but what it is that the AI community is most excited about in terms of what they can do.
Can anyone shed any light on this? Or direct me to a good resource that will do so in their stead?
For a concrete example of Markov models in AI, take a look at the Viterbi search algorithm, which is heavily used in speech and natural language recognition.
Thanks—good example.