Model Markov Chain

Build and analyze discrete or continuous Markov chains including transition matrix construction, state classification, stationary distribution computation, and mean first passage times. Use when modeling a memoryless system with observed transition counts or rates, computing long-run steady-state probabilities, determining expected hitting times or absorption probabilities, classifying states as transient or recurrent, or building a foundation for hidden Markov models or reinforcement learning MDPs.

pjt222 Updated 44 repo stars

File contents

pjt222/agent-almanac commit 3561cf5ad8

Frequently asked questions

npx get-skill add pjt222/model-markov-chain