Markov Chain Visualiser

Build, simulate, and analyse discrete-time Markov chains interactively

Tools

Presets

Transition Matrix

State Diagram

Click to add states. Switch to edge mode to connect them.

State Info

Click a state to see details

Edge Info

Click an edge to edit probability

Validation

Controls

10
1

Statistics

Steps0
Current State-

Simulation View

Visit Frequency

Legend

Empirical frequency
Theoretical stationary dist.

Stationary Distribution π

Empirical vs Theoretical

Convergence: Pn as n increases

1

Row Convergence

Each row of Pn converges to π for ergodic chains

State Classification

Chain Properties

Communicating Classes

Absorption Probabilities

Expected Hitting Times

Transition Matrix P

Pn Power

1

Eigenvalues of P

Eigenvalue Analysis