where P is the Markov transition matrix and \pi_{i} and \pi_{j} are the equilibrium probabilities of being in states i and j, respectively.