Definition(s). Px(A)=P(A∣X0=x) Ty=min{n≥1∣Xn=y}, the minimum amount of time it takes to get to state Xn. Pyy=Py(Ty<∞), the probability Xn returns to y having started at y.