Alle boeken

Professioneel

Apps Over Coach Inloggen Begin met lezen

Quantitative Finance · Begrippenlijst

Wat is Markov chain, continuous-time Markov chain?

Ook bekend als: Markov chain · continuous-time Markov chain

Definition 8.1 Quantitative Methods · Hoofdstuk 8 — Markov Chains and Queues

A Markov chain is a Markov process with a countable state space, observed at integer times, with transition matrix Pij=P(Xn+1=j∣Xn=i)P_{ij} = \P(X_{n+1} = j \mid X_n = i). A continuous-time Markov chain is a right-continuous Markov process (Xt)t≥0(X_t)_{t\ge0} with a countable state space whose transition probabilities Pij(t)=P(Xs+t=j∣Xs=i)P_{ij}(t) = \P(X_{s+t} = j \mid X_s = i) do not depend on ss.

Lees in het hoofdstuk →