Potential based sensitivity analysis of Markov chains

Xi Ren Cao*

*Corresponding author for this work

Research output: Chapter in Book/Conference Proceeding/ReportBook Chapterpeer-review

1 Citation (Scopus)

Abstract

We propose a new approach to the single-sample-path-based sensitivity analysis of Markov chains. The approach is based on a fundamental concept: performance potentials. Like the potential energy in physics, only the differences between potentials are important. We show that the differences of potentials can be determined by using the group inverse of I - P, where I is the identity matrix and P the transition matrix of the Markov chain. Potentials reflect the system performance in transient periods and can be used to determine the performance sensitivity with respect to a change of the transition matrix. The results provide a general and efficient approach to the single-sample-path-based sensitivity analysis for many engineering systems, for which the standard perturbation analysis does not work well.

Original languageEnglish
Title of host publicationProceedings of the IEEE Conference on Decision and Control
Editors Anon
Publication statusPublished - 1996
EventProceedings of the 1996 35th IEEE Conference on Decision and Control. Part 3 (of 4) - Kobe, Jpn
Duration: 11 Dec 199613 Dec 1996

Publication series

NameProceedings of the IEEE Conference on Decision and Control
Volume1
ISSN (Print)0191-2216

Conference

ConferenceProceedings of the 1996 35th IEEE Conference on Decision and Control. Part 3 (of 4)
CityKobe, Jpn
Period11/12/9613/12/96

Fingerprint

Dive into the research topics of 'Potential based sensitivity analysis of Markov chains'. Together they form a unique fingerprint.

Cite this