Markov Chains

Theory and Applications

Nonfiction, Science & Nature, Mathematics, Applied
Cover of the book Markov Chains by Bruno Sericola, Wiley
View on Amazon View on AbeBooks View on Kobo View on B.Depository View on eBay View on Walmart
Author: Bruno Sericola ISBN: 9781118731536
Publisher: Wiley Publication: August 5, 2013
Imprint: Wiley-ISTE Language: English
Author: Bruno Sericola
ISBN: 9781118731536
Publisher: Wiley
Publication: August 5, 2013
Imprint: Wiley-ISTE
Language: English

Markov chains are a fundamental class of stochastic processes. They are widely used to solve problems in a large number of domains such as operational research, computer science, communication networks and manufacturing systems. The success of Markov chains is mainly due to their simplicity of use, the large number of available theoretical results and the quality of algorithms developed for the numerical evaluation of many metrics of interest.
The author presents the theory of both discrete-time and continuous-time homogeneous Markov chains. He carefully examines the explosion phenomenon, the Kolmogorov equations, the convergence to equilibrium and the passage time distributions to a state and to a subset of states. These results are applied to birth-and-death processes. He then proposes a detailed study of the uniformization technique by means of Banach algebra. This technique is used for the transient analysis of several queuing systems.

Contents

  1. Discrete-Time Markov Chains
  2. Continuous-Time Markov Chains
  3. Birth-and-Death Processes
  4. Uniformization
  5. Queues

About the Authors

Bruno Sericola is a Senior Research Scientist at Inria Rennes – Bretagne Atlantique in France. His main research activity is in performance evaluation of computer and communication systems, dependability analysis of fault-tolerant systems and stochastic models.

View on Amazon View on AbeBooks View on Kobo View on B.Depository View on eBay View on Walmart

Markov chains are a fundamental class of stochastic processes. They are widely used to solve problems in a large number of domains such as operational research, computer science, communication networks and manufacturing systems. The success of Markov chains is mainly due to their simplicity of use, the large number of available theoretical results and the quality of algorithms developed for the numerical evaluation of many metrics of interest.
The author presents the theory of both discrete-time and continuous-time homogeneous Markov chains. He carefully examines the explosion phenomenon, the Kolmogorov equations, the convergence to equilibrium and the passage time distributions to a state and to a subset of states. These results are applied to birth-and-death processes. He then proposes a detailed study of the uniformization technique by means of Banach algebra. This technique is used for the transient analysis of several queuing systems.

Contents

  1. Discrete-Time Markov Chains
  2. Continuous-Time Markov Chains
  3. Birth-and-Death Processes
  4. Uniformization
  5. Queues

About the Authors

Bruno Sericola is a Senior Research Scientist at Inria Rennes – Bretagne Atlantique in France. His main research activity is in performance evaluation of computer and communication systems, dependability analysis of fault-tolerant systems and stochastic models.

More books from Wiley

Cover of the book A Companion to Relativism by Bruno Sericola
Cover of the book A Companion to American Gothic by Bruno Sericola
Cover of the book Wide Band Gap Semiconductor Nanowires 2 by Bruno Sericola
Cover of the book Health Communication by Bruno Sericola
Cover of the book Basic English Grammar For Dummies - US by Bruno Sericola
Cover of the book Buying and Selling Laboratory Instruments by Bruno Sericola
Cover of the book Coaching Salespeople into Sales Champions by Bruno Sericola
Cover of the book Verhaltensanalyse im Controlling by Bruno Sericola
Cover of the book Words of the World by Bruno Sericola
Cover of the book The Horn of Africa by Bruno Sericola
Cover of the book Digital Macro and Close-Up Photography For Dummies by Bruno Sericola
Cover of the book Email Marketing By the Numbers by Bruno Sericola
Cover of the book Nonlinear Parameter Optimization Using R Tools by Bruno Sericola
Cover of the book Bioanalytics by Bruno Sericola
Cover of the book Metrology and Standardization for Nanotechnology by Bruno Sericola
We use our own "cookies" and third party cookies to improve services and to see statistical information. By using this website, you agree to our Privacy Policy