Markov Chains

Theory and Applications

Nonfiction, Science & Nature, Mathematics, Applied
Cover of the book Markov Chains by Bruno Sericola, Wiley
View on Amazon View on AbeBooks View on Kobo View on B.Depository View on eBay View on Walmart
Author: Bruno Sericola ISBN: 9781118731536
Publisher: Wiley Publication: August 5, 2013
Imprint: Wiley-ISTE Language: English
Author: Bruno Sericola
ISBN: 9781118731536
Publisher: Wiley
Publication: August 5, 2013
Imprint: Wiley-ISTE
Language: English

Markov chains are a fundamental class of stochastic processes. They are widely used to solve problems in a large number of domains such as operational research, computer science, communication networks and manufacturing systems. The success of Markov chains is mainly due to their simplicity of use, the large number of available theoretical results and the quality of algorithms developed for the numerical evaluation of many metrics of interest.
The author presents the theory of both discrete-time and continuous-time homogeneous Markov chains. He carefully examines the explosion phenomenon, the Kolmogorov equations, the convergence to equilibrium and the passage time distributions to a state and to a subset of states. These results are applied to birth-and-death processes. He then proposes a detailed study of the uniformization technique by means of Banach algebra. This technique is used for the transient analysis of several queuing systems.

Contents

  1. Discrete-Time Markov Chains
  2. Continuous-Time Markov Chains
  3. Birth-and-Death Processes
  4. Uniformization
  5. Queues

About the Authors

Bruno Sericola is a Senior Research Scientist at Inria Rennes – Bretagne Atlantique in France. His main research activity is in performance evaluation of computer and communication systems, dependability analysis of fault-tolerant systems and stochastic models.

View on Amazon View on AbeBooks View on Kobo View on B.Depository View on eBay View on Walmart

Markov chains are a fundamental class of stochastic processes. They are widely used to solve problems in a large number of domains such as operational research, computer science, communication networks and manufacturing systems. The success of Markov chains is mainly due to their simplicity of use, the large number of available theoretical results and the quality of algorithms developed for the numerical evaluation of many metrics of interest.
The author presents the theory of both discrete-time and continuous-time homogeneous Markov chains. He carefully examines the explosion phenomenon, the Kolmogorov equations, the convergence to equilibrium and the passage time distributions to a state and to a subset of states. These results are applied to birth-and-death processes. He then proposes a detailed study of the uniformization technique by means of Banach algebra. This technique is used for the transient analysis of several queuing systems.

Contents

  1. Discrete-Time Markov Chains
  2. Continuous-Time Markov Chains
  3. Birth-and-Death Processes
  4. Uniformization
  5. Queues

About the Authors

Bruno Sericola is a Senior Research Scientist at Inria Rennes – Bretagne Atlantique in France. His main research activity is in performance evaluation of computer and communication systems, dependability analysis of fault-tolerant systems and stochastic models.

More books from Wiley

Cover of the book Inside Private Equity by Bruno Sericola
Cover of the book Fundamentals of Applied Pathophysiology by Bruno Sericola
Cover of the book Active Value Investing by Bruno Sericola
Cover of the book Passion Into Profit by Bruno Sericola
Cover of the book Dynamics of Housing in East Asia by Bruno Sericola
Cover of the book Soil Mechanics by Bruno Sericola
Cover of the book The Cunning of Uncertainty by Bruno Sericola
Cover of the book Golden Retrievers For Dummies?, Mini Edition by Bruno Sericola
Cover of the book Wiley-Schnellkurs Analysis by Bruno Sericola
Cover of the book Physicochemical and Biomimetic Properties in Drug Discovery by Bruno Sericola
Cover of the book Saxophone For Dummies by Bruno Sericola
Cover of the book The Handbook of Phonetic Sciences by Bruno Sericola
Cover of the book Working with Female Offenders by Bruno Sericola
Cover of the book Nanoparticulate Drug Delivery Systems by Bruno Sericola
Cover of the book Behavioral Finance and Investor Types by Bruno Sericola
We use our own "cookies" and third party cookies to improve services and to see statistical information. By using this website, you agree to our Privacy Policy