Understanding Markov Chains

Examples and Applications

Nonfiction, Science & Nature, Mathematics, Statistics
Cover of the book Understanding Markov Chains by Nicolas Privault, Springer Singapore
View on Amazon View on AbeBooks View on Kobo View on B.Depository View on eBay View on Walmart
Author: Nicolas Privault ISBN: 9789811306594
Publisher: Springer Singapore Publication: August 3, 2018
Imprint: Springer Language: English
Author: Nicolas Privault
ISBN: 9789811306594
Publisher: Springer Singapore
Publication: August 3, 2018
Imprint: Springer
Language: English

This book provides an undergraduate-level introduction to discrete and continuous-time Markov chains and their applications, with a particular focus on the first step analysis technique and its applications to average hitting times and ruin probabilities. It also discusses classical topics such as recurrence and transience, stationary and limiting distributions, as well as branching processes. It first examines in detail two important examples (gambling processes and random walks) before presenting the general theory itself in the subsequent chapters. It also provides an introduction to discrete-time martingales and their relation to ruin probabilities and mean exit times, together with a chapter on spatial Poisson processes. The concepts presented are illustrated by examples, 138 exercises and 9 problems with their solutions.

View on Amazon View on AbeBooks View on Kobo View on B.Depository View on eBay View on Walmart

This book provides an undergraduate-level introduction to discrete and continuous-time Markov chains and their applications, with a particular focus on the first step analysis technique and its applications to average hitting times and ruin probabilities. It also discusses classical topics such as recurrence and transience, stationary and limiting distributions, as well as branching processes. It first examines in detail two important examples (gambling processes and random walks) before presenting the general theory itself in the subsequent chapters. It also provides an introduction to discrete-time martingales and their relation to ruin probabilities and mean exit times, together with a chapter on spatial Poisson processes. The concepts presented are illustrated by examples, 138 exercises and 9 problems with their solutions.

More books from Springer Singapore

Cover of the book Eastern Asian Population History and Contemporary Population Issues by Nicolas Privault
Cover of the book Business and Management Practices in South Asia by Nicolas Privault
Cover of the book Gender, Care and Migration in East Asia by Nicolas Privault
Cover of the book Fibrous and Textile Materials for Composite Applications by Nicolas Privault
Cover of the book Micro-Performance During Postwar Japan’s High-Growth Era by Nicolas Privault
Cover of the book Transboundary Game of Life by Nicolas Privault
Cover of the book Visual Pattern Discovery and Recognition by Nicolas Privault
Cover of the book Pedagogies and Curriculums to (Re)imagine Public Education by Nicolas Privault
Cover of the book Refractive Indices of Solids by Nicolas Privault
Cover of the book Advanced Monitoring in P2P Botnets by Nicolas Privault
Cover of the book State-Society Relations and Confucian Revivalism in Contemporary China by Nicolas Privault
Cover of the book Modeling, Design and Simulation of Systems by Nicolas Privault
Cover of the book Plant Responses to Xenobiotics by Nicolas Privault
Cover of the book Systematic Approach of Characterisation and Behaviour of Recycled Aggregate Concrete by Nicolas Privault
Cover of the book Plant-Microbe Interactions in Agro-Ecological Perspectives by Nicolas Privault
We use our own "cookies" and third party cookies to improve services and to see statistical information. By using this website, you agree to our Privacy Policy