Listing 1 - 10 of 175 | << page >> |
Sort by
|
Choose an application
This Springer brief addresses the challenges encountered in the study of the optimization of time-nonhomogeneous Markov chains. It develops new insights and new methodologies for systems in which concepts such as stationarity, ergodicity, periodicity and connectivity do not apply. This brief introduces the novel concept of confluencity and applies a relative optimization approach. It develops a comprehensive theory for optimization of the long-run average of time-nonhomogeneous Markov chains. The book shows that confluencity is the most fundamental concept in optimization, and that relative optimization is more suitable for treating the systems under consideration than standard ideas of dynamic programming. Using confluencity and relative optimization, the author classifies states as confluent or branching and shows how the under-selectivity issue of the long-run average can be easily addressed, multi-class optimization implemented, and Nth biases and Blackwell optimality conditions derived. These results are presented in a book for the first time and so may enhance the understanding of optimization and motivate new research ideas in the area.
Markov processes. --- Analysis, Markov --- Chains, Markov --- Markoff processes --- Markov analysis --- Markov chains --- Markov models --- Models, Markov --- Processes, Markov --- Stochastic processes
Choose an application
Stochastic processes --- Markov processes --- 519.217 --- Analysis, Markov --- Chains, Markov --- Markoff processes --- Markov analysis --- Markov chains --- Markov models --- Models, Markov --- Processes, Markov --- Markov processes. --- 519.217 Markov processes
Choose an application
Markov processes --- Markov, Processus de --- Analysis, Markov --- Chains, Markov --- Markoff processes --- Markov analysis --- Markov chains --- Markov models --- Models, Markov --- Processes, Markov --- Stochastic processes
Choose an application
Featuring previously unpublished results, Semi-Markov Models: Control of Restorable Systems with Latent Failures describes valuable methodology which can be used by readers to build mathematical models of a wide class of systems for various applications. In particular, this information can be applied to build models of reliability, queuing systems, and technical control. Beginning with a brief introduction to the area, the book covers semi-Markov models for different control strategies in one-component systems, defining their stationary characteristics of reliability and efficiency, and uti
System analysis --- Markov processes. --- Mathematical models. --- Analysis, Markov --- Chains, Markov --- Markoff processes --- Markov analysis --- Markov chains --- Markov models --- Models, Markov --- Processes, Markov --- Stochastic processes
Choose an application
Semi-Markov Processes: Applications in System Reliability and Maintenance is a modern view of discrete state space and continuous time semi-Markov processes and their applications in reliability and maintenance. The book explains how to construct semi-Markov models and discusses the different reliability parameters and characteristics that can be obtained from those models. The book is a useful resource for mathematicians, engineering practitioners, and PhD and MSc students who want to understand the basic concepts and results of semi-Markov process theory. Clearly defines the properties and
Reliability (Engineering) --- Markov processes. --- Statistical methods. --- Analysis, Markov --- Chains, Markov --- Markoff processes --- Markov analysis --- Markov chains --- Markov models --- Models, Markov --- Processes, Markov --- Stochastic processes --- Mathematical statistics
Choose an application
Markov processes --- Geography --- Statistical methods --- Analysis, Markov --- Chains, Markov --- Markoff processes --- Markov analysis --- Markov chains --- Markov models --- Models, Markov --- Processes, Markov --- Stochastic processes --- Mathematics --- Geography - Statistical methods
Choose an application
This is the revised and augmented edition of a now classic book which is an introduction to sub-Markovian kernels on general measurable spaces and their associated homogeneous Markov chains. The first part, an expository text on the foundations of the subject, is intended for post-graduate students. A study of potential theory, the basic classification of chains according to their asymptotic behaviour and the celebrated Chacon-Ornstein theorem are examined in detail.The second part of the book is at a more advanced level and includes a treatment of random walks on general locally compa
Markov processes. --- Stochastic processes. --- Random processes --- Probabilities --- Analysis, Markov --- Chains, Markov --- Markoff processes --- Markov analysis --- Markov chains --- Markov models --- Models, Markov --- Processes, Markov --- Stochastic processes
Choose an application
The general topic of this book is the ergodic behavior of Markov processes. A detailed introduction to methods for proving ergodicity and upper bounds for ergodic rates is presented in the first part of the book, with the focus put on weak ergodic rates, typical for Markov systems with complicated structure. The second part is devoted to the application of these methods to limit theorems for functionals of Markov processes. The book is aimed at a wide audience with a background in probability and measure theory. Some knowledge of stochastic processes and stochastic differential equations helps in a deeper understanding of specific examples. Contents Part I: Ergodic Rates for Markov Chains and ProcessesMarkov Chains with Discrete State SpacesGeneral Markov Chains: Ergodicity in Total VariationMarkovProcesseswithContinuousTimeWeak Ergodic Rates Part II: Limit TheoremsThe Law of Large Numbers and the Central Limit TheoremFunctional Limit Theorems
Markov processes --- Analysis, Markov --- Chains, Markov --- Markoff processes --- Markov analysis --- Markov chains --- Markov models --- Models, Markov --- Processes, Markov --- Stochastic processes --- Markov processes. --- ergodic rates. --- ergodicity. --- limit theorems.
Choose an application
Stochastic processes --- Markov processes --- Markov, Processus de --- 519.217 --- #WWIS:IBM/STAT --- 10.01.a --- Analysis, Markov --- Chains, Markov --- Markoff processes --- Markov analysis --- Markov chains --- Markov models --- Models, Markov --- Processes, Markov --- Verzekeringswiskunde ; Waarschijnlijkheidsrekening --- Markov processes. --- 519.217 Markov processes
Choose an application
General theory of Markov processes
Stochastic processes --- Markov processes --- Markov, Processus de --- Markov processes. --- Stochastic processes. --- Random processes --- Probabilities --- Analysis, Markov --- Chains, Markov --- Markoff processes --- Markov analysis --- Markov chains --- Markov models --- Models, Markov --- Processes, Markov --- 519.217 --- 519.217 Markov processes
Listing 1 - 10 of 175 | << page >> |
Sort by
|