Continuous semi-Markov processes

Applied Semi-Markov Processes

Recent developments in Markov decision processes

Measure-Valued Branching Markov Processes

Nonlinear Markov processes and kinetic equations

Boundary Value Problems and Markov Processes

Markov Decision Processes With Their Applications

Cycle Representations of Markov Processes

Controlled Markov Processes and Viscosity Solutions

An Introduction to Markov Processes

General theory of Markov processes

Diffusions, Markov processes and martingales

Markov processes characterization and convergence

Numerical analysis of Markov decision processes

Dirichlet forms and Markov processes

Dirichlet forms and Markov processes

Markov processes and learning models

Markov processes and potential theory

Dynamic programming and Markov processes

Simulation-Based Algorithms for Markov Decision Processes

Markov Decision Processes with Applications to Finance

Markov Processes, Gaussian Processes, and Local Times

Simulation-based Algorithms for Markov Decision Processes

Markov Processes, Brownian Motion, and Time Symmetry

Markov decision processes : discrete stochastic dynamic programming

Markov decision processes discrete stochastic dynamic programming

Markov processes an introduction for physical scientists

Semi-Markov processes : applications in system reliability and maintenance

Applications of Discrete-time Markov Chains and Poisson Processes to Air Pollution Modeling and Studies

Advances in Regression, Survival Analysis, Extreme Values, Markov Processes and Other Statistical Applications

Continuous Average Control of Piecewise Deterministic Markov Processes

Planning with Markov decision processes an AI perspective

Fluctuations in Markov Processes Time Symmetry and Martingale Approximation

Entropy of Hidden Markov Processes and Connections to Dynamical Systems Papers from the Banff International Research Station Workshop

Markov Decision Processes and the Belief-Desire-Intention Model Bridging the Gap for Autonomous Agents

Continuous-Time Markov Decision Processes Theory and Applications

Markov processes and applications algorithms, networks, genome and finance

Limit theorems on large deviations for Markov stochastic processes

The numerical exploitation of periodicity in Markov decision processes

NASA Formal Methods 15th International Symposium, NFM 2023, Houston, TX, USA, May 16-18, 2023, Proceedings

Theoretical Aspects of Computing - ICTAC 2023 20th International Colloquium, Lima, Peru, December 4-8, 2023, Proceedings

Information Systems and Design Third International Conference, ICID 2022, Tashkent, Uzbekistan, September 12-13, 2022, Revised Selected Papers

Modeling and Simulation of Social-Behavioral Phenomena in Creative Societies Second International Conference, MSBC 2022, Vilnius, Lithuania, September 21-23, 2022, Proceedings

Quantitative Evaluation of Systems 20th International Conference, QEST 2023, Antwerp, Belgium, September 20-22, 2023, Proceedings

Hidden Semi-Markov models : theory, algorithms and applications

Probabilistic Graphical Models Principles and Applications

Advances in Enterprise Engineering IX 5th Enterprise Engineering Working Conference, EEWC 2015, Prague, Czech Republic, June 15-19, 2015, Proceedings

Fundamentals of Software Engineering 6th International Conference, FSEN 2015, Tehran, Iran, April 22-24, 2015. Revised Selected Papers

Automata, Languages, and Programming 42nd International Colloquium, ICALP 2015, Kyoto, Japan, July 6-10, 2015, Proceedings, Part II

Asia Pacific Business Process Management Third Asia Pacific Conference, AP-BPM 2015, Busan, South Korea, June 24-26, 2015, Proceedings

Business Process Management Workshops BPM 2014 International Workshops, Eindhoven, The Netherlands, September 7-8, 2014, Revised Papers

Finite Difference Methods,Theory and Applications 6th International Conference, FDM 2014, Lozenetz, Bulgaria, June 18-23, 2014, Revised Selected Papers

Computer Aided Verification 27th International Conference, CAV 2015, San Francisco, CA, USA, July 18-24, 2015, Proceedings, Part I

Software Engineering and Formal Methods SEFM 2014 Collocated Workshops: HOFM, SAFOME, OpenCert, MoKMaSD, WS-FMDS, Grenoble, France, September 1-2, 2014, Revised Selected Papers

Introduction to imprecise probabilities

Markov chains : analytic and Monte Carlo computations

Stochastic analysis and diffusion processes

Engineering risk assessment with subset simulation

Approximate iterative algorithms

Random dynamical systems in finance

Markov chains : theory, algorithms and applications

A first course in probability and Markov chains

Degenerate diffusion operators arising in population biology

Selected topics on continuous-time controlled Markov chains and Markov games

Stochastic population processes analysis, approximations, simulations

Schaum's outline of theory and problems of probability

One thousand exercises in probability

Handbook of Markov chain Monte Carlo

Introducing Monte Carlo methods with R

Algorithms for reinforcement learning

Performance modeling of communication networks with Markov chains

Advanced Markov chain Monte Carlo methods learning from past samples

Markov Chains and Stochastic Stability

Hidden Markov models for time series an introduction using R

Marine navigation and safety of sea transportation

Handbook of hidden Markov models in bioinformatics

Stochastic relations foundations for Markov transition systems

Analytical methods for Markov semigroups

Markov chains : models, algorithms and applications

Queueing networks and Markov chains modeling and performance evaluation with computer science applications

Queueing networks and Markov chains modeling and performance evaluation with computer science applications

Functional inequalities, Markov semigroups and spectral theory

Bayesian models for categorical data

Graph Directed Markov Systems Geometry and Dynamics of Limit Sets

Bioinformatics the machine learning approach

Markov chains : Gibbs fields, Monte Carlo simulation, and queues

Semi-Markov models and applications

Applications of Markov chains in chemical engineering

Markov chain Monte Carlo : stochastic simulation for Bayesian inference