Continuous semi-Markov processes

Applied Semi-Markov Processes

Recent developments in Markov decision processes

Measure-Valued Branching Markov Processes

Nonlinear Markov processes and kinetic equations

Boundary Value Problems and Markov Processes

Markov Decision Processes With Their Applications

Controlled Markov Processes and Viscosity Solutions

Cycle Representations of Markov Processes

An Introduction to Markov Processes

General theory of Markov processes

Diffusions, Markov processes and martingales

Markov processes characterization and convergence

Numerical analysis of Markov decision processes

Dirichlet forms and Markov processes

Dirichlet forms and Markov processes

Markov processes and learning models

Markov processes and potential theory

Dynamic programming and Markov processes

Simulation-Based Algorithms for Markov Decision Processes

Markov Decision Processes with Applications to Finance

Markov Processes, Gaussian Processes, and Local Times

Simulation-based Algorithms for Markov Decision Processes

Markov decision processes : discrete stochastic dynamic programming

Markov Processes, Brownian Motion, and Time Symmetry

Markov decision processes discrete stochastic dynamic programming

Markov processes an introduction for physical scientists

Semi-Markov processes : applications in system reliability and maintenance

Continuous Average Control of Piecewise Deterministic Markov Processes

Advances in Regression, Survival Analysis, Extreme Values, Markov Processes and Other Statistical Applications

Applications of Discrete-time Markov Chains and Poisson Processes to Air Pollution Modeling and Studies

Fluctuations in Markov Processes Time Symmetry and Martingale Approximation

Planning with Markov decision processes an AI perspective

Markov Decision Processes and the Belief-Desire-Intention Model Bridging the Gap for Autonomous Agents

Entropy of Hidden Markov Processes and Connections to Dynamical Systems Papers from the Banff International Research Station Workshop

Continuous-Time Markov Decision Processes Theory and Applications

Markov processes and applications algorithms, networks, genome and finance

Limit theorems on large deviations for Markov stochastic processes

The numerical exploitation of periodicity in Markov decision processes

Quantitative Evaluation of Systems 20th International Conference, QEST 2023, Antwerp, Belgium, September 20-22, 2023, Proceedings

Modeling and Simulation of Social-Behavioral Phenomena in Creative Societies Second International Conference, MSBC 2022, Vilnius, Lithuania, September 21-23, 2022, Proceedings

Information Systems and Design Third International Conference, ICID 2022, Tashkent, Uzbekistan, September 12-13, 2022, Revised Selected Papers

NASA Formal Methods 15th International Symposium, NFM 2023, Houston, TX, USA, May 16-18, 2023, Proceedings

Theoretical Aspects of Computing - ICTAC 2023 20th International Colloquium, Lima, Peru, December 4-8, 2023, Proceedings

Hidden Semi-Markov models : theory, algorithms and applications

Asia Pacific Business Process Management Third Asia Pacific Conference, AP-BPM 2015, Busan, South Korea, June 24-26, 2015, Proceedings

Advances in Enterprise Engineering IX 5th Enterprise Engineering Working Conference, EEWC 2015, Prague, Czech Republic, June 15-19, 2015, Proceedings

Finite Difference Methods,Theory and Applications 6th International Conference, FDM 2014, Lozenetz, Bulgaria, June 18-23, 2014, Revised Selected Papers

Computer Aided Verification 27th International Conference, CAV 2015, San Francisco, CA, USA, July 18-24, 2015, Proceedings, Part I

Fundamentals of Software Engineering 6th International Conference, FSEN 2015, Tehran, Iran, April 22-24, 2015. Revised Selected Papers

Software Engineering and Formal Methods SEFM 2014 Collocated Workshops: HOFM, SAFOME, OpenCert, MoKMaSD, WS-FMDS, Grenoble, France, September 1-2, 2014, Revised Selected Papers

Automata, Languages, and Programming 42nd International Colloquium, ICALP 2015, Kyoto, Japan, July 6-10, 2015, Proceedings, Part II

Business Process Management Workshops BPM 2014 International Workshops, Eindhoven, The Netherlands, September 7-8, 2014, Revised Papers

Probabilistic Graphical Models Principles and Applications

Markov chains : analytic and Monte Carlo computations

Engineering risk assessment with subset simulation

Introduction to imprecise probabilities

Approximate iterative algorithms

Stochastic analysis and diffusion processes

Random dynamical systems in finance

A first course in probability and Markov chains

Degenerate diffusion operators arising in population biology

Markov chains : theory, algorithms and applications

Selected topics on continuous-time controlled Markov chains and Markov games

Stochastic population processes analysis, approximations, simulations

One thousand exercises in probability

Schaum's outline of theory and problems of probability

Handbook of Markov chain Monte Carlo

Introducing Monte Carlo methods with R

Algorithms for reinforcement learning

Performance modeling of communication networks with Markov chains

Advanced Markov chain Monte Carlo methods learning from past samples

Markov Chains and Stochastic Stability

Marine navigation and safety of sea transportation

Hidden Markov models for time series an introduction using R

Handbook of hidden Markov models in bioinformatics

Stochastic relations foundations for Markov transition systems

Analytical methods for Markov semigroups

Markov chains : models, algorithms and applications

Queueing networks and Markov chains modeling and performance evaluation with computer science applications

Queueing networks and Markov chains modeling and performance evaluation with computer science applications

Functional inequalities, Markov semigroups and spectral theory

Bayesian models for categorical data

Graph Directed Markov Systems Geometry and Dynamics of Limit Sets

Bioinformatics the machine learning approach

Markov chains : Gibbs fields, Monte Carlo simulation, and queues

Semi-Markov models and applications

Applications of Markov chains in chemical engineering

Markov chain Monte Carlo : stochastic simulation for Bayesian inference