How Clear Probabilistic Models Can Strengthen Intelligent Systems in an Uncertain World

Software engineer Sai Bhargav Yalamanchi notes that mathematical tools helping practitioners interpret uncertainty have ...
IEEE

Adaptive Neural Sliding Mode Control of Markov Jump Systems Subject to Malicious Attacks

Abstract: This article investigates the problem of adaptive neural sliding mode control for Markov jump systems. The transition probabilities of the Markov process are partly unknown. The cyber layer, ...
Scientific Research Publishing

Puterman, M.L. (2014) Markov Decision Processes: Discrete Stochastic Dynamic Programming. John Wiley & Sons.

ABSTRACT: Offline reinforcement learning (RL) focuses on learning policies using static datasets without further exploration. With the introduction of distributional reinforcement learning into ...
IEEE

Tracking and Control of Gauss–Markov Processes over Packet-Drop Channels with Acknowledgments

Abstract: We consider the problem of tracking the state of Gauss-Markov processes over rate-limited erasure-prone links. We concentrate first on the scenario in which several independent processes are ...
archive

Continuous time Markov processes : an introduction

Ask the publishers to restore access to 500,000+ books. An icon used to represent a menu that can be toggled by interacting with this icon. A line drawing of the Internet Archive headquarters building ...
archive

Markov processes and applications : algorithms, networks, genome and finance

Ask the publishers to restore access to 500,000+ books. A line drawing of the Internet Archive headquarters building façade. An illustration of a heart shape "Donate to the archive" An illustration of ...
GitHub

markov-processes

We present a user-friendly open-source Matlab package for stochastic data analysis that enables to perform a standard analysis of given turbulent data and extracts the stochastic equations describing ...
GitHub

MDPFuzz: Testing Models Solving Markov Decision Processes.

Crash-triggering states found by MDPFuzz: For more results, please refer to our website. We evaluate MDPFuzz on five SOTA models solving MDPs. We include the core components of MDPFuzz in the fuzz ...