- TensorFlow Reinforcement Learning Quick Start Guide
- Kaushik Balakrishnan
- 214字
- 2021-06-24 15:29:07
Learning the Markov decision process
The Markov property is widely used in RL, and it states that the environment's response at time t+1 depends only on the state and action at time t. In other words, the immediate future only depends on the present and not on the past. This is a useful property that simplifies the math considerably, and is widely used in many fields such as RL and robotics.
Consider a system that transitions from state s0 to s1 by taking an action a0 and receiving a reward r1, and thereafter from s1 to s2 taking action a1, and so on until time t. If the probability of being in a state s' at time t+1 can be represented mathematically as in the following function, then the system is said to follow the Markov property:

Note that the probability of being in state st+1 depends only on st and at and not on the past. An environment that satisfies the following state transition property and reward function as follows is said to be a Markov Decision Process (MDP):


Let's now define the very foundation of RL: the Bellman equation. This equation will help in providing an iterative solution to obtaining value functions.
- 工業機器人虛擬仿真實例教程:KUKA.Sim Pro(全彩版)
- Getting Started with Clickteam Fusion
- 計算機應用復習與練習
- 精通Windows Vista必讀
- Cloud Analytics with Microsoft Azure
- 數據庫原理與應用技術學習指導
- 數據挖掘實用案例分析
- Photoshop CS3特效處理融會貫通
- Learning C for Arduino
- Visual Basic.NET程序設計
- Troubleshooting OpenVPN
- Python:Data Analytics and Visualization
- ASP.NET 2.0 Web開發入門指南
- 單片機技術項目化原理與實訓
- TensorFlow Deep Learning Projects