Skip to main content
aegean.ai home page
Book
Search...
⌘K
GitHub
LinkedIn
Search...
Navigation
Bellman Equations
Recycling Robot Example
Introduction
Foundations
Neural Networks
Perception
World Models
LLMs
Reasoning
VLMs
Planning
MDPs
RL
VLA Agents
Annexes
Markov Decision Processes
Overview
MDP Introduction
Bellman Equations
Bellman Expectation
Bellman Optimality
Policy Improvement
Recycling Robot
Dynamic Programming
Policy Iteration
On this page
Problem statement
Solution
Bellman Equations
Recycling Robot Example
Applying Bellman optimality to a recycling robot MDP.
Problem statement
Finite State Machine of a a recycling robot and MDP dynamics LUT
Solution
Edit this page on GitHub
or
file an issue
.
Connect these docs
to Claude, VSCode, and more via MCP for real-time answers.
Policy Improvement
Previous
Policy Iteration
Next
⌘I