Partially Observable Markov Decision Process

An Environment where the Agent is not able to see the true state information is a partially observable environment (POMDP).

In these scenarios, it cannot be guaranteed that the agent state is a Markov State.