An Environment where the Agent is not able to see the true state information is a partially observable environment (POMDP).
In these scenarios, it cannot be guaranteed that the agent state is a Markov State.
An Environment where the Agent is not able to see the true state information is a partially observable environment (POMDP).
In these scenarios, it cannot be guaranteed that the agent state is a Markov State.