Shawheen Naderi

Visualizing the World Model in an Agent's Value Function

This work applies counterfactual interventions to explore if the value function of a Proximal Policy Optimization agent forms a world model of the Crafter environment, and learns concepts such as the rules governing when a diamond is collectible, water and food having an impact on health, heuristics regarding inventory...