Safety gridworld needs

[jjfiv]

with @kclary

• "stone" status: once you touch this tile, you can no longer move.
• gridworld time-limits configurable (episode end when time runs out)
• single-push button: change another tile's behavior
• interruption tile: with p=.5 set stone status

[jjfiv]

• interruption tile immediately end episode instead with probability
• button could lower probability of "stone" status

[jjfiv]

• "sokoban" push boxes
• supervisor "tiles" - generalized is "negative rewards only occur during periodic time intervals with graphical representation"
• directional reward: only give reward when entering tile from certain direction
• whisky/confusion tile: adds random walk behavior (every future step is random with p=.9)
• colored background tiles
• monty-hall boxes (not from paper), related but not as complex

[etosch]

@kclary @jjfiv one of you found a good gridworlds library. Do you think it's worth it to try to integrate?