I noticed the size of the ball and beam in simulation was not the same as the actual one, so I updated sim to be closer.

I also added the past action rolling list to the model, which allowed it to see what it tried to do previously. It now survives 1000 steps in simulation (~50 seconds)