Nvidia created environment for train RL bots simultaneously. Pretty cool if u dont want to mess up with physics engine by yourself

https://arxiv.org/abs/1810.05762