A vectorized, differentiable multi-agent reinforcement learning simulator with a PyTorch 2D physics engine, multi-robot scenarios and Gym, RLlib and TorchRL integration.