Here's a description of the API: https://github.com/openai/gym-http-api/blob/master/README.md We'll definitely want this to expand out the range of playable games.