Environments

Here is an incomplete list of all evaluated environments:

Continuous state - discrete action

• Gymnasium: CartPole, Acrobot, MountainCar
• Jumanji: TSP, Knapsack

Continuous state - continuous action

• Gymnasium: Pendulum
• Mujoco: tba.

Discrete state - discrete action

• Gymnasium: FrozenLake, Cliffwalking
• Jumanji: Maze