windows系统下最新版gym[atari]中的游戏环境（此时最新版的gym为0.24.0，gym==0.24.0)
关于gym[atari]的安装参看以前的博文：
windows系统下安装最新版gym的安装方法（此时最新版的gym为0.24.0，gym==0.24.0)
上代码：
import time import gym print("游戏ID:\t\t\t\t\t\t\t\t 游戏名:\t\t\t\t\t\t\t\t 游戏类型:") for env in gym.envs.registry.values(): print('{:<35} {:<35} {:<15}'.format(env.id, env.name, env.entry_point.split(':')[1])) print("\n\n游戏环境detail：") print(env) print(type(gym.envs.registry.keys())) print(type(gym.envs.registry.values())) print("\n\n环境测试阶段：") a_time = time.time() num = 0 for env in gym.envs.registry.values(): try: env = gym.make(env.id, render_mode='human') obs = env.reset() for i in range(10): action = env.action_space.sample() obs, reward, done, info = env.step(action) # time.sleep(0.01) env.close() except Exception: num+=1 print(env) print("报错环境数为：", num) print("用时：", time.time()-a_time)
运行结果：
游戏ID: 游戏名: 游戏类型: ALE/Tetris-v5 Tetris AtariEnv ALE/Tetris-ram-v5 Tetris-ram AtariEnv ALE/Adventure-v5 Adventure AtariEnv ALE/Adventure-ram-v5 Adventure-ram AtariEnv ALE/AirRaid-v5 AirRaid AtariEnv ALE/AirRaid-ram-v5 AirRaid-ram AtariEnv ALE/Alien-v5 Alien AtariEnv ALE/Alien-ram-v5 Alien-ram AtariEnv ALE/Amidar-v5 Amidar AtariEnv ALE/Amidar-ram-v5 Amidar-ram AtariEnv ALE/Assault-v5 Assault AtariEnv ALE/Assault-ram-v5 Assault-ram AtariEnv ALE/Asterix-v5 Asterix AtariEnv ALE/Asterix-ram-v5 Asterix-ram AtariEnv ALE/Asteroids-v5 Asteroids AtariEnv ALE/Asteroids-ram-v5 Asteroids-ram AtariEnv ALE/Atlantis-v5 Atlantis AtariEnv ALE/Atlantis-ram-v5 Atlantis-ram AtariEnv ALE/Atlantis2-v5 Atlantis2 AtariEnv ALE/Atlantis2-ram-v5 Atlantis2-ram AtariEnv ALE/Backgammon-v5 Backgammon AtariEnv ALE/Backgammon-ram-v5 Backgammon-ram AtariEnv ALE/BankHeist-v5 BankHeist AtariEnv ALE/BankHeist-ram-v5 BankHeist-ram AtariEnv ALE/BasicMath-v5 BasicMath AtariEnv ALE/BasicMath-ram-v5 BasicMath-ram AtariEnv ALE/BattleZone-v5 BattleZone AtariEnv ALE/BattleZone-ram-v5 BattleZone-ram AtariEnv ALE/BeamRider-v5 BeamRider AtariEnv ALE/BeamRider-ram-v5 BeamRider-ram AtariEnv ALE/Berzerk-v5 Berzerk AtariEnv ALE/Berzerk-ram-v5 Berzerk-ram AtariEnv ALE/Blackjack-v5 Blackjack AtariEnv ALE/Blackjack-ram-v5 Blackjack-ram AtariEnv ALE/Bowling-v5 Bowling AtariEnv ALE/Bowling-ram-v5 Bowling-ram AtariEnv ALE/Boxing-v5 Boxing AtariEnv ALE/Boxing-ram-v5 Boxing-ram AtariEnv ALE/Breakout-v5 Breakout AtariEnv ALE/Breakout-ram-v5 Breakout-ram AtariEnv ALE/Carnival-v5 Carnival AtariEnv ALE/Carnival-ram-v5 Carnival-ram AtariEnv ALE/Casino-v5 Casino AtariEnv ALE/Casino-ram-v5 Casino-ram AtariEnv ALE/Centipede-v5 Centipede AtariEnv ALE/Centipede-ram-v5 Centipede-ram AtariEnv ALE/ChopperCommand-v5 ChopperCommand AtariEnv ALE/ChopperCommand-ram-v5 ChopperCommand-ram AtariEnv ALE/CrazyClimber-v5 CrazyClimber AtariEnv ALE/CrazyClimber-ram-v5 CrazyClimber-ram AtariEnv ALE/Crossbow-v5 Crossbow AtariEnv ALE/Crossbow-ram-v5 Crossbow-ram AtariEnv ALE/Darkchambers-v5 Darkchambers AtariEnv ALE/Darkchambers-ram-v5 Darkchambers-ram AtariEnv ALE/Defender-v5 Defender AtariEnv ALE/Defender-ram-v5 Defender-ram AtariEnv ALE/DemonAttack-v5 DemonAttack AtariEnv ALE/DemonAttack-ram-v5 DemonAttack-ram AtariEnv ALE/DonkeyKong-v5 DonkeyKong AtariEnv ALE/DonkeyKong-ram-v5 DonkeyKong-ram AtariEnv ALE/DoubleDunk-v5 DoubleDunk AtariEnv ALE/DoubleDunk-ram-v5 DoubleDunk-ram AtariEnv ALE/Earthworld-v5 Earthworld AtariEnv ALE/Earthworld-ram-v5 Earthworld-ram AtariEnv ALE/ElevatorAction-v5 ElevatorAction AtariEnv ALE/ElevatorAction-ram-v5 ElevatorAction-ram AtariEnv ALE/Enduro-v5 Enduro AtariEnv ALE/Enduro-ram-v5 Enduro-ram AtariEnv ALE/Entombed-v5 Entombed AtariEnv ALE/Entombed-ram-v5 Entombed-ram AtariEnv ALE/Et-v5 Et AtariEnv ALE/Et-ram-v5 Et-ram AtariEnv ALE/FishingDerby-v5 FishingDerby AtariEnv ALE/FishingDerby-ram-v5 FishingDerby-ram AtariEnv ALE/FlagCapture-v5 FlagCapture AtariEnv ALE/FlagCapture-ram-v5 FlagCapture-ram AtariEnv ALE/Freeway-v5 Freeway AtariEnv ALE/Freeway-ram-v5 Freeway-ram AtariEnv ALE/Frogger-v5 Frogger AtariEnv ALE/Frogger-ram-v5 Frogger-ram AtariEnv ALE/Frostbite-v5 Frostbite AtariEnv ALE/Frostbite-ram-v5 Frostbite-ram AtariEnv ALE/Galaxian-v5 Galaxian AtariEnv ALE/Galaxian-ram-v5 Galaxian-ram AtariEnv ALE/Gopher-v5 Gopher AtariEnv ALE/Gopher-ram-v5 Gopher-ram AtariEnv ALE/Gravitar-v5 Gravitar AtariEnv ALE/Gravitar-ram-v5 Gravitar-ram AtariEnv ALE/Hangman-v5 Hangman AtariEnv ALE/Hangman-ram-v5 Hangman-ram AtariEnv ALE/HauntedHouse-v5 HauntedHouse AtariEnv ALE/HauntedHouse-ram-v5 HauntedHouse-ram AtariEnv ALE/Hero-v5 Hero AtariEnv ALE/Hero-ram-v5 Hero-ram AtariEnv ALE/HumanCannonball-v5 HumanCannonball AtariEnv ALE/HumanCannonball-ram-v5 HumanCannonball-ram AtariEnv ALE/IceHockey-v5 IceHockey AtariEnv ALE/IceHockey-ram-v5 IceHockey-ram AtariEnv ALE/Jamesbond-v5 Jamesbond AtariEnv ALE/Jamesbond-ram-v5 Jamesbond-ram AtariEnv ALE/JourneyEscape-v5 JourneyEscape AtariEnv ALE/JourneyEscape-ram-v5 JourneyEscape-ram AtariEnv ALE/Kaboom-v5 Kaboom AtariEnv ALE/Kaboom-ram-v5 Kaboom-ram AtariEnv ALE/Kangaroo-v5 Kangaroo AtariEnv ALE/Kangaroo-ram-v5 Kangaroo-ram AtariEnv ALE/KeystoneKapers-v5 KeystoneKapers AtariEnv ALE/KeystoneKapers-ram-v5 KeystoneKapers-ram AtariEnv ALE/KingKong-v5 KingKong AtariEnv ALE/KingKong-ram-v5 KingKong-ram AtariEnv ALE/Klax-v5 Klax AtariEnv ALE/Klax-ram-v5 Klax-ram AtariEnv ALE/Koolaid-v5 Koolaid AtariEnv ALE/Koolaid-ram-v5 Koolaid-ram AtariEnv ALE/Krull-v5 Krull AtariEnv ALE/Krull-ram-v5 Krull-ram AtariEnv ALE/KungFuMaster-v5 KungFuMaster AtariEnv ALE/KungFuMaster-ram-v5 KungFuMaster-ram AtariEnv ALE/LaserGates-v5 LaserGates AtariEnv ALE/LaserGates-ram-v5 LaserGates-ram AtariEnv ALE/LostLuggage-v5 LostLuggage AtariEnv ALE/LostLuggage-ram-v5 LostLuggage-ram AtariEnv ALE/MarioBros-v5 MarioBros AtariEnv ALE/MarioBros-ram-v5 MarioBros-ram AtariEnv ALE/MiniatureGolf-v5 MiniatureGolf AtariEnv ALE/MiniatureGolf-ram-v5 MiniatureGolf-ram AtariEnv ALE/MontezumaRevenge-v5 MontezumaRevenge AtariEnv ALE/MontezumaRevenge-ram-v5 MontezumaRevenge-ram AtariEnv ALE/MrDo-v5 MrDo AtariEnv ALE/MrDo-ram-v5 MrDo-ram AtariEnv ALE/MsPacman-v5 MsPacman AtariEnv ALE/MsPacman-ram-v5 MsPacman-ram AtariEnv ALE/NameThisGame-v5 NameThisGame AtariEnv ALE/NameThisGame-ram-v5 NameThisGame-ram AtariEnv ALE/Othello-v5 Othello AtariEnv ALE/Othello-ram-v5 Othello-ram AtariEnv ALE/Pacman-v5 Pacman AtariEnv ALE/Pacman-ram-v5 Pacman-ram AtariEnv ALE/Phoenix-v5 Phoenix AtariEnv ALE/Phoenix-ram-v5 Phoenix-ram AtariEnv ALE/Pitfall-v5 Pitfall AtariEnv ALE/Pitfall-ram-v5 Pitfall-ram AtariEnv ALE/Pitfall2-v5 Pitfall2 AtariEnv ALE/Pitfall2-ram-v5 Pitfall2-ram AtariEnv ALE/Pong-v5 Pong AtariEnv ALE/Pong-ram-v5 Pong-ram AtariEnv ALE/Pooyan-v5 Pooyan AtariEnv ALE/Pooyan-ram-v5 Pooyan-ram AtariEnv ALE/PrivateEye-v5 PrivateEye AtariEnv ALE/PrivateEye-ram-v5 PrivateEye-ram AtariEnv ALE/Qbert-v5 Qbert AtariEnv ALE/Qbert-ram-v5 Qbert-ram AtariEnv ALE/Riverraid-v5 Riverraid AtariEnv ALE/Riverraid-ram-v5 Riverraid-ram AtariEnv ALE/RoadRunner-v5 RoadRunner AtariEnv ALE/RoadRunner-ram-v5 RoadRunner-ram AtariEnv ALE/Robotank-v5 Robotank AtariEnv ALE/Robotank-ram-v5 Robotank-ram AtariEnv ALE/Seaquest-v5 Seaquest AtariEnv ALE/Seaquest-ram-v5 Seaquest-ram AtariEnv ALE/SirLancelot-v5 SirLancelot AtariEnv ALE/SirLancelot-ram-v5 SirLancelot-ram AtariEnv ALE/Skiing-v5 Skiing AtariEnv ALE/Skiing-ram-v5 Skiing-ram AtariEnv ALE/Solaris-v5 Solaris AtariEnv ALE/Solaris-ram-v5 Solaris-ram AtariEnv ALE/SpaceInvaders-v5 SpaceInvaders AtariEnv ALE/SpaceInvaders-ram-v5 SpaceInvaders-ram AtariEnv ALE/SpaceWar-v5 SpaceWar AtariEnv ALE/SpaceWar-ram-v5 SpaceWar-ram AtariEnv ALE/StarGunner-v5 StarGunner AtariEnv ALE/StarGunner-ram-v5 StarGunner-ram AtariEnv ALE/Superman-v5 Superman AtariEnv ALE/Superman-ram-v5 Superman-ram AtariEnv ALE/Surround-v5 Surround AtariEnv ALE/Surround-ram-v5 Surround-ram AtariEnv ALE/Tennis-v5 Tennis AtariEnv ALE/Tennis-ram-v5 Tennis-ram AtariEnv ALE/TicTacToe3D-v5 TicTacToe3D AtariEnv ALE/TicTacToe3D-ram-v5 TicTacToe3D-ram AtariEnv ALE/TimePilot-v5 TimePilot AtariEnv ALE/TimePilot-ram-v5 TimePilot-ram AtariEnv ALE/Trondead-v5 Trondead AtariEnv ALE/Trondead-ram-v5 Trondead-ram AtariEnv ALE/Turmoil-v5 Turmoil AtariEnv ALE/Turmoil-ram-v5 Turmoil-ram AtariEnv ALE/Tutankham-v5 Tutankham AtariEnv ALE/Tutankham-ram-v5 Tutankham-ram AtariEnv ALE/UpNDown-v5 UpNDown AtariEnv ALE/UpNDown-ram-v5 UpNDown-ram AtariEnv ALE/Venture-v5 Venture AtariEnv ALE/Venture-ram-v5 Venture-ram AtariEnv ALE/VideoCheckers-v5 VideoCheckers AtariEnv ALE/VideoCheckers-ram-v5 VideoCheckers-ram AtariEnv ALE/Videochess-v5 Videochess AtariEnv ALE/Videochess-ram-v5 Videochess-ram AtariEnv ALE/Videocube-v5 Videocube AtariEnv ALE/Videocube-ram-v5 Videocube-ram AtariEnv ALE/VideoPinball-v5 VideoPinball AtariEnv ALE/VideoPinball-ram-v5 VideoPinball-ram AtariEnv ALE/WizardOfWor-v5 WizardOfWor AtariEnv ALE/WizardOfWor-ram-v5 WizardOfWor-ram AtariEnv ALE/WordZapper-v5 WordZapper AtariEnv ALE/WordZapper-ram-v5 WordZapper-ram AtariEnv ALE/YarsRevenge-v5 YarsRevenge AtariEnv ALE/YarsRevenge-ram-v5 YarsRevenge-ram AtariEnv ALE/Zaxxon-v5 Zaxxon AtariEnv ALE/Zaxxon-ram-v5 Zaxxon-ram AtariEnv Adventure-v0 Adventure AtariEnv AdventureDeterministic-v0 AdventureDeterministic AtariEnv AdventureNoFrameskip-v0 AdventureNoFrameskip AtariEnv Adventure-v4 Adventure AtariEnv AdventureDeterministic-v4 AdventureDeterministic AtariEnv AdventureNoFrameskip-v4 AdventureNoFrameskip AtariEnv Adventure-ram-v0 Adventure-ram AtariEnv Adventure-ramDeterministic-v0 Adventure-ramDeterministic AtariEnv Adventure-ramNoFrameskip-v0 Adventure-ramNoFrameskip AtariEnv Adventure-ram-v4 Adventure-ram AtariEnv Adventure-ramDeterministic-v4 Adventure-ramDeterministic AtariEnv Adventure-ramNoFrameskip-v4 Adventure-ramNoFrameskip AtariEnv AirRaid-v0 AirRaid AtariEnv AirRaidDeterministic-v0 AirRaidDeterministic AtariEnv AirRaidNoFrameskip-v0 AirRaidNoFrameskip AtariEnv AirRaid-v4 AirRaid AtariEnv AirRaidDeterministic-v4 AirRaidDeterministic AtariEnv AirRaidNoFrameskip-v4 AirRaidNoFrameskip AtariEnv AirRaid-ram-v0 AirRaid-ram AtariEnv AirRaid-ramDeterministic-v0 AirRaid-ramDeterministic AtariEnv AirRaid-ramNoFrameskip-v0 AirRaid-ramNoFrameskip AtariEnv AirRaid-ram-v4 AirRaid-ram AtariEnv AirRaid-ramDeterministic-v4 AirRaid-ramDeterministic AtariEnv AirRaid-ramNoFrameskip-v4 AirRaid-ramNoFrameskip AtariEnv Alien-v0 Alien AtariEnv AlienDeterministic-v0 AlienDeterministic AtariEnv AlienNoFrameskip-v0 AlienNoFrameskip AtariEnv Alien-v4 Alien AtariEnv AlienDeterministic-v4 AlienDeterministic AtariEnv AlienNoFrameskip-v4 AlienNoFrameskip AtariEnv Alien-ram-v0 Alien-ram AtariEnv Alien-ramDeterministic-v0 Alien-ramDeterministic AtariEnv Alien-ramNoFrameskip-v0 Alien-ramNoFrameskip AtariEnv Alien-ram-v4 Alien-ram AtariEnv Alien-ramDeterministic-v4 Alien-ramDeterministic AtariEnv Alien-ramNoFrameskip-v4 Alien-ramNoFrameskip AtariEnv Amidar-v0 Amidar AtariEnv AmidarDeterministic-v0 AmidarDeterministic AtariEnv AmidarNoFrameskip-v0 AmidarNoFrameskip AtariEnv Amidar-v4 Amidar AtariEnv AmidarDeterministic-v4 AmidarDeterministic AtariEnv AmidarNoFrameskip-v4 AmidarNoFrameskip AtariEnv Amidar-ram-v0 Amidar-ram AtariEnv Amidar-ramDeterministic-v0 Amidar-ramDeterministic AtariEnv Amidar-ramNoFrameskip-v0 Amidar-ramNoFrameskip AtariEnv Amidar-ram-v4 Amidar-ram AtariEnv Amidar-ramDeterministic-v4 Amidar-ramDeterministic AtariEnv Amidar-ramNoFrameskip-v4 Amidar-ramNoFrameskip AtariEnv Assault-v0 Assault AtariEnv AssaultDeterministic-v0 AssaultDeterministic AtariEnv AssaultNoFrameskip-v0 AssaultNoFrameskip AtariEnv Assault-v4 Assault AtariEnv AssaultDeterministic-v4 AssaultDeterministic AtariEnv AssaultNoFrameskip-v4 AssaultNoFrameskip AtariEnv Assault-ram-v0 Assault-ram AtariEnv Assault-ramDeterministic-v0 Assault-ramDeterministic AtariEnv Assault-ramNoFrameskip-v0 Assault-ramNoFrameskip AtariEnv Assault-ram-v4 Assault-ram AtariEnv Assault-ramDeterministic-v4 Assault-ramDeterministic AtariEnv Assault-ramNoFrameskip-v4 Assault-ramNoFrameskip AtariEnv Asterix-v0 Asterix AtariEnv AsterixDeterministic-v0 AsterixDeterministic AtariEnv AsterixNoFrameskip-v0 AsterixNoFrameskip AtariEnv Asterix-v4 Asterix AtariEnv AsterixDeterministic-v4 AsterixDeterministic AtariEnv AsterixNoFrameskip-v4 AsterixNoFrameskip AtariEnv Asterix-ram-v0 Asterix-ram AtariEnv Asterix-ramDeterministic-v0 Asterix-ramDeterministic AtariEnv Asterix-ramNoFrameskip-v0 Asterix-ramNoFrameskip AtariEnv Asterix-ram-v4 Asterix-ram AtariEnv Asterix-ramDeterministic-v4 Asterix-ramDeterministic AtariEnv Asterix-ramNoFrameskip-v4 Asterix-ramNoFrameskip AtariEnv Asteroids-v0 Asteroids AtariEnv AsteroidsDeterministic-v0 AsteroidsDeterministic AtariEnv AsteroidsNoFrameskip-v0 AsteroidsNoFrameskip AtariEnv Asteroids-v4 Asteroids AtariEnv AsteroidsDeterministic-v4 AsteroidsDeterministic AtariEnv AsteroidsNoFrameskip-v4 AsteroidsNoFrameskip AtariEnv Asteroids-ram-v0 Asteroids-ram AtariEnv Asteroids-ramDeterministic-v0 Asteroids-ramDeterministic AtariEnv Asteroids-ramNoFrameskip-v0 Asteroids-ramNoFrameskip AtariEnv Asteroids-ram-v4 Asteroids-ram AtariEnv Asteroids-ramDeterministic-v4 Asteroids-ramDeterministic AtariEnv Asteroids-ramNoFrameskip-v4 Asteroids-ramNoFrameskip AtariEnv Atlantis-v0 Atlantis AtariEnv AtlantisDeterministic-v0 AtlantisDeterministic AtariEnv AtlantisNoFrameskip-v0 AtlantisNoFrameskip AtariEnv Atlantis-v4 Atlantis AtariEnv AtlantisDeterministic-v4 AtlantisDeterministic AtariEnv AtlantisNoFrameskip-v4 AtlantisNoFrameskip AtariEnv Atlantis-ram-v0 Atlantis-ram AtariEnv Atlantis-ramDeterministic-v0 Atlantis-ramDeterministic AtariEnv Atlantis-ramNoFrameskip-v0 Atlantis-ramNoFrameskip AtariEnv Atlantis-ram-v4 Atlantis-ram AtariEnv Atlantis-ramDeterministic-v4 Atlantis-ramDeterministic AtariEnv Atlantis-ramNoFrameskip-v4 Atlantis-ramNoFrameskip AtariEnv BankHeist-v0 BankHeist AtariEnv BankHeistDeterministic-v0 BankHeistDeterministic AtariEnv BankHeistNoFrameskip-v0 BankHeistNoFrameskip AtariEnv BankHeist-v4 BankHeist AtariEnv BankHeistDeterministic-v4 BankHeistDeterministic AtariEnv BankHeistNoFrameskip-v4 BankHeistNoFrameskip AtariEnv BankHeist-ram-v0 BankHeist-ram AtariEnv BankHeist-ramDeterministic-v0 BankHeist-ramDeterministic AtariEnv BankHeist-ramNoFrameskip-v0 BankHeist-ramNoFrameskip AtariEnv BankHeist-ram-v4 BankHeist-ram AtariEnv BankHeist-ramDeterministic-v4 BankHeist-ramDeterministic AtariEnv BankHeist-ramNoFrameskip-v4 BankHeist-ramNoFrameskip AtariEnv BattleZone-v0 BattleZone AtariEnv BattleZoneDeterministic-v0 BattleZoneDeterministic AtariEnv BattleZoneNoFrameskip-v0 BattleZoneNoFrameskip AtariEnv BattleZone-v4 BattleZone AtariEnv BattleZoneDeterministic-v4 BattleZoneDeterministic AtariEnv BattleZoneNoFrameskip-v4 BattleZoneNoFrameskip AtariEnv BattleZone-ram-v0 BattleZone-ram AtariEnv BattleZone-ramDeterministic-v0 BattleZone-ramDeterministic AtariEnv BattleZone-ramNoFrameskip-v0 BattleZone-ramNoFrameskip AtariEnv BattleZone-ram-v4 BattleZone-ram AtariEnv BattleZone-ramDeterministic-v4 BattleZone-ramDeterministic AtariEnv BattleZone-ramNoFrameskip-v4 BattleZone-ramNoFrameskip AtariEnv BeamRider-v0 BeamRider AtariEnv BeamRiderDeterministic-v0 BeamRiderDeterministic AtariEnv BeamRiderNoFrameskip-v0 BeamRiderNoFrameskip AtariEnv BeamRider-v4 BeamRider AtariEnv BeamRiderDeterministic-v4 BeamRiderDeterministic AtariEnv BeamRiderNoFrameskip-v4 BeamRiderNoFrameskip AtariEnv BeamRider-ram-v0 BeamRider-ram AtariEnv BeamRider-ramDeterministic-v0 BeamRider-ramDeterministic AtariEnv BeamRider-ramNoFrameskip-v0 BeamRider-ramNoFrameskip AtariEnv BeamRider-ram-v4 BeamRider-ram AtariEnv BeamRider-ramDeterministic-v4 BeamRider-ramDeterministic AtariEnv BeamRider-ramNoFrameskip-v4 BeamRider-ramNoFrameskip AtariEnv Berzerk-v0 Berzerk AtariEnv BerzerkDeterministic-v0 BerzerkDeterministic AtariEnv BerzerkNoFrameskip-v0 BerzerkNoFrameskip AtariEnv Berzerk-v4 Berzerk AtariEnv BerzerkDeterministic-v4 BerzerkDeterministic AtariEnv BerzerkNoFrameskip-v4 BerzerkNoFrameskip AtariEnv Berzerk-ram-v0 Berzerk-ram AtariEnv Berzerk-ramDeterministic-v0 Berzerk-ramDeterministic AtariEnv Berzerk-ramNoFrameskip-v0 Berzerk-ramNoFrameskip AtariEnv Berzerk-ram-v4 Berzerk-ram AtariEnv Berzerk-ramDeterministic-v4 Berzerk-ramDeterministic AtariEnv Berzerk-ramNoFrameskip-v4 Berzerk-ramNoFrameskip AtariEnv Bowling-v0 Bowling AtariEnv BowlingDeterministic-v0 BowlingDeterministic AtariEnv BowlingNoFrameskip-v0 BowlingNoFrameskip AtariEnv Bowling-v4 Bowling AtariEnv BowlingDeterministic-v4 BowlingDeterministic AtariEnv BowlingNoFrameskip-v4 BowlingNoFrameskip AtariEnv Bowling-ram-v0 Bowling-ram AtariEnv Bowling-ramDeterministic-v0 Bowling-ramDeterministic AtariEnv Bowling-ramNoFrameskip-v0 Bowling-ramNoFrameskip AtariEnv Bowling-ram-v4 Bowling-ram AtariEnv Bowling-ramDeterministic-v4 Bowling-ramDeterministic AtariEnv Bowling-ramNoFrameskip-v4 Bowling-ramNoFrameskip AtariEnv Boxing-v0 Boxing AtariEnv BoxingDeterministic-v0 BoxingDeterministic AtariEnv BoxingNoFrameskip-v0 BoxingNoFrameskip AtariEnv Boxing-v4 Boxing AtariEnv BoxingDeterministic-v4 BoxingDeterministic AtariEnv BoxingNoFrameskip-v4 BoxingNoFrameskip AtariEnv Boxing-ram-v0 Boxing-ram AtariEnv Boxing-ramDeterministic-v0 Boxing-ramDeterministic AtariEnv Boxing-ramNoFrameskip-v0 Boxing-ramNoFrameskip AtariEnv Boxing-ram-v4 Boxing-ram AtariEnv Boxing-ramDeterministic-v4 Boxing-ramDeterministic AtariEnv Boxing-ramNoFrameskip-v4 Boxing-ramNoFrameskip AtariEnv Breakout-v0 Breakout AtariEnv BreakoutDeterministic-v0 BreakoutDeterministic AtariEnv BreakoutNoFrameskip-v0 BreakoutNoFrameskip AtariEnv Breakout-v4 Breakout AtariEnv BreakoutDeterministic-v4 BreakoutDeterministic AtariEnv BreakoutNoFrameskip-v4 BreakoutNoFrameskip AtariEnv Breakout-ram-v0 Breakout-ram AtariEnv Breakout-ramDeterministic-v0 Breakout-ramDeterministic AtariEnv Breakout-ramNoFrameskip-v0 Breakout-ramNoFrameskip AtariEnv Breakout-ram-v4 Breakout-ram AtariEnv Breakout-ramDeterministic-v4 Breakout-ramDeterministic AtariEnv Breakout-ramNoFrameskip-v4 Breakout-ramNoFrameskip AtariEnv Carnival-v0 Carnival AtariEnv CarnivalDeterministic-v0 CarnivalDeterministic AtariEnv CarnivalNoFrameskip-v0 CarnivalNoFrameskip AtariEnv Carnival-v4 Carnival AtariEnv CarnivalDeterministic-v4 CarnivalDeterministic AtariEnv CarnivalNoFrameskip-v4 CarnivalNoFrameskip AtariEnv Carnival-ram-v0 Carnival-ram AtariEnv Carnival-ramDeterministic-v0 Carnival-ramDeterministic AtariEnv Carnival-ramNoFrameskip-v0 Carnival-ramNoFrameskip AtariEnv Carnival-ram-v4 Carnival-ram AtariEnv Carnival-ramDeterministic-v4 Carnival-ramDeterministic AtariEnv Carnival-ramNoFrameskip-v4 Carnival-ramNoFrameskip AtariEnv Centipede-v0 Centipede AtariEnv CentipedeDeterministic-v0 CentipedeDeterministic AtariEnv CentipedeNoFrameskip-v0 CentipedeNoFrameskip AtariEnv Centipede-v4 Centipede AtariEnv CentipedeDeterministic-v4 CentipedeDeterministic AtariEnv CentipedeNoFrameskip-v4 CentipedeNoFrameskip AtariEnv Centipede-ram-v0 Centipede-ram AtariEnv Centipede-ramDeterministic-v0 Centipede-ramDeterministic AtariEnv Centipede-ramNoFrameskip-v0 Centipede-ramNoFrameskip AtariEnv Centipede-ram-v4 Centipede-ram AtariEnv Centipede-ramDeterministic-v4 Centipede-ramDeterministic AtariEnv Centipede-ramNoFrameskip-v4 Centipede-ramNoFrameskip AtariEnv ChopperCommand-v0 ChopperCommand AtariEnv ChopperCommandDeterministic-v0 ChopperCommandDeterministic AtariEnv ChopperCommandNoFrameskip-v0 ChopperCommandNoFrameskip AtariEnv ChopperCommand-v4 ChopperCommand AtariEnv ChopperCommandDeterministic-v4 ChopperCommandDeterministic AtariEnv ChopperCommandNoFrameskip-v4 ChopperCommandNoFrameskip AtariEnv ChopperCommand-ram-v0 ChopperCommand-ram AtariEnv ChopperCommand-ramDeterministic-v0 ChopperCommand-ramDeterministic AtariEnv ChopperCommand-ramNoFrameskip-v0 ChopperCommand-ramNoFrameskip AtariEnv ChopperCommand-ram-v4 ChopperCommand-ram AtariEnv ChopperCommand-ramDeterministic-v4 ChopperCommand-ramDeterministic AtariEnv ChopperCommand-ramNoFrameskip-v4 ChopperCommand-ramNoFrameskip AtariEnv CrazyClimber-v0 CrazyClimber AtariEnv CrazyClimberDeterministic-v0 CrazyClimberDeterministic AtariEnv CrazyClimberNoFrameskip-v0 CrazyClimberNoFrameskip AtariEnv CrazyClimber-v4 CrazyClimber AtariEnv CrazyClimberDeterministic-v4 CrazyClimberDeterministic AtariEnv CrazyClimberNoFrameskip-v4 CrazyClimberNoFrameskip AtariEnv CrazyClimber-ram-v0 CrazyClimber-ram AtariEnv CrazyClimber-ramDeterministic-v0 CrazyClimber-ramDeterministic AtariEnv CrazyClimber-ramNoFrameskip-v0 CrazyClimber-ramNoFrameskip AtariEnv CrazyClimber-ram-v4 CrazyClimber-ram AtariEnv CrazyClimber-ramDeterministic-v4 CrazyClimber-ramDeterministic AtariEnv CrazyClimber-ramNoFrameskip-v4 CrazyClimber-ramNoFrameskip AtariEnv Defender-v0 Defender AtariEnv DefenderDeterministic-v0 DefenderDeterministic AtariEnv DefenderNoFrameskip-v0 DefenderNoFrameskip AtariEnv Defender-v4 Defender AtariEnv DefenderDeterministic-v4 DefenderDeterministic AtariEnv DefenderNoFrameskip-v4 DefenderNoFrameskip AtariEnv Defender-ram-v0 Defender-ram AtariEnv Defender-ramDeterministic-v0 Defender-ramDeterministic AtariEnv Defender-ramNoFrameskip-v0 Defender-ramNoFrameskip AtariEnv Defender-ram-v4 Defender-ram AtariEnv Defender-ramDeterministic-v4 Defender-ramDeterministic AtariEnv Defender-ramNoFrameskip-v4 Defender-ramNoFrameskip AtariEnv DemonAttack-v0 DemonAttack AtariEnv DemonAttackDeterministic-v0 DemonAttackDeterministic AtariEnv DemonAttackNoFrameskip-v0 DemonAttackNoFrameskip AtariEnv DemonAttack-v4 DemonAttack AtariEnv DemonAttackDeterministic-v4 DemonAttackDeterministic AtariEnv DemonAttackNoFrameskip-v4 DemonAttackNoFrameskip AtariEnv DemonAttack-ram-v0 DemonAttack-ram AtariEnv DemonAttack-ramDeterministic-v0 DemonAttack-ramDeterministic AtariEnv DemonAttack-ramNoFrameskip-v0 DemonAttack-ramNoFrameskip AtariEnv DemonAttack-ram-v4 DemonAttack-ram AtariEnv DemonAttack-ramDeterministic-v4 DemonAttack-ramDeterministic AtariEnv DemonAttack-ramNoFrameskip-v4 DemonAttack-ramNoFrameskip AtariEnv DoubleDunk-v0 DoubleDunk AtariEnv DoubleDunkDeterministic-v0 DoubleDunkDeterministic AtariEnv DoubleDunkNoFrameskip-v0 DoubleDunkNoFrameskip AtariEnv DoubleDunk-v4 DoubleDunk AtariEnv DoubleDunkDeterministic-v4 DoubleDunkDeterministic AtariEnv DoubleDunkNoFrameskip-v4 DoubleDunkNoFrameskip AtariEnv DoubleDunk-ram-v0 DoubleDunk-ram AtariEnv DoubleDunk-ramDeterministic-v0 DoubleDunk-ramDeterministic AtariEnv DoubleDunk-ramNoFrameskip-v0 DoubleDunk-ramNoFrameskip AtariEnv DoubleDunk-ram-v4 DoubleDunk-ram AtariEnv DoubleDunk-ramDeterministic-v4 DoubleDunk-ramDeterministic AtariEnv DoubleDunk-ramNoFrameskip-v4 DoubleDunk-ramNoFrameskip AtariEnv ElevatorAction-v0 ElevatorAction AtariEnv ElevatorActionDeterministic-v0 ElevatorActionDeterministic AtariEnv ElevatorActionNoFrameskip-v0 ElevatorActionNoFrameskip AtariEnv ElevatorAction-v4 ElevatorAction AtariEnv ElevatorActionDeterministic-v4 ElevatorActionDeterministic AtariEnv ElevatorActionNoFrameskip-v4 ElevatorActionNoFrameskip AtariEnv ElevatorAction-ram-v0 ElevatorAction-ram AtariEnv ElevatorAction-ramDeterministic-v0 ElevatorAction-ramDeterministic AtariEnv ElevatorAction-ramNoFrameskip-v0 ElevatorAction-ramNoFrameskip AtariEnv ElevatorAction-ram-v4 ElevatorAction-ram AtariEnv ElevatorAction-ramDeterministic-v4 ElevatorAction-ramDeterministic AtariEnv ElevatorAction-ramNoFrameskip-v4 ElevatorAction-ramNoFrameskip AtariEnv Enduro-v0 Enduro AtariEnv EnduroDeterministic-v0 EnduroDeterministic AtariEnv EnduroNoFrameskip-v0 EnduroNoFrameskip AtariEnv Enduro-v4 Enduro AtariEnv EnduroDeterministic-v4 EnduroDeterministic AtariEnv EnduroNoFrameskip-v4 EnduroNoFrameskip AtariEnv Enduro-ram-v0 Enduro-ram AtariEnv Enduro-ramDeterministic-v0 Enduro-ramDeterministic AtariEnv Enduro-ramNoFrameskip-v0 Enduro-ramNoFrameskip AtariEnv Enduro-ram-v4 Enduro-ram AtariEnv Enduro-ramDeterministic-v4 Enduro-ramDeterministic AtariEnv Enduro-ramNoFrameskip-v4 Enduro-ramNoFrameskip AtariEnv FishingDerby-v0 FishingDerby AtariEnv FishingDerbyDeterministic-v0 FishingDerbyDeterministic AtariEnv FishingDerbyNoFrameskip-v0 FishingDerbyNoFrameskip AtariEnv FishingDerby-v4 FishingDerby AtariEnv FishingDerbyDeterministic-v4 FishingDerbyDeterministic AtariEnv FishingDerbyNoFrameskip-v4 FishingDerbyNoFrameskip AtariEnv FishingDerby-ram-v0 FishingDerby-ram AtariEnv FishingDerby-ramDeterministic-v0 FishingDerby-ramDeterministic AtariEnv FishingDerby-ramNoFrameskip-v0 FishingDerby-ramNoFrameskip AtariEnv FishingDerby-ram-v4 FishingDerby-ram AtariEnv FishingDerby-ramDeterministic-v4 FishingDerby-ramDeterministic AtariEnv FishingDerby-ramNoFrameskip-v4 FishingDerby-ramNoFrameskip AtariEnv Freeway-v0 Freeway AtariEnv FreewayDeterministic-v0 FreewayDeterministic AtariEnv FreewayNoFrameskip-v0 FreewayNoFrameskip AtariEnv Freeway-v4 Freeway AtariEnv FreewayDeterministic-v4 FreewayDeterministic AtariEnv FreewayNoFrameskip-v4 FreewayNoFrameskip AtariEnv Freeway-ram-v0 Freeway-ram AtariEnv Freeway-ramDeterministic-v0 Freeway-ramDeterministic AtariEnv Freeway-ramNoFrameskip-v0 Freeway-ramNoFrameskip AtariEnv Freeway-ram-v4 Freeway-ram AtariEnv Freeway-ramDeterministic-v4 Freeway-ramDeterministic AtariEnv Freeway-ramNoFrameskip-v4 Freeway-ramNoFrameskip AtariEnv Frostbite-v0 Frostbite AtariEnv FrostbiteDeterministic-v0 FrostbiteDeterministic AtariEnv FrostbiteNoFrameskip-v0 FrostbiteNoFrameskip AtariEnv Frostbite-v4 Frostbite AtariEnv FrostbiteDeterministic-v4 FrostbiteDeterministic AtariEnv FrostbiteNoFrameskip-v4 FrostbiteNoFrameskip AtariEnv Frostbite-ram-v0 Frostbite-ram AtariEnv Frostbite-ramDeterministic-v0 Frostbite-ramDeterministic AtariEnv Frostbite-ramNoFrameskip-v0 Frostbite-ramNoFrameskip AtariEnv Frostbite-ram-v4 Frostbite-ram AtariEnv Frostbite-ramDeterministic-v4 Frostbite-ramDeterministic AtariEnv Frostbite-ramNoFrameskip-v4 Frostbite-ramNoFrameskip AtariEnv Gopher-v0 Gopher AtariEnv GopherDeterministic-v0 GopherDeterministic AtariEnv GopherNoFrameskip-v0 GopherNoFrameskip AtariEnv Gopher-v4 Gopher AtariEnv GopherDeterministic-v4 GopherDeterministic AtariEnv GopherNoFrameskip-v4 GopherNoFrameskip AtariEnv Gopher-ram-v0 Gopher-ram AtariEnv Gopher-ramDeterministic-v0 Gopher-ramDeterministic AtariEnv Gopher-ramNoFrameskip-v0 Gopher-ramNoFrameskip AtariEnv Gopher-ram-v4 Gopher-ram AtariEnv Gopher-ramDeterministic-v4 Gopher-ramDeterministic AtariEnv Gopher-ramNoFrameskip-v4 Gopher-ramNoFrameskip AtariEnv Gravitar-v0 Gravitar AtariEnv GravitarDeterministic-v0 GravitarDeterministic AtariEnv GravitarNoFrameskip-v0 GravitarNoFrameskip AtariEnv Gravitar-v4 Gravitar AtariEnv GravitarDeterministic-v4 GravitarDeterministic AtariEnv GravitarNoFrameskip-v4 GravitarNoFrameskip AtariEnv Gravitar-ram-v0 Gravitar-ram AtariEnv Gravitar-ramDeterministic-v0 Gravitar-ramDeterministic AtariEnv Gravitar-ramNoFrameskip-v0 Gravitar-ramNoFrameskip AtariEnv Gravitar-ram-v4 Gravitar-ram AtariEnv Gravitar-ramDeterministic-v4 Gravitar-ramDeterministic AtariEnv Gravitar-ramNoFrameskip-v4 Gravitar-ramNoFrameskip AtariEnv Hero-v0 Hero AtariEnv HeroDeterministic-v0 HeroDeterministic AtariEnv HeroNoFrameskip-v0 HeroNoFrameskip AtariEnv Hero-v4 Hero AtariEnv HeroDeterministic-v4 HeroDeterministic AtariEnv HeroNoFrameskip-v4 HeroNoFrameskip AtariEnv Hero-ram-v0 Hero-ram AtariEnv Hero-ramDeterministic-v0 Hero-ramDeterministic AtariEnv Hero-ramNoFrameskip-v0 Hero-ramNoFrameskip AtariEnv Hero-ram-v4 Hero-ram AtariEnv Hero-ramDeterministic-v4 Hero-ramDeterministic AtariEnv Hero-ramNoFrameskip-v4 Hero-ramNoFrameskip AtariEnv IceHockey-v0 IceHockey AtariEnv IceHockeyDeterministic-v0 IceHockeyDeterministic AtariEnv IceHockeyNoFrameskip-v0 IceHockeyNoFrameskip AtariEnv IceHockey-v4 IceHockey AtariEnv IceHockeyDeterministic-v4 IceHockeyDeterministic AtariEnv IceHockeyNoFrameskip-v4 IceHockeyNoFrameskip AtariEnv IceHockey-ram-v0 IceHockey-ram AtariEnv IceHockey-ramDeterministic-v0 IceHockey-ramDeterministic AtariEnv IceHockey-ramNoFrameskip-v0 IceHockey-ramNoFrameskip AtariEnv IceHockey-ram-v4 IceHockey-ram AtariEnv IceHockey-ramDeterministic-v4 IceHockey-ramDeterministic AtariEnv IceHockey-ramNoFrameskip-v4 IceHockey-ramNoFrameskip AtariEnv Jamesbond-v0 Jamesbond AtariEnv JamesbondDeterministic-v0 JamesbondDeterministic AtariEnv JamesbondNoFrameskip-v0 JamesbondNoFrameskip AtariEnv Jamesbond-v4 Jamesbond AtariEnv JamesbondDeterministic-v4 JamesbondDeterministic AtariEnv JamesbondNoFrameskip-v4 JamesbondNoFrameskip AtariEnv Jamesbond-ram-v0 Jamesbond-ram AtariEnv Jamesbond-ramDeterministic-v0 Jamesbond-ramDeterministic AtariEnv Jamesbond-ramNoFrameskip-v0 Jamesbond-ramNoFrameskip AtariEnv Jamesbond-ram-v4 Jamesbond-ram AtariEnv Jamesbond-ramDeterministic-v4 Jamesbond-ramDeterministic AtariEnv Jamesbond-ramNoFrameskip-v4 Jamesbond-ramNoFrameskip AtariEnv JourneyEscape-v0 JourneyEscape AtariEnv JourneyEscapeDeterministic-v0 JourneyEscapeDeterministic AtariEnv JourneyEscapeNoFrameskip-v0 JourneyEscapeNoFrameskip AtariEnv JourneyEscape-v4 JourneyEscape AtariEnv JourneyEscapeDeterministic-v4 JourneyEscapeDeterministic AtariEnv JourneyEscapeNoFrameskip-v4 JourneyEscapeNoFrameskip AtariEnv JourneyEscape-ram-v0 JourneyEscape-ram AtariEnv JourneyEscape-ramDeterministic-v0 JourneyEscape-ramDeterministic AtariEnv JourneyEscape-ramNoFrameskip-v0 JourneyEscape-ramNoFrameskip AtariEnv JourneyEscape-ram-v4 JourneyEscape-ram AtariEnv JourneyEscape-ramDeterministic-v4 JourneyEscape-ramDeterministic AtariEnv JourneyEscape-ramNoFrameskip-v4 JourneyEscape-ramNoFrameskip AtariEnv Kangaroo-v0 Kangaroo AtariEnv KangarooDeterministic-v0 KangarooDeterministic AtariEnv KangarooNoFrameskip-v0 KangarooNoFrameskip AtariEnv Kangaroo-v4 Kangaroo AtariEnv KangarooDeterministic-v4 KangarooDeterministic AtariEnv KangarooNoFrameskip-v4 KangarooNoFrameskip AtariEnv Kangaroo-ram-v0 Kangaroo-ram AtariEnv Kangaroo-ramDeterministic-v0 Kangaroo-ramDeterministic AtariEnv Kangaroo-ramNoFrameskip-v0 Kangaroo-ramNoFrameskip AtariEnv Kangaroo-ram-v4 Kangaroo-ram AtariEnv Kangaroo-ramDeterministic-v4 Kangaroo-ramDeterministic AtariEnv Kangaroo-ramNoFrameskip-v4 Kangaroo-ramNoFrameskip AtariEnv Krull-v0 Krull AtariEnv KrullDeterministic-v0 KrullDeterministic AtariEnv KrullNoFrameskip-v0 KrullNoFrameskip AtariEnv Krull-v4 Krull AtariEnv KrullDeterministic-v4 KrullDeterministic AtariEnv KrullNoFrameskip-v4 KrullNoFrameskip AtariEnv Krull-ram-v0 Krull-ram AtariEnv Krull-ramDeterministic-v0 Krull-ramDeterministic AtariEnv Krull-ramNoFrameskip-v0 Krull-ramNoFrameskip AtariEnv Krull-ram-v4 Krull-ram AtariEnv Krull-ramDeterministic-v4 Krull-ramDeterministic AtariEnv Krull-ramNoFrameskip-v4 Krull-ramNoFrameskip AtariEnv KungFuMaster-v0 KungFuMaster AtariEnv KungFuMasterDeterministic-v0 KungFuMasterDeterministic AtariEnv KungFuMasterNoFrameskip-v0 KungFuMasterNoFrameskip AtariEnv KungFuMaster-v4 KungFuMaster AtariEnv KungFuMasterDeterministic-v4 KungFuMasterDeterministic AtariEnv KungFuMasterNoFrameskip-v4 KungFuMasterNoFrameskip AtariEnv KungFuMaster-ram-v0 KungFuMaster-ram AtariEnv KungFuMaster-ramDeterministic-v0 KungFuMaster-ramDeterministic AtariEnv KungFuMaster-ramNoFrameskip-v0 KungFuMaster-ramNoFrameskip AtariEnv KungFuMaster-ram-v4 KungFuMaster-ram AtariEnv KungFuMaster-ramDeterministic-v4 KungFuMaster-ramDeterministic AtariEnv KungFuMaster-ramNoFrameskip-v4 KungFuMaster-ramNoFrameskip AtariEnv MontezumaRevenge-v0 MontezumaRevenge AtariEnv MontezumaRevengeDeterministic-v0 MontezumaRevengeDeterministic AtariEnv MontezumaRevengeNoFrameskip-v0 MontezumaRevengeNoFrameskip AtariEnv MontezumaRevenge-v4 MontezumaRevenge AtariEnv MontezumaRevengeDeterministic-v4 MontezumaRevengeDeterministic AtariEnv MontezumaRevengeNoFrameskip-v4 MontezumaRevengeNoFrameskip AtariEnv MontezumaRevenge-ram-v0 MontezumaRevenge-ram AtariEnv MontezumaRevenge-ramDeterministic-v0 MontezumaRevenge-ramDeterministic AtariEnv MontezumaRevenge-ramNoFrameskip-v0 MontezumaRevenge-ramNoFrameskip AtariEnv MontezumaRevenge-ram-v4 MontezumaRevenge-ram AtariEnv MontezumaRevenge-ramDeterministic-v4 MontezumaRevenge-ramDeterministic AtariEnv MontezumaRevenge-ramNoFrameskip-v4 MontezumaRevenge-ramNoFrameskip AtariEnv MsPacman-v0 MsPacman AtariEnv MsPacmanDeterministic-v0 MsPacmanDeterministic AtariEnv MsPacmanNoFrameskip-v0 MsPacmanNoFrameskip AtariEnv MsPacman-v4 MsPacman AtariEnv MsPacmanDeterministic-v4 MsPacmanDeterministic AtariEnv MsPacmanNoFrameskip-v4 MsPacmanNoFrameskip AtariEnv MsPacman-ram-v0 MsPacman-ram AtariEnv MsPacman-ramDeterministic-v0 MsPacman-ramDeterministic AtariEnv MsPacman-ramNoFrameskip-v0 MsPacman-ramNoFrameskip AtariEnv MsPacman-ram-v4 MsPacman-ram AtariEnv MsPacman-ramDeterministic-v4 MsPacman-ramDeterministic AtariEnv MsPacman-ramNoFrameskip-v4 MsPacman-ramNoFrameskip AtariEnv NameThisGame-v0 NameThisGame AtariEnv NameThisGameDeterministic-v0 NameThisGameDeterministic AtariEnv NameThisGameNoFrameskip-v0 NameThisGameNoFrameskip AtariEnv NameThisGame-v4 NameThisGame AtariEnv NameThisGameDeterministic-v4 NameThisGameDeterministic AtariEnv NameThisGameNoFrameskip-v4 NameThisGameNoFrameskip AtariEnv NameThisGame-ram-v0 NameThisGame-ram AtariEnv NameThisGame-ramDeterministic-v0 NameThisGame-ramDeterministic AtariEnv NameThisGame-ramNoFrameskip-v0 NameThisGame-ramNoFrameskip AtariEnv NameThisGame-ram-v4 NameThisGame-ram AtariEnv NameThisGame-ramDeterministic-v4 NameThisGame-ramDeterministic AtariEnv NameThisGame-ramNoFrameskip-v4 NameThisGame-ramNoFrameskip AtariEnv Phoenix-v0 Phoenix AtariEnv PhoenixDeterministic-v0 PhoenixDeterministic AtariEnv PhoenixNoFrameskip-v0 PhoenixNoFrameskip AtariEnv Phoenix-v4 Phoenix AtariEnv PhoenixDeterministic-v4 PhoenixDeterministic AtariEnv PhoenixNoFrameskip-v4 PhoenixNoFrameskip AtariEnv Phoenix-ram-v0 Phoenix-ram AtariEnv Phoenix-ramDeterministic-v0 Phoenix-ramDeterministic AtariEnv Phoenix-ramNoFrameskip-v0 Phoenix-ramNoFrameskip AtariEnv Phoenix-ram-v4 Phoenix-ram AtariEnv Phoenix-ramDeterministic-v4 Phoenix-ramDeterministic AtariEnv Phoenix-ramNoFrameskip-v4 Phoenix-ramNoFrameskip AtariEnv Pitfall-v0 Pitfall AtariEnv PitfallDeterministic-v0 PitfallDeterministic AtariEnv PitfallNoFrameskip-v0 PitfallNoFrameskip AtariEnv Pitfall-v4 Pitfall AtariEnv PitfallDeterministic-v4 PitfallDeterministic AtariEnv PitfallNoFrameskip-v4 PitfallNoFrameskip AtariEnv Pitfall-ram-v0 Pitfall-ram AtariEnv Pitfall-ramDeterministic-v0 Pitfall-ramDeterministic AtariEnv Pitfall-ramNoFrameskip-v0 Pitfall-ramNoFrameskip AtariEnv Pitfall-ram-v4 Pitfall-ram AtariEnv Pitfall-ramDeterministic-v4 Pitfall-ramDeterministic AtariEnv Pitfall-ramNoFrameskip-v4 Pitfall-ramNoFrameskip AtariEnv Pong-v0 Pong AtariEnv PongDeterministic-v0 PongDeterministic AtariEnv PongNoFrameskip-v0 PongNoFrameskip AtariEnv Pong-v4 Pong AtariEnv PongDeterministic-v4 PongDeterministic AtariEnv PongNoFrameskip-v4 PongNoFrameskip AtariEnv Pong-ram-v0 Pong-ram AtariEnv Pong-ramDeterministic-v0 Pong-ramDeterministic AtariEnv Pong-ramNoFrameskip-v0 Pong-ramNoFrameskip AtariEnv Pong-ram-v4 Pong-ram AtariEnv Pong-ramDeterministic-v4 Pong-ramDeterministic AtariEnv Pong-ramNoFrameskip-v4 Pong-ramNoFrameskip AtariEnv Pooyan-v0 Pooyan AtariEnv PooyanDeterministic-v0 PooyanDeterministic AtariEnv PooyanNoFrameskip-v0 PooyanNoFrameskip AtariEnv Pooyan-v4 Pooyan AtariEnv PooyanDeterministic-v4 PooyanDeterministic AtariEnv PooyanNoFrameskip-v4 PooyanNoFrameskip AtariEnv Pooyan-ram-v0 Pooyan-ram AtariEnv Pooyan-ramDeterministic-v0 Pooyan-ramDeterministic AtariEnv Pooyan-ramNoFrameskip-v0 Pooyan-ramNoFrameskip AtariEnv Pooyan-ram-v4 Pooyan-ram AtariEnv Pooyan-ramDeterministic-v4 Pooyan-ramDeterministic AtariEnv Pooyan-ramNoFrameskip-v4 Pooyan-ramNoFrameskip AtariEnv PrivateEye-v0 PrivateEye AtariEnv PrivateEyeDeterministic-v0 PrivateEyeDeterministic AtariEnv PrivateEyeNoFrameskip-v0 PrivateEyeNoFrameskip AtariEnv PrivateEye-v4 PrivateEye AtariEnv PrivateEyeDeterministic-v4 PrivateEyeDeterministic AtariEnv PrivateEyeNoFrameskip-v4 PrivateEyeNoFrameskip AtariEnv PrivateEye-ram-v0 PrivateEye-ram AtariEnv PrivateEye-ramDeterministic-v0 PrivateEye-ramDeterministic AtariEnv PrivateEye-ramNoFrameskip-v0 PrivateEye-ramNoFrameskip AtariEnv PrivateEye-ram-v4 PrivateEye-ram AtariEnv PrivateEye-ramDeterministic-v4 PrivateEye-ramDeterministic AtariEnv PrivateEye-ramNoFrameskip-v4 PrivateEye-ramNoFrameskip AtariEnv Qbert-v0 Qbert AtariEnv QbertDeterministic-v0 QbertDeterministic AtariEnv QbertNoFrameskip-v0 QbertNoFrameskip AtariEnv Qbert-v4 Qbert AtariEnv QbertDeterministic-v4 QbertDeterministic AtariEnv QbertNoFrameskip-v4 QbertNoFrameskip AtariEnv Qbert-ram-v0 Qbert-ram AtariEnv Qbert-ramDeterministic-v0 Qbert-ramDeterministic AtariEnv Qbert-ramNoFrameskip-v0 Qbert-ramNoFrameskip AtariEnv Qbert-ram-v4 Qbert-ram AtariEnv Qbert-ramDeterministic-v4 Qbert-ramDeterministic AtariEnv Qbert-ramNoFrameskip-v4 Qbert-ramNoFrameskip AtariEnv Riverraid-v0 Riverraid AtariEnv RiverraidDeterministic-v0 RiverraidDeterministic AtariEnv RiverraidNoFrameskip-v0 RiverraidNoFrameskip AtariEnv Riverraid-v4 Riverraid AtariEnv RiverraidDeterministic-v4 RiverraidDeterministic AtariEnv RiverraidNoFrameskip-v4 RiverraidNoFrameskip AtariEnv Riverraid-ram-v0 Riverraid-ram AtariEnv Riverraid-ramDeterministic-v0 Riverraid-ramDeterministic AtariEnv Riverraid-ramNoFrameskip-v0 Riverraid-ramNoFrameskip AtariEnv Riverraid-ram-v4 Riverraid-ram AtariEnv Riverraid-ramDeterministic-v4 Riverraid-ramDeterministic AtariEnv Riverraid-ramNoFrameskip-v4 Riverraid-ramNoFrameskip AtariEnv RoadRunner-v0 RoadRunner AtariEnv RoadRunnerDeterministic-v0 RoadRunnerDeterministic AtariEnv RoadRunnerNoFrameskip-v0 RoadRunnerNoFrameskip AtariEnv RoadRunner-v4 RoadRunner AtariEnv RoadRunnerDeterministic-v4 RoadRunnerDeterministic AtariEnv RoadRunnerNoFrameskip-v4 RoadRunnerNoFrameskip AtariEnv RoadRunner-ram-v0 RoadRunner-ram AtariEnv RoadRunner-ramDeterministic-v0 RoadRunner-ramDeterministic AtariEnv RoadRunner-ramNoFrameskip-v0 RoadRunner-ramNoFrameskip AtariEnv RoadRunner-ram-v4 RoadRunner-ram AtariEnv RoadRunner-ramDeterministic-v4 RoadRunner-ramDeterministic AtariEnv RoadRunner-ramNoFrameskip-v4 RoadRunner-ramNoFrameskip AtariEnv Robotank-v0 Robotank AtariEnv RobotankDeterministic-v0 RobotankDeterministic AtariEnv RobotankNoFrameskip-v0 RobotankNoFrameskip AtariEnv Robotank-v4 Robotank AtariEnv RobotankDeterministic-v4 RobotankDeterministic AtariEnv RobotankNoFrameskip-v4 RobotankNoFrameskip AtariEnv Robotank-ram-v0 Robotank-ram AtariEnv Robotank-ramDeterministic-v0 Robotank-ramDeterministic AtariEnv Robotank-ramNoFrameskip-v0 Robotank-ramNoFrameskip AtariEnv Robotank-ram-v4 Robotank-ram AtariEnv Robotank-ramDeterministic-v4 Robotank-ramDeterministic AtariEnv Robotank-ramNoFrameskip-v4 Robotank-ramNoFrameskip AtariEnv Seaquest-v0 Seaquest AtariEnv SeaquestDeterministic-v0 SeaquestDeterministic AtariEnv SeaquestNoFrameskip-v0 SeaquestNoFrameskip AtariEnv Seaquest-v4 Seaquest AtariEnv SeaquestDeterministic-v4 SeaquestDeterministic AtariEnv SeaquestNoFrameskip-v4 SeaquestNoFrameskip AtariEnv Seaquest-ram-v0 Seaquest-ram AtariEnv Seaquest-ramDeterministic-v0 Seaquest-ramDeterministic AtariEnv Seaquest-ramNoFrameskip-v0 Seaquest-ramNoFrameskip AtariEnv Seaquest-ram-v4 Seaquest-ram AtariEnv Seaquest-ramDeterministic-v4 Seaquest-ramDeterministic AtariEnv Seaquest-ramNoFrameskip-v4 Seaquest-ramNoFrameskip AtariEnv Skiing-v0 Skiing AtariEnv SkiingDeterministic-v0 SkiingDeterministic AtariEnv SkiingNoFrameskip-v0 SkiingNoFrameskip AtariEnv Skiing-v4 Skiing AtariEnv SkiingDeterministic-v4 SkiingDeterministic AtariEnv SkiingNoFrameskip-v4 SkiingNoFrameskip AtariEnv Skiing-ram-v0 Skiing-ram AtariEnv Skiing-ramDeterministic-v0 Skiing-ramDeterministic AtariEnv Skiing-ramNoFrameskip-v0 Skiing-ramNoFrameskip AtariEnv Skiing-ram-v4 Skiing-ram AtariEnv Skiing-ramDeterministic-v4 Skiing-ramDeterministic AtariEnv Skiing-ramNoFrameskip-v4 Skiing-ramNoFrameskip AtariEnv Solaris-v0 Solaris AtariEnv SolarisDeterministic-v0 SolarisDeterministic AtariEnv SolarisNoFrameskip-v0 SolarisNoFrameskip AtariEnv Solaris-v4 Solaris AtariEnv SolarisDeterministic-v4 SolarisDeterministic AtariEnv SolarisNoFrameskip-v4 SolarisNoFrameskip AtariEnv Solaris-ram-v0 Solaris-ram AtariEnv Solaris-ramDeterministic-v0 Solaris-ramDeterministic AtariEnv Solaris-ramNoFrameskip-v0 Solaris-ramNoFrameskip AtariEnv Solaris-ram-v4 Solaris-ram AtariEnv Solaris-ramDeterministic-v4 Solaris-ramDeterministic AtariEnv Solaris-ramNoFrameskip-v4 Solaris-ramNoFrameskip AtariEnv SpaceInvaders-v0 SpaceInvaders AtariEnv SpaceInvadersDeterministic-v0 SpaceInvadersDeterministic AtariEnv SpaceInvadersNoFrameskip-v0 SpaceInvadersNoFrameskip AtariEnv SpaceInvaders-v4 SpaceInvaders AtariEnv SpaceInvadersDeterministic-v4 SpaceInvadersDeterministic AtariEnv SpaceInvadersNoFrameskip-v4 SpaceInvadersNoFrameskip AtariEnv SpaceInvaders-ram-v0 SpaceInvaders-ram AtariEnv SpaceInvaders-ramDeterministic-v0 SpaceInvaders-ramDeterministic AtariEnv SpaceInvaders-ramNoFrameskip-v0 SpaceInvaders-ramNoFrameskip AtariEnv SpaceInvaders-ram-v4 SpaceInvaders-ram AtariEnv SpaceInvaders-ramDeterministic-v4 SpaceInvaders-ramDeterministic AtariEnv SpaceInvaders-ramNoFrameskip-v4 SpaceInvaders-ramNoFrameskip AtariEnv StarGunner-v0 StarGunner AtariEnv StarGunnerDeterministic-v0 StarGunnerDeterministic AtariEnv StarGunnerNoFrameskip-v0 StarGunnerNoFrameskip AtariEnv StarGunner-v4 StarGunner AtariEnv StarGunnerDeterministic-v4 StarGunnerDeterministic AtariEnv StarGunnerNoFrameskip-v4 StarGunnerNoFrameskip AtariEnv StarGunner-ram-v0 StarGunner-ram AtariEnv StarGunner-ramDeterministic-v0 StarGunner-ramDeterministic AtariEnv StarGunner-ramNoFrameskip-v0 StarGunner-ramNoFrameskip AtariEnv StarGunner-ram-v4 StarGunner-ram AtariEnv StarGunner-ramDeterministic-v4 StarGunner-ramDeterministic AtariEnv StarGunner-ramNoFrameskip-v4 StarGunner-ramNoFrameskip AtariEnv Tennis-v0 Tennis AtariEnv TennisDeterministic-v0 TennisDeterministic AtariEnv TennisNoFrameskip-v0 TennisNoFrameskip AtariEnv Tennis-v4 Tennis AtariEnv TennisDeterministic-v4 TennisDeterministic AtariEnv TennisNoFrameskip-v4 TennisNoFrameskip AtariEnv Tennis-ram-v0 Tennis-ram AtariEnv Tennis-ramDeterministic-v0 Tennis-ramDeterministic AtariEnv Tennis-ramNoFrameskip-v0 Tennis-ramNoFrameskip AtariEnv Tennis-ram-v4 Tennis-ram AtariEnv Tennis-ramDeterministic-v4 Tennis-ramDeterministic AtariEnv Tennis-ramNoFrameskip-v4 Tennis-ramNoFrameskip AtariEnv TimePilot-v0 TimePilot AtariEnv TimePilotDeterministic-v0 TimePilotDeterministic AtariEnv TimePilotNoFrameskip-v0 TimePilotNoFrameskip AtariEnv TimePilot-v4 TimePilot AtariEnv TimePilotDeterministic-v4 TimePilotDeterministic AtariEnv TimePilotNoFrameskip-v4 TimePilotNoFrameskip AtariEnv TimePilot-ram-v0 TimePilot-ram AtariEnv TimePilot-ramDeterministic-v0 TimePilot-ramDeterministic AtariEnv TimePilot-ramNoFrameskip-v0 TimePilot-ramNoFrameskip AtariEnv TimePilot-ram-v4 TimePilot-ram AtariEnv TimePilot-ramDeterministic-v4 TimePilot-ramDeterministic AtariEnv TimePilot-ramNoFrameskip-v4 TimePilot-ramNoFrameskip AtariEnv Tutankham-v0 Tutankham AtariEnv TutankhamDeterministic-v0 TutankhamDeterministic AtariEnv TutankhamNoFrameskip-v0 TutankhamNoFrameskip AtariEnv Tutankham-v4 Tutankham AtariEnv TutankhamDeterministic-v4 TutankhamDeterministic AtariEnv TutankhamNoFrameskip-v4 TutankhamNoFrameskip AtariEnv Tutankham-ram-v0 Tutankham-ram AtariEnv Tutankham-ramDeterministic-v0 Tutankham-ramDeterministic AtariEnv Tutankham-ramNoFrameskip-v0 Tutankham-ramNoFrameskip AtariEnv Tutankham-ram-v4 Tutankham-ram AtariEnv Tutankham-ramDeterministic-v4 Tutankham-ramDeterministic AtariEnv Tutankham-ramNoFrameskip-v4 Tutankham-ramNoFrameskip AtariEnv UpNDown-v0 UpNDown AtariEnv UpNDownDeterministic-v0 UpNDownDeterministic AtariEnv UpNDownNoFrameskip-v0 UpNDownNoFrameskip AtariEnv UpNDown-v4 UpNDown AtariEnv UpNDownDeterministic-v4 UpNDownDeterministic AtariEnv UpNDownNoFrameskip-v4 UpNDownNoFrameskip AtariEnv UpNDown-ram-v0 UpNDown-ram AtariEnv UpNDown-ramDeterministic-v0 UpNDown-ramDeterministic AtariEnv UpNDown-ramNoFrameskip-v0 UpNDown-ramNoFrameskip AtariEnv UpNDown-ram-v4 UpNDown-ram AtariEnv UpNDown-ramDeterministic-v4 UpNDown-ramDeterministic AtariEnv UpNDown-ramNoFrameskip-v4 UpNDown-ramNoFrameskip AtariEnv Venture-v0 Venture AtariEnv VentureDeterministic-v0 VentureDeterministic AtariEnv VentureNoFrameskip-v0 VentureNoFrameskip AtariEnv Venture-v4 Venture AtariEnv VentureDeterministic-v4 VentureDeterministic AtariEnv VentureNoFrameskip-v4 VentureNoFrameskip AtariEnv Venture-ram-v0 Venture-ram AtariEnv Venture-ramDeterministic-v0 Venture-ramDeterministic AtariEnv Venture-ramNoFrameskip-v0 Venture-ramNoFrameskip AtariEnv Venture-ram-v4 Venture-ram AtariEnv Venture-ramDeterministic-v4 Venture-ramDeterministic AtariEnv Venture-ramNoFrameskip-v4 Venture-ramNoFrameskip AtariEnv VideoPinball-v0 VideoPinball AtariEnv VideoPinballDeterministic-v0 VideoPinballDeterministic AtariEnv VideoPinballNoFrameskip-v0 VideoPinballNoFrameskip AtariEnv VideoPinball-v4 VideoPinball AtariEnv VideoPinballDeterministic-v4 VideoPinballDeterministic AtariEnv VideoPinballNoFrameskip-v4 VideoPinballNoFrameskip AtariEnv VideoPinball-ram-v0 VideoPinball-ram AtariEnv VideoPinball-ramDeterministic-v0 VideoPinball-ramDeterministic AtariEnv VideoPinball-ramNoFrameskip-v0 VideoPinball-ramNoFrameskip AtariEnv VideoPinball-ram-v4 VideoPinball-ram AtariEnv VideoPinball-ramDeterministic-v4 VideoPinball-ramDeterministic AtariEnv VideoPinball-ramNoFrameskip-v4 VideoPinball-ramNoFrameskip AtariEnv WizardOfWor-v0 WizardOfWor AtariEnv WizardOfWorDeterministic-v0 WizardOfWorDeterministic AtariEnv WizardOfWorNoFrameskip-v0 WizardOfWorNoFrameskip AtariEnv WizardOfWor-v4 WizardOfWor AtariEnv WizardOfWorDeterministic-v4 WizardOfWorDeterministic AtariEnv WizardOfWorNoFrameskip-v4 WizardOfWorNoFrameskip AtariEnv WizardOfWor-ram-v0 WizardOfWor-ram AtariEnv WizardOfWor-ramDeterministic-v0 WizardOfWor-ramDeterministic AtariEnv WizardOfWor-ramNoFrameskip-v0 WizardOfWor-ramNoFrameskip AtariEnv WizardOfWor-ram-v4 WizardOfWor-ram AtariEnv WizardOfWor-ramDeterministic-v4 WizardOfWor-ramDeterministic AtariEnv WizardOfWor-ramNoFrameskip-v4 WizardOfWor-ramNoFrameskip AtariEnv YarsRevenge-v0 YarsRevenge AtariEnv YarsRevengeDeterministic-v0 YarsRevengeDeterministic AtariEnv YarsRevengeNoFrameskip-v0 YarsRevengeNoFrameskip AtariEnv YarsRevenge-v4 YarsRevenge AtariEnv YarsRevengeDeterministic-v4 YarsRevengeDeterministic AtariEnv YarsRevengeNoFrameskip-v4 YarsRevengeNoFrameskip AtariEnv YarsRevenge-ram-v0 YarsRevenge-ram AtariEnv YarsRevenge-ramDeterministic-v0 YarsRevenge-ramDeterministic AtariEnv YarsRevenge-ramNoFrameskip-v0 YarsRevenge-ramNoFrameskip AtariEnv YarsRevenge-ram-v4 YarsRevenge-ram AtariEnv YarsRevenge-ramDeterministic-v4 YarsRevenge-ramDeterministic AtariEnv YarsRevenge-ramNoFrameskip-v4 YarsRevenge-ramNoFrameskip AtariEnv Zaxxon-v0 Zaxxon AtariEnv ZaxxonDeterministic-v0 ZaxxonDeterministic AtariEnv ZaxxonNoFrameskip-v0 ZaxxonNoFrameskip AtariEnv Zaxxon-v4 Zaxxon AtariEnv ZaxxonDeterministic-v4 ZaxxonDeterministic AtariEnv ZaxxonNoFrameskip-v4 ZaxxonNoFrameskip AtariEnv Zaxxon-ram-v0 Zaxxon-ram AtariEnv Zaxxon-ramDeterministic-v0 Zaxxon-ramDeterministic AtariEnv Zaxxon-ramNoFrameskip-v0 Zaxxon-ramNoFrameskip AtariEnv Zaxxon-ram-v4 Zaxxon-ram AtariEnv Zaxxon-ramDeterministic-v4 Zaxxon-ramDeterministic AtariEnv Zaxxon-ramNoFrameskip-v4 Zaxxon-ramNoFrameskip AtariEnv CartPole-v0 CartPole CartPoleEnv CartPole-v1 CartPole CartPoleEnv MountainCar-v0 MountainCar MountainCarEnv MountainCarContinuous-v0 MountainCarContinuous Continuous_MountainCarEnv Pendulum-v1 Pendulum PendulumEnv Acrobot-v1 Acrobot AcrobotEnv LunarLander-v2 LunarLander LunarLander LunarLanderContinuous-v2 LunarLanderContinuous LunarLander BipedalWalker-v3 BipedalWalker BipedalWalker BipedalWalkerHardcore-v3 BipedalWalkerHardcore BipedalWalker CarRacing-v1 CarRacing CarRacing CarRacingDomainRandomize-v1 CarRacingDomainRandomize CarRacing CarRacingDiscrete-v1 CarRacingDiscrete CarRacing CarRacingDomainRandomizeDiscrete-v1 CarRacingDomainRandomizeDiscrete CarRacing Blackjack-v1 Blackjack BlackjackEnv FrozenLake-v1 FrozenLake FrozenLakeEnv FrozenLake8x8-v1 FrozenLake8x8 FrozenLakeEnv CliffWalking-v0 CliffWalking CliffWalkingEnv Taxi-v3 Taxi TaxiEnv Reacher-v2 Reacher ReacherEnv Reacher-v4 Reacher ReacherEnv Pusher-v2 Pusher PusherEnv Pusher-v4 Pusher PusherEnv InvertedPendulum-v2 InvertedPendulum InvertedPendulumEnv InvertedPendulum-v4 InvertedPendulum InvertedPendulumEnv InvertedDoublePendulum-v2 InvertedDoublePendulum InvertedDoublePendulumEnv InvertedDoublePendulum-v4 InvertedDoublePendulum InvertedDoublePendulumEnv HalfCheetah-v2 HalfCheetah HalfCheetahEnv HalfCheetah-v3 HalfCheetah HalfCheetahEnv HalfCheetah-v4 HalfCheetah HalfCheetahEnv Hopper-v2 Hopper HopperEnv Hopper-v3 Hopper HopperEnv Hopper-v4 Hopper HopperEnv Swimmer-v2 Swimmer SwimmerEnv Swimmer-v3 Swimmer SwimmerEnv Swimmer-v4 Swimmer SwimmerEnv Walker2d-v2 Walker2d Walker2dEnv Walker2d-v3 Walker2d Walker2dEnv Walker2d-v4 Walker2d Walker2dEnv Ant-v2 Ant AntEnv Ant-v3 Ant AntEnv Ant-v4 Ant AntEnv Humanoid-v2 Humanoid HumanoidEnv Humanoid-v3 Humanoid HumanoidEnv Humanoid-v4 Humanoid HumanoidEnv HumanoidStandup-v2 HumanoidStandup HumanoidStandupEnv HumanoidStandup-v4 HumanoidStandup HumanoidStandupEnv 游戏环境detail： EnvSpec(id='HumanoidStandup-v4', entry_point='gym.envs.mujoco.humanoidstandup_v4:HumanoidStandupEnv', reward_threshold=None, nondeterministic=False, max_episode_steps=1000, order_enforce=True, autoreset=False, kwargs={}, namespace=None, name='HumanoidStandup', version=4) <class 'dict_keys'> <class 'dict_values'>
环境测试阶段： A.L.E: Arcade Learning Environment (version 0.7.5+db37282) [Powered by Stella] C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Adventure-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment AdventureDeterministic-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment AdventureNoFrameskip-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Adventure-ram-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Adventure-ramDeterministic-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Adventure-ramNoFrameskip-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment AirRaid-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment AirRaidDeterministic-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment AirRaidNoFrameskip-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment AirRaid-ram-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment AirRaid-ramDeterministic-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment AirRaid-ramNoFrameskip-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Alien-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment AlienDeterministic-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment AlienNoFrameskip-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Alien-ram-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Alien-ramDeterministic-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Alien-ramNoFrameskip-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Amidar-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment AmidarDeterministic-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment AmidarNoFrameskip-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Amidar-ram-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Amidar-ramDeterministic-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Amidar-ramNoFrameskip-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Assault-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment AssaultDeterministic-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment AssaultNoFrameskip-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Assault-ram-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Assault-ramDeterministic-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Assault-ramNoFrameskip-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Asterix-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment AsterixDeterministic-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment AsterixNoFrameskip-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Asterix-ram-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Asterix-ramDeterministic-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Asterix-ramNoFrameskip-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Asteroids-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment AsteroidsDeterministic-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment AsteroidsNoFrameskip-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Asteroids-ram-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Asteroids-ramDeterministic-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Asteroids-ramNoFrameskip-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Atlantis-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment AtlantisDeterministic-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment AtlantisNoFrameskip-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Atlantis-ram-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Atlantis-ramDeterministic-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Atlantis-ramNoFrameskip-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment BankHeist-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment BankHeistDeterministic-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment BankHeistNoFrameskip-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment BankHeist-ram-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment BankHeist-ramDeterministic-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment BankHeist-ramNoFrameskip-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment BattleZone-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment BattleZoneDeterministic-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment BattleZoneNoFrameskip-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment BattleZone-ram-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment BattleZone-ramDeterministic-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment BattleZone-ramNoFrameskip-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment BeamRider-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment BeamRiderDeterministic-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment BeamRiderNoFrameskip-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment BeamRider-ram-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment BeamRider-ramDeterministic-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment BeamRider-ramNoFrameskip-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Berzerk-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment BerzerkDeterministic-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment BerzerkNoFrameskip-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Berzerk-ram-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Berzerk-ramDeterministic-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Berzerk-ramNoFrameskip-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Bowling-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment BowlingDeterministic-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment BowlingNoFrameskip-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Bowling-ram-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Bowling-ramDeterministic-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Bowling-ramNoFrameskip-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Boxing-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment BoxingDeterministic-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment BoxingNoFrameskip-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Boxing-ram-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Boxing-ramDeterministic-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Boxing-ramNoFrameskip-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Breakout-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment BreakoutDeterministic-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment BreakoutNoFrameskip-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Breakout-ram-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Breakout-ramDeterministic-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Breakout-ramNoFrameskip-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Carnival-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment CarnivalDeterministic-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment CarnivalNoFrameskip-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Carnival-ram-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Carnival-ramDeterministic-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Carnival-ramNoFrameskip-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Centipede-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment CentipedeDeterministic-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment CentipedeNoFrameskip-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Centipede-ram-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Centipede-ramDeterministic-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Centipede-ramNoFrameskip-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment ChopperCommand-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment ChopperCommandDeterministic-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment ChopperCommandNoFrameskip-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment ChopperCommand-ram-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment ChopperCommand-ramDeterministic-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment ChopperCommand-ramNoFrameskip-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment CrazyClimber-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment CrazyClimberDeterministic-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment CrazyClimberNoFrameskip-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment CrazyClimber-ram-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment CrazyClimber-ramDeterministic-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment CrazyClimber-ramNoFrameskip-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Defender-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment DefenderDeterministic-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment DefenderNoFrameskip-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Defender-ram-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Defender-ramDeterministic-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Defender-ramNoFrameskip-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment DemonAttack-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment DemonAttackDeterministic-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment DemonAttackNoFrameskip-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment DemonAttack-ram-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment DemonAttack-ramDeterministic-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment DemonAttack-ramNoFrameskip-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment DoubleDunk-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment DoubleDunkDeterministic-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment DoubleDunkNoFrameskip-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment DoubleDunk-ram-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment DoubleDunk-ramDeterministic-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment DoubleDunk-ramNoFrameskip-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment ElevatorAction-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment ElevatorActionDeterministic-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment ElevatorActionNoFrameskip-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment ElevatorAction-ram-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment ElevatorAction-ramDeterministic-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment ElevatorAction-ramNoFrameskip-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Enduro-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment EnduroDeterministic-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment EnduroNoFrameskip-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Enduro-ram-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Enduro-ramDeterministic-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Enduro-ramNoFrameskip-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment FishingDerby-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment FishingDerbyDeterministic-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment FishingDerbyNoFrameskip-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment FishingDerby-ram-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment FishingDerby-ramDeterministic-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment FishingDerby-ramNoFrameskip-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Freeway-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment FreewayDeterministic-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment FreewayNoFrameskip-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Freeway-ram-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Freeway-ramDeterministic-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Freeway-ramNoFrameskip-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Frostbite-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment FrostbiteDeterministic-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment FrostbiteNoFrameskip-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Frostbite-ram-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Frostbite-ramDeterministic-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Frostbite-ramNoFrameskip-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Gopher-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment GopherDeterministic-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment GopherNoFrameskip-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Gopher-ram-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Gopher-ramDeterministic-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Gopher-ramNoFrameskip-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Gravitar-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment GravitarDeterministic-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment GravitarNoFrameskip-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Gravitar-ram-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Gravitar-ramDeterministic-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Gravitar-ramNoFrameskip-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Hero-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment HeroDeterministic-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment HeroNoFrameskip-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Hero-ram-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Hero-ramDeterministic-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Hero-ramNoFrameskip-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment IceHockey-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment IceHockeyDeterministic-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment IceHockeyNoFrameskip-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment IceHockey-ram-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment IceHockey-ramDeterministic-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment IceHockey-ramNoFrameskip-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Jamesbond-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment JamesbondDeterministic-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment JamesbondNoFrameskip-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Jamesbond-ram-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Jamesbond-ramDeterministic-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Jamesbond-ramNoFrameskip-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment JourneyEscape-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment JourneyEscapeDeterministic-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment JourneyEscapeNoFrameskip-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment JourneyEscape-ram-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment JourneyEscape-ramDeterministic-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment JourneyEscape-ramNoFrameskip-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Kangaroo-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment KangarooDeterministic-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment KangarooNoFrameskip-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Kangaroo-ram-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Kangaroo-ramDeterministic-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Kangaroo-ramNoFrameskip-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Krull-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment KrullDeterministic-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment KrullNoFrameskip-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Krull-ram-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Krull-ramDeterministic-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Krull-ramNoFrameskip-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment KungFuMaster-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment KungFuMasterDeterministic-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment KungFuMasterNoFrameskip-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment KungFuMaster-ram-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment KungFuMaster-ramDeterministic-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment KungFuMaster-ramNoFrameskip-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment MontezumaRevenge-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment MontezumaRevengeDeterministic-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment MontezumaRevengeNoFrameskip-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment MontezumaRevenge-ram-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment MontezumaRevenge-ramDeterministic-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment MontezumaRevenge-ramNoFrameskip-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment MsPacman-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment MsPacmanDeterministic-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment MsPacmanNoFrameskip-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment MsPacman-ram-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment MsPacman-ramDeterministic-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment MsPacman-ramNoFrameskip-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment NameThisGame-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment NameThisGameDeterministic-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment NameThisGameNoFrameskip-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment NameThisGame-ram-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment NameThisGame-ramDeterministic-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment NameThisGame-ramNoFrameskip-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Phoenix-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment PhoenixDeterministic-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment PhoenixNoFrameskip-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Phoenix-ram-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Phoenix-ramDeterministic-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Phoenix-ramNoFrameskip-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Pitfall-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment PitfallDeterministic-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment PitfallNoFrameskip-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Pitfall-ram-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Pitfall-ramDeterministic-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Pitfall-ramNoFrameskip-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Pong-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment PongDeterministic-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment PongNoFrameskip-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Pong-ram-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Pong-ramDeterministic-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Pong-ramNoFrameskip-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Pooyan-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment PooyanDeterministic-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment PooyanNoFrameskip-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Pooyan-ram-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Pooyan-ramDeterministic-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Pooyan-ramNoFrameskip-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment PrivateEye-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment PrivateEyeDeterministic-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment PrivateEyeNoFrameskip-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment PrivateEye-ram-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment PrivateEye-ramDeterministic-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment PrivateEye-ramNoFrameskip-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Qbert-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment QbertDeterministic-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment QbertNoFrameskip-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Qbert-ram-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Qbert-ramDeterministic-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Qbert-ramNoFrameskip-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Riverraid-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment RiverraidDeterministic-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment RiverraidNoFrameskip-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Riverraid-ram-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Riverraid-ramDeterministic-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Riverraid-ramNoFrameskip-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment RoadRunner-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment RoadRunnerDeterministic-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment RoadRunnerNoFrameskip-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment RoadRunner-ram-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment RoadRunner-ramDeterministic-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment RoadRunner-ramNoFrameskip-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Robotank-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment RobotankDeterministic-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment RobotankNoFrameskip-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Robotank-ram-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Robotank-ramDeterministic-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Robotank-ramNoFrameskip-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Seaquest-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment SeaquestDeterministic-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment SeaquestNoFrameskip-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Seaquest-ram-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Seaquest-ramDeterministic-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Seaquest-ramNoFrameskip-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Skiing-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment SkiingDeterministic-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment SkiingNoFrameskip-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Skiing-ram-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Skiing-ramDeterministic-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Skiing-ramNoFrameskip-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Solaris-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment SolarisDeterministic-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment SolarisNoFrameskip-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Solaris-ram-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Solaris-ramDeterministic-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Solaris-ramNoFrameskip-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment SpaceInvaders-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment SpaceInvadersDeterministic-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment SpaceInvadersNoFrameskip-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment SpaceInvaders-ram-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment SpaceInvaders-ramDeterministic-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment SpaceInvaders-ramNoFrameskip-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment StarGunner-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment StarGunnerDeterministic-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment StarGunnerNoFrameskip-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment StarGunner-ram-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment StarGunner-ramDeterministic-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment StarGunner-ramNoFrameskip-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Tennis-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment TennisDeterministic-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment TennisNoFrameskip-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Tennis-ram-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Tennis-ramDeterministic-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Tennis-ramNoFrameskip-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment TimePilot-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment TimePilotDeterministic-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment TimePilotNoFrameskip-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment TimePilot-ram-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment TimePilot-ramDeterministic-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment TimePilot-ramNoFrameskip-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Tutankham-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment TutankhamDeterministic-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment TutankhamNoFrameskip-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Tutankham-ram-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Tutankham-ramDeterministic-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Tutankham-ramNoFrameskip-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment UpNDown-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment UpNDownDeterministic-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment UpNDownNoFrameskip-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment UpNDown-ram-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment UpNDown-ramDeterministic-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment UpNDown-ramNoFrameskip-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Venture-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment VentureDeterministic-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment VentureNoFrameskip-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Venture-ram-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Venture-ramDeterministic-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Venture-ramNoFrameskip-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment VideoPinball-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment VideoPinballDeterministic-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment VideoPinballNoFrameskip-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment VideoPinball-ram-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment VideoPinball-ramDeterministic-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment VideoPinball-ramNoFrameskip-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment WizardOfWor-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment WizardOfWorDeterministic-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment WizardOfWorNoFrameskip-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment WizardOfWor-ram-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment WizardOfWor-ramDeterministic-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment WizardOfWor-ramNoFrameskip-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment YarsRevenge-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment YarsRevengeDeterministic-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment YarsRevengeNoFrameskip-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment YarsRevenge-ram-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment YarsRevenge-ramDeterministic-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment YarsRevenge-ramNoFrameskip-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Zaxxon-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment ZaxxonDeterministic-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment ZaxxonNoFrameskip-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Zaxxon-ram-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Zaxxon-ramDeterministic-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Zaxxon-ramNoFrameskip-v0 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment CartPole-v0 is out of date. You should consider upgrading to version `v1`. logger.warn( EnvSpec(id='CartPole-v0', entry_point='gym.envs.classic_control.cartpole:CartPoleEnv', reward_threshold=195.0, nondeterministic=False, max_episode_steps=200, order_enforce=True, autoreset=False, kwargs={}, namespace=None, name='CartPole', version=0) EnvSpec(id='CartPole-v1', entry_point='gym.envs.classic_control.cartpole:CartPoleEnv', reward_threshold=475.0, nondeterministic=False, max_episode_steps=500, order_enforce=True, autoreset=False, kwargs={}, namespace=None, name='CartPole', version=1) EnvSpec(id='MountainCar-v0', entry_point='gym.envs.classic_control.mountain_car:MountainCarEnv', reward_threshold=-110.0, nondeterministic=False, max_episode_steps=200, order_enforce=True, autoreset=False, kwargs={}, namespace=None, name='MountainCar', version=0) EnvSpec(id='MountainCarContinuous-v0', entry_point='gym.envs.classic_control.continuous_mountain_car:Continuous_MountainCarEnv', reward_threshold=90.0, nondeterministic=False, max_episode_steps=999, order_enforce=True, autoreset=False, kwargs={}, namespace=None, name='MountainCarContinuous', version=0) EnvSpec(id='Pendulum-v1', entry_point='gym.envs.classic_control.pendulum:PendulumEnv', reward_threshold=None, nondeterministic=False, max_episode_steps=200, order_enforce=True, autoreset=False, kwargs={}, namespace=None, name='Pendulum', version=1) EnvSpec(id='Acrobot-v1', entry_point='gym.envs.classic_control.acrobot:AcrobotEnv', reward_threshold=-100.0, nondeterministic=False, max_episode_steps=500, order_enforce=True, autoreset=False, kwargs={}, namespace=None, name='Acrobot', version=1) EnvSpec(id='LunarLander-v2', entry_point='gym.envs.box2d.lunar_lander:LunarLander', reward_threshold=200, nondeterministic=False, max_episode_steps=1000, order_enforce=True, autoreset=False, kwargs={}, namespace=None, name='LunarLander', version=2) EnvSpec(id='LunarLanderContinuous-v2', entry_point='gym.envs.box2d.lunar_lander:LunarLander', reward_threshold=200, nondeterministic=False, max_episode_steps=1000, order_enforce=True, autoreset=False, kwargs={'continuous': True}, namespace=None, name='LunarLanderContinuous', version=2) EnvSpec(id='BipedalWalker-v3', entry_point='gym.envs.box2d.bipedal_walker:BipedalWalker', reward_threshold=300, nondeterministic=False, max_episode_steps=1600, order_enforce=True, autoreset=False, kwargs={}, namespace=None, name='BipedalWalker', version=3) EnvSpec(id='BipedalWalkerHardcore-v3', entry_point='gym.envs.box2d.bipedal_walker:BipedalWalker', reward_threshold=300, nondeterministic=False, max_episode_steps=2000, order_enforce=True, autoreset=False, kwargs={'hardcore': True}, namespace=None, name='BipedalWalkerHardcore', version=3) EnvSpec(id='CarRacing-v1', entry_point='gym.envs.box2d.car_racing:CarRacing', reward_threshold=900, nondeterministic=False, max_episode_steps=1000, order_enforce=True, autoreset=False, kwargs={}, namespace=None, name='CarRacing', version=1) EnvSpec(id='CarRacingDomainRandomize-v1', entry_point='gym.envs.box2d.car_racing:CarRacing', reward_threshold=900, nondeterministic=False, max_episode_steps=1000, order_enforce=True, autoreset=False, kwargs={'domain_randomize': True}, namespace=None, name='CarRacingDomainRandomize', version=1) EnvSpec(id='CarRacingDiscrete-v1', entry_point='gym.envs.box2d.car_racing:CarRacing', reward_threshold=900, nondeterministic=False, max_episode_steps=1000, order_enforce=True, autoreset=False, kwargs={'continuous': False}, namespace=None, name='CarRacingDiscrete', version=1) EnvSpec(id='CarRacingDomainRandomizeDiscrete-v1', entry_point='gym.envs.box2d.car_racing:CarRacing', reward_threshold=900, nondeterministic=False, max_episode_steps=1000, order_enforce=True, autoreset=False, kwargs={'domain_randomize': True, 'continuous': False}, namespace=None, name='CarRacingDomainRandomizeDiscrete', version=1) C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Reacher-v2 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Pusher-v2 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment InvertedPendulum-v2 is out of date. You should consider upgrading to version `v4`. EnvSpec(id='Blackjack-v1', entry_point='gym.envs.toy_text.blackjack:BlackjackEnv', reward_threshold=None, nondeterministic=False, max_episode_steps=None, order_enforce=True, autoreset=False, kwargs={'sab': True, 'natural': False}, namespace=None, name='Blackjack', version=1) EnvSpec(id='FrozenLake-v1', entry_point='gym.envs.toy_text.frozen_lake:FrozenLakeEnv', reward_threshold=0.7, nondeterministic=False, max_episode_steps=100, order_enforce=True, autoreset=False, kwargs={'map_name': '4x4'}, namespace=None, name='FrozenLake', version=1) EnvSpec(id='FrozenLake8x8-v1', entry_point='gym.envs.toy_text.frozen_lake:FrozenLakeEnv', reward_threshold=0.85, nondeterministic=False, max_episode_steps=200, order_enforce=True, autoreset=False, kwargs={'map_name': '8x8'}, namespace=None, name='FrozenLake8x8', version=1) EnvSpec(id='CliffWalking-v0', entry_point='gym.envs.toy_text.cliffwalking:CliffWalkingEnv', reward_threshold=None, nondeterministic=False, max_episode_steps=None, order_enforce=True, autoreset=False, kwargs={}, namespace=None, name='CliffWalking', version=0) EnvSpec(id='Taxi-v3', entry_point='gym.envs.toy_text.taxi:TaxiEnv', reward_threshold=8, nondeterministic=False, max_episode_steps=200, order_enforce=True, autoreset=False, kwargs={}, namespace=None, name='Taxi', version=3) EnvSpec(id='Reacher-v2', entry_point='gym.envs.mujoco:ReacherEnv', reward_threshold=-3.75, nondeterministic=False, max_episode_steps=50, order_enforce=True, autoreset=False, kwargs={}, namespace=None, name='Reacher', version=2) EnvSpec(id='Reacher-v4', entry_point='gym.envs.mujoco.reacher_v4:ReacherEnv', reward_threshold=-3.75, nondeterministic=False, max_episode_steps=50, order_enforce=True, autoreset=False, kwargs={}, namespace=None, name='Reacher', version=4) EnvSpec(id='Pusher-v2', entry_point='gym.envs.mujoco:PusherEnv', reward_threshold=0.0, nondeterministic=False, max_episode_steps=100, order_enforce=True, autoreset=False, kwargs={}, namespace=None, name='Pusher', version=2) EnvSpec(id='Pusher-v4', entry_point='gym.envs.mujoco.pusher_v4:PusherEnv', reward_threshold=0.0, nondeterministic=False, max_episode_steps=100, order_enforce=True, autoreset=False, kwargs={}, namespace=None, name='Pusher', version=4) EnvSpec(id='InvertedPendulum-v2', entry_point='gym.envs.mujoco:InvertedPendulumEnv', reward_threshold=950.0, nondeterministic=False, max_episode_steps=1000, order_enforce=True, autoreset=False, kwargs={}, namespace=None, name='InvertedPendulum', version=2) EnvSpec(id='InvertedPendulum-v4', entry_point='gym.envs.mujoco.inverted_pendulum_v4:InvertedPendulumEnv', reward_threshold=950.0, nondeterministic=False, max_episode_steps=1000, order_enforce=True, autoreset=False, kwargs={}, namespace=None, name='InvertedPendulum', version=4) EnvSpec(id='InvertedDoublePendulum-v2', entry_point='gym.envs.mujoco:InvertedDoublePendulumEnv', reward_threshold=9100.0, nondeterministic=False, max_episode_steps=1000, order_enforce=True, autoreset=False, kwargs={}, namespace=None, name='InvertedDoublePendulum', version=2) EnvSpec(id='InvertedDoublePendulum-v4', entry_point='gym.envs.mujoco.inverted_double_pendulum_v4:InvertedDoublePendulumEnv', reward_threshold=9100.0, nondeterministic=False, max_episode_steps=1000, order_enforce=True, autoreset=False, kwargs={}, namespace=None, name='InvertedDoublePendulum', version=4) EnvSpec(id='HalfCheetah-v2', entry_point='gym.envs.mujoco:HalfCheetahEnv', reward_threshold=4800.0, nondeterministic=False, max_episode_steps=1000, order_enforce=True, autoreset=False, kwargs={}, namespace=None, name='HalfCheetah', version=2) EnvSpec(id='HalfCheetah-v3', entry_point='gym.envs.mujoco.half_cheetah_v3:HalfCheetahEnv', reward_threshold=4800.0, nondeterministic=False, max_episode_steps=1000, order_enforce=True, autoreset=False, kwargs={}, namespace=None, name='HalfCheetah', version=3) EnvSpec(id='HalfCheetah-v4', entry_point='gym.envs.mujoco.half_cheetah_v4:HalfCheetahEnv', reward_threshold=4800.0, nondeterministic=False, max_episode_steps=1000, order_enforce=True, autoreset=False, kwargs={}, namespace=None, name='HalfCheetah', version=4) logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment InvertedDoublePendulum-v2 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment HalfCheetah-v2 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment HalfCheetah-v3 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Hopper-v2 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Hopper-v3 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Swimmer-v2 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Swimmer-v3 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Walker2d-v2 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Walker2d-v3 is out of date. You should consider upgrading to version `v4`. logger.warn( EnvSpec(id='Hopper-v2', entry_point='gym.envs.mujoco:HopperEnv', reward_threshold=3800.0, nondeterministic=False, max_episode_steps=1000, order_enforce=True, autoreset=False, kwargs={}, namespace=None, name='Hopper', version=2) EnvSpec(id='Hopper-v3', entry_point='gym.envs.mujoco.hopper_v3:HopperEnv', reward_threshold=3800.0, nondeterministic=False, max_episode_steps=1000, order_enforce=True, autoreset=False, kwargs={}, namespace=None, name='Hopper', version=3) EnvSpec(id='Hopper-v4', entry_point='gym.envs.mujoco.hopper_v4:HopperEnv', reward_threshold=3800.0, nondeterministic=False, max_episode_steps=1000, order_enforce=True, autoreset=False, kwargs={}, namespace=None, name='Hopper', version=4) EnvSpec(id='Swimmer-v2', entry_point='gym.envs.mujoco:SwimmerEnv', reward_threshold=360.0, nondeterministic=False, max_episode_steps=1000, order_enforce=True, autoreset=False, kwargs={}, namespace=None, name='Swimmer', version=2) EnvSpec(id='Swimmer-v3', entry_point='gym.envs.mujoco.swimmer_v3:SwimmerEnv', reward_threshold=360.0, nondeterministic=False, max_episode_steps=1000, order_enforce=True, autoreset=False, kwargs={}, namespace=None, name='Swimmer', version=3) EnvSpec(id='Swimmer-v4', entry_point='gym.envs.mujoco.swimmer_v4:SwimmerEnv', reward_threshold=360.0, nondeterministic=False, max_episode_steps=1000, order_enforce=True, autoreset=False, kwargs={}, namespace=None, name='Swimmer', version=4) EnvSpec(id='Walker2d-v2', entry_point='gym.envs.mujoco:Walker2dEnv', reward_threshold=None, nondeterministic=False, max_episode_steps=1000, order_enforce=True, autoreset=False, kwargs={}, namespace=None, name='Walker2d', version=2) EnvSpec(id='Walker2d-v3', entry_point='gym.envs.mujoco.walker2d_v3:Walker2dEnv', reward_threshold=None, nondeterministic=False, max_episode_steps=1000, order_enforce=True, autoreset=False, kwargs={}, namespace=None, name='Walker2d', version=3) EnvSpec(id='Walker2d-v4', entry_point='gym.envs.mujoco.walker2d_v4:Walker2dEnv', reward_threshold=None, nondeterministic=False, max_episode_steps=1000, order_enforce=True, autoreset=False, kwargs={}, namespace=None, name='Walker2d', version=4) EnvSpec(id='Ant-v2', entry_point='gym.envs.mujoco:AntEnv', reward_threshold=6000.0, nondeterministic=False, max_episode_steps=1000, order_enforce=True, autoreset=False, kwargs={}, namespace=None, name='Ant', version=2) EnvSpec(id='Ant-v3', entry_point='gym.envs.mujoco.ant_v3:AntEnv', reward_threshold=6000.0, nondeterministic=False, max_episode_steps=1000, order_enforce=True, autoreset=False, kwargs={}, namespace=None, name='Ant', version=3) EnvSpec(id='Ant-v4', entry_point='gym.envs.mujoco.ant_v4:AntEnv', reward_threshold=6000.0, nondeterministic=False, max_episode_steps=1000, order_enforce=True, autoreset=False, kwargs={}, namespace=None, name='Ant', version=4) EnvSpec(id='Humanoid-v2', entry_point='gym.envs.mujoco:HumanoidEnv', reward_threshold=None, nondeterministic=False, max_episode_steps=1000, order_enforce=True, autoreset=False, kwargs={}, namespace=None, name='Humanoid', version=2) EnvSpec(id='Humanoid-v3', entry_point='gym.envs.mujoco.humanoid_v3:HumanoidEnv', reward_threshold=None, nondeterministic=False, max_episode_steps=1000, order_enforce=True, autoreset=False, kwargs={}, namespace=None, name='Humanoid', version=3) EnvSpec(id='Humanoid-v4', entry_point='gym.envs.mujoco.humanoid_v4:HumanoidEnv', reward_threshold=None, nondeterministic=False, max_episode_steps=1000, order_enforce=True, autoreset=False, kwargs={}, namespace=None, name='Humanoid', version=4) C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Ant-v2 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Ant-v3 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Humanoid-v2 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment Humanoid-v3 is out of date. You should consider upgrading to version `v4`. logger.warn( C:\Users\81283\anaconda3\envs\test\lib\site-packages\gym\envs\registration.py:568: UserWarning: WARN: The environment HumanoidStandup-v2 is out of date. You should consider upgrading to version `v4`. logger.warn( EnvSpec(id='HumanoidStandup-v2', entry_point='gym.envs.mujoco:HumanoidStandupEnv', reward_threshold=None, nondeterministic=False, max_episode_steps=1000, order_enforce=True, autoreset=False, kwargs={}, namespace=None, name='HumanoidStandup', version=2) EnvSpec(id='HumanoidStandup-v4', entry_point='gym.envs.mujoco.humanoidstandup_v4:HumanoidStandupEnv', reward_threshold=None, nondeterministic=False, max_episode_steps=1000, order_enforce=True, autoreset=False, kwargs={}, namespace=None, name='HumanoidStandup', version=4) 报错环境数为： 47 用时： 1163.6926209926605
可以看到所有的Atari游戏均可以正常运行，这也是比前几版本的gym[atari]要好的地方，因为前几版本的Atari游戏中pacman和surround游戏会运行报错，而新版本的gym中就很好的解决了这个问题。（上面运行的环境出现报错的情况是因为对应的gym组件没有安装，如mujoco）
不过值得我们注意的一点是虽然Atari的所有游戏环境均可正常运行但是却又很多都有警告提示，如：
具体如：
UserWarning: WARN: The environment SpaceInvadersNoFrameskip-v0 is out of date. You should consider upgrading to version `v4`.
而这个警告就是说有些游戏环境的v0版本已过时，建议使用v4版本，对此我们看了下gym对应Atari页面的说明：
https://github.com/mgbellemare/Arcade-Learning-Environment#rom-management
我们看到关于游戏环境版本的问题可以参看官方的对应论文：
Revisiting the Arcade Learning Environment by Machado et al..
==========================================
本博客是博主个人学习时的一些记录，不保证是为原创，个别文章加入了转载的源地址，还有个别文章是汇总网上多份资料所成，在这之中也必有疏漏未加标注处，如有侵权请与博主联系。
如果未特殊标注则为原创，遵循 CC 4.0 BY-SA 版权协议。
posted on 2022-05-31 11:00 Angry_Panda 阅读(500) 评论(0) 编辑 收藏 举报
