Hi, I have installed gym_extensions and all the tests in the gym_extensions package work. However while I attempt to run the same environment in the original code with
python main.py --task CentipedeEight-v1 --use_gnn_as_policy 1 --network_shape 64,64 --lr 0.0003 --num_threads 4 --lr_schedule adaptive --max_timesteps 1000000 --use_gnn_as_value 0 --gnn_embedding_option noninput_shared --root_connection_option nN,Rn,uE --gnn_node_option nG,nB
I get the following error:
[0130 16:05:39 @main.py:21] New environments available : ['WalkersHopperzero-v1', 'WalkersHalfhumanoidzero-v1', 'WalkersHalfcheetahzero-v1', 'WalkersFullcheetahzero-v1', 'WalkersOstrichzero-v1', 'WalkersHopperone-v1', 'WalkersHalfhumanoidone-v1', 'WalkersHalfcheetahone-v1', 'WalkersFullcheetahone-v1', 'WalkersOstrichone-v1', 'WalkersHoppertwo-v1', 'WalkersHalfhumanoidtwo-v1', 'WalkersHalfcheetahtwo-v1', 'WalkersFullcheetahtwo-v1', 'WalkersOstrichtwo-v1', 'WalkersHopperthree-v1', 'WalkersHalfhumanoidthree-v1', 'WalkersHalfcheetahthree-v1', 'WalkersFullcheetahthree-v1', 'WalkersOstrichthree-v1', 'WalkersHopperfour-v1', 'WalkersHalfhumanoidfour-v1', 'WalkersHalfcheetahfour-v1', 'WalkersFullcheetahfour-v1', 'WalkersOstrichfour-v1', 'WalkersHopperfive-v1', 'WalkersHalfhumanoidfive-v1', 'WalkersHalfcheetahfive-v1', 'WalkersFullcheetahfive-v1', 'WalkersOstrichfive-v1', 'CentipedeThree-v1', 'CentipedeFour-v1', 'CentipedeFive-v1', 'CentipedeSix-v1', 'CentipedeSeven-v1', 'CentipedeEight-v1', 'CentipedeTen-v1', 'CentipedeTwelve-v1', 'CentipedeFourteen-v1', 'CentipedeTwenty-v1', 'CentipedeThirty-v1', 'CentipedeForty-v1', 'CentipedeFifty-v1', 'CpCentipedeThree-v1', 'CpCentipedeFour-v1', 'CpCentipedeFive-v1', 'CpCentipedeSix-v1', 'CpCentipedeSeven-v1', 'CpCentipedeEight-v1', 'CpCentipedeTen-v1', 'CpCentipedeTwelve-v1', 'CpCentipedeFourteen-v1', 'ReacherZero-v1', 'ReacherOne-v1', 'ReacherTwo-v1', 'ReacherThree-v1', 'ReacherFour-v1', 'ReacherFive-v1', 'ReacherSix-v1', 'ReacherSeven-v1', 'SnakeThree-v1', 'SnakeFour-v1', 'SnakeFive-v1', 'SnakeSix-v1', 'SnakeSeven-v1', 'SnakeEight-v1', 'SnakeNine-v1', 'SnakeTen-v1', 'SnakeTwenty-v1', 'SnakeForty-v1'] Traceback (most recent call last): File "/home/josyula/Programs/NerveNet/tool/main.py", line 26, in <module> learner_env = gym.make(args.task) File "/home/josyula/miniconda3/lib/python3.9/site-packages/gym/envs/registration.py", line 235, in make return registry.make(id, **kwargs) File "/home/josyula/miniconda3/lib/python3.9/site-packages/gym/envs/registration.py", line 129, in make env = spec.make(**kwargs) File "/home/josyula/miniconda3/lib/python3.9/site-packages/gym/envs/registration.py", line 90, in make env = cls(**_kwargs) File "/home/josyula/Programs/NerveNet/tool/../environments/multitask_env/walkers.py", line 374, in __init__ super(WalkersHalfcheetahfiveEnv, self).__init__(num=5) File "/home/josyula/Programs/NerveNet/tool/../environments/multitask_env/walkers.py", line 190, in __init__ mujoco_env.MujocoEnv.__init__(self, xml_path, 4) File "/home/josyula/miniconda3/lib/python3.9/site-packages/gym/envs/mujoco/mujoco_env.py", line 71, in __init__ observation, _reward, done, _info = self.step(action) File "/home/josyula/miniconda3/lib/python3.9/site-packages/gym/core.py", line 58, in step raise NotImplementedError NotImplementedError
same environment works in gym_extensions:
python nervenet_env_single_test.py
Can you please help regarding this issue? Thank you.
Hi, I have installed gym_extensions and all the tests in the gym_extensions package work. However while I attempt to run the same environment in the original code with
python main.py --task CentipedeEight-v1 --use_gnn_as_policy 1 --network_shape 64,64 --lr 0.0003 --num_threads 4 --lr_schedule adaptive --max_timesteps 1000000 --use_gnn_as_value 0 --gnn_embedding_option noninput_shared --root_connection_option nN,Rn,uE --gnn_node_option nG,nBI get the following error:
[0130 16:05:39 @main.py:21] New environments available : ['WalkersHopperzero-v1', 'WalkersHalfhumanoidzero-v1', 'WalkersHalfcheetahzero-v1', 'WalkersFullcheetahzero-v1', 'WalkersOstrichzero-v1', 'WalkersHopperone-v1', 'WalkersHalfhumanoidone-v1', 'WalkersHalfcheetahone-v1', 'WalkersFullcheetahone-v1', 'WalkersOstrichone-v1', 'WalkersHoppertwo-v1', 'WalkersHalfhumanoidtwo-v1', 'WalkersHalfcheetahtwo-v1', 'WalkersFullcheetahtwo-v1', 'WalkersOstrichtwo-v1', 'WalkersHopperthree-v1', 'WalkersHalfhumanoidthree-v1', 'WalkersHalfcheetahthree-v1', 'WalkersFullcheetahthree-v1', 'WalkersOstrichthree-v1', 'WalkersHopperfour-v1', 'WalkersHalfhumanoidfour-v1', 'WalkersHalfcheetahfour-v1', 'WalkersFullcheetahfour-v1', 'WalkersOstrichfour-v1', 'WalkersHopperfive-v1', 'WalkersHalfhumanoidfive-v1', 'WalkersHalfcheetahfive-v1', 'WalkersFullcheetahfive-v1', 'WalkersOstrichfive-v1', 'CentipedeThree-v1', 'CentipedeFour-v1', 'CentipedeFive-v1', 'CentipedeSix-v1', 'CentipedeSeven-v1', 'CentipedeEight-v1', 'CentipedeTen-v1', 'CentipedeTwelve-v1', 'CentipedeFourteen-v1', 'CentipedeTwenty-v1', 'CentipedeThirty-v1', 'CentipedeForty-v1', 'CentipedeFifty-v1', 'CpCentipedeThree-v1', 'CpCentipedeFour-v1', 'CpCentipedeFive-v1', 'CpCentipedeSix-v1', 'CpCentipedeSeven-v1', 'CpCentipedeEight-v1', 'CpCentipedeTen-v1', 'CpCentipedeTwelve-v1', 'CpCentipedeFourteen-v1', 'ReacherZero-v1', 'ReacherOne-v1', 'ReacherTwo-v1', 'ReacherThree-v1', 'ReacherFour-v1', 'ReacherFive-v1', 'ReacherSix-v1', 'ReacherSeven-v1', 'SnakeThree-v1', 'SnakeFour-v1', 'SnakeFive-v1', 'SnakeSix-v1', 'SnakeSeven-v1', 'SnakeEight-v1', 'SnakeNine-v1', 'SnakeTen-v1', 'SnakeTwenty-v1', 'SnakeForty-v1'] Traceback (most recent call last): File "/home/josyula/Programs/NerveNet/tool/main.py", line 26, in <module> learner_env = gym.make(args.task) File "/home/josyula/miniconda3/lib/python3.9/site-packages/gym/envs/registration.py", line 235, in make return registry.make(id, **kwargs) File "/home/josyula/miniconda3/lib/python3.9/site-packages/gym/envs/registration.py", line 129, in make env = spec.make(**kwargs) File "/home/josyula/miniconda3/lib/python3.9/site-packages/gym/envs/registration.py", line 90, in make env = cls(**_kwargs) File "/home/josyula/Programs/NerveNet/tool/../environments/multitask_env/walkers.py", line 374, in __init__ super(WalkersHalfcheetahfiveEnv, self).__init__(num=5) File "/home/josyula/Programs/NerveNet/tool/../environments/multitask_env/walkers.py", line 190, in __init__ mujoco_env.MujocoEnv.__init__(self, xml_path, 4) File "/home/josyula/miniconda3/lib/python3.9/site-packages/gym/envs/mujoco/mujoco_env.py", line 71, in __init__ observation, _reward, done, _info = self.step(action) File "/home/josyula/miniconda3/lib/python3.9/site-packages/gym/core.py", line 58, in step raise NotImplementedError NotImplementedErrorsame environment works in gym_extensions:
python nervenet_env_single_test.pyCan you please help regarding this issue? Thank you.