Skip to content

enchance obs manager#18

Open
vybhav-ibr wants to merge 1 commit intojgillick:mainfrom
vybhav-ibr:feature/enhance_obs_manager
Open

enchance obs manager#18
vybhav-ibr wants to merge 1 commit intojgillick:mainfrom
vybhav-ibr:feature/enhance_obs_manager

Conversation

@vybhav-ibr
Copy link
Copy Markdown

modify observation manager to return each component of the observations as a separate box, make obs_size calculation compatible with multi-dimensional arrays to support sensors

makes the observation_space of the type collection.OrderedDict, This makes it possible for the policy to segregate the observations into its individual components(this is only possible with skrl, and skrl has a built in function for this called space_to_space), after the observation is divided into its constituents, different NNs can be used for the different observations, for instance the sensor observations like lidar, camera can be encoded into lower dimensional vectors using a CNN, which also helps preserve the spatial relation between the pixels/points. This is pretty much the only way sensor data can be used for RL, because using a fully connected network for the sensor observations will make the network way too large(a few million parameters).

here is an example of how this is used in SKRL code

…ns as a seperate box, make obs_size calculation compatable with multi-dimensional arrays to support sensors
@jgillick
Copy link
Copy Markdown
Owner

This PR is not ready for review:

  • You created a new script, in the root directory, instead of actually updating the observation manager. This makes it hard to easily see which parts are different and how to use them. Is this intended to be a new manager?
  • There's no example which shows how this is used. Is this for an actual robot project you're working?

Please avoid submitting incomplete PRs

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants