Skip to content

[Bug]: Lookat parameter on gs.sensors.RasterizerCameraOptions not taking effect #2591

@NanaKay007

Description

@NanaKay007

Bug Description

Hello,

I'm fairly convinced there's a bug associated with this sensor interface. I have tried various values for 'lookat' parameter, but none take effect. However, removing entity_indx fixes the issue. Based on the docs, it's hard to see why this specific set-up wouldn't work. Appreciate any help here. Thanks.

robot = scene.add_entity(
            gs.morphs.URDF(
                file="urdf/go2/urdf/go2.urdf",
                **entity_kwargs,
            )
        )

sensor_kwargs = dict(
        entity_idx=robot.idx,
        lookat=(1,0,3),
        pos=(0.3,0,0.3),
        draw_debug=True,
        euler_offset=(0,0,0),
        link_idx_local=0,
        fov=70,
    )
sensor = scene.add_sensor(gs.sensors.RasterizerCameraOptions(**sensor_kwargs))

Steps to Reproduce

robot = scene.add_entity(
            gs.morphs.URDF(
                file="urdf/go2/urdf/go2.urdf",
                **entity_kwargs,
            )
        )

sensor_kwargs = dict(
        entity_idx=robot.idx,
        lookat=(1,0,3),
        pos=(0.3,0,0.3),
        draw_debug=True,
        euler_offset=(0,0,0),
        link_idx_local=0,
        fov=70,
    )
sensor = scene.add_sensor(gs.sensors.RasterizerCameraOptions(**sensor_kwargs))
 
def read_sensor_cpu():
      data = sensor.read().rgb
      return data.cpu()

scene.start_recording(
      read_sensor_cpu,
      gs.recorders.MPLImagePlot(
          show_window=True
      )
  )

Expected Behavior

look at should take effect with entity attached.

Screenshots/Videos

No response

Relevant log output

Environment

  • OS: macOS Tahoe
  • GPU/CPU [e.g. A100, RTX 4090, M3pr, Intel I9-9900k, Ryzen 5900x] (N/A if no GPU/CPU)
  • GPU-driver version (N/A if no GPU)
  • CUDA / CUDA-toolkit version : N/A

Release version or Commit ID

version: 0.4.1

Additional Context

No response

Metadata

Metadata

Assignees

No one assigned

    Labels

    bugSomething isn't working

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions