iGPU and power related issues

[System64fumo]

Hello, As per geerlingguy/sbc-reviews#62 (comment) i've moved the conversation to this repo.

Just got the time to test and debug sorry for the wait.
That being said as per my previous messages on that post, I've gotten the 7.0.0 mainline kernel booted on my radxa orion o6 alongside the required patches but have faced some trouble getting the board to poweroff/reboot or use the iGPU.

Pressing the power button or sending a shutdown/reboot command through linux "Works" but the board remains powered on until i forcefully hold the power button for a few seconds..

As for the iGPU, I haven't gotten it working with mesa? Vulkan claims to work? But i highly doubt it's actually using the iGPU because my dGPU is showing higher usage than normal (Which to me implies it's falling back to it)

Some misc logs:

DRI_PRIME=1 glmark2-wayland
=======================================================
    glmark2 2023.01
=======================================================
    OpenGL Information
    GL_VENDOR:      Mesa
    GL_RENDERER:    Mali-G720 MC10 (Panfrost)
    GL_VERSION:     3.1 Mesa 26.1.1-arch1.2
    Surface Config: buf=32 r=8 g=8 b=8 a=8 depth=24 stencil=0 samples=0
    Surface Size:   800x600 windowed
=======================================================
[build] use-vbo=false:wl_display#1: error 1: invalid arguments for wl_surface#17.attach
 FPS: 562 FrameTime: 1.781 ms
=======================================================
                                  glmark2 Score: 561 
=======================================================

MESA_VK_DEVICE_SELECT=13b5:c8700008! vkcube
Selected WSI platform: wayland
WARNING: panvk is not a conformant Vulkan implementation, testing use only.
Selected GPU 0: Mali-G720 MC10, type: IntegratedGpu

vulkaninfo --summary
WARNING: [../mesa-26.1.2/src/amd/vulkan/radv_physical_device.c:2411] Code 0 : Device '/dev/dri/renderD128' is not using the AMDGPU kernel driver: Permission denied (VK_ERROR_INCOMPATIBLE_DRIVER)
WARNING: panvk is not a conformant Vulkan implementation, testing use only.
==========
VULKANINFO
==========

Vulkan Instance Version: 1.4.350


Instance Extensions: count = 26
-------------------------------
VK_EXT_acquire_drm_display             : extension revision 1
VK_EXT_acquire_xlib_display            : extension revision 1
VK_EXT_debug_report                    : extension revision 10
VK_EXT_debug_utils                     : extension revision 2
VK_EXT_direct_mode_display             : extension revision 1
VK_EXT_display_surface_counter         : extension revision 1
VK_EXT_headless_surface                : extension revision 1
VK_EXT_layer_settings                  : extension revision 2
VK_EXT_surface_maintenance1            : extension revision 1
VK_EXT_swapchain_colorspace            : extension revision 5
VK_KHR_device_group_creation           : extension revision 1
VK_KHR_display                         : extension revision 23
VK_KHR_external_fence_capabilities     : extension revision 1
VK_KHR_external_memory_capabilities    : extension revision 1
VK_KHR_external_semaphore_capabilities : extension revision 1
VK_KHR_get_display_properties2         : extension revision 1
VK_KHR_get_physical_device_properties2 : extension revision 2
VK_KHR_get_surface_capabilities2       : extension revision 1
VK_KHR_portability_enumeration         : extension revision 1
VK_KHR_surface                         : extension revision 25
VK_KHR_surface_maintenance1            : extension revision 1
VK_KHR_surface_protected_capabilities  : extension revision 1
VK_KHR_wayland_surface                 : extension revision 6
VK_KHR_xcb_surface                     : extension revision 6
VK_KHR_xlib_surface                    : extension revision 6
VK_LUNARG_direct_driver_loading        : extension revision 1

Instance Layers: count = 12
---------------------------
VK_LAYER_INTEL_nullhw                INTEL NULL HW                                                1.1.73   version 1
VK_LAYER_MESA_anti_lag               Open-source implementation of the VK_AMD_anti_lag extension. 1.4.303  version 1
VK_LAYER_MESA_device_select          Linux device selection layer                                 1.4.303  version 1
VK_LAYER_MESA_overlay                Mesa Overlay layer                                           1.4.303  version 1
VK_LAYER_MESA_screenshot             Mesa Screenshot layer                                        1.4.303  version 1
VK_LAYER_MESA_vram_report_limit      Limit reported VRAM                                          1.4.303  version 1
VK_LAYER_RENDERDOC_Capture           Debugging capture layer for RenderDoc                        1.4.324  version 44
VK_LAYER_VALVE_steam_fossilize_32    Steam Pipeline Caching Layer                                 1.3.207  version 1
VK_LAYER_VALVE_steam_fossilize_64    Steam Pipeline Caching Layer                                 1.3.207  version 1
VK_LAYER_VALVE_steam_fossilize_arm64 Steam Pipeline Caching Layer                                 1.3.207  version 1
VK_LAYER_VALVE_steam_overlay_32      Steam Overlay Layer                                          1.3.207  version 1
VK_LAYER_VALVE_steam_overlay_64      Steam Overlay Layer                                          1.3.207  version 1

Devices:
========
GPU0:
	apiVersion         = 1.4.348
	driverVersion      = 26.1.2
	vendorID           = 0x1002
	deviceID           = 0x7480
	deviceType         = PHYSICAL_DEVICE_TYPE_DISCRETE_GPU
	deviceName         = AMD Radeon RX 7600 XT (RADV NAVI33)
	driverID           = DRIVER_ID_MESA_RADV
	driverName         = radv
	driverInfo         = Mesa 26.1.2-arch1.1
	conformanceVersion = 1.4.0.0
	deviceUUID         = 00000000-c300-0000-0000-000000000000
	driverUUID         = 414d442d-4d45-5341-2d44-525600000000
GPU1:
	apiVersion         = 1.4.348
	driverVersion      = 26.1.2
	vendorID           = 0x13b5
	deviceID           = 0xc8700008
	deviceType         = PHYSICAL_DEVICE_TYPE_INTEGRATED_GPU
	deviceName         = Mali-G720 MC10
	driverID           = DRIVER_ID_MESA_PANVK
	driverName         = panvk
	driverInfo         = Mesa 26.1.2-arch1.1
	conformanceVersion = 0.0.0.0
	deviceUUID         = b5130000-0800-70c8-0000-000000000000
	driverUUID         = 4ceacc34-58dd-c6fe-638d-a00ec59747ac 

DRI_PRIME=1 glxinfo -B
name of display: :0
MESA: error: dri3_alloc_render_buffer:1653 xcb_dri3_pixmap_from_buffer[s] failed
MESA: error: X error: 11
display: :0  screen: 0
direct rendering: Yes
Extended renderer info (GLX_MESA_query_renderer):
    Vendor: Mesa (0x13b5)
    Device: Mali-G720 MC10 (Panfrost) (0xffffffff)
    Version: 26.1.2
    Accelerated: yes
    Video memory: 63846MB
    Unified memory: yes
    Preferred profile: core (0x1)
    Max core profile version: 3.1
    Max compat profile version: 3.1
    Max GLES1 profile version: 1.1
    Max GLES[23] profile version: 3.1
OpenGL vendor string: Mesa
OpenGL renderer string: Mali-G720 MC10 (Panfrost)
OpenGL core profile version string: 3.1 Mesa 26.1.2-arch1.1
OpenGL core profile shading language version string: 1.40
OpenGL core profile context flags: (none)
MESA: error: dri3_alloc_render_buffer:1653 xcb_dri3_pixmap_from_buffer[s] failed
MESA: error: X error: 11

OpenGL version string: 3.1 Mesa 26.1.2-arch1.1
OpenGL shading language version string: 1.40
OpenGL context flags: (none)
MESA: error: dri3_alloc_render_buffer:1653 xcb_dri3_pixmap_from_buffer[s] failed
MESA: error: X error: 11

OpenGL ES profile version string: OpenGL ES 3.1 Mesa 26.1.2-arch1.1
OpenGL ES profile shading language version string: OpenGL ES GLSL ES 3.10

I'm running the recommended config as per the instructions on this git repo with minor changes such as disabling any debug related configs or unnecessary modules (Mainly networking and anything related for other SoCs like sophgo or the like)

I'm also running the CIX unlocked UEFI although i've also tried claystan's nightly UEFI which didn't change anything..

@amazingfate Any help would be appreciated.

[amazingfate]

For your poweroff issue, it is necessary to collect log from serial console to see which step the os is stuck.

About the iGPU, which display port you are connecting to the monitor? If you are connecting to the port on your AMD graphic card, it will still work.

[System64fumo]

I'm connected through the AMD GPU's DP and HDMI ports, Will collect relevant uart logs later today.

[System64fumo]

Regular linux UART output:

Sent SIGTERM to all processes
Sent SIGKILL to all processes
Requesting system poweroff

EC UART output:

Channel0: (2, d8)2.348V T:309.901(36.4 C) Rt:59.227.
Channel1: (2, f5)2.442V T:306.713(33.2 C) Rt:68.301.
Channel3: (2, d4)2.335V T:310.330(36.8 C) Rt:58.114.
Channel4: (2, f5)2.442V T:306.713(33.2 C) Rt:68.301.
Channel5: (2, f7)2.448V T:306.488(33.0 C) Rt:69.000.
rCsuPM data:0x253a
G3PwrLongPressTimCnt:0
G3PwrLongPressTimCnt:0
G3PwrLongPressTimCnt:0
G3PwrLongPressTimCnt:0
G3PwrLongPressTimCnt:0
Channel0: (2, d8)2.348V T:309.901(36.4 C) Rt:59.227.
Channel1: (2, f5)2.442V T:306.713(33.2 C) Rt:68.301.
Channel3: (2, d3)2.332V T:310.437(36.9 C) Rt:57.840.
Channel4: (2, f5)2.442V T:306.713(33.2 C) Rt:68.301.
Channel5: (2, f8)2.452V T:306.375(32.9 C) Rt:69.354.
rCsuPM data:0x253a
G3PwrLongPressTimCnt:0
G3PwrLongPressTimCnt:0
G3PwrLongPressTimCnt:0
G3PwrLongPressTimCnt:0
G3PwrLongPressTimCnt:0
Channel0: (2, db)2.358V T:309.577(36.1 C) Rt:60.082.
Channel1: (2, f9)2.455V T:306.262(32.8 C) Rt:69.710.
Channel3: (2, d5)2.339V T:310.223(36.7 C) Rt:58.389.
Channel4: (2, f8)2.452V T:306.375(32.9 C) Rt:69.354.
Channel5: (2, f8)2.452V T:306.375(32.9 C) Rt:69.354.
rCsuPM data:0x253a
G3PwrLongPressTimCnt:0

The EC log keeps repeating itself over and over every second or so.

As for the iGPU, I decided to move both HDMI and DP to the onboard ports
Result? Crash/Shutdown whenever trying to do anything iGPU related, Eg opening a terminal to see nvtop.

[amazingfate]

Regular linux UART output:

Sent SIGTERM to all processes
Sent SIGKILL to all processes
Requesting system poweroff

This is the log from system init process. Please add kernel arg initcall_debug loglevel=7 to see detail kernel log.

As for the iGPU, I decided to move both HDMI and DP to the onboard ports
Result? Crash/Shutdown whenever trying to do anything iGPU related, Eg opening a terminal to see nvtop.

You can try to disable the panthor driver when using display from dGPU, or disable amdgpu/modeset when using display from board.

[System64fumo]

Alright just did some tests
I've unplugged my dGPU completely and now linux 7.0.0 reboots/shuts down normally.
As for the iGPU related shutdown.. for whatever reason something is triggering a thermal shutdown:

[   30.840162] thermal thermal_zone3: acpitz: critical temperature reached
[   30.840174] reboot: HARDWARE PROTECTION shutdown (Temperature too high)
[   30.881479] elogind-daemon[631]: Received signal 15 [TERM]
Sent SIGKILL to all processes
Requesting system poweroff

I'm going to assume linux isn't liking N/A for a safe temperature 😅

thermal.off=1 let me get through to a desktop
And now that i don't have the dGPU plugged in i can confirm the iGPU works, Tested in labwc with glmark2-wayland.

I guess not a lot of testing was done with dGPUs?

Edit: forgot to mention, Sorry for the delay.. I sort of depend on this machine for day to day use.. Sorry!

[amazingfate]

I guess not a lot of testing was done with dGPUs?

Yes we haven't test with dGPUs with the mainline kernel. We will improve this.