Skip to content

[Rel 7.0 RC3] [rocpd] Adding summary module to generate summaries from rocpd databa…#190

Closed
systems-assistant[bot] wants to merge 2 commits intorelease/rocm-rel-7.0from
import/release_rocm-rel-7.0/ROCm_rocprofiler-sdk/yhui_rocpd-summary-7.0
Closed

[Rel 7.0 RC3] [rocpd] Adding summary module to generate summaries from rocpd databa…#190
systems-assistant[bot] wants to merge 2 commits intorelease/rocm-rel-7.0from
import/release_rocm-rel-7.0/ROCm_rocprofiler-sdk/yhui_rocpd-summary-7.0

Conversation

@systems-assistant
Copy link
Contributor

…se + query submodule + rocpd command-line tools (#488)

  • cherry pick into release/rocm-rel-7.0
  • Adds summary and query modules
  • Adds rocpd command-line tools

https://ontrack-internal.amd.com/browse/SWDEV-504931


PR Details

Associated Jira Ticket Number/Link

https://ontrack-internal.amd.com/browse/SWDEV-504931

What type of PR is this? (check all applicable)

  • Refactor
  • Feature
  • Bug Fix
  • Optimization
  • Documentation Update
  • Continuous Integration

Technical details

Added/updated tests?

  • Yes
  • No, Does not apply to this PR.

Updated CHANGELOG?

  • Yes
  • No, Does not apply to this PR.

Added/Updated documentation?

  • Yes
  • No, Does not apply to this PR.

🔁 Imported from ROCm/rocprofiler-sdk#124
🧑‍💻 Originally authored by @rocm-devops

yhuiYH and others added 2 commits July 30, 2025 14:44
…se + query submodule + rocpd command-line tools (#488)

* adding summary.py to generate tmp <category_region>_summary views

* migrating CSV summary to SDK method of writing CSVs

  - Add domain_view to summary.py
  - omit the C++ code of writing CSV because it gets revered later anyway

* Add summary subparser and write_sql_view_to_csv function

* adding all <>_summary views generation to summary.py

* add summary_per_rank feature

* add --summary-per-rank

* reconstruct generate_summary_view and create_domain_view

-introduce by_rank

* remove sqr and variance in summary views

* use RocpdImportData instead of connection

* two fixes on summary.py

--modify the generate_summary_view function to return a tuple with view name and sql code

add if_not_exits parameter to generete_summary_view

* Refactor summary.py to allow output path and filename args, and apply time_window
- clean up summary table column headers
- only generate by-rank views if that param is specified

* Add ProcessID to Hostname output and csv, so users can identify the system in the by-rank summaries

* Summary.py, just add hostname to by-rank summaries, instead of creating mapping table

* Summary - migrate csv writer to pandas, for more future flexibility

* Adding a few simple tests for summary.py

* Linting fixes

* add region_categories to summary options

  -  Automatically retrieve region categories from the database if argument is None

* add backticks for view_names

* fix tests after rebase

* Made code review changes
- fixed whitespace in CMakelists.txt
- adding query.py module & subparser in __main__.py
- refactor summary function to return query
- used query.py to output csv
- used query.py to also output summary to console
- provided new command line options to select summary output to csv or console

* Made fix to jinja template in query.py, as suggested by copilot

* Consolidated output calls to query in export_view function based on feedback
- refactored: helpers, query functions, create view functions
- extended formats to include what query supports (md, html, pdf, json)
- added json format to query, and changed orient=records
- adding jinja2 and reportlab to requirements.txt

* Add version_info for rocpd and roctx

* Add rocpd commandline tool

* Add executable permissions to source/bin/rocpd.py

* Removed rocpd2query, and cleaned up --help examples

---------

Co-authored-by: acanadas <acanadas@amd.com>
Co-authored-by: Jin Tao <jintao12@amd.com>
Co-authored-by: a-canadasruiz <Araceli.CanadasRuiz@amd.com>
Co-authored-by: Jonathan R. Madsen <Jonathan.Madsen@amd.com>
…elease_rocm-rel-7.0/ROCm_rocprofiler-sdk/yhui_rocpd-summary-7.0
abchoudh-amd pushed a commit that referenced this pull request Aug 8, 2025
[ROCm/rocprofiler-sdk commit: 03e5a1d]
ajanicijamd pushed a commit to ajanicijamd/rocm-systems that referenced this pull request Aug 8, 2025
Update Dyninst submodule
Refactoring of build scripts to build TBB, Boost, ElfUtils, and LibIberty, since Dyninst build scripts no longer do.
Workflows are now building Dyninst and its dependencies.

---------

Co-authored-by: marantic-amd <marantic@amd.com>
Co-authored-by: David Galiffi <David.Galiffi@amd.com>

[ROCm/rocprofiler-systems commit: 96df9b6]
@bwelton
Copy link
Contributor

bwelton commented Aug 8, 2025

7.0 RC, closing

@bwelton bwelton closed this Aug 8, 2025
ammallya pushed a commit that referenced this pull request Jan 21, 2026
Changed the data type of `size` to `size_t` in all functional tests to ensure
consistency with rocSHMEM APIs.
ammallya pushed a commit that referenced this pull request Jan 21, 2026
Changed the data type of `size` to `size_t` in all functional tests to ensure
consistency with rocSHMEM APIs.

[ROCm/rocshmem commit: 7a5c6f8]
ammallya pushed a commit that referenced this pull request Jan 30, 2026
* Resolve an issue for saving decoded jpeg images

* update version and changelog

* address review comment

* clean up
ammallya pushed a commit that referenced this pull request Jan 30, 2026
* Resolve an issue for saving decoded jpeg images

* update version and changelog

* address review comment

* clean up

[ROCm/rocjpeg commit: 6ad2925]
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants