Skip to content

Report metadata extraction#1

Closed
AlbSed wants to merge 3 commits intomainfrom
feature/metadata-objects
Closed

Report metadata extraction#1
AlbSed wants to merge 3 commits intomainfrom
feature/metadata-objects

Conversation

@AlbSed
Copy link
Copy Markdown

@AlbSed AlbSed commented May 5, 2025

This pull request introduces several updates to enhance functionality, improve maintainability, and modernize dependencies. Key changes include upgrading the Python version in the Dockerfile, adding support for metadata extraction in reports, and improving file handling in the src/component.py module. Below is a detailed breakdown of the most important changes grouped by theme.

Dependency and Environment Updates:

  • Updated the base Python image in the Dockerfile from python:3.10-slim to python:3.11-slim to leverage the latest Python features and performance improvements.

Metadata Extraction and Reporting Enhancements:

  • Added a new metadata_fields property to the configuration schema in component_config/configRowSchema.json, allowing users to specify metadata fields to include in the report.
  • Introduced extract_report_metadata and write_metadata_table methods in src/component.py to extract and write metadata fields from a report response to a CSV file. These methods are used when the input_variant is set to existing_report_id. [1] [2]
  • Added a metadata_fields attribute to the Configuration class in src/configuration.py to store the list of metadata fields specified by the user.

File Handling Improvements:

  • Ensured that directories are created before writing files by adding os.makedirs calls in write_report and write_metadata_table methods in src/component.py. This prevents potential errors when the target directory does not exist. [1] [2]

@AlbSed AlbSed requested a review from a team May 5, 2025 06:13
@kudj
Copy link
Copy Markdown
Contributor

kudj commented Jun 23, 2025

feature not needed anymore...

@kudj kudj closed this Jun 23, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants