Skip to content

Add Chrysalis ingestion wrapper#169

Draft
tomvothecoder wants to merge 2 commits into
E3SM-Project:mainfrom
tomvothecoder:feature/154-ingestion-sites
Draft

Add Chrysalis ingestion wrapper#169
tomvothecoder wants to merge 2 commits into
E3SM-Project:mainfrom
tomvothecoder:feature/154-ingestion-sites

Conversation

@tomvothecoder
Copy link
Copy Markdown
Collaborator

Description

This adds a scheduler-agnostic HPC archive ingestor entrypoint and a thin Chrysalis site wrapper for existing Jenkins-driven metadata ingestion.

Checklist

  • Code follows project style guidelines
  • Self-reviewed code
  • No new warnings
  • Tests added or updated (if needed)
  • All tests pass (locally and CI/CD)
  • Documentation/comments updated (if needed)
  • Breaking change noted (if applicable)

Deployment Notes (if any)

No special deployment steps.

Local validation is currently blocked because PostgreSQL was unavailable at 127.0.0.1, so make backend-test and the targeted ingestion test file could not complete in this environment.

@tomvothecoder tomvothecoder requested a review from TonyB9000 May 6, 2026 22:33
@TonyB9000
Copy link
Copy Markdown

@tomvothecoder Once I am clear on the boundaries to the term "NERSC ingestion wrapper", I should be able to comprehent "Chrysalis ingestion wrapper". The term "scheduler-agnostic" refers to Jenkins? (I always considered cron to be universal...).

Copy link
Copy Markdown

@TonyB9000 TonyB9000 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Configures a call to the hpc_archive_ingestor. Understandable.

What process sets "SIMBOARD_API_BASE_URL" and "SIMBOARD_API_TOKEN"?

@TonyB9000
Copy link
Copy Markdown

Hmmmm. The "Tom Requested your review" took me to the page with 7 files to examine, each with a "submit-review" option. As soon as I completed the first one, all 7 vanished...

@tomvothecoder
Copy link
Copy Markdown
Collaborator Author

tomvothecoder commented May 13, 2026

Configures a call to the hpc_archive_ingestor. Understandable.

What process sets "SIMBOARD_API_BASE_URL" and "SIMBOARD_API_TOKEN"?

Hmmmm. The "Tom Requested your review" took me to the page with 7 files to examine, each with a "submit-review" option. As soon as I completed the first one, all 7 vanished...

Accidentally tagged you for review. I meant to assign this PR you. It is fixed now.

@tomvothecoder tomvothecoder added the type: enhancement New feature or request label May 13, 2026
@TonyB9000
Copy link
Copy Markdown

@tomvothecoder "Accidentally tagged you for review". OK, (I think colleges should offer a master's program in github).

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

type: enhancement New feature or request

Projects

None yet

Development

Successfully merging this pull request may close these issues.

[DevOps]: Scope automated metadata ingestion at other sites (prioritize Chrysalis first)

2 participants