Skip to content

Automate notices testing#477

Open
amyblais wants to merge 5 commits into
masterfrom
amyblais-noticesautomation
Open

Automate notices testing#477
amyblais wants to merge 5 commits into
masterfrom
amyblais-noticesautomation

Conversation

@amyblais
Copy link
Copy Markdown
Member

@amyblais amyblais commented May 12, 2026

Adding GitHub Actions automation to reduce manual steps in the in-product notices testing workflow.
Spec doc: https://mattermost.atlassian.net/wiki/spaces/Security/pages/4550393860/Automation+-+In-Product+Notices+Testing


  1. validate-notices.yml — runs on every PR targeting master when notices.json changes. It performs three checks:
  • Schema validation: ensures every notice is well-formed against notices.schema.json
  • Duplicate ID check: fails if any two notices share the same id
  • URL reachability: HEAD-requests every action_param, image, and inline URL and fails if any are unreachable
  1. auto-test-pr.yml — runs when a PR is opened or reopened against the release branch. It automatically creates a mirror PR targeting master with a [Test] prefix on the title, a link back to the original release PR, and the pre-filled /cloud command to configure a test server after merging.

  2. Supporting files:

  • scripts/validate-schema.js — runs the AJV schema check
  • scripts/check-urls.js — URL reachability checker
  • scripts/check-duplicate-ids.js — duplicate ID detector

@coderabbitai
Copy link
Copy Markdown

coderabbitai Bot commented May 12, 2026

Review Change Stack

Warning

Rate limit exceeded

@amyblais has exceeded the limit for the number of commits that can be reviewed per hour. Please wait 18 minutes and 25 seconds before requesting another review.

You’ve run out of usage credits. Purchase more in the billing tab.

⌛ How to resolve this issue?

After the wait time has elapsed, a review can be triggered using the @coderabbitai review command as a PR comment. Alternatively, push new commits to this PR.

We recommend that you space out your commits to avoid hitting the rate limit.

🚦 How do rate limits work?

CodeRabbit enforces hourly rate limits for each developer per organization.

Our paid plans have higher rate limits than the trial, open-source and free plans. In all cases, we re-allow further reviews after a brief timeout.

Please see our FAQ for further information.

ℹ️ Review info
⚙️ Run configuration

Configuration used: Organization UI

Review profile: CHILL

Plan: Pro

Run ID: 2850b419-640f-40c1-a958-4de900e7e444

📥 Commits

Reviewing files that changed from the base of the PR and between 2957ae2 and fbc7f2e.

📒 Files selected for processing (5)
  • .github/scripts/check-duplicate-ids.js
  • .github/scripts/check-urls.js
  • .github/scripts/validate-schema.js
  • .github/workflows/auto-test-pr.yml
  • .github/workflows/validate-notices.yml
✨ Finishing Touches
🧪 Generate unit tests (beta)
  • Create PR with unit tests
  • Commit unit tests in branch amyblais-noticesautomation

Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out.

❤️ Share

Comment @coderabbitai help to get the list of available commands and usage tips.

@amyblais
Copy link
Copy Markdown
Member Author

@coderabbitai full review

@amyblais amyblais changed the title Create validate-notices.yml Automate notices testing May 12, 2026
@amyblais amyblais added the 2: Dev Review Requires review by a core committer label May 12, 2026
@amyblais amyblais requested a review from yasserfaraazkhan May 12, 2026 11:45
@coderabbitai
Copy link
Copy Markdown

coderabbitai Bot commented May 12, 2026

✅ Actions performed

Full review triggered.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

2: Dev Review Requires review by a core committer

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant