Skip to content

ROADMAP.md

Latest commit

 

History

History
53 lines (33 loc) · 2.72 KB

ROADMAP.md

File metadata and controls

53 lines (33 loc) · 2.72 KB
Raw

Roadmap

Planned scripts for browser automation, web scraping, and enterprise web application integration.

In Progress

Nothing currently active.

Planned

Confluence Automation

  • confluence_page_creator.py — Extend confluence.py into a reusable class. Accept page title and content as arguments or from a Markdown file. Support creating pages under a configurable parent page.
  • confluence_page_updater.py — Find an existing Confluence page by title and update its content. Useful for automated status pages and report publishing.
  • confluence_space_auditor.py — List all pages in a Confluence space and report last-modified date, author, and word count. Outputs a CSV for content governance audits.
  • confluence_bulk_publisher.py — Read a directory of Markdown files and publish each as a Confluence page in a specified space, preserving directory structure as parent/child hierarchy.

Web Scraping Utilities

  • table_scraper.py — Extract HTML tables from any web page using BeautifulSoup and export as CSV or JSON. Handles multi-row headers and merged cells.
  • dynamic_content_scraper.py — Scrape JavaScript-rendered content using Selenium with configurable scroll depth and wait conditions. Useful for SPAs.
  • login_session_scraper.py — Reusable authenticated scraper base class: handles login, session cookies, and retry logic. Extend for specific sites.

Testing & Validation

  • ui_smoke_test.py — Lightweight smoke test suite for validating that a web application's key pages load and critical UI elements are present. Configurable via YAML.
  • link_checker.py — Crawl a site and report broken links (404/5xx) with page source and link text. Output: Markdown report.
  • form_validator.py — Automate form submission with various inputs and assert expected validation messages. Useful for regression testing web forms.

Utilities

  • screenshot_capture.py — Full-page screenshot tool for any URL. Supports configurable viewport, headless mode, and batch URL list input.
  • webdriver_factory.py — Factory function that returns a configured Chrome or Firefox driver based on environment variables. Centralises driver setup for all scripts.

Ideas / Backlog

  • Jira automation scripts (create tickets, update status, add comments)
  • Azure DevOps web portal automation for operations not available via API
  • Scheduled monitoring script: check page availability and alert on changes

Notes

  • All scripts use webdriver-manager — no manual ChromeDriver downloads required.
  • Credentials are always sourced from environment variables, never hardcoded.
  • Use --headless mode for all unattended/CI execution.