Skip to content

Replace browser scraping with Roblox API + switch output to JSON - #1

Open
Curvn wants to merge 12 commits into
The-Graze:masterfrom
Curvn:master
Open

Replace browser scraping with Roblox API + switch output to JSON#1
Curvn wants to merge 12 commits into
The-Graze:masterfrom
Curvn:master

Conversation

@Curvn

@Curvn Curvn commented May 1, 2026

Copy link
Copy Markdown

This pull request replaces the original browser-based asset checker with a Roblox Toolbox API implementation and updates the output system to JSON.

Major changes

Data collection overhaul

  • Replaced Puppeteer-based scraping with Roblox Toolbox Service API
  • Uses batched requests (up to 100 IDs per call) for improved performance
  • Removes all browser automation dependencies

Output system update

  • Replaced TXT output with structured JSON output (audio - Sorted.json)
  • Added manual JSON building with proper escaping for reliability
  • Prevents issues related to System.Text.Json reflection restrictions

Stability improvements

  • Eliminated dependency on headless Chrome
  • More reliable asset detection using API response data
  • Improved handling for missing or moderated assets

Input / Output

  • Input remains: audio.txt
  • Output is now: audio - Sorted.json

Notes

  • Only audio scanning is included in this version
  • Core parsing logic for input format remains unchanged
  • This is a functional rewrite of the scanning method, not just a formatting change

Curvn added 12 commits May 1, 2026 11:29
- Replaced Puppeteer/web scraping with Roblox Toolbox API
- Improved performance by batching asset requests
- Reduced scan types to audio only (removed decals/clothes/models)
- Added automatic audio.txt template creation on first run
- Cleaner and simpler project structure overall
dont need.
Better README.md
Changed the output from TXT to structured JSON format for easier parsing and future use.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant