Skip to content

Repository files navigation

Scoopify 🍧

A Node.js script that scrapes and stores domain information of Shopify stores using Puppeteer and SQLite.

Installation

git clone https://github.com/PrashantBtkl/scoopify && npm install

Usage

node scraper.js

Notes

Rate limiting will occur after scraping 50 pages.Runs Chrome in visible mode for solving captcha manually. The script stores progress in SQLite, allowing for session resumption

TODO:

  • Automated Captcha Solving
  • Proxy rotation

About

scrape domains of all shopify stores

Topics

Resources

Stars

2 stars

Watchers

2 watching

Forks

Releases

Packages

Contributors

Languages