A fast, multi-threaded CLI web scraper with a beautiful terminal UI. https://pypi.org/project/staticweb/
pip install staticwebsw https://example.com --link- 🔗 Extract links (
--link) - 📄 Extract paragraphs (
--para) - 🧾 Extract full page text (
--all) - 🏷 Extract custom tags (
--tag h1) - 📦 JSON output (
--json) - 💾 Save results (
--save output.txt) - ⚡ Multi-threading (
--threads) - 🎨 Rich UI (progress bar, tables, colors)
sw https://example.com --para
sw https://example.com --tag h1
sw https://example.com --link --json
sw https://example.com https://google.com --threads 5sw --codeofitView full source code directly in terminal.
This tool is designed to feel like:
curl + grep + scrapy (but simpler and cleaner)
Use responsibly. Always respect:
- robots.txt
- website terms of service
PRs welcome. Ideas welcome. Make it better.