IRUtils

This repo is a tracked log of the scripts I write for myself, due to regional network restrictions.

URLBrute

A Python utility for batch checking the reachability of URLs. About the image: You've definitely noticed the success rate (2 in more than 1,500). This is not an intentional modified/made-up result and has nothing to do with this repo, but displays how we're struggling to survive and get our genuinely basic human rights back, these days; only because of the region we're born, or somehow got stuckked inside afterwards. See this quick preview.

To see a preview of some successful responses, see this image from an older version.

Overview

URLBrute sends HTTP GET requests to a list of provided URLs and reports which ones are reachable, along with any connection errors encountered.

Usage

python URLBrute.py <domains_file>

If no file is specified, defaults to domains.txt in the same directory.

Input Format

Provide one domain per line in a text file:

example.com
google.com
github.com

Features

• Automatic domain-to-URL handling (if necessary)
• Request timeout (5 seconds default)
• Logging of all requests and errors

Output

• Successfully reachable URLs are collected in checker.reachable and finally (and/or after a keyboard interrupt) to a pre-specified file. (if not set, falls back to a default path)
• Results are immediately logged to .log file (for restorability, in case of any interruptions)
• Status codes and error types displayed in console

Acknowledgments

Special thanks to atakanaltok's repository, awesome-useful-websites, for providing useful web resources and tools. A list of these awesome websites (possibly with exclusions/additions) has been provided in domains.txt so you can test the functionality of the script.