Finish Robots.txt check #1
Description
Add the check to see if site onlineradiobox.com adds a robot.txt entry that discourages the use of web scrapers. Currently their robots.txt file allows the scraping of "onlineradiobox.com/us/thirdrock/playlist/" but with AI leading to more aggressive web scraping who knows.
Figure be a good sport and add it.