scrapyprojects All the websites were scraped in python language using scrapy framework. Some code snippets were deliberately omitted due to copyright reasons.