GNDG/IndeedScrapper
Folders and files
| Name | Name | Last commit date | ||
|---|---|---|---|---|
Repository files navigation
Spider to use with the Scrapy web crawling and scraping Python framework. Scrapes job listings from Indeed.com and stores in a MySQL DB http://scrapy.org/ Requires --------------- scrapy pymongo Usage --------------- cp settings.py.example settings.py edit settings.py > scrapy crawl indeed --logfile=crawl.log