This tool was created to harvest all RDF from a specific domain. You can provide it with a starting URI, and it will follow all links that match the hostname of the starting URI, harvesting everything to a text file containing n-triples. No URIs outside of the starting host will be accessed.
This project uses Composer. Run "composer install" to set up dependencies.
php Murpoint.php [starting URI] [output file]
If Murpoint encounters a fatal error during execution, it will dump its state to a file. You can attempt to retry the crawl later with:
php Murpoint.php --resume [name of dump file]
You can obtain information on all available options with:
php Murpoint.php --help
This project was designed to feed the triple store used by dimenovels.org, and is named for Captain Howard Murpoint, the villain of Charles Garvice's dime novel, "The Spider and the Fly."