2015-07-29 12:43:21 +00:00
|
|
|
fullscrape
|
|
|
|
|
==========
|
|
|
|
|
|
2015-08-15 15:38:37 +00:00
|
|
|
A Full Website Scraper
|
|
|
|
|
|
|
|
|
|
Usage:
|
2015-08-15 15:39:08 +00:00
|
|
|
> fullscrape url out-dir [-d=depth] [-x]
|
2015-08-15 15:38:37 +00:00
|
|
|
|
|
|
|
|
Arguments:
|
|
|
|
|
> url: The url that you want to start the scrape at.
|
|
|
|
|
> out-dir: The output directory. If it doesn't exist, it will be created.
|
|
|
|
|
> d: The depth of the scrape. Defaults to no limit.
|
|
|
|
|
> x: Cross Domain scraping. This could get dangerous, the internet's a big place.
|
|
|
|
|
|
|
|
|
|
Sometime I may add the ability for fullscrape to automatically make non-relative links relative. Because that seems useful.
|
