fullscrape/README.md

16 lines
498 B
Markdown

fullscrape
==========
A Full Website Scraper
Usage:
> fullscrape url out-dir [-d=depth] [-x]
Arguments:
> url: The url that you want to start the scrape at.
> out-dir: The output directory. If it doesn't exist, it will be created.
> d: The depth of the scrape. Defaults to no limit.
> x: Cross Domain scraping. This could get dangerous, the internet's a big place.
Sometime I may add the ability for fullscrape to automatically make non-relative links relative. Because that seems useful.