Crawler

Crawler

Let's build something to extract all the content from the web. Who said that we should not use all the information available. Let's crawl, crawl and crawl again. We'll stop when there is nothing left.