Tag Archives: crawling

Preliminary Experiences Crawling with 80legs

80legs is a company specializing in the crawling and preprocessing part of search, where you can upload your seed urls (where to start crawling), configure your crawl job (depth, domain restrictions etc.) and also run existing or custom analysis code … Continue reading

Posted in cloud computing | Tagged , , , , , | 3 Comments