Tag Archives: crawling

Preliminary Experiences Crawling with 80legs

Posted on November 4, 2009 by Amund Tveit

80legs is a company specializing in the crawling and preprocessing part of search, where you can upload your seed urls (where to start crawling), configure your crawl job (depth, domain restrictions etc.) and also run existing or custom analysis code … Continue reading →

Posted in cloud computing | Tagged , , , , , | 3 Comments