What we do...
80legs is a service platform for crawling and processing web content. Our service is very powerful and very affordable. We give you the following capabilities:
- Exceptional performance: Crawl up to 2 billion web pages/day.
- Easy to use and highly customizable: Start crawling in minutes and design your own crawls.
- Very affordable: Only $2 per million pages crawled and $0.03 per CPU-hr used.
We simplify and eliminate the challenges of crawling web content so that you can focus on your core business, technologies and competencies.
We're currently in private beta. If you'd like to join, just let us know. Check out our blog and follow us for interesting news.
..and why you'll love it!
We put the power of over 50,000 computers to work for you. Our unique distributed architecture stitches together computers from all aroudn the world to deliver exceptional crawling performance at an incredibly low cost. With 80legs, you can crawl up to 2 billion pages per day. We can help you scale your crawling needs faster than anyone else.
Why set up servers in a datacenter or instances in the cloud? Wouldn't you rather just fill out a form or use an API to crawl the web? That's all it takes with 80legs. We've done all the grunt work so you can focus on the content you want to crawl and process.
We've also handled all the frightfully complex aspects of web crawling, such as respecting the bandwidth of crawled sites, avoiding the re-crawling of links, and much more. Trust us: you really don't want to have to write a web crawler. We've already done it for you!
Crawling can be very, very expensive. If you do it in the cloud, you'll spend at least $4 per million pages crawled. If you use a data center, you'll spend even more.
We charge $2 per million pages crawled and $0.03 per CPU-hr used. Our prices will save you a lot of money as you scale your crawling.