What we do...
80legs is a service platform for crawling and processing web content. Our service is very powerful and very affordable. We give you the following capabilities:
- Exceptional performance: Crawl up to 2 billion web pages/day.
- Easy to use and highly customizable: Design and run your own crawls in minutes.
- Very affordable: Only $2 per million pages crawled and $0.03 per CPU-hr used.
Start running crawls today by visiting our web portal and registering.
..and why you'll love it!
We put the power of over 50,000 computers to work for you. Our unique distributed architecture stitches together computers from all around the world to deliver exceptional crawling performance at an incredibly low cost.
| DATACENTER | THE CLOUD | 80LEGS | |
|---|---|---|---|
| Pages crawled / day | 200 million | 100 million | 2 billion |
| Steps required | Build racks | Setup instances | Fill out web form |
| Configure servers | Configure virtual machines | ||
| Write web crawler | Write web crawler | ||
| Cost to build or use | $500,000+ | $4.00 / million pages | $2.00 / million pages |
| $0.10 / CPU-hour | $0.03 / CPU-hour | ||
We are more powerful, easy to use and affordable than any other crawling solution. The table above is based on large-scale crawling needs, but 80legs offers the same benefits to anyone.