Social Networks
Our social network crawl packages regularly crawl publicly-available profiles on major social networks. They typically produce 10 - 20 million records per month.
Crawl packages for specific social networks are viewable in the 80legs Marketplace once you log in. You can also request your own if you don't see the one you need.
Sample record
A record in a social network crawl package will look something like the one shown below. Each record is in XML format, allowing for complete parsing and processing of the data as you see fit.
<username>joeanybody</username>
<userID>12587</userID>
<location>San Francisco Bay Area</location>
<picture>http://link_to_image.network.com/image.jpg</picture>
<connections>57</connections>
<summary>Focus is on product development and operations.</summary>
<specialty>General management, product development</specialty>
<workexperiences>
<workexperience>
<title>Product Manager</title>
<company>Internet Co.</company>
<datestart>2009-11-01</datestart>
<dateend>2010-03-16</dateend>
</workexperience>
</workexperiences>
<educations>
<education>
<school>UCLA</school>
<degree>B.S., Computer Science</degree>
<datestart>1990-01-01</datestart>
<dateend>1994-07-01</dateend>
</education>
</educations>
</profile>
You can view examples of each crawl packages' records in the 80legs Marketplace.
What can you do with this data?
The most exciting part of data is what you can do with it. Social network data provides fascinating insights into how people are grouped, whether it be by geography, careers, education or more.
Some of the customers that use social network crawl packages use the information they receive to identify employment trends. Others use it for market research. The data provided by these packages gives you a near-real-time view into the ever-changing makeup of our society.
Accessing a social network crawl package
If you'd like to access one of these packages, you should go to the 80legs Marketplace, where you can purchase the crawl package you like.
Public data vs. private data
Our crawl packages only crawl publicly-available profiles on social network. These profiles are made public to everyone by the social network itself. We do not access private profiles or information by any means.
If you're concerned that your personal profile may be crawled by us, we recommend that you check your privacy settings on any social network you use. It's always a good idea to know what data is available publicly and what isn't.