HiQ is a “people analytics” firm that creates software tools for corporate human resources departments. Its Skill Mapper graphically represents the credentials and abilities of a workforce; its Keeper service identifies when employees are at risk of leaving for another job. Both draw the overwhelming majority of their data from a single trove: the material that is posted—with varying degrees of timeliness, detail, accuracy, and self-awareness—by the 500 million people on the social networking site LinkedIn.
Date: November 16, 2017
1) “Depending on whom you talk to, the sides are arguing about free speech or privacy, the scourge of data scraping or the danger of digital monopolies.” Where do you come out in this debate?
2) What other sources of data might be scraped by bots and what could you learn from this?