Some people have the view that data harvesters are unscrupulous, data-thieving, money grabbing pirates of the digital oceans.
Others believe that we are part of the Mafiosi, living in the shadows of the dark-web. Hacking sites, stealing credit card info and destabilising elections, just for fun.
Whilst these descriptions make great bedtime story-lines for 6 year olds, in reality, we are your average middle-class geeks. Some are married, some have kids and others have appetites for nerdy t-shirts. Despite our differences, we are united in our passion for data and love to distill cohesive stories from vast quantities of mined data.
Tuscan villas, race-horses, luxury yachts, and fast cars – considered by many as the ultimate rewards. For me, they do not compare to the breathtaking thrill of watching a data-harvesting spider run on a swarm of servers.