The Politics of Digg

Understanding the complex network that drives stories to the front page

digg logoLast Wednesday at about 11 a.m., tech journalist David Cohn was perusing his RSS reader when he came across an article titled “Measuring the ‘Colbert Bump.” The piece summarized the analysis conducted by a political scientist who wanted to quantitatively measure the effects a politician would see if he were to appear on Comedy Central’s The Colbert Report. The study found that Democrats who go on the show “enjoy a significant increase in the number and total amount of donations they receive over the next 30 days when compared to similar candidates who do not appear on the show.”

After Cohn finished reading the article he did what he often does when he comes across an online item he finds particularly interesting; he submitted it to the popular social news site Digg. Several hours later, after hundreds of other Digg users voiced their support for the story by clicking on the “digg it” button, his link reached the front page. From there, it would go on to drive tens of thousands of readers to the article in a server-crushing wave of traffic. With over a million registered users and many more casual readers and RSS subscribers, there are few sites that can provide more online exposure than Digg.

But despite proclamations of its democratic community — one where a group of users works in tandem to pluck out an important news item to push to the masses — not every vote is created equal. Cohn’s link, for instance, didn’t make it to the front page simply because it led to an interesting story; the tech journalist is part of a band of elite Diggers able to consistently catapult its submissions over the threshold that separates the “upcoming” stories from the “popular.”

In a Thursday phone conversation, Cohn told me that he opened his account in 2005, when Digg was mostly a tech community.

“How the site used to work is completely different than how it works now,” he said. “Now there’s sort of — and this is a credit to Digg, from my perspective — it’s harder and harder to predict what stories will go to the front page … It used to be based on the numbers alone, like if a story has 150 diggs it’d go to the front page. In the past it did feel like you were able to — not control, necessarily — you could leverage power over your submission to get to the front page, and that’s harder and harder now.”

As the site grew increasingly popular, it became the target of more and more users who wanted to game the system; entire companies sprouted up offering to promote stories for money and homogenized groups worked together to promote their own agendas and content. The site administrators eventually rolled out new algorithms that necessitated a “diversity” of votes to make it harder for a group of 50 or so malicious Diggers to hijack the site for its own purposes.

But despite these new hurdles, the elite group still enjoys an enormous amount of power when it comes to promoting its own links. And it wasn’t luck that awarded this power; almost all of Digg’s top users engage in regular behind-the-scenes networking in a you-scratch-my-back strategy, a series of instant messages, shouts and emails that come together and thrust hordes of stories past other competitors.

As many relayed to me over the past few days, it’s a game that takes a good bit of persistence and an abundance of spare time. And, because of a lack of transparency from Digg employees, there has been a growing tide of conspiracy theories about this group and others, claims of “bury brigades” and secret cabals of editors that comb through upcoming categories, bashing down any links that don’t promote a particular viewpoint or bias.

In the past week I’ve conducted phone and email interviews with over 50 of Digg’s top users in an attempt to piece together the cohesive links and strategies that make them so successful. It was during these discussions that I discovered that these Diggers are much more than a team of link pushers and self-marketers; many of their conversations have later developed into real-world friendships.

“It’s mostly through IM,” Michael Abehsera told me earlier today. “I speak to most of them and know them personally. I talk to them on the phone. It’s a network, we all speak to each other. All the people who get five or six stories a month on the front page, we see each other on IM and say hello to one another.”

Abehsera’s current account is about three weeks old, though he’s been a user for much longer; his last account was deleted for what he openly admits were questionable (blackhat, even) tactics in promoting his submissions (“I don’t do that stuff anymore though,” he told me). I asked him to explain how much more influence a Digger who takes the time to market one of his links has compared to one who simply submits the story and then backs away.

“You have to have networking,” Abehsera asserted. “If you have good content and not the networking, if you don’t know how to optimize content, then there’s no way to get to the front page. Unless you happen to be really lucky.”

When I expressed a certain amount of skepticism of this — after all, shouldn’t an important breaking New York Times story become popular regardless of who submits it? — he waved off my democratic idealism, repeating that great content, though important, only makes up a fraction of the criteria needed.

“I don’t think it’s a bad thing,” he said. “While you need to first find an interesting article, Digg gives you that power to sell it. If you don’t have the power to sell it, then it’s not going to make it to the front page. I’m not saying that only power users are successful, because there must be 5,000 to 10,000 people who can get a front page article. It’s just that you have to sell the article, and if you don’t it’s not going to make it.”

Any modicum of doubt I still had was dispelled as I spoke to more of these top Diggers. Each one outlined a honed strategy to maximize his chance of success while continuing to look for any signs of inefficiency in his system. In what can almost be described as blatant politicization, several of the Diggers told of analyzing their friends lists and trimming away those least likely to aid them in their quests for the ultimate goal: front page promotion. This is precisely why you’ll see thousands of user profiles stating things like ( taken from an actual profile), “I digg friends articles. I do think it works both ways: If you find yourself removed it is because you didn’t digg me or weren’t around for awhile. Digg me and I will add you back.”

Brian Cuban — brother of billionaire Mark Cuban — told me that many of the Digg users split off into their own respective niches, developing almost what a traditional journalist would refer to as a “beat.”

“My brother Mark Cuban is attempting to purchase the Chicago Cubs so I have been gravitating to stories about that,” he said in an email. ” I generally come across those links in the Chicago Tribune since those will be the freshest and most relevant on the subject. I feel stories on the Cubs pending sale are of national interest to the Digg sports community. The Digg community has confirmed this. All but 1 of my submissions on this subject have gone [front page].”

Like most the people I interviewed for this article, I asked Cuban whether he bought into any of the more radical conspiracy theories about Digg, including the existence of “bury brigades” that constantly monitor the site to exterminate any stories that fall on the other side of some political divide.

“I think a lot of it is wives tales and it is certainly all speculation,” he wrote. “The Digg community is so large that I think it would take a very concerted effort of lots of diggers to bury a story that would otherwise have national interest. I think a lot of stories that you would not think would appeal to the masses make it though artificially because people just do not care about the subject matter enough to take a positive or negative interest in it and it slides through. This happens a lot with videos. If the subject matter touches a nerve on some level people will respond one way or the other. As along as there are algorithms, there will be MIT math geeks who crack them and figure out how to beat them. I think it is a good thing that people probe for weakness. That leads to improvement and innovation.”

This sentiment was echoed by most the others I spoke to. Many seemed to have a fair amount of confidence that the Digg gods, in their omniscient wisdom, were managing to stay ahead of the game, tweaking their system to fend off any organized effort to undermine Digg’s chaotic-yet-pure body of links that it manages to churn out every day. Though most admitted that yes, there was still a decent bit of manipulation, they claimed that the Digg community managed to weed most of it out, with only a very small number of questionable stories maintaining their perches atop the front page balcony.

Of course it was inevitable, however, that I would come across long-time users who were entrenched in nostalgia for better times — those who exclaim daily in the comments section of stories that Digg has lost its way, that it has become subject to lowest-common-denominator stories in its attempt to appeal to the broadest base of users.

I happened to catch a user named Kelly, who Diggs under the account tomboy501, when she was admittedly buzzed on two glasses of wine and therefore susceptible to writing the stream-of-conscious email that I received from her late Friday night.

“Here’s some reality: digg is gamed beyond belief. Period,” she wrote. “Here’s the secret: Want to your stories to be popular and go to the front page? Blind digg. Blind digg everything the power users submit. You’ll get there soon. It’s a gross and disturbing display; digg is a mere shadow of it’s former glory.”

She went on to bemoan the running memes that have become staples of Digg– “It’s 4chan. It’s lolcats. It’s Goat-Fucking stories. It’s 12-year old bathroom humor that will make you king of the frontpage.” — and her desire for the community to devolve back to its tech roots.

“I love digg in many ways,” she said. “Some great obscure content there if you know where to look…but it’s buried deep in the site. I keep waiting for digg to right itself. And the community to realign. Maybe one day. One day I won’t care much ..and will give up…and will fade away with the rest of them. For now…it’s a bad habit I can’t seem to break yet.”

21 Comments

  1. Fireglo Says:

    Great Article! I wish I had told you more but I’m still formulating my own opinions although you’ve covered a good 90% of them here.

  2. Superman Says:

    This is so true. I’m learning this myself and I’m slowly networking and becoming friends with the power diggers. :)

    My Digg: http://digg.com/users/superman7018

  3. Bubashelili Says:

    Very interesting article. I disagree with a few points but on the whole it seems like you’re on the money. I too am always trying to network with strong users. Dugg :)

    http://digg.com/users/bubashelili

  4. Harish Agrawal Says:

    Great story and very thorough research. I was a regular on Digg earlier because it offered off beat content. Now it is completely taken over by power users..

  5. dpolitico Says:

    I think you nailed digg with this line: “In what can almost be described as blatant politicization, several of the Diggers told of analyzing their friends lists and trimming away those least likely to aid them in their quests for the ultimate goal: front page promotion.” Great article.

  6. Roni Says:

    Very well-written article covering both ends of the digg spectrum and the politics factor into FP promotion.

  7. Stephen Ward Says:

    “…those who exclaim daily in the comments section of stories that Digg has lost its way, that it has become subject to lowest-common-denominator stories in its attempt to appeal to the broadest base of users.”

    In a way, I think this is the evolution of most major media. As growth occurs, content becomes focused more and more on what the users want to hear. And, with a large and homogeneous enough user base, those topics are bound to center around stories of broad interest. It’s tragic, perhaps, but inevitable once a site like this reaches critical mass.

  8. Mike Says:

    I disagree with Kelly, I think the fp of categories like Tech, politics etc has very good content and I think that no matter how you game the system it stills need to be good content period.

  9. Jared Says:

    I agree with this article. I notice how the diggs on my articles have gone up as my friends list has gone up. Also those increased diggs haven’t contributed to increased clicks to my article pages. Its all about people responding to shouts just so you will for them. You have to get enough people to do that before you can make the front page and then people will click on the stuff because they are interested. Content does matter to a point though, has to be decent stuff.

  10. Dan Fortner Says:

    Dude, what about Reddit? Lets not forget what the little engine that could. LOL

    DF
    http://www.useurl.us/12m

  11. Johnny Says:

    Great article Simon. It really explains what has changed about Digg. There’s a good social media marketing firm that specializes on Digg, StumbleUpon, Reddit, etc at http://www.viralmediapros.com.

  12. Robert Nagle Says:

    Here’s my tale of when Digg disillusionment reached a tipping point . Congrats on being dugg though.

  13. Joe Lachovsky Says:

    I’ve been a member of Digg since November 28th, 2005 and will agree with pretty much everything said above. It’s gotten to the point where I rarely ever submit stories, because I refuse to give into the politics of it all. The content that you used to be able to find on this site was always amazing and truly was life improving. Now all you have is a bunch of 12 year olds arguing about which political party f’d up America and pictures of cats. I wish for the return of the ‘old’ Digg, but I don’t think Digg will be the old glory it once was. But I’ll keep Digging away hoping for better days.

  14. Jorgandus Says:

    A well done story. A related piece might look into the growing (vocal) politicization of digg.

    For some reason, these user-motivated content communities seem to attract doctrinal-ideological peddlers (usually liberal).

    I’ve been in earlier communities of this sort, and I’ve seen a similar phenomenon. In my experience, it can happen very quickly, and the community is NEVER the better for it – it becomes increasingly insular and more and more niche ala Huffington.

  15. Damon Says:

    In regards to the “politics” of digg, it is so obviously hard-core left that I tell everyone I know to ignore the site. There is no way that 70-80% of America is hard core left like diggers are. Disappointing….

  16. Eric Dubay Says:

    Excellent article. The Digg bury brigade is most certainly a reality. And the double – G (diGG) makes me suspicious of Masonic involvement as well

  17. Wayne Smallman Says:

    Kelly & I share the same views; Digg is wasteland of truly pointless content, punctuated briefly by small oasis of good content, that’s often really, really hard to find.

    I’ve been on Digg since late 2005 and I’ve watched Digg go from something driven by very passionate people into something that’s a sad reflection of utter nonsense I see doing well elsewhere, like LOLcats, as an example.

    Don’t get me wrong, I’ve had my fair share of articles on the front page. But even then, Digg is just a means to an end; the traffic from Digg is essentially a managed DDoS attack, with the secondary traffic from Delicious, Reddit and StumbleUpon being where the real value is.

    I don’t think there’s much of a way back with the current stewardship. They lack the courage to do the right thing.

    Maybe if Google had bought them, then we’d see some change.

    I don’t see Digg getting any better, but I’d be happy for them to prove me wrong…

  18. bronson Says:

    I see a similar pattern with another social app on FB called vampires, one that my giorlfriend is involved with as a user.

    A similar networking trend exists and she’s related several ideas to me which echo Kelly’s sentiment.

    One of the angles is to befriend the friends of the power users, so that when you do send through a friends request, they see that you have their friends in common, thus securing the connection to the big players in the game; who can help your cause a great deal.

  19. bronson Says:

    apologies for the spelling error in the previous comment.

  20. Equanimous Says:

    I agree that this is a problem on digg.

    I have made a new news site which solves this problem.
    It is online at
    http://crowdnews.eu/

    It is only 14 days old so it is still in beta.

  21. shiftline Says:

    Great Article

    My Dig :)
    http://digg.com/users/shiftline


Blog Widget by LinkWithin