Researchers Fang Wu and Bernardo Huberman from Hewlett-Packard Laboratories in Palo Alto, California, thought that the popularity of an idea or item in a large population should depend on its novelty, which tends to decrease over time due to a variety of factors. In order to test this idea, the researchers analyzed how a news story propagates on the interactive Web site digg.com.
Their results, which are published in
PNAS, analyze 29,864 popular digg stories during the year 2006, with more than 1 million users determining the popularity of the submissions.
“The greatest significance of our results is that we were able to establish a connection between novelty and collective attention in large groups of people,” Huberman told
PhysOrg.com. “Psychologists have studied the interplay between novelty and attention with human subjects for many years, but never at the group level on such a scale.”
Among Wu and Huberman’s results is the existence of a natural time scale over which attention grows and fades. Since the researchers only considered popular stories (those which made it to the front page, based on a complex algorithm), the initial growth must be rapid. However, once a story makes it to the front page, the data indicate a straight correlation between the average log of diggs and the time variance. In other words, the more popular a story becomes, the faster it spreads.
“Basically, at any given time, a group of n people will read the story, digg it and tell it to others, but only some random fraction of those told will actually read and digg the story,” Huberman explained. “This process, which naively would lead to multiplicative growth in the number of diggs, is counteracted by the fact that the novelty of the story is decaying in time. When put together, this process leads to a log-normal distribution of the number of diggs and also to a fast increase at the beginning that tapers off with a rate predicted by our equations, and verified to high precision with the data.”
As for the decline of interest in a story, a story’s digg rate decays, on average, following a stretched exponential law. This is because many factors contribute to the decreasing novelty of a successful story (such as topic category, time of day when it was made popular, etc.). Since individual stories tend to fade exponentially, the combined result looks like a stretched exponential. Interestingly, stretched exponentials have been used to explain other decays, such as the discharge of a capacitor and luminescence decays.
The researchers also analyzed the probability distribution of stories based on the total number of diggs received, which is approximately log-normal. Specifically, most popular stories quickly climb to 200 diggs, but the largest section (20%) tops off at between 400 and 600 diggs. After that, the distribution of diggs drops off more gradually, with a handful reaching up past the 3000-digg mark.
This study is one of the first to analyze data on collective attention from very large groups of people in a non-laboratory, yet isolated, setting. As such, the researchers hope that the results will help experts in choosing which items to display in different types of news media, advertising, or any other medium that relies on social networking to spread its content.
“Our theory points to a methodology for displaying content on a portal,” Huberman said. “If one is interested in maximizing the number of views of the portal, then given our theory and a few measurements, they can decide on posting the newest stories first (like digg does now) or the more favorite ones.”
More information:
HP’s Information Dynamics Lab:
http://www.hpl.hp.com/research/idl/
Wu, Fang, and Huberman, Bernardo A. “Novelty and collective attention.”
Proceedings of the National Academy of Sciences. November 6, 2007, vol. 104, no. 45, 17599-17601.
Copyright 2007 PhysOrg.com.
All rights reserved. This material may not be published, broadcast, rewritten or redistributed in whole or part without the express written permission of PhysOrg.com.
Related stories:
CMU prof whose 'last lecture' moved millions dies
(AP) -- Randy Pausch said obstacles serve a purpose: They "give us a chance to show how badly we want something." Confronted with incurable cancer, he devised a last lecture that became an Internet sensation, a best-selling book and a celebration of a life spent achieving his dreams.
Virtual world is sign of future for scientists, engineers
Purdue University is operating a virtual environment that enables scientists and engineers to interpret raw data collected with powerful instruments called dynamic atomic force microscopes.
Videogame makers to duel in E3 arena
Blockbuster sequels, slick technology and duels between the big three console makers are expected in Los Angeles next week as videogame industry players reveal their newest creations.
EU to rule on roaming price caps for mobile data
(AP) -- European regulators are nearing a decision on whether to impose price caps on text messaging and mobile Internet use while traveling.
Study debunks theory Asian students are top notchers in US
A belief that Asian-Americans are taking over US universities, outperforming other groups and grabbing the bulk of math, science and engineering degrees has been debunked in a landmark study.
Drinking at an early age can lead to later alcohol dependence
An early age at onset of drinking (AOD) is a strong predictor of subsequent alcohol dependence (AD). Following through on previous research that found substantial increases in drinking and AD among women born between 1944 - 1983, compared to women born between 1934 - 1943, this study examined the influence of AOD. Results showed that women born after 1944 also began drinking earlier than their predecessors, which might help to explain their higher rates of AD.
The price paid for higher energy is highly dangerous to teeth
For more than 10 years, energy drinks in the United States have been on the rise, promising consumers more “oomph” in their day. In fact, it is estimated that the energy drink market will hit $10 billion by 2010. While that may be great news for energy drink companies, it could mean a different story for the oral health of consumers who sometimes daily rely on these drinks for that extra boost.
UI develops free, easy-to-use web tool kit for archivists
Archivists at the University of Illinois Library believe they have built a better tool kit. Their new online collections management program called Archon has more than a few attractive features – not the least of which is that it was developed for “lone archivists with limited technological resources and knowledge,” said Scott Schwartz, one of the developers of the software program and the archivist for music and fine arts at Illinois.
