New approach to fixing spreadsheet errors could save billions

Computer scientists at Oregon State University have created a new, much simpler approach to fixing errors in spreadsheets, a system that is easy to use and might help businesses around the world reduce mistakes and save billions of dollars.

The advances - which allow a non-specialist to identify and fix a problem by selecting from a short list of change suggestions – were announced today at the International Conference on Software Engineering in Minneapolis, Minn. The new system, called "GoalDebug," is being licensed to a spinoff company in Oregon.

Spreadsheets, a standard bookkeeping and accounting tool used by businesses to track everything from payroll to accounts receivable, are one of the most common of all computer software programs. In the U.S. it has been estimated that 11 million people create about 100 million spreadsheets a year, which in turn might be managed by up to 60 million users. But they are notoriously prone to errors, experts say.

"Most users of spreadsheets are overconfident, they believe that the data is correct," said Martin Erwig, an associate professor of computer science in the OSU College of Engineering. "But it has been observed that up to 90 percent of the spreadsheets being used have non-trivial errors in them. In fact, one auditor has said he never inspected a single spreadsheet during his entire career that was completely accurate."

Sometimes the result is a paycheck delayed or a few dollars misplaced. But often the costs or financial misrepresentations are far more serious, and companies have lost millions or billions of dollars, Erwig said, occasionally drawing notice and ridicule in the national press. The overall problem for business and industry is sufficiently large that OSU's work has already drawn the attention of some large financial institutions.

Part of the problem, Erwig said, is that spreadsheet use and development is so common that it is frequently being done by people with very limited training or interest in computer software programming. These "end users" of computer software don't have the background to investigate codes, programs or formulas, they just want the program to work, and often erroneously assume that it does.

"There are dozens of places an error can be made," Erwig said. "A person can click their mouse in the wrong spot, a simple mechanical error. They could use a plus instead of a minus, add a row at the end of a data area instead of in the middle, and get a completely different result. And these errors can be awfully difficult to spot, especially with large spreadsheets that have thousands of cells."

What the new OSU systems do is try to identify the ways that humans commonly make mistakes and then suggest what the correct approach might have been. For instance, if someone sees a figure in a spreadsheet that seems suspicious or is clearly incorrect, they can plug in the correct number, and the OSU system can suggest several programming mistakes that might have created the error - which the user can then sort through and use to identify the problem. A study performed by Robin Abraham, a recent OSU doctoral graduate, has shown that in 80 percent of the cases, the needed change is among the top five suggestions produced by the system, and in 72 percent of the cases it is among the top two suggestions.

"With this approach, people still have ultimate control over the spreadsheet programs," Erwig said. "What we do is give them a prioritized list of where the problem most likely is. They can literally start at the top of the list, see if that's what went wrong, and if not, move down to the second option on the list."

OSU's GoalDebug system, which stands for "Goal Directed Debugging of Spreadsheets," gives end users a chance to explore, apply, refine, or reject suggested changes. This much simpler and systematic approach allows people with comparatively little training in computer programming to identify and repair errors, Erwig said, by looking at a short list of possible problems instead of combing through hundreds or thousands of cells.

Software engineers spend 70-80 percent of their time testing and debugging programs, a recent study concluded - and even for these professionals, finding and fixing errors took an average of 17 hours.

"Spreadsheet debugging problems are huge," Erwig said. "We believe there will be a significant demand for these products, a large market."

Source: Oregon State University

Related stories:

As Master Data Management Matures, Its Availability Improves
With an average cost of $1 million, MDM deployments used to be relegated to only the largest companies in the world. But now new companies are now stepping into the market with creative products and services.
Calculators okay in math class, if students know the facts first
Calculators are useful tools in elementary mathematics classes, if students already have some basic skills, new research has found. The findings shed light on the debate about whether and when calculators should be used in the classroom.
Playing video games offers learning across life span, say studies
Certain types of video games can have beneficial effects, improving gamers' dexterity as well as their ability to problem-solve – attributes that have proven useful not only to students but to surgeons, according to research discussed Sunday at the Annual Convention of the American Psychological Association.
Study finds a wide variety of errors in testing process at family medicine clinics
The largest study to date of testing errors reported by family physician offices in the United States found that problems occur throughout the testing process and disproportionately affect minority patients.
Refractive errors affect vision for half of American adults
About half of U.S. adults age 20 and older have refractive errors, or eye problems that result in less than 20/20 vision, according to a report in the August issue of Archives of Ophthalmology, one of the JAMA/Archives journals.
32 research monkeys die in accident at Nevada lab
(AP) -- Thirty-two research monkeys at a Nevada laboratory died because human errors made the room too hot, officials for the drug company that runs the lab said Thursday. Animal rights activists complain the company took too long to report the deaths.
Scientists replicate diseases in the lab with new stem cell lines
A set of new stem cell lines will make it possible for researchers to explore ten different genetic disorders—including muscular dystrophy, juvenile diabetes, and Parkinson's disease—in a variety of cell and tissue types as they develop in laboratory cultures.
Scripps research team unravels new cellular repair mechanism
A Scripps Research team has unraveled a new biochemical pathway that triggers a critical repair response to correct errors in the DNA replication process that could otherwise lead to harmful or fatal mutations in cells. Though the work focused on yeast cells, the team expects to find an analogous system in human cells that could be exploited as a target for potential therapies for cancers, which are often caused by such repair mechanisms going off course. The research was published today in an advanced, online issue of the Proceedings of the National Academy of Sciences.

News discussion:

Technology news