MIT develops measures to predict performance of complex systems

Taking a cue from the financial world, MIT researchers along with experts in industry and government have developed a list of 13 measures that engineers can use to predict how well a system--or project--will perform before it is even finished.

Known as leading indicators, analogous measures are regularly used by economists, investors and businesses to help predict the economy's performance.

The idea behind the new set of leading indicators is to improve the management and performance of complex programs before they are delivered, in a more predictive way than simple business metrics.

"Leading indicators can provide important insights for managers of complex programs, such as those in the aerospace industry, and can allow them to make real-time adjustments to project activities, staffing and schedules to ensure a project stays on track," said Donna Rhodes, a principal researcher for MIT's Lean Aerospace Initiative (LAI).

The MIT leading indicators project, co-led by Rhodes and industry colleague Garry Roedler of Lockheed Martin, began in 2004 following an LAI/U.S. Air Force workshop on systems engineering that established the groundwork for the project. Systems engineering is an interdisciplinary approach to creating successful systems by focusing on variables including customer needs, system requirements, design synthesis and system validation, all while considering the complete problem.

A leading indicator may be an individual measure, or collection of measures, that are predictive of future system performance before the performance is realized.

Thirteen ways of looking at a system

The 13 leading indicators defined by the MIT team include risk handling trends. This indicator would be used by management to determine whether a project team is proactively handling potential problems (or risks) at the appropriate times with the goal of minimizing or eliminating their occurrence. If the actions to address a given project risk are not taken, then there is a higher probability that the risk will be realized, resulting in negative impact to project cost, schedule, performance or customer satisfaction. The insight gained through the use of this indicator can help identify where additional effort may be needed to avoid preventable problems or reduce impacts.

Several major aerospace companies worked to validate the 13 indicators in pilot programs during 2006, which helped refine them. Then, working in collaboration with the International Council on Systems Engineering (INCOSE), the leading professional society for systems engineering practitioners, the MIT team published a guidance document about the work. That document has been made available to the larger systems engineering community.

According to Rhodes, "The leading indicators project is an excellent example of how academic, government and industry experts can work together to perform collaborative research that has real impact on engineering practice."

The other leading indicators identified by the team are: system definition change; backlog trends; interface trends; requirements validation trends; requirements verification trends; work product approval trends; review action closure trends; risk exposure trends; technology maturity trends; technical measurement trends; systems engineering staffing & skills trends; and process compliance trends.

Source: MIT

Related stories:

Even the Antarctic winter cannot protect Wilkins Ice Shelf
Wilkins Ice Shelf has experienced further break-up with an area of about 160 km² breaking off from 30 May to 31 May 2008. ESA's Envisat satellite captured the event – the first ever-documented episode to occur in winter.
High pretreatment PSA velocity predicts worse outcome
The most significant single predictor of aggressive prostate cancer is an elevated rate of increase in prostate specific antigen (PSA) levels, according to a new study. Published in the July 1, 2007 issue of CANCER, a peer-reviewed journal of the American Cancer Society, the study found that a pre-treatment rate of PSA increase, called PSA velocity, of more than 2 ng/ml/year was strongly associated with a high risk of death from prostate cancer.
New Solar Underwater Robot Technology
A new solar-powered underwater robot technology developed for undersea observation and water monitoring will be showcased at a Sept. 16 workshop on leading-edge robotics to be held at the National Science Foundation (NSF) in Arlington, Va.
Scenarios for the Evolution of the Wireless Industry
Great Uncertainty in the Wireless Industry over the Demand for Future Mobile Services Due to the Slow Take-up of Early 3G Services

Research and Markets has announced the addition of Scenarios for the Evolution of the Wireless Industry to their offering.
"Great uncertainties over future demand for services and the extent to which alternative technologies will displace existing cellular standards present major challenges to organisations across the wireless industry. Single-line forecasts no longer provide the necessary insight. Organisations need to understand the implications of a number of feasible scenarios for the evolution of the wireless industry, which bring enormous threats and opportunities."
'Deadly dozen' reports diseases worsened by climate change
Health experts from the Wildlife Conservation Society today released a report that lists 12 pathogens that could spread into new regions as a result of climate change, with potential impacts to both human and wildlife health and global economies. Called The Deadly Dozen: Wildlife Diseases in the Age of Climate Change, the new report provides examples of diseases that could spread as a result of changes in temperatures and precipitation levels. The best defense, according to the report's authors, is a good offense in the form of wildlife monitoring to detect how these diseases are moving so health professionals can learn and prepare to mitigate their impact.
'Color My Pyramid' nutrition education program battles obesity in DC schools
An online game might be the secret weapon for winning the war against childhood obesity. Researchers at George Mason University have designed and tested a nutrition education program called "Color My Pyramid" to teach students how to evaluate their dietary intake and activity level. The program incorporates the Department of Agriculture's MyPyramid.gov for Kids Blast-Off Game, an interactive computer game that allows kids to win by fueling their rocket with nutritious foods and a healthy level of physical activity.
Economist's Model Forecasted Current Economic Slowdown One Year In Advance
(PhysOrg.com) -- An economist at Rensselaer Polytechnic Institute says that a model he developed forecasted the current economic slowdown at least one year before it became apparent to most observers. The model, which was first published in the Journal of Finance in June 1991, has successfully predicted every recession since 1955.
New studies find global warming will have significant economic impacts on Florida coasts
Leading Florida-based scientific researchers released two new studies today, including a Florida State University report finding that climate change will cause significant impacts on Florida's coastlines and economy due to increased sea level rise. A second study by researchers at Florida Atlantic University recommends that the state of Florida adopt a series of policy programs aimed at adapting to these large coastal and other impacts as a result of climate change. Key findings of the FAU report were included just this week by Florida Gov. Charlie Crist's Climate and Energy Action Team when it adopted the "Adaptation" section of its final report.

News discussion:

General Science news