'Immersidata' improves interactive game development user-testing

USC engineers are perfecting a games user testing tool that captures and analyzes play experience to automatically detect weakness and flaws - and it may soon gauge player emotional involvement.

User testing is a critical and key element of creating a new game - books have been written about it. But it remains a highly subjective and quite unstructured exercise.

"Traditionally," says Tim Marsh, a post-doctoral researcher at the USC Viterbi School of Engineering's Integrated Media Systems Center, "game companies hire teenagers, and turn them loose trying to find flaws and gaps in the game," which they report either verbally or in writing, along with their impressions."

This is neither systematic or scientific, says Marsh, who will present what he believes is a better way at a conference presentation entitled "Continuous and Unobtrusive Capture of User-Player Behavior and Experience to Assess and Inform Game Design and Development, to be given at the Fun 'n Games 2006 Conference in England on June 26, 2006.

Marsh's method analyzes "immersidata." USC Viterbi School computer scientist Cyrus Shahabi, one of the researchers on the project, coined the term several years ago to refer to the machine-readable record of commands sent to the computer by keyboards, joysticks and other controls, collected in parallel with a videotape recording of the player at the game session.

The tool to use this record is "ISIS" (Immersidata AnalySIS), which can "identify data of interest and index events within the videotape. For the game development application, ISIS can return indexed examples of six different kinds of occurrences, or "points" in the immersidata/video record. They include:

-- Activity completion points, when the player has finished a final task associated with a mission.
-- Task completion points, a subset under this, allowing a researcher to go back over the performance of a task.
-- Break points, times when nothing seems to be happening; the player isn't moving and no events occur. This can be distraction, or a break, but "break is a very important concept … because it provides clues to what interrupts players," say Marsh.
-- Wandering points, somewhat similar times when the user-player is moving, but doesn't select any objects .
-- Critical events. Some elements of the game are the hardest, and these can be pre-selected, so that action leading up to accomplishment or non-accomplishment can be studied
-- Navigation errors. Collisions with a wall or object potentially point to inadequate or poor design causing user disorientation.

By backtracking from the points, investigators can see how the point developed. Similar patterns backing up parallel points can be clear indications of problem in the game.

Marsh and Shahabi used for their tests a "serious" (i.e., teaching) game designed to instruct students in human anatomy and physiology. The study analyzed sessions by 16 undergraduate students, with sessions of 13 of them intensively studies.

Though the group tested the technique on a serious game, "the techniques are for use testing all game genres, entertainment and non-entertainment," Marsh said.

The system already works extremely effectively to find problems in the areas it is set to look for, Marsh reports. Improvements are already in the works to add functionality to find and identify other potential problem areas -- to recognize repetition patters by players, and to replace and/or supplement the video capture with a replay of the game from the player's point of view, for example.

Marsh is also working on ways to use immersidata and to capture more aspects of the game experience, including particularly the emotional/empathetic elements. Marsh recently wrote a chapter on this, entitled "Vicarious Experience: Staying There Connected With and Through Our Own and Other Characters" in a new book, Gaming as Culture (McFarland Press, 2006)

Source: University of Southern California

Related stories:

Beyond chess: Deep green models rapid change for combat commanders
Can an artificial intelligence program anticipate military surprises? The USC Information Sciences Institute is playing a $7.6 million part in a DARPA research effort called Deep Green aimed at creating a system that can do so, one that might help future combat commanders in the field anticipate enemy moves.
Britain’s last Neanderthals were more sophisticated than we thought
An archaeological excavation at a site near Pulborough, West Sussex, has thrown remarkable new light on the life of northern Europe’s last Neanderthals. It provides a snapshot of a thriving, developing population – rather than communities on the verge of extinction.

University researchers promote new animal recognition technology
Two entrepreneurial researchers from The University of Queensland and the University of Southern Queensland, have taken their collaborative research further along the commercialisation pathway with their appearance tonight on the ABC's The New Inventors program.

Chill out, your computer knows what’s best for you
Computers are starting to become more human-centric, anticipating your needs and smoothly acting to meet them. Much of the progress can be attributed to work done by European researchers.

Computer game's high score could earn the Nobel Prize in medicine
Gamers have devoted countless years of collective brainpower to rescuing princesses or protecting the planet against alien invasions. This week researchers at the University of Washington will try to harness those finely honed skills to make medical discoveries, perhaps even finding a cure for HIV.
The 'choking game,' psychological distress and bullying
Ontario’s youth are experiencing a different kind of high -- approximately seven percent (an estimated 79,000 students in grades 7 to 12) report participating in a thrill-seeking activity called the “choking game”, which involves self-asphyxiation or having been choked by someone else on purpose. The 2007 Ontario Student Drug Use and Health Survey (OSDUHS) revealed these new data, as well as indicators and trends on the psychological health of Ontario’s youth, in the Mental Health and Well-Being Report released today by the Centre for Addiction and Mental Health (CAMH) for Children’s Mental Health Week.
Computer Science Fog Machine Improves Computer Graphics
UC San Diego computer scientists have created a fog and smoke machine for computer graphics that cuts the computational cost of making realistic smoky and foggy 3-D images, such as beams of light from a lighthouse piercing thick fog.
Beyond chess: Deep green models rapid change for combat commanders
The USC Information Sciences Institute is playing a $7.6 million part in a DARPA research effort called Deep Green aimed at creating a system that can do so, one that might help future combat commanders in the field anticipate enemy moves.

News discussion:

Technology news