A revolutionary new interface allows users to really feel virtual textiles. The system combines a specially designed glove, a sophisticated computer model and visual representation to reproduce the sensation of cloth with an impressive degree of realism.
“It is a multi-modal approach that has never been tried before,” says Professor Nadia Magnenat-Thalmann, coordinator of the HAPTEX project. HAPTEX stands for Haptic sensing of virtual textiles.
The new system is a major breakthrough achieved through highly focused work of a small consortium of five research institutes. In just three years, they have created a pre-commercialisation prototype of the device and its related multi-modal software.
But it was not easy. Creating the realistic sensation of deformable textiles required a huge amount of modelling. “That was our first big challenge,” says Magnenat-Thalmann, taking precise measurements of the tensile, bending and stretching properties of the material.
“You also need very high resolution; the visual system will give a realistic impression of movement with just 20 frames a second, but touch is much more sensitive. You need a thousand samples a second to recreate touch,” she tells ICT Results.
Major challenges
In the end, the team created two models. One global model tracks the overall properties of the material. A second, fine-resolution model then maps the actual sensation on skin. All this information had to be combined with a detailed visual representation of the textile.
“That was another major problem,” notes Magnenat-Thalmann, “because the two must be in sync or the sensation will not be realistic.” Like a video with the audio out of sync, any latency between the visual and the sensual destroys the effect.
These were three major challenges from the outset, but they were just the beginning. “We had major jobs to do with the hardware, too. Nobody has combined a force-feedback device with a tactile one,” reports Magnenat-Thalmann.
HAPTEX overcame this problem by developing a powered exoskeleton glove with a pair of pin arrays that provide tactile sensation to two fingers. The glove gives the sensation of bending and stretching the fabric, while the pin arrays convey texture. Then this integrated device is combined with the visual and tactile database to give an overall impression.
Feeling is believing
“We have a working prototype device and we have validated it. It gives a reliable and reproducible sensation of real fabrics in a virtual world,” says Magnenat-Thalmann.
Reviewers were very impressed with the project’s results, but Magnenat-Thalmann says the project did not achieve all that they hoped for. “Originally, our vision was to create a system that allowed users to distinguish between, say, cotton, wool and silk in a blind test. The system is not that sensitive yet.”
It is, however, in pre-commercialisation form. The team now hopes to secure funding for a second project that will take the device from prototype stage to full commercialisation. If they succeed, it will be a first of its kind.
It will also mean entirely new markets. The textile industry and online shopping are obvious examples, but Magnenat-Thalmann also sees applications in gaming, where it could be used to make virtual worlds more realistic.
Source:
ICT Results
Related stories:
Researchers Design Band-Aid-Size Tactile Display
Currently, we get most of our information from computers through visual and audio features. But as researchers from Korea point out, the most widespread sense on the human body is touch. While some tactile computer devices do exist, the researchers are trying to take full advantage of this overlooked sense with the development of a tactile display that can be wrapped around your finger like a band-aid.
Robot Suit May Help You Achieve a Perfect Golf Swing
Researchers have developed a vibrotactile feedback suit to help individuals learn new motor skills more quickly and accurately than by mimicking human teachers alone. Besides golf, dance and sports training, the suit may also be useful for individuals undergoing motor rehabilitation after neurological damage, as well as for posture improvement.
Shrinking waistline is all in the mind
Researchers have identified the area of the brain which controls perception of our body image by using an illusion that made people think their waists were shrinking.
Computer scientists develop ubiquitous video application for 3D environments
Computer scientists at the University of California, San Diego have taken the wraps off a new technique for mixing images and video feeds from mobile cameras in the field to provide remote viewers with a virtual window into a physical environment. Dubbed 'RealityFlythrough,' the application constructs a 3D virtual environment dynamically out of the live video streams.
Monkeys Adapt Robot Arm as Their Own
Monkeys that learn to use their brain signals to control a robotic arm are not just learning to manipulate an external device, Duke University Medical Center neurobiologists have found. Rather, their brain structures are adapting to treat the arm as if it were their own appendage.
The finding has profound implications both for understanding the extraordinary adaptability of the primate brain and for the potential clinical success of brain-operated devices to give the handicapped the ability to control their environment, said the researchers.
Samsung Intros 3D Game Phones with Vibration
Samsung Electronics introduced 3D game phones (models: SPH-G1000, SCH-G100) with vibration capability. The phone delivers realistic images and true-to-life sound, while the vibration it sends to the user's hand provides an extra sensation to the game experience. During an auto racing game, for example, the mobile phone vibrates as the player's car bumps over gravel or other unpaved surfaces, adding realism to virtual reality.
Atomic-resolution views suggest function of enzyme that regulates light-detecting signals in eye
An atomic-resolution view of an enzyme found only in the eye has given researchers at the University of Washington (UW) clues about how this enzyme, essential to vision, is activated. The enzyme, phosphodiesterase 6 (PDE6), is central to the way light entering the retina is converted into a cascade of signals to the brain.
Neurotransmitter defect may trigger autoimmune disease
A potentially blinding neurological disorder, often confused with multiple sclerosis (MS), has now become a little less mysterious. A new study by researchers at the Mayo Clinic in Rochester, Minnesota, may have uncovered the cause of Devic's disease. Their new study, which will appear online on October 6th in the
Journal of Experimental Medicine, could result in new treatment options for this devastating disease.
