A multi-sensory system for the investigation of geoscientific data

In this paper, we report our ongoing research into multi-sensory investigation of geoscientific data. Our geoscientific data investigation system (GDIS) integrates three-dimensional, interactive computer graphics, touch (haptics) and real-time sonification into a multi-sensory virtual environment. GDIS has been used to investigate geological structures derived from high-resolution bathymetry-maps of the Mid-Atlantic Ridge. It helped us obtain improved models of the mega-mullions, which promise to grant insight into the deeper structures of the ocean floor. Haptic force feedback was used to precisely digitize line-features on three-dimensional morphology and to feel surface properties via varying friction settings; additional, overlapping data can be perceived via sound (sonification). We also report on the results of a psycho-acoustic study about the absolute recognition of sound signals, and on the actual feedback that we have received from a number of geoscientists during a recent major geoscience conference.