TY - GEN
T1 - Conveying language through haptics
T2 - 22nd International Symposium on Wearable Computers, ISWC 2018
AU - Dunkelberger, Nathan
AU - Sullivan, Jenny
AU - Bradley, Joshua
AU - Walling, Nickolas P.
AU - Manickam, Indu
AU - Dasarathy, Gautam
AU - Israr, Ali
AU - Lau, Frances W.Y.
AU - Klumb, Keith
AU - Knott, Brian
AU - Abnousi, Freddy
AU - Baraniuk, Richard
AU - O’Malley, Marcia K.
PY - 2018/10/8
Y1 - 2018/10/8
N2 - In our daily lives, we rely heavily on our visual and auditory channels to receive information from others. In the case of impairment, or when large amounts of information are already transmitted visually or aurally, alternative methods of communication are needed. A haptic language offers the potential to provide information to a user when visual and auditory channels are unavailable. Previously created haptic languages include deconstructing acoustic signals into features and displaying them through a haptic device, and haptic adaptations of Braille or Morse code; however, these approaches are unintuitive, slow at presenting language, or require a large surface area. We propose using a multi-sensory haptic device called MISSIVE, which can be worn on the upper arm and is capable of producing brief cues, sufficient in quantity to encode the full English phoneme set. We evaluated our approach by teaching subjects a subset of 23 phonemes, and demonstrated an 86% accuracy in a 50 word identification task after 100 minutes of training.
AB - In our daily lives, we rely heavily on our visual and auditory channels to receive information from others. In the case of impairment, or when large amounts of information are already transmitted visually or aurally, alternative methods of communication are needed. A haptic language offers the potential to provide information to a user when visual and auditory channels are unavailable. Previously created haptic languages include deconstructing acoustic signals into features and displaying them through a haptic device, and haptic adaptations of Braille or Morse code; however, these approaches are unintuitive, slow at presenting language, or require a large surface area. We propose using a multi-sensory haptic device called MISSIVE, which can be worn on the upper arm and is capable of producing brief cues, sufficient in quantity to encode the full English phoneme set. We evaluated our approach by teaching subjects a subset of 23 phonemes, and demonstrated an 86% accuracy in a 50 word identification task after 100 minutes of training.
KW - Haptics
KW - Multi-sensory
KW - Speech.
KW - Wearable
UR - http://www.scopus.com/inward/record.url?scp=85056821369&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85056821369&partnerID=8YFLogxK
U2 - 10.1145/3267242.3267244
DO - 10.1145/3267242.3267244
M3 - Conference contribution
AN - SCOPUS:85056821369
T3 - Proceedings - International Symposium on Wearable Computers, ISWC
SP - 25
EP - 32
BT - ISWC 2018 - Proceedings of the 2018 ACM International Symposium on Wearable Computers
PB - Association for Computing Machinery
Y2 - 8 October 2018 through 12 October 2018
ER -