AR-intercepted Communication |
Motivation
To investigate communication properly, one approach is to monitor as many channels that transmit communicative signals as possible. Apart from speech this includes also nonverbal channels like facial expressions, gestures, head gestures, eye gaze, body posture etc.
While monitoring usually is done with the help of scene cameras which do not participante in the interaction because of their perspective, it is also possible to use some sensors that allow the monitoring from the participants' perspective. This can be achieved by using multimodal augmented reality devices like AR goggles and headphones. Although some natural communication channels are occluded by this technique there are still channels left for investigation: speech, gestures, head gestures, body posture etc. On the other hand, this enables us to monitor exactly these visual and auditory cues that are percepted by the users. Furthermore, it offers also other possibilities for the transmitted interaction signals:
- monitoring
- recording
- analysis (semi-automatic)
- modification
- enhancement
Further information:
Literature:
- "A Multimodal Augmented Reality System for Alignment Research", International Conference on Human-Computer Interaction, San Diego, USA, 18/07/2009. Export: Tagged XML BibTex