header

Poster: A Theory -Informed Roadmap Towards Multimodal Ocular-based Attention Metrics for Conversational VR


Agnes Widera, Torsten Wolfgang Kuhlen, Andrea Bönsch
ACM Symposium on Applied Perception (SAP) 2026
pubimg

Eye- tracking in consumer head-mounted displays (HMDs) already provides reliable data for visual attention tracking. We now strive to extend this capability to conversational attention, which also involves auditory processing, cognitive load, mind-wandering, and fatigue. To this end, we propose a taxonomy that maps gaze, blink dynamics, and pupillometry onto these five complementary dimensions and briefly summarize current eye - tracking- based evaluation methods. From the identified gaps, we outline a three - stage research roadmap — (i) robust pupillometry calibration, (ii) multimodal signal disambiguation, and (iii) composite attention-score fusion — aimed at achieving reliable, real -time inference of attentional engagement in Virtual-Reality (VR)-based dialogues.

» Show BibTeX

@inproceedings{10.1145/3821409.3833884,
author = {Widera, Agnes and Kuhlen, Torsten W. and B{\"o}nsch, Andrea},
title = {A Theory-Informed Roadmap Towards Multimodal Ocular-based Attention Metrics for Conversational VR},
year = {2026},
isbn = {9798400727993},
publisher = {Association for Computing Machinery},
address = {New York, NY, USA},
url = {https://doi.org/10.1145/3821409.3833884},
doi = {10.1145/3821409.3833884},
booktitle = {Proceedings of the 2026 ACM Symposium on Applied Perception},
articleno = {36},
numpages = {2},
keywords = {Virtual Reality, Attention, Eye-Tracking, Pupillometry, Blinking},
series = {SAP '26}
}




Datenschutzerklärung/Privacy Policy Home Visual Computing institute RWTH Aachen University