Research carried out by the Distributed and Interactive Systems from Centrum Wiskunde & Informatica (CWI) has resulted in several contributions to this year's ACM CHI Conference on Human Factors in Computing Systems. CHI is the flagship conference of ACM SIGCHI, the premier international society for professionals, academics and students who are interested in technology and human-computer interaction. While this year's conference has been unfortunately cancelled due to COVID-19, below we highlight the work we would have presented. We unfortunately also have to cancel the 2nd Pre-CHI 2020 event that was to be held at CWI. Below we describe our contributions two full papers, two workshops, four late-breaking works, and one panel.
Our first full paper investigates the problem of collecting accurate and precise emotion ground truth labels for mobile video watching. We contribute a validated annotation technique and associated annotation fusion method, that is suitable for collecting fine-grained emotion annotations while users watch mobile videos. Our second full paper investigates wearable, on-chest thermal displays and how they influence voice processing. We contribute a better understanding of how thermal displays can augment voice perception, which can enhance voice assistants and support individuals with emotional prosody impairments.
Our first workshop addresses Social VR, a new medium for remote communication and collaboration. We will run this Social VR workshop online using a social VR platform--Mozilla Hubs! Our second workshop deals with emotion ground truth data collection. We aim to (a) explore and define novel elicitation tasks (b) survey sensing and annotation techniques (c) create a taxonomy of when and where to apply an elicitation method.
Our first LBW titled “Designing A Social VR Clinic for Medical Consultations” investigates how social Virtual Reality (VR) can create new opportunities for remote communication, and can potentially be a new tool for remote medical consultations. In our second LBW titled “Designing Real-time, Continuous Emotion Annotation Techniques for 360° VR Videos”, we design six continuous emotion annotation techniques for the Oculus Rift HMD aimed at minimizing workload and distraction. In our third LBW titled “Towards Improving Emotion Self-report Collection using Self-reflection”, we look at Experience Sampling Methods (ESMs) and their use for emotion self-report data collection. In our fourth LBW titled “Designing User Interface for Facilitating Live Editing in Streaming”, we look at how media assets, such as overlay graphics or comments, can make video streaming a unique ad engaging experience.
Finally, in this Panel Discussion, we aim at gathering researchers and practitioners to reflect on using mixed reality (XR) technologies to support collaborative learning and co-creation, and to foster a joint force by connecting the Learning and Education community and the XR community at CHI.
About DIS
CWI’s Distributed and Interactive Systems research group focuses on facilitating and improving the way people use interactive systems and how people communicate with each other. We combine data science with a strong human-centric, empirical approach to understand the experience of users. This enables us to design and develop next generation intelligent and empathic systems. We base our results on realistic testing grounds and data sets, and embrace areas such as ubiquitous computing, human-centered multimedia systems, and languages.
References
- Paper 1: T. Zhang, A. El Ali, C. Wang, A. Hanjalic & P. Cesar (2020). RCEA: Real-time, Continuous Emotion Annotation for Collecting Precise Mobile Video Ground Truth Labels. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (ACM CHI 2020), Honolulu, Hawaii, USA, Apr 25-30, 2020.
DOI: http://dx.doi.org/10.1145/3313831.3376808
Preprint: http://abdoelali.com/pdfs/Paper679.pdf
Video preview: https://www.youtube.com/watch?v=63OD4aRU-z0
- Paper 2: A. El Ali, X. Yang, S. Ananthanarayan, T. Röggla, J. Jansen, J. Hartcher-O’Brien, K. Jansen & P. Cesar (2020). ThermalWear: Exploring Wearable On-chest Thermal Displays to Augment Voice Messages with Affect. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (ACM CHI 2020), Honolulu, Hawaii, USA, Apr 25-30, 2020.
DOI: https://doi.org/10.1145/3313831.3376682
Preprint: http://abdoelali.com/pdfs/Paper553.pdf
Video preview: https://www.youtube.com/watch?v=dEgGRpj0HtI
Source code: https://github.com/cwi-dis/ThermalWear
- Workshop 1: Li, J., Vinayagamoorthy, V., Schwartz, R., Ijsselsteijn, W., Shamma, D. A. & Cesar, P. (2020). Social VR: A New Medium for Remote Communication and Collaboration. In Extended Abstracts Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (ACM CHI 2020), Honolulu, Hawaii, USA, Apr 25-30, 2020.
DOI: http://dx.doi.org/10.1145/3334480.3375160
Preprint: http://tiny.cc/i1zmmz
- Workshop 2: A. El Ali, M. Perusquía-Hernández, P. Denman, Y. Abdelrahman, M. Hassib, A. Meschtscherjakov, D. Ferreira & N. Henze (2020). MEEC: First Workshop on Momentary Emotion Elicitation and Capture. In Extended Abstracts Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (ACM CHI 2020), Honolulu, Hawaii, USA, Apr 25-30, 2020.
DOI: http://dx.doi.org/10.1145/3334480.3375175
Preprint: http://abdoelali.com/pdfs/WS09.pdf
- LBW 1: Li, J., Chen, G., De Ridder, H. & Cesar, P. (2020). Designing A Social VR Clinic for Medical Consultations. In Extended Abstracts Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (ACM CHI 2020), Honolulu, Hawaii, USA, Apr 25-30, 2020.
DOI: https://doi.org/10.1145/3334480.3382836
Preprint: http://tiny.cc/y3zmmz
- LBW 2: T. Xue, S. Ghosh, G. Ding, A. El Ali & P. Cesar (2020). Designing Real-time, Continuous Emotion Annotation Techniques for 360° VR Videos. In Extended Abstracts Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (ACM CHI 2020), Honolulu, Hawaii, USA, Apr 25-30, 2020.
DOI: http://dx.doi.org/10.1145/3334480.3382895
Preprint: http://abdoelali.com/pdfs/LBW311.pdf
Video preview: https://www.youtube.com/watch?v=tFpVuxTXPLk
- LBW 3: S. Ghosh, B. Mitra & P. De (2020). Towards Improving Emotion Self-report Collection using Self-reflection. In Extended Abstracts Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (ACM CHI 2020), Honolulu, Hawaii, USA, Apr 25-30, 2020.
DOI: https://doi.org/10.1145/3334480.3383019
Preprint: http://tiny.cc/cj1mmz
- LBW 4: Tharatipyakul, A., Li, J. & Cesar, P. (2020). Designing User Interface for Facilitating Live Editing in Streaming. In Extended Abstracts Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (ACM CHI 2020), Honolulu, Hawaii, USA, Apr 25-30, 2020.
DOI: https://doi.org/10.1145/3334480.3383037
Preprint: http://tiny.cc/e6zmmz
- Panel: Vasilchenko, A., Li, J., Ryskeldiev, B., Sarcar, S., Ochiai, Y., Kunze, K. & Radu, I. (2020). Collaborative Learning and Co-creation in XR. In Extended Abstracts Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (ACM CHI 2020), Honolulu, Hawaii, USA, Apr 25-30, 2020.
DOI: https://doi.org/10.1145/3334480.3381056
Preprint: http://tiny.cc/98zmmz
