Project A05: Contextualized and online parametrization of attention in human–robot explanatory dialog

In Project A05, researchers from the areas of linguistics, psychology, and computer science are investigating attention in human-robot explanatory dialog. They are addressing questions including: where do humans focus their attention when a robot explains a task to them? How can robots direct their counterpart’s attention to achieve the goal of the task? What influence does it have on overall understanding? To investigate these questions, the researchers are assessing attention during an interactive human robot explanatory dialog. The researchers are also aiming to investigate the conditions under which certain linguistic formulations, such as “do X and not Y”, might influence the nature of explanation and understanding. Based on these results, the researchers will then draw conclusions about how robots can understand and direct the attention of their human counterparts and subsequently generate interpretable explanations.

 

Research areas: Linguistics, Psychology, Computer science

Project leaders

Prof. Dr. Katharina Rohlfing

Transregional Collaborative Research Centre 318

More about the person

Prof. Dr. Ingrid Scharlau

Transregional Collaborative Research Centre 318

More about the person

Britta Wrede

Transregional Collaborative Research Centre 318

More about the person

Staff

Ngoc Chi Banh, M.Sc.

Transregional Collaborative Research Centre 318

More about the person

André Groß, M.Sc.

Transregional Collaborative Research Centre 318

More about the person

Amit Singh, M.Sc.

Transregional Collaborative Research Centre 318

More about the person

Associate member

Dr.-Ing. Birte Richter, Bielefeld University

Support Staff

Oliver Debernitz, Paderborn University

Kostantin Gubenko, Paderborn University

Annabell Horch, Paderborn University

Tim Schaffhauser, Paderborn University

Bjarne Thomzik, Bielefeld University

Publications

Effects of verbal negation on TVA’s capacity and weight parameters
N.C. Banh, I. Scharlau, in: S. Malejka, M. Barth, H. Haider, C. Stahl (Eds.), TeaP 2022 - Abstracts of the 64th Conference of Experimental Psychologists , Pabst Science Publishers, 2022.
Folgen wiederholter Negation auf die Aufmerksamkeit
N.C. Banh, I. Scharlau, K.J. Rohlfing, in: C. Bermeitinger, W. Greve (Eds.), 52. Kongress Der Deutschen Gesellschaft Für Psychologie, 2022.
What is Missing in XAI So Far?
U. Schmid, B. Wrede, KI - Künstliche Intelligenz 36 (2022) 303–315.
Explainable AI
U. Schmid, B. Wrede, KI - Künstliche Intelligenz 36 (2022) 207–210.
Exploring Monological and Dialogical Phases in Naturally Occurring Explanations
J.B. Fisher, V. Lohmer, F. Kern, W. Barthlen, S. Gaus, K. Rohlfing, KI - Künstliche Intelligenz 36 (2022) 317–326.
An Architecture Supporting Configurable Autonomous Multimodal Joint-Attention-Therapy for Various Robotic Systems
A. Groß, C. Schütze, B. Wrede, B. Richter, in: INTERNATIONAL CONFERENCE ON MULTIMODAL INTERACTION, ACM, 2022, pp. 154–159.
Enabling Non-Technical Domain Experts to Create Robot-Assisted Therapeutic Scenarios via Visual Programming
C. Schütze, A. Groß, B. Wrede, B. Richter, in: INTERNATIONAL CONFERENCE ON MULTIMODAL INTERACTION, ACM, 2022, pp. 166–170.
First steps towards real-time assessment of attentional weights and capacity according to TVA
N.C. Banh, I. Scharlau, in: S. Merz, C. Frings, B. Leuchtenberg, B. Moeller, S. Mueller, R. Neumann, B. Pastötter, L. Pingen, G. Schui (Eds.), Abstracts of the 65th TeaP, ZPID (Leibniz Institute for Psychology), 2023.
Contrastiveness in the context of action demonstration: an eye-tracking study on its effects on action perception and action recall
A. Singh, K.J. Rohlfing, in: Proceedings of the Annual Meeting of the Cognitive Science Society 45 (45), Cognitive Science Society, Sydney, Australia, 2023.
Scaffolding the human partner by contrastive guidance in an explanatory human-robot dialogue
A. Groß, A. Singh, N.C. Banh, B. Richter, I. Scharlau, K.J. Rohlfing, B. Wrede, Frontiers in Robotics and AI 10 (2023).
RISE: an open-source architecture for interdisciplinary and reproducible human–robot interaction research
A. Groß, C. Schütze, M. Brandt, B. Wrede, B. Richter, Frontiers in Robotics and AI 10 (2023).
EEG Correlates of Distractions and Hesitations in Human–Robot Interaction: A LabLinking Pilot Study
B. Richter, F. Putze, G. Ivucic, M. Brandt, C. Schütze, R. Reisenhofer, B. Wrede, T. Schultz, Multimodal Technologies and Interaction 7 (2023).
Show all publications