In the new subproject A06, Junior Professor Dr. Hanna Drimalla will be conducting research on feedback signals by people with psychological conditions and people in stressful situations.
During the explanatory process, the explainer generally tries to find out whether the person he or she is talking to is following the explanation. To do this, the explainer must perceive non-verbal signals from the other person and adjust their explanation accordingly. Individual and situational factors can influence these social signals. Feedback signals can differ, for example, for people with psychological conditions compared to those without, as well as for people in stressful situations as opposed to those in neutral situations. This diversity of signaling should also be taken into account by artificial intelligence (AI) systems when explaining topics to humans, as project investigator Junior Professor Dr. Hanna Drimalla herself explains.
These issues and more are being explored in the new TRR sub-project A06 called "Co-Constructing social signs of understanding to adapt monitoring to diversity”. This subproject is located within research area A ("Explaining") of the Transregio Research Profile. A06’s key research objectives include:
- Developing an understanding of how social signals from the explainee are influenced by intra-individual (e.g. psychological conditions) and inter-individual (e.g. stress) factors in an explanation.
- Investigating the extent to which automated monitoring models developed using data from people without psychological conditions in neutral situations are generalizable to inter- and intra-individual varieties.
- Building an explanatory AI system that can deal with these effects. Following a co-constructive approach, it will work together with the explainee to develop an understanding of social signals.
Junior Professor Dr. Hanna Drimalla has serving as a junior professor for "Multimodal Behaviour Processing" at Bielefeld University since the end of 2020. Because the new appointment was made after the application for the Transregio had already been submitted, the application for this subproject was submitted retrospectively, and has now been approved by the German Research Foundation (DFG).
