Who Speaks Next ? Turn Change and Next Speaker Prediction in Multimodal Multiparty Interaction - Normandie Université Access content directly
Conference Papers Year : 2020

Who Speaks Next ? Turn Change and Next Speaker Prediction in Multimodal Multiparty Interaction

Abstract

Turn change prediction and next speaker prediction are two important tasks in multimodal, multiparty human-agent interaction. Predicting a change of dialogue turn and the most probable next speaker can help an agent to decide whether he should contribute to the discussion or wait for someone else to speak. In this research, we propose a machine learning-based approach for both turn change and next speaker prediction. Individual as well as combined models are explored to tackle these tasks. Results show that the proposed models outperform baselines. An ablation study is also performed to measure the importance of different features.
No file

Dates and versions

hal-03273372 , version 1 (29-06-2021)

Identifiers

Cite

Alexandre Pauchet, Usman Malik, Julien Saunier, Kotaro Funakoshi. Who Speaks Next ? Turn Change and Next Speaker Prediction in Multimodal Multiparty Interaction. 2020 IEEE 32nd International Conference on Tools with Artificial Intelligence (ICTAI), Nov 2020, Baltimore, France. pp.349-354, ⟨10.1109/ICTAI50040.2020.00062⟩. ⟨hal-03273372⟩
23 View
0 Download

Altmetric

Share

Gmail Mastodon Facebook X LinkedIn More