Who Speaks Next ? Turn Change and Next Speaker Prediction in Multimodal Multiparty Interaction - Normandie Université
Communication Dans Un Congrès Année : 2020

Who Speaks Next ? Turn Change and Next Speaker Prediction in Multimodal Multiparty Interaction

Résumé

Turn change prediction and next speaker prediction are two important tasks in multimodal, multiparty human-agent interaction. Predicting a change of dialogue turn and the most probable next speaker can help an agent to decide whether he should contribute to the discussion or wait for someone else to speak. In this research, we propose a machine learning-based approach for both turn change and next speaker prediction. Individual as well as combined models are explored to tackle these tasks. Results show that the proposed models outperform baselines. An ablation study is also performed to measure the importance of different features.
Fichier non déposé

Dates et versions

hal-03273372 , version 1 (29-06-2021)

Identifiants

Citer

Alexandre Pauchet, Usman Malik, Julien Saunier, Kotaro Funakoshi. Who Speaks Next ? Turn Change and Next Speaker Prediction in Multimodal Multiparty Interaction. 2020 IEEE 32nd International Conference on Tools with Artificial Intelligence (ICTAI), Nov 2020, Baltimore, France. pp.349-354, ⟨10.1109/ICTAI50040.2020.00062⟩. ⟨hal-03273372⟩
27 Consultations
0 Téléchargements

Altmetric

Partager

More