Hunyadi, L. and Váradi, T. and Kovács, Gy. and Szekrényes, I. and Kiss, H. and Takács, K. (2018) Human-human, human-machine communication: on the HuComTech multimodal corpus. In: CLARIN Annual Conference 2018, 2018.10.08-2018.10.10., Pisa, Italy.
|
Text
ecp18159006.pdf Download (725kB) | Preview |
Abstract
The present paper describes HuComTech, a multimodal corpus featuring over 50 hours of video taped interviews with 112 informants. The interviews were carried out in a lab equipped with multiple cameras and microphones able to record posture, hand gestures, facial expressions, gaze etc. as well as the acoustic and linguistic features of what was said. As a result of large-scale manual and semi-automatic annotation, the HuComTech corpus offers a rich dataset on 47 annotation levels. The paper presents the objectives, the workflow, the annotation work, focusing on two aspects in particular i.e. time alignment made with the Leipzig tool WEBMaus and the automatic detection of intonation contours developed by the HuComTech team. Early exploitation of the corpus included analysis of hidden patterns with the use of sophisticated multivariat analysis of temporal relations within the data points. The HuComTech corpus is one o the flagship language resources available through the HunCLARIN repository
| Item Type: | Conference or Workshop Item (Paper) |
|---|---|
| Uncontrolled Keywords: | Multimodality, Multimodal corpus, Hidden patterns of communication, Human-machine communicatio |
| Subjects: | H Social Sciences / társadalomtudományok > HE Transportation and Communications > HE2 Communications / hírközlés P Language and Literature / nyelvészet és irodalom > P0 Philology. Linguistics / filológia, nyelvészet |
| SWORD Depositor: | MTMT SWORD |
| Depositing User: | MTMT SWORD |
| Date Deposited: | 27 Sep 2019 09:45 |
| Last Modified: | 27 Sep 2019 09:45 |
| URI: | http://real.mtak.hu/id/eprint/101685 |
Actions (login required)
 |
Edit Item |
