An Evaluation of Chinese Human-Computer Dialogue Technology

Subjects: Computer Science >> Integration Theory of Computer Science submitted time 2022-11-27 Cooperative journals: 《数据智能（英文）》

Zixian, Feng Caihai, Zhu Weinan, Zhang Zhigang, Chen Wanxiang, Che Minlie, Huang Linlin, Li

Abstract： There is a growing interest in developing human-computer dialogue systems which is an important branch in the field of artificial intelligence (AI). However, the evaluation of large-scale Chinese human-computer dialogues is still a challenging task. To attract more attention to dialogue evaluation work, we held the fourth Evaluation of Chinese Human-Computer Dialogue Technology (ECDT). It consists of few-shot learning in spoken language understanding (SLU) (Task 1) and knowledge-driven multi-turn dialogue competition (Task 2), the data sets of which are provided by Harbin Institute of Technology and Tsinghua University. In this paper, we will introduce the evaluation tasks and data sets in detail. Meanwhile, we will also analyze the evaluation results and the existing problems in the evaluation.

 Hits 1544  Downloads 160  Comment 0