A Study on Automatic Open-Domain Dialogue Evaluation Metrics

Citations

SCOPUS

1

초록

Given the extensive use of conversational systems in daily life, there arises a need for an automated evaluation system tailored to such conversations. In light of this, an array of studies is underway to develop automatic evaluation metrics. Unlike conventional approaches, contemporary methodologies incorporate techniques that leverage the contextual nuances of conversation systems. In conclusion, it points out that recently explored methodologies are better suited for assessing conversations compared to classical methods; however, it is worth noting that these methodologies may also possess inherent limitations. © 2024 IEEE.

키워드

automatic evaluation; evaluation metrics; open-domain dialogue
제목
A Study on Automatic Open-Domain Dialogue Evaluation Metrics
저자
Kim, Minki; Kim, Junyeong
DOI
10.1109/ICCE59016.2024.10444444
발행일
2024-01
유형
Conference paper
저널명
Digest of Technical Papers - IEEE International Conference on Consumer Electronics
권
2024 IEEE