• Journal of Internet Computing and Services
    ISSN 2287 - 1136 (Online) / ISSN 1598 - 0170 (Print)
    https://jics.or.kr/

A Method of Automated Quality Evaluation for Voice-Based Consultation


Keonsoo Lee, Jung-Yeon Kim, Journal of Internet Computing and Services, Vol. 22, No. 2, pp. 69-75, Apr. 2021
10.7472/jksii.2021.22.2.69, Full Text:
Keywords: Call Center, Consultation, Quality Assurance, speech recognition, Process Automation

Abstract

In a contact-free society, online services are becoming more important than classic offline services. At the same time, the role of a contact center, which executes customer relation management (CRM), is increasingly essential. For supporting the CRM tasks and their effectiveness, techniques of process automation need to be applied. Quality assurance (QA) is one of the time and resource consuming, and typical processes that are suitable for automation. In this paper, a method of automatic quality evaluation for voice based consultations is proposed. Firstly, the speech in consultations is transformed into a text by speech recognition. Then quantitative evaluation based on the QA metrics, including checking the elements in opening and closing mention, the existence of asking the mandatory information, the attitude of listening and speaking, is executed. 92.7% of the automated evaluations are the same to the result done by human experts. It was found that the non matching cases of the automated evaluations were mainly caused from the mistranslated Speech-to-Text (STT) result. With the confidence of STT result, this proposed method can be employed for enhancing the efficiency of QA process in contact centers.


Statistics
Show / Hide Statistics

Statistics (Cumulative Counts from November 1st, 2017)
Multiple requests among the same browser session are counted as one view.
If you mouse over a chart, the values of data points will be shown.


Cite this article
[APA Style]
Lee, K. & Kim, J. (2021). A Method of Automated Quality Evaluation for Voice-Based Consultation. Journal of Internet Computing and Services, 22(2), 69-75. DOI: 10.7472/jksii.2021.22.2.69.

[IEEE Style]
K. Lee and J. Kim, "A Method of Automated Quality Evaluation for Voice-Based Consultation," Journal of Internet Computing and Services, vol. 22, no. 2, pp. 69-75, 2021. DOI: 10.7472/jksii.2021.22.2.69.

[ACM Style]
Keonsoo Lee and Jung-Yeon Kim. 2021. A Method of Automated Quality Evaluation for Voice-Based Consultation. Journal of Internet Computing and Services, 22, 2, (2021), 69-75. DOI: 10.7472/jksii.2021.22.2.69.