Chatbot with Touch and Graphics

May 2020 · Hyeonggeun Yun, Auejin Ham, Jin Kim, Taeyeong Kim, Jeongeun Kim, Haechan Lee, Jongrae Park, Jinkyu Jang

awardDGIST UGRP Excellence Prize

Paper

What
An interaction technique (TwG) that carries emotion and turn-taking to a chatbot through touch.
Why
Chatbots have been treated in terms of natural language processing for text conversation, leaving little means to convey a user's emotion or manage whose turn it is.
How
Users send emotion and hand over the turn by touching a graphic interface; a Wizard of Oz study evaluated the resulting experience.
New
Emotional expression improved over conventional text-only chatbot interaction, and turn-taking became more natural.

Abstract

Use of chatbots for emotional exchange is recently increasing in various domains. However, as existing chatbots have been considered in terms of natural language processing techniques for interaction with text-based chatting, chatbot interaction with users is lacking in terms of considering the emotions of users and managing turn-taking in conversation. This paper suggests an interaction technique having touch interactions with graphic interfaces (TwG) to solve these problems. In the system, users send their emotions and manage turn-taking through TwG technique. We conducted a Wizard of Oz study to evaluate user experience on emotional expression and turn-taking with TwG technique. Results showed that TwG interaction improved emotional expression compared to a traditional text-based chatbot interaction. Furthermore, the results showed that TwG positively affects natural turn-taking of the conversation.

Presentations & Awards

This project also exists as a publication.