---
id: chatbot-touch-graphics
type: project
title: Chatbot with Touch and Graphics
url: https://auejin.com/en/projects/chatbot-touch-graphics/
lang: en
alternate:
  ko: https://auejin.com/ko/projects/chatbot-touch-graphics/
updated: '2026-08-11'
---

# Chatbot with Touch and Graphics

May 2020 · Hyeonggeun Yun,  Auejin Ham , Jin Kim, Taeyeong Kim, Jeongeun Kim, Haechan Lee, Jongrae Park, Jinkyu Jang

award: [DGIST UGRP Excellence Prize](https://auejin.com/en/awards/dgist-ugrp-excellence-2020/)

- **What** — An interaction technique (TwG) that carries emotion and turn-taking to a chatbot through touch.
- **Why** — Chatbots have been treated in terms of natural language processing for text conversation, leaving little means to convey a user's emotion or manage whose turn it is.
- **How** — Users send emotion and hand over the turn by touching a graphic interface; a Wizard of Oz study evaluated the resulting experience.
- **New** — Emotional expression improved over conventional text-only chatbot interaction, and turn-taking became more natural.

## Abstract

![](https://auejin.com/assets/chatbot-touch-graphics/chatbot-touch-graphics-1.png)

Use of chatbots for emotional exchange is recently increasing in various domains. However, as existing chatbots have been considered in terms of natural language processing techniques for interaction with text-based chatting, chatbot interaction with users is lacking in terms of considering the emotions of users and managing turn-taking in conversation. This paper suggests an interaction technique having touch interactions with graphic interfaces (TwG) to solve these problems. In the system, users send their emotions and manage turn-taking through TwG technique. We conducted a Wizard of Oz study to evaluate user experience on emotional expression and turn-taking with TwG technique. Results showed that TwG interaction improved emotional expression compared to a traditional text-based chatbot interaction. Furthermore, the results showed that TwG positively affects natural turn-taking of the conversation.

## Presentations & Awards

*This project also exists as a [publication](https://auejin.com/en/publications/2020-chatbot-touch-graphics/).*

## Related

- [Chatbot with Touch and Graphics: An Interaction of Users for Emotional Expression and Turn-taking](https://auejin.com/en/publications/2020-chatbot-touch-graphics/)
- [Daegu Gyeongbuk Institute of Science and Technology (DGIST), B.S. in Interdisciplinary Engineering](https://auejin.com/en/education/dgist-bs/)