Multimodal Contents Authoring and Playback System for Learning Human Anatomy


Haptic interaction has become an essential component in constructing immersive virtual environment, and now plenty of virtual education platforms introduce the haptics in their system. Researchers have revealed that haptic interaction can improve learners' understanding. However, the contents with haptic interaction are relatively hard to produce due to the complexity of development procedures.

To address this problem, we developed the interactive human anatomy learning platform. The distinguishable feature of our platform is the user-creatable multimodal learning scenario. The script containing the learning scenario is written in XML format. Since it provides intuitive grammar, the user without any prior knowledge of haptics or even programming languages can produce his or her own scenarios. The script engine interprets the script file, and haptic and visual rendering loops deliver the contents in the script to the user via corresponding modalities. The multimodal interactions between the system and the user then increase the presence and the immersion. We expect our platform to promote many haptic-based applications in learning environment, especially for young children to learn about the human body structures more effectively.

Overview of the platform

Abridged example of the script file and its structure

Snapshots of human anatomy learning contents

Video clip
(*Adobe Flash Player required)


Seokyeol Kim ( at