A kinect game in the VirtualSign project: training and learning with gestures

This paper presents the development of a game aimed at making the process of learning sign language enjoyable and interactive, using the VirtualSign Translator. In this game the player controls a character that interacts with various objects and non-player characters with the aim of collecting several gestures from the Portuguese Sign Language. Through the connection with VirtualSign Translator the data gloves and Kinect support this interaction and the character can then represent the gestures. This allows for the user to visualize and learn or train the various existing configurations of gestures. To improve the interactivity and to make the game more interesting and motivating, several checkpoints were placed along game levels. This provides the players with a chance to test the knowledge they have acquired so far on the checkpoints, after performing the signs using Kinect. A High Scores system was also created, as well as a History option, to ensure that the game is a continuous and motivating learning process.

Description

Comunicação apresentada na 7ª Conferência Internacional de Arte Digital realizada em Óbidos de 19-20 de março de 2015

Keywords

Kinect game Game development Educational content Educational game Portuguese Sign Language (LGP)

URI

http://hdl.handle.net/10400.2/4446

Citation

Escudeiro, Paula [et al.] - A kinect game in the VirtualSign project : training and learning with gestures. In Artech 2015. International Conference on Digital Arts, 7, Óbidos, 2015 - "Creating digital e-motions [Em linha]: proceedings". Editada por José Bidarra [et al.]. [S.l.] : Artech International, 2015. ISBN 978-989-99370-0-0. 5 p.