Untitled

Funder

Organizational Unit

Publications

Separating gesture detection and application control concerns with a multimodal architecture

Publication . Morgado, Leonel; Cardoso, Bernardo; Carvalho, Fausto de; Fernandes, Luís; Paredes, Hugo; Barbosa, Luís; Fonseca, Benjamim; Martins, Paulo; Nunes, Ricardo Rodrigues

Gesture-controlled applications typically are tied to specific gestures, and also tied to specific recognition methods and specific gesture-detection devices. We propose a concernseparation architecture, which mediates the following concerns: gesture acquisition; gesture recognition; and gestural control. It enables application developers to respond to gesture-independent commands, recognized using plug-in gesture-recognition modules that process gesture data via both device-dependent and deviceindependent data formats and callbacks. Its feasibility is demonstrated with a sample implementation.

2015Conference object

Open access

Primeira armada da Índia: novo conceito de jogo misturando realidades aumentada e virtual, gestos finos e amplos

Publication . Morgado, Leonel; Cristóvão, Paulo; Fernandes, Luís; Nunes, Ricardo Rodrigues; Martins, Paulo; Paredes, Hugo; Barbosa, Luís; Cardoso, Bernardo; Carvalho, Fausto de

Apresentamos um conceito de jogo inovador e o seu protótipo inicial, integrando tipos distintos de interação e de visualização. Dois jogadores interagem como timoneiro de uma nau portuguesa e gigante Adamastor. Um joga em realidade virtual controlada por gestos finos, outro usa aumentação contextual com gestos amplos e fi-nos. Pretende o conceito e o protótipo servirem como exemplificadores das potencialidades das novas formas de interação e de como as concretizar.

2015Conference object

Open access

Bringing user experience empirical data to gesture-control and somatic interaction in virtual reality videogames: an exploratory study with a multimodal interaction prototype

Publication . Fernandes, Luís; Nunes, Ricardo Rodrigues; Matos, Gonçalo; Azevedo, Diogo; Pedrosa, Daniela; Morgado, Leonel; Paredes, Hugo; Barbosa, Luís; Fonseca, Benjamim; Martins, Paulo; Cardoso, Bernardo; Carvalho, Fausto de

With the emergence of new low-cost gestural interaction devices various studies have been developed on multi-modal human-computer interaction to improve user experience. We present an exploratory study which analysed the user experience with a multimodal interaction game prototype. As a result, we propose a set of preliminary recommendations for combined use of such devices and present implications for advancing the multimodal field in human-computer interaction.

2015Conference object

Open access

EmbodiMentor: a science fiction prototype to embody different perspectives using augmented reality

Publication . Morgado, Leonel; Gütl, Christian; Stahlal, Aletha

This paper describes the EmbodiMentor, an interaction concept and metaphor that aims to enable users to embody a different person or character’s perspective, specify or modify his/her/its emotional elements and conditioning elements, and experience the resulting changes. Its use case scenario is the education and training of foreign languages and intercultural communication skills, were contextualization and first person experiences in common settings are key for practical skill acquisitions. It was born as the micro-science-fiction prototype “Frances can’t sleep. She crawls out of bed and with her EmbodiMentor runs through a range of a client’s emotional states, pitching to each one. She then falls asleep.” The application of the science fiction prototyping concept has been proven a strong approach to develop and investigate innovative applications of emerging technologies.

2016Conference object

Open access