Loading...
4 results
Search Results
Now showing 1 - 4 of 4
- Separating gesture detection and application control concerns with a multimodal architecturePublication . Morgado, Leonel; Cardoso, Bernardo; Carvalho, Fausto de; Fernandes, Luís; Paredes, Hugo; Barbosa, Luís; Fonseca, Benjamim; Martins, Paulo; Nunes, Ricardo RodriguesGesture-controlled applications typically are tied to specific gestures, and also tied to specific recognition methods and specific gesture-detection devices. We propose a concernseparation architecture, which mediates the following concerns: gesture acquisition; gesture recognition; and gestural control. It enables application developers to respond to gesture-independent commands, recognized using plug-in gesture-recognition modules that process gesture data via both device-dependent and deviceindependent data formats and callbacks. Its feasibility is demonstrated with a sample implementation.
- Bringing user experience empirical data to gesture-control and somatic interaction in virtual reality videogames: an exploratory study with a multimodal interaction prototypePublication . Fernandes, Luís; Nunes, Ricardo Rodrigues; Matos, Gonçalo; Azevedo, Diogo; Pedrosa, Daniela; Morgado, Leonel; Paredes, Hugo; Barbosa, Luís; Fonseca, Benjamim; Martins, Paulo; Cardoso, Bernardo; Carvalho, Fausto deWith the emergence of new low-cost gestural interaction devices various studies have been developed on multi-modal human-computer interaction to improve user experience. We present an exploratory study which analysed the user experience with a multimodal interaction game prototype. As a result, we propose a set of preliminary recommendations for combined use of such devices and present implications for advancing the multimodal field in human-computer interaction.
- Primeira armada da Índia: novo conceito de jogo misturando realidades aumentada e virtual, gestos finos e amplosPublication . Morgado, Leonel; Cristóvão, Paulo; Fernandes, Luís; Nunes, Ricardo Rodrigues; Martins, Paulo; Paredes, Hugo; Barbosa, Luís; Cardoso, Bernardo; Carvalho, Fausto deApresentamos um conceito de jogo inovador e o seu protótipo inicial, integrando tipos distintos de interação e de visualização. Dois jogadores interagem como timoneiro de uma nau portuguesa e gigante Adamastor. Um joga em realidade virtual controlada por gestos finos, outro usa aumentação contextual com gestos amplos e fi-nos. Pretende o conceito e o protótipo servirem como exemplificadores das potencialidades das novas formas de interação e de como as concretizar.
- Exploring educational immersive videogames : an empirical study with a 3D multimodal interaction prototypePublication . Fernandes, Luís Miguel Alves; Matos, Gonçalo Cruz; Azevedo, Diogo; Nunes, Ricardo Rodrigues; Paredes, Hugo; Morgado, Leonel; Barbosa, Luís; Martins, Paulo; Fonseca, Benjamim; Cristóvão, Paulo; Carvalho, Fausto de; Cardoso, BernardoGestural interaction devices emerged and originated various studies on multimodal human-computer interaction to improve user experience. However, there is a knowledge gap regarding the use of these devices to enhance learning. We present an exploratory study which analysed the user experience with a multimodal immersive videogame prototype, based on a Portuguese historical/cultural episode. Evaluation tests took place in high school environments and public videogaming events. Two users would be present simultaneously in the same virtual reality environment: one as the helmsman aboard Vasco da Gama’s XV-century Portuguese ship, another as the mythical Adamastor stone giant at the Cape of Good Hope. The helmsman player wore a virtual reality headset to explore the environment, whereas the giant player used body motion to control the giant, and observed results on a screen, with no headset. This allowed a preliminary characterization of user experience, identifying challenges and potential use of these devices in multi-user virtual learning contexts. We also discuss the combined use of such devices, towards future development of similar systems, and its implications on learning improvement through multimodal human-computer interaction.