Loading...
4 results
Search Results
Now showing 1 - 4 of 4
- Separating gesture detection and application control concerns with a multimodal architecturePublication . Morgado, Leonel; Cardoso, Bernardo; Carvalho, Fausto de; Fernandes, Luís; Paredes, Hugo; Barbosa, Luís; Fonseca, Benjamim; Martins, Paulo; Nunes, Ricardo RodriguesGesture-controlled applications typically are tied to specific gestures, and also tied to specific recognition methods and specific gesture-detection devices. We propose a concernseparation architecture, which mediates the following concerns: gesture acquisition; gesture recognition; and gestural control. It enables application developers to respond to gesture-independent commands, recognized using plug-in gesture-recognition modules that process gesture data via both device-dependent and deviceindependent data formats and callbacks. Its feasibility is demonstrated with a sample implementation.
- Bringing user experience empirical data to gesture-control and somatic interaction in virtual reality videogames: an exploratory study with a multimodal interaction prototypePublication . Fernandes, Luís; Nunes, Ricardo Rodrigues; Matos, Gonçalo; Azevedo, Diogo; Pedrosa, Daniela; Morgado, Leonel; Paredes, Hugo; Barbosa, Luís; Fonseca, Benjamim; Martins, Paulo; Cardoso, Bernardo; Carvalho, Fausto deWith the emergence of new low-cost gestural interaction devices various studies have been developed on multi-modal human-computer interaction to improve user experience. We present an exploratory study which analysed the user experience with a multimodal interaction game prototype. As a result, we propose a set of preliminary recommendations for combined use of such devices and present implications for advancing the multimodal field in human-computer interaction.
- Primeira armada da Índia: novo conceito de jogo misturando realidades aumentada e virtual, gestos finos e amplosPublication . Morgado, Leonel; Cristóvão, Paulo; Fernandes, Luís; Nunes, Ricardo Rodrigues; Martins, Paulo; Paredes, Hugo; Barbosa, Luís; Cardoso, Bernardo; Carvalho, Fausto deApresentamos um conceito de jogo inovador e o seu protótipo inicial, integrando tipos distintos de interação e de visualização. Dois jogadores interagem como timoneiro de uma nau portuguesa e gigante Adamastor. Um joga em realidade virtual controlada por gestos finos, outro usa aumentação contextual com gestos amplos e fi-nos. Pretende o conceito e o protótipo servirem como exemplificadores das potencialidades das novas formas de interação e de como as concretizar.
- Immersive learning experiences for understanding complex systemsPublication . Fernandes, Luís; Morgado, Leonel; Paredes, Hugo; Coelho, António; Richter, JonathonComplexity is core part of our lives. Aware or not, people need to understand and communicate complex ideas and perspectives. Understanding and communicating complexity can be facilitated through interactive simulations. Doing so in the physical world is often impractical, however. Users and developers are overloaded with information and ambiguity, costs are prohibitive, and unsupervised physical simulations raise safety concerns. Novel immersive technology might hold the key to transforming how we tackle understanding and communicating complexity. In this position paper, we propose empowering user agency and perception to take part in complex learning experiences and create their own, combining two factors: enhanced visual and spatial context provided by location-awareness, immersive environments, and somatic, embodied agency; and enhanced cultural and social context by leveraging as input methods the rich semantics of cultural-social gestures and rituals. To deem the feasibility of this argument, we propose developing two culture-aware prototypes, one for the Confederated Salish and Kootenai Tribes in Montana, United States, and another for a Western Europe cultural context.