Repository logo
 
Publication

Real time bidirectional translator of Portuguese sign language

2015Conference object Open access
Simple item page
dc.contributor.authorEscudeiro, Paula
dc.contributor.authorEscudeiro, Nuno
dc.contributor.authorReis, Rosa
dc.contributor.authorRodrigues, Pedro
dc.contributor.authorLopes, Jorge
dc.contributor.authorNorberto, Marcelo
dc.contributor.authorBaltasar, Ana Bela
dc.contributor.authorBarbosa, Maciel
dc.contributor.authorBidarra, José
dc.date.accessioned2023-07-25T09:15:22Z
dc.date.available2023-07-25T09:15:22Z
dc.date.issued2015
dc.description.abstractThe communication with deaf by means of written text is not as efficient as it might seem at first. In fact, there is a very deep gap between sign language and spoken/written language. The vocabulary, the sentence construction and the grammatical rules are quite different among these two worlds. These facts bring significant difficulties in reading and understanding the meaning of text for deaf people and, on the other hand, make it quite difficult for people with no hearing disabilities to understand sign language. The deployment of tools to assist the daily communication, in schools, in public services, in museums and other, between deaf people and the rest may be a significant contribution to the social inclusion of the deaf community. The work described in this paper addresses the development of a bidirectional translator between Portuguese Sign Language and Portuguese text and a serious game to promote the learning of the Portuguese Sign Language. The translator from sign language to text resorts to two devices, namely the Microsoft Kinect and 5DT Sensor Gloves in order to gather data about the motion and shape of the hands. The hands configurations are classified using Support Vector Machines. The classification of the movement and orientation of the hands is achieved through the use of Dynamic Time Warping algorithm. The translator exhibits a precision higher than 90%. In the other direction, the translation of Portuguese text to Portuguese Sign Language is supported by a 3D avatar which interprets the entered text and performs the corresponding animations. As a complement, we also present a serious game directed to assist in the difficult task of learning the Portuguese Sign Language.pt_PT
dc.description.sponsorshipThis work was supported by the ISEP (Instituto Superior de Engenharia do Porto) and GILT (Games, Interaction and Learning Technologies) under Grant Nos. 60973089. FCT (Fundação para a ciência e Tecnologia) project.pt_PT
dc.description.versioninfo:eu-repo/semantics/publishedVersionpt_PT
dc.identifier.citationEscudeiro, P., Escudeiro, N., Reis, R., Rodrigues, P., Lopes, J., Norberto, M., Baltasar, A. B., Barbosa, M., & Bidarra, J. (2015). Real Time Bidirectional Translator of Portuguese Sign Language. Comunicação publicada nas atas da WEBIST 2015 - 11th International Conference on Web Information Systems and Technologies, Lisboa, 20-22 de maio, pp. 203-213.pt_PT
dc.identifier.urihttp://hdl.handle.net/10400.2/14617
dc.language.isoengpt_PT
dc.peerreviewedyespt_PT
dc.publisherWEBISTpt_PT
dc.relation.publisherversionhttp://dx.doi.org/10.5220/0005448502030213pt_PT
dc.rights.urihttp://creativecommons.org/licenses/by-nc-nd/4.0/pt_PT
dc.subjectPortuguese sign languagept_PT
dc.subjectEducationpt_PT
dc.subjectDeafpt_PT
dc.subjectKinectpt_PT
dc.subjectSensor glovespt_PT
dc.subjectTranslatorpt_PT
dc.subjectMachine learningpt_PT
dc.subjectOpenCvpt_PT
dc.subjectSupport vector machinespt_PT
dc.subjectDynamic time warpingpt_PT
dc.subjectAvatarpt_PT
dc.subjectSerious gamespt_PT
dc.titleReal time bidirectional translator of Portuguese sign languagept_PT
dc.typeconference object
dspace.entity.typePublication
oaire.citation.conferencePlaceLisboapt_PT
oaire.citation.titleWEBIST 2015. 11th International Conference on Web Information Systems and Technologiespt_PT
person.familyNameEscudeiro
person.familyNameBidarra
person.givenNamePaula
person.givenNameJosé
person.identifierM-9115-2013
person.identifier.ciencia-id5F1C-FD71-6F1C
person.identifier.ciencia-id1B13-3753-EC0A
person.identifier.orcid0000-0003-2528-572X
person.identifier.orcid0000-0002-2082-5996
person.identifier.scopus-author-id6505859253
rcaap.rightsopenAccesspt_PT
rcaap.typeconferenceObjectpt_PT
relation.isAuthorOfPublicationc8070a27-e10e-4a90-ad89-64b7ec8df24b
relation.isAuthorOfPublication9eadf6dc-1afb-4c1c-9c3d-2e46e56df529
relation.isAuthorOfPublication.latestForDiscovery9eadf6dc-1afb-4c1c-9c3d-2e46e56df529

Files

Original bundle
Now showing 1 - 1 of 1
Thumbnail Image
Name:
WEBIST_2015.pdf
Size:
625.19 KB
Format:
Adobe Portable Document Format
Download
License bundle
Now showing 1 - 1 of 1
No Thumbnail Available
Name:
license.txt
Size:
1.97 KB
Format:
Item-specific license agreed upon to submission
Description:
Download

Collections

Ciências da Educação | Comunicações em congressos, conferências, seminários/Communications in congresses, conferences, seminars