Repository logo
 
Publication

Virtual sign : a real time bidirectional translator of portuguese sign language

2015Journal article Open access
Simple item page
dc.contributor.authorEscudeiro, Paula
dc.contributor.authorEscudeiro, Nuno
dc.contributor.authorReis, Rosa
dc.contributor.authorLopes, Jorge
dc.contributor.authorNorberto, Marcelo
dc.contributor.authorBaltazar, Ana Bela
dc.contributor.authorBarbosa, Maciel
dc.contributor.authorBidarra, José
dc.date.accessioned2015-12-03T14:45:32Z
dc.date.available2015-12-03T14:45:32Z
dc.date.issued2015
dc.description.abstractPromoting equity, equal opportunities to all and social inclusion of people with disabilities is a concern of modern societies at large and a key topic in the agenda of European Higher Education. Despite all the progress, we cannot ignore the fact that the conditions provided by the society for the deaf are still far from being perfect. The communication with deaf by means of written text is not as efficient as it might seem at first. In fact, there is a very deep gap between sign language and spoken/written language. The vocabulary, the sentence construction and the grammatical rules are quite different among these two worlds. These facts bring significant difficulties in reading and understanding the meaning of text for deaf people and, on the other hand, make it quite difficult for people with no hearing disabilities to understand sign language. The deployment of tools to assist the daily communication, in schools, in public services, in museums and other, between deaf people and the rest may be a significant contribution to the social inclusion of the deaf community. The work described in this paper addresses the development of a bidirectional translator between Portuguese Sign Language and Portuguese text. The translator from sign language to text resorts to two devices, namely the Microsoft Kinect and 5DT Sensor Gloves in order to gather data about the motion and shape of the hands. The hands configurations are classified using Support Vector Machines. The classification of the movement and orientation of the hands are achieved through the use of Dynamic Time Warping algorithm. The translator exhibits a precision higher than 90%. In the other direction, the translation of Portuguese text to Portuguese Sign Language is supported by a 3D avatar which interprets the entered text and performs the corresponding animations.pt_PT
dc.identifier.citationEscudeiro, Paula [et al.] - Virtual sign : real time bidirectional translator of portuguese sign language. "Procedia Computer Science" [Em linha]. ISSN 1877-0509. Vol. 67 (2015), p. 252-262pt_PT
dc.identifier.doihttp://dx.doi.org/10.1016/j.procs.2015.09.269pt_PT
dc.identifier.issn1877-0509
dc.identifier.urihttp://hdl.handle.net/10400.2/4695
dc.language.isoengpt_PT
dc.peerreviewedyespt_PT
dc.publisherScienceDirectpt_PT
dc.subjectPortuguese Sign Language (LGP)pt_PT
dc.subjectEducationpt_PT
dc.subjectDeafpt_PT
dc.subjectKinectpt_PT
dc.subjectMachine learningpt_PT
dc.subjectOpen CVpt_PT
dc.subjectSensor glovespt_PT
dc.subjectTranslatorpt_PT
dc.subjectSupport vector machinespt_PT
dc.subjectDynamic time warpingpt_PT
dc.subjectAvatarpt_PT
dc.titleVirtual sign : a real time bidirectional translator of portuguese sign languagept_PT
dc.typejournal article
dspace.entity.typePublication
oaire.citation.endPage262pt_PT
oaire.citation.startPage252pt_PT
oaire.citation.titleProcedia Computer Sciencept_PT
oaire.citation.volume67pt_PT
person.familyNameEscudeiro
person.familyNameBidarra
person.givenNamePaula
person.givenNameJosé
person.identifierM-9115-2013
person.identifier.ciencia-id5F1C-FD71-6F1C
person.identifier.ciencia-id1B13-3753-EC0A
person.identifier.orcid0000-0003-2528-572X
person.identifier.orcid0000-0002-2082-5996
person.identifier.scopus-author-id6505859253
rcaap.rightsopenAccesspt_PT
rcaap.typearticlept_PT
relation.isAuthorOfPublicationc8070a27-e10e-4a90-ad89-64b7ec8df24b
relation.isAuthorOfPublication9eadf6dc-1afb-4c1c-9c3d-2e46e56df529
relation.isAuthorOfPublication.latestForDiscovery9eadf6dc-1afb-4c1c-9c3d-2e46e56df529

Files

Original bundle
Now showing 1 - 1 of 1
Thumbnail Image
Name:
Virtual Sign – A Real Time Bidirectional Translator of Portuguese Sign Language.pdf
Size:
448.92 KB
Format:
Adobe Portable Document Format
Download
License bundle
Now showing 1 - 1 of 1
No Thumbnail Available
Name:
license.txt
Size:
1.97 KB
Format:
Item-specific license agreed upon to submission
Description:
Download

Collections

Ciências e Tecnologia | Artigos em revistas internacionais / Papers in international journals
Ciências da Educação | Artigos em revistas internacionais / Papers in international journals
LE@D - Laboratório de Educação a Distância e Elearning | Artigos em revistas / Papers in journals