Software created in AM turns sign language into sounds – Globo.com

Sensors installed on the forearms that allow transforming gestures on voice and transmit them by a cell. The invention, called the project “Giullia – the hand that says,” was launched on Monday (18) by the Amazonas State University (UEA). According to the creator of the project, a worldwide manufacturer of mobile phones has already shown interest in the project. The program aims to facilitate communication of people with disabilities

For the researcher and creator of “Giullia,” Manuel Cardoso, the disabled will be able to improve their competitiveness in the market. Cardoso says the research is done for over a year by the Robotics Center team and Automotive UEA.

“These sensors pick up the signals from the arm muscles of the hand and fingers and transmit via bluetooth to the mobile. On mobile, we embarked on a technology based on artificial intelligence, called artificial neural networks, which are mathematical models that assimilate the functionality, for example, of biological neurons, so that we can teach the program recognize patterns of signals coming from. If a hearing impaired is looked at you and understands what you say, it will gesturing response and the cell will translate what he said in sign language. The hand starts to generate a voice that is not issued by the vocal cords, hence the name: the hand that speaks, “said Cardoso

According to the researcher, on Tuesday (19) a commission that participated in the survey will leave for the United States to. a meeting with US expert in order to raise funds for the development of new research.

The creator of the project said that patent license the “Giullia” is negotiated with a world cell phone maker . “There are people with this disability worldwide and we expect [to the negotiations] is to support the continuity of research from financial gain,” he said.

‘Giullia “
According to Cardoso, the project name is a tribute to a young man who had their brain activity harmed because of an acquired bacteria still in the maternity ward. She was one of the beneficiaries of the project “Mouse Eye”, which allows people with motor disabilities to navigate the Internet and write text on the computer using sensors connected to eye movement

Giullia -. Who also had hearing impairment – He entered the project “Mouse Eye” to seven years. She died last year, aged 15. “Giullia was an inspiration. I often say that she left, but will stay with us forever,” assures Cardoso.