Huawei's Facing Emotions app uses sound to allow the visually impaired to see emotions
Chinese tech giant Huawei has developed an app that uses artificial intelligence to allow the visually impaired to "see" the emotion on the face of someone they are talking to by translating it into sound.
Called Facing Emotions, the app, developed with the Polish Blind Association, uses the rear camera of Huawei's Mate 20 Pro phone to read the emotion on the face of whoever the blind user is talking to, by analysing their expression using artificial intelligence (AI).
An offline machine-learning algorithm integrated into the phone identifies the main facial features of the interlocutor, including eyebrows, eyes, nose and mouth. It can then determine the positions in relation to each other and identify the particular emotion.
The app translates these seven universal human emotions – anger, fear, disgust, happiness, sadness, surprise and contempt – into seven distinct sounds. The detected emotion is played through the phone's microphone.
The sounds corresponding to each emotion were created by blind composer Tomasz Bilecki. "The sounds I wanted to create needed to be specific for each emotion, and not distract users from their conversations," said Bilecki.
The team aimed to make each sound short, concise and simple, in the hope that they won't feel invasive in a conversation between two people, as well as being recognisable and easy to recall. The app was tested by blind users and their insights were incorporated into the de...
-------------------------------- |
CARGOS Y FUNCIONES DE LOS PROFESIONALES EN UN PROYECTO. Tutoriales de arquitectura. |
|
Downside-up: Treviso Apartment Defies Gravity with Concrete Soffit
04-05-2024 09:20 - (
Architecture )
Prague 1 Flat: Petr Jan?álek’s Renovation of Historic Apartment
04-05-2024 09:20 - (
Architecture )