Du willst Design studieren?Bewerbungsschluss zum Sommersemester 2023 ist der 15. November!
Inhalt des Kurses
Invention Design 2
In dem Kurs Invention Design suchen Studierende Anwendungsmöglichkeiten für neue Technologien. Bilderkennung, Machine-Learning, 3D-Audio, LIDAR: Ihren Nutzen entfalten technische Möglichkeiten durch ihren sinnvollen Einsatz.
In this subject, the task was to select an already existing and working technology and develop something useful and possibly solve a problem with it.
Finding a technology
We decided to focus on the technology Motion tracking. We think motion tracking is a future-oriented technology that has potential to solve problems that could arise in the future or even just now. With motion tracking, you can track the movement of an object and facial expressions and then apply the tracking data for that movement to another object to create compositions in which images and effects follow the motion.
Field of application
Our user group is deaf or hard of hearing people, or more specifically people who use ASL as their main language. Through different kinds of research and interviews with those involved we found out that there is a large problem area in the field of education in school and job application but also in communication such as making doctor visits/appointments, as well as the communication between different offices through emailing or calling. Because what many people do not know is that the american sign language has a different grammatical sentence structure than the written form. Which makes writing and spelling difficult for deaf people.
Developing an iPad plug-in for deaf people to make interabled online communication easier in any type of way with using the motion and face tracking technology.
online communicate with hearing people (translator)
write emails and texts with correct written grammar (education)
The plug-in should be used to communicate online with other people and especially not asl speaking people. But also to write business emails for e.g. job applications or to write texts for school or university. In short, our plug-in should always help where a grammatically and spellingly correct text should be written. So deaf people would no longer be dependent on an interpreter. With the plug-in the users are much more flexible concerning the time of use. Furthermore you can write what you want without a third person having to know about it. So, it just makes the user much more independent.
With motion tracking the signs of the user are detected.
With the AI the signed words are translated into correct written English.
An animation shows the user what the other person has written.
With special gestures you can delete a word or jump to the next line.
You can also set whether the AI should translate the signs into formal written language or into a daily used language.