spatial vocabulary App
Kunsthochschule Weißensee
2023
The Unity scene is set up with a place indicator that lets the user place objects on surfaces, and a UI canvas with buttons con- nected to virtual sound objects. When the user pushes one of the buttons, a matching sound object appears on top of the placement indicator. The sound objects come with a matching audio source that uses spatial audio to create a 3D sound. Once the audio has been placed on a surface, it can be triggered and played by the person approaching within one meter of the object's position.
First, an earcon appears and signals that the person is in the vicinity of a spatial vocabulary → then the word is said in the language the person understands → the person has a few seconds to find the translation → a sound gives feed- back on whether the word was said correctly or not → the word is said by the app in the foreign language with an ex- ample sentence.
