Connexion

Connexion is an audiovisual music performance for VR. The performer uses 3D interface to control the granular synthesis and spatial positioning of sounds within the auditorium. The visual representation gives the performer clues about the characteristics of sound, also being an indicator of the spatial propagation of sound. This gives the performer an actual feeling of performing with their gestures and movements as one has with the material instruments. The form of the interface itself is digital artwork. 

Connexion was created using Unreal Engine 4. It employs granular synthesis as the modulator of the pre-composed music. The performer moves the sounds with his hands (which are the emitters of sounds) around the round object, which is called a „monad”. The movement makes the sound flow around the soundfield. The position of hands also changes the parameters of the synthesis – sound emission time and granularity. This gives control over dramatic aspects of music piece.

Operating system: Windows 10 64-bit, Windows 11 64-bit

Supported headsets: HTC Vive, HTC Vive Pro, Oculus Quest via cable link, Valve Index

Room size requirements : minimal required is 2 meters by 2 meters

Shortcuts:

SPACE - start the experience

R - restart experience

P - pause

C - re-center

ESC - exit the application