sonic-sight

Game

Here is an example of a game using the described engine to render the depth in the scene to sounds. Unfortunately the game is still a bit buggy. Due to the limitations that running it in a browser introduce, it runs single threaded and with some delay in sounds. If the game starts to become unresponsive, reload the page and restart.

It should be usable enough to show interactive rendering of 3D world to sound.

Controls in the game are: wasd for moving forward, left back, right, left and right arrow keys for turning on the spot and space to trigger the rendering of depth to sound.

In the game you play a human adult with the dpth camera on his chest, with the main camera showing what the human sees through his eyes (that is why the depth and sound might seem offset a bit).