{"id":1169,"date":"2010-05-20T23:56:32","date_gmt":"2010-05-20T21:56:32","guid":{"rendered":"http:\/\/web.ist.utl.pt\/~Pedro.Lopes\/blog\/?p=1169"},"modified":"2010-05-20T23:56:32","modified_gmt":"2010-05-20T21:56:32","slug":"recognizing-gestures-by-the-sound-they-make-dtw-and-puredata","status":"publish","type":"post","link":"https:\/\/plopesmusic.org\/?p=1169","title":{"rendered":"Recognizing gestures by the sound they make (DTW and Puredata)"},"content":{"rendered":"

This prototype follows the idea of [1] where Harrison uses a microphone to record and recognize a set of defined gestures. In this implementation we follow the same approach by using the Dynamic Time Warp algorithm[2,3] but propose it under a different setting: the PureData programming environment[4].<\/span><\/p>\n

This research for IMMI course at IST will result in a small decoupled system that is able to recognize a set of gestures and send the resulting gesture in a OSC formatted message, to be received in any connected system via network (either locally of remotely) \u2013 thus achieving modularity. For our experiments will be using it to recognized gestures performed by a DJ with his foot to control a DJ setup, can be used for many more applications (such as proposed by Harrison in[1]).<\/span><\/p>\n

Currently there is no implementation of the DTW algorithm for usage in PureData environment, although it has been proposed by Todoroff and Bettens [5] but still not ported to PureData, our implementation is based on on Andrew Slater and John Coleman’s DTW[6] but ported to PureData with several needed modifications. The DTW object is still in alpha phase but it is already working and available for public usage here[7], the official release will be published later once the API is fully defined.<\/span><\/span><\/p>\n