I am working on a game in which I want to use my cello as an input device. I play cello to generate and control the game world, and the audience uses Xbox controllers to play with/against me.
Now it is easy enough to read microphone input from my cello to my game, but what I really want to know is which notes I play and when notes start and end.
So here's the question: are there any libraries that can do real-time waveform analysis and tell me what notes are being played? Either in the form of a VST (FMOD can use VSTs, as far as I know), or as a separate library that I can call from C++. So far I have not found something suitable, while I know this should technically be possible: Rocksmith and guitar synths must use the same kind of technology.
Bonus features (not necessary, but would be nice to have):
-volume envelope within the note
-how much vibrato there is
-able to recognise very fast notes
-can recognise two-note chords (cello cannot do more than two notes at a time)
So, does anyone have any suggestions for libraries that can do this, or an approach for this?
Thanks in advance!
Realtime musical tone analysis library
My dev blog
Ronimo Games (my game dev company)
Awesomenauts (2D MOBA for Steam/PS4/PS3/360)
Swords & Soldiers (2D RTS for Wii/PS3/Steam/mobile)
Swords & Soldiers 2 (WiiU)
Proun (abstract racing game for PC/iOS/3DS)
Cello Fortress (live performance game controlled by cello)
This topic is closed to new replies.
Advertisement
Popular Topics
Advertisement
Recommended Tutorials
Advertisement