Author |
Message |
Inventor
Stream Operator
Joined: Oct 13, 2007 Posts: 6221 Location: near Austin, Tx, USA
Audio files: 267
|
Posted: Tue Nov 03, 2009 11:51 am Post subject:
Musical Tai Chi Subject description: Yet another cool project... |
|
|
At the electro-music 2009 festival I was one of two people who shared the laptop battle victory. I saw all of the performances and they were all equally good, so I don't know how the judges chose but anyway what I did was attach a USB three-axis accelerometer board to my hand and make music by waving my hand around.
This was so well received that on the way home I imagineered a really fun thing to do: Musical Tai Chi. I'm going to start working on little circuit boards that create sound when they are moved around, causing an audio response to dance or motion such as Tai Chi. Being very overweight, I think that the light exercise of Tai Chi is just what I need to help me slim down a bit, plus I'd like to get familiar enough with it that I can hold Musical Tai Chi classes at festivals like EM10 and so on.
For now, I will just work with my existing tethered computer set up, but what I imagineered is a small, low-cost hand-mounted board that creates audio in response to Tai Chi motions and then broadcasts it on the AM radio band. Then people could put a board on each hand and an AM radio would pick up everyone's signal and send it to the PA system. As we all do Tai Chi, there would result a chorus of tones to the venue, which would be a lot of fun. Some additional details I've thought about are as follows:
o The audio provides feedback of correct Tai Chi motion so that if you don't move properly you can hear it.
o The boards are battery powered with on/off switch and LED indicator.
o Cost should be around $25 or so to enable most folks to go home with one or two of them.
o Use a 3-axis accelerometer chip from Analog Devices that outputs three analog voltages for X, Y, and Z.
o Provide for left/right panning in response to motion.
o Provide for frequency shifting in response to motion.
o Maybe do echo/reverb as well.
o Keep the board very simple and small.
o If you don't move smoothly and fluidly, you can hear it easily. This includes warbling if your hand shakes and tonal shift if you move unevenly.
o Other stuff I can't remember at the moment.
I'm open to all variety of suggestions and design ideas, so please feel free to put your thinking cap on for this one, thanks.
Les _________________ "Let's make noise for peace." - Kijjaz |
|
Back to top
|
|
|
wmonk
Joined: Sep 15, 2008 Posts: 528 Location: Enschede, the Netherlands
Audio files: 15
|
Posted: Tue Nov 03, 2009 12:22 pm Post subject:
|
|
|
Perhaps bluetooth is a nice idea to connect to a computer, so it'll send OSC messages, and you can hook up different things? |
|
Back to top
|
|
|
Inventor
Stream Operator
Joined: Oct 13, 2007 Posts: 6221 Location: near Austin, Tx, USA
Audio files: 267
|
Posted: Tue Nov 03, 2009 1:17 pm Post subject:
|
|
|
Yes for sure bluetooth is a good thing here. I plan to cut the wires with a bluetooth networking product sometime, but it requires battery usb power and an adapter from mini usb to usb or somesuch arrangement. I'll work with the cabled board for now and prototype the idea by expanding the laptop battle program in such a way that it models an easily implementable circuit. Then later come other solutions.
Les _________________ "Let's make noise for peace." - Kijjaz |
|
Back to top
|
|
|
electri-fire
Joined: Jul 26, 2006 Posts: 536 Location: Dordrecht NL
Audio files: 4
G2 patch files: 4
|
Posted: Tue Nov 10, 2009 12:59 pm Post subject:
|
|
|
I'm astounded by your productivity Les. Of cause Tai Chi would not be the only field where this would come in handy.
These would be gestural musical instruments in their own right. Or indeed controllers as Wmonk suggested. Adapted Wii or Nunchuck controllers through an Arduinoboard have a sluggish response. An XYZ sensor especially dedicated to soundcontrol might improve this. Great idea!
. |
|
Back to top
|
|
|
electri-fire
Joined: Jul 26, 2006 Posts: 536 Location: Dordrecht NL
Audio files: 4
G2 patch files: 4
|
Posted: Tue Nov 10, 2009 1:14 pm Post subject:
Re: Musical Tai Chi Subject description: Yet another cool project... |
|
|
Inventor wrote: | Cost should be around $25 or so to enable most folks to go home with one or two of them... |
I bought a Nunchuck for 19,50 euros, so yours could be a steal for $25. I'd be amazed if you could add echo/reverb for that price, that doesn't sound that simple to me.
Most simple AM radio's are mono. As a "cheap and cheerful" portable musical instrument I'd skip the panning.
For theremin like use volume would be indispensible. Pitch is, obviously. Then you could have the remaining parameter dedicated to timbre, like with a filter or waveshaper of sorts. |
|
Back to top
|
|
|
electri-fire
Joined: Jul 26, 2006 Posts: 536 Location: Dordrecht NL
Audio files: 4
G2 patch files: 4
|
Posted: Tue Nov 10, 2009 1:28 pm Post subject:
|
|
|
There's been talk on doing installations next EM meeting.
Mind overflows with possible uses now. Have a couple of them dangling in a door opening like these insect barrier curtains if you know what I mean. Put them in a ball to play throw and catch. Etc. etc. etc.... Fun! |
|
Back to top
|
|
|
Inventor
Stream Operator
Joined: Oct 13, 2007 Posts: 6221 Location: near Austin, Tx, USA
Audio files: 267
|
Posted: Tue Nov 10, 2009 3:37 pm Post subject:
|
|
|
Yes Mathe, the possibilites really do seem endless. I think you're right about not adding reverb and stuff. Perhaps all that is needed is an oscillator who's frequency is a function of the acceleration value. If you move your hand quickly, the frequency jumps up. If your hand is shaky, the frequency warbles. So you try to have smooth, slow, fluid motions which are the goal in Tai Chi.
The trouble is, the device reports X, Y, and Z as analog voltages so they must be squared, summed, and square rooted to get an acceleration vector. This is too much for a simple little board.
Perhaps the answer is to have three separate oscillators, one for each axis, all running at say 1MHz which is the middle of the AM band.
Any thoughts on this?
Les _________________ "Let's make noise for peace." - Kijjaz |
|
Back to top
|
|
|
electri-fire
Joined: Jul 26, 2006 Posts: 536 Location: Dordrecht NL
Audio files: 4
G2 patch files: 4
|
Posted: Tue Nov 10, 2009 5:33 pm Post subject:
|
|
|
Inventor wrote: | If you move your hand quickly, the frequency jumps up. If your hand is shaky, the frequency warbles. So you try to have smooth, slow, fluid motions which are the goal in Tai Chi. |
Yeah, to keep a note going you would have to keep moving. That's one way of playing it , but a button to engage a sample and hold to hold your gestured note would come in handy for musical use i would imagine.
With a theremin hand position would determine the outcome, not acceleration. So with the acceleration sensor you'd want to convert to speed, then multiply speed by time to know where you are. This is a totally other implementation of your idea I realise, and at this point my nunchuck controller project came to a halt. would this be possible? Maybe you already mentioned this, I'm not sure.
I suck at mathematics, I got this wierd thing, as a reflex,my mind goes blank when calculations pop up. |
|
Back to top
|
|
|
Inventor
Stream Operator
Joined: Oct 13, 2007 Posts: 6221 Location: near Austin, Tx, USA
Audio files: 267
|
Posted: Tue Nov 10, 2009 5:43 pm Post subject:
|
|
|
Mathe, I have looked into doing this and it's really tough to do. You see, to track position by integrating the X, Y, and Z axes you would have to hold the device perfectly level and not rotate it. Also the thing is constantly measuring gravity as well as G forces, so that's another factor.
To properly track motion you need a 6-axis sensor that reports the pitch, roll, and yaw angles as well as the X, Y, and Z values. Then you have to do the same math that's required to dock the Space Shuttle! I looked up the math in the past, I forget what it's called - Euler equations IIRC - and it's tough!
What we need to look into is some simple, elegant solution that would be really small and cheap. Also the part is miniature so it will be necessary to have the boards assembled by the board house, so we might as well make it all surface mount parts.
Les _________________ "Let's make noise for peace." - Kijjaz |
|
Back to top
|
|
|
electri-fire
Joined: Jul 26, 2006 Posts: 536 Location: Dordrecht NL
Audio files: 4
G2 patch files: 4
|
Posted: Tue Nov 10, 2009 5:49 pm Post subject:
|
|
|
Too bad position calculation isn't feasable. I couldn't do it on Arduino, but that may be because I'm not smart enough.
Inventor wrote: | Perhaps the answer is to have three separate oscillators, one for each axis, all running at say 1MHz which is the middle of the AM band. |
On the fly answer, but wouldn't you just need One 1MHz as a carier, then have the sound frequency you want as volume fluctuations?
Would using it in a group need very precise (identical) 1MHz oscillators, or have each participant use his/her own radio, or someone might not be optimally recieved?
Would FM be simpler to implement? |
|
Back to top
|
|
|
Symatic Star
Joined: Apr 12, 2010 Posts: 138 Location: Australia
Audio files: 8
|
Posted: Mon Apr 19, 2010 9:11 am Post subject:
|
|
|
Ok Inventor, You have me very excited about these devices, I am a professional juggler/performer, I do shows, perform on stilts.... ( as well as musician... ) My mind boggles with possibillities.I also have a venture with a creative partner who is a Chi Gong teacher/martial artist. I perform mainly solo at many festivals each year, I am sure we can help each other some way with this.
1. would there be any restrictions on speed of movement?
2. lets put them not only on the hands but lots of other body parts also.
3. they would become part of a costume
4. ooh lets put versions of them in the props I juggle
5. how do they relate to each other when at different distances?
Could be a beautiful cacophony (plenty of possiblities for comedic application also)
Aah I could go on... |
|
Back to top
|
|
|
Inventor
Stream Operator
Joined: Oct 13, 2007 Posts: 6221 Location: near Austin, Tx, USA
Audio files: 267
|
Posted: Mon Apr 19, 2010 9:17 am Post subject:
|
|
|
Captain Quirk wrote: |
1. would there be any restrictions on speed of movement?
2. lets put them not only on the hands but lots of other body parts also.
3. they would become part of a costume
4. ooh lets put versions of them in the props I juggle
5. how do they relate to each other when at different distances?
|
Thanks Cap for your thoughtful reply. Here are your answers:
1. The sensors max out at +/- 3G of acceleration.
2. Yes, can do
3. Yes, that is done with these types of things.
4. They are wired, but there is a wireless alternative.
5. They report acceleration, independently.
Hope that helps.
Les _________________ "Let's make noise for peace." - Kijjaz |
|
Back to top
|
|
|
Symatic Star
Joined: Apr 12, 2010 Posts: 138 Location: Australia
Audio files: 8
|
Posted: Mon Apr 19, 2010 9:30 am Post subject:
|
|
|
5. They report acceleration, independently.
Can some sort of modulation also be added when they change distance to each other? Maybe it kicks in when they are at a certain distance from each other? |
|
Back to top
|
|
|
Inventor
Stream Operator
Joined: Oct 13, 2007 Posts: 6221 Location: near Austin, Tx, USA
Audio files: 267
|
Posted: Mon Apr 19, 2010 9:36 am Post subject:
|
|
|
Cap, to do position tracking with these things, you need a 6-axis sensor and something called "Euler Equations", which is basically the math they use to dock the space shuttle. So yeah, can be done. There are other technologies if you have the means to apply them.
Les _________________ "Let's make noise for peace." - Kijjaz |
|
Back to top
|
|
|
electri-fire
Joined: Jul 26, 2006 Posts: 536 Location: Dordrecht NL
Audio files: 4
G2 patch files: 4
|
Posted: Mon Apr 19, 2010 1:00 pm Post subject:
|
|
|
Inventor wrote: | To do position tracking with these things, you need a 6-axis sensor and something called "Euler Equations", which is basically the math they use to dock the space shuttle. So yeah, can be done. There are other technologies if you have the means to apply them. |
"Can be done." " If you have the means to apply them."
Translation: "Only Nasa , Pentagoon or Criminal Intelligence Agency can afford this technology." Or so it seemed only just half a year ago. Now this prebuilt airmouse: http://www.engadget.com/2007/07/12/logitechs-mx-air-mouse-a-witches-brew-of-lasers-mems-and-rf/ ships in the US and Europe for $150 sometime in August.
Your easiest option is to wait till then and buy it to try out.
Unless you're whizz and can develope your own from scratch, peripheral electronics, wireless contact to the processor, write drivers maybe, convert the inputs to OSC or MIDI, route this to your sound generator software of choice, etc. etc. etc.
Captain Quirk wrote: |
1. would there be any restrictions on speed of movement? |
Besides the 3G limit there's another bottleneck, that is "polling rate" of the sensor, baudrate / data transmission speed and processing speed.
Intuitively I'd expect it to be too low for incorporation in a juggling object. The Space Shuttle wasn't being smacked into a Space Station with the speed you'd hurl some object into the air. I see potential for hand(held) gestures. But I see juggler's (erm..) 'Clubs" ? tumbling, and I guess ball are not having a straight movement up, but also a spin. Greatly complicating data processing. Then, a juggler would juggle three objects at least to be taken serious? Computers would expect just one of these Air Mouse things to be used, so you'd need some merging or multiplexing utility (wich is bound to be written by someone within half a year after those AirMice are available).
Don't let my obvious sceptisism put you off though, I'm as eager to see these kind of things working as you are. |
|
Back to top
|
|
|
airlock
Joined: Apr 06, 2007 Posts: 296 Location: Calabash, NC USA
Audio files: 52
|
Posted: Mon Apr 19, 2010 1:50 pm Post subject:
|
|
|
electri-fire wrote: | I'm astounded by your productivity Les. Of cause Tai Chi would not be the only field where this would come in handy.
. |
<snip>
Exactly!
Les, if you get these working and wireless I'll take two and see what use they might have at work, where we use things like the Wii in the brain injury rehab unit. Great stuff, Les!
EDIT to add: Wow! |
|
Back to top
|
|
|
Inventor
Stream Operator
Joined: Oct 13, 2007 Posts: 6221 Location: near Austin, Tx, USA
Audio files: 267
|
Posted: Mon Apr 19, 2010 3:22 pm Post subject:
|
|
|
Thanks guys, I haven't messed with this much since em09 but they are cool. The wireless solution is to use the hand control remote from a Wii machine. But an airmouse solution is good too.
Les _________________ "Let's make noise for peace." - Kijjaz |
|
Back to top
|
|
|
Roland Kuit
Joined: Sep 29, 2003 Posts: 1090 Location: The Netherlands/Sweden
Audio files: 8
G2 patch files: 127
|
Posted: Mon Apr 19, 2010 3:36 pm Post subject:
|
|
|
hi les,
interesting. i used the i-cube a number of times in performances with light sensors but i did not like all those wires. so bluetooth is an interesting option. also, you can use 2 camera to midi(max/dsp).
howard captured this vid in london of me during a performance:
http://electro-music.com/avis/roland_kuit-1.avi
it is not taj chi, but it will give you an idea:) |
|
Back to top
|
|
|
Inventor
Stream Operator
Joined: Oct 13, 2007 Posts: 6221 Location: near Austin, Tx, USA
Audio files: 267
|
Posted: Mon Apr 19, 2010 3:54 pm Post subject:
|
|
|
Hi roland, that was a wild performance! Yes, these devices have great potential and will only get more prevalent.
Les _________________ "Let's make noise for peace." - Kijjaz |
|
Back to top
|
|
|
Inventor
Stream Operator
Joined: Oct 13, 2007 Posts: 6221 Location: near Austin, Tx, USA
Audio files: 267
|
|
Back to top
|
|
|
Inventor
Stream Operator
Joined: Oct 13, 2007 Posts: 6221 Location: near Austin, Tx, USA
Audio files: 267
|
|
Back to top
|
|
|
Inventor
Stream Operator
Joined: Oct 13, 2007 Posts: 6221 Location: near Austin, Tx, USA
Audio files: 267
|
Posted: Thu Apr 22, 2010 9:51 pm Post subject:
|
|
|
I came up with something more interesting for this program and I'm going to play it on the radio station's anniversary show this saturday. So tune in for a listen.
Les _________________ "Let's make noise for peace." - Kijjaz |
|
Back to top
|
|
|
wmonk
Joined: Sep 15, 2008 Posts: 528 Location: Enschede, the Netherlands
Audio files: 15
|
Posted: Fri Apr 23, 2010 4:39 pm Post subject:
|
|
|
Now I think of it... a smartphone is ideal for this (iPhone, Android). They have bluetooth, x- y and z axis sensors, compass and a touch screen. When sending OSC signals with bluetooth to chuck, you have a great performance instrument! _________________ Weblog! |
|
Back to top
|
|
|
|