Show and Tell: Hand Gestures with Leap Motion

[the_dovid]

Hey, friends.

I've been wondering for a while if it was possible to use the Leap Motion Controller to trigger keyboard triggered hand gestures.  So I found a cheap one on ebay and whipped up this little experiment:

This uses a third-party app called gamewave that allows for highly customized mapping of gestures to actions.  For this test, all i did was set it to detect when each hand was moving upward and simulate a keyboard press, whcih then triggered a simple forward/reverse layer cycle.

With more experimentation, I think a lot more is possible.

[oksamurai]

Wow - awesome! What a great idea. Didn't you ask me about this like a few days ago...and now you already have something up and running? Really impressive.

[the_dovid]

Yeah, after you and I shmoozed about it I couldn't get it out of my head.  This is obviously not the most elegant implementation, just a proof of concept.

The next thing rattling around in my head is using a Makey Makey hooked up to various props to trigger actions in Ch.  That's kind of an unnecessarily elaborate alternative to just putting stickers on your keyboard,  but it might be useful for live broadcasts with actors who aren't used to Ch and keyboard triggers.

[oksamurai]

Oh wow - that would be cool too - keep us posted!

[El Wombat]

Bravo!! Had to look twice at your demo this is really a push forward! Thank you for sharing this! Keep up the good work!

[GangchenPeaceArt]

Wow wow super good...please go on

[KizKat]

This is very cool. Did you ever do more experiments with this? Super interested in this for live streaming.

[oksamurai]

We have full body tracking now: https://youtu.be/gWBLAcTWH5Q