Hi,
I've been working on this for some time, grabbing codes here and there and doing my own (I'm not a programmer), finally worked really nice, I added this to an art exhibition and people without experience made it through to control the panos just with body movements.
Gestures worked are:

• hands to rotate,
  
• walk forward/backward to zoom in/out,
  
• a right punch gesture to click on the center of the screen, but as panos switched over time

Todo list:

• left hand moves the pano (dragg mouse) right hand moves mouse
• left hand punch for left click
• right hand punch for right click
• GUI!! with gestures, options and so
  

Here the exhibition video and some prior test on 360cities panos:

http://www.youtube.com/watch?v=4eGK3ngm0aw

http://www.youtube.com/watch?v=XHTFeNvczkM


Code needs some documenting and cleaning, then I will release it, still have to look where and how (advice accepted here)
I'll let you know here when I do it.

Cheers!