Although I never tried it, I think you could open a video player SWF as a hotspot in order to tie it to a position in the panorama. Why don't you give it a try and then post how it went?
Look at image hotspots here:
http://krpano.com/docu/xml/#hotspot