Sorry but i don't see the profit of what you describe.
Of course for video you don't need to switch the scene to switch the video, but i work like that.
I prefer to have for every 360 video or pano a scene. The rest i keep dynamic which makes it very clear and manageable.
Tuur