We have been developing fully immersive systems, converting video into 3D models. We can also do this with moving movies. The work we have been doing for a very well known brand is all protected by NDA’s, but we will post more information when we get time.
New World Designs have created a full 3D model of the Zoolander set, using the images we took on the rig. This could be imported into any 3D software and manipulated any way you wish, including the background being removed leaving just Ben Stiller and Owen Wilson jumping.
On this example, we converted this test dance shot into 3D to allow the background to be removed.