MIT’s Computer Science and Artificial Intelligence Laboratory<\/a> (MIT CSAIL) continues to make filmmaking<\/strong> headlines \u2014 so much so that we need to roundup all the future industry-changing advances they’ve already made.<\/p>\n Have you ever needed to film a tree blowing in the wind, only to go out and shoot on a day when the air is as still as can be? With\u00a0Interactive Dynamic Video<\/a>\u00a0(IDV) you would be able to move an object after it was filmed<\/strong>. Let that sink in for a minute.<\/p>\n You could shoot the stationary tree, then, in post, you could grab the leaves and shake the tree. That’s a rather insane concept to consider. Much like a motion designer can\u00a0manipulate shape layers<\/strong> however they want, filmmakers could do the same with backgrounds \u2014and potentially actors.<\/strong><\/p>\n A computer algorithm searches the entire video clip for incredibly small vibrations<\/strong> or movements<\/strong> of an object. In the video below, you’ll see how researchers shot a five-second video of a wireframe character. By analyzing the character’s subtle movements, the algorithm creates the Interactive Dynamic Video \u2014 which allows users to push, pull,<\/strong> and interact with an object<\/strong> with the mouse cursor.<\/p>\n The algorithm creates “vibration modes” to determine realistic movements. The algorithm also fills in the blank space in the background when an object changes position. The algorithm works without even knowing the 3D shape of the object.<\/p>\n
\nInstant VFX \u2014 Touch and Move Objects\u00a0in Post<\/h3>\n
![\"MIT's](\"https:\/\/pbblogassets.s3.amazonaws.com\/uploads\/2016\/08\/MIT-Dynamic-Video.gif\" "\\"MIT's")
\n<\/a>GIF\u00a0via MIT \/ Abe Davis<\/em><\/p>\n![\"MIT's](\"https:\/\/pbblogassets.s3.amazonaws.com\/uploads\/2016\/08\/idv.gif\" "\\"MIT's")
\nGIF\u00a0via MIT\/Abe Davis<\/em><\/p>\n