{"id":176662,"date":"2022-11-16T06:00:00","date_gmt":"2022-11-16T12:00:00","guid":{"rendered":"https:\/\/www.premiumbeat.com\/blog\/?p=176662"},"modified":"2022-11-25T14:03:54","modified_gmt":"2022-11-25T20:03:54","slug":"3d-object-tracking-in-video-part-i","status":"publish","type":"post","link":"https:\/\/www.premiumbeat.com\/blog\/3d-object-tracking-in-video-part-i\/","title":{"rendered":"3D Object Tracking in a Custom Video Clip &#8211; Part I"},"content":{"rendered":"\n<h2 class=\"wp-block-heading\" id=\"h-explore-how-to-set-up-markers-for-custom-geometry-tracking-so-you-can-easily-track-objects-in-your-green-screen-footage\"><span id=\"explore-how-to-set-up-markers-for-custom-geometry-tracking-so-you-can-easily-track-objects-in-your-green-screen-footage\">Explore how to set up markers for custom geometry tracking so you can easily track objects in your green screen footage.<\/span><\/h2>\n\n\n\n<p>As a 3D artist, I&#8217;ve always been passionate about live-action movies. In this case, the actors are real, while the rest is almost 98% CGI. The actors perform on <a href=\"https:\/\/www.premiumbeat.com\/blog\/how-virtual-production-is-evolving\/\" target=\"_blank\" rel=\"noreferrer noopener\" data-wpel-link=\"internal\">digital backgrounds<\/a> during the video shoots, surrounded by 3D props.<\/p>\n\n\n\n<p>If you ever watch <a href=\"https:\/\/www.premiumbeat.com\/blog\/best-documentaries-about-filmmaking\/\" target=\"_blank\" rel=\"noreferrer noopener\" data-wpel-link=\"internal\">behind-the-scenes documentaries<\/a> and footage, you&#8217;ll see giant green screens with tracking markers. It&#8217;s commonplace to see flying actors supported by wires\u2014for action sequences\u2014and even physical assets in some parts of the shooting location.<\/p>\n\n\n\n<p>It&#8217;s so exciting to understand these techniques applied to the film industry! Although your <a href=\"https:\/\/www.premiumbeat.com\/blog\/5-ways-to-give-your-low-budget-film-more-production-value\/\" target=\"_blank\" rel=\"noreferrer noopener\" data-wpel-link=\"internal\">budget<\/a> might not be comparable to that of a major studio, it&#8217;s not a big deal. You can always learn to apply the same principles by producing professional shots and executing some simple 3D techniques.<\/p>\n\n\n\n<p><em>The Jungle Book<\/em> by Walt Disney pictures makes the protagonist live inside a tremendous 3D environment. Because of the jungle colors, the actor playing Mowgli constantly performs in front of a blue screen and not a green. The match and the integration are fantastic.<\/p>\n\n\n\n<figure class=\"wp-block-image size-full\"><img loading=\"lazy\" decoding=\"async\" width=\"755\" height=\"884\" src=\"https:\/\/www.premiumbeat.com\/blog\/wp-content\/uploads\/2022\/10\/jungleBook.jpg\" alt=\"Actor in The Jungle Book against a blue screen vs same shot with the jungle filled in\" class=\"wp-image-176807\" srcset=\"https:\/\/vip-go.premiumbeat.com\/wp-content\/uploads\/2022\/10\/jungleBook.jpg 755w, https:\/\/vip-go.premiumbeat.com\/wp-content\/uploads\/2022\/10\/jungleBook.jpg?resize=256,300 256w, https:\/\/vip-go.premiumbeat.com\/wp-content\/uploads\/2022\/10\/jungleBook.jpg?resize=277,324 277w, https:\/\/vip-go.premiumbeat.com\/wp-content\/uploads\/2022\/10\/jungleBook.jpg?resize=359,420 359w, https:\/\/vip-go.premiumbeat.com\/wp-content\/uploads\/2022\/10\/jungleBook.jpg?resize=543,636 543w, https:\/\/vip-go.premiumbeat.com\/wp-content\/uploads\/2022\/10\/jungleBook.jpg?resize=560,656 560w, https:\/\/vip-go.premiumbeat.com\/wp-content\/uploads\/2022\/10\/jungleBook.jpg?resize=150,176 150w\" sizes=\"auto, (max-width: 755px) 100vw, 755px\" \/><figcaption class=\"wp-element-caption\"><em>In <\/em>The Jungle Book<em>, part of the background is digital and rendered over the blue regions. Image via <a href=\"https:\/\/www.fxguide.com\/quicktakes\/the-jungle-book-wins-vfx-oscar\/\" target=\"_blank\" rel=\"noreferrer noopener\" data-wpel-link=\"external\">fxguide.com<\/a><\/em>.<\/figcaption><\/figure>\n\n\n\n<p>The technique involved is called camera tracking. When the camera moves, the static 3D elements must maintain their location as if they were part of the actual video shoot. <\/p>\n\n\n\n<p>You can find a series of episodes I wrote at the following links:<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li><a href=\"https:\/\/www.premiumbeat.com\/blog\/3d-elements-in-real-video-clips-part-i\/\" target=\"_blank\" rel=\"noreferrer noopener\" data-wpel-link=\"internal\">How to Integrate 3D Elements into Video Footage \u2013 Part I<\/a><\/li>\n\n\n\n<li><a href=\"https:\/\/www.premiumbeat.com\/blog\/3d-elements-in-video-footage-part-ii\/\" target=\"_blank\" rel=\"noreferrer noopener\" data-wpel-link=\"internal\">How to Integrate 3D Elements into Video Footage \u2013 Part II<\/a><\/li>\n\n\n\n<li><a href=\"https:\/\/www.premiumbeat.com\/blog\/3d-elements-in-real-video-clips-part-iii\/\" target=\"_blank\" rel=\"noreferrer noopener\" data-wpel-link=\"internal\">How to Integrate 3D Elements into Video Footage \u2013 Part III<\/a><\/li>\n<\/ul>\n\n\n\n<p>Sometimes we could also want to focus on a specific object in the video and track its movement.<\/p>\n\n\n\n<p>Imagine the following example where a pair of 3D arms follows the actor&#8217;s arm movement by overlapping them during the sequence. As a result, we could add a digital scar on the character&#8217;s arm, for instance.<\/p>\n\n\n\n<figure class=\"wp-block-image size-large\"><img decoding=\"async\" src=\"https:\/\/www.premiumbeat.com\/blog\/wp-content\/uploads\/2022\/10\/geometry-tracking.jpg\" alt=\"A group of people at a bar. One man's arms are marked off with green markers to track their movement\" \/><figcaption class=\"wp-element-caption\"><em>Image via&nbsp;<a href=\"https:\/\/www.fxguide.com\/quicktakes\/qlbeans-tracking-in-belgrade\/\" target=\"_blank\" rel=\"noreferrer noopener\" data-wpel-link=\"external\">fxguide.com<\/a><\/em>.<\/figcaption><\/figure>\n\n\n\n<hr class=\"wp-block-separator has-alpha-channel-opacity\" \/>\n\n\n\n<h3 class=\"wp-block-heading\" id=\"h-make-your-video-shoot-with-the-right-equipment\"><span id=\"make-your-video-shoot-with-the-right-equipment\">Make your Video Shoot with the Right Equipment<\/span><\/h3>\n\n\n\n<p>The point of this article is to show you how everyone can take advantage of affordable tools to record a short live-action sequence with <a href=\"https:\/\/www.premiumbeat.com\/blog\/what-is-cgi-in-film\/\" target=\"_blank\" rel=\"noreferrer noopener\" data-wpel-link=\"internal\">CGI<\/a> elements. Depending on your budget, you can do that, from a modest cost of $250 to thousands of dollars.<\/p>\n\n\n\n<p>This is just the first part of the two-part series. We&#8217;ll get through the preliminary steps in this issue to set up a real shot with 3D object tracking. In the next installment, we&#8217;ll conclude our current scene that we need to complete with lighting, rendering, compositing, and other professional tips while working with your 3D software.<\/p>\n\n\n\n<p>Before getting straight to the shot, let&#8217;s see what equipment we need.<\/p>\n\n\n\n<h4 class=\"wp-block-heading\" id=\"h-green-screen\"><span id=\"green-screen\">Green Screen<\/span><\/h4>\n\n\n\n<ul class=\"wp-block-list\">\n<li>According to the available space and nature of the shot, you can opt for either a portable or a permanent one. Some people even paint a wall green. <br>Because our shot will consider the actor without recording his feet, we&#8217;ll adopt a comfortable, portable green screen.<br>Also, we don&#8217;t want to move a lot in the shot, so this is a perfect choice.<\/li>\n<\/ul>\n\n\n\n<div class=\"wp-block-media-text alignwide is-stacked-on-mobile\"><figure class=\"wp-block-media-text__media\"><img loading=\"lazy\" decoding=\"async\" width=\"755\" height=\"965\" src=\"https:\/\/www.premiumbeat.com\/blog\/wp-content\/uploads\/2022\/10\/greenscreen.jpg\" alt=\"Performer holding an ipad in front of a green screen\" class=\"wp-image-176829 size-full\" srcset=\"https:\/\/vip-go.premiumbeat.com\/wp-content\/uploads\/2022\/10\/greenscreen.jpg 755w, https:\/\/vip-go.premiumbeat.com\/wp-content\/uploads\/2022\/10\/greenscreen.jpg?resize=235,300 235w, https:\/\/vip-go.premiumbeat.com\/wp-content\/uploads\/2022\/10\/greenscreen.jpg?resize=277,354 277w, https:\/\/vip-go.premiumbeat.com\/wp-content\/uploads\/2022\/10\/greenscreen.jpg?resize=359,459 359w, https:\/\/vip-go.premiumbeat.com\/wp-content\/uploads\/2022\/10\/greenscreen.jpg?resize=543,694 543w, https:\/\/vip-go.premiumbeat.com\/wp-content\/uploads\/2022\/10\/greenscreen.jpg?resize=560,716 560w, https:\/\/vip-go.premiumbeat.com\/wp-content\/uploads\/2022\/10\/greenscreen.jpg?resize=150,192 150w\" sizes=\"auto, (max-width: 755px) 100vw, 755px\" \/><\/figure><div class=\"wp-block-media-text__content\">\n<p>KHOMO GEAR Collapsible Chromakey Panel.<\/p>\n\n\n\n<p>Easy to mount\u20141 minute\u2014and offers sufficient space for our shot. <\/p>\n\n\n\n<p>This way, we can composite any images or videos and act in front of them<\/p>\n<\/div><\/div>\n\n\n\n<h4 class=\"wp-block-heading\" id=\"h-a-series-of-tracking-markers\"><span id=\"a-series-of-tracking-markers\">A Series of Tracking Markers<\/span><\/h4>\n\n\n\n<ul class=\"wp-block-list\">\n<li>The goal is to track the head movement by overlapping a 3D object with it. Sometimes we can follow an element without trackers, but a marker-based solution will be adopted to refine the tracking.<br>Generally speaking, there are many ways to create trackers. A cheap but robust solution uses simple skin markers which can be easily removed from your body.<\/li>\n<\/ul>\n\n\n\n<div class=\"wp-block-media-text alignwide is-stacked-on-mobile\"><figure class=\"wp-block-media-text__media\"><img loading=\"lazy\" decoding=\"async\" width=\"755\" height=\"565\" src=\"https:\/\/www.premiumbeat.com\/blog\/wp-content\/uploads\/2022\/11\/skin-markers.jpg\" alt=\"Skin-safe ink markers for drawing marks on performers\" class=\"wp-image-177110 size-full\" srcset=\"https:\/\/vip-go.premiumbeat.com\/wp-content\/uploads\/2022\/11\/skin-markers.jpg 755w, https:\/\/vip-go.premiumbeat.com\/wp-content\/uploads\/2022\/11\/skin-markers.jpg?resize=300,225 300w, https:\/\/vip-go.premiumbeat.com\/wp-content\/uploads\/2022\/11\/skin-markers.jpg?resize=277,207 277w, https:\/\/vip-go.premiumbeat.com\/wp-content\/uploads\/2022\/11\/skin-markers.jpg?resize=359,269 359w, https:\/\/vip-go.premiumbeat.com\/wp-content\/uploads\/2022\/11\/skin-markers.jpg?resize=543,406 543w, https:\/\/vip-go.premiumbeat.com\/wp-content\/uploads\/2022\/11\/skin-markers.jpg?resize=560,419 560w, https:\/\/vip-go.premiumbeat.com\/wp-content\/uploads\/2022\/11\/skin-markers.jpg?resize=150,112 150w\" sizes=\"auto, (max-width: 755px) 100vw, 755px\" \/><\/figure><div class=\"wp-block-media-text__content\">\n<p>It&#8217;s better to create the right contrast on the skin to ease the tracking process. In our specific situation, we&#8217;ll be utilizing the black skin marker.<\/p>\n<\/div><\/div>\n\n\n\n<h4 class=\"wp-block-heading\" id=\"h-two-softboxes\"><span id=\"two-softboxes\">Two Softboxes<\/span><\/h4>\n\n\n\n<ul class=\"wp-block-list\">\n<li>They illuminate the green screen and the subject. Double usage is not mandatory at all! You might also decide to target the softboxes to the screen and use additional lamps for the subject. Apart from the lighting on the subject, the primary function of the softboxes is to illuminate the green screen as uniformly as possible. In fact, the more the uniform color, the easier to extract the background by the chroma key. <\/li>\n\n\n\n<li>In the most straightforward configuration, two lamps are sufficient if positioned one on the left and one on the right. <\/li>\n\n\n\n<li>As the word suggests, they produce soft shadows and they are suitable for portrait lighting in the studio. For more info, there is an issue talking about lighting schemes.<br><br>Soft lighting is produced by the presence of cloth in front of an incandescent lamp. Consequently, the scattered light creates that soft effect.<\/li>\n<\/ul>\n\n\n\n<div class=\"wp-block-media-text alignwide is-stacked-on-mobile\"><figure class=\"wp-block-media-text__media\"><img loading=\"lazy\" decoding=\"async\" width=\"755\" height=\"613\" src=\"https:\/\/www.premiumbeat.com\/blog\/wp-content\/uploads\/2022\/10\/softboxes.jpg\" alt=\"An example of a softbox with its specialized lightbulb and carry case\" class=\"wp-image-176851 size-full\" srcset=\"https:\/\/vip-go.premiumbeat.com\/wp-content\/uploads\/2022\/10\/softboxes.jpg 755w, https:\/\/vip-go.premiumbeat.com\/wp-content\/uploads\/2022\/10\/softboxes.jpg?resize=300,244 300w, https:\/\/vip-go.premiumbeat.com\/wp-content\/uploads\/2022\/10\/softboxes.jpg?resize=277,225 277w, https:\/\/vip-go.premiumbeat.com\/wp-content\/uploads\/2022\/10\/softboxes.jpg?resize=359,291 359w, https:\/\/vip-go.premiumbeat.com\/wp-content\/uploads\/2022\/10\/softboxes.jpg?resize=543,441 543w, https:\/\/vip-go.premiumbeat.com\/wp-content\/uploads\/2022\/10\/softboxes.jpg?resize=560,455 560w, https:\/\/vip-go.premiumbeat.com\/wp-content\/uploads\/2022\/10\/softboxes.jpg?resize=150,122 150w\" sizes=\"auto, (max-width: 755px) 100vw, 755px\" \/><\/figure><div class=\"wp-block-media-text__content\">\n<p>A pair of OMBAR Softboxes. 135 W, 5500 K.<\/p>\n<\/div><\/div>\n\n\n\n<h4 class=\"wp-block-heading\" id=\"h-a-simple-tripod-for-your-camera\"><span id=\"a-simple-tripod-for-your-camera\">A simple Tripod for your Camera<\/span><\/h4>\n\n\n\n<p>You must have the ability to set the height of your camera, depending on your shot. A tripod is what you need.<\/p>\n\n\n\n<p>The following is a good choice.<\/p>\n\n\n\n<div class=\"wp-block-media-text alignwide is-stacked-on-mobile\"><figure class=\"wp-block-media-text__media\"><img loading=\"lazy\" decoding=\"async\" width=\"755\" height=\"613\" src=\"https:\/\/www.premiumbeat.com\/blog\/wp-content\/uploads\/2022\/10\/tripod-for-videos.jpg\" alt=\"An example of a tripod with a carry case\" class=\"wp-image-176858 size-full\" srcset=\"https:\/\/vip-go.premiumbeat.com\/wp-content\/uploads\/2022\/10\/tripod-for-videos.jpg 755w, https:\/\/vip-go.premiumbeat.com\/wp-content\/uploads\/2022\/10\/tripod-for-videos.jpg?resize=300,244 300w, https:\/\/vip-go.premiumbeat.com\/wp-content\/uploads\/2022\/10\/tripod-for-videos.jpg?resize=277,225 277w, https:\/\/vip-go.premiumbeat.com\/wp-content\/uploads\/2022\/10\/tripod-for-videos.jpg?resize=359,291 359w, https:\/\/vip-go.premiumbeat.com\/wp-content\/uploads\/2022\/10\/tripod-for-videos.jpg?resize=543,441 543w, https:\/\/vip-go.premiumbeat.com\/wp-content\/uploads\/2022\/10\/tripod-for-videos.jpg?resize=560,455 560w, https:\/\/vip-go.premiumbeat.com\/wp-content\/uploads\/2022\/10\/tripod-for-videos.jpg?resize=150,122 150w\" sizes=\"auto, (max-width: 755px) 100vw, 755px\" \/><\/figure><div class=\"wp-block-media-text__content\">\n<p>MACTREM Professional Camera Tripod.<\/p>\n<\/div><\/div>\n\n\n\n<hr class=\"wp-block-separator has-alpha-channel-opacity\" \/>\n\n\n\n<h3 class=\"wp-block-heading\" id=\"h-preparing-our-shooting-location\"><span id=\"preparing-our-shooting-location\">Preparing our Shooting Location<\/span><\/h3>\n\n\n\n<p>Our scene represents a short clip where I enter the frame, look around for a few seconds, and approach to exit. The shot doesn&#8217;t require a big stage, and you can easily replicate it at home, even if you don&#8217;t have enough space around you.<\/p>\n\n\n\n<p>This is my shooting location.<\/p>\n\n\n\n<div class=\"wp-block-media-text alignwide is-stacked-on-mobile\"><figure class=\"wp-block-media-text__media\"><img loading=\"lazy\" decoding=\"async\" width=\"755\" height=\"473\" src=\"https:\/\/www.premiumbeat.com\/blog\/wp-content\/uploads\/2022\/11\/shooting-location.jpg\" alt=\"A rolling green screen set up in a living room\" class=\"wp-image-177117 size-full\" srcset=\"https:\/\/vip-go.premiumbeat.com\/wp-content\/uploads\/2022\/11\/shooting-location.jpg 755w, https:\/\/vip-go.premiumbeat.com\/wp-content\/uploads\/2022\/11\/shooting-location.jpg?resize=300,188 300w, https:\/\/vip-go.premiumbeat.com\/wp-content\/uploads\/2022\/11\/shooting-location.jpg?resize=277,174 277w, https:\/\/vip-go.premiumbeat.com\/wp-content\/uploads\/2022\/11\/shooting-location.jpg?resize=359,225 359w, https:\/\/vip-go.premiumbeat.com\/wp-content\/uploads\/2022\/11\/shooting-location.jpg?resize=543,340 543w, https:\/\/vip-go.premiumbeat.com\/wp-content\/uploads\/2022\/11\/shooting-location.jpg?resize=560,351 560w, https:\/\/vip-go.premiumbeat.com\/wp-content\/uploads\/2022\/11\/shooting-location.jpg?resize=150,94 150w\" sizes=\"auto, (max-width: 755px) 100vw, 755px\" \/><\/figure><div class=\"wp-block-media-text__content\">\n<p>The lamps\u2014one on the left and one on the right\u2014uniformly illuminate the green screen by producing soft lighting.<\/p>\n\n\n\n<p>Remember not to act too close to the green screen. In fact, you should avoid the presence of visible shadows on it. That will simplify the work in post-processing and make your shot look professional.<\/p>\n<\/div><\/div>\n\n\n\n<p>Once you are done with your setup, it&#8217;s time to introduce the markers on your face.<\/p>\n\n\n\n<div class=\"wp-block-media-text alignwide is-stacked-on-mobile\"><figure class=\"wp-block-media-text__media\"><img loading=\"lazy\" decoding=\"async\" width=\"755\" height=\"679\" src=\"https:\/\/www.premiumbeat.com\/blog\/wp-content\/uploads\/2022\/11\/skin-markers-on-face.jpg\" alt=\"The author with skin-safe tracking marks on his face\" class=\"wp-image-177120 size-full\" srcset=\"https:\/\/vip-go.premiumbeat.com\/wp-content\/uploads\/2022\/11\/skin-markers-on-face.jpg 755w, https:\/\/vip-go.premiumbeat.com\/wp-content\/uploads\/2022\/11\/skin-markers-on-face.jpg?resize=300,270 300w, https:\/\/vip-go.premiumbeat.com\/wp-content\/uploads\/2022\/11\/skin-markers-on-face.jpg?resize=277,249 277w, https:\/\/vip-go.premiumbeat.com\/wp-content\/uploads\/2022\/11\/skin-markers-on-face.jpg?resize=359,323 359w, https:\/\/vip-go.premiumbeat.com\/wp-content\/uploads\/2022\/11\/skin-markers-on-face.jpg?resize=543,488 543w, https:\/\/vip-go.premiumbeat.com\/wp-content\/uploads\/2022\/11\/skin-markers-on-face.jpg?resize=560,504 560w, https:\/\/vip-go.premiumbeat.com\/wp-content\/uploads\/2022\/11\/skin-markers-on-face.jpg?resize=150,135 150w\" sizes=\"auto, (max-width: 755px) 100vw, 755px\" \/><\/figure><div class=\"wp-block-media-text__content\">\n<p>There is no strict rule about the position of your markers, as well as the number of them. That depends on what you want to track and where.<\/p>\n\n\n\n<p>Honestly, I could have used much fewer markers since I&#8217;m not capturing the muscle deformation here, but the head movement. However, I wanted to have a bigger set of trackers to choose from and check which ones refine the result in the best way.<\/p>\n\n\n\n<p><br><\/p>\n<\/div><\/div>\n\n\n\n<p>We&#8217;ll see the whole tracking process in a while. For the moment, let&#8217;s have a look at one shot from the <strong>green screen session.<\/strong><\/p>\n\n\n\n<p>I used an example background with a bit of color correction to test the <strong>chroma key quality<\/strong>. This is just an example, and we&#8217;ll apply a different background for our final shot.<\/p>\n\n\n\n<figure class=\"wp-block-image size-large\"><img loading=\"lazy\" decoding=\"async\" height=\"910\" width=\"1024\" src=\"https:\/\/www.premiumbeat.com\/blog\/wp-content\/uploads\/2022\/11\/greenscreen-test.jpg?w=1024\" alt=\"The author against a green screen vs the author with a spooky haunted house backdrop filled in and light adjusted\" class=\"wp-image-177135\" srcset=\"https:\/\/vip-go.premiumbeat.com\/wp-content\/uploads\/2022\/11\/greenscreen-test.jpg 1618w, https:\/\/vip-go.premiumbeat.com\/wp-content\/uploads\/2022\/11\/greenscreen-test.jpg?resize=300,267 300w, https:\/\/vip-go.premiumbeat.com\/wp-content\/uploads\/2022\/11\/greenscreen-test.jpg?resize=768,683 768w, https:\/\/vip-go.premiumbeat.com\/wp-content\/uploads\/2022\/11\/greenscreen-test.jpg?resize=1024,910 1024w, https:\/\/vip-go.premiumbeat.com\/wp-content\/uploads\/2022\/11\/greenscreen-test.jpg?resize=1536,1365 1536w, https:\/\/vip-go.premiumbeat.com\/wp-content\/uploads\/2022\/11\/greenscreen-test.jpg?resize=277,246 277w, https:\/\/vip-go.premiumbeat.com\/wp-content\/uploads\/2022\/11\/greenscreen-test.jpg?resize=359,319 359w, https:\/\/vip-go.premiumbeat.com\/wp-content\/uploads\/2022\/11\/greenscreen-test.jpg?resize=543,483 543w, https:\/\/vip-go.premiumbeat.com\/wp-content\/uploads\/2022\/11\/greenscreen-test.jpg?resize=865,769 865w, https:\/\/vip-go.premiumbeat.com\/wp-content\/uploads\/2022\/11\/greenscreen-test.jpg?resize=994,883 994w, https:\/\/vip-go.premiumbeat.com\/wp-content\/uploads\/2022\/11\/greenscreen-test.jpg?resize=560,498 560w, https:\/\/vip-go.premiumbeat.com\/wp-content\/uploads\/2022\/11\/greenscreen-test.jpg?resize=150,133 150w\" sizes=\"auto, (max-width: 1024px) 100vw, 1024px\" \/><figcaption class=\"wp-element-caption\"><em>The green screenshot and the chroma key compositing based on a static background<\/em>.<\/figcaption><\/figure>\n\n\n\n<figure class=\"wp-block-image size-large\"><img loading=\"lazy\" decoding=\"async\" height=\"908\" width=\"1024\" src=\"https:\/\/www.premiumbeat.com\/blog\/wp-content\/uploads\/2022\/11\/greenscreen-color-correction.jpg?w=1024\" alt=\"The author with a spooky haunted house backdrop filled in and color adjusted \" class=\"wp-image-177137\" srcset=\"https:\/\/vip-go.premiumbeat.com\/wp-content\/uploads\/2022\/11\/greenscreen-color-correction.jpg 1618w, https:\/\/vip-go.premiumbeat.com\/wp-content\/uploads\/2022\/11\/greenscreen-color-correction.jpg?resize=300,266 300w, https:\/\/vip-go.premiumbeat.com\/wp-content\/uploads\/2022\/11\/greenscreen-color-correction.jpg?resize=768,681 768w, https:\/\/vip-go.premiumbeat.com\/wp-content\/uploads\/2022\/11\/greenscreen-color-correction.jpg?resize=1024,908 1024w, https:\/\/vip-go.premiumbeat.com\/wp-content\/uploads\/2022\/11\/greenscreen-color-correction.jpg?resize=1536,1362 1536w, https:\/\/vip-go.premiumbeat.com\/wp-content\/uploads\/2022\/11\/greenscreen-color-correction.jpg?resize=277,246 277w, https:\/\/vip-go.premiumbeat.com\/wp-content\/uploads\/2022\/11\/greenscreen-color-correction.jpg?resize=359,318 359w, https:\/\/vip-go.premiumbeat.com\/wp-content\/uploads\/2022\/11\/greenscreen-color-correction.jpg?resize=543,482 543w, https:\/\/vip-go.premiumbeat.com\/wp-content\/uploads\/2022\/11\/greenscreen-color-correction.jpg?resize=865,767 865w, https:\/\/vip-go.premiumbeat.com\/wp-content\/uploads\/2022\/11\/greenscreen-color-correction.jpg?resize=994,882 994w, https:\/\/vip-go.premiumbeat.com\/wp-content\/uploads\/2022\/11\/greenscreen-color-correction.jpg?resize=560,497 560w, https:\/\/vip-go.premiumbeat.com\/wp-content\/uploads\/2022\/11\/greenscreen-color-correction.jpg?resize=150,133 150w\" sizes=\"auto, (max-width: 1024px) 100vw, 1024px\" \/><figcaption class=\"wp-element-caption\"><em>A bit of color correction in After Effects<\/em>.<\/figcaption><\/figure>\n\n\n\n<hr class=\"wp-block-separator has-alpha-channel-opacity\" \/>\n\n\n\n<h3 class=\"wp-block-heading\" id=\"h-object-tracking-in-action\"><span id=\"object-tracking-in-action\">Object Tracking in Action<\/span><\/h3>\n\n\n\n<p>Here comes the fun part!<\/p>\n\n\n\n<p>The shot itself is not that fancy, as long as we don&#8217;t add a 3D mesh to spice the scene up. For this purpose I decided to wear a mask throughout the clip. So, why not use a well-known mask from one of the most iconic horror movie villains of all time?<\/p>\n\n\n\n<p>Oh yes! I&#8217;m talking about Jason Voorhees from <em>Friday the 13th<\/em>.<\/p>\n\n\n\n<p>I used a 3D mask from the web, which has to follow my head movement.<\/p>\n\n\n\n<p>This kind of task is called <strong>Object Tracking<\/strong>. Instead of recording how the real camera moves in a scene\u2014aka camera tracking\u2014we record the movement of a video element to overlap a 3D mesh.<\/p>\n\n\n\n<figure class=\"wp-block-gallery has-nested-images columns-default is-cropped wp-block-gallery-1 is-layout-flex wp-block-gallery-is-layout-flex\">\n<figure class=\"wp-block-image size-large\"><img loading=\"lazy\" decoding=\"async\" width=\"755\" height=\"570\" data-id=\"177157\" src=\"https:\/\/www.premiumbeat.com\/blog\/wp-content\/uploads\/2022\/11\/jason-voorhees-mask-side.jpg\" alt=\"A 3\/4 view of a 3D mesh representing Jason's mask\" class=\"wp-image-177157\" srcset=\"https:\/\/vip-go.premiumbeat.com\/wp-content\/uploads\/2022\/11\/jason-voorhees-mask-side.jpg 755w, https:\/\/vip-go.premiumbeat.com\/wp-content\/uploads\/2022\/11\/jason-voorhees-mask-side.jpg?resize=300,226 300w, https:\/\/vip-go.premiumbeat.com\/wp-content\/uploads\/2022\/11\/jason-voorhees-mask-side.jpg?resize=277,209 277w, https:\/\/vip-go.premiumbeat.com\/wp-content\/uploads\/2022\/11\/jason-voorhees-mask-side.jpg?resize=359,271 359w, https:\/\/vip-go.premiumbeat.com\/wp-content\/uploads\/2022\/11\/jason-voorhees-mask-side.jpg?resize=543,410 543w, https:\/\/vip-go.premiumbeat.com\/wp-content\/uploads\/2022\/11\/jason-voorhees-mask-side.jpg?resize=560,423 560w, https:\/\/vip-go.premiumbeat.com\/wp-content\/uploads\/2022\/11\/jason-voorhees-mask-side.jpg?resize=150,113 150w\" sizes=\"auto, (max-width: 755px) 100vw, 755px\" \/><\/figure>\n\n\n\n<figure class=\"wp-block-image size-large\"><img loading=\"lazy\" decoding=\"async\" width=\"755\" height=\"570\" data-id=\"177156\" src=\"https:\/\/www.premiumbeat.com\/blog\/wp-content\/uploads\/2022\/11\/jason-voorhees-mask.jpg\" alt=\"A frontal view of a 3D mesh representing Jason's mask\" class=\"wp-image-177156\" srcset=\"https:\/\/vip-go.premiumbeat.com\/wp-content\/uploads\/2022\/11\/jason-voorhees-mask.jpg 755w, https:\/\/vip-go.premiumbeat.com\/wp-content\/uploads\/2022\/11\/jason-voorhees-mask.jpg?resize=300,226 300w, https:\/\/vip-go.premiumbeat.com\/wp-content\/uploads\/2022\/11\/jason-voorhees-mask.jpg?resize=277,209 277w, https:\/\/vip-go.premiumbeat.com\/wp-content\/uploads\/2022\/11\/jason-voorhees-mask.jpg?resize=359,271 359w, https:\/\/vip-go.premiumbeat.com\/wp-content\/uploads\/2022\/11\/jason-voorhees-mask.jpg?resize=543,410 543w, https:\/\/vip-go.premiumbeat.com\/wp-content\/uploads\/2022\/11\/jason-voorhees-mask.jpg?resize=560,423 560w, https:\/\/vip-go.premiumbeat.com\/wp-content\/uploads\/2022\/11\/jason-voorhees-mask.jpg?resize=150,113 150w\" sizes=\"auto, (max-width: 755px) 100vw, 755px\" \/><\/figure>\n<figcaption class=\"blocks-gallery-caption wp-element-caption\"><em>A 3D mesh representing Jason&#8217;s mask.<\/em><\/figcaption><\/figure>\n\n\n\n<h3 class=\"wp-block-heading\" id=\"h-inside-pftrack\"><span id=\"inside-pftrack\">Inside PFTrack<\/span><\/h3>\n\n\n\n<p>The <a href=\"https:\/\/www.premiumbeat.com\/blog\/3d-elements-in-real-video-clips-part-i\/\" target=\"_blank\" rel=\"noreferrer noopener\" data-wpel-link=\"internal\">PFTrack software<\/a> is a feature-rich tool based on nodes, so we&#8217;ll use it for this project.<\/p>\n\n\n\n<p>After importing the video sequence, we are ready to work on the shot. This is the primary interface with the series of used nodes.<\/p>\n\n\n\n<figure class=\"wp-block-gallery has-nested-images columns-default is-cropped wp-block-gallery-2 is-layout-flex wp-block-gallery-is-layout-flex\">\n<figure class=\"wp-block-image size-full\"><a href=\"https:\/\/www.premiumbeat.com\/blog\/wp-content\/uploads\/2022\/11\/PFTrackNodes.jpg\" data-wpel-link=\"internal\"><img loading=\"lazy\" decoding=\"async\" width=\"755\" height=\"753\" data-id=\"177161\" src=\"https:\/\/www.premiumbeat.com\/blog\/wp-content\/uploads\/2022\/11\/PFTrackNodes.jpg\" alt=\"Edit nodes within PFTrack\" class=\"wp-image-177161\" srcset=\"https:\/\/vip-go.premiumbeat.com\/wp-content\/uploads\/2022\/11\/PFTrackNodes.jpg 755w, https:\/\/vip-go.premiumbeat.com\/wp-content\/uploads\/2022\/11\/PFTrackNodes.jpg?resize=150,150 150w, https:\/\/vip-go.premiumbeat.com\/wp-content\/uploads\/2022\/11\/PFTrackNodes.jpg?resize=300,300 300w, https:\/\/vip-go.premiumbeat.com\/wp-content\/uploads\/2022\/11\/PFTrackNodes.jpg?resize=277,276 277w, https:\/\/vip-go.premiumbeat.com\/wp-content\/uploads\/2022\/11\/PFTrackNodes.jpg?resize=359,358 359w, https:\/\/vip-go.premiumbeat.com\/wp-content\/uploads\/2022\/11\/PFTrackNodes.jpg?resize=543,542 543w, https:\/\/vip-go.premiumbeat.com\/wp-content\/uploads\/2022\/11\/PFTrackNodes.jpg?resize=560,559 560w, https:\/\/vip-go.premiumbeat.com\/wp-content\/uploads\/2022\/11\/PFTrackNodes.jpg?resize=96,96 96w\" sizes=\"auto, (max-width: 755px) 100vw, 755px\" \/><\/a><\/figure>\n\n\n\n<figure class=\"wp-block-image size-full\"><a href=\"https:\/\/www.premiumbeat.com\/blog\/wp-content\/uploads\/2022\/11\/PFTrack.jpg\" data-wpel-link=\"internal\"><img loading=\"lazy\" decoding=\"async\" width=\"755\" height=\"369\" data-id=\"177160\" src=\"https:\/\/www.premiumbeat.com\/blog\/wp-content\/uploads\/2022\/11\/PFTrack.jpg\" alt=\"Raw video clip in PFTrack\" class=\"wp-image-177160\" srcset=\"https:\/\/vip-go.premiumbeat.com\/wp-content\/uploads\/2022\/11\/PFTrack.jpg 755w, https:\/\/vip-go.premiumbeat.com\/wp-content\/uploads\/2022\/11\/PFTrack.jpg?resize=300,147 300w, https:\/\/vip-go.premiumbeat.com\/wp-content\/uploads\/2022\/11\/PFTrack.jpg?resize=277,135 277w, https:\/\/vip-go.premiumbeat.com\/wp-content\/uploads\/2022\/11\/PFTrack.jpg?resize=359,175 359w, https:\/\/vip-go.premiumbeat.com\/wp-content\/uploads\/2022\/11\/PFTrack.jpg?resize=543,265 543w, https:\/\/vip-go.premiumbeat.com\/wp-content\/uploads\/2022\/11\/PFTrack.jpg?resize=560,274 560w, https:\/\/vip-go.premiumbeat.com\/wp-content\/uploads\/2022\/11\/PFTrack.jpg?resize=150,73 150w\" sizes=\"auto, (max-width: 755px) 100vw, 755px\" \/><\/a><\/figure>\n<figcaption class=\"blocks-gallery-caption wp-element-caption\"><em>The main interface with the nodes<\/em>.<\/figcaption><\/figure>\n\n\n\n<p>The<strong> Edit Camera<\/strong> node is extremely important here as it provides a fundamental hint to PFTrack. What we want to edit is the camera focal length. We manually enter that parameter which has to be as precise as possible. However, you might not know that value, especially if you don&#8217;t record the shot yourself.<\/p>\n\n\n\n<p>In that case, the<strong> Estimate Focal<\/strong> node works as expected. It returns the proper camera focal length based on a few perspective indications\u2014more info <a href=\"https:\/\/support-thepixelfarm.co.uk\/online-documentation\/docs\/pftrack_node_estimate_focal.html\" target=\"_blank\" rel=\"noreferrer noopener\" data-wpel-link=\"external\">here<\/a>.<\/p>\n\n\n\n<p>The <strong>User Track<\/strong> node allows me to pick custom markers on the face and record their movement during the whole shot. As mentioned earlier, we select a subset of markers.<\/p>\n\n\n<div class=\"wp-block-image\">\n<figure class=\"aligncenter size-full is-resized\"><img loading=\"lazy\" decoding=\"async\" src=\"https:\/\/www.premiumbeat.com\/blog\/wp-content\/uploads\/2022\/11\/user-trackers-descriptionClean.jpg\" alt=\"Using the User Track node to select and follow certain marks on the performer's face\" class=\"wp-image-177168\" width=\"595\" height=\"593\" srcset=\"https:\/\/vip-go.premiumbeat.com\/wp-content\/uploads\/2022\/11\/user-trackers-descriptionClean.jpg 755w, https:\/\/vip-go.premiumbeat.com\/wp-content\/uploads\/2022\/11\/user-trackers-descriptionClean.jpg?resize=150,150 150w, https:\/\/vip-go.premiumbeat.com\/wp-content\/uploads\/2022\/11\/user-trackers-descriptionClean.jpg?resize=300,300 300w, https:\/\/vip-go.premiumbeat.com\/wp-content\/uploads\/2022\/11\/user-trackers-descriptionClean.jpg?resize=277,276 277w, https:\/\/vip-go.premiumbeat.com\/wp-content\/uploads\/2022\/11\/user-trackers-descriptionClean.jpg?resize=359,358 359w, https:\/\/vip-go.premiumbeat.com\/wp-content\/uploads\/2022\/11\/user-trackers-descriptionClean.jpg?resize=543,542 543w, https:\/\/vip-go.premiumbeat.com\/wp-content\/uploads\/2022\/11\/user-trackers-descriptionClean.jpg?resize=560,559 560w, https:\/\/vip-go.premiumbeat.com\/wp-content\/uploads\/2022\/11\/user-trackers-descriptionClean.jpg?resize=96,96 96w\" sizes=\"auto, (max-width: 595px) 100vw, 595px\" \/><figcaption class=\"wp-element-caption\"><em>The User Track node allows adding custom trackers. For each user tracker, there is also a small window for setting up its precise position (green cross)<\/em>.<\/figcaption><\/figure>\n<\/div>\n\n\n<p>By using the tracking commands, we can record the movement.<\/p>\n\n\n\n<p>Those trackers will be used soon as helpers for the <strong>Geometry Track<\/strong> node. They are good at maintaining a particular perspective and help refine the orientation of the 3D mesh as the head moves.<\/p>\n\n\n\n<p>A portion of the clip shows the user trackers, which follow some of the black markers.<\/p>\n\n\n\n<figure class=\"wp-block-embed is-type-video is-provider-youtube wp-block-embed-youtube wp-embed-aspect-16-9 wp-has-aspect-ratio\"><div class=\"wp-block-embed__wrapper\">\n<span class=\"embed-youtube\" style=\"text-align:center; display: block;\"><iframe loading=\"lazy\" class=\"youtube-player\" width=\"640\" height=\"360\" src=\"https:\/\/www.youtube.com\/embed\/SZSiTK7NLfw?version=3&#038;rel=1&#038;showsearch=0&#038;showinfo=1&#038;iv_load_policy=1&#038;fs=1&#038;hl=en-US&#038;autohide=2&#038;wmode=transparent\" allowfullscreen=\"true\" style=\"border:0;\" sandbox=\"allow-scripts allow-same-origin allow-popups allow-presentation allow-popups-to-escape-sandbox\"><\/iframe><\/span>\n<\/div><\/figure>\n\n\n\n<hr class=\"wp-block-separator has-alpha-channel-opacity\" \/>\n\n\n\n<h3 class=\"wp-block-heading\" id=\"h-the-geometry-track-node\"><span id=\"the-geometry-track-node\">The Geometry Track Node<\/span><\/h3>\n\n\n\n<p>The <strong>Geometry Track<\/strong> node is outstanding, as it can work even without tracking markers. It&#8217;s sufficient to match a 3D mesh to a moving object in the video\u2014at a specific frame\u2014and start tracking back and forth.<br>So, why did we use black markers on the face?<\/p>\n\n\n\n<p>The Geometry Track node also accepts user trackers to improve and refine the result. To utilize this node, you have to:<\/p>\n\n\n\n<div class=\"wp-block-media-text alignwide is-stacked-on-mobile\"><figure class=\"wp-block-media-text__media\"><img loading=\"lazy\" decoding=\"async\" width=\"755\" height=\"917\" src=\"https:\/\/www.premiumbeat.com\/blog\/wp-content\/uploads\/2022\/11\/jason-mask-on.jpg\" alt=\"Author with 3D Jason Voorhes mask over his face\" class=\"wp-image-177192 size-full\" srcset=\"https:\/\/vip-go.premiumbeat.com\/wp-content\/uploads\/2022\/11\/jason-mask-on.jpg 755w, https:\/\/vip-go.premiumbeat.com\/wp-content\/uploads\/2022\/11\/jason-mask-on.jpg?resize=247,300 247w, https:\/\/vip-go.premiumbeat.com\/wp-content\/uploads\/2022\/11\/jason-mask-on.jpg?resize=277,336 277w, https:\/\/vip-go.premiumbeat.com\/wp-content\/uploads\/2022\/11\/jason-mask-on.jpg?resize=359,436 359w, https:\/\/vip-go.premiumbeat.com\/wp-content\/uploads\/2022\/11\/jason-mask-on.jpg?resize=543,660 543w, https:\/\/vip-go.premiumbeat.com\/wp-content\/uploads\/2022\/11\/jason-mask-on.jpg?resize=560,680 560w, https:\/\/vip-go.premiumbeat.com\/wp-content\/uploads\/2022\/11\/jason-mask-on.jpg?resize=150,182 150w\" sizes=\"auto, (max-width: 755px) 100vw, 755px\" \/><\/figure><div class=\"wp-block-media-text__content\">\n<p>Load the 3D model\u2014Jason&#8217;s mask\u2014by clicking on the Load button of the Geometry Track node. Translate, rotate and scale the imported 3D mesh to match the face at a certain frame. It&#8217;s better to choose a frame where the head is oriented toward the camera.<\/p>\n\n\n\n<figure class=\"wp-block-image size-full\"><img loading=\"lazy\" decoding=\"async\" width=\"440\" height=\"190\" src=\"https:\/\/www.premiumbeat.com\/blog\/wp-content\/uploads\/2022\/11\/load-button.jpg\" alt=\"\" class=\"wp-image-177196\" srcset=\"https:\/\/vip-go.premiumbeat.com\/wp-content\/uploads\/2022\/11\/load-button.jpg 440w, https:\/\/vip-go.premiumbeat.com\/wp-content\/uploads\/2022\/11\/load-button.jpg?resize=300,130 300w, https:\/\/vip-go.premiumbeat.com\/wp-content\/uploads\/2022\/11\/load-button.jpg?resize=277,120 277w, https:\/\/vip-go.premiumbeat.com\/wp-content\/uploads\/2022\/11\/load-button.jpg?resize=359,155 359w, https:\/\/vip-go.premiumbeat.com\/wp-content\/uploads\/2022\/11\/load-button.jpg?resize=150,65 150w\" sizes=\"auto, (max-width: 440px) 100vw, 440px\" \/><\/figure>\n<\/div><\/div>\n\n\n\n<div class=\"wp-block-media-text alignwide is-stacked-on-mobile\"><figure class=\"wp-block-media-text__media\"><img loading=\"lazy\" decoding=\"async\" width=\"755\" height=\"921\" src=\"https:\/\/www.premiumbeat.com\/blog\/wp-content\/uploads\/2022\/11\/look-up.jpg\" alt=\"Showing how the mask follows movements of the head and face\" class=\"wp-image-177197 size-full\" srcset=\"https:\/\/vip-go.premiumbeat.com\/wp-content\/uploads\/2022\/11\/look-up.jpg 755w, https:\/\/vip-go.premiumbeat.com\/wp-content\/uploads\/2022\/11\/look-up.jpg?resize=246,300 246w, https:\/\/vip-go.premiumbeat.com\/wp-content\/uploads\/2022\/11\/look-up.jpg?resize=277,338 277w, https:\/\/vip-go.premiumbeat.com\/wp-content\/uploads\/2022\/11\/look-up.jpg?resize=359,438 359w, https:\/\/vip-go.premiumbeat.com\/wp-content\/uploads\/2022\/11\/look-up.jpg?resize=543,662 543w, https:\/\/vip-go.premiumbeat.com\/wp-content\/uploads\/2022\/11\/look-up.jpg?resize=560,683 560w, https:\/\/vip-go.premiumbeat.com\/wp-content\/uploads\/2022\/11\/look-up.jpg?resize=150,183 150w\" sizes=\"auto, (max-width: 755px) 100vw, 755px\" \/><\/figure><div class=\"wp-block-media-text__content\">\n<p>At this point, use the arrows to track back and forth. The single arrows work frame by frame, while the double ones keep tracking for more frames.<\/p>\n\n\n\n<figure class=\"wp-block-image size-full\"><img loading=\"lazy\" decoding=\"async\" width=\"344\" height=\"163\" src=\"https:\/\/www.premiumbeat.com\/blog\/wp-content\/uploads\/2022\/11\/geometry-tracking-commands.jpg\" alt=\"\" class=\"wp-image-177202\" srcset=\"https:\/\/vip-go.premiumbeat.com\/wp-content\/uploads\/2022\/11\/geometry-tracking-commands.jpg 344w, https:\/\/vip-go.premiumbeat.com\/wp-content\/uploads\/2022\/11\/geometry-tracking-commands.jpg?resize=300,142 300w, https:\/\/vip-go.premiumbeat.com\/wp-content\/uploads\/2022\/11\/geometry-tracking-commands.jpg?resize=277,131 277w, https:\/\/vip-go.premiumbeat.com\/wp-content\/uploads\/2022\/11\/geometry-tracking-commands.jpg?resize=150,71 150w\" sizes=\"auto, (max-width: 344px) 100vw, 344px\" \/><\/figure>\n<\/div><\/div>\n\n\n\n<div class=\"wp-block-media-text alignwide is-stacked-on-mobile\"><figure class=\"wp-block-media-text__media\"><img loading=\"lazy\" decoding=\"async\" width=\"755\" height=\"921\" src=\"https:\/\/www.premiumbeat.com\/blog\/wp-content\/uploads\/2022\/11\/look-up-opposite-direction.jpg\" alt=\"Testing the tracking on the 3D mask\" class=\"wp-image-177198 size-full\" srcset=\"https:\/\/vip-go.premiumbeat.com\/wp-content\/uploads\/2022\/11\/look-up-opposite-direction.jpg 755w, https:\/\/vip-go.premiumbeat.com\/wp-content\/uploads\/2022\/11\/look-up-opposite-direction.jpg?resize=246,300 246w, https:\/\/vip-go.premiumbeat.com\/wp-content\/uploads\/2022\/11\/look-up-opposite-direction.jpg?resize=277,338 277w, https:\/\/vip-go.premiumbeat.com\/wp-content\/uploads\/2022\/11\/look-up-opposite-direction.jpg?resize=359,438 359w, https:\/\/vip-go.premiumbeat.com\/wp-content\/uploads\/2022\/11\/look-up-opposite-direction.jpg?resize=543,662 543w, https:\/\/vip-go.premiumbeat.com\/wp-content\/uploads\/2022\/11\/look-up-opposite-direction.jpg?resize=560,683 560w, https:\/\/vip-go.premiumbeat.com\/wp-content\/uploads\/2022\/11\/look-up-opposite-direction.jpg?resize=150,183 150w\" sizes=\"auto, (max-width: 755px) 100vw, 755px\" \/><\/figure><div class=\"wp-block-media-text__content\">\n<p>If you notice that, for a frame, the tracking is a bit off, you can always re-orient the face on that frame, add a key, move to the next frame, and click on <strong>Refine<\/strong> button. The refine button should be applied to the previous frame as well.<\/p>\n\n\n\n<p>That way, you create a smooth transition after you add a key.<\/p>\n\n\n\n<figure class=\"wp-block-image size-full\"><img loading=\"lazy\" decoding=\"async\" width=\"342\" height=\"255\" src=\"https:\/\/www.premiumbeat.com\/blog\/wp-content\/uploads\/2022\/11\/refine-add-key.jpg\" alt=\"\" class=\"wp-image-177204\" srcset=\"https:\/\/vip-go.premiumbeat.com\/wp-content\/uploads\/2022\/11\/refine-add-key.jpg 342w, https:\/\/vip-go.premiumbeat.com\/wp-content\/uploads\/2022\/11\/refine-add-key.jpg?resize=300,224 300w, https:\/\/vip-go.premiumbeat.com\/wp-content\/uploads\/2022\/11\/refine-add-key.jpg?resize=277,207 277w, https:\/\/vip-go.premiumbeat.com\/wp-content\/uploads\/2022\/11\/refine-add-key.jpg?resize=150,112 150w\" sizes=\"auto, (max-width: 342px) 100vw, 342px\" \/><\/figure>\n<\/div><\/div>\n\n\n\n<div class=\"wp-block-media-text alignwide is-stacked-on-mobile\"><figure class=\"wp-block-media-text__media\"><img loading=\"lazy\" decoding=\"async\" width=\"755\" height=\"923\" src=\"https:\/\/www.premiumbeat.com\/blog\/wp-content\/uploads\/2022\/11\/look-left.jpg\" alt=\"User Trackers helping the Geometry Track node follow movement\" class=\"wp-image-177208 size-full\" srcset=\"https:\/\/vip-go.premiumbeat.com\/wp-content\/uploads\/2022\/11\/look-left.jpg 755w, https:\/\/vip-go.premiumbeat.com\/wp-content\/uploads\/2022\/11\/look-left.jpg?resize=245,300 245w, https:\/\/vip-go.premiumbeat.com\/wp-content\/uploads\/2022\/11\/look-left.jpg?resize=277,339 277w, https:\/\/vip-go.premiumbeat.com\/wp-content\/uploads\/2022\/11\/look-left.jpg?resize=359,439 359w, https:\/\/vip-go.premiumbeat.com\/wp-content\/uploads\/2022\/11\/look-left.jpg?resize=543,664 543w, https:\/\/vip-go.premiumbeat.com\/wp-content\/uploads\/2022\/11\/look-left.jpg?resize=560,685 560w, https:\/\/vip-go.premiumbeat.com\/wp-content\/uploads\/2022\/11\/look-left.jpg?resize=150,183 150w\" sizes=\"auto, (max-width: 755px) 100vw, 755px\" \/><\/figure><div class=\"wp-block-media-text__content\">\n<p>The previous user trackers can be added as helpers to the Geometry Track node.<\/p>\n\n\n\n<p>That way your tracking will be much better.<\/p>\n\n\n\n<p>At this stage don&#8217;t worry if the laces don&#8217;t match the head. They will be adjusted later on in Maya. <\/p>\n\n\n\n<p>Here is the list of the previous trackers.<\/p>\n\n\n\n<figure class=\"wp-block-image size-full\"><img loading=\"lazy\" decoding=\"async\" width=\"597\" height=\"381\" src=\"https:\/\/www.premiumbeat.com\/blog\/wp-content\/uploads\/2022\/11\/helpers.jpg\" alt=\"\" class=\"wp-image-177209\" srcset=\"https:\/\/vip-go.premiumbeat.com\/wp-content\/uploads\/2022\/11\/helpers.jpg 597w, https:\/\/vip-go.premiumbeat.com\/wp-content\/uploads\/2022\/11\/helpers.jpg?resize=300,191 300w, https:\/\/vip-go.premiumbeat.com\/wp-content\/uploads\/2022\/11\/helpers.jpg?resize=277,177 277w, https:\/\/vip-go.premiumbeat.com\/wp-content\/uploads\/2022\/11\/helpers.jpg?resize=359,229 359w, https:\/\/vip-go.premiumbeat.com\/wp-content\/uploads\/2022\/11\/helpers.jpg?resize=543,347 543w, https:\/\/vip-go.premiumbeat.com\/wp-content\/uploads\/2022\/11\/helpers.jpg?resize=560,357 560w, https:\/\/vip-go.premiumbeat.com\/wp-content\/uploads\/2022\/11\/helpers.jpg?resize=150,96 150w\" sizes=\"auto, (max-width: 597px) 100vw, 597px\" \/><\/figure>\n<\/div><\/div>\n\n\n\n<p>At this point, this is the result we obtained.<\/p>\n\n\n\n<figure class=\"wp-block-embed is-type-video is-provider-youtube wp-block-embed-youtube wp-embed-aspect-16-9 wp-has-aspect-ratio\"><div class=\"wp-block-embed__wrapper\">\n<span class=\"embed-youtube\" style=\"text-align:center; display: block;\"><iframe loading=\"lazy\" class=\"youtube-player\" width=\"640\" height=\"360\" src=\"https:\/\/www.youtube.com\/embed\/XyNG6gIlinI?version=3&#038;rel=1&#038;showsearch=0&#038;showinfo=1&#038;iv_load_policy=1&#038;fs=1&#038;hl=en-US&#038;autohide=2&#038;wmode=transparent\" allowfullscreen=\"true\" style=\"border:0;\" sandbox=\"allow-scripts allow-same-origin allow-popups allow-presentation allow-popups-to-escape-sandbox\"><\/iframe><\/span>\n<\/div><figcaption class=\"wp-element-caption\"><em>The geometry tracking works fine. The laces will be fixed in Maya later on<\/em>.<\/figcaption><\/figure>\n\n\n\n<hr class=\"wp-block-separator has-alpha-channel-opacity\" \/>\n\n\n\n<h3 class=\"wp-block-heading\" id=\"h-the-export-node\"><span id=\"the-export-node\">The Export Node<\/span><\/h3>\n\n\n\n<p>In the end, we have to export the mask animation from PFTrack to your favorite 3D software.<\/p>\n\n\n\n<p>In my case, I exported for Maya but PFTrack offers different exporters like fbx, obj, and 3DS Max to name a few.<\/p>\n\n\n\n<p>The <strong>Export<\/strong> node also allows you to select what to export from the scene. In our case, we only need the 3D mesh with the embedded animation and that&#8217;s included by default.<\/p>\n\n\n\n<hr class=\"wp-block-separator has-alpha-channel-opacity\" \/>\n\n\n\n<p>This is the conclusion of the first part of the series. We&#8217;ll keep on working on this shot until the end of the next episode.<\/p>\n\n\n\n<p>In the meantime, I invite you to follow me on my <a href=\"https:\/\/www.linkedin.com\/in\/francesco-furneri-25541740\/\" target=\"_blank\" rel=\"noreferrer noopener\" data-wpel-link=\"external\">Linkedin<\/a> page.<\/p>\n\n\n\n<hr class=\"wp-block-separator has-alpha-channel-opacity\" \/>\n\n\n\n<p>For more on 3D, check out these articles:<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li><a href=\"https:\/\/www.premiumbeat.com\/blog\/best-free-animation-software-ready-to-download-right-now\/\" target=\"_blank\" rel=\"noreferrer noopener\" data-wpel-link=\"internal\">Best FREE Animation Software \u2014 Ready to Download Right Now<\/a><\/li>\n\n\n\n<li><a href=\"https:\/\/www.premiumbeat.com\/blog\/best-3d-models-for-blender-cinema-4d\/\" target=\"_blank\" rel=\"noreferrer noopener\" data-wpel-link=\"internal\">Best Site to Download 3D Models for Blender, Cinema 4D, and More<\/a><\/li>\n\n\n\n<li><a href=\"https:\/\/www.premiumbeat.com\/blog\/3d-terrain-blender-without-plugins\/\" target=\"_blank\" rel=\"noreferrer noopener\" data-wpel-link=\"internal\">How to Create Real 3D Terrain in Blender (Without Plugins)<\/a><\/li>\n\n\n\n<li><a href=\"https:\/\/www.premiumbeat.com\/blog\/free-cinema-4d-models\/\" target=\"_blank\" rel=\"noreferrer noopener\" data-wpel-link=\"internal\">Six FREE 3D Models for Cinema 4D Users<\/a><\/li>\n\n\n\n<li><a href=\"https:\/\/www.premiumbeat.com\/blog\/blender-channels-for-3d-artists\/\" target=\"_blank\" rel=\"noreferrer noopener\" data-wpel-link=\"internal\">The 10 Best Blender YouTube Channels for 3D Artists<\/a><\/li>\n<\/ul>\n","protected":false},"excerpt":{"rendered":"<p>Explore how to set up markers for custom geometry tracking so you can easily track objects in your green screen footage.<\/p>\n","protected":false},"author":203,"featured_media":177244,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"jetpack_post_was_ever_published":false,"_jetpack_newsletter_access":"","_jetpack_dont_email_post_to_subs":false,"_jetpack_newsletter_tier_id":0,"_jetpack_memberships_contains_paywalled_content":false,"_jetpack_memberships_contains_paid_content":false,"footnotes":"","jetpack_publicize_message":"","jetpack_publicize_feature_enabled":true,"jetpack_social_post_already_shared":true,"jetpack_social_options":{"image_generator_settings":{"template":"highway","default_image_id":0,"font":"","enabled":false},"version":2}},"categories":[6677,3843,715,21,583],"tags":[284,888,3073,481,7175,7176,7144],"class_list":["post-class-post-176662","post-class-post","post-class-type-post","post-class-status-publish","post-class-format-standard","post-class-has-post-thumbnail","post-class-hentry","post-class-category-3d","post-class-category-filmmaking-2","post-class-category-industry","post-class-category-tutorials","post-class-category-video-production-2","post-class-tag-3d","post-class-tag-autodesk-maya","post-class-tag-cgi","post-class-tag-compositing","post-class-tag-object-tracking","post-class-tag-pftrack","post-class-tag-turbosquid"],"acf":[],"yoast_head":"<!-- This site is optimized with the Yoast SEO Premium plugin v18.5 (Yoast SEO v21.5) - https:\/\/yoast.com\/wordpress\/plugins\/seo\/ -->\n<title>3D Object Tracking in a Custom Video Clip - Part I<\/title>\n<meta name=\"description\" content=\"Explore how to set up markers for custom geometry tracking so you can easily track objects in your green screen footage.\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/www.premiumbeat.com\/blog\/3d-object-tracking-in-video-part-i\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"3D Object Tracking in a Custom Video Clip - Part I\" \/>\n<meta property=\"og:description\" content=\"Explore how to set up markers for custom geometry tracking so you can easily track objects in your green screen footage.\" \/>\n<meta property=\"og:url\" content=\"https:\/\/www.premiumbeat.com\/blog\/3d-object-tracking-in-video-part-i\/\" \/>\n<meta property=\"og:site_name\" content=\"The Beat: A Blog by PremiumBeat\" \/>\n<meta property=\"article:publisher\" content=\"https:\/\/www.facebook.com\/premiumbeat\" \/>\n<meta property=\"article:published_time\" content=\"2022-11-16T12:00:00+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2022-11-25T20:03:54+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/pbblogassets.s3.amazonaws.com\/uploads\/2022\/11\/09091442\/cover.jpg\" \/>\n\t<meta property=\"og:image:width\" content=\"1000\" \/>\n\t<meta property=\"og:image:height\" content=\"584\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/jpeg\" \/>\n<meta name=\"author\" content=\"Francesco Furneri\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:creator\" content=\"@Premiumbeat\" \/>\n<meta name=\"twitter:site\" content=\"@Premiumbeat\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Francesco Furneri\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"10 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\/\/www.premiumbeat.com\/blog\/3d-object-tracking-in-video-part-i\/\",\"url\":\"https:\/\/www.premiumbeat.com\/blog\/3d-object-tracking-in-video-part-i\/\",\"name\":\"3D Object Tracking in a Custom Video Clip - Part I\",\"isPartOf\":{\"@id\":\"https:\/\/www.premiumbeat.com\/blog\/#website\"},\"datePublished\":\"2022-11-16T12:00:00+00:00\",\"dateModified\":\"2022-11-25T20:03:54+00:00\",\"author\":{\"@id\":\"https:\/\/www.premiumbeat.com\/blog\/#\/schema\/person\/38d8ffc2fc1ddef3504b0c4b4a6c901c\"},\"description\":\"Explore how to set up markers for custom geometry tracking so you can easily track objects in your green screen footage.\",\"breadcrumb\":{\"@id\":\"https:\/\/www.premiumbeat.com\/blog\/3d-object-tracking-in-video-part-i\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/www.premiumbeat.com\/blog\/3d-object-tracking-in-video-part-i\/\"]}]},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/www.premiumbeat.com\/blog\/3d-object-tracking-in-video-part-i\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/www.premiumbeat.com\/blog\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"3D\",\"item\":\"https:\/\/www.premiumbeat.com\/blog\/category\/3d\/\"},{\"@type\":\"ListItem\",\"position\":3,\"name\":\"3D Object Tracking in a Custom Video Clip &#8211; Part I\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/www.premiumbeat.com\/blog\/#website\",\"url\":\"https:\/\/www.premiumbeat.com\/blog\/\",\"name\":\"The Beat: A Blog by PremiumBeat\",\"description\":\"\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/www.premiumbeat.com\/blog\/?s={search_term_string}\"},\"query-input\":\"required name=search_term_string\"}],\"inLanguage\":\"en-US\"},{\"@type\":\"Person\",\"@id\":\"https:\/\/www.premiumbeat.com\/blog\/#\/schema\/person\/38d8ffc2fc1ddef3504b0c4b4a6c901c\",\"name\":\"Francesco Furneri\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/www.premiumbeat.com\/blog\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/6a33810a9d5969e29e363107ed645f7e7a05541df8f6dfabae90f532773d2fe2?s=96&d=mm&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/6a33810a9d5969e29e363107ed645f7e7a05541df8f6dfabae90f532773d2fe2?s=96&d=mm&r=g\",\"caption\":\"Francesco Furneri\"},\"description\":\"Francesco is a 3D artist with more than 15 years of experience in 3D Computer Graphics. Specialized in 3D Modeling and Texturing \/ Lighting, Francesco is currently working for a company dealing with modeling, texturing, lighting and rendering. He also contributes to various films by providing 3D characters, environments and props.\",\"sameAs\":[\"https:\/\/www.artstation.com\/jackfurneri\"],\"url\":\"https:\/\/www.premiumbeat.com\/blog\/author\/ffurneri\/\"}]}<\/script>\n<!-- \/ Yoast SEO Premium plugin. -->","yoast_head_json":{"title":"3D Object Tracking in a Custom Video Clip - Part I","description":"Explore how to set up markers for custom geometry tracking so you can easily track objects in your green screen footage.","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/www.premiumbeat.com\/blog\/3d-object-tracking-in-video-part-i\/","og_locale":"en_US","og_type":"article","og_title":"3D Object Tracking in a Custom Video Clip - Part I","og_description":"Explore how to set up markers for custom geometry tracking so you can easily track objects in your green screen footage.","og_url":"https:\/\/www.premiumbeat.com\/blog\/3d-object-tracking-in-video-part-i\/","og_site_name":"The Beat: A Blog by PremiumBeat","article_publisher":"https:\/\/www.facebook.com\/premiumbeat","article_published_time":"2022-11-16T12:00:00+00:00","article_modified_time":"2022-11-25T20:03:54+00:00","og_image":[{"width":1000,"height":584,"url":"https:\/\/pbblogassets.s3.amazonaws.com\/uploads\/2022\/11\/09091442\/cover.jpg","type":"image\/jpeg"}],"author":"Francesco Furneri","twitter_card":"summary_large_image","twitter_creator":"@Premiumbeat","twitter_site":"@Premiumbeat","twitter_misc":{"Written by":"Francesco Furneri","Est. reading time":"10 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/www.premiumbeat.com\/blog\/3d-object-tracking-in-video-part-i\/","url":"https:\/\/www.premiumbeat.com\/blog\/3d-object-tracking-in-video-part-i\/","name":"3D Object Tracking in a Custom Video Clip - Part I","isPartOf":{"@id":"https:\/\/www.premiumbeat.com\/blog\/#website"},"datePublished":"2022-11-16T12:00:00+00:00","dateModified":"2022-11-25T20:03:54+00:00","author":{"@id":"https:\/\/www.premiumbeat.com\/blog\/#\/schema\/person\/38d8ffc2fc1ddef3504b0c4b4a6c901c"},"description":"Explore how to set up markers for custom geometry tracking so you can easily track objects in your green screen footage.","breadcrumb":{"@id":"https:\/\/www.premiumbeat.com\/blog\/3d-object-tracking-in-video-part-i\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/www.premiumbeat.com\/blog\/3d-object-tracking-in-video-part-i\/"]}]},{"@type":"BreadcrumbList","@id":"https:\/\/www.premiumbeat.com\/blog\/3d-object-tracking-in-video-part-i\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/www.premiumbeat.com\/blog\/"},{"@type":"ListItem","position":2,"name":"3D","item":"https:\/\/www.premiumbeat.com\/blog\/category\/3d\/"},{"@type":"ListItem","position":3,"name":"3D Object Tracking in a Custom Video Clip &#8211; Part I"}]},{"@type":"WebSite","@id":"https:\/\/www.premiumbeat.com\/blog\/#website","url":"https:\/\/www.premiumbeat.com\/blog\/","name":"The Beat: A Blog by PremiumBeat","description":"","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/www.premiumbeat.com\/blog\/?s={search_term_string}"},"query-input":"required name=search_term_string"}],"inLanguage":"en-US"},{"@type":"Person","@id":"https:\/\/www.premiumbeat.com\/blog\/#\/schema\/person\/38d8ffc2fc1ddef3504b0c4b4a6c901c","name":"Francesco Furneri","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.premiumbeat.com\/blog\/#\/schema\/person\/image\/","url":"https:\/\/secure.gravatar.com\/avatar\/6a33810a9d5969e29e363107ed645f7e7a05541df8f6dfabae90f532773d2fe2?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/6a33810a9d5969e29e363107ed645f7e7a05541df8f6dfabae90f532773d2fe2?s=96&d=mm&r=g","caption":"Francesco Furneri"},"description":"Francesco is a 3D artist with more than 15 years of experience in 3D Computer Graphics. Specialized in 3D Modeling and Texturing \/ Lighting, Francesco is currently working for a company dealing with modeling, texturing, lighting and rendering. He also contributes to various films by providing 3D characters, environments and props.","sameAs":["https:\/\/www.artstation.com\/jackfurneri"],"url":"https:\/\/www.premiumbeat.com\/blog\/author\/ffurneri\/"}]}},"jetpack_publicize_connections":[],"jetpack_featured_media_url":"https:\/\/www.premiumbeat.com\/blog\/wp-content\/uploads\/2022\/11\/cover.jpg","jetpack_sharing_enabled":true,"jetpack_shortlink":"https:\/\/wp.me\/pab9JK-JXo","_links":{"self":[{"href":"https:\/\/www.premiumbeat.com\/blog\/wp-json\/wp\/v2\/posts\/176662","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.premiumbeat.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.premiumbeat.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.premiumbeat.com\/blog\/wp-json\/wp\/v2\/users\/203"}],"replies":[{"embeddable":true,"href":"https:\/\/www.premiumbeat.com\/blog\/wp-json\/wp\/v2\/comments?post=176662"}],"version-history":[{"count":168,"href":"https:\/\/www.premiumbeat.com\/blog\/wp-json\/wp\/v2\/posts\/176662\/revisions"}],"predecessor-version":[{"id":177519,"href":"https:\/\/www.premiumbeat.com\/blog\/wp-json\/wp\/v2\/posts\/176662\/revisions\/177519"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.premiumbeat.com\/blog\/wp-json\/wp\/v2\/media\/177244"}],"wp:attachment":[{"href":"https:\/\/www.premiumbeat.com\/blog\/wp-json\/wp\/v2\/media?parent=176662"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.premiumbeat.com\/blog\/wp-json\/wp\/v2\/categories?post=176662"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.premiumbeat.com\/blog\/wp-json\/wp\/v2\/tags?post=176662"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}