Today I will talk about how to use the 3D camera tracker in Adobe After Effects CS6 to extract camera movement information and export that information into your favourite 3D program
Using the 3D camera tracker to analyse your footage and extract camera information only makes sense if your camera is moving during the shot. If you have a locked down shot (fixed camera position) and assuming you wrote down all the information to replicate the scene in your 3D program as discussed in the last part, you do not need to use 3D camera tracking and you can move on to the next part of this tutorial
However, in the UFO scene we filmed, the camera executes a pan and a tilt up towards the sky so we will have to track our footage.
Before we get to our UFO scene, let me first show you how to use the 3D camera tracker in a normal situation. I have a scene here of me walking with my camera through a street in Melbourne.
To apply the 3D camera tracker, simply locate the '3D Camera Tracker' effect in the Effects & Presets panel and apply it to your footage layer. The tracker will immediately begin analysing your footage in the background.
The 3D camera tracker is now processing your footage frame by frame and applying 2D track points to trace the movement of distinct visual elements in the scene. Once it has completed this task, it will solve this cloud of 2D track points and their movement to reverse engineer the position and movement of the camera. It will also convert the 2D track points into 3D track points using the calculated depth information.
This can take a while depending on the resolution and length of your footage as well as the power of your computer.
While this is going on, let's have a quick look at all the parameters availale in the 3D camera tracker.
I don't find myself changing these parameters often as the tracker usually does a pretty good job all by itself. However, it's good to know what these settings are useful for in case you do get into a more tricky situation.
At the very top, the effect will show you a progress indicator to tell you how much longer you will have to wait until analysis is complete.
Below this indicator you can specify the shot type.
For most of my shots, I usually just leave it on 'Fixed Angle of View' and I haven't had many issues yet
The next option allows you to specify which track points to show.
This will only become relevant once the 3D camera tracker has finished analysing and a number of track points is displayed on top of your footage.
Just leave it on '3D Solved' and you'll be fine. If something goes wrong and you do not have any 3D track points, the 2D source track points will be displayed instead
You can also adjust the track point and the target size. The target size refers to the size of a visual bullseye helper that you will see when you hover your mouse over a tracked piece of footage. You will see that shortly. If you want to render the track points as part of the effect, you can check the 'Render Track Points' option.
Just above the advanced options you will find the 'Create Camera' button.
Once the 3D Camera Tracker has finished its work, this button will be enabled and you can click it to create a camera that imitates the movement of the camera used to film the footage.
Let's expand the Advanced options by clicking on the twisty (triangle) to see what goodies we have in there
First off, you can specify the solve method used to try to extract camera and depth information from the 2D track points.
Once the 3D camera tracker has finished analysing your footage and solving the 2D track points, you will see some results information below the solve method option.
You also have the option to perform a more detailed analysis of your footage and suppress any warnings that are usually shown when the tracker wants to tell you that you should re-analyse your footage.
thank you very much for what you are doing here. Helping and sharing with beginners is admirable.
It would be nice if you show the process of compositing passes for the UFO. Obviously, beginners are having quite hard times with passes compositing at the very first time.
Also i suppose you can lit some light on the media management. In short words show guys how you organise the shooting (converting media, back up, organise folders, naming working files etc). You can share how you use your wonderfull Pigeon software. From my exp and point of view it's wonderfull i recomend it to everyone who is viewing this website. Really guys, shotgun will come infront of you some day, but this simple but yet powerfull peace of software is woth to try.
And one more suggestion, try to tutor on your real projects. It's very helpfull when you can see a real challange.
Thank you for your feedback and apologies for taking so long to get back to you. It's been a bit busy with work and YouTube lately so I didn't get much time to spend on my blog. I have since uploaded tutorials for creating the 3D scene and compositing the UFO in After Effects
I have put requests for a media management tutorial and some more behind the scene VFX tutorials (where I show how I solve real problems for my projects) on my request list. I can't ever guarantee when I'll get around to them, but I am trying to do a few lighter tutorials on my channel so I can create content for everyone a bit more frequently
Just a quick question:
Do the colours of the tracking markers mean anything? There have been times where I have tried to use points with the same colour as they seem to be on the same plane. Is this the way it works or is that coincidental? Maybe they are just multicoloured for visibility purposes?
PS this page is crammed with useful info, nice one!!
Thanks for the feedback! It sounds like you are talking about two different modes: masks (usually yellow) and shapes (usually blue). If you try to draw a shape/points onto a layer and you don't have the layer selected or you are not over the visible parts of the layer, After Effects will create a new shape layer and your shapes will appear blue. If you have the layer selected and are over a visible part of the layer, After Effects will create a new mask which will likely appear blue. These colours can also be configured. Cheers!
this 3d camera Tracker tutorial was really very nice but i have a question that can i ride a 3d virtual bike if yes please make a tutorial for it
Glad you enjoyed the tutorial. You can, but it'd be a complicated tutorial. I recommend watching the entire 3D VFX series (all 6 parts). The very same technique can be used for any type of 3d effect - including riding a virtual bike. Though you'd likely be better off just riding a real one
sorry , I can not complete the above steps , it is an " alert
tou need to check " Allow Scripts to Write an Access Network Files " in the Genral Preferensces in order to use this plug in "