Point Tracking

If you didn't read the overview section yet, please do so before reading the following. We will walk you though point-tracking the street-car shot as illustrated in the overview section.

Let's go ahead and add a point tracker on the layer:

When reviewing the motion of the shot, we can see that the sides of the street car move in a perspective motion. Notice that the windows of the street car show not only reflections but also reveal the background behind them, so trying a track in these regions is highly likely to fail.

Before adding a new marker, we will first set the New Marker Model setting to Perspective since all markers we want to track need to track a perspective motion.

Note that this can be changed on each marker afterwards by changing the Tracking Model parameter of the marker.

Adding Markers

Adding a marker can be done directly in the Viewer by activating the add mode on the left toolbar and clicking where desired in the image.

Note that the marker user interfaces allow you to control the following parameters of the marker:

• The center (or tracked point) of the marker is the small cross in the middle of the marker
• The inner rectangle with 4 corners represent the pattern window: this is what you want to track. Note that the 4 corners need-not be a rectangle: when tracking a perspective model, the 4 corners will move freely, like a CornerPin..
• The outter rectangle represents the search region: this is how far it will look to the next/previous frame when tracking. If the motion of the shot is very large between each frame, it may fall outside the search window and fail to track.

The marker also has an Offset parameter, which will go over later, but that can be moved in the viewer by dragging the center point while holding Ctrl.

Whenever you add the marker for the first time, you also set a pattern keyframe, visible on the timeline row of the Marker.

The pattern keyframe will be the reference used for tracking the next frames (when tracking forward, otherwise previous frames when tracking backward), until the next pattern keyframe is encountered. You can remove as needed the pattern keyframes from the timeline or from the viewer's top toolbar. Note that you need at least one keyframe in order to track correctly.

Motion Model

Depending on what kind of model transform type you want to use to match-move other elements (or stabilize the footage), different scenarios are possible to perform the tracking:

• Tracking a Location model requires only a single point to track.
• Tracking a Location+Rotation or Location+Scale requires at least 2 points to track
• Tracking a Location+Rotation+Scale or Affine requires at least 3 points to track
• Tracking a Perspective model requires at least 4 points to track

In Autograph, you will notice that when tracking a marker with a Tracking Model other than Location, the 4 corners of the pattern of the marker will be deformed. In this case, it is possible to use a single marker to track a model requiring multiple points since it already tracks 4 corners + center. However, tracking multiple markers that follow the same motion may yield stronger results, depending on the shot.

Tracking

To start the tracking, you may need to select the desired markers when the Track Selected Markers mode is selected in the viewer's top toolbar. Let's increase the search window horizontally of our marker, since we see the street car moves faster per frame than the default 20px setting.

In our case, since we created the first pattern keyframe in the middle of the sequence, we will need to both track forward and backward using the buttons from the viewer's top toolbar.

What to do when the tracker stops

After tracking a few frames, the tracker stopped.

What we can do here is try to change the following parameters and start tracking again from the failed frame

• Increase the search window again: since the pattern may have gotten bigger, the search window may get too small
• Check Normalize Intensities in the tracker settings menu: since our shot contains a few reflections and changes of lighting this may help
• Increase the maximum number of iterations: sometimes when the reference pattern keyframe is very different from the frame to track, the tracker needs to internally perform a lot of searches, which are bounded by this parameter.
• Add a new pattern keyframe by clicking on the corresponding in the toolbar: this will help as next frames to track are closer to the new keyframe and are likely to find a match more easily.

If it still continues to fail, consider tracking another point of the shot that follows the same motion. Remember that the tracker needs to have textured elements with edges: a flat surface such as a poorly lit greenscreen without any features will be impossible to track.

In our case, the problem was a search window too small. Let's launch again the tracker.

Reaching the edge of the frame

The tracker successfully tracked the marker until it reached the edge of the frame, where it began to be out of sight, causing the tracker not to find a corresponding match.

This is where the Offset parameter of the marker is useful: you can drag it using Ctrl when moving the center of the marker.

What we are going to to do is offset the marker to another feature following the same motion but that is still in the shot. The tracker will apply the offset and apply it to the marker's original center

Once all points following the same motion are tracked, we can move on to apply the tracked model.