Skip to main content

In the age of episodic streaming, VFX studios are making more use of Nuke Smart Vectors to perform quick fixes and hit deadlines. Below, Nuke expert Josh Parks explores Smart Vectors and reveals how to implement them into your workflow.

Smart Vectors in Nuke make it easy to perform tricky tasks quickly and efficiently and hit deadlines, so it’s no surprise the feature is popular in episodic TV workflows. Today, episodic TV visual effects can include anything from high-energy fight sequences to small tweaks like adding marks to a face for continuity or beauty work to remove unwanted wrinkles. The latter workflows especially benefit from Smart Vectors.

The Smart Vector node in Nuke produces faster, more accurate tracking data by calculating pixel motion between frames. The channel’s values represent where the pixel moves on the subsequent frame and where it came from in the previous. Smart Vectors use this information and make it super easy to essentially stick one asset element to another or remove a blemish, all with minimal work and within achievable deadlines.

Below, Nuke expert Josh Parks looks at some tips concerning how to use this handy tool in your work.

Did you know?

ftrack Studio integrates with Nuke to allow for easy tracking of tasks from directly within in Nuke.

Smart vectors 1

1. Keep things light – Precomp Smart Vectors as an STMap

Smart Vectors represent the movement of every pixel in your shot—that’s a lot of information to calculate, meaning Smart Vectors can be very computationally intensive. Of course, you could precomp them out. However, the problem is that you’d have to hook the precomp up to a Vector Distort node to distort your chosen image—a similarly data-heavy process.

So, how can we avoid working with information-heavy Smart Vectors? We use the STMap! You can apply your distortion to an STMap and precomp it out. You can then precomp the heavy parts of the usual Smart Vector setup and apply the movement using a lightweight STMap node.

To create an STMap, use the following expressions in the following channels of an expression node:

  • Red channel: (x+0.5)/width
  • Green channel: (y+0.5)/height

You will now have an STMap. You can apply your Smart Vector motion vectors to this STMap and precomp your image. Once precomped, disable the Smart Vector and Vector Distort node and apply the STMap using an STMap node. You’ll now have a less computationally intensive workflow.

Smart vectors 2

2. Improve quality with Smart Vectors – Pre-treat the plate

Even when using Smart Vectors, achieving a smooth, clean image result can be difficult. Thankfully, I have a few handy tricks to make things easier. For starters, you can pretreat your plate to enhance its details (a little like when you’re working on a 2D track). This process makes it much easier for Nuke to track each pixel and results in a better-looking output.

Here are some other go-to methods I turn to whenever I have a shot and the Smart Vectors aren’t working as I’d like them to:

  • Connect a Grade Node with gamma down and gain up. Doing so will increase the contrast in your image and make it easier for Nuke to track each pixel.
  • Add a slight Sharpen to your image to make the details pop. You must apply this Sharpen in log space to avoid artifacts. To do so, connect a Log2Lin node and set it to “Lin2Log”. Next, connect your Sharpen node, connect another log2lin node, and convert it back from “Log2Lin”.
  • Convert to a different Colourspace. Connect a Colourspace node and try going from linear to a colorspace in which the details pop out a little more.
Smart vectors 3

3. Speed up your workflow – Combine multiple Smart Vectors

As with keying, it’s unlikely you’ll achieve the perfect Smart Vector output using just one setup. To attain the best result for a particular area, you’ll want to adjust settings such as Vector Detail and Strength, which will pretreat your plate in different ways.

Combining two Smart Vectors with different settings can be useful. You can do so in a few ways. The best in my experience is to keymix the outcome of two Smart Vector nodes. Doing so will create multiple Smart Vector nodes in your script. However, so you may want to apply the result of each Smart Vector node to an STMap (as described above) and precomp out. You can then keymix these STMaps for a faster workflow.

Smart vectors 4

4. Use Smart Vectors to speed up your roto process

Generally speaking, Smart Vectors are used to stick one image to another. However, the feature has other uses: I’ve recently used them to speed up my roto.

Smart Vectors measure every pixel’s movement, so you gain a lot more flexibility than using a 2D tracker. Let’s use the example of a warping shirt requiring roto. As with a tracker workflow, you can roto the shirt on a frame with a little motion blur, enabling you to see the object’s true shape. Then, you can set this frame as your reference frame in the Vector Distort node and run your alpha matte through your Smart Vector setup.

Next step: cross your fingers! Although this workflow doesn’t always work, it can save a ton of time when it does. Using Smart Vectors is my go-to when I need to perform a bit of roto, and I want it done quickly.

Smart vectors 5

Try Nuke in ftrack Studio

Start your free trial of ftrack Studio and see first-hand how it seamlessly integrates with Nuke for stress-free production tracking.
I'd like to try ftrack
Smart vectors a

More from the blog

Enhanced performance in ftrack Studio: Fine-tuning for speed, reliability, and security

| API, Developer, New features, Product, Productivity, Studio | No Comments
From significant API query speed improvements to the adoption of Python 3, ftrack Studio has recently received a batch of speed, reliability, and security enhancements to make your project management…

Backlight and the Visual Effects Society forge a partnership for the VES Awards judging process

| Case Study | No Comments
Backlight was thrilled to be invited by the Visual Effects Society (VES) - the VFX industry’s premier global honorary society - to help support the virtual judging process for its…

Presenting the new sidebar: Enhancing project navigation in ftrack Studio

| New features, Product, Release, Studio | No Comments
We’re excited to announce the rollout of a new sidebar in ftrack Studio, now accessible across all views. This update marks a big step in our ongoing effort to refine…

Achieving Better Feedback Cycles and Faster Nuke Workflows at D-Facto Motion Studio

| Case Study, Studio | No Comments
D-Facto Motion GmbH is one of the largest and most well-known studios in European visual effects and post-production. With a presence across seven cities in Germany and a new facility…

Making the switch: The transition to cineSync 5

| Announcements, cineSync, News, Product | No Comments
cineSync 5 is going to become the primarily supported version of cineSync. Here’s what’s changing, why, and how it will supercharge your next project. Last year, we unveiled cineSync 5,…

Supporting Your Studio: Free ftrack Studio Training and Office Hours from Backlight

| News | No Comments
Our industry has recently faced the toughest challenges ever encountered. As the echoes of industry strikes begin subsiding, we offer our support to empower and uplift the film and TV…

What’s new in cineSync – a deeper iconik integration, laser tool, OTIOZ support, and more

| cineSync, New features, Product, Release | No Comments
cineSync's latest update brings flexibility and precision to your cineSync experience, making it easier to connect your review sessions with media management and storage in iconik, introducing color profiles to…

The Imaginarium Studios: Running a Thriving Motion Capture Studio with ftrack Studio

| Animation, Case Study, News, Q&A, Review, Studio | No Comments
Formed in 2012 by legendary actor and director Andy Serkis and led by CEO Matt Brown, The Imaginarium Studios is a performance-led capture and virtual production studio with facilities located…