Week 1: Introduction to the compositing software Nuke
“NUKE” is a high-end visual effects and compositing software widely used in the film, television, and animation industries. Developed by Foundry, it specializes in node-based compositing, allowing users to seamlessly blend and manipulate multiple visual elements in a highly efficient, non-destructive workflow. NUKE is known for its robust toolset for tasks like 2D and 3D compositing, keying, tracking, and rotoscoping, and is often used in complex visual effects pipelines for feature films and commercials.
-Nuke Shortcuts:
General Shortcuts
Ctrl + N (Cmd + N on Mac): New script
Ctrl + O (Cmd + O on Mac): Open script
Ctrl + S (Cmd + S on Mac): Save script
Ctrl + Z (Cmd + Z on Mac): Undo
Ctrl + Y (Cmd + Y on Mac): Redo
Space: Toggle fullscreen
Node Graph
Tab: Open the node creation menu
D: Disable/Enable a node
Ctrl + C (Cmd + C on Mac): Copy node
Ctrl + V (Cmd + V on Mac): Paste node
Ctrl + X (Cmd + X on Mac): Cut node
Delete: Delete node
A: Auto-arrange nodes
Shift + X: Swap input connections
Viewer Controls
1, 2, 3, … 9: Connect viewer to node (corresponding to number pressed)
F: Fit the image to the viewer
H: Home (reset viewer position)
R: Reset viewer to 1:1 zoom
Ctrl + Shift + Click (Cmd + Shift + Click on Mac): Set viewer focus to clicked point
Arrow keys: Pan the viewer
Playback Controls
L: Play forward
J: Play backward
K: Stop
Left Arrow/Right Arrow: Step backward/forward by one frame
Alt + Left Arrow/Right Arrow (Option on Mac): Step backward/forward by 10 frames
Node Shortcuts
M: Merge node
G: Grade node
R: Read node
T: Transform node
S: Shuffle node
K: Keyer node
Ctrl + Shift + P (Cmd + Shift + P on Mac): Create a new backdrop node
Z: Z-Depth-related nodes
Transforming/Manipulating Nodes
Shift + Click + Drag: Move node in node graph
Ctrl + Shift + Click + Drag (Cmd + Shift on Mac): Select and move multiple nodes
Alt + Drag (Option on Mac): Copy node
S: Open project settings
Ctrl + Shift + L (Cmd + Shift + L on Mac): Toggle autolabel of nodes
Viewer Adjustment Shortcuts
Alt + Click + Drag (Option on Mac): Adjust brightness
Alt + Scroll Wheel (Option on Mac): Zoom in/out
Shift + Scroll Wheel: Adjust gamma
Demo exercise in week 1’s lecture:
This is the main Nuke HUD
Press [tab] to add a node of your choosing.
Press [F] to focus on any selected area such as the screen or a node
Assign your nodes by numbers in order to shuffle between them
I can shuffle between selected nodes by pressing their assigned number.
I added the following nodes to experiment on.
I added a “transform” node by pressing T or T while a node was previously selected so the transform will by default link to said node.
I used the transform node to move my color wheel around in the viewport.
I added a blur node and gave it an increased value on the color wheel’s edges by picking the “gaussian” setting.
Press [S] on the properties panel to check the render properties of your scene.
I was given different background and foreground layers which I had to rearrange their nodes in the proper order so my composite would come together properly.
Week 2: NUKE Rotoscope Basics
Rotoscoping is an animation technique where animators trace over motion picture footage, frame by frame, to create realistic action. Initially developed for traditional hand-drawn animation, it’s now used in a wide range of visual effects, especially in films and digital video. The process allows for the seamless integration of animated characters or effects with live-action footage. Modern applications often involve separating foreground objects from the background in video, a technique used for tasks like compositing.
The technique was invented by Max Fleischer in 1915. Fleischer used a specially designed projector to project live-action footage onto a glass panel where it could be traced. His first major application of the technique was in his Out of the Inkwell cartoon series. Today, rotoscoping is still a fundamental part of many visual effects workflows, though digital tools have largely replaced the manual frame-by-frame process.
Reference: Halas, J. (1987). Computer animation: theory and practice. Taylor & Francis.
Ideal Folder Structure for NUKE
Exercise 1:
I added my video of independently moving candy pieces.
To begin “rotoscoping” I added a “copy” node using [K] and a “Roto” node using [O]
With the Roto node selected I equipped my “Bezier Pen” tool to draw where my mask was going to be.
The alpha channel of my mask.
I can also used a rectangle masking tool.
Next, I picked a frame where the video had the least movements so the Roto mask can work more effectively.
I traced my shape around my object.
[M] to show overlay for a clearer trace.
I set my key frame at the end of the timeline.
I set my keyframe at the start.
Applying what I learned
Week 3: Advanced Rotoscoping
My initial scene: I needed to develop a technique to effectively rotoscope the man’s hand.
This was where the hand in the video had the least motion- hence where it was going to be the easiest to begin rotoscoping.
Dividing the hand so I can rotoscope individual shapes on it was the way to go. Too much points in a rotoscope would cause a jitter effect in my video.
Rotoscope using the “B-spline” pen according to my theory of dividing my hand (and fingers) into different parts to rotoscope.
Control to and drag to select multiple points.
My final product:
Bonus: rotoscoping the whole body:
My final product
Week 4: Keying
My first attempt at keying in NUKE without any prior knowledge
Exercise 1 required me to key out the sky of my first image and replace it with a sky of another image.
My main image
The sky image asset
Pressing [Y] activates “Luminance” vision.
I added a “Keyer” node to create and adjust my alpha.
My node tree so far…
I rotoscoped the area I did not want to fall under the effect of my sky asset.
I inverted my keyer’s selection to adjust the white values in my alpha.
I added a merge stencil to separate my alpha
I added a “garbage” rotoscope node to get rid of unwanted alpha that was in my original image.
The script code for a color adjustment node I am going to copy and paste into NukeX,
The color adjustment node
The final result
Luma Key: adding clouds to the sky
Week 5: Color and Color Grading
Exercise 1:
My goal was to color grade the women and not the background.
Viewing my images with heavy blur really helps me distinguish the different colors in an image.
I viewed my LUMA levels [Y] to make it so that the aperture slider diminishes all the blacks in my image at the same time.
Before
After
Exercise 2:
I wanted to clean this uncanny shade.
To take a step further, I rotoscoped the windows and key framed my multiply node under each separate grade node connected to its separate rotoscope node.
Note: do not duplicate the rotoscope node to use it on another grade. Rotoscope nodes retain data and unless you remove that data, the graded colors will mix.
My final result:
Bonus:
Target
Starting point
Result
Week 6: Tracking
One point tracking
The gray area is not tracked properly in this scene.
Two point tracking:
I want 2 tracking points to rotate alongside their designated buildings in the scene.
Planar tracking
I wanted to track the car’s wind sheild.
Week 7:Clean Up and Patch Repair
Exercise 1: Introduction to the “Clone” tool
This is the “Rotoscope Paint” tool.
I can use the Roto-paint tool to paint out the foreground into my scene such as the color bars image.
In the Roto paint node, I can select “Clone” so I can eye drop a color in my scene which will be painted over any areas I want to hide.
I added a tracker so the previous effect can be applied to all my scene instead of just one of its frames.
My finished product
Exercise 2: Masking out and Adjusting the Noise in a Scene
I needed to get rid of the old man in the red circle.
I added a tracker to track the scene’s movement around him.
After adding the “Frame Hold” node, I was able to freeze a later on frame in the scene in which the old was not present.
I Rotoscoped the area I wanted to cut out.
It worked. However, the women which I wanted to stay in the scene was affected by my Rotoscoped area.
My node tree up to this point:
I added a multiply node and keyframed its value at the point she went in the roto and right afterwards.
Since the Rotoscope step, I had uneven noised in my scene as shown in the “Blues” view. Note: the last color the human eye sees is blue.
I tracked my uneven noise area with the “Denoise” node’s tracker. Then, I added a noise node and adjusted its settings.
Before
After
My final node tree.
My final product
Week 8: Complex Tracking
Planner Tracker
I needed to use a “Planner” Tracker to get rid of the people in this video
I rotoscoped the shape near the people so my planner tracker will recognise how the video moves around them.
The corner pin node is my tracking node.
My final product
Week 9: NUKE Recap Rotoscope and Tracking: