3D Match Moving

Week1

Nuke 3d and Camera Projection

We began learning about the basics of 3D view space in Nuke during the first lesson of the 3D Match Moving. We began by bringing the Scene Node and the Camera Node for that.

Press TAB key top Switch between 2D to 3D.

Scene and Camera Node

3D Camera in the scene

Later, we introduced the color bar, but first we had to bring the card node and connect it to the scene in order to see it in 3D.

Color Bar

Scanline render node is used to return it to a 2D environment. . You could connect 2D nodes to your asset before the card node if you have numerous assets and you just want to change one of them.

ScanlineRender [3D]

Later on, we learn how to control the movement of the camera and import 3D objects from Maya into Nuke. To do that, we created a straightforward cube model and included a camera in the frame. Following that, we created a basic animation using a camera movement.

Maya work flow

 

To import a Maya file into Nuke, first choose the object to import into Nuke. Next, pick Cache -> Alembic Cache -> Export Selection to Alembic.

Process

Once the file has been dropped into the Node graph, link the nodes that we previously utilized, then change the view from the top and choose Camera 2.

Nuke

Week 03

3D Equalizer

This week, we learned about 3D Equalizer, an industry standard program designed specifically for tracking. It is a really simple tool, with the sole purpose being to track by producing many points around the scene. The more trackers and points there are, the more sophisticated the 3D model will be created, ensuring that it fits the scene precisely in the event that 3D modeling is required later on.

The 3D Equaliser’s default blank interface

Since the only thing this software can work on is image sequences.

Importing image sequence

Pathway to import image sequence

Workspace after importing Image Sequence

Later, we made shortcuts by referring to the flowchart, which was beneficial because it expedites and simplifies labor.

Shortcuts for the software

We need to program in our camera settings next. You are constantly given information about the camera’s lens, sensor size, focal length, and other specifications when this is utilized in the industry. This will allow you to precisely match the CG elements you have on film with your real-world assets. Here, we modified our focal length and sensor size by only using the data that we discovered online.

Changing the Camera setting

We must export the Buffer Compression File, which is in the Playback Option, in order to get the clip to play consistently.

Export Buffer Compression File

Exporting to run file consistently.

Trackers

Week 04

Lenses and Cameras

We are studying camera sensors and lenses this week. We learned a lot from this session, which will help us move toward more precise and effective 3D matchmoving.

We are studying camera sensors and lenses this week. We learned a lot from this session, which will help us move toward more precise and effective 3D matchmoving.
We also get a thorough understanding of how sensors function and how focal length and sensor size interact. The most important lesson we learned was that, even if the camera and sensor remain the same, a small change in focal length can significantly alter the image.The image will be closer to the topic the longer the focus length.

 

Week 05

 Filming

This week, we went out for filming, which was a great experience because we learned how the entire procedure works. In this, we took on several tasks such as operating the camera, assisting others, and keeping track of the photos.

Aside from capturing the videos, we also acquired HDRIs and performed photo scanning to produce 3D models.

 

Assignment 01

Our task for this project was to follow the scene while performing matchmoving. In 3DE, i created locators for that initially. Making at least 40 trackers was the requirement. After the tracking was completed, all of the data had to be calculated. Following the distortion of the trackers, all of the data was imported into Nuke, where I made the sign board patch, changed the sport’s locators, and set the 3D model that I had obtained from 3DE.

Survey Data

Lens Setting

Camera Setting

Tracker Points

CALC

Lens Distotion

Adding 3D Object and locators

Locators and 3D Objects

After that we exported out all the data to Nuke

Bringing the file to Nuke

 

Original 

 

Locators

 

With BOX

 

FINAL

Clean up

Assignment 01 Breakdown

 

Week 06

3DE Free flow and Nuke

We are learning how to move data from 3De to Nuke this week. Using Nuke, we establish a tracking data of the door and the sign board in this session. We then position the locator and remove the written work from the sign board to composite the data.

Tracking

Created Locators and 3D model in 3DE

Nuke Script

Final Video

 

Week 08 

Lens Distortion and Grids

This week, we study the operation of lens distortion.

Tracking Points

No Camera Constraints

Calc

After Changing Camera Constraints

Adding New Sequence Camera

Distortion Grid

To extend Grid

Extension

Calc Distortion

Undistord

Parameter Adjustment

 

Week 09

Dynamic Lenses

This week, we examine how 3DE operates in situations where the lens is close to the subject when we used dynamic zooming to change the focus length.

Camera

Lens

Adding Trackers

 

Week10

Nuke Maya Pipeline

We are studying the industrial pipeline this week. how to transfer a video from one program to another. To begin with, we created tracking points using h3De., we exported the video to Maya, where we used 3D Model to tweak the lighting and got a render output. Afterwards, we took the CGI video and manually composed it in Nuke.

Exporting to Maya

Maya interface

 

Final

 

Assignment02

1980s Billboard and Street Light

Final Marker Script

Final Script

Final