Week 1- The age of the image, trend of the lens

A trend in VFX is when a certain technique or method is used more than a couple times. an example of a trend is motion tracking. Motion tracking is used in most current movies and tv shows.

Another trend in VFX is real time rendering. With Realtime rendering you are able to make changes to any aspect of your work in the software in real time.

De aging:

Blog Post: What is a Current Trend in VFX

A current trend in VFX is the emergence of Virtual Production, which blends real-time rendering, LED walls, and motion capture to construct enthralling environments straight on set. Used in productions like The Mandalorian and House of the Dragon, this technique permits filmmakers to visualize their digital domains in real-time as opposed to using extensive green screens and post-production CGI. It delivers a heightened realism that’s integrated with live-action under a variety of lights, circumstances, and camera configurations. Here are some at a glance.

A trend can be understood as a dominant movement, innovation, or shift influencing an industry. In VFX, trends emerge because of technological advancements, evolving audience expectations, and industry demands. Virtual Production has become an increasingly popular trend in VFX; it has shifted the industry toward integrated filmmaking, where physical and digital elements blend more seamlessly than ever. This is not just a trend. Everyone in the industry from filmmakers to technicians to software engineers is excited about the possibilities virtual production offers.

Another significant development is the use of tools powered by artificial intelligence, which are shaking up the labor-intensive processes of same-time visual effects. Tools that are powered by artificial intelligence, such as Adobe I/O, do the hard work of number crunching that computers are so good at. But most significant for the average user, these AI tools have a way of crunching data that gives users more bang for their buck because, on the whole, they work faster and more efficiently.

These trends show that VFX is becoming more efficient, realistic, and under the creative control of filmmakers. In particular, Virtual Production is redefining the art of the moving picture by bridging the gap between practical effects and CGI, giving directors the ability to tell their stories with an unprecedented level of immersion. Stated simply, the evolution of VFX is the evolution of cinema itself.

Face replacement:

 

 

Week 2: The Photographic Truth Claim: Can we believe what we see?

Example of an image being more like reality, and is reality becoming more like an image?

Ai upscaling images enhancing and adding a 4k resolution to images.

Blog Post: Write a post on the Photographic Truth-Claim

The photographic truth-claim is the extremely old belief that photographs in themselves in fact verify reality as objectively and truthfully as is feasible. It is a belief generated by mechanical camera technology, which, unlike human experience, neither distorts nor misreads what it captures. The world at large has accepted photographs as true representations of objects, places, and people since the advent of photography. However, with the advancements in digital technology, particularly with visual effects and photo manipulation, this assumption has been challenged.

Thanks to the advancements of digital compositing, CGI, and artificially produced images by means of AI, real and created images are increasingly inseparable from one another. Filmmakers, television producers, and even the news media heavily use methods such as photorealistic rendering, deepfakes, and digital de-aging of actors, so much so that it is difficult to be certain if a raw photo really is as-is or augmented and manipulated. For example, Robert De Niro was decades younger in The Irishman, utilizing VFX to change reality convincingly.

However, the claim of truth within the photograph remains relevant culturally. In journalism and documentary filmmaking, there exists an assumption that photographs present honest representations of what occurs in the world. A moral problem occurs when images are presented as reality when, indeed, they are manipulated, affecting public opinion and the history of the record.

In the end, as photography is still connected to truth, technological progress has moved the issue to one of credibility and purpose. No longer is the debate whether or not a photograph represents reality, but whether or not its application is true to the expectation of the viewer of authenticity.

Week 3: Faking Photographs

Blog Post: Write a definition of VFX compositing. What is it and how does it work?

Compositing VFX is the merging of multiple visual items into a final uninterrupted shot. Filmmakers’ most valuable asset in today’s times, compositing allows the joining together of digital effects, CGI, and live-action shots. Compositing helps create realistic sets, merge digital characters, or add to the scene with elements like explosions, weather, or replacement background.

It involves a variety of techniques, the most commonly utilized being chroma keying, rotoscoping, layering, and color grading. Filmmakers use chroma keying, commonly known as green screen technology, to replace a green or blue screen with a digitally generated environment. Rotoscoping involves hand-tracing items frame by frame in order to separate them from the background, and it is helpful in the blending of real actors with the use of CGI components. Layering combines multiple visual elements such as foreground, background, and effects so they convincingly interact with each other. Finally, color grading and correction are utilized in matching the lighting, the shadows, and the texture so the composite would look real.

Compositing is generally carried out with the help of professional software such as Adobe After Effects, Nuke, and Fusion, with advanced tools for managing and blending things together. High-budget films use advanced 3D compositing in order to composite digital objects into real-life-action shots with real depth and motion tracking and real reflections.

VFX compositing has a significant role in films such as Avengers: Endgame or Avatar, in which worlds and characters are generated digitally yet look as if they are part of real environments and actors. Compositing remains one of the foundations of visual effects, which brings it to the next levels in filmmaking today.

Week 4: The trend of Photorealism

Photo realism can apply to whole scenes and shots

can apply to different individual characters

can be only computer generated images

it may consist of a mix of CGI and filmed footage

Version 1:

I Am Legend (2007) CG zombie dogs

I Am Legends (2007) CG Zombie Humanoid

Tron Legacy (2010) CG Environment

Interstellar (2014) CG Environment

Version 2:

Sin City (2005)

 

Blog Post: Write a post on Photorealism

Photorealism is the creation of images that are indistinguishable from real real-world shots. In VFX, the creation of photorealism is achieved through the replication of real-world lighting, texture, physics and camera dynamics in order to blend digital elements with live-action elements in a manner indistinguishable from the real thing. Photorealism is utilized heavily in film, television, and videogame production to enrich the storytelling and create immersive environments.

In order to achieve photorealism, VFX artists rely on realistic lighting simulations and complex textures and the latest techniques in rendering. Among the most significant are the principles of ray tracing, simulating the way in which light interacts with surfaces and creating accurate reflections and shadows and depth cues. Another core technique is Physically Based Rendering (PBR), getting metal, glass and skin reacting to light in a realistic manner.

One of the best examples of cinematic photorealism would be The Lion King (2019), in which the application of CGI was used to recreate the African savannah and wildlife with flawless detail. Another would be the application in the film Blade Runner 2049 combining digital sets and effects and real-world camera shots to produce a hyper-realistic future.

Photorealism is similarly important in de-aging technology in The Irishman, where actors have been digitally de-aged through decades with the use of CGI. Virtual production in The Mandalorian similarly utilizes real-time render to show photorealistic sets on LED screens.

The greater the VFX technology advances, the better the photorealism and the closer the gap between the real and virtual grows. It challenges the viewer to identify the real and the CGI, opening up to the future for cinema.

What does Photorealism mean in the realm of visual effects? What makes something appear realistic? How do these attributes distinguish photorealism from other styles or techniques in VFX?

Week 5: Bringing indexicality to the capture of movement

Blog Post: Write a post comparing Motion Capture to Key Frame Animation

Motion capture and key frame animation are both animation and visual effect techniques both with a different mechanism of generating motion. Both the techniques have existed in the situation of contemporary film-making and animation but both are distinct in the manner the motion is generated and utilized in the objects or characters.

Motion capturing is the procedure for taking live actor or object movements through the use of special cameras and sensors. The movements are converted into digital form and later simulated through the use of software to create the final 3D characters to be translated into animation form. The use of MoCap is rampant in films like The Lord of the Rings and Avatar, where human locomotion, expressions, and performances are captured and translated into digital characters with realistic movements. The procedure is reputed for creating realistic and organic motion because it’s a depiction of real human movement.

Conversely, key frame animation is a more conventional method where the animators set the key poses or frames by hand and the computer fills in the gaps in between. Key frame animation gives the animators greater control and allows the creation of stylized or exaggerated motion that will be difficult or even impossible to do using MoCap. The Incredibles and Spider-Man: Into the Spider-Verse use key frame animation to create dynamic and highly expressive characters.

While key frame animation is supreme in stylization and artistic liberties, the moCap is well-suited to realistic and organic movements. Most games and movies utilize both to some extent in a bid to mix realism and artistic liberties and form the forte of both the techniques.

Week 6:

Blog Post: Write a Case Study post on Reality Capture

Using cutting-edge technologies like LiDAR scanning, photogrammetry, and 3D modeling, reality capture is a groundbreaking process that produces precise, high-fidelity digital replicas of real-world settings. A very effective technique for combining live-action and digital aspects in filmmaking and producing immersive worlds is reality capture.

The Mandalorian (2019), which used virtual production and LiDAR scanning to create breathtaking environments that are indistinguishable from live-action shots, is one of the best examples of reality capture in action. Filmmakers could produce incredibly detailed 3D models of buildings and landscapes by scanning real-world sets. During real-time filming, actors were able to perform within photorealistic sets thanks to these being projected onto LED screens.

The 2019 film The Lion King also made use of reality capture, employing LiDAR scanning to digitally recreate the entire African savanna. The team converted real-world objects and animals into 3D assets by using photogrammetry to capture them in great detail. As a result, they were able to create lifelike settings and animals that blended in seamlessly with the animated world.

Reality capture is particularly useful for worlds that are either impractical or impossible to film in, like alien planets or the past, because it not only adds realism but also eliminates the need for expensive and time-consuming practical sets. As this technology advances, it’s also changing the way filmmakers approach world-building, giving them new creative options and simplifying the production process.

Assignment 2: Current Trends Essay

How do Spectacular, Invisible, and Seamless Visual Effects influence Modern Filmmaking?

Visual effects (VFX) have revolutionized modern filmmaking, creating immersive experiences that captivate audiences and enhance storytelling. Visual effects are categorized into three main types: spectacular, invisible, and seamless visual effects. Spectacular visual effects are highly noticeable and visually stunning and are designed to impress and excite the audience and create scenes that would be impossible, too costly, or too dangerous to capture in the real world, such as an unearthly creature or a superhero. Spectacular visual effects are mostly used in fantasy, science fiction, and action films. They create visually stunning and mind blowing moments that are normally unachievable to do in real life settings. Examples include the action scenes in Doctor Strange in the Mind-bending and reality-warping parts of the movie, blending magic, physics, and surrealism into the scene. As well, the CGI na’vi in Avatar along with the bioluminescent ecosystem in their world , Pandora, which features glowing forests that were fully computer generated, along with various types of alien wildlife. And lastly, the creation of massive hordes of running zombies in World War Z. Procedural animation and crowd simulation software was used to generate thousands of zombies including an aspect of artificial intelligence, where the zombies behaved like a fluid or a slime, climbing on top each other to reach where they needed to go.These effects focus more on spectacle rather than realism, emphasizing and showing off creativity and technological advancements. They are meant to dazzle viewers and create unforgettable moments.

Seamless visual effects are used to blend real life and digital elements together in a way that looks and feels natural, blending flawlessly into the scene and are usually not too eye catching in order to maintain the viewers immersion. Seamless visual effects often work as a tether between spectacular and invisible effects. The effects maintain realism while adding artistic and imaginative elements, but nothing to distract the viewer from the narrative or the scene. Some examples of seamless visual effects are, animals that come to life, such as The Lion King and Tiger from The Life of Pi, which interact naturally with human characters while obviously standing out as fantasy and make believe. Another example is the earth viewed from space in the movie Gravity, the earth is all CG but it blends seamlessly with the scene and does not take the attention away from what is going on in the scene. Seamless visual effects enhance storytelling by making sure CGI elements feel integrated into, rather than separate from the real world and can blend reality with fantasy.

Invisible visual effects are the hidden heroes of visual storytelling. They very subtly enhance realism, and do their job by making sure that every scene appears authentic, immersive and real without drawing any attention to the visual effects behind them. Invisible effects are subtle and blend seamlessly with live-action footage, enhancing realism without drawing attention. Invisible visual effects are in most movies and TV shows nowadays, and they can be used to create historical environments, adjust lighting, remove unwanted elements, and add details like weather effects and anything else along those lines. Some examples of invisible visual effects include the recreation of the historical Colosseum in The Gladiator, and the recreation of London during the war in World War 2. Their job is to support the storytelling and narrative by making scenes look completely natural and believable whilst maintaining the effect’s secrecy. This essay will focus on and explore the role of invisible Visual effects in filmmaking, examining its significance in digital storytelling, its reliance on VFX software, rendering, compositing, CG, and its integration into modern film and TV production.

Invisible visual effects play a crucial role in strengthening realism and supporting a film to develop it’s desired narrative. In contrast to spectacular effects, which emphasize the impossible being possible and emphasizing the extremely impressive and stunning visuals, invisible visual effects’ main goal is to remain unnoticed, ensuring that the audience remains fully immersed in the story at all times. These effects are used to modify backgrounds, recreate historical settings, and gently enhance details that would otherwise be difficult to achieve practically. For example, Forrest Gump starring Tom Hanks used invisible visual effects to integrate Tom Hanks into various historical events that were caught on camera, they also removed Lieutenant Dan’s legs, and enhanced real world locations, all while keeping its realism and going basically unnoticed by the viewer. The way invisible visual effects are even possible is largely dependent on modern digital software being able to complete these sorts of tasks, such as compositing, rendering, and photographic manipulation. Compositing involves combining multiple videos and visual elements into a single, cohesive shot, having the final output of the compositing seamlessly blend with the live action footage. Rendering makes it possible for the creation of realistic lighting, textures, and movements that align with real-world physics. Photographic manipulation works by adjusting colors, shadows, and reflections to maintain consistency and fluidity between digital and practical elements. These techniques align with photorealism and mimesis, ensuring that the effects created replicate real world visuals convincingly. The historical reconstruction of ancient Rome in Gladiator exemplifies how these techniques bring historical settings to life while maintaining authenticity. Without invisible visual effects many viewers would not be able to be fully immersed into historical settings and witness what it was like back in the set time frame of a film or series. The ability to bring the viewer back in time and immerse them in the past is one of my favorite things about invisible visual effects.

The success of invisible effects heavily relies on careful planning during production. Directors and producers must work with visual effects supervisors and consider VFX requirements when designing sets, selecting shooting locations, and planning camera movements. Without a visual effects supervisor, the director and producer would not have the eye or the experience to create shots viable to create convincing scenes in films. Motion capture technology allows filmmakers to combine computer generated characters seamlessly into live action scenes, for example in War for the Planet of the Apes, Andy Serkis who played the role of Caesar really showed how motion capture could deliver emotionally powerful performances, even being able to capture his specific facial expressions and movements down to a T to ensure that his expressions and movements remained lifelike. Motion capture is also used in a lot of video games creating a highly realistic character for players to embody and control. Similarly, digital aging and de-aging techniques, such as those used in the movie The Irishman. CGI was used to de-age Robert De Niro, Al Pacino, and Joe Pesci, allowing them to embody their younger selves and play their characters across multiple decades, enabling filmmakers to maintain a consistent narrative without having to rely on multiple actors or extensive makeup to achieve the desired result.

Virtual production has further transformed the use of invisible visual effects, they combine real time digital environments with live action filming. This technique replaces the traditional green screens with LED panels that display CGI backgrounds in real time, which allows actors to interact naturally with their surroundings as they can see the environment around them, and immerse themselves into the scene allowing actors and actresses to further their skills in the scene. For instance, in The Batman they used LiDAR scanning to map Gotham City, blending real locations with CGI extensions, they also used virtual production for Gotham City’s skyline, letting actors interact naturally and realistically with the environment around them. These techniques reduce post-production efforts while also improving the visual authenticity of the shot. This innovation streamlines a major part of the filmmaking process, while always making sure that invisible effects remain as realistic and effective as they can be.

Despite being a major part of most movies and TV shows, invisible effects often go largely unrecognized by audiences; this is due to the fact that they are designed to be unnoticed. All of their success lies in their ability to create realistic and believable environments that contribute to the narrative without drawing any attention to the technical expertise behind them. However, their impact is for a fact, shaping the way filmmakers tell stories and allowing for a much greater creative flexibility. As technology advances, invisible effects will continue to play a vital and main role in movies and TV shows, as they seamlessly merge reality and digital artistry to create a better, more immersive experience for the audience.

In conclusion, invisible visual effects are a fundamental aspect of modern filmmaking, they provide an extreme amount of realism and depth to narratives without taking over the attention of the  story. Through advanced digital tools and careful integration into the production process, these effects greatly enhance the audience’s engagement and immerses them deeper into the film than they would be if invisible visual effects were not used. While they may not be as engaging and visually striking as spectacular visual effects, the contribution of invisible visual effects has given to enhance the cinematic realism is truly irreplaceable. As filmmakers continue to work, they will continue to push the boundaries of digital storytelling, and invisible effects will remain a much needed tool in creating unimaginable and believable worlds on screen.

 

References

Eran Dinur (2017). The filmmaker’s guide to visual effects : the art and techniques of VFX for directors, producers, editors, and cinematographers. New York: Routledge, Taylor & Francis Group.

‌www.foundry.com. (n.d.). Hidden in plain sight: the art of invisible VFX | Foundry. [online] Available at: https://www.foundry.com/insights/film-tv/art-of-invisible-vfx.

admin (2017). The Secrets Behind Invisible Effects – VFX Voice Magazine. [online] VFX Voice Magazine. Available at: https://www.vfxvoice.com/the-secrets-behind-invisible-effects/ [Accessed 27 Mar. 2025].

Keil, C. and Whissel, K. (2016). Editing and special/visual effects. London ; New York: I.B. Tauris & Co.