Investigative Study

Week 01

We start the week off by considering and talking about possible essay topic topics.
Some interesting topics were brought up.

AI’s impact on the VFX business

As the AI revolution continues to grow, it has gotten easier to create something that doesn’t exist. It has an impact on the VFX business

swapping real artists for computer-generated characters

Since it’s easier to deal with them Real artists are becoming less valuable and are gradually being replaced in terms of production.

Animal handling

Investigating the use of CGI animals and the need of animal safety in movies.

Deepfakes 

In today’s lecture, we will explore what deepfakes are, how they are created, and their applications in the entertainment industry. This leads us to the first question: what exactly is a deepfake?

In visual effects and cinematography, deepfake technology uses artificial intelligence to produce fake material that looks realistic. In order to edit photos and videos, it usually integrates machine learning techniques, like neural networks. This enables creators to create fully synthetic performances, mimic voices, or exchange faces. While deepfake can improve storytelling by bringing historical people back to life or changing the appearance of actors, it also presents ethical questions about permission and misrepresentation. Its increasing accessibility puts traditional filmmaking methods to the test, igniting debates about authenticity and possible technological abuse in the business. As deepfake develops in visual effects, striking a balance between creativity and accountability is essential.

Some examples of DEEPFAKES used in movies and shows:

DEEPFAKE

FACE MERGE

 

Week 02

AI developments with photography and VFX

The photographer acknowledges using artificial intelligence to create the winning image.

The Article

Photographer admits prize-winning image was AI-generated | Sony world photography awards | The Guardian

These days, artificial intelligence is used everywhere, from creating sentences to creating images that didn’t exist before. With the right impression, artificial intelligence can create representations of everything it has been trained to do, which often makes people wonder if it will eventually replace the creative industry. On the other hand, it has proven helpful for a lot of things.

In addition to being utilized to make eye contact with the camera, people also use it to make expressions for characters. I thought it was fascinating that with AI’s assistance, creators don’t have to worry about constantly staring at the camera because they can read the scripts while their eyes are on it.

AI tools replacing the work of VFX artists in terms of budget and vfx production

 

Proposal for an essay

Technology’s impact in the creation of VFX.

In recent years, the rapid advancement of technology has profoundly transformed the creation of visual effects (VFX) in the film and media industry. Historically, producing a single VFX shot required immense effort and time from artists, often involving intricate manual processes. However, with the advent of sophisticated tools and software, what once took days or weeks can now often be accomplished in just a few clicks. Technologies such as computer-generated imagery (CGI), real-time rendering, and machine learning have not only streamlined workflows but also enhanced the creative possibilities for filmmakers. As a result, artists can focus more on creativity and storytelling, while technology handles the more labor-intensive aspects of VFX production. This shift marks a significant evolution in how visual effects are conceptualized and executed, paving the way for even more innovative cinematic experiences.

While technology has significantly enhanced the efficiency and creativity of VFX production, it has also introduced challenges, particularly regarding employment within the industry. The automation and advanced tools that allow for quicker and more sophisticated visual effects have led to a reduction in demand for certain traditional roles. Many artists find themselves displaced as software can perform tasks that once required extensive human labor. This dual impact highlights the need for professionals to adapt, learning new skills to remain relevant in an evolving landscape. Therefore, while technology has opened up exciting possibilities for innovation and storytelling, it also raises important questions about job security and the future of artistry in the VFX industry. Balancing these positive and negative aspects is crucial for navigating the changing dynamics of this field.

 

Week 03

Proposal question and Essay Topic

Revolutionizing Visual Effects: The Impact of Procedural Content Generation in Unreal Engine.

This essay explores the transformative impact of Procedural Content Generation (PCG) on digital content creation, particularly in the realm of visual effects (VFX) through Unreal Engine. It highlights how PCG enhances production quality and speed by automating the creation of complex assets and environments, enabling filmmakers and VFX artists to achieve unprecedented visual detail and scale. The discussion will include examples of projects that have successfully utilized PCG techniques to craft engaging narratives. Additionally, the essay addresses the limitations and challenges of PCG, as well as its future potential in the evolving landscape of digital filmmaking. Ultimately, it showcases how Unreal Engine’s PCG capabilities empower filmmakers to create immersive, real-time environments that captivate global audiences.

Presentation For the Essay Proposal

1

2

3

4

5

 

Week 04

Extra Practical Research for the related Topic:

AI impacts the cost of VFX production.

  • How Ai is been used in VFX Production.
  • How Ai is Impacting the Cost of VFX Production.
  • How Ai has replaced Man handling sectors from VFX Production Pipeline.
  • Comparison between Ai Cost  and VFX Artist Cost in Producing a Film.
  • Ai impacting on time consumption , both negative and positive in the process of Film making.
  • What Ai Applications and software are in the market which makes everyone VFX Artist by simple clicks.

 

Ai Rotoscoping using Runaway:

To give it a quick try I used one of the video I filmed and took it to Runaway and with the help of green screen tool I managed to get quick roto of the subject I made initial selection. Later i just expert it out to get the mask and just like this with in few minutes i managed to roto for the shot.

Before

 

After

Remove Background – Runway

I used the website called runway to test the accuracy of AI’s rotoscopy and clean plate capabilities for my essay proposal. I did this by using a video that we had filled out the other day. After adding a few points to the primary object, the video was automatically tracked for the duration and a green screen video was produced.

If an artist had been hired for the shot, the same thing might have taken longer.

 

Week 05

Investigative Study Proposal

Research Topic:

Revolutionizing Visual Effects: The Impact of Procedural Content Generation in Unreal Engine on Computer Generated Landscapes.

Introduction:

Digital content generation has changed as a result of the implementation of Procedural Content Generation (PCG), especially in the field of visual effects (VFX). With its advanced capabilities and effective PCG tools, Unreal Engine is leading this transformation. The idea of PCG in Unreal Engine and its significant influence on the VFX sector will be discussed in this essay. Filmmakers and VFX artists may now achieve previously unthinkable visual detail and scale with PCG’s development of new levels of efficiency and creativity through the automation of complex asset and environment production.

The essay will focus on how PCG improves production quality and speed by accelerating the development of dynamic simulations, realistic environments, and adaptive elements. Additionally, this essay will provide specific cases of the projects that have used PCG-driven techniques to create visually captivating stories. Furthermore discussed will be PCG’s drawbacks and restrictions as well as its possible prospects in the rapidly changing field of digital filmmaking. The essay will look at these components to show how PCG in Unreal Engine is changing visual effects and giving filmmakers new tools to create real-time environments and experiences that fascinate audiences worldwide.

Methodology:

The methodology for this essay will be a combination of practical research and case study analysis to provide a comprehensive understanding of how Procedural Content Generation (PCG) in Unreal Engine impacts visual effects (VFX). The practical research component will involve examining technical documentation and experimenting with PCG tools within Unreal Engine, such as its node-based systems, Blueprint scripting, and real-time rendering capabilities. This hands-on approach will offer firsthand insights into how PCG functions, its potential for asset and environment creation, and the challenges faced when integrating it into VFX workflows.

Additionally, the essay will include case studies of VFX artists and studios that have successfully used PCG in their projects. By analyzing their processes, interviews, and project outcomes, the essay will illustrate real-world applications of PCG in film and animation, highlighting best practices and lessons learned. Case studies will also explore the impact of PCG on production timelines, budget efficiency, and creative control. This combined methodology will provide both a technical and applied perspective, enriching the essay with practical examples and expert experiences that showcase the transformative role of PCG in modern visual effects.

Keywords:

  • Procedural Content Generation (PCG)
  • Unreal Engine
  • Visual Effects (VFX)
  • Real-time Rendering
  • Automation in VFX
  • Asset Creation
  • Digital Environments
  • Production Efficiency

Sources:

  • Community Tutorial on PCG in UE5.2 – This thread includes an in-depth tutorial on creating dynamic environments using PCG techniques. It’s a great starting point for understanding practical applications in visual effects: Community Tutorial: Procedural Content Generation UE 5.2
  • These resources should help you explore the PCG framework’s capabilities and its application in visual effects in Unreal Engine. For more comprehensive documentation, check the official overview: Procedural Content Generation Overview

    Talks and Demos from GDC 2023 – This recording provides insights into new PCG tools and features introduced in Unreal Engine 5, showcasing how to populate open-world environments: GDC 2023 Presentation Epic Developer Community Forums

  • Books: “Real-Time Rendering” by Tomas Akenine-Möller et al. or “The Art of Unreal Engine 5” provide foundational knowledge and practical examples.
  • Youtube: https://youtu.be/ncokCVoN-oU?si=WTETD62UeVQ5HBgt

 

Bibliography:

Epic Games Developer. (2024). PCG Development Guides | Unreal Engine 5.4 Documentation | Epic Developer Community. [online] Available at: https://dev.epicgames.com/documentation/en-us/unreal-engine/pcg-development-guides?application_version=5.4 [Accessed 2 Nov. 2024].

‌Epic Developer Community. (n.d.). Procedural Content Generation UE 5.2 – In-Depth Overview & Building Forest Environment | Community tutorial. [online] Available at: https://dev.epicgames.com/community/learning/tutorials/3426/unreal-engine-procedural-content-generation-ue-5-2-in-depth-overview-building-forest-environment.

Epic Games Developer. (2024). Procedural Content Generation Overview | Unreal Engine 5.5 Documentation | Epic Developer Community. [online] Available at: https://dev.epicgames.com/documentation/en-us/unreal-engine/procedural-content-generation-overview.

Epic Developer Community. (n.d.). Procedural Content Generation in UE5 | GDC 2023 | Talks and demos. [online] Available at: https://dev.epicgames.com/community/learning/talks-and-demos/Dlld/unreal-engine-procedural-content-generation-in-ue5-gdc-2023.

Akenine-Möller, T., Haines, E. and Hoffman, N. (2019). Real-Time Rendering. CRC Press.

‌First, P. (2024). PCG: First Steps to Advanced Development | Unreal Fest 2024. [online] YouTube. Available at: https://youtu.be/ncokCVoN-oU?si=WTETD62UeVQ5HBgt [Accessed 2 Nov. 2024].

Reference Images:

W‌eek 07

To explore the topic “Revolutionizing Visual Effects: The Impact of Procedural Content Generation in Unreal Engine on Computer-Generated Landscapes,” I will employ a practical research approach. Given the hands-on nature of this subject, my primary method involves implementing Procedural Content Generation (PCG) within Unreal Engine to create detailed landscapes.

I plan to design and develop a landscape using PCG techniques, subsequently analyzing both the time efficiency and memory consumption of the generated assets. PCG leverages algorithmic processes to produce complex, realistic environments swiftly and with minimal memory usage compared to traditional methods. By conducting this practical project, I aim to gain comprehensive insights into the effectiveness of PCG in generating high-quality visual content. Additionally, this approach will enable me to benchmark my results against industry standards, providing a clear understanding of PCG’s potential to transform the visual effects landscape.

In my research on “Revolutionizing Visual Effects: The Impact of Procedural Content Generation in Unreal Engine on Computer-Generated Landscapes,” I will delve into how Procedural Content Generation (PCG) operates within Unreal Engine 5 to create hyper-realistic, organic environments efficiently compared to traditional methods. The focus will be on analyzing how PCG frameworks expedite landscape creation and how they manage resources effectively.

To carry out my research, I’ll consult Unreal Engine documentation, community forums, and videos from creators to understand the in-depth functionality and potential applications of PCG. I plan to use the Procedural Content Generation Framework plugin exclusively, as it’s ideally suited for this topic. Through this hands-on approach, I will gauge the plugin’s effectiveness, test its output efficiency, and see how well it aligns with industry standards for time and memory optimization in VFX. This practical approach will provide a comprehensive view of PCG’s capabilities, including any additional uses beyond landscape creation.

 

Week 08

DRAFT  for feedback

Topic : Revolutionizing Visual Effects: The Impact of Procedural Content                   Generation in Unreal Engine on Computer Generated Landscapes.

‌Introduction:

The film, television, and gaming industries have seen exponential growth in recent years, with production budgets reaching unprecedented levels. This surge in investment is driven by the continuous advancement of technology, which has revolutionized the creation of content. Visual effects (VFX) have become a cornerstone of modern filmmaking and gaming industry, playing an integral role in everything from blockbuster films to advertisements. In fact, the complexity and scale of visual effects have expanded to such an extent that producing just 30 seconds of an advertisement can require as much effort as creating a full-length feature film. As production budgets continue to grow, the demand for more detailed and expansive visual effects has intensified, especially for large-scale settings like dense forests, intricate architectural structures, and realistic terrains. Meeting this demand has become increasingly feasible due to the development of procedural content generation (PCG), a technique that automates the creation of vast, detailed landscapes and assets with incredible speed and precision.

PCG has significantly transformed the field of VFX, enabling filmmakers and VFX artists to achieve levels of visual fidelity and scale that were once thought impossible. In particular, Unreal Engine has emerged as a leading platform for PCG, offering powerful tools that allow for the efficient generation of complex environments and assets. This essay will explore the profound impact of PCG on visual effects in the digital filmmaking industry, with a focus on how it enhances production quality and efficiency. Through the automation of asset and environment creation, PCG allows for the rapid development of dynamic simulations, realistic landscapes, and adaptive elements that respond to real-time changes.

This essay will also explore notable examples of projects that have utilized procedural content generation (PCG) to craft visually engaging narratives, highlighting how this technology is revolutionizing the creative process. It will provide a detailed analysis of the practical research conducted to understand how PCG influences the visual effects process and its overall effectiveness in streamlining production. While PCG offers numerous advantages, it also presents certain challenges and limitations, which will be examined in this discussion. The essay will conclude by exploring the future of PCG in digital filmmaking, considering its evolving role in an industry that continually pushes the boundaries of technological innovation. Through this exploration, the essay will demonstrate how procedural content generation, particularly within Unreal Engine, is reshaping the visual effects landscape, enabling filmmakers to create immersive, real-time environments that captivate global audiences.

Week 09

Body Feedback

Theoretical Background

Procedural Content Generation (PCG) is a process that uses algorithmic methods to automatically create content, offering significant advantages in both efficiency and creativity. This technique has become a cornerstone of modern game development, enabling developers to produce vast, dynamic worlds without the need for manually creating every asset. PCG can be applied to a wide variety of tasks within game development, such as generating textures, 3D models, and expansive in-game environments. As Unreal Engine is primarily a game development software, it has become a popular platform for the implementation of PCG. As it is a powerful tool and capabilities make it easier for developers to generate intricate and large-scale game environments quickly, significantly reducing the time and effort required for manual content creation. PCG’s application extends beyond just generating landscapes or environments. It can also be used to create other critical game elements, such as character models, animations, and even gameplay mechanics. By automating much of the asset creation process, PCG opens up new opportunities for game developers to focus on higher-level design and innovation, rather than getting weighed down in the time-consuming tasks of content creation. This flexibility allows for the rapid iteration of ideas, facilitating more dynamic and interactive game worlds. One of the most notable aspects of PCG is its ability to introduce randomness and variety, which enhances the player’s experience by ensuring no two gameplay sessions are identical. Each playthrough feels unique due to the procedurally generated content, which can range from terrain features to quest objectives. This unpredictability makes games more engaging and repayable, as players can discover new experiences every time they play. A prime example of PCG in action is the globally famous game Minecraft. The game’s entire world, including its landscapes, caves, and ecosystems, is procedurally generated, meaning that each new game world offers a different set of challenges and adventures. This procedural generation makes Minecraft infinitely repayable, as players are always exploring new terrain and discovering fresh experiences. The success of Minecraft highlights the power of PCG to create vast, immersive game worlds that captivate players with their depth and variety. By harnessing the potential of procedural content generation, developers are able to create more dynamic, engaging, and unique gaming experiences, making it a vital tool in the industry today.

Week 11

Presentation Week

Rushyang_Week11_Presentation

1

2

3

4

5

6

7

8

9

10