In my practical research, I will use Meshyai as my 3D AI generator to explore how an AI-generated 3D model can fit into a traditional animation workflow.
I created the following 3D creature using ZBrush, which I will use as concept art for Meshy AI. I expect to achieve similar features from Meshy AI.
In Meshyai, you can recreate 3D models through various methods, including Text to 3D, Image to 3D, AI Texturing, and Text to Voxel.
Step 01 – Text to 3D
As the first method of creating my concept art, I am using text-to-3D. In this case, I am using a similar prompt from Meshy AI and modifying it according to my concept art.
Meshy AI promt as follows
Design a humanoid monster with a twisted, muscular frame, standing tall at 8 feet, covered in jagged, stone-like skin. Its face is a blend of human and beast, with hollow, glowing eyes and sharp, fang-like teeth. The arms are unnaturally long, ending in razor-sharp claws, and its spine protrudes, giving it a hunched, menacing posture. The creature exudes dark energy, with veins of glowing red running through its skin. Ultra detailed, best 8k texture, perfect mesh, #animation#
https://www.meshy.ai/discover?search=monster
Customised prompt
Design a 4 legs 2 hands humanoid monster with a twisted, muscular frame, standing tall at 8 feet, covered in jagged, stone-like skin. Its face is a blend of human and beast, with hollow, red eyes. The arms are unnaturally long, ending in razor-sharp claws, and its spine protrudes, giving it a hunched, menacing posture. The creature exudes dark energy, with veins of glowing red running through its skin. Ultra detailed, best 8k texture, perfect mesh, #animation#
1- Add your prompt to the prompt area. 2- Click generate button
I customized the prompt several times and ended with the following result.
Final promt
Design a 6 legs monster with a twisted, muscular frame, standing tall at 8 feet, covered in jagged, stone-like skin. Its face is a blend of human and beast, with hollow, red eyes. The arms are unnaturally long, ending in razor-sharp claws, and its spine protrudes, giving it a hunched, menacing posture. The creature exudes dark energy, with veins of glowing red running through its skin. Ultra detailed, best 8k texture, perfect mesh, #animation#
Final textured 3D model as follows
Meshy AI couldn’t generate what I was prompted.
Step 02 – Image to 3D
In step two of creating a 3D model from my concept art, I used an image to the 3D method. This time, I am uploading my concept art into Meshy AI.
After a few attempts at generating the process, Meshy AI outputs the following model. Unfortunately, I am unable to use this model immediately in my 3D workflow.
Concept art from AI
For my practical research, I aimed to incorporate more AI in generating my concept art. I used deep AI to create a concept art of a festive rabbit.I have used a 3D cartoon Character Generator as my concept art style.
https://deepai.org/machine-learning-model/3d-cartoon-generator
I have prompted ” christmas rabit paws open” and generated the following image.
I will use the above AI-generated art as a concept and ask Meshy AI to develop a similar 3D model.
Method 01 – First I will use text to 3D model in meshy AI
I am using the following text prompt to create my character
The object is a cartoonish, symmetrical, soft-textured bunny with large ears, a fluffy tail, and a striped red scarf, standing upright with open paws
Here is what Meshy AI generated according to the prompted text.
Method 02 – I will use Image to 3D as my next step
Here is what Meshy AI produced based on the image-to-3D option.
This model has some issues, including texturing and topology. I am unable to use this model immediately in my 3D workflow.AI-generated 3D models could be used as a quick base model. Modifying AI-generated 3D models is tedious and requires talented artists with technical skills.
Meshy AI has a rigging tool to rig and animates the generated character.
Meshy AI exports the FBX file along with the animation. I successfully imported that file into MAYA and made modifications.
Maya Playblast file as follows
In my research, I found a social media influencer, Jon Draper ( https://www.youtube.com/watch?v=7aYy9H7jQuQ / https://aianimation.com/ ), who shows how he used meshy AI for his animation pipeline.
In my research, I found a community influencer, Jon Draper, who shows how he used meshy AI for his animation pipeline. He used Meshy AI to generate 3D models, textures, and animation. After creating the models, he exported his 3D character from Meshy as FBX and imported it into Blender. He combined walking and running animations in a Blender and exported them as animated “glb” or “gltf” file formats. Next, he imported the “glb” file into Adobe After Effects, did the final composition, and exported it as an mp4 video. He also demonstrated how to add facial animation to the character using another AI tool called Live Portrait. He replaced his reference voice with a different one using Eleven Labs, which generates AI voice. He upscaled his final video file using an AI tool called Krea. Skilled people like Jon Draper have already been using AI tools in the 3D animation pipeline.
The following video will explain the workflow of generating concept art from AI, modelling it with AI, and finally animating it in Unreal Engine.
AI Base Mesh Generator – Image to 3D
Adding AI to your zBrush character WorkFlow?
Is the future of 3D modeling Generative AI? Meshy.AI review
Will AI Take Your Job? – How to Prepare for AI-Driven Job Loss
I found another 3D artist, social media influencer Grant Abbitt (https://www.youtube.com/watch?v=qiaHVBZIKWg), who talked about AI anxiety. According to Grant Abbitt, there are a few ways aspiring artists can effectively incorporate AI into their workflow to boost productivity:
- Focus on learning fundamental art skills like anatomy, scene construction, colour theory, etc. These fundamentals will help you understand what makes good art and communicate your vision effectively to the AI.
- Check out ways to use AI as a handy tool to increase your productivity. For example, you might find that AI can handle repetitive tasks like touch-ups or edits, which lets you spend more time on the creative stuff.
- Consider working in small teams that combine your artistic skills with the capabilities of AI and coding. This collaborative approach can help you produce higher-quality work faster.
- Be open-minded and adaptable to new technologies. The speaker emphasizes that resisting AI is unlikely to be effective, so embracing it as a tool can open up opportunities.
He also mentioned that it is essential to view AI as a tool that enhances your artistic abilities rather than a threat to your job. By learning to work effectively with AI, aspiring artists can increase their productivity and potentially discover new avenues for their creative work.
The End of 3d Artists?
How This Revolutionary AI is Redefining 3D Modeling Forever