Today we’ll be using AI tools to create virtual environments for your film projects!
We cover the entire workflow, from generating the 3D environment, to filming in a low-budget virtual production environment, to compositing your shot with some AI tips and tricks, like re-lighting your shot based on the environment you’ve created!
Chapters:
00:00 Intro
00:34 What is Virtual Production?
01:42 Generating a 360° image
03:17 Preparing the 3D Model [Depth Maps]
06:22 Filming the scene
08:05 Key out the actors
09:10 Generate Normal Maps
11:15 Putting it all together
14:11 Final Shots
Tools used in this video:
- Skybox Labs by Blockade Labs:
- NVIDIA Canvas:
- ControlNet for Stable Diffusion:
- midjourney:
- High Resolution Depth Maps for Stable Diffusion WebUI:
- Blender:
- CamTrackAR:
- Reality OBJ to USDZ Converter:
- After Effects:
- :
- High Reslution Normal Maps for Stable Diffusion:
- DaVinciResolve:
- Reference to image plane:
Videos Links:
- Avatar Featurette: Performance Capture:
- Avatar & Avatar 2 Behind the scenes - How James Cameron Evolved Motion Capture in the Avatar Films:
- The Virtual Production of The Mandalorian Season Two:
- Blender Motion Tracking - Room Transformation! by Ian Hubert:
- Grae n YouTube Channel: @UC_EkMqKOm7Ej_g03Ryv0UZw
- Inpainting in Augmented Reality:
- How to Make a Blur Node in Blender!:
❤️ Buy me a coffee:
Follow me on Twitter:
1 view
947
284
4 weeks ago 00:00:17 3
Cappie // Mita😳- Rock n Roll -【MMD MiSide 4K | 60FPS】