Updated: Making a NeRF animation with NVIDIA’s Instant NGP
NOTE: there’s a faster way to extract the images, shown at 1:20 - read these notes!
Video made is here:
Watch it loop here:
The model was filmed at Chesterwood, in Stockbridge, MA, USA. A great place to visit!
The final NeRF created from this model is here:
Instant NGP software and build instructions:
Instructions on making your own NeRFs - extremely useful:
Locking the exposure when you make a video can definitely help, e.g., - short version for iPhone: before recording, hold your finger on the focus point for a few seconds, then press the yellow “AE/AF lock“ button that appears above.
Problems? For help, see the Discussion area on the site and search on all issues at
Complementary blog post and video with more (somewhat dated) info:
Need more help? Try the NeRF Discord server: or perhaps the reddit group (there is also , but that’s for making 3D models, e.g., meshes, from NeRFs).
The commands I used in the conda command window (“ngp“ is an environment I earlier created for instant-ngp; see it at the bottom of these notes):
# Set environment in Anaconda
conda activate ngp
# Pull images from movie; I’ve put movie directory “chesterwood“ in the instant-ngp directory for simplicity. Change “fps 2“ to whatever is needed to give you around 100 images.
cd C:\Users\(your path here)\Github\instant-ngp
cd chesterwood
python ..\scripts\ --video_in --video_fps 2 --run_colmap --overwrite
# NOTE! This line is a bit different than shown in the video, as advice on aabb_scale’s use has changed. Also, I usually want to delete a few images after extracting them, so I don’t do an exhaustive match at this point. In fact, I usually hit break (Control-C) when I see “Feature extraction“ starting, as the images have all been extracted at that point.
#After you delete any blurry or useless frames, continue below to match cameras.
# Camera match given set of images. Do for any set of images. Run from directory containing your “images“ directory.
python C:\Users\(your path here)\Github\instant-ngp\scripts\ --colmap_matcher exhaustive --run_colmap --aabb_scale 16 --overwrite
# For videos or closely related sets of shots, you can take out the “--colmap_matcher exhaustive“ from the line above, since your images are in order. This saves a few minutes. You could also leave off “--aabb_scale 16“ or put 64, the new default; the docs say it is worth playing with this number, see for how (short version: edit it in ). In my limited testing, I personally have not seen a difference.
# run interactive instant-ngp - run from the main directory “instant-ngp“
cd ..
instant-ngp chesterwood
(NOTE! If you don’t seen the “Camera path“ menu, drag the “instant-ngp“ menu off of it - the two menus start in the same space, oddly enough. And, if you don’t see the “Render video“ button in this menu, resize the menu to view it. The menu starts very small. You can also close the “Path manipulation“ submenu - click on the arrow to its left - to see the other Camera path options.)
------------
The anaconda environment setup commands I personally use to install the packages needed (just need to do these once for the project, other than the “activate“):
conda create -n ngp python=
conda activate ngp
cd C:\Users\ehaines\Documents\_documents\Github\instant-ngp
pip install -r
The above creates a conda “environment“ called ngp, makes it the active one, then installs the software you need. After creating an environment is created, you can open a new Anaconda window and “conda activate ngp“ from anywhere to use it.
If you get stuck, you might want to check my previous video’s notes:
1 view
361
80
5 days ago 00:12:05 1
ZenBusiness Review 2024: What Makes It Stand Out?
1 week ago 00:03:02 1
SPX Options Trading : Strategies for Big Gains!
2 weeks ago 00:26:26 1
LEGO Horizon Adventures PS5 Pro Gameplay - Thunderjaw Boss Fight