Magic Lantern Forum

Using Magic Lantern => Tutorials and Creative Uses => Topic started by: ricardopt on April 27, 2020, 11:57:48 AM

Title: Canon EOS M 4k timelapse using raw cr2 images with free or paid software
Post by: ricardopt on April 27, 2020, 11:57:48 AM
Hi everyone

Here's a "guide" on how to create a 4k timelapse from raw images, i know Zeek posted a guide on how to achieve this by using raw video but this is a different way on how to do it, i used raw (cr2) files that in my opinion give better results, this is possible by using paid software or free software, you can use only one or several programs (paid/free) english is not my native language so apologies in advance, also this "guide" assumes you know a bit about video/image editing.

in this particular situation im using 1200 images and stabilization/denoising was used in After Effects, Davinci Resolve and Premiere Pro

1st method - After effects (paid software)
(https://i.imgur.com/GCUYClk.jpg)
you can use after effects to do everything but you'll need a fast PC, i loaded all 1200 images and camera raw popped upp and used it to colour correct the image and apply all changes to every image, after that created a new sequence (3840x2140) and dragged the images there, then i resized/cropped everything to fit the 4k dimensions, after that i exported the video but on my PC it took ages (at one time it was showing it was going to take 7 hours), i cancelled after 30 minutes and checked the uncomplete video and the quality was great, it works but its slow.

2nd method - DaVinci Resolve (free)
(https://i.imgur.com/X53RF0q.jpg)
Like After effects everything can be done with Davinci Resolve, in some ways its simpler, when importing it detects that all images are part of a seguence and you only "one" file, imported it into a 4k timeline and color corrected/resized/cropped it and then exported it, but much like After Effects its slow and it took a bit more time to figure out how to edit since im more used to after effects and premiere, but it can be done and with same output quality as after effects.

3rd method - Lightroom (paid software)
(https://i.imgur.com/ccQfLnr.jpg)
Lightroom can also be used to create a timelapse,i loaded all the images, colour corrected/resized/cropped one image and synced all changes to the rest of the images, after that selected the "create slideshow" option and here you have to spend some time to disable some of its options like background colour etc etc, i disabled everything since i only wanted to show the images in the final video, there's no option to set a framerate but since i knew the file @30fps would have a 38s duration i loaded a 38s wav music file and checked the match video to music duration :)  lightroom only allows to export to 1080p and like after effects and davinci resolve its slow but it works.

4th method - Lightroom + Premiere Pro (paid software)
I used lightroom to batch colour correct/resize/crop and export everything to 3840x2160, loaded all the images in to premiere pro and exported to 4k at 30fps... using this combination allowed me to create the final 4k video in 2 hours.

5th method - RawTherapee + DaVinci Resolve (free software)
Like the 4th method i used raw therapee to batch colour correct/resize/export the images to 4k resolution, after that i loaded everything in Davinci Resolve on a 4k timeline and exported it, its faster than using any of the first 3 methods but overall slower than using lightroom and Premiere Pro but quality is the same.

i didnt try other free software but i guess you can do the same by using RawTherapee or DarkTable to process/export the images and the use Kdenlive/openshot/Shotcut to creat the video.

my method:
Used Lightroom to process/export the images to 4416x2484, i imported all the images in Premiere Pro and created a 4k timeline, when importing the images  i choose not to resize to 4k timeline dimensions as i wanted to have a 13% zoom out effect from 4416x2484 to 3480x2160, added some music and exported it.

what about Linux?
I have a dualboot windows/ubuntu PC and you can create the same using free tools on linux, RawTherapee works very well on Linux, DarkTable i havent tried on Linux but works as well, for creating the video you can use Kdenlive, i dont recomend Davinci Resolve on linux because it crashes/hangs a lot and not all formats are supported.

and here's the video, watch in 4k when available:
https://www.magiclantern.fm/forum/index.php?topic=24961.0
Title: Re: Canon EOS M 4k timelapse using raw cr2 images with free or paid software
Post by: Danne on April 27, 2020, 12:53:39 PM
Nowadays possibilities are many. You can even transform cr2 files back into MLV thanks to ili3101 and build your timelapse from with mlv app.
Title: Re: Canon EOS M 4k timelapse using raw cr2 images with free or paid software
Post by: ricardopt on April 27, 2020, 01:55:56 PM
Hi Danne, thanks for the tip, just tried the new mlvapp version to try that out but it has to convert to mlv and the size increases by 50% a 21mb cr2 image gets transcoded to a 30mb mlv and then batch export to jpeg.

i have a 25gb cr2 images folder, after the lightroom edits/export i get a 8gb jpeg image folder that i use to create the final video, with the mlvapp an extra folder with 37gb of mlv files needs to be created, am i missing any detail?

Title: Re: Canon EOS M 4k timelapse using raw cr2 images with free or paid software
Post by: Kharak on April 27, 2020, 01:59:04 PM
Resolve can't handle CR2, you need to use Adobe DNG converter. CR2 to DNG

Then you have a real-time playback of your Timelapse.
Title: Re: Canon EOS M 4k timelapse using raw cr2 images with free or paid software
Post by: ricardopt on April 27, 2020, 02:10:38 PM
Quote from: Kharak on April 27, 2020, 01:59:04 PM
Resolve can't handle CR2, you need to use Adobe DNG converter. CR2 to DNG

Resolve 16 free version that i have does support CR2.

Quote from: Kharak on April 27, 2020, 01:59:04 PM
...Then you have a real-time playback of your Timelapse.

dont need it, i just wait a 1s or 2 so that resolve updates the image.
Title: Re: Canon EOS M 4k timelapse using raw cr2 images with free or paid software
Post by: IDA_ML on April 27, 2020, 03:42:06 PM
Easiest and fastest way:
===============

The next time you film a timelapse using ML, pack it into a MLV file.  Both, the video mode and the silent FRSP mode provide this option.  Then just open the MLV file in MLVApp, do all your corrections there in the same way as you would color correct a photo with ACR and then just export your timelapse video in whatever format, size and fps you like.  A MLV file containing 1200 full size frames should take no more than 30 minutes to export even on a fairly weak laptop. 

There is an even faster way:
==================

Install MLVFS on your computer.  This will allow you to mount your MLV file as a DNG sequence which you can open with Resolve directly.  Do your corrections and grading with the Camera RAW module of Resolve and export in whatever resolution you like.  Rendering speed at UHD (3840x2160) is about 4 frames/s (Quicktime, MPEG container) on my laptop, so it will take about 5 minutes to export your 1200 frames file.  If you make some very complex processing (noise reduction, stabilization, etc.), it will of course take longer but basic corrected files really render very fast.
Title: Re: Canon EOS M 4k timelapse using raw cr2 images with free or paid software
Post by: ricardopt on April 27, 2020, 07:30:01 PM
Quote from: IDA_ML on April 27, 2020, 03:42:06 PM
Easiest and fastest way:
===============

The next time you film a timelapse using ML, pack it into a MLV file.  Both, the video mode and the silent FRSP mode provide this option.  Then just open the MLV file in MLVApp, do all your corrections there in the same way as you would color correct a photo with ACR and then just export your timelapse video in whatever format, size and fps you like.  A MLV file containing 1200 full size frames should take no more than 30 minutes to export even on a fairly weak laptop. 

Faster doesnt mean its better, i was doing stabilization /denoising/zoom, that is why it was taking so long,  if none of that was required it would be a lot faster aswell, in my opinion i have a lot more freedom when color grading cr2 than mlv, no contest there (in my opinion).

Quote from: IDA_ML on April 27, 2020, 03:42:06 PM
There is an even faster way:
==================

Install MLVFS on your computer.  This will allow you to mount your MLV file as a DNG sequence which you can open with Resolve directly.  Do your corrections and grading with the Camera RAW module of Resolve and export in whatever resolution you like.  Rendering speed at UHD (3840x2160) is about 4 frames/s (Quicktime, MPEG container) on my laptop, so it will take about 5 minutes to export your 1200 frames file.  If you make some very complex processing (noise reduction, stabilization, etc.), it will of course take longer but basic corrected files really render very fast.

i'll edit what i wrote in the first post. i was denoising/stabilizing as well.
Title: Re: Canon EOS M 4k timelapse using raw cr2 images with free or paid software
Post by: IDA_ML on April 27, 2020, 08:27:13 PM
Quote from: ricardopt on April 27, 2020, 07:30:01 PM
in my opinion i have a lot more freedom when color grading cr2 than mlv, no contest there (in my opinion).

I am of the opposite opinion.  Post processing MLV files in MLVApp gives me better results than processing CR2 files in ACR.  In fact, over the last few months, I have been processing my stills CR2 files entirely with MLVApp after converting them to MLV using the RAW2MLV.exe module.  The latest MLVApp version offers this functionality too.

By the way, what do you need stabilization and denoising for?  You film your timelapses on a tripod anyway.  The one that you showed was filmed on a bright sunny day too.  So, you had plenty of light - no denoising was necessary.
Title: Re: Canon EOS M 4k timelapse using raw cr2 images with free or paid software
Post by: ricardopt on April 28, 2020, 12:04:24 PM
Quote from: IDA_ML on April 27, 2020, 08:27:13 PM
I am of the opposite opinion.  Post processing MLV files in MLVApp gives me better results than processing CR2 files in ACR.  In fact, over the last few months, I have been processing my stills CR2 files entirely with MLVApp after converting them to MLV using the RAW2MLV.exe module.  The latest MLVApp version offers this functionality too.

I'll give it a few more tries, when i tried it it didnt have the quality i thought it would have, i tried it for a few days right after Danne implemented it, i might be wrong or done something wrong but the field of view using the magic lantern intervalometer is bigger compared to the 4k inbuilt timelapse movie mode, i like to do a subtle zoom effect on timelapses and having a wider view helps.

Quote from: IDA_ML on April 27, 2020, 08:27:13 PMBy the way, what do you need stabilization and denoising for?  You film your timelapses on a tripod anyway.  The one that you showed was filmed on a bright sunny day too.  So, you had plenty of light - no denoising was necessary.

that day i wasnt using a tripod, the camera was on an improvised tripod and the wind shook the camera a couple times, about the denoising...when converting to 1080p from 5184x3456 i didnt notice it but when converting to 3480x2160 i did see some grain/noise in the clouds.
Title: Re: Canon EOS M 4k timelapse using raw cr2 images with free or paid software
Post by: Danne on April 28, 2020, 12:21:36 PM
For the best full MLV buffer, timelapse experience with the least hassle I would recommend following:
1 - Enable 5k anamorphic flv preset. You reach it via tap screen menu
2 - Use the Intervalometer lua script enabled at the bottom of the Mvoie tab menu.

This way you´ll get a MLV recording the full sensor but it will end up with mlv metadata and buffer info. Then just work with that in Mlv app.

Well, either that or ful blown cr2 files like you do right now ;).
Title: Re: Canon EOS M 4k timelapse using raw cr2 images with free or paid software
Post by: IDA_ML on April 28, 2020, 06:25:32 PM
@ricardopt

Your vilage is such a fantastic place!  All you need to do is to be patient and experiment more.  The combination ML -> MLVApp is your best choice for ultimate quality footage and post processing.  Once you learn how to get the best out of this combination, you will enjoy such a high image quality that everyone who sees your footage will be blown away by the colors, detail, smooth transitions and dynamic range.  Here are a few more hints:

1)  For noise free images learn how to expose to the right without blowing up the highlights.  Activate your RAW histogram and zebras and expose carefully for the highlights.  When you start clipping the brightest areas, dial 0,5 to 1 stop down to avoid overexposure just in case the sun suddenly comes out behind the clouds.  This happens very often.

2) Make sure you always focus precisely!  ML offers very useful focus aid tools for that.  A LCD viewfinder helps a lot in bright sunny days when you don't see anything on the screen.

3)  A quality VND filter is essential for high image quality of your timelapses.  Get yourself one that does not soften the image when used with your favorite timelapse lenses.  Make sure, you do not set it very close to the darkest position to avoid the "cross" effect.

4) Set your shutter to Full range in the ML video menu and carefully select your fps to match the speed of the moving objects in your scene.  For moving clouds, a fps range between 0,5 and 4 fps is your best choice, dependent on how high the clouds are up in the sky.  Then try to adhere to the 180 deg. rule to avoid choppiness of your footage.  If you film at 2 fps, your shutter speed needs to be 1/4-th of a sec.  Don't be tempted to use high shutter speeds - this will result in a jerky and ugly looking timelapse video.  Now you understand how important a good VND filter is that has to provide this enormous light attenuation in a bright sunny day!  Also, avoid stopping down your lens above F11, otherwise you will end up with soft milky footage due to diffraction.

5) It is very often windy when you film timelapses, otherwise how are you going to get moving clouds?  This means, you need a very stable tripod.  Consider hanging a heavy load to its hook for further stabilization.  Shakiness will ruin your footage and all your efforts are gone!

6) No matter what software you use for postprocessing, NEVER overprocess your images!  Work very carefully and gently with the sliders and you will get what you want.

Looking forward to more timelapse videos from your beautiful location. ;)
Title: Re: Canon EOS M 4k timelapse using raw cr2 images with free or paid software
Post by: Kharak on April 29, 2020, 11:25:38 AM
Quote from: ricardopt on April 27, 2020, 02:10:38 PM
Resolve 16 free version that i have does support CR2.

dont need it, i just wait a 1s or 2 so that resolve updates the image.

Resolve can import CR2, sure, but as you wrote yourself, the processing is extremely slow and the colors are somewhat off.

If you convert to C/DNG, the processing and rendering is done in real-time and the colors are correct.
Title: Re: Canon EOS M 4k timelapse using raw cr2 images with free or paid software
Post by: ricardopt on April 30, 2020, 11:03:06 AM
@ Danne, IDA_ML, Kharak...thanks for the tips and info, i've tried to create some timelapses in the raw video mode using the intervalometer but all i get is continuous video, ive tried different settings using the 5k flv preset but no luck... the intervalometer in movie tab its confusing with so many options (to me at least), there's also a timelapse mode under raw video, does this work together with the intervalometer in movie tab? i only want to take a pic every 3 seconds...but i dont find any reference to that option,,,only fps. at the moment the intervalometer in the photo tab is the one that works perfectly.
Title: Re: Canon EOS M 4k timelapse using raw cr2 images with free or paid software
Post by: Danne on April 30, 2020, 12:57:30 PM
Try this:
https://www.magiclantern.fm/forum/index.php?topic=9741.msg223302;topicseen#msg223302

Jump straight to step 1 and 2 since intervalometer is already enabled.