Magic Lantern Forum

Using Magic Lantern => Raw Video => Raw Video Postprocessing => Topic started by: limey on May 03, 2015, 04:40:17 PM

Title: MLV RAW Video + Dual ISO post processing - DNG's corrupted?
Post by: limey on May 03, 2015, 04:40:17 PM
I'm having all sorts of problems with MLV RAW video + Dual ISO. I'd say I'm an advanced Magic Lantern user. Been using it for a long time, have used many of its features in both video and photo.

Camera: 5dmk3, the MLV files play fine in MLVRawViewer, the files are definitely not corrupted. Recorded at a very easy on the camera resolution.

I have a mac and a pc and have tried post processing MLV RAW Dual ISO Video on the following:

On Mac (I've tried multiple MLV movies):
1. Danne's script > Import to premiere (says files are damaged)
2. MLV Rawviewer > DNG > Lightroom > export dual iso converter > Import to premiere (says files are damaged)
3. MLV Mystic > DNG / Dual Iso > Import to premiere (says files are corrupted)
4. All of the above > Open all files in camera raw then synchronize settings > Import to premiere (says files are damaged)

On PC (Multiple MLV movies):
1. MLV Rawviewer > DNG > Lightroom > export dual iso converter > Import to premiere (says files are damaged)
2. MLV Mystic > DNG / Dual Iso > Import to premiere (says files are corrupted)
3. All of the above > Open all files in camera raw then synchronize settings > Import to premiere (says files are damaged)

On MAC I can open the DNG's with Camera RAW/PS. On PC I get the message, Photoshop can't open this file.

Now the only thing I can think of, is that MLV and Dual ISO doesn't work and the proper way to do it is recording in RAW?
Title: Re: MLV RAW Video + Dual ISO post processing - DNG's corrupted?
Post by: N/A on May 03, 2015, 04:44:45 PM
Try MLVFS. Has built-in support for dual iso, is kept up-to-date and is (imo) the most straight-forward workflow.
Title: Re: MLV RAW Video + Dual ISO post processing - DNG's corrupted?
Post by: limey on May 03, 2015, 04:56:47 PM
I forgot. I have tried MLVFS as well on Mac.
Title: Re: MLV RAW Video + Dual ISO post processing - DNG's corrupted?
Post by: Danne on May 03, 2015, 05:10:12 PM
Actually. I just updated cr2hdr-r so the files should work now in premiere pro. Thanks to @cpc.
DNG files are "repacked" to work with premiere. Repacking is done in parent folder.
Sidenote. If you discover any flicker at bottom in files please tell. Just updated with N/A compilation (cr2hdr20bit) from Nikfreaks build. Think it will work just fine though had some reports about pixelated border issues before.
Thanks
Title: Re: MLV RAW Video + Dual ISO post processing - DNG's corrupted?
Post by: N/A on May 03, 2015, 07:09:07 PM
Nice Danne, I'll have to check that out. Did the new cr2hdr help the 70D issue?
Limey, care to upload a dual iso mlv so we can test it?
Title: Re: MLV RAW Video + Dual ISO post processing - DNG's corrupted?
Post by: Danne on May 03, 2015, 07:30:55 PM
Cr2hdr compilation works very good. Deafeye is doing a recheck regarding pixelated border on some shots. I will check as well tonight.

*Tried a 3x zoom mode and it seemed fine to me. That,s where the interpolation issue appeared last before A1ex updated.
Title: Re: MLV RAW Video + Dual ISO post processing - DNG's corrupted?
Post by: limey on May 04, 2015, 06:15:40 PM
I'll upload one. I have a really bad internet connection at work.

Did a fresh MLV recording; used DANNE's new script;
The files look great (they look really good) and I CAN open them in adobe camera raw, but still can't import to adobe premiere cc.
Title: Re: MLV RAW Video + Dual ISO post processing - DNG's corrupted?
Post by: limey on May 04, 2015, 08:14:55 PM
https://www.dropbox.com/s/cok2lns6tflrhht/M04-0023.MLV?dl=0
Title: Re: MLV RAW Video + Dual ISO post processing - DNG's corrupted?
Post by: Danne on May 04, 2015, 08:28:04 PM
It works here
(http://s24.postimg.org/joj11tkw1/Screen_Shot_2015_05_04_at_20_24_06.jpg) (http://postimg.org/image/joj11tkw1/)

What version of cr2hdr-r and when did you download?

Did you run the uninstall command before install command?

The files should 3.4mb in size after @cpc repack is done.
Title: Re: MLV RAW Video + Dual ISO post processing - DNG's corrupted?
Post by: limey on May 04, 2015, 09:03:36 PM
I've used the 1.8app

I just tried the 5.6s and it didn't work.

No I didn't run the uninstall command first...I'm doing that now!
Title: Re: MLV RAW Video + Dual ISO post processing - DNG's corrupted?
Post by: Danne on May 04, 2015, 09:05:49 PM
You should download the 7.0 version in the first post. At the top http://www.magiclantern.fm/forum/index.php?topic=13512.0
Title: Re: MLV RAW Video + Dual ISO post processing - DNG's corrupted?
Post by: limey on May 04, 2015, 09:17:07 PM
It worked. So awesome.
Title: Re: MLV RAW Video + Dual ISO post processing - DNG's corrupted?
Post by: Danne on May 04, 2015, 09:22:07 PM
Cool :)
Kudos to @cpc.
http://www.magiclantern.fm/forum/index.php?topic=15027.msg146234#msg146234
Title: Re: MLV RAW Video + Dual ISO post processing - DNG's corrupted?
Post by: limey on May 04, 2015, 09:38:29 PM
So if you want to grade these, you just import the DNG;s to DaVinci or Lightroom....and there hasn't been any issues? I'm doing it now after I push the reply.
Title: Re: MLV RAW Video + Dual ISO post processing - DNG's corrupted?
Post by: Danne on May 04, 2015, 09:55:38 PM
They should work with audio and without both in Davinci resolve and premiere. Please report if you notice anything.
Title: Re: MLV RAW Video + Dual ISO post processing - DNG's corrupted?
Post by: limey on May 04, 2015, 10:33:22 PM
Ok. So I opened them in Camera Raw, change settings (exposure/shadows/etc) then saved as new files.

These new files save as 1.6mb and will not open in Premiere.

So the only way to raise shadows and exposure with these dual-iso DNG's and have them open in Premiere is in Davinci?
Title: Re: MLV RAW Video + Dual ISO post processing - DNG's corrupted?
Post by: dmilligan on May 04, 2015, 10:38:31 PM
You can't use ACR settings in Premiere. You can use ACR and render out to some intermediate codec and then open that in Premiere, but you cannot use ACR modifications/DNGs in Premiere, since ACR settings are simply metadata and can only be applied by ACR engine. Premiere has its own RAW development engine that is GPU based.

Quote from: limey on May 03, 2015, 04:56:47 PM
I forgot. I have tried MLVFS as well on Mac.
And it didn't work? What did you try and what didn't work?
Title: Re: MLV RAW Video + Dual ISO post processing - DNG's corrupted?
Post by: limey on May 04, 2015, 11:26:32 PM
That is an excellent explanation regarding the ACR situation. Thank you.  What is the option then for utilizing the best that dual ISO offers ie raising exposure/shadows for video?

Mlvfs was likely not working because I was using the wrong cr2hdr-r version
Title: Re: MLV RAW Video + Dual ISO post processing - DNG's corrupted?
Post by: Danne on May 04, 2015, 11:30:27 PM
QuoteMlvfs was likely not working because I was using the wrong cr2hdr-r version
?

Mlvfs has dual iso support on its own but without the conversion step. Havn,t tried it lately since focusing on cr2hdr-r though. Definitely worth checking out.
http://www.magiclantern.fm/forum/index.php?topic=13152.0 (http://www.magiclantern.fm/forum/index.php?topic=13152.0)

Title: Re: MLV RAW Video + Dual ISO post processing - DNG's corrupted?
Post by: limey on May 05, 2015, 04:26:56 AM
I may have misspoke. I will test MLVFS again tomorrow (to double check that I did try that) on Mac.

Still the question for me I haven't solved. How do you use ACR adjustments (or taking advantage of Dual ISO benefits in other way) and then go to Premiere for editing? I have not tried going to Davinci yet first (with dual iso).
Title: Re: MLV RAW Video + Dual ISO post processing - DNG's corrupted?
Post by: limey on May 05, 2015, 04:49:55 AM
Just tried on MLVFS on Windows. I redownloaded the .dll file and registered it. Imported the files to Premiere and I see the Dual ISO lines in the movie fwiw. I'm sure I'm missing a step or version.
Title: Re: MLV RAW Video + Dual ISO post processing - DNG's corrupted?
Post by: dmilligan on May 05, 2015, 12:56:58 PM
The windows version is way behind and not currently being maintained, it does not have the dual ISO stuff.
Title: Re: MLV RAW Video + Dual ISO post processing - DNG's corrupted?
Post by: limey on May 05, 2015, 03:24:21 PM
Ok thanks dmilligan. Will try on my mac today, although you already know it works. :D
Title: Re: MLV RAW Video + Dual ISO post processing - DNG's corrupted?
Post by: limey on May 05, 2015, 05:06:58 PM
Tried MLVFS with a Dual-ISO video and it did not convert the Dual ISO movie. I must be missing an item here.

I reinstalled the MLVFS.dmg file, killed the process, restarted, tried it several times to import premiere, but I still see the Dual-ISO lines in Premiere.
Title: Re: MLV RAW Video + Dual ISO post processing - DNG's corrupted?
Post by: dmilligan on May 05, 2015, 05:30:10 PM
You have to turn on dual ISO processing in the web interface (it's off by default, b/c even trying to detect dual ISO footage would slow MLVFS down for your non dual ISO footage).

There basically two modes 'preview' and 'full'. Preview is very fast (still get real-time playback), but low quality. It's meant to allow you to preview/edit/cut your footage before rendering. The 'full' mode is very slow, a single 1080p frame may take several seconds or more depending on the settings you select and CPU speed (mean23 is much faster than AMaZE, BTW).

Because dual ISO conversion is so slow, it doesn't really fit with MLVFS's do everything on the fly philosophy. Everytime (more or less, there is a little bit of caching done) you go back and try to read a particular frame, MLVFS will have to re-convert the frame. That's why there is the preview mode. The idea is you use preview while editing and then switch to full when you're ready to grade/render out.
Title: Re: MLV RAW Video + Dual ISO post processing - DNG's corrupted?
Post by: limey on May 05, 2015, 06:43:52 PM
Ok I turned it on. I got it to work very cool. Slow like you mentioned.

Is there any way to use the ACR switches and import to Premiere? Because otherwise what is the point of filming in Dual ISO if you can't bring up the shadows etc?
Title: Re: MLV RAW Video + Dual ISO post processing - DNG's corrupted?
Post by: Danne on May 05, 2015, 06:48:50 PM
dmilligan already answered you here

QuoteYou can't use ACR settings in Premiere. You can use ACR and render out to some intermediate codec and then open that in Premiere, but you cannot use ACR modifications/DNGs in Premiere, since ACR settings are simply metadata and can only be applied by ACR engine. Premiere has its own RAW development engine that is GPU based.

If you want the to work in ACR export your files through after effects to some highres intermediate like ProRes444HQ after grading.
There is a lot of things to be aware of when doing coloring and stuff to movie sequences in acr. Search around the forum. A lot has been done on the subject already.
Title: Re: MLV RAW Video + Dual ISO post processing - DNG's corrupted?
Post by: limey on May 06, 2015, 12:24:15 AM
Yes thank you. Both of you have been a big help in helping me figure this out.

I have been on Windows for years, but Mac only 2 months. So not really familiar with ProRes other than reading about that its a great codec.

This is a great thread for others to refer to because so many great answers here.

Dual-ISO Raw/MLV Video - Windows workflow:
1. MLVMystic (dual iso off) or MLV RawViewer
2. DNG export
3. Import to Lightroom (make adjustments)
4. Export/Convert cr2hdr 20bit
5. Real Export to DNG
6. Import to AE (make sure composition is same size as your RAW recording)
7. Export AVI
8. Import Premiere
9. Export Premiere

Mac workflow:
still to come

Will try Davinci as a substitute to Lightroom steps.
Title: Re: MLV RAW Video + Dual ISO post processing - DNG's corrupted?
Post by: limey on May 07, 2015, 10:59:45 PM
Davinci on Mac will not recognize the ACR adjustments. Without ACR adjustments it recognizes the DNG's as a sequence.

With the ACR adjustments it not only does not recognize the adjustments, but also does not recognize them as a sequence and shows individual DNG's.
Title: Re: MLV RAW Video + Dual ISO post processing - DNG's corrupted?
Post by: limey on May 08, 2015, 07:35:02 AM
This is turning into quite a journey. I hope it will help someone else.

On windows, exported to JPEG and had to bulk file rename for premiere to recognize sequence. With JPEG there is aliasing in the video, but I guess that is why everyone says to use crop 3x mode for dual ISO video?
Title: MLV RAW Video + Dual ISO post processing - DNG's corrupted?
Post by: DeafEyeJedi on May 09, 2015, 09:49:48 PM
@limey:

Nice to see some action going on in here on your end. I was just like you back in the day trying to figure out the best workflow on Mac's when it comes to Dual-ISO files from 5D3 (heck even I am still trying to narrow down the choices!). LoL

Anyway, I have tried this way and it may seem a long workflow but it works for me... I love MLVFS so much but I can't use it for Dual-ISO files because it just take forever (w for it to render and sometimes it doesn't come out the way I would like. (yet MLVFS is still champ when it comes to regular MLV files big TIME!) anyway since you are on a Mac...

Try @Danne's cr2hdr-r latest beta and take the converted DNG's into AE (where you can use ACR) as well as being able to color grade as well as exporting as ProRes all in a single app (AE).

Otherwise if you aren't using Dual-ISO -- then try MLVFS > AE (SmartImport2) > NLE (if you want to apply LUTS which can also be done in AE for quicker workflow but limited color grading unless it's a FLAT LOG such as Cinelog-C)
Title: Re: MLV RAW Video + Dual ISO post processing - DNG's corrupted?
Post by: limey on May 13, 2015, 05:47:57 AM
Thanks @DeafEyeJedi

I will try your workflows on the Mac side utilizing AE for both the Dual-ISO as well as MLV. AE is a weakness of mine - I never use the right side panels (other than text/character panel).

The whole point I'm trying to use Dual ISO video is a for a potential real estate shoot I have. Haven't secured the job yet, but will need to show ocean views while exposing the interior.

Is it advisable if I am going to shoot Dual-ISO that I shoot in 3x crop mode?
Title: MLV RAW Video + Dual ISO post processing - DNG's corrupted?
Post by: DeafEyeJedi on May 13, 2015, 06:11:13 AM
AE is worth every effort especially for Dual-ISO for the Highlights/Shadow recovering via ACR.

I also use @Danne's amazing app in cr2hdr-r with the latest beta which works well for not only Dual-ISO and HDR as well the normal RAW/MLV... 

Correct -- It is recommended to shoot in 3x crop mode with a wide angle in order to avoid aliasing & such... perhaps within around 8-16mm range, if you'd rather.
Title: Re: MLV RAW Video + Dual ISO post processing - DNG's corrupted?
Post by: limey on May 13, 2015, 06:51:24 AM
Good. I'll try it tomorrow with my 14mm Rokinon.

Any advice for shots where exposure changes completely, such as walking inside through a door to walking outside.
Title: Re: MLV RAW Video + Dual ISO post processing - DNG's corrupted?
Post by: limey on May 15, 2015, 12:08:40 AM
Well I forgot my 14mm Roki, but tried the 3x crop mode on my Tamron.

The results and workflow worked with ACR adjustments. The problem I came across was two fold. Not all DNG's were de-dual-iso'd and some DNG's did not take to the ACR adjustments.

Here is the workflow I did.

Raw MLV at 1920x1080 on a Komputerbay 128g card. No skipped frames.

I used Danne's cr2hdr-2 script.

Imported the DNG's into AE. I did adjust ACR settings.

Exported from AE to ProRes 422 HQ.

I played the quicktime file and can see many frames were not dual-iso'd and many did not accept the ACR settings done in the AE import.

I wonder if I need to run Danne's script twice?
Title: Re: MLV RAW Video + Dual ISO post processing - DNG's corrupted?
Post by: Danne on May 15, 2015, 12:32:43 AM
What version of cr2hdr-r are you running? I don,t think A1ex binary will miss a dual iso frame but you could upload an example that didn,t convert for me to check.
Title: Re: MLV RAW Video + Dual ISO post processing - DNG's corrupted?
Post by: limey on May 15, 2015, 03:47:20 AM
hmm I'll check tomorrow in the office. I think its the version right before your latest one potentially.
Title: Re: MLV RAW Video + Dual ISO post processing - DNG's corrupted?
Post by: Danne on May 15, 2015, 08:03:50 AM
I fixed some issues regarding dual iso randomness in latest version. Might work better.
http://www.magiclantern.fm/forum/index.php?topic=13512.0