Author Topic: My first DUAL-ISO RAW Video Test with EOS-M  (Read 19735 times)

DeafEyeJedi

  • Hero Member
  • *****
  • Posts: 3397
  • 5D3 | M1 | 7D | 70D | SL1 | M2 | 50D
My first DUAL-ISO RAW Video Test with EOS-M
« on: September 22, 2014, 08:00:28 AM »
I shot in RAW resolution 1344x538, 1/50, 24p (FPS Override set to 24.000) w 22mm STM, Dual ISO (100/1600) and closed the iris down to f12 for ETTR effect.

Workflow:
originally I convert the RAW files with MLVMytic (Beta 0.5) with the Dual-ISO settings on. Worked well but couldn't figure out why ACR couldn't read the DNG files from the MLVMystic (Beta 0.5) version? (probably because they are technically CinemaDNG which should work fine with DaVinci Resolve but my old macbook pro doesn't hold up with the real time playback very well.

So I went back to the good old fashion way of exporting the CDNG through Adobe LightRoom5 to fine-tune & color grade them and then export as TIFF files.

THEN Open IMAGE SEQUENCE in Quicktime 7 and exported as quicktime format in 1920x720 422 HQ.. (I'm starting to think I could have not stretched it out as much) but oh well its just a test!

p.s. I tried to use RAWTHERAPEE to try and get rid of the hot/dead pixels that the EOS-M usually produces... SO FRUSTRATING! I can only open one file at a time to get the effect to work and Im not sure how to batch them all together to make it quicker. Probably will get this task done on the next test!

I am still seeing a bunch of aliasing going on...  :-\

5D3.113 | 5D3.123 | EOSM.203 | 7D.203 | 70D.112 | 100D.101 | EOSM2.* | 50D.109

a1ex

  • Administrator
  • Hero Member
  • *****
  • Posts: 12457

Danne

  • Contributor
  • Hero Member
  • *****
  • Posts: 6928
Re: My first DUAL-ISO RAW Video Test with EOS-M
« Reply #2 on: September 22, 2014, 01:17:16 PM »
Nice to see some dual iso movie action :)
Here are som good conversion apps. There is also the neccesity to implement Alex --same-level command to avoid flickery dng:s in movie sequences. You can get more info here:

http://www.magiclantern.fm/forum/index.php?topic=12796.25

Lightroom (Mac, windows)
http://www.magiclantern.fm/forum/index.php?topic=11056.0

MLVFS (use it with binary to convert dual isofiles)
http://www.magiclantern.fm/forum/index.php?topic=13152.0

Barracuda (windows)
http://www.magiclantern.fm/forum/index.php?topic=9102.0

DeafEyeJedi

  • Hero Member
  • *****
  • Posts: 3397
  • 5D3 | M1 | 7D | 70D | SL1 | M2 | 50D
My first DUAL-ISO RAW Video Test with EOS-M
« Reply #3 on: September 22, 2014, 07:27:57 PM »
@A1ex -- thanks for referring NOT to use MLVmystic as I've just noticed that it is technically out of date and won't be maintained! My fault on that...

@Danne -- I do have the Cr2hdr plugin to use in LR5 but maybe I keep telling myself that I'm not quite sure if it compresses after the converts? I'll check and see if the plug in is up to date since I installed it sometime late last year after the holidays? It may need to be updated and I'll give it another test with the same exact RAW file that was used in this video.

I'll see if I can get this to work again while at work today. Thanks all for your feedbacks!
5D3.113 | 5D3.123 | EOSM.203 | 7D.203 | 70D.112 | 100D.101 | EOSM2.* | 50D.109

DeafEyeJedi

  • Hero Member
  • *****
  • Posts: 3397
  • 5D3 | M1 | 7D | 70D | SL1 | M2 | 50D
My SECOND DUAL-ISO RAW Video Test with EOS-M
« Reply #4 on: September 23, 2014, 10:25:18 AM »
Take two...


cr2hdr: a post processing tool for Dual ISO images

Last update: 0eabcb0 on 2014-08-29 12:42:54 UTC by a1ex:
cr2hdr exposure matching: when all else fails, brute force prevails...

Active options:
--amaze-edge    : use a temporary demosaic step (AMaZE) followed by edge-directed interpolation (default)
--cs2x2         : apply 2x2 chroma smoothing in noisy and aliased areas (default)
--wb=graymax    : set AsShotNeutral by maximizing the number of gray pixels (default)

Input file      : /Volumes/LaCie/EOS-M first TEST/M20-1628_C0000/M20-1628_C0000_00348.dng
Camera          : Canon EOS M
Camera model    : Canon EOS M
Full size       : 1344 x 538
Active area     : 1344 x 538
Black borders   : N/A
ISO pattern     : BddB RGGB
White levels    : 14045 14882
Noise levels    : 8.00 8.00 8.00 8.00 (14-bit)
ISO difference  : 4.06 EV (1663)
Black delta     : 21.37
Dynamic range   : 10.55 (+) 10.65 => 14.70 EV (in theory)
Looking for hot/cold pixels...
Hot pixels      : 502
Cold pixels     : 129
AMaZE interpolation ...
Amaze took 0.22 s
Edge-directed interpolation...
Semi-overexposed: 37.09%
Deep shadows    : 35.24%
Horizontal stripe fix...
Full-res reconstruction...
ISO overlap     : 3.5 EV (approx)
Half-res blending...
Chroma smoothing...
Building alias map...
Filtering alias map...
Smoothing alias map...
Final blending...
Noise level     : 8.00 (20-bit), ideally 8.00
Dynamic range   : 16.55 EV (cooked)
AsShotNeutral   : 0.51 1 0.62, 5107K/g=1.04 (gray max)
5D3.113 | 5D3.123 | EOSM.203 | 7D.203 | 70D.112 | 100D.101 | EOSM2.* | 50D.109

a1ex

  • Administrator
  • Hero Member
  • *****
  • Posts: 12457
Re: My first DUAL-ISO RAW Video Test with EOS-M
« Reply #5 on: September 23, 2014, 10:38:49 AM »
Use --same-levels to get rid of the flicker ;)

DeafEyeJedi

  • Hero Member
  • *****
  • Posts: 3397
  • 5D3 | M1 | 7D | 70D | SL1 | M2 | 50D
Re: My first DUAL-ISO RAW Video Test with EOS-M
« Reply #6 on: September 23, 2014, 07:49:37 PM »
@a1ex - That's right I read that somewhere in the forums recently, unfortunately I went ahead and shot this video in RAW without the Post Deflicker enabled. So I don't have the sidecar file (XMP) to use in post. My fault on that!

Will shoot another test with a new RAW/MLV file in order to add the XMP file to match the black levels.

Unless it is possible for me to adjust the black levels solely in ACR and perhaps just sync them up? Thoughts?
5D3.113 | 5D3.123 | EOSM.203 | 7D.203 | 70D.112 | 100D.101 | EOSM2.* | 50D.109

a1ex

  • Administrator
  • Hero Member
  • *****
  • Posts: 12457
Re: My first DUAL-ISO RAW Video Test with EOS-M
« Reply #7 on: September 23, 2014, 07:57:43 PM »
Post deflicker? That's for still photos (timelapse).

DeafEyeJedi

  • Hero Member
  • *****
  • Posts: 3397
  • 5D3 | M1 | 7D | 70D | SL1 | M2 | 50D
Re: My first DUAL-ISO RAW Video Test with EOS-M
« Reply #8 on: September 23, 2014, 08:14:27 PM »
Now that's even more embarrassing. Yes, again you are right. However, per Danne's suggestion that I tried to use the command in terminal to set the black levels... This is the errors that I am getting in Terminal. Thoughts?

5D3.113 | 5D3.123 | EOSM.203 | 7D.203 | 70D.112 | 100D.101 | EOSM2.* | 50D.109

Danne

  • Contributor
  • Hero Member
  • *****
  • Posts: 6928
Re: My first DUAL-ISO RAW Video Test with EOS-M
« Reply #9 on: September 23, 2014, 11:05:20 PM »
Here are to ways to get a1ex --same-levels command to apply on your files.

This link apply same levels to already converted dng files

This link will convert dual iso dng to regular dng and apply same levels to them

DeafEyeJedi

  • Hero Member
  • *****
  • Posts: 3397
  • 5D3 | M1 | 7D | 70D | SL1 | M2 | 50D
Re: My first DUAL-ISO RAW Video Test with EOS-M
« Reply #10 on: September 24, 2014, 04:49:26 AM »
@Danne -- Thanks for the follow up regarding these instructional videos. I could swear I followed these instructions precisely and yet I'm still getting these odd errors.

Will definitely try them again as soon as I get home from work. Thanks again for your kind support as always!  :D
5D3.113 | 5D3.123 | EOSM.203 | 7D.203 | 70D.112 | 100D.101 | EOSM2.* | 50D.109

DeafEyeJedi

  • Hero Member
  • *****
  • Posts: 3397
  • 5D3 | M1 | 7D | 70D | SL1 | M2 | 50D
Re: My first DUAL-ISO RAW Video Test with EOS-M
« Reply #11 on: September 24, 2014, 10:03:00 AM »
Just got home. Terminal went well -- Thanks again Danne and now I am facing this pop up window again after attempting to export DNG's into ACR (same applies for LR5) and Last time it was due to MLVMystic but this isn't the case.

Any thoughts?

5D3.113 | 5D3.123 | EOSM.203 | 7D.203 | 70D.112 | 100D.101 | EOSM2.* | 50D.109

Danne

  • Contributor
  • Hero Member
  • *****
  • Posts: 6928
Re: My first DUAL-ISO RAW Video Test with EOS-M
« Reply #12 on: September 24, 2014, 12:13:39 PM »
Try again to run both commands. One after the other. Both black and white level command has to be applied.

DeafEyeJedi

  • Hero Member
  • *****
  • Posts: 3397
  • 5D3 | M1 | 7D | 70D | SL1 | M2 | 50D
Re: My first DUAL-ISO RAW Video Test with EOS-M
« Reply #13 on: September 24, 2014, 08:00:12 PM »
@Danne -- good enough for you to know (obviously this has happened to you before) in which I find it odd and after going through the commands again it just somehow made it readable to both ACR & LR5. So strange but thanks again.

So for this workflow I used the same original RAW file from the first video in this post.

Workflow as it follows:

MLVFS>Adjusted the Black levels in Terminal commands (Thanks Danne!)>LR5 (color grade) & then export as 16-bit TIFF's> Open as Image Sequence in QT7 to export as Quicktime 422 HQ.

Ideally I would rather use Davinci Resolve for the shorter and easier workflow but my old 2006 Macbook Pro (even with the new upgrade memory ram and SSD drive) and yet it's not able to playback smoothly. *grunts*

Here's Take 3-

***Even after getting the Blacks level adjusted somehow made the HOT/DEAD pink/green pixels slightly more visible (which is a known issue for EOS-M owners and I am aware of the fix can be made with RawTheraPee -- but I'm currently still searching on the net for a way how to apply the fix for all files rather than doing them one by one. Perhaps anyone know a shortcut key regarding the software to make that possible?
5D3.113 | 5D3.123 | EOSM.203 | 7D.203 | 70D.112 | 100D.101 | EOSM2.* | 50D.109

Danne

  • Contributor
  • Hero Member
  • *****
  • Posts: 6928
Re: My first DUAL-ISO RAW Video Test with EOS-M
« Reply #14 on: September 24, 2014, 08:19:39 PM »
Have you tried mlrawviewer?

DeafEyeJedi

  • Hero Member
  • *****
  • Posts: 3397
  • 5D3 | M1 | 7D | 70D | SL1 | M2 | 50D
Re: My first DUAL-ISO RAW Video Test with EOS-M
« Reply #15 on: September 24, 2014, 09:32:46 PM »
Speaking of MLRawViewer... I'm currently exporting the converted DNG's them as DNG's (not Quicktime .MOV) with the Quality enabled as well as the Status of Stripes correction.



Let me know if this is the correct set up?

5D3.113 | 5D3.123 | EOSM.203 | 7D.203 | 70D.112 | 100D.101 | EOSM2.* | 50D.109

Danne

  • Contributor
  • Hero Member
  • *****
  • Posts: 6928
Re: My first DUAL-ISO RAW Video Test with EOS-M
« Reply #16 on: September 24, 2014, 09:44:24 PM »
Probably right but don, t know if double exporting dngs works?

DeafEyeJedi

  • Hero Member
  • *****
  • Posts: 3397
  • 5D3 | M1 | 7D | 70D | SL1 | M2 | 50D
Re: My first DUAL-ISO RAW Video Test with EOS-M
« Reply #17 on: September 24, 2014, 10:09:27 PM »
These hot/dead pixels basically show up whenever my lens is facing the sun and somehow it goes away (kind of) when it doesn't have the flare coming in...



and you're right it won't let me export as DNG's... nor as .MOV either.

So should I start with the Original RAW DNG's through with MLRawViewer and export them as DNG's prior to doing the MLVFS?

or afterwards?

ugh sorry for all the questions but I would like to get the proper workflow done first before I go ahead and shoot some 2.5k DUAL ISO videos...  ;)
5D3.113 | 5D3.123 | EOSM.203 | 7D.203 | 70D.112 | 100D.101 | EOSM2.* | 50D.109

DeafEyeJedi

  • Hero Member
  • *****
  • Posts: 3397
  • 5D3 | M1 | 7D | 70D | SL1 | M2 | 50D
Re: My first DUAL-ISO RAW Video Test with EOS-M
« Reply #18 on: September 26, 2014, 06:47:53 AM »
so I started the whole process again with the original RAW file -- my question now is... is it possible for the RAW files to become useless after being used with MLVFS? Because after the MLVFS conversion which produced all of the DNG's into a strange pinkish look in every frame. I was hoping that it would go away once I use LR5 to export the DNG's with cr2hd2 20-bit plugin but I keep getting the pop up window with nothing stated that the DNG's have been converted. Nothing happens!

So does that mean the RAW file is somehow useless or am I missing something?
5D3.113 | 5D3.123 | EOSM.203 | 7D.203 | 70D.112 | 100D.101 | EOSM2.* | 50D.109

DeafEyeJedi

  • Hero Member
  • *****
  • Posts: 3397
  • 5D3 | M1 | 7D | 70D | SL1 | M2 | 50D
Re: My first DUAL-ISO RAW Video Test with EOS-M
« Reply #19 on: September 26, 2014, 09:19:45 AM »
 ::) Although this worked fine just the other day after following Danne's suggestions and here I am about to give up on with this particular RAW file and probably going to end up shooting another DUAL-ISO test some time tomorrow. perhaps outside of my work area or nearby the beach.

This is what I am dealing with so far...




Anyone notice anything odd or familiar from this kind of behavior? I wonder if it's an MLVFS issue... PROBABLY NOT!

Shame on me...
5D3.113 | 5D3.123 | EOSM.203 | 7D.203 | 70D.112 | 100D.101 | EOSM2.* | 50D.109

dmilligan

  • Developer
  • Hero Member
  • *****
  • Posts: 3218
  • 60Da / 1100D / EOSM
Re: My first DUAL-ISO RAW Video Test with EOS-M
« Reply #20 on: September 26, 2014, 01:28:16 PM »
make sure you have the latest version of mlvfs (read/write support was only implemented recently),
you can also try copying the files out of mlvfs into the real file system and see if you get the same error (that would indicate whether or not its an issue with mlvfs)

Danne

  • Contributor
  • Hero Member
  • *****
  • Posts: 6928
Re: My first DUAL-ISO RAW Video Test with EOS-M
« Reply #21 on: September 26, 2014, 03:37:08 PM »
What are your settings in lightroom? Last I experimented I had to have "same levels" option ticked to get conversion going. Otherwise it stopped at after the first file was converted. Of course I had to set "same levels" again after the conversion for exiftool to work outside mlvfs. 

DeafEyeJedi

  • Hero Member
  • *****
  • Posts: 3397
  • 5D3 | M1 | 7D | 70D | SL1 | M2 | 50D
Re: My first DUAL-ISO RAW Video Test with EOS-M
« Reply #22 on: September 27, 2014, 05:41:16 AM »
The pinkish occurs before I even go into LR5 so I wouldn't say it is an issue with LR5 nor MLVFS because I did try to copy the files out of MLVFS folder into another folder on my desktop and yet it did still produce the exact same pinkish effect.



Is this normal for this to occur even after converting more than once on a single DUAL-ISO RAW file?
5D3.113 | 5D3.123 | EOSM.203 | 7D.203 | 70D.112 | 100D.101 | EOSM2.* | 50D.109

DeafEyeJedi

  • Hero Member
  • *****
  • Posts: 3397
  • 5D3 | M1 | 7D | 70D | SL1 | M2 | 50D
Re: My first DUAL-ISO RAW Video Test with EOS-M
« Reply #23 on: September 27, 2014, 06:00:43 AM »
@dmilligan -- I just did an update right now with your latest MLVFS from your bitbucket site. Still comes up Pink. I think I may have somehow corrupted the RAW file itself?

So what can I do to prevent this from happening again?
5D3.113 | 5D3.123 | EOSM.203 | 7D.203 | 70D.112 | 100D.101 | EOSM2.* | 50D.109

mjneubrander

  • New to the forum
  • *
  • Posts: 23
Re: My first DUAL-ISO RAW Video Test with EOS-M
« Reply #24 on: September 27, 2014, 08:48:07 AM »
So I did some stuff with rawtherapee batching a while back. At that point you needed to create a saved profile via the GUI and then run it via command line. These were the cmd line options rawtherapee -t -Y -p profilepath/profile.pp3 -o outputdir -c inputdir

-t = 16 bit tiff
-Y = overwrite
-p = profile
-o = output dir
-c = input dir to convert

The rawpedia entry (not sure how long the IP is valid for, but it sure is interesting to see a website run on an IP these days.)
http://50.87.144.65/~rt/w/index.php?title=Command-Line_Options

My archaic batch file VBS and BAT combined, including multiple command line batch commands for different raw programs and compiling into movies with ffmpg based on the old raw format (before mlv)

https://drive.google.com/file/d/0B2sc-xLyUSKqQWdPdlFHZjlPaU0/edit?usp=sharing