Author Topic: Dual ISO - massive dynamic range improvement (dual_iso.mo)  (Read 1791352 times)

kayman1021

  • New to the forum
  • *
  • Posts: 20
Re: Dual ISO - massive dynamic range improvement (dual_iso.mo)
« Reply #3075 on: June 09, 2020, 05:59:20 PM »
tools used
dng frames and an mlv

@masc
I completely forgot mlvapp is capable of this, thanks for reminding

@Danne
Uploaded on "dng frames and mlv"
0_corrected_I_raw_corr_disabled.dng is that i made outside of mlvapp, the others are from the original, exported with different raw correction settings.
Mine does not look good as dng somehow, but i attached an mlv that contains the first frame of the round trip file. There is looks okay.

@adrjork
I have MLV App v1.11
Also i zipped the tools as "tools used"
EOS 100D, Xiaomi A1

Danne

  • Developer
  • Hero Member
  • *****
  • Posts: 7137
Re: Dual ISO - massive dynamic range improvement (dual_iso.mo)
« Reply #3076 on: June 09, 2020, 10:02:54 PM »
Trying to wrap my head around this. So, the first dng is the one that converts successful?
0_corrected_I_raw_corr_disabled.dng

Could you tell me or upload a dng that you know for sure you are able to convert that looks ok? I just tried cr2hdr from 2016 but still getting stripes.I just need one of your dng files that you are able to convert, nothing else.

kayman1021

  • New to the forum
  • *
  • Posts: 20
EOS 100D, Xiaomi A1

adrjork

  • Member
  • ***
  • Posts: 175
Re: Dual ISO - massive dynamic range improvement (dual_iso.mo)
« Reply #3078 on: June 10, 2020, 05:54:47 AM »
It works...
I've no words kayman1021.
With your apps' version my dual-ISOs get solved. I don't even need raw2mlv because I uploaded the DNGs directly into Davinci... and it finally works.

Now, just to be fussy, passing throuh cr2hdr is a “pain-in-the-a@@” workflow: very-very-very time-consuming.

@Danne: is there any future chance to see this sort of “legacy” dual-ISO-conversion option in Switch?

Danne

  • Developer
  • Hero Member
  • *****
  • Posts: 7137
Re: Dual ISO - massive dynamic range improvement (dual_iso.mo)
« Reply #3079 on: June 10, 2020, 07:00:28 AM »
If I know what version and from what branch I could look into what's going on. If it's even cr2hdr but probably is.
Shouldn't be too hard for a windows user to obtain this info.

Thanks for the file @kayman1021. It doesn´t wothout lines convert on my mac so it depends on your version of cr2hdr. If you could find from what branch and version I could look into it.

adrjork

  • Member
  • ***
  • Posts: 175
Re: Dual ISO - massive dynamic range improvement (dual_iso.mo)
« Reply #3080 on: June 10, 2020, 09:47:02 AM »
I'm not really a Windows user and I'm not a coder, anyway the working cr2hdr.exe has been created 4 Dec 2017, and HERE i found Commit 06fae84 dated 4 Dec 2017... Is it anything useful?

kayman1021

  • New to the forum
  • *
  • Posts: 20
Re: Dual ISO - massive dynamic range improvement (dual_iso.mo)
« Reply #3081 on: June 10, 2020, 10:10:03 AM »
I am at work now, if arrive at home i'll check (5 hours from now)
It's probably the version on ML Downloads/Utilities
EOS 100D, Xiaomi A1

Danne

  • Developer
  • Hero Member
  • *****
  • Posts: 7137
Re: Dual ISO - massive dynamic range improvement (dual_iso.mo)
« Reply #3082 on: June 10, 2020, 10:16:52 AM »
No specified branch but should be included in the binary info I think.

adrjork

  • Member
  • ***
  • Posts: 175
Re: Dual ISO - massive dynamic range improvement (dual_iso.mo)
« Reply #3083 on: June 10, 2020, 10:35:46 AM »
It's probably the version on ML Downloads/Utilities
Apparently yes: same creation date. Perhaps silly question: does libraw.dll matter somehow?

No specified branch but should be included in the binary info I think.
Can you tell me how can I extract this info for you? (In OSX I opened the .exe with Keka, and now I have some docs in a folder. I opened them with an Hex editor and the only one not-in-alien-language is a doc named “19” in which there is written «GNU C 4.9.0 20130523 (experimental) -m32 -mtune=generic -march=pentiumpro -g -O2 -std=gnu99». Is it anything useful? I guess not...)

Danne

  • Developer
  • Hero Member
  • *****
  • Posts: 7137
Re: Dual ISO - massive dynamic range improvement (dual_iso.mo)
« Reply #3084 on: June 10, 2020, 11:12:57 AM »
Ok, compiled from cr2hdr branch which seems to be the one used successfully here:
https://bitbucket.org/hudson/magic-lantern/branch/cr2hdr

I managed to convert the uploaded dng correctly with a mac binary so obviously it should work.

I updated Switch, please test:
https://bitbucket.org/Dannephoto/switch/downloads/Switch.dmg

Also a mac binary here:
https://bitbucket.org/Dannephoto/magic-lantern/downloads/cr2hdr


EDIT: Tested Switch and problem still persists so @kayman1021 round trip to rebake the dng fixed it. We need to examine what data is missing originally. Phew, complicated stuff.

EDIT: Tested again and the mlv_dump not coming from bouncyball works straight out of the box with the updated version of cr2hdr. In Switch select (m)  mlv_dump(MLV)

So, the problem seems related to mlv_dump version. cr2hdr doesn´t like the dng from the updated mlv_dump code.

masc

  • Contributor
  • Hero Member
  • *****
  • Posts: 1812
Re: Dual ISO - massive dynamic range improvement (dual_iso.mo)
« Reply #3085 on: June 10, 2020, 12:36:46 PM »
@Danne: do you see the difference between the versions? Is it the same algorithm as in MLVApp? Worth to change it?
5D3.113 | EOSM.202

Danne

  • Developer
  • Hero Member
  • *****
  • Posts: 7137
Re: Dual ISO - massive dynamic range improvement (dual_iso.mo)
« Reply #3086 on: June 10, 2020, 01:04:16 PM »
Yes. Mlv App has those issues. Will probably fix those flickery bugs and maybe finally dual iso will become reliable.

Danne

  • Developer
  • Hero Member
  • *****
  • Posts: 7137
Re: Dual ISO - massive dynamic range improvement (dual_iso.mo)
« Reply #3087 on: June 11, 2020, 09:11:20 AM »
What works now in Switch for dual iso for both mlv_dump version are:
    (05) do not fix cold pixels  added!
    (07) disable vertical stripes in highlights  added!

Disable cold pixel and vertical stripes. Now cr2hdr chews the files normally again...

adrjork

  • Member
  • ***
  • Posts: 175
Re: Dual ISO - massive dynamic range improvement (dual_iso.mo)
« Reply #3088 on: June 11, 2020, 05:39:16 PM »
You almost did it, Danne. Great job anyway!
I tested 7 most problematic dual-ISO mlvs, and new Switch does work for 6, and fails only for 1.
That one gives a weird result: the converted dngs are a sequence that alternates bunches of good-dngs and bunches of bad-dngs. The bunches contain different numbers of dngs, for example the first bunches contain respectively 8-good-dngs, 2-bad-dngs, 8-good-dngs, 10-bad-dngs, 2-good-dngs, etc.
Good-dngs have extension in uppercase (.DNG) whilst bad-dngs have extension in lowercase (.dng).
The curious thing is that importing the dngs-folder into Davinci, the software can't recognize a unique sequence, instead it imports all the bunches separately (each one with 8, 2, 8, 10, 2, etc. dng-frames)
I uploaded the first 30 dngs of the folder HERE, and also a shortened version of the problematic mlv HERE (the original file was 15GB, so I used MLVApp, RAW Correction disabled, codec MLV Fast Pass).

Danne

  • Developer
  • Hero Member
  • *****
  • Posts: 7137
Re: Dual ISO - massive dynamic range improvement (dual_iso.mo)
« Reply #3089 on: June 11, 2020, 07:50:22 PM »
Usually when not all files are converted it means cr2hdr algoritm have a hard time detecting dualiso on the file. Trying a second time sometimes works but probably the file itself wasn´t a perfect dualiso example. Sorry, I can´t download atm, on a very slow connection. Could you upload maybe a single dng file that wouldn´t convert?

adrjork

  • Member
  • ***
  • Posts: 175
Re: Dual ISO - massive dynamic range improvement (dual_iso.mo)
« Reply #3090 on: June 12, 2020, 08:03:35 AM »
Tried a second chance with that single problematic file gave a perfect result.
I correct myself: you COMPLETELY did it.
Sincerely many congrats for your amazing work.

sm105

  • New to the forum
  • *
  • Posts: 28
Re: Dual ISO - massive dynamic range improvement (dual_iso.mo)
« Reply #3091 on: September 03, 2020, 09:43:00 PM »
Are the flickering issues generally more pronounced with heavily underexposed shadows? I've got a telephoto shot of the full moon (well above the horizon, so very bright!) with some relatively dim buildings in the foreground. With 5D3 dual-iso at 100/1600, exposed for the moon at 100, I get crazy flickering with both MLV App and Switch. I've confirmed with exiftool the the black and white levels are constant. Besides the flickering, the individual processed DNGs look amazing!

MotherSoraka

  • New to the forum
  • *
  • Posts: 17
48FPS Dual ISO?
« Reply #3092 on: December 11, 2020, 05:57:45 AM »
Anyone tested Dual ISO in 48+ FPS mode?
for some reason i get a very weird flickering.

mhs

  • Just arrived
  • *
  • Posts: 1
Re: Dual ISO - massive dynamic range improvement (dual_iso.mo)
« Reply #3093 on: February 07, 2021, 07:29:43 PM »
Hi, I am new to ML.
I just installed ML few days ago on my 6D and I have tryout dual iso module today which has got me some greyed out images.
As far as I know it needs a cr2hdr program to convert it to normal image and that is the only way to use it.
However, neither links of .c code/binary are still opened.
Any suggestion to do with my photos?

Thanks.

ML700D

  • New to the forum
  • *
  • Posts: 32
Re: Dual ISO - massive dynamic range improvement (dual_iso.mo)
« Reply #3094 on: April 11, 2021, 07:02:50 AM »
What if triple iso?  just wondering how.. :D

ML700D

  • New to the forum
  • *
  • Posts: 32
Re: Dual ISO - massive dynamic range improvement (dual_iso.mo)
« Reply #3095 on: Today at 12:07:06 PM »
Yes. Mlv App has those issues. Will probably fix those flickery bugs and maybe finally dual iso will become reliable.
Ohh.. I just knew it, I thought it was dual iso module problem... thanks.