Dual ISO - massive dynamic range improvement (dual_iso.mo)

Started by a1ex, July 16, 2013, 06:33:50 PM

Previous topic - Next topic

0 Members and 3 Guests are viewing this topic.

dfort

Just as a reminder--if you are testing out cr2hdr, raw2dng and mlv_dump from dmilligan's ml_dng branch please make sure you post your comments to the open pull request:

https://bitbucket.org/hudson/magic-lantern/pull-requests/603/dng-module-wip

Once again, here are the Windows and Mac versions.

dfort

Quote from: Walter Schulz on August 18, 2015, 12:04:24 AM
Cr2hdr.exe works now. Tag-Issue solved.
But Win 8.1 "Smartscreen" is warning me about security threat. Never happened before.

You shouldn't be downloading .exe files from strangers. Who knows what they might do to your computer.

Just kidding--I'm surprised you haven't gotten more security threat warnings.

toze3

Quote from: dfort on August 17, 2015, 11:39:48 PM
Thanks. Here's the whole bunch, cr2hdr, raw2dng and mlv_dump.

These are working on my old Windows laptop and they should also work on a new 64-bit system. (Used mingw-w64-i686)


Already tested and it's ok, except it's not the latest 20-bit version, but cr2hdr 16-bit and the camera white balance isn't correct, maybe because it doesn't have the option  --wb=graymax

See the following picture, in the left is the cr2hdr 20 bit version, with tag corrected and in the right the DNG from this cr2hdr version

RAWTHERAPEE 4.2.276 with no processing with white balance set to camera. When in AUTO mode both looks equal



Also from the logs:
This new cr2hdr 16-bit
Last update: 76b5a32 on 2015-03-21 15:19:29 UTC by david:
dng: allow 64 bit compilation for raw2dng, mlv_dump, and cr2hdr

Unknown option: --wb=graymax
Active options:
--amaze-edge    : use a temporary demosaic step (AMaZE) followed by edge-directed interpolation (default)
--cs2x2         : apply 2x2 chroma smoothing in noisy and aliased areas (default)

Input file      : D:\Fotografia\RAW\0DISO_CR2_BKP\_MG_2498.CR2
Camera          : Canon EOS 550D
Full size       : 5344 x 3516
Active area     : 5202 x 3465
White level     : 12500
Black borders   : 142 left, 51 top
Black level     : 1965
ISO pattern     : dBBd GBRG
Noise levels    : 5.75 10.23 10.34 5.75 (14-bit)
ISO difference  : 3.03 EV (817)
Black delta     : 5.14
Dynamic range   : 10.84 (+) 9.99 => 13.02 EV (in theory)
Looking for hot/cold pixels...
Hot pixels      : 3
Cold pixels     : 1
AMaZE interpolation ...
Amaze took 5.41 s
Edge-directed interpolation...
Semi-overexposed: 40.16%
Deep shadows    : 4.08%
Horizontal stripe fix...
Full-res reconstruction...
ISO overlap     : 4.8 EV (approx)
Half-res blending...
Chroma smoothing...
Building alias map...
Filtering alias map...
Smoothing alias map...
Final blending...
Noise level     : 4.39 (16-bit), ideally 4.36
Dynamic range   : 13.23 EV (cooked)
Black adjust    : -2
White balance determined from WB_RGGBLevelsMeasured
AsShotNeutral   : 0.453714 1 0.809524


CR2HDR 20-bit
Last update: 0c08758 on 2015-05-09 19:25:05 UTC by a1ex:
cr2hdr: Makefile commands to create a zip package for Windows

Active options:
--amaze-edge    : use a temporary demosaic step (AMaZE) followed by edge-directed interpolation (default)
--cs2x2         : apply 2x2 chroma smoothing in noisy and aliased areas (default)
--wb=graymax    : set AsShotNeutral by maximizing the number of gray pixels (default)

Input file      : D:\Fotografia\RAW\0DISO_CR2_BKP\_MG_2498.CR2
Camera          : Canon EOS 550D
Full size       : 5344 x 3516
Active area     : 5202 x 3465
Black borders   : 142 left, 51 top
Black level     : 2048
ISO pattern     : dBBd GBRG
White levels    : 11738 12099
Noise levels    : 5.74 10.23 10.34 5.79 (14-bit)
ISO difference  : 3.03 EV (815)
Black delta     : 2.87
Black adjust    : 2
Dynamic range   : 10.72 (+) 9.92 => 12.95 EV (in theory)
Looking for hot/cold pixels...
Hot pixels      : 2
Cold pixels     : 13620
AMaZE interpolation ...
Amaze took 2.23 s
Edge-directed interpolation...
Semi-overexposed: 43.64%
Deep shadows    : 4.95%
Horizontal stripe fix...
49: offset too large (-4315)
50: offset too large (41078)
Full-res reconstruction...
ISO overlap     : 4.7 EV (approx)
Half-res blending...
Chroma smoothing...
Building alias map...
Filtering alias map...
Smoothing alias map...
Final blending...
Noise level     : 66.08 (20-bit), ideally 65.99
Dynamic range   : 13.20 EV (cooked)
Black adjust    : -30
AsShotNeutral   : 0.51 1 0.57, 4557K/g=0.98 (gray max)

dfort

Good report toze3. Looks like dmilligan worked on this before the 20-bit version of cr2hdr was ready.

Please keep checking the comments and changes on the pull request and let me know if you need another build to test.

https://bitbucket.org/hudson/magic-lantern/pull-requests/603/dng-module-wip

dfort

Quote from: toze3 on August 18, 2015, 11:11:02 AM
Already tested and it's ok, except it's not the latest 20-bit version

dmilligan just merged his code with the 20-bit version. I'm not able to open the Windows executable on my old laptop but for anyone who wants to do some testing--

Windows cr2hdr-20bit      Macintosh cr2hdr-20bit

toze3

Quote from: dfort on August 19, 2015, 03:54:55 AM
dmilligan just merged his code with the 20-bit version. I'm not able to open the Windows executable on my old laptop but for anyone who wants to do some testing--

Windows cr2hdr-20bit      Macintosh cr2hdr-20bit

It's a 16-bit app not compatible with my 64-bits machine...

Danne

Mac version cr2hdr works perfectly.
When it comes to white balance and mlv_dump I can see calculations for this in dng folder but numbers in actual dng files are always way off. Might send in a bug report if this issuposed to work same as in mlvfs?

dfort

Quote from: toze3 on August 19, 2015, 11:29:42 AM
It's a 16-bit app not compatible with my 64-bits machine...

That's odd, I'll look into it. The Mac version seems to be working.

Anyone else able to compile cr2hdr for Windows willing to help out?

dfort

I've been struggling to get a Windows binary of cr2hdr 20-bit version with the ml_dng changes applied. I do have a version built in the Cygwin environment which means you will need to download the .dll files for it to work. If anyone is interested in trying it out--here is the link.

toze3

Quote from: dfort on August 20, 2015, 01:44:43 AM
I've been struggling to get a Windows binary of cr2hdr 20-bit version with the ml_dng changes applied. I do have a version built in the Cygwin environment which means you will need to download the .dll files for it to work. If anyone is interested in trying it out--here is the link.

I put the dll on the same paste that cr2hdr, and it gives an error (translated from portuguese -> entering point not found (dynamic library)

One question, why is the file half the size (in KB) compared with the a1ex original 20-bit version (186KB vs 366KB)

It could be missing things?


dfort

Quote from: toze3 on August 20, 2015, 10:19:34 AM
I put the dll on the same paste that cr2hdr, and it gives an error (translated from portuguese -> entering point not found (dynamic library)

That's why I dislike distributions that require dynamically linked libraries. I'm still struggling getting MinGW to compile the 20-bit version.

Portuguese? Are you in Portugal or Brazil or someplace else? I visited Porto and Lisboa. I can speak Spanish but the extent of my Portuguese is "muito obrigado."

Quote from: toze3 on August 20, 2015, 10:19:34 AM
One question, why is the file half the size (in KB) compared with the a1ex original 20-bit version (186KB vs 366KB)

It could be missing things?

Sure, it is missing the libraries. Basically the libraries can be either statically or dynamically linked. Static linking includes the libraries in the executable file so the size of the .exe file is bigger than a dynamically linked version. So far I've only been able to compile dmilligan's ml_dng-cr2dng20bit in Cygwin which doesn't allow statically linked libraries.

I've had my best success at compiling ML code on a Mac. I didn't get any errors or warnings when cross compiling a Windows cr2hdr.exe but obviously it isn't working. Too bad, all the other command line tools seemed to cross compile fine.

dfort

Good news everyone--

Windows binary cr2hdr 20-bit version from the ml_dng branch is working. At least it launches on my system. Please try it out.

You can get it here.

This is a MinGW cross compile and no .dll's are required.

Danne


DeafEyeJedi

Just tested it on Windows here at work and I can also confirm that it works...

Seriously @dfort you're a pure workhorse and THANK you for finally closing the gap between Windows & Mac!

Great Job, Mate! [emoji108]
5D3.113 | 5D3.123 | EOSM.203 | 7D.203 | 70D.112 | 100D.101 | EOSM2.* | 50D.109

dfort

Anyone tested the new cr2hdr 20-bit on the 70D yet?

Danne


DeafEyeJedi

5D3.113 | 5D3.123 | EOSM.203 | 7D.203 | 70D.112 | 100D.101 | EOSM2.* | 50D.109

toze3



mizantropia

Im confused.
I downloaded plugin (and exe file later on) and both doesnt work?
Ive got plugin enabled on my Ligthroom6 plugins list, and still no option to process files on 'right click. menu.
I drop CR2 files on exe file, still nothing.

Win 7, 64 bit.

I checked, those files are dual iso.
What am i doing wrong?

Walter Schulz

- Adobe's documentation about LR export plug-in location is just wrong and kichetof relied on that one. If you don't believe, you may download LR SDK 6 and try to run any of its export plug-ins in C:\TEMP.
If you want to have ML plug-in visible in context menu you have to place cr2hdr.lrplug in your Lightroom program folder in subdir Modules.
You can use your "unvisible" LR plug-in by using "Export ...". You have to select ML plug-in from drop-down list and press Export button.
If you have managed to make it visible in context menu you will see there is no user interface to change setting. If you want to change settings you have to use "Export ...".

- I suppose you downloaded your plug-in version from first post in LR plug-in thread. Sidenote: Why did you place your question here and not there? Anyway, this one is outdated and won't support 70D. Look into BIN subfolder and if there is a file CR2HDR20.exe you want to download and use http://www.filedropper.com/lrplugin

-


Walter Schulz

Look at change list for recent builds:

https://builds.magiclantern.fm/jenkins/job/7D.203/218/changes

Changes 11 to 123 (sic!) are about cr2hdr.
Unfortunately there is no job for creating binaries. Eager to test this. Anyone able to compile for OS X and Windows?

DeafEyeJedi

Looks so sick! Definitely eager to test this one out.

Boss didn't play too nice w me and my personal 7D is broken (long story short it got soaked on a shoot my fault) and just found another used one online for $450 that includes a 24 pancake along w 2 batteries and a 64GB card.

Smells like good news are coming soon for 7D owners...
5D3.113 | 5D3.123 | EOSM.203 | 7D.203 | 70D.112 | 100D.101 | EOSM2.* | 50D.109

Audionut

It's only the 20bit branch merged into the unified branch.  So nothing new here, a1ex already made a binary available.

The rest is boring dev stuff from dfort, nothing exciting for an end user.  :P  Unless you ever wanted to compile cr2hdr yourself, in which case it probably just got a whole bunch easier.   ;)