Magic Lantern Forum

Using Magic Lantern => Post-processing Workflow => HDR and Dual ISO Postprocessing => Topic started by: a1ex on December 15, 2013, 04:47:48 PM

Title: CeroNoice - HDR tool inspired from ZeroNoise
Post by: a1ex on December 15, 2013, 04:47:48 PM
After having some trouble getting ZeroNoise (http://www.guillermoluijk.com/article/nonoise/index_en.htm) working, I coded my own version of the algorithm (well, only the part I understood) and ran a little experiment to check whether you should really take as many brackets as you can, or whether you can get away with just 2 or 3 pictures spaced at 4 EV or more (http://www.magiclantern.fm/forum/index.php?topic=9285.msg91737#msg91737).

I've called my program CeroNoice, pronounced pretty much like ZeroNoise, with a Spanish "ce" ("hay que sacar la lengua").

Download: CeroNoice.exe (http://acoutts.com/a1ex/CeroNoice.exe). It requires dcraw (get it from cr2hdr.zip (http://acoutts.com/a1ex/cr2hdr.zip)) and outputs 32-bit float DNGs (I know, it's overkill, but 16-bit float is not a native C data type).


Greg sent me a 6x2 EV bracketed sequence (thanks!):
IMG_5826.CR2 (http://wget%20http://greg.orimega.com/upload/ml/car/IMG_5826.CR2) IMG_5827.CR2 (http://wget%20http://greg.orimega.com/upload/ml/car/IMG_5827.CR2) IMG_5828.CR2 (http://wget%20http://greg.orimega.com/upload/ml/car/IMG_5828.CR2) IMG_5829.CR2 (http://wget%20http://greg.orimega.com/upload/ml/car/IMG_5829.CR2) IMG_5830.CR2 (http://wget%20http://greg.orimega.com/upload/ml/car/IMG_5830.CR2) IMG_5831.CR2 (http://wget%20http://greg.orimega.com/upload/ml/car/IMG_5831.CR2)

(http://a1ex.magiclantern.fm/hdr/CeroNoice/sample.jpg)

The test script and results (warning: the files are huge, don't jump to download without reading what is what):

# 1 image, exposed for highlights
sh test.sh IMG_5826.CR2 && mv out.dng 26.dng (http://a1ex.magiclantern.fm/hdr/CeroNoice/26.dng) && convert a.tif 26.jpg (http://a1ex.magiclantern.fm/hdr/CeroNoice/26.jpg)

# 2 images, 2 stops apart
sh test.sh IMG_5826.CR2 IMG_5827.CR2 && mv out.dng 26-27.dng (http://a1ex.magiclantern.fm/hdr/CeroNoice/26-27.dng) && convert a.tif 26-27.jpg (http://a1ex.magiclantern.fm/hdr/CeroNoice/26-27.jpg)

# 2 images, 4 stops apart
sh test.sh IMG_5826.CR2 IMG_5828.CR2 && mv out.dng 26-28.dng (http://a1ex.magiclantern.fm/hdr/CeroNoice/26-28.dng) && convert a.tif 26-28.jpg (http://a1ex.magiclantern.fm/hdr/CeroNoice/26-28.jpg)

# 2 images, 6 stops apart
sh test.sh IMG_5826.CR2 IMG_5829.CR2 && mv out.dng 26-29.dng (http://a1ex.magiclantern.fm/hdr/CeroNoice/26-29.dng) && convert a.tif 26-29.jpg (http://a1ex.magiclantern.fm/hdr/CeroNoice/26-29.jpg)

# 2 images, 8 stops apart
sh test.sh IMG_5826.CR2 IMG_5830.CR2 && mv out.dng 26-30.dng (http://a1ex.magiclantern.fm/hdr/CeroNoice/26-30.dng) && convert a.tif 26-30.jpg (http://a1ex.magiclantern.fm/hdr/CeroNoice/26-30.jpg)

# 2 images, 10 stops apart (!)
sh test.sh IMG_5826.CR2 IMG_5831.CR2 && mv out.dng 26-31.dng (http://a1ex.magiclantern.fm/hdr/CeroNoice/26-31.dng) && convert a.tif 26-31.jpg (http://a1ex.magiclantern.fm/hdr/CeroNoice/26-31.jpg)

# 3 images, 4 and 6 stops apart (total 10)
sh test.sh IMG_5826.CR2 IMG_5828.CR2 IMG_5831.CR2 && mv out.dng 26-28-31.dng (http://a1ex.magiclantern.fm/hdr/CeroNoice/26-28-31.dng) && convert a.tif 26-28-31.jpg (http://a1ex.magiclantern.fm/hdr/CeroNoice/26-28-31.jpg)

# 3 images, 6 and 4 stops apart (total 10)
sh test.sh IMG_5826.CR2 IMG_5829.CR2 IMG_5831.CR2 && mv out.dng 26-29-31.dng (http://a1ex.magiclantern.fm/hdr/CeroNoice/26-29-31.dng) && convert a.tif 26-29-31.jpg (http://a1ex.magiclantern.fm/hdr/CeroNoice/26-29-31.jpg)

# 6 images, 2 stops apart (total 10)
sh test.sh IMG_5826.CR2 IMG_5827.CR2 IMG_5828.CR2 IMG_5829.CR2 IMG_5830.CR2 IMG_5831.CR2 && mv out.dng 26-27-28-29-30-31.dng (http://a1ex.magiclantern.fm/hdr/CeroNoice/26-27-28-29-30-31.dng) && convert a.tif 26-27-28-29-30-31.jpg (http://a1ex.magiclantern.fm/hdr/CeroNoice/26-27-28-29-30-31.jpg)

Other scripts you may need to review or reproduce my experiment:
dngfloat_hdr.py (http://a1ex.magiclantern.fm/hdr/CeroNoice/dngfloat_hdr.py) (requires dng_validate.exe from Adobe DNG SDK v1.4, not earlier)
test.sh (http://a1ex.magiclantern.fm/hdr/CeroNoice/test.sh)

Now it's your turn to look at these images, try my program and draw the conclusions.

Happy pixel peeping!
Title: Re: CeroNoice - HDR tool inspired from ZeroNoise
Post by: engardeknave on December 15, 2013, 07:25:54 PM
Oh wow, I will have to investigate these later.

QuoteGreg sent me a 6x2 EV bracketed sequence (thanks!):
IMG_5826.CR2 IMG_5827.CR2 IMG_5828.CR2 IMG_5829.CR2 IMG_5830.CR2 IMG_5831.CR2

This is kind of a shitty bracket. Are you lacking brackets to test with? I have so, so many.
Title: Re: CeroNoice - HDR tool inspired from ZeroNoise
Post by: a1ex on December 15, 2013, 07:30:28 PM
Yes, would be nice.
Title: Re: CeroNoice - HDR tool inspired from ZeroNoise
Post by: a1ex on December 15, 2013, 08:52:48 PM
Update: I've patched ufraw (http://a1ex.magiclantern.fm/hdr/CeroNoice/ufraw_dng32float.patch) to open these 32-bit DNGs. Of course, internal processing is still 16-bit, but the range is chosen according to initial exposure compensation passed from command line. That means, if I start ufraw with "ufraw foo.dng --exposure=15", it will throw away 12 EV of highlight detail (initial exposure - 3EV) and will use these bits for shadow detail.

With this patch, I can run these DNGs through uniform_exposure.py (http://www.magiclantern.fm/forum/index.php?topic=7022) and it just works. Here's what I've got from this example, with default settings:

(http://a1ex.magiclantern.fm/hdr/CeroNoice/car-small.jpg) (http://a1ex.magiclantern.fm/hdr/CeroNoice/car.jpg)

The patch is very rough and quite invasive; I doubt it will be accepted if I submit it to ufraw tracker in at this stage. But if you want to try it, I'd be happy to see your feedback.
Title: Re: CeroNoice - HDR tool inspired from ZeroNoise
Post by: engardeknave on December 16, 2013, 12:37:50 AM
baleted
Title: Re: CeroNoice - HDR tool inspired from ZeroNoise
Post by: engardeknave on December 16, 2013, 06:30:19 AM
The two photos eight stops apart output is really an incredible result. I was unable to achieve this with those two photos even with manual adjustment via my normal methods. The others with more frames have less noise in the shadows, but the difference is not noticeable at normal resolutions. And if that is just what the script produced without manual adjustment, this is really significant. This may be a better HDR solution than anything else around now.

Going to download the scripts/patches and try it.
Title: Re: CeroNoice - HDR tool inspired from ZeroNoise
Post by: a1ex on December 16, 2013, 07:54:58 AM
Yes, all these pictures were obtained without manual adjustment. Caveat: if you want to use uniform_exposure.py you will have to compile ufraw after applying my patch (easy on Linux, but on Windows it doesn't seem easy).

Kirkt (a big fan of ZeroNoise and dual ISO) told me there's a HDR program that uses the ZeroNoise technique: http://www.lumariver.com/Products/LumariverHDR/

About Lightroom: after watching this tutorial (https://www.youtube.com/watch?v=GtV9dWyN7JM), there seems to be a HDR processing mode in LR that lets you move the exposure slider from -10 to +10, but my 32-bit float DNGs can only be adjusted from -5 to +5. As far as I understood from here (http://forums.adobe.com/message/5229773), DNG files are imported via Adobe Camera Raw, which is limited to 16-bit output. Marsu42 confirmed this (http://www.magiclantern.fm/forum/index.php?topic=9458.msg91898#msg91898). Boo...

After reading this (http://blogs.adobe.com/jnack/2012/10/the-dng-format-evolves-to-support-hdr-more.html) I thought floating point DNG is the way to go, but I couldn't find a straightforward way for regular users to edit these files (except for dng_validate and my modified ufraw, both requiring geek skills).

If you have some contacts at Adobe, feel free to ask them to take a look at these files. I'm a total noob regarding Adobe products, so I'd like some help.
Title: Re: CeroNoice - HDR tool inspired from ZeroNoise
Post by: Walter Schulz on December 16, 2013, 08:23:02 AM
Quote from: a1ex on December 16, 2013, 07:54:58 AMIf you have some contacts at Adobe, feel free to ask them to take a look at these files.

Eric Chan is active in Luminous Landscape's forums and an engaged and helpful person. His nick is madmanchan. If you don't want to participate there you may contact him via email. Just visit http://people.csail.mit.edu/ericchan/photos/ and you will find his address.
If the name doesn't ring a bell just read credits for LR and/or CS/CC's RAW module. Or read http://blogs.adobe.com/photoshopdotcom/2013/07/principal-scientist-and-mad-man-eric-chan-discusses-his-role-in-improving-photoshop.html

Ciao
Walter
Title: Re: CeroNoice - HDR tool inspired from ZeroNoise
Post by: engardeknave on December 16, 2013, 09:45:20 AM
Yeah, I have no way of patching UFRaw, but I'm playing around with Ceronoice now. In one case I had somewhat better results than exposure fusion using Ceronoice with only two files out of a seven frame bracket. I had very poor results with a particularly terrible bracketed scene (the one with the brown floor/furniture bright window included in the brackets I uploaded).

I can't believe how fast it is. This opens up the possibility of creating multiple versions of a file.

32-bit tifs can be adjusted in ACR 8.0 from -10 to +10. Just tried it. (Big difference!) I don't know if there's some problem with outputting to tif. I personally have no need to save adjustments in a 32-bit format, but if someone wanted they could open tifs directly in Photoshop and skip ACR.
Title: Re: CeroNoice - HDR tool inspired from ZeroNoise
Post by: a1ex on December 16, 2013, 09:49:18 AM
For TIF output I'd also have to do debayer, apply white balance and (here I'm a bit lost) do all sorts of color space conversions, gamma and so on. Basically, a complete raw converter from scratch. Maybe dcraw-float can help here, didn't look into it.
Title: Re: CeroNoice - HDR tool inspired from ZeroNoise
Post by: a1ex on December 16, 2013, 10:41:46 AM
Quote from: engardeknave on December 16, 2013, 12:37:50 AM
This looks promising. Still have to go through it all, but here's those brackets: http://we.tl/BQVDTX8Ind

First results:
- I simply ran CeroNoice * in all directories (blindly)
- I placed all the DNGs in one folder (had to rename them manually, this was the most painful step)
- I opened each DNG in the patched ufraw (with --exposure=10), adjusted WB (spot WB on the walls and 1-2 notches towards warmer color) and saved ID files (*.ufraw)
- ran uniform_exposure.py with default settings while writing this post
- after that, I looked in the JPEG folder and got these files (didn't pixel peep them yet):

(http://a1ex.magiclantern.fm/hdr/CeroNoice/engarde/small/3871.jpg) (http://a1ex.magiclantern.fm/hdr/CeroNoice/engarde/3871.jpg) (http://a1ex.magiclantern.fm/hdr/CeroNoice/engarde/small/3929.jpg) (http://a1ex.magiclantern.fm/hdr/CeroNoice/engarde/3929.jpg) (http://a1ex.magiclantern.fm/hdr/CeroNoice/engarde/small/7600.jpg) (http://a1ex.magiclantern.fm/hdr/CeroNoice/engarde/7600.jpg)
(http://a1ex.magiclantern.fm/hdr/CeroNoice/engarde/small/8047.jpg) (http://a1ex.magiclantern.fm/hdr/CeroNoice/engarde/8047.jpg) (http://a1ex.magiclantern.fm/hdr/CeroNoice/engarde/small/8527.jpg) (http://a1ex.magiclantern.fm/hdr/CeroNoice/engarde/8527.jpg) (http://a1ex.magiclantern.fm/hdr/CeroNoice/engarde/small/9188.jpg) (http://a1ex.magiclantern.fm/hdr/CeroNoice/engarde/9188.jpg)
(http://a1ex.magiclantern.fm/hdr/CeroNoice/engarde/small/9296.jpg) (http://a1ex.magiclantern.fm/hdr/CeroNoice/engarde/9296.jpg) (http://a1ex.magiclantern.fm/hdr/CeroNoice/engarde/small/9715.jpg) (http://a1ex.magiclantern.fm/hdr/CeroNoice/engarde/9715.jpg) (http://a1ex.magiclantern.fm/hdr/CeroNoice/engarde/small/9717.jpg) (http://a1ex.magiclantern.fm/hdr/CeroNoice/engarde/9717.jpg)

Now I'd probably tweak the parameters to brighten them a bit. This workflow feels very confortable to me.

Continued: I've changed shadow_level to 200000 from 5000, which resulted in some obscene exposures being fed to enfuse (roughly from 0 to +18 EV). The resulting images got brighter, but had low contrast (example (http://a1ex.magiclantern.fm/hdr/CeroNoice/engarde2/3871-lo-contrast.jpg)), so I've ran "mogrify -sigmoidal-contrast 4 *.jpg" (on 8-bit jpeg, but if you want stronger edits you should switch to 16-bit tif):

(http://a1ex.magiclantern.fm/hdr/CeroNoice/engarde2/small/3871.jpg) (http://a1ex.magiclantern.fm/hdr/CeroNoice/engarde2/3871.jpg) (http://a1ex.magiclantern.fm/hdr/CeroNoice/engarde2/small/3929.jpg) (http://a1ex.magiclantern.fm/hdr/CeroNoice/engarde2/3929.jpg) (http://a1ex.magiclantern.fm/hdr/CeroNoice/engarde2/small/7600.jpg) (http://a1ex.magiclantern.fm/hdr/CeroNoice/engarde2/7600.jpg)
(http://a1ex.magiclantern.fm/hdr/CeroNoice/engarde2/small/8047.jpg) (http://a1ex.magiclantern.fm/hdr/CeroNoice/engarde2/8047.jpg) (http://a1ex.magiclantern.fm/hdr/CeroNoice/engarde2/small/8527.jpg) (http://a1ex.magiclantern.fm/hdr/CeroNoice/engarde2/8527.jpg) (http://a1ex.magiclantern.fm/hdr/CeroNoice/engarde2/small/9188.jpg) (http://a1ex.magiclantern.fm/hdr/CeroNoice/engarde2/9188.jpg)
(http://a1ex.magiclantern.fm/hdr/CeroNoice/engarde2/small/9296.jpg) (http://a1ex.magiclantern.fm/hdr/CeroNoice/engarde2/9296.jpg) (http://a1ex.magiclantern.fm/hdr/CeroNoice/engarde2/small/9715.jpg) (http://a1ex.magiclantern.fm/hdr/CeroNoice/engarde2/9715.jpg) (http://a1ex.magiclantern.fm/hdr/CeroNoice/engarde2/small/9717.jpg) (http://a1ex.magiclantern.fm/hdr/CeroNoice/engarde2/9717.jpg)

Attempt 3:

Looking at some reference JPEGs posted by engardeknave here (http://www.magiclantern.fm/forum/index.php?topic=7022.msg90328#msg90328), I realized this kind of photos should be even brigher:

(http://a1ex.magiclantern.fm/hdr/CeroNoice/engarde3/107-9927-9933-e-small.jpg) (http://a1ex.magiclantern.fm/hdr/CeroNoice/engarde3/107-9927-9933-e.jpg) (http://a1ex.magiclantern.fm/hdr/CeroNoice/engarde3/117-9328-9331-e-s-small.jpg) (http://a1ex.magiclantern.fm/hdr/CeroNoice/engarde3/117-9328-9331-e-s.jpg)

Since shadow level was already maxed out (the brightest exposure from enfuse input was almost white), I've biased enfuse towards brighter midtones by setting enfuse_options = "--gray-projector=value --exposure-mu=0.6" in the script (default is 0.5) and I've also enabled 16-bit TIF output. Applied -sigmoidal-contrast 5 via ImageMagick, converted to jpeg (quality 75 to keep files small) and here's the result:

(http://a1ex.magiclantern.fm/hdr/CeroNoice/engarde3/small/3871.jpg) (http://a1ex.magiclantern.fm/hdr/CeroNoice/engarde3/3871.jpg) (http://a1ex.magiclantern.fm/hdr/CeroNoice/engarde3/small/3929.jpg) (http://a1ex.magiclantern.fm/hdr/CeroNoice/engarde3/3929.jpg) (http://a1ex.magiclantern.fm/hdr/CeroNoice/engarde3/small/7600.jpg) (http://a1ex.magiclantern.fm/hdr/CeroNoice/engarde3/7600.jpg)
(http://a1ex.magiclantern.fm/hdr/CeroNoice/engarde3/small/8047.jpg) (http://a1ex.magiclantern.fm/hdr/CeroNoice/engarde3/8047.jpg) (http://a1ex.magiclantern.fm/hdr/CeroNoice/engarde3/small/8527.jpg) (http://a1ex.magiclantern.fm/hdr/CeroNoice/engarde3/8527.jpg) (http://a1ex.magiclantern.fm/hdr/CeroNoice/engarde3/small/9188.jpg) (http://a1ex.magiclantern.fm/hdr/CeroNoice/engarde3/9188.jpg)
(http://a1ex.magiclantern.fm/hdr/CeroNoice/engarde3/small/9296.jpg) (http://a1ex.magiclantern.fm/hdr/CeroNoice/engarde3/9296.jpg) (http://a1ex.magiclantern.fm/hdr/CeroNoice/engarde3/small/9715.jpg) (http://a1ex.magiclantern.fm/hdr/CeroNoice/engarde3/9715.jpg) (http://a1ex.magiclantern.fm/hdr/CeroNoice/engarde3/small/9717.jpg) (http://a1ex.magiclantern.fm/hdr/CeroNoice/engarde3/9717.jpg)

And finally, you can download some 16-bit low-contrast TIF files (as saved by enfuse) if you want to edit them: 3871.tif (http://a1ex.magiclantern.fm/hdr/CeroNoice/engarde3/3871.tif), 9296.tif (http://a1ex.magiclantern.fm/hdr/CeroNoice/engarde3/9296.tif) and 9717.tif (http://a1ex.magiclantern.fm/hdr/CeroNoice/engarde3/9717.tif).

In a nutshell, this is what you can get with my scripted workflow and minimal tweaking.
Title: Re: CeroNoice - HDR tool inspired from ZeroNoise
Post by: Greg on December 16, 2013, 03:52:33 PM
It looks great. HDR programs can throw into the trash.  ;D
Title: Re: CeroNoice - HDR tool inspired from ZeroNoise
Post by: bart on December 16, 2013, 04:13:38 PM
Wow those are very high quality, natural and pleasing looking results. Well done!
Title: Re: CeroNoice - HDR tool inspired from ZeroNoise
Post by: engardeknave on December 16, 2013, 06:01:44 PM
The colors are really bad, but we're getting very close on the levels. I say this because they are different photoshoots and they're starting to look consistent. Once they're consistent, there's a baseline, and it's just a matter of personal taste from there. In ACR there's sliders for "blacks" and "whites", which seem to adjust shadow and highlight contrast respectively. That's what I'd probably use on most of these. I think there might be something going on with conflicting colorspaces too. They should all be sRGB, but I might have shot some in AdobeRGB.

God these houses are ugly. I should have thought of this before, but I just dug up all the finished shots from my site. I had to do a lot of color adjustments for most of these, so don't get hung up on the colors. Also the finished ones are all straightened out too.

(http://firstshowingphoto.com/wp-content/gallery/4722-new-castle-drive-frisco/115-3871-3875-e-s.jpg) (http://firstshowingphoto.com/wp-content/gallery/4722-new-castle-drive-frisco/115-3871-3875-e-s.jpg) (http://firstshowingphoto.com/wp-content/gallery/4722-new-castle-drive-frisco/115-3871-3875-e-s.jpg) (http://firstshowingphoto.com/wp-content/gallery/4722-new-castle-drive-frisco/126-3929-3933-e-s.jpg) (http://firstshowingphoto.com/wp-content/gallery/4722-new-castle-drive-frisco/126-3929-3933-e-s.jpg) (http://firstshowingphoto.com/wp-content/gallery/8612-fisher-rd-frisco/103-7600-7606-e-s.jpg) (http://firstshowingphoto.com/wp-content/gallery/8612-fisher-rd-frisco/103-7600-7606-e-s.jpg)
(http://firstshowingphoto.com/wp-content/gallery/15833-mirasol-drive-fort-worth/110-8047-8053-e.jpg) (http://firstshowingphoto.com/wp-content/gallery/15833-mirasol-drive-fort-worth/110-8047-8053-e.jpg) (http://firstshowingphoto.com/wp-content/gallery/4109-silverwood-lane/113-8527-8531-e-s.jpg) (http://firstshowingphoto.com/wp-content/gallery/4109-silverwood-lane/113-8527-8531-e-s.jpg) (http://firstshowingphoto.com/wp-content/gallery/4431-chasemoor-place-frisco/110-9188-9192-e.jpg) (http://firstshowingphoto.com/wp-content/gallery/4431-chasemoor-place-frisco/110-9188-9192-e.jpg)
(http://firstshowingphoto.com/wp-content/gallery/2551-daybreak-drive-rockwall/110-9296-9300-e-s.jpg) (http://firstshowingphoto.com/wp-content/gallery/2551-daybreak-drive-rockwall/110-9296-9300-e-s.jpg) (http://firstshowingphoto.com/wp-content/gallery/3434-chaparral-dr-farmers-branch/101-9715-9719-e.jpg) (http://firstshowingphoto.com/wp-content/gallery/3434-chaparral-dr-farmers-branch/101-9715-9719-e.jpg) (http://firstshowingphoto.com/wp-content/gallery/3434-chaparral-dr-farmers-branch/108-9717-9722-e.jpg) (http://firstshowingphoto.com/wp-content/gallery/3434-chaparral-dr-farmers-branch/108-9717-9722-e.jpg)
Title: Re: CeroNoice - HDR tool inspired from ZeroNoise
Post by: dmilligan on December 16, 2013, 11:35:35 PM
@a1ex,

You might be interested in PixInsight. It has a very good HDR merging tool (that is mask based like this technique): http://pixinsight.com/forum/index.php?topic=2320.0

Also, all the sorts of advanced stuff you can do with PixInsight (like PixelMath, image analysis and statistics) seems to me like it would be right up your alley. It's easily extensible and scriptable as well (it's designed that way), you can easily work with linear data and huge precision (64-bit float). Most of the tools and workflows are aimed at astrophotography though.
Title: Re: CeroNoice - HDR tool inspired from ZeroNoise
Post by: engardeknave on December 17, 2013, 09:37:02 AM
Ok, something must be wrong with your dngs, A1ex. Maybe the headers. I found that I could save a 32-bit TIF as DNG from ACR (strangely it stays 32-bit). Then I can open it up in ACR and adjust exposure from -10 to 10.
Title: Re: CeroNoice - HDR tool inspired from ZeroNoise
Post by: a1ex on December 17, 2013, 09:38:08 AM
Can you send me your DNG?
Title: Re: CeroNoice - HDR tool inspired from ZeroNoise
Post by: engardeknave on December 17, 2013, 10:14:39 AM
Also noticed the file is twice the size. http://we.tl/Hu3av6SqHg

Your dng is ~84mb, Adobe's is 150. A 32-bit tif is 240. Photomatix produces a 32-bit .hdr file that is 63mb. This works great in ACR, except there's no way to open multiple .hdr files at once in ACR. So frustrating.
Title: Re: CeroNoice - HDR tool inspired from ZeroNoise
Post by: a1ex on December 17, 2013, 10:27:49 AM
From file size, I guess Adobe's DNG is a Linear DNG (that is, demosaiced). Will download and take a look.
Title: Re: CeroNoice - HDR tool inspired from ZeroNoise
Post by: engardeknave on December 17, 2013, 06:44:50 PM
I found this: http://www.adobe.com/support/downloads/dng/dng_sdk.html

No idea if it's useful. Looking at the source I see interesting things like "dng_mosaic_info.cpp" ("A interpolation kernel for a single pixel of a single plane") and "dng_linearization_info.cpp".
Title: Re: CeroNoice - HDR tool inspired from ZeroNoise
Post by: a1ex on December 17, 2013, 06:58:44 PM
You can open the DNG with dng_validate.exe from that zip.

Another idea: compress the DNG with Adobe DNG Converter and see if ACR likes it better.
Title: Re: CeroNoice - HDR tool inspired from ZeroNoise
Post by: engardeknave on December 17, 2013, 08:37:47 PM
Same after Adobe DNG convertor. I'd tried dng_validate, but it gave me an error message on both your DNG and the one I saved from ACR.

I also confirmed that there seems to be better highlight control in ACR with the Adobe DNG than the ones CeroNoise is making.
Title: Re: CeroNoice - HDR tool inspired from ZeroNoise
Post by: a1ex on December 17, 2013, 08:43:35 PM
CeroNoice does not make any highlight control. I have no idea what you are comparing.

For dng_validate, make sure you have the SDK for DNG 1.4, not earlier.
Title: Re: CeroNoice - HDR tool inspired from ZeroNoise
Post by: Greg on December 17, 2013, 08:45:27 PM
engardeknave, try this :

(http://s23.postimg.org/sflho3jgr/dng.jpg)
Title: Re: CeroNoice - HDR tool inspired from ZeroNoise
Post by: engardeknave on December 17, 2013, 10:00:36 PM
I tried that in ACR already. No effect. (The options for those of you who don't have ACR and can't read moonspeak are "Linear (demosaiced)" and "Uncompressed".)

QuoteCeroNoice does not make any highlight control. I have no idea what you are comparing

I'm talking about the sliders in ACR. The exposure control goes from -5 to +5 with your dng and -10 to +10 with Adobe's, but I wasn't sure if that was really meaningful until I tested with a few of the sliders in ACR.
Title: Re: CeroNoice - HDR tool inspired from ZeroNoise
Post by: rudison on December 17, 2013, 10:23:17 PM
Oh my god!!!
What a great tool!

I tried it with 3 raw files from the 650D (AEB 2 EV). Size for each file ~ 18 MB.
CeroNoice creates a file of 71 MB (dng_validate tells me: 32 bit, FloatingPoint, uncompressed)
With DNGConverter (or import into LR 5.3) the filesize is 54 MB (32 bit, FloatingPointX2, deflate)
With DNGConverter (lossy) the filesize is reduced to 23 MB (16 bit, FloatingPointX2, deflate)

I think the last option is the best one. 16 bit FloatingPoint should be good enough.
(Adobe creates a 8 bit lossy jpg DNG file if you select lossy compression for a raw file directly from the camera. But a 32 bit FP DNG is converted into a 16 bit FP DNG!).

For the final image it is necessary to adjust the basic sliders in Lightroom (exposure, contrast, highlights, shadows, ...) The exposure limit (-5/+5) is not a problem for me. If one of the sliders reaches the limit (shadows?) I can also adjust the tone curve.

The final image seems to be as good or better than the image I got in the past with enfuse. I will continue testing.


Note: This is the correct link to the SDK 1.4: http://www.adobe.com/support/downloads/detail.jsp?ftpID=5475
Title: Re: CeroNoice - HDR tool inspired from ZeroNoise
Post by: a1ex on December 17, 2013, 10:30:11 PM
When you see -5..5 EV in Lightroom, it's using 16 bits for raw processing (just like stock dcraw/ufraw). For things where dual ISO is enough, this is fine. For more extreme brackets like the ones from this thread, it's not.

When it shows -10..10 EV, it uses some higher bit depth, and this is what we should get. Probably it's something missing in the DNG header (not sure what yet).
Title: Re: CeroNoice - HDR tool inspired from ZeroNoise
Post by: rudison on December 18, 2013, 12:06:39 AM
Ok, now I understand the problem.

I tried it with a more extreme bracket. In this case I had to set the exposure to +5 and shadows to +100. And I get ugly patterns/banding in the dark areas.

I suspect Lightroom will only use the higher bit depth if a debayered file is imported (I tried tiftest.dng from engardeknave).

   
Title: Re: CeroNoice - HDR tool inspired from ZeroNoise
Post by: engardeknave on December 18, 2013, 01:41:30 AM
The Lightroom controls are just calling the same codebase as ACR from a different GUI as I understand it.

I tried the SDK 1.4 (which I thought I had & linked), and assuming you haven't tried yourself yet for whatever reason:

Validating "out.dng"...
*** Warning: Too little padding on left edge of CFA image (possible interpolation artifacts) ***
*** Warning: Too little padding on top edge of CFA image (possible interpolation artifacts) ***
*** Warning: Too little padding on right edge of CFA image (possible interpolation artifacts) ***
*** Warning: Too little padding on bottom edge of CFA image (possible interpolation artifacts) ***
Raw image read time: 0.045 sec
Linearization time: 0.034 sec
Interpolate time: 0.313 sec
Validation complete


Validating "tiftest.dng"...
Raw image read time: 1.266 sec
FindNewRawImageDigest time: 0.547 sec
Linearization time: 0.192 sec
Interpolate time: 0.000 sec
Validation complete
Title: Re: CeroNoice - HDR tool inspired from ZeroNoise
Post by: rudison on December 18, 2013, 11:27:22 PM
The tool dng_validate is able to convert the 32bit floating point dng into a 32bit floating point tiff (linearization, black/white level mapping, demosaic processing). This allows the following workflow:


CeroNoice.exe 1.dng 2.dng 3.dng 4.dng
dng_validate.exe -3 out out.dng
exiftool.exe -tagsfromfile 1.dng out.tif


Afterwards the tif file can be imported in Lightroom. The white balance / levels / tone curve needs to be changed, but with good quality (EV -10 ... 10). The tif file can also be processed with other tools for advanced tonemapping techniques.

Disadvantages:

@ a1ex: Is it possible to make a version of CeroNoice that creates a 16 bit (32 bit?) integer dng (linear)? With or without a black level? Maybe this gives enough quality if it's not a scene with very high dynamic range (no extreme bracket).
Title: Re: CeroNoice - HDR tool inspired from ZeroNoise
Post by: engardeknave on December 19, 2013, 12:56:30 AM
Ah, this is a big step in the right direction. I've been trying to figure this out for hours. Although with regard tot he colors, I have the saturation pegged and it's just barely enough.

If I could make a request, it would be a ceronoise that accepts an output file name argument so I can start scripting this.
Title: Re: CeroNoice - HDR tool inspired from ZeroNoise
Post by: a1ex on December 19, 2013, 05:53:23 PM
Great find.

If you can isolate a minimal set of tags that ACR is looking for, it would be even more helpful for me.

@engardeknave: will do, but most likely next year. I also want to match WB (the bottom-left picture from your set needs it, probably because of fluorescent lighting), add some basic checks for motion artifacts, and use 16-bit output (both integer and float).

The current version was coded in a couple of hours (it's pretty much the cr2hdr code with the deinterlacing part removed).
Title: Re: CeroNoice - HDR tool inspired from ZeroNoise
Post by: engardeknave on December 20, 2013, 02:34:10 AM
If you can isolate a minimal set of tags that ACR is looking for, it would be even more helpful for me.

I attempted and failed at this for an embarrassing number of hours yesterday.

I think there might be some other problem though, or maybe exposure fusion is just better. I say this because I have at least two photos which had far better highlight recovery after Enfuse. Also I'm not sure the color issue is just a matter of messing with wb/green/saturation. I found it impossible to get the colors quite right with these. I was going to post examples, but I'm busy trying to work out a different process right now.
Title: Re: CeroNoice - HDR tool inspired from ZeroNoise
Post by: kirkt on December 28, 2013, 05:03:58 AM
I've managed to spend a little bit of time trying to find a useable workflow for DNG Float -> 32bit TIFF as outlined above, using the dng_validate application.   Using the Mac version, I took a DNG Float file from LumaRiverHDR and ran it through dng_validate.  The image data is a merge of two non-dualIso (regular raw) images into a single DNG Float  - however, the same basic merging applies using the CeroNoice concept.

The output is the "-3" third stage file, a TIFF that has UniWB (all channel multipliers = 1):

(http://kirkt.smugmug.com/Photography/Link-Share/i-RgKgSSR/0/X3/Stage3outScreenShot-X3.jpg)

I opened this image in Photoshop and used the Unified Color PS plug-in called 32Float to edit the 32bit TIFF.  Here is the default tone mapped image in the 32 Float interface:

(http://kirkt.smugmug.com/Photography/Link-Share/i-FbjQ3JD/0/O/HDRExposeAuto.jpg)

What is really nice about 32 Float is its 32bit white balance tool.  In this test scene (shot a couple of years ago) I included a gray target - I click-white-balanced on it and got:

(http://kirkt.smugmug.com/Photography/Link-Share/i-rRpqqJb/0/X3/HDRExposeWB-X3.jpg)

From 32 bit float I returned a 32bit image that I could then work on as usual in PS.  I found that other methods of trying to massage the 32bit UniWB TIFF left a lot of green artifact.  ACR accepts 32bit TIFFs but cannot handle the UniWB data - trying to WB the file is a disaster. 

Here is the final image, after some adjustments in PS:

(http://kirkt.smugmug.com/Photography/Link-Share/i-W4dKDh9/0/O/STAGE3OUTAfter.jpg)

This method permits me to use my "standard" 32bit workflow, with some minor modifications at the beginning of the process.  If one tried to convert a single, optimally exposed raw file of this scene, you could get the basic tonal range, but the shadows would be filled with noise that would ruin detail and tonal transitions in the shadows, especially under the table and in the jacket, for example.  Even the relatively uniform wall tones would be riddled with noise that would smear and disrupt the gradual tonal transition and falloff of the window light. 

Cool!

kirk
Title: Re: CeroNoice - HDR tool inspired from ZeroNoise
Post by: engardeknave on December 28, 2013, 08:24:06 AM
QuoteI found that other methods of trying to massage the 32bit UniWB TIFF left a lot of green artifact.  ACR accepts 32bit TIFFs but cannot handle the UniWB data - trying to WB the file is a disaster. 

This is the problem I encountered, but I didn't understand why. I had some success opening a -3 .tif directly into Photoshop and using auto levels. In levels, you have to change the options to Enhance Per Channel Contrast, and click one of the target colors and check Relative To Document. I only tried one file so far though.
Title: Re: CeroNoice - HDR tool inspired from ZeroNoise
Post by: garry23 on December 28, 2013, 11:42:20 AM
Although this nay be a little off topic, this article gives sound useful insight into getting minimum noise data in the camera: http://photographylife.com/riddle-intermediate-iso-settings.

Cheers

Garry
Title: Re: CeroNoice - HDR tool inspired from ZeroNoise
Post by: globalphotobank on December 29, 2013, 03:18:04 AM
How does one use this? CeroNoice I use CS6 and lightroom 5?
Title: Re: CeroNoice - HDR tool inspired from ZeroNoise
Post by: engardeknave on December 29, 2013, 03:49:09 AM
1) Type "ceronoice"

2) Type some file names

3) Press enter
Title: Re: CeroNoice - HDR tool inspired from ZeroNoise
Post by: RenatoPhoto on December 29, 2013, 02:07:16 PM
I tried ZeroNoise on a set of braketed photos for 360 view.  I use Photomatix Pro 4.2.4 (64-bit) to merge the photos and export them as tiffs.  Then I use ACR for final touchup.

I used ZeroNoise and imported the resulting dng into ACR.  I like the results very much except for an area where the chromatic aberration gets out of control.  It is amazing how fast ZeroNoise can accomplish the merging task!!!

Here is the troubled area of the picture.   

https://drive.google.com/file/d/0B9z8Y0rg-pu8UzlSSVZzVllDVXc/edit?usp=sharing

Title: Re: CeroNoice - HDR tool inspired from ZeroNoise
Post by: a1ex on December 29, 2013, 10:52:14 PM
These are motion artifacts (known limitation).
Title: Re: CeroNoice - HDR tool inspired from ZeroNoise
Post by: RenatoPhoto on December 30, 2013, 04:54:49 AM
I will test it again in an area where there is no motion.  This is very promising!!
Thanks
Title: Re: CeroNoice - HDR tool inspired from ZeroNoise
Post by: Legushka on April 14, 2014, 02:19:49 PM
32bit dng --> tiff 16bit in windows?
Title: Re: CeroNoice - HDR tool inspired from ZeroNoise
Post by: garry23 on April 14, 2014, 04:13:00 PM
Trying to get a CeroNoice workflow going on my 64bit set up. Usually I see +/-10 Ev in LR.

Placed dcraw in that folder.

Put CeroNoice.exe in a folder.

Exported two .cr2 brackets for evaluation to that folder.

Moved the two .cr2s onto CeroNoice, which created an .DNG.

Now the problem: the dng opens OK in LR, but is only a +/- 5Ev image file.

I think I need to run another step: with dng_validate.exe maybe, ie to convert to 32bit TIFF. But I can't find dng_validate.exe.

Could someone point me in the right direction regarding dng_validate and the completion of the workflow to 32bit processing in LR.

Cheers

Title: Re: CeroNoice - HDR tool inspired from ZeroNoise
Post by: engardeknave on April 15, 2014, 05:31:54 PM
Should be this: http://www.adobe.com/support/downloads/dng/dng_sdk.html
Title: Re: CeroNoice - HDR tool inspired from ZeroNoise
Post by: garry23 on April 16, 2014, 12:48:52 AM
Enderdeknave

Thanks.

Downloaded and extracted dng_validate and placed in a folder with CeroNoice.exe etc.

As I said in another post, I can generate a dng OK, ie I get an out.dng, but I'm afraid I simply don't know how to progress with the command line instructions for dng_validate.

I hope some kind person can talk me through a simple workflow ro get to a +/- 10Ev Tiff (32bit) for Lightroom post processing.

Cheers

Garry

Title: Re: CeroNoice - HDR tool inspired from ZeroNoise
Post by: engardeknave on April 16, 2014, 12:58:09 AM
Quote from: rudison on December 18, 2013, 11:27:22 PM

CeroNoice.exe 1.dng 2.dng 3.dng 4.dng
dng_validate.exe -3 out out.dng
exiftool.exe -tagsfromfile 1.dng out.tif

Title: Re: CeroNoice - HDR tool inspired from ZeroNoise
Post by: garry23 on April 16, 2014, 01:47:22 AM
Once again, many thanks.

I understand the workflow, however, I am still stumbling.

The reason is my stupidity as I'm not familiar with using the command line etc.

The remaining question, with the three .exes in a folder with the input .cr2s, I notice you have .dngs, how should I call up the command line process or put the commands in file.

I don't wish to waste your time anymore, you have been very helpful.

I guess I won't further this route, because of my lack of Win knowledge.

As I say, thanks for your responses.

Title: Re: CeroNoice - HDR tool inspired from ZeroNoise
Post by: garry23 on April 16, 2014, 03:09:45 AM
Ok, I'm making progress!!

I've educated myself on .bat files and run this two image test:

CeroNoice.exe 1.cr2 2.cr2
dng_validate.exe -3 out out.dng
exiftool.exe -tagsfromfile 1.cr2 out.tif

Seems to run OK, ie no error messages, but it doesn't look right to me, eg how do you get from out.dng to out.tiff.

All I get is an 16 bit out.dng, ie no 32 bit out.tiff.

Can someone point out where I'm going wrong?

Sorry to be a pain, however, I know this forum is full of helpful people.
Title: Re: CeroNoice - HDR tool inspired from ZeroNoise
Post by: garry23 on April 16, 2014, 03:24:33 PM
Have taken a step back, but have more insight after injecting a pause in my .bat file and seeing I have an error:

Warning: The exposure time is <=0
DNGBackwardversion is ... too high

The two exposures I am using are 1/10 and 1/80. I tried the script with .cr2 and .dng. Both failed.

The script is:
CeroNoice.exe 1.dng 2.dng
dng_validate.exe -3 out out.dng
exiftool.exe -tagsfromfile 1.dng out.dng
pause

Any help welcomed.

Title: Re: CeroNoice - HDR tool inspired from ZeroNoise
Post by: a1ex on April 16, 2014, 03:57:47 PM
Simply try reading the thread.

Quote from: a1ex on December 17, 2013, 08:43:35 PM
For dng_validate, make sure you have the SDK for DNG 1.4, not earlier.

Quote from: rudison on December 17, 2013, 10:23:17 PM
Note: This is the correct link to the SDK 1.4: http://www.adobe.com/support/downloads/detail.jsp?ftpID=5475
Title: Re: CeroNoice - HDR tool inspired from ZeroNoise
Post by: garry23 on April 16, 2014, 04:19:38 PM
Alex

Just to reassure you I am not one to 'just' jump in. I read and re-read this thread and others to find a solution, but, because of my poor coding skills I was flummoxed, ie I didn't understand the error messages.

I also honestly thought I had 1.4 running. I checked after reading your last post and, yes, I had 1.3 running.

1.4 running now and conversion to 32 Tiff works fine.

The Tiff initially has a strong green tint, but I can remove this in post.

Thanks for you response: I'm up and running!

Garry
Title: Re: CeroNoice - HDR tool inspired from ZeroNoise
Post by: garry23 on April 16, 2014, 04:48:20 PM
Realtime feedback here: so don't moan at all my posts :-o).

1. lots of lag in LR (64 bit) in processing 32 bit Tif. In fact I had to click on and off images to force updates. Could 'just' be size of Tif, ie about 250Mb.
2. No problems in Ps-CC (64 bit)
3. Tif starts with green tint, easily removed via WB tool
4. Real problem is that the tif is very noisy in the shadow regions, despite one of the brackets being taken for those zones

These are early observations, but the noise still being there worries me. I seems that the noise is being carried over from some of the images that are taken for the highlights.

Title: Re: CeroNoice - HDR tool inspired from ZeroNoise
Post by: a1ex on April 16, 2014, 04:52:11 PM
Did you pass the bracketed shots in the correct order? (see the help)
Title: Re: CeroNoice - HDR tool inspired from ZeroNoise
Post by: garry23 on April 16, 2014, 05:02:22 PM
Alex

The brackets are in order of increasing exposure, from lightest to darkest. I can't see any reference to order.

Here is the script:
CeroNoice.exe 1.cr2 2.cr2
dng_validate.exe -3 out out.dng
exiftool.exe -tagsfromfile 1.cr2 out.dng
pause

BTW I still get error messages about exposure time <=0 and padding.
Title: Re: CeroNoice - HDR tool inspired from ZeroNoise
Post by: a1ex on April 16, 2014, 05:03:25 PM
Quote
Usage: CeroNoice DARK.CR2 BRIGHTER.CR2 EVEN_BRIGHTER.CR2 ...
Title: Re: CeroNoice - HDR tool inspired from ZeroNoise
Post by: garry23 on April 16, 2014, 05:13:35 PM
Alex

Thank you!! I simply could not find that reference.

Looks much better now!!! Will carry on experimenting.

BTW I still get exposure <=0 warning and padding messages.

Once again: thanks for your patience with me.
Title: Re: CeroNoice - HDR tool inspired from ZeroNoise
Post by: engardeknave on April 18, 2014, 03:55:55 AM
A1ex, will you make this work with full paths & file names for the input and output files yet? I'd like to script this to run along side my current workflow so I can compare the results. Would be tested on a ton of files.
Title: Re: CeroNoice - HDR tool inspired from ZeroNoise
Post by: garry23 on April 18, 2014, 04:13:54 AM
I have just posted a workflow, but it is awaiting moderator action.
Title: Re: CeroNoice - HDR tool inspired from ZeroNoise
Post by: garry23 on April 19, 2014, 07:07:39 AM
Engardeknave

BTW here is some workflow scripting I did.

I find this greatly speeds up my processing from within LR.

http://www.magiclantern.fm/forum/index.php?topic=11508.0

Cheers

Garry
Title: Re: CeroNoice - HDR tool inspired from ZeroNoise
Post by: engardeknave on April 19, 2014, 09:57:16 AM
Garry, my existing scripts consist of several thousand lines of vbscript that automatically process and sort hundreds of bracket sets from several shoots at once. I'm asking A1ex to make Ceronoice work with paths so I don't have to employ weird hacks or copy gigabytes of temp files during this process.
Title: Re: CeroNoice - HDR tool inspired from ZeroNoise
Post by: garry23 on April 19, 2014, 02:50:20 PM
Got it. I thought I was in a different league to you :-o)
Title: Re: CeroNoice - HDR tool inspired from ZeroNoise
Post by: garry23 on April 19, 2014, 07:51:05 PM
Alex (anyone else)

I have tried to use CeroNoice with .cr2 files from my S95 and G11: but no luck, even if I convert to .dng first.

I get RAW info inject failed and no camera model error.

As I've converted the 12-bit .cr2 to .dng, I thought this might be OK. But it appears it isn't.

Bottom line: I'm guessing CeroNoice doesn't run and runs with 14-bit .cr2s? Or am I missing a trick?
Title: Re: CeroNoice - HDR tool inspired from ZeroNoise
Post by: a1ex on April 22, 2014, 09:01:47 AM
engardeknave: will do (sorry, forgot about it).

garry23: nice workflow, would be interesting to see more samples. Maybe you can compare the results with whatever other HDR software you were using? (I don't really know them, I use enfuse for tonemapping and that's pretty much all my experience with HDR software).

I also have in mind some more updates, basically updating the exposure matching algorithm from the latest cr2hdr, Kalman weighting (to reduce noise even more), white balance matching (some samples from engardeknave require it) and soft-film curve (to squeeze the HDR data in a 16-bit DNG container). Not sure what to do about motion artifacts though.

Can you upload some raw files from S95 and G11?
Title: Re: CeroNoice - HDR tool inspired from ZeroNoise
Post by: garry23 on April 22, 2014, 02:37:16 PM
Alex/Engardeknave

The 'issues' I have seen, having spent a weekend playing with CeroNoice, is that it only works with my 14-bit images, ie not 12-bit. BTW how do I send you bracketed images from my S95? I have a dropbox but I think I need your email address to share. I'm sorry, I'm not up to speed on dropboxes etc.

The other issue I have seen is that some images have a very fine, ie a pitch of 4 pixels, slightly dark grid imprinted on the processed image. Clearly visible.

I also always get padding warnings and exposure <= 0 warning. But as these don't appeared to interfere with the processing I ignore them!

I have also tweaked by workflow by making my .bat an .exe. This way I simply export the images from in LR and by .exe does the rest in the background, ie the user sees no command window and the CeroNoice processed image 'magically' appears in a LR watched folder. I also added in some error handling, ie checking for the right input (.cr2 or .dng) and returning an error jpeg to LR instead of a 32-bit TIFF. My .exe also returns the TIFF with the original file name plus a "_32bit" appended for identification.

I will compare images with other 32-bit merging routes asap.

Cheers

Title: Re: CeroNoice - HDR tool inspired from ZeroNoise
Post by: garry23 on April 22, 2014, 02:41:06 PM
Alex

Try this link:

https://www.dropbox.com/sh/5i1by5uw86hz8nc/yZhcwsHQaF
Title: Re: CeroNoice - HDR tool inspired from ZeroNoise
Post by: garry23 on April 22, 2014, 03:01:06 PM
Alex

Here is a TIFF that exhibits the matrix-lije artifact:

https://www.dropbox.com/sh/2z5k0ylrh642s0z/CVBp6urTtI
Title: Re: CeroNoice - HDR tool inspired from ZeroNoise
Post by: a1ex on April 22, 2014, 03:25:39 PM
Can you upload the CR2 files for the matrix artifact?

Tip: you can also use the edit button ;)
Title: Re: CeroNoice - HDR tool inspired from ZeroNoise
Post by: garry23 on April 22, 2014, 03:37:05 PM
Dropbox updated with .cr2s.

If it works: here is a CeroNoice processed image:

(https://www.dropbox.com/s/7gsb9hp7p17nnh9/Backbone.jpg)

Not sure if there is a size or downsizing engine working here?
Title: Re: CeroNoice - HDR tool inspired from ZeroNoise
Post by: garry23 on April 22, 2014, 03:37:36 PM
Image clearly didn't post. OK I'm dumb!!!
Title: Re: CeroNoice - HDR tool inspired from ZeroNoise
Post by: garry23 on April 22, 2014, 03:38:48 PM
Anyway, here's in the processed image in Dropbox:

https://www.dropbox.com/s/7gsb9hp7p17nnh9/Backbone.jpg
Title: Re: CeroNoice - HDR tool inspired from ZeroNoise
Post by: a1ex on April 22, 2014, 03:45:06 PM
How are the artifacts looking like? I don't know what to look for...
Title: Re: CeroNoice - HDR tool inspired from ZeroNoise
Post by: garry23 on April 22, 2014, 03:47:19 PM
Alex

In the tiff if you zoom in to the pixel level you can see that there is an every fourth pixel pattern in  the x and y directions.

The effect is clearer to see on some images than others, and not on every one.
Title: Re: CeroNoice - HDR tool inspired from ZeroNoise
Post by: a1ex on April 22, 2014, 03:55:01 PM
Found it by merging the raw files; looks like a black level issue in my algorithm (had it with dual iso). Need to update the code.
Title: Re: CeroNoice - HDR tool inspired from ZeroNoise
Post by: garry23 on April 22, 2014, 04:14:06 PM
Glad you found it!  I was beginning to worry it was me!

BTW can you explain why I get the exposure and padding warnings?

Cheers
Title: Re: CeroNoice - HDR tool inspired from ZeroNoise
Post by: a1ex on April 22, 2014, 04:16:02 PM
Because I didn't fill them in the DNG :P
Title: Re: CeroNoice - HDR tool inspired from ZeroNoise
Post by: garry23 on April 22, 2014, 04:37:08 PM
OK, this is simply a test of my ability to post a low res image, plus show what CeroNoice-based processing can do (all be it low res):

(https://www.dropbox.com/s/7gsb9hp7p17nnh9/Backbone.jpg)

PS: I didn't pick up on the 900 limit!!
Title: Re: CeroNoice - HDR tool inspired from ZeroNoise
Post by: garry23 on April 22, 2014, 04:39:01 PM
OK: can someone help me.

The image link I embedded was 900x674.

Why don't I see it?

Stupid from New Mexico!
Title: Re: CeroNoice - HDR tool inspired from ZeroNoise
Post by: a1ex on April 22, 2014, 04:45:03 PM
You need to link to a plain jpeg image, not to a HTML page.
Title: Re: CeroNoice - HDR tool inspired from ZeroNoise
Post by: garry23 on April 22, 2014, 04:45:44 PM
Alex

I used this link.

https://www.dropbox.com/s/7gsb9hp7p17nnh9/Backbone.jpg
Title: Re: CeroNoice - HDR tool inspired from ZeroNoise
Post by: a1ex on April 22, 2014, 04:53:01 PM
Your link goes to this page:

<!DOCTYPE html><html lang="en" xmlns:fb="http://ogp.me/ns/fb#" xml:lang="en" class="media-desktop" xmlns="http://www.w3.org/1999/xhtml"><head><script type="text/javascript">
                window._document_observe_listeners = [];
                document.observe = function(event, func) {
....


A JPEG looks like this:

00000000  ff d8 ff e0 00 10 4a 46  49 46 00 01 00 01 00 48  |......JFIF.....H|
00000010  00 48 00 00 ff e1 20 0e  45 78 69 66 00 00 49 49  |.H.... .Exif..II|
00000020  2a 00 08 00 00 00 0b 00  00 01 03 00 01 00 00 00  |*...............|
00000030  a4 16 00 00 01 01 03 00  01 00 00 00 3c 1e 00 00  |............<...|
00000040  02 01 03 00 03 00 00 00  92 00 00 00 12 01 09 00  |................|
00000050  01 00 00 00 01 00 00 00  15 01 03 00 01 00 00 00  |................|
...


So, try placing the JPEG in the Public folder, where you can get a direct link to the JPEG (not to a HTML page).
Title: Re: CeroNoice - HDR tool inspired from ZeroNoise
Post by: garry23 on April 22, 2014, 05:39:26 PM
Alex

As I said, I'm dumb.

Thanks for spending time to educate me n

Unfortunately, Dropbox free doesn't allow public folders.

In future I will simply put links to an image, as I don't intend to post many images  :)
Title: Re: CeroNoice - HDR tool inspired from ZeroNoise
Post by: a1ex on April 22, 2014, 05:47:10 PM
Ouch... looks like they disabled the feature for new accounts.

Does this trick work? http://techdows.com/2012/10/create-public-folder-dropbox-new-account.html
Title: Re: CeroNoice - HDR tool inspired from ZeroNoise
Post by: garry23 on April 22, 2014, 06:18:32 PM
Alex

No trick, I'm afraid it just asked me for money to upgrade to pro.

Thanks for looking into this.

Cheers
Title: Re: CeroNoice - HDR tool inspired from ZeroNoise
Post by: alexpok on April 22, 2014, 10:12:07 PM
Quote from: a1ex on December 15, 2013, 04:47:48 PM
After having some trouble getting ZeroNoise (http://www.guillermoluijk.com/article/nonoise/index_en.htm) working, I coded my own version of the algorithm (well, only the part I understood) and ran a little experiment to check whether you should really take as many brackets as you can, or whether you can get away with just 2 or 3 pictures spaced at 4 EV or more (http://www.magiclantern.fm/forum/index.php?topic=9285.msg91737#msg91737).

I've called my program CeroNoice, pronounced pretty much like ZeroNoise, with a Spanish "ce" ("hay que sacar la lengua").


I test this program lots of times, the image quality in result is amaizing, thanks for that a1ex - i also have a problems with original ZeroNoise.

I found some problems as well, i will try to describe them below, may be it helps to improve this wonderfull tool.

1. I decided to limit testing  by only 2 shots, 3EV difference. The reason - the quality already very good in case of no problems, in case of some problems additional files only makes it worse.

2. I made 2 sequences by 2 shots, run CeroNoice, run DNG_validate as described. The only difference between these sequences was one additional lamp turned on - it produces some highlights on scene. In good case (lamp off) i just process out.dng in Adobe Photoshop camera RAW 8.3 - i did not noticed any problems, just huge quality increase. In bad case (lamp on) green color cast appears on some objects - with highlights (best visible on white cups behind). Most important, that when checking resulting 32 bit tiff file  - it still exists and i can not imagine any transofmation, that can eliminate it - the area in wich it ocuurs has almost identical 
lighting, so you cant apply any curve (transformation).
  I think, that here some sort of rounding problem - this problem already exist in this huge 256 Mb tiff file.

I put a link to my Google  drive here  with these examples. I can say, that situation is quite repeatable in different conditions, in case of using 3 files blue color cast begins etc.
I have tried to make these examples illustrative, but may be made some mistake.

https://drive.google.com/folderview?id=0B72zfsjcoFZGanVIeVM5RDM4ZXc&usp=sharing

PS. I also did a comparison to the dual ISO in this case - also very good improvment over original version, but some noticable color artifacts (looks like chromatic aberrations, beter visible on a sauce bottle text on the left and power outlet on the wall). But very usable image in result. I also put it into the same directory.
WB - grey point below the name of coffemachine on the left. All image provided are Canon 5dIII .cr2
Title: Re: CeroNoice - HDR tool inspired from ZeroNoise
Post by: garry23 on April 23, 2014, 06:50:00 AM
As some may have picked up, I now have a quasi-plug-in for CeroNoice working in Lightroom (but Windows only I'm afraid).

In addition to CerioNoice.exe, dng_validate.exe and dcraw.exe, you need my "CeroNoice Bracketing.exe", which is the 'glueware' processor between CeroNoice.exe, dng_validate.exe and Lightroom.

My workflow is as follows:
1.   Set up once:
a.   Create a processing folder anywhere in your system;
b.   Place CeroNoice Bracketing.exe in that folder with the three other three .exes;
c.   Create a sub-folder in your processing folder called "ceronoice watched folder";
d.   In LR, under file & auto input settings, point at the "ceronoice watched folder" (and create a destination folder in LR);
e.   Create an export preset (called it anything you like) with the following attributes: export to the processing folder you created, ie with the .exes in; select export format as original (it works with .cr2 or .dng); under post processing after export, point to "CeroNoice Bracketing.exe"

2.   To use:
a.   Select the images to be processed in ascending order of 'brightness', ie by ctrl + left mouse clicking;
b.   Export by selecting the preset you set up above, ie right click + export;
c.   Wait a few seconds and in the auto import destination folder will appear your 32-bit TIFF. All working files will have been deleted. Also my .exe carries out some simple error handling, ie throw some .jpgs at it!

In conclusion, although my approach is not a fully-fledged plug-in (like kichetof achieved - well done), the .exe and auto-input approach achieves auto/one-click-like processing of CeroNoice from within a Windows Lightroom environment.
Title: Re: CeroNoice - HDR tool inspired from ZeroNoise
Post by: a1ex on April 23, 2014, 07:37:58 AM
@alexpok: nice samples, will take a look. Can you include the result of the original ZeroNoise with these files?

(I'm just curious to see how it works, since I couldn't run it)
Title: Re: CeroNoice - HDR tool inspired from ZeroNoise
Post by: alexpok on April 23, 2014, 04:44:29 PM
Quote from: a1ex on April 23, 2014, 07:37:58 AM
@alexpok: nice samples, will take a look. Can you include the result of the original ZeroNoise with these files?

(I'm just curious to see how it works, since I couldn't run it)

In case of these examples it crashes on the last stage. I spent lot of time, push it to work - missing DLL in system, i have to set previous date on computer, compatibility mode with WinXP etc. But sometime (depends on files) it crashes on last stage - not enougth memory. Too much for me ( I have 64Gb (Win64)) - i decided to stop trying.

But i have cheked your patched Ufraw version ( i am not sure, that i know how to set all necessary options, but i dit what i can). The same problem - i put small jpeg files - how it looks to the same folder, and add the third file - you can see another (i think so) type of artifacts.

More interesting, i think - i try some (new for me) Photoshop workflow, emulating your program. I put processed cr2 files on separate layers, and try to use very nice option - layer blending with comdition. I simply take (not very precise) highlights from one image, and rest from brighter one. It works, but this procedure is time consuming and nonlinear by itself. Whats interesting - i have the same artifacts in the same place (on a cups), but have some walkaround - in Photoshop you can "split" the border of this algoritm, after this some of the pixels you take from first, some - from second, and certain critical amount on the border - mixed. This works. The result is not so bright and nice that in your program, but it works. Thats why i am sure, that particular this problem could be solved with moderate time.

[Addition of the next day].

I put the results (jpegs, but full res around 4 megs each) of both CeroNoice and my Photoshop method in the same subdir CeroNoice.Bad
The result of CeroNoice was processed 2 ways - by Adobe Camera Raw 8.3, and modified UFRAw. I should say, that result of UFraw looks much better - it doesnt have greenish color cast, and all artifacts much less prominent.
Now my image a little bit brighter - i modified method a little.

[endOfAddition]


PS.
The numbers (on the border) in this huge tif are pretty close, but i found this problem (much less prominent tho) even in "Good" situation.  May be performing all calculations in double (8 byte) could help. For example, with FFT i can perform multiplications of numbers with  millions decimal digits(nvidia CUDA) with double and only 10000 or so with float.  Even one wrong constant and conversion(8-4-8) can ruin all algorithm.

PPS. Thanks for your great work - its realy amaizing. I even did not believed my eyes trying RAW video and Dual ISO.
Title: Re: CeroNoice - HDR tool inspired from ZeroNoise
Post by: garry23 on April 24, 2014, 05:26:33 AM
Alex

Just to let you know that I went to use CeroNoice.exe tonight and my Norton security remove your .exe!

This is the data Norton created:

acoutts.com
Web Site Location       United States of America
icoCaution
CAUTION
Site Owner? Click here
Norton Rating
Safeweb Share
Norton Safe Web has analyzed acoutts.com for safety and security problems. Below is a sample of the threats that were found.
Summary

    Computer Threats: 1
    Identity Threats: 0
    Annoyance factors: 0

I now need to download again!
Title: Re: CeroNoice - HDR tool inspired from ZeroNoise
Post by: lureb74 on May 15, 2014, 02:22:25 PM
Quote from: garry23 on April 23, 2014, 06:50:00 AM
In addition to CerioNoice.exe, dng_validate.exe and dcraw.exe, you need my "CeroNoice Bracketing.exe", which is the 'glueware' processor between CeroNoice.exe, dng_validate.exe and Lightroom.

What exactly is the meaning of "CeroNoice Bracketing.exe, which is the 'glueware' processor between CeroNoice.exe, dng_validate.exe and Lightroom"? And where I can find this "CeroNoice Bracketing.exe", if it is shared?

Sorry for the question, but I tried many times to obtain DNGs with +/-10 exp stops il LR with CeroNoice, I really don't understand how to...
The only ways that I've found since now are with PS (merge with HDR Pro), Photomatix or many other HDR softwares. Great softwares, because they have deghosting tools too, but they are expensives...
Title: Re: CeroNoice - HDR tool inspired from ZeroNoise
Post by: josepvm on August 19, 2014, 06:22:23 PM
I get lots of pink and also green dots when trying to make an HDR picture of a sunset with CeroNoice, from a bracketed series, EOS 500D

(http://www.arrakis.es/~josepvm/out_2.jpg)

Image (https://dl.dropboxusercontent.com/u/44995840/out_2.jpg)

The pink and green dots must be blown highlights in the brighter exposures. And I suppose the issue is related with bad white level info in the cr2 files.

As suggested in the ufraw-mod thread (http://www.magiclantern.fm/forum/index.php?topic=9597.msg112815#msg112815), I've tried to convert the cr2 files to DNG with Adobe DNG converter, and then process the DNG series wih CeroNoice, but this does not solve the issue. Checking the black and white levels for the DNG's (with "exiftool -BlackLevel -WhiteLevel *.dng") I get values of 1024 for black level and 13200 for white level. I've tried to reduce the white level value in the DNG's using:

exiftool -WhiteLevel=10000 *.dng

and even

exiftool -WhiteLevel=4000 *.dng


and then compose the HDR with CeroNoice again, but this does not solve the problem, either.

Here is a link to a Dropbox folder (https://www.dropbox.com/sh/wouwezhizfl9jmy/AAA46eYzbH4oHoQdHMfEmwRta) with the original frames in cr2 format, the same frames converted to DNG, and the resuting HDR with CeroNoice (jpg format. processed with ufraw-mod, the 32 bit float DNG is huge)


The issue is not exclusive to CeroNoice. Using Darktable (that also gets a HDR picture in DNG format directly merging the cr2 files) I also get these pink dots in sun's reflection on the sea surface.


The original Zeronoise, by Guillermo Luijk, (to be precise, the Linux port by Juanma Font  (http://zeronoiseforlinux.blogspot.com.es/)), that first converts every cr2 file with dcraw and then merges the resulting tiff files, brings good results, no pink and green dots (some further adjustments done with Darktable):

(http://www.arrakis.es/~josepvm/ZN_230344.jpg)

Image 2 (https://dl.dropboxusercontent.com/u/44995840/ZN_230344.jpg)

Any suggestion, to avoid these issues?



Title: Re: CeroNoice - HDR tool inspired from ZeroNoise
Post by: a1ex on August 19, 2014, 07:09:04 PM
These are motion artifacts (known limitation). Not sure what to suggest, need to research the topic first.
Title: Re: CeroNoice - HDR tool inspired from ZeroNoise
Post by: josepvm on August 19, 2014, 07:19:55 PM
Quote from: a1ex on August 19, 2014, 07:09:04 PM
These are motion artifacts (known limitation). Not sure what to suggest, need to research the topic first.

Ok, thanks, I had not taken into account that the water was moving  ??? At least a mistery solved for me, when using both CeroNoice or Darktable. This is also a tracked issue in Darktable for quite a long time.

Thanks again, A1ex. And a further question: would be possible to get a Linux build of CeroNoice? In case you don't want to share the source code for any reason, I have not found it in your Bitbucket repository...

Title: Re: CeroNoice - HDR tool inspired from ZeroNoise
Post by: a1ex on August 19, 2014, 07:27:34 PM
Here's the source, but building it requires some serious patching of ML DNG code (to add floating point support).

CeroNoice.c (http://a1ex.magiclantern.fm/bleeding-edge/CeroNoice.c)

From what I remember, you need to upgrade to DNG 1.4, remove the bad pixel opcodes, and tag the file as floating point. Building it with 16-bit integer output should be easier, but the dynamic range is very limited (only useful for those cases where dual iso is enough).
Title: Re: CeroNoice - HDR tool inspired from ZeroNoise
Post by: josepvm on August 19, 2014, 07:33:37 PM
Ok, thanks. I will try, but it seems too hard for me by now ... and considering that the Windows executable works fine with wine  :)
Title: Re: CeroNoice - HDR tool inspired from ZeroNoise
Post by: josepvm on August 20, 2014, 03:39:49 PM
I have taken a closer look at the HDR image processed with the original Zeronoise, and the motion artifacts are also present. This is a 100% crop of the same sunset scene in my previous post:

(https://dl.dropboxusercontent.com/u/44995840/ZN_pr-bl_0_ag_0.jpg)

Done with Zeronoise, with no progressive blending and no antighosting.


In CeroNoice and Darktable's HDR merging, the artifacts are a lot more visible, probably because the merging is done with not debayered files, and the artifacts produce, after debayering, zones with highly saturated magenta and green artifacts.

I have played with "Progressive blending" and "Antighost" settings in Zeronoise. And the artifacts can be reduced a little. Here are some samples:

(https://dl.dropboxusercontent.com/u/44995840/ZN_pr-bl_3_ag_0.jpg)

Progressive blending set to 3 pixels, Antighost set to 0.

(https://dl.dropboxusercontent.com/u/44995840/ZN_pr-bl_0_ag_3.jpg)

Progressive blending set to 0, Antighost set to 3 pixels.

(https://dl.dropboxusercontent.com/u/44995840/ZN_pr-bl_3_ag_6.jpg)

Progressive blending set to 3 pixels, Antighost set to 6 pixels.

The transition from a zone taken from a darker exposure to a zone taken from a brighter one is much less apparent, but other artifacts appear (see some circles on the water with a light blue halo), and also some detail is lost, and some of the people on the beach are erased.
Title: Re: CeroNoice - HDR tool inspired from ZeroNoise
Post by: josepvm on August 21, 2014, 03:49:47 PM
Quote from: a1ex on August 19, 2014, 07:27:34 PM
Here's the source, but building it requires some serious patching of ML DNG code (to add floating point support).

CeroNoice.c (http://a1ex.magiclantern.fm/bleeding-edge/CeroNoice.c)

From what I remember, you need to upgrade to DNG 1.4, remove the bad pixel opcodes, and tag the file as floating point. Building it with 16-bit integer output should be easier, but the dynamic range is very limited (only useful for those cases where dual iso is enough).

I have succesfully built it for Linux, in 16 bit integer mode.

It's quite easy. I have placed CeroNoice.c in "modules/dual_iso" directory, created a "Makefile.CeroNoice" file using "Makeflile.cr2hdr" as a template, replacing the "cr2hdr" or "CR2HDR" strings with CeroNoice or CERONOICE, respectively. And then adding a entry for "Makefile.CeroNoice" to the "Makefile" file in the same directory, similar to the already existing entry for "Makefile.cr2hdr". And at last, a simple "make CeroNoice" in the command line builds it.

It works, and the DR is not as wide as the 32 float version, of course, but is wide enough to merge a bracketed series of 2 exposures spaced 4EV. And both being Dual-ISO 100/800 shots. I process first the 2 Dual-ISO cr2 files with cr2hdr (20bit) and then I merge the resulting DNG files with CeroNoice.

This is enough for me to cover a lot of HDR scenes where a single Dual-ISO shot is not enough. And with only 2 frames, the delay between shots is short enough to minimize a lot of motion artifacts.

So this 16 bit integer version of CeroNoice seems to me a quite useful tool for creating HDR pictures.

It clips more highlights (both 16 bit integer and 32 bit float versions) than Zeronoise applied to the same frames. But is a lot faster and easier to use. So I only need to avoid exposing too much the darkest frame.
Title: Re: CeroNoice - HDR tool inspired from ZeroNoise
Post by: Guillermo Luijk on August 28, 2014, 07:59:23 PM
I think you are asking too much from a pixel selection algorithm, it will never work properly on moving scenes. What I do with ZN (the genuine one!) when moving parts of the scene affect differently lit areas, is to manually edit the blending map, forcing all pixels are taken from the same RAW source file. That would have worked perfect on the sea waves.

Automated anti-ghosting:
(http://www.guillermoluijk.com/tutorial/zeronoise/ag1_antes.jpg)
(http://www.guillermoluijk.com/tutorial/zeronoise/ag1_despues.jpg)


Manual anti-ghosting:
(http://www.guillermoluijk.com/tutorial/zeronoise/ag2_antes.jpg)
(http://www.guillermoluijk.com/tutorial/zeronoise/ag2_despues.jpg)

Regards
Title: Re: CeroNoice - HDR tool inspired from ZeroNoise
Post by: Guillermo Luijk on August 28, 2014, 08:09:38 PM
I don't know how to quote someone's post on this forum so I copy&paste here a comment by alexpok:

"I found some problems as well, i will try to describe them below, may be it helps to improve this wonderfull tool.

1. I decided to limit testing  by only 2 shots, 3EV difference. The reason - the quality already very good in case of no problems, in case of some problems additional files only makes it worse.

2. I made 2 sequences by 2 shots, run CeroNoice, run DNG_validate as described. The only difference between these sequences was one additional lamp turned on - it produces some highlights on scene. In good case (lamp off) i just process out.dng in Adobe Photoshop camera RAW 8.3 - i did not ..."



You will never get good results with the ZN algorithm if your images are not linearly correlated in exposure. If you switch on a lamp, not all pixels of the scene get the same extra amount of exposure, so the ZN algorithm will produce terrible artifacts in the merged composite. You would need a very wide progressive blending parameter (no idea if alex's ceronoice implements it) and even in that case the results can be wrong.

For such type of differently exposed images, I have found the Enfuse algorithm (actually I always use the Tufuse (http://www.tawbaware.com/tufuse.htm) implementation by Max Lyons) very robust. It is capable of even merging quite finely 2 shots where a flash was used only on one of the captures.

Regards

Title: Re: CeroNoice - HDR tool inspired from ZeroNoise
Post by: josepvm on August 29, 2014, 12:34:39 AM
Quote from: Guillermo Luijk on August 28, 2014, 07:59:23 PM
I think you are asking too much from a pixel selection algorithm, it will never work properly on moving scenes. What I do with ZN (the genuine one!) when moving parts of the scene affect differently lit areas, is to manually edit the blending map, forcing all pixels are taken from the same RAW source file. That would have worked perfect on the sea waves.

Thanks, Guillermo, I will try it.

And thanks for your programs (Zeronoise, Histogrammar) and your great tutorials and articles (Gracias por tus programas y los magníficos tutoriales y artículos en tu web  ;))


Title: Re: CeroNoice - HDR tool inspired from ZeroNoise
Post by: josepvm on October 28, 2014, 10:02:50 AM
Just to inform that CeroNoice 32-bit float DNGs can be sucessfully processed with Darktable.

This is the trick that Johannes Hanika has suggested me in Darktable's developers mailing list:

Quote
it's only that our float dng are normalised to clipping at 1.0, and these have crazy high values in them. so you need to disable the highlight reconstruction module (see screenshot) and stop down by like 15ev (right click and type in the respective slider in the exposure module, the range will dynamically expand).

Title: Re: CeroNoice - HDR tool inspired from ZeroNoise
Post by: Canon eos m on October 28, 2014, 06:10:07 PM
Hi Alex,

Tried to convert with CeroNoise. Black level (shadows) improved magically but pink patches in the upper middle portion of the picture.

Camera 5DM3
Format MLV
Converted with raw2cdng
Denoise with CeroNoise from OP
Sample File: https://www.dropbox.com/s/er72reml99a3atl/out.dng?dl=0

Another request: CN will not allow processing of more than 10 files in one go. Could this be increased? Not sure but better to ask :)


Title: Re: CeroNoice - HDR tool inspired from ZeroNoise
Post by: a1ex on October 28, 2014, 07:25:45 PM
Looks like some white level issue; if you have the input DNGs, I can take a look.

Don't remember about any limit on number of files, but I'm not sure why you need more than 10 images. This is not a general image stacking algorithm - it only does a dumb copying of the brightest pixels from each image. There are a lot of stacking programs, widely used in astrophotography.

Just found another program that seems to use the same algorithm: http://jcelaya.github.io/hdrmerge/

I didn't try it, but I should probably stop reinventing the wheel :P
Title: Re: CeroNoice - HDR tool inspired from ZeroNoise
Post by: mWaltari on October 29, 2014, 08:39:44 AM
Hello Alex,

How do you use 32 Floats for the CeroNoise?

Are you scaling/normalizing the original data 16bit int -> directly to the Float or are you scaling it to some other value range.

(White and Black level values in this code in 32bit Float)

Just pondering to do some hobby code for the Image prosessign with floats and All pointers are more than welcome ;)

.-Tee-.
Title: Re: CeroNoice - HDR tool inspired from ZeroNoise
Post by: a1ex on October 29, 2014, 08:56:48 AM
IIRC I'm scaling them to 0-65535, but for some reason they ended up as 0-131072.

Didn't try to debug this.
Title: Re: CeroNoice - HDR tool inspired from ZeroNoise
Post by: Canon eos m on October 29, 2014, 10:18:14 AM
Quote from: a1ex on October 28, 2014, 07:25:45 PM
Looks like some white level issue; if you have the input DNGs, I can take a look.

Input DNG: https://www.dropbox.com/s/v7jf1cnrx70j7iz/%5BCanon%205D%20Mark%20III%5D00000.dng?dl=0
Title: Re: CeroNoice - HDR tool inspired from ZeroNoise
Post by: a1ex on October 29, 2014, 12:39:20 PM
If you really used that DNG as input, and got the truck as output, you should really check your hard drive (time to restore your backups?)
Title: Re: CeroNoice - HDR tool inspired from ZeroNoise
Post by: Canon eos m on October 29, 2014, 02:01:13 PM
oops! really embarrassed  ;D

let me look for the right file an upload

Edit: https://www.dropbox.com/s/v7jf1cnrx70j7iz/%5BCanon%205D%20Mark%20III%5D00000.dng?dl=0
Title: Re: CeroNoice - HDR tool inspired from ZeroNoise
Post by: a1ex on October 29, 2014, 02:32:36 PM
You have used only one input file? You need at least two (with different exposure).
Title: Re: CeroNoice - HDR tool inspired from ZeroNoise
Post by: Canon eos m on October 29, 2014, 03:02:22 PM
Quote from: a1ex on October 29, 2014, 02:32:36 PM
You have used only one input file? You need at least two (with different exposure).

???

Let me go through the thread again .. missed the point completely  ???
Title: Re: CeroNoice - HDR tool inspired from ZeroNoise
Post by: garry23 on October 29, 2014, 09:51:21 PM
Canon eos m

I have written a few words here that may help: http://photography.grayheron.net/2014/04/noiseless-post-processing-fact-or.html
Title: Re: CeroNoice - HDR tool inspired from ZeroNoise
Post by: Canon eos m on October 30, 2014, 02:51:22 AM
Thanks Alex ....
Gary ... Will certainly try your workflow
Title: Opening DNG files in 32bit mode in LR
Post by: assaft on December 28, 2014, 02:40:42 AM
Thanks for the great efforts in developing and supporting this tool!

Just a small question - did anyone find a way to open DNG files in 32bit mode in Lightroom (exp. slider ranging from -10ev to +10ev)? Is there a tag or anything like that in the DNG file that needs to be set for Lightroom to open the file in 32bit mode?

I know about the trick of using dng_validate to convert the DNG to TIFF 32bit and it works nicely but I'm trying to avoid the big TIFF files and the more limited control over WB.

I tried to open DNG 32bit files created by HDRMerge and by PhotoAcute; same result - Lightroom opens them in 16bit so they have to be converted to TIFF 32bit before importing.
Title: Re: CeroNoice - HDR tool inspired from ZeroNoise
Post by: afre on January 09, 2015, 11:44:05 PM
.
Title: Re: CeroNoice - HDR tool inspired from ZeroNoise
Post by: cedricb on March 31, 2015, 04:08:37 PM
@a1ex: do you have the link for the latest source code and all the patches required so I can compile it for Linux (Fefora) ?  ...is your ufraw patch against the latest version?
...do you have a make file or something similar? 8)
Title: Re: CeroNoice - HDR tool inspired from ZeroNoise
Post by: a1ex on March 31, 2015, 04:38:31 PM
Yes, the link is in this thread.

My ufraw patches are here (complete repository): www.magiclantern.fm/forum/index.php?topic=9597
Title: Re: CeroNoice - HDR tool inspired from ZeroNoise
Post by: cedricb on March 31, 2015, 04:54:21 PM
QuoteHere's the source, but building it requires some serious patching of ML DNG code (to add floating point support).

CeroNoice.c

From what I remember, you need to upgrade to DNG 1.4, remove the bad pixel opcodes, and tag the file as floating point. Building it with 16-bit integer output should be easier, but the dynamic range is very limited (only useful for those cases where dual iso is enough).

...do I need some serious patches to enable 32bits?  :-X
Title: Re: CeroNoice - HDR tool inspired from ZeroNoise
Post by: eliz on April 28, 2015, 10:59:41 AM
Quote from: a1exAfter having some trouble getting ZeroNoise working
The Zeronoise v1.1 start only if the computer date is set to year 2011. I don't know why Guillermo made it like this. You can use this small utility to run it
http://www.nirsoft.net/utils/run_as_date.html
i use Dec 2011 and it's working

Will be nice if Guillermo make this program open source, this is a great tool
@later edit: it seems image blending code is already open source:
http://forum.luminous-landscape.com/index.php?topic=17775.msg200353#msg200353
Title: Re: CeroNoice - HDR tool inspired from ZeroNoise
Post by: josepvm on May 08, 2015, 08:47:21 AM
Quote from: eliz on April 28, 2015, 10:59:41 AM
The Zeronoise v1.1 start only if the computer date is set to year 2011. I don't know why Guillermo made it like this. You can use this small utility to run it
http://www.nirsoft.net/utils/run_as_date.html
i use Dec 2011 and it's working

Zeronoise for Linux (port by Juanma Font, available here: http://zeronoiseforlinux.blogspot.com.es/ ) works just fine for me on Ubuntu.

Title: Re: CeroNoice - HDR tool inspired from ZeroNoise
Post by: markanini on December 07, 2015, 12:58:42 AM
I tried running on a set of S90 CR2's and got this error:

Input file     : C:\Users\Barack Obama\Desktop\zero noise\IMG_1076.CR2
No camera model found with id 0x0
Error: RAW INFO INJECTION FAILED
Title: Re: CeroNoice - HDR tool inspired from ZeroNoise
Post by: markanini on December 14, 2015, 08:49:03 AM
Anyone?
Title: Re: CeroNoice - HDR tool inspired from ZeroNoise
Post by: josepvm on December 14, 2015, 01:08:36 PM
A1ex programmed CeroNoice modifying the code from cr2hdr, the utility used for processing Dual-ISO images taken with ML supported DSLR cameras. So I suppose CeroNoice may still contain the camera check code from cr2hdr and only works on images from ML supported DSLR's. Just gessing it.