Author Topic: [SOLVED!] Dead pixels - Hot pixels - Banding in RAW recording  (Read 104499 times)

a1ex

  • Administrator
  • Hero Member
  • *****
  • Posts: 12564
Re: [SOLVED?] Dead pixels - Hot pixels - Banding in RAW recording
« Reply #125 on: May 30, 2013, 11:46:36 AM »
Uh... for some reason, the windows version doesn't do the math right, but the linux one does... looking into it.

Edit: solved, download again, it was a windows-specific compiling flag.

https://bitbucket.org/hudson/magic-lantern/commits/b5e91e24995e

fascina

  • New to the forum
  • *
  • Posts: 27
  • 5D Mark III
Re: [SOLVED?] Dead pixels - Hot pixels - Banding in RAW recording
« Reply #126 on: May 30, 2013, 12:38:43 PM »
I can't believe it, but banding is really completely gone with newest RAW2DNG tool! What a historic moment, now we can shoot RAW FullHD even under the most demanding situations without color pixels or banding or whatsoever.

Alex, I think you (and the rest of the team) will really make filmmaking history with this. FullHD raw from a superb fullframe sensor, without any negative sideeffects whatsoever. You should get the Technical Oscar for this. And the resolution is the maximum one can get out of FullHD. What an amazing time to live in. Thank you so much!

swinxx

  • Hero Member
  • *****
  • Posts: 606
Re: [SOLVED?] Dead pixels - Hot pixels - Banding in RAW recording
« Reply #127 on: May 30, 2013, 12:43:55 PM »
https://www.dropbox.com/sh/bua4hwbm8w1i47f/3ArdOXBS5p

i have installed the newest build on my 5d mk3, 29_May,
made a complete reset of canon settings,
recorded some raw,
converted on the mac with raw2dng 0.10
got the same vertical noise.. :(
check the dropbox link.
the blue one is a screenshot and unsqueezed cause of anamorphic lens.
the dng is untouched.
thx.


squig

  • Hero Member
  • *****
  • Posts: 518
  • Crash test dummy MK3
Re: [SOLVED?] Dead pixels - Hot pixels - Banding in RAW recording
« Reply #128 on: May 30, 2013, 12:48:07 PM »
The mac version isn't updated yet, try again tomorrow with version 0.11.

swinxx

  • Hero Member
  • *****
  • Posts: 606
Re: [SOLVED?] Dead pixels - Hot pixels - Banding in RAW recording
« Reply #129 on: May 30, 2013, 12:52:39 PM »
great, thank you.

LucaBrasi

  • Freshman
  • **
  • Posts: 70
Re: [SOLVED?] Dead pixels - Hot pixels - Banding in RAW recording
« Reply #130 on: May 30, 2013, 01:10:29 PM »
Thanks a1ex and dev team for continuing the BMCC ass kicking, respect!!!

New raw2dng worked a treat  ;D

RenatoPhoto

  • Moderators
  • Hero Member
  • *****
  • Posts: 1509
  • 5DM3 / 7D
Re: [SOLVED?] Dead pixels - Hot pixels - Banding in RAW recording
« Reply #131 on: May 30, 2013, 02:12:46 PM »
A1lex.  Put up donation link so you can get 5D3.  I cannot keep up with all the testing!   ;D ;D ;D ;D

Congratulations!
http://www.pululahuahostal.com  |  EF 300 f/4, EF 100-400 L, EF 180 L, EF-S 10-22, Samyang 14mm, Sigma 28mm EX DG, Sigma 8mm 1:3.5 EX DG, EF 50mm 1:1.8 II, EF 1.4X II, Kenko C-AF 2X

vroem

  • New to the forum
  • *
  • Posts: 41
Re: [SOLVED?] Dead pixels - Hot pixels - Banding in RAW recording
« Reply #132 on: May 30, 2013, 02:32:17 PM »
I only have a 60D so I can't test this debug build. I made a dng with a lot of hot pixels by overexposing and using high iso. This way I found out that Adobe's raw engine corrects dead or hot pixels, but only the once that are not next to each other. Maybe this is a reason why results are so inconsistent...

I would suggest to use a program like RawTherapee for pixel peeping, it's free and open source.


1%

  • Developer
  • Hero Member
  • *****
  • Posts: 5936
  • 600D/6D/50D/EOSM/7D
Re: [SOLVED!] Dead pixels - Hot pixels - Banding in RAW recording
« Reply #133 on: May 30, 2013, 02:43:42 PM »
600D benefited from af_raw being set, try it on 60D. Did not get any banding.

marekk

  • Senior
  • ****
  • Posts: 331
  • www.oddajmisie.com
Re: [SOLVED?] Dead pixels - Hot pixels - Banding in RAW recording
« Reply #134 on: May 30, 2013, 02:44:01 PM »
I've got also a problem with some bad/hot pixels on 60D (I've just build ML from latest source).

https://docs.google.com/file/d/0B-HdscXfsKpgdXZGUUc0VTRVMEE/edit?usp=sharing

I only have a 60D so I can't test this debug build. I made a dng with a lot of hot pixels by overexposing and using high iso. This way I found out that Adobe's raw engine corrects dead or hot pixels, but only the once that are not next to each other. Maybe this is a reason why results are so inconsistent...
[/img]

marekk

  • Senior
  • ****
  • Posts: 331
  • www.oddajmisie.com
Re: [SOLVED!] Dead pixels - Hot pixels - Banding in RAW recording
« Reply #135 on: May 30, 2013, 02:44:48 PM »
thx, I will try it
600D benefited from af_raw being set, try it on 60D. Did not get any banding.

marekk

  • Senior
  • ****
  • Posts: 331
  • www.oddajmisie.com
Re: [SOLVED!] Dead pixels - Hot pixels - Banding in RAW recording
« Reply #136 on: May 30, 2013, 02:54:25 PM »
ok, no dead/hot pixels after compiling with lv_af_raw

600D benefited from af_raw being set, try it on 60D. Did not get any banding.

a1ex

  • Administrator
  • Hero Member
  • *****
  • Posts: 12564
Re: [SOLVED!] Dead pixels - Hot pixels - Banding in RAW recording
« Reply #137 on: May 30, 2013, 03:07:22 PM »
lv_af_raw enables edge detection. Don't use it.

marekk

  • Senior
  • ****
  • Posts: 331
  • www.oddajmisie.com
Re: [SOLVED!] Dead pixels - Hot pixels - Banding in RAW recording
« Reply #138 on: May 30, 2013, 03:13:05 PM »
ok
I've just checked RawTherapee Hot/Dead pixel filter and it works..


lv_af_raw enables edge detection. Don't use it.

marekk

  • Senior
  • ****
  • Posts: 331
  • www.oddajmisie.com
Re: [SOLVED!] Dead pixels - Hot pixels - Banding in RAW recording
« Reply #139 on: May 30, 2013, 04:03:13 PM »
hmm ... does edge detection work when AF is in manual mode ?

lv_af_raw enables edge detection. Don't use it.

fascina

  • New to the forum
  • *
  • Posts: 27
  • 5D Mark III
Re: [SOLVED!] Dead pixels - Hot pixels - Banding in RAW recording
« Reply #140 on: May 30, 2013, 06:20:45 PM »
There is a bug in the new RAW2DNG. When I convert RAWs with it, there are black vertical lines in those areas of the photo with are strongly overexposed.

This doesn't happen with the old RAW2DNG, however old RAW2DNG has vertical banding. Vertical banding is completely gone with new RAW2DNG. The footage looks soooo clean now without old vertical banding problem.

Please download and use Windows RAW2DNG to see the problem (vertical lines):

http://www.webpage-design.org/M30-1805.RAW

Problem occures both with Global Draw Off and On.

a1ex

  • Administrator
  • Hero Member
  • *****
  • Posts: 12564
Re: [SOLVED!] Dead pixels - Hot pixels - Banding in RAW recording
« Reply #141 on: May 30, 2013, 06:33:32 PM »
Those are zebras :D

bumkicho

  • Member
  • ***
  • Posts: 102
Re: [SOLVED!] Dead pixels - Hot pixels - Banding in RAW recording
« Reply #142 on: May 30, 2013, 06:36:16 PM »
Just tried new raw2dng window version. I see black vertical lines too.

Shield

  • Senior
  • ****
  • Posts: 254
Re: Dead pixels - Hot pixels - Banding in RAW recording
« Reply #143 on: May 30, 2013, 07:44:31 PM »
My lens (50/1.8) has no correction data on 5D3.

So do you have a 50/1 or a 50/1.8?

squig

  • Hero Member
  • *****
  • Posts: 518
  • Crash test dummy MK3
Re: [SOLVED!] Dead pixels - Hot pixels - Banding in RAW recording
« Reply #144 on: May 30, 2013, 08:17:41 PM »
Those are zebras :D

Now I'm seeing them too!



I have a feature request, I want wombats!

fascina

  • New to the forum
  • *
  • Posts: 27
  • 5D Mark III
Re: [SOLVED!] Dead pixels - Hot pixels - Banding in RAW recording
« Reply #145 on: May 30, 2013, 08:47:21 PM »
Zebras at overexposed areas are gone with the newest RAW2DNG, thanks A1ex!  :)

The footage is so amazingly clean now that the 8-Pixel-Vertical-Banding is gone. I can't believe it, it's so breathtaking. So sharp, such a unbelievable dynamic range, exceeding the best photochemical film in dynamic range.

bumkicho

  • Member
  • ***
  • Posts: 102
Re: [SOLVED!] Dead pixels - Hot pixels - Banding in RAW recording
« Reply #146 on: May 30, 2013, 08:59:38 PM »
Where is this newest raw2dng?

fascina

  • New to the forum
  • *
  • Posts: 27
  • 5D Mark III

swinxx

  • Hero Member
  • *****
  • Posts: 606
Re: [SOLVED!] Dead pixels - Hot pixels - Banding in RAW recording
« Reply #148 on: May 30, 2013, 10:34:00 PM »
yes, great. thank you. but it is pc only.
mac version 0.10 has the vertical noise problem. so we have to wait for .011 on the mac.
greets.

fascina

  • New to the forum
  • *
  • Posts: 27
  • 5D Mark III
Re: [SOLVED!] Dead pixels - Hot pixels - Banding in RAW recording
« Reply #149 on: June 02, 2013, 08:34:19 PM »
There are some subjects where the RAW2DNG algorythm does not yet recognize the 8-pixel-vertical-banding and therefore does not substracts it out.

I was about to upload some samples, but have seen that there is a new RAW2DNG update (https://bitbucket.org/hudson/magic-lantern/commits/97d9ed828854ad0d9376dd8e0917db51f3ee6df9) which is not yet available to download for Windows.

So I'll wait to check my RAW footage with the new RAW2DNG (once it will become available for download) before I upload the RAW samples.