Magic Lantern Forum

Using Magic Lantern => Raw Video => Topic started by: RenatoPhoto on December 14, 2013, 03:02:58 PM

Title: New and Old Banding Issues
Post by: RenatoPhoto on December 14, 2013, 03:02:58 PM
Here is a summary of the Banding issues that I could find.  Some Posts have been deleted but I was able to recover them using Google cached system.  I have provided the recovered post in zip files containing the html pages.

Any further Banding issues should be discussed here so I will lock the other post.

Weird vertical lines that fade away gradually
http://www.magiclantern.fm/forum/index.php?topic=8439.0
Sept 21

Vertical Lines: is it a recognized problem? Can it ruin the photography?
http://www.magiclantern.fm/forum/index.php?topic=8319.0
September 15

Banding issues
http://www.magiclantern.fm/forum/index.php?topic=7702.msg67345;topicseen#msg67345
August 16

Bad Banding
http://www.magiclantern.fm/forum/index.php?topic=6925.0
July 05

[SOLVED!] Dead pixels - Hot pixels - Banding in RAW recording ...
Lost
Jun 2
Recovered Here: https://drive.google.com/file/d/0B9z8Y0rg-pu8c2RIeUpUNHdIMHc/edit?usp=sharing

[SOLVED] Vertical banding in raw Canon 5D mark III - Magic Lantern
LOST
May 23 2013
Recovered Here: https://drive.google.com/file/d/0B9z8Y0rg-pu8c3J6dzVZQmdUdnM/edit?usp=sharing

5D MK3 Raw sensor ISO noise samples
http://www.magiclantern.fm/forum/index.php?topic=5609.0
May 23
-------------------

Related Post:

PinkDotRemover tool 650D
http://www.magiclantern.fm/forum/index.php?topic=6658.0;topicseen
June 15

Aliasing correction in 60FPS RAW Video
http://www.magiclantern.fm/forum/index.php?topic=8044.0
Sept 2
Title: Re: New and Old Banding Issues
Post by: Luiz Roberto dos Santos on December 14, 2013, 08:15:29 PM
@developers

Some example files from 600D with vertical banding and dead pixels.

ML_config: build 2013Dec09, 4c81cd113960
RAW_rec settings: 1280x544, extra hacks.
Modules: raw_rec.mo, mlv_play.mo and ettr.mo
[benchmarks, if necessary: http://goo.gl/s4MWKx and http://goo.gl/Ntqnco ]



Record in crop mode (3x), ISO 400: http://goo.gl/2xmpqY

Record in crop mode (3x), ISO 800: http://goo.gl/r3jiJy

Record in full mode (1x), ISO 1600: http://goo.gl/Jy9FqK


Just a comparison between crop and non crop mode raw (maybe this affect on vertical lines):


Record in full mode (1x), ISO 800: http://goo.gl/dNnwRX

Record in crop mode (3x), ISO 800: http://goo.gl/ztlXfQ


Greetings.
Title: Re: New and Old Banding Issues
Post by: eyeland on December 16, 2013, 05:29:02 PM
I'll be happy to do some highly controlled 5D3 LR/ACR/AE test-footage if needed, just let me know what parameters etc you're interested in. The banding issue I am seeing is the only thing keeping me from using ML  RAW video professionally.
Title: Re: New and Old Banding Issues
Post by: mannfilm on December 17, 2013, 06:53:41 PM
Canon 5Dm3. Are the RAW banding issues still there? I thought this was taken care of back in june or july. I've shot alot with the more recent builds, and have not noticed any banding - did I just miss it?
Title: Re: New and Old Banding Issues
Post by: Luiz Roberto dos Santos on December 19, 2013, 12:57:56 AM
I get new aleatory pattern on 600D, see this:







Image at 4s:


(http://img9.imageshack.us/img9/3305/r2q0.png)



Some DNG files: http://goo.gl/LHNrwN



This is interesting, because I thought it was just a few pixels and thought they were static, but no.
I converted the .raw in RAW2GPCF with these parameters: -444 -d4 -q5 -c -wl 55555
(I over the white level to become more apparent).
Title: Re: New and Old Banding Issues
Post by: Luiz Roberto dos Santos on January 28, 2014, 10:10:18 AM
FPN samples (https://app.box.com/s/b6ocscs5ip9c7jotmt5k). Simple silent pic from 600D. Appear more pattern on deep shadows. On crop mode, this not appear [or less].
Title: Re: New and Old Banding Issues
Post by: arrinkiiii on February 04, 2014, 09:33:39 PM

Hope this is the right thread... Here 2 dng's with some=full of banding/noise strips vertical in the 7D

https://www.dropbox.com/sh/mh5tx98ve7kjjwn/9lgxdsJF5L

Title: Re: New and Old Banding Issues
Post by: eyeland on February 26, 2014, 08:38:58 AM
I never uploaded further examples seeing as I haven't had any banding issues with builds form august and later :) Yay :)
Title: Re: New and Old Banding Issues
Post by: arrinkiiii on February 26, 2014, 10:28:40 AM

I never saw so much vertical strips/noise/banding as now. ISO 100 and any more dark/shadow area and is there...even i can see it in Lv.  Horrible! 
Title: Re: New and Old Banding Issues
Post by: eyeland on March 14, 2014, 07:15:55 PM
No matter what I do, I am unable to repeat the problem.
I have tested with a selection of nightly builds from the last 4 months, and I have not yet had the same frustrating stribes as seen in the test footage I linked in one of the above threads. I could go through some of the early builds that I used when I had the issue, but as that would mainly be an academic exercise, I don't see much point in that.
With this issue hopefully solved (fingers crossed) I am ready to use ML RAW video as soon as I get a project where the budget allows for the workflow :D
@arrinkiiii : If you still have issues with banding, could you post an example and upload a a DNG?
Title: Re: New and Old Banding Issues
Post by: arrinkiiii on March 14, 2014, 09:37:01 PM

Hi,

Im not at home but as soon i arrive i will post another example.

https://www.dropbox.com/sh/mh5tx98ve7kjjwn/9lgxdsJF5L

Title: Re: New and Old Banding Issues
Post by: a1ex on March 14, 2014, 09:39:04 PM
Status update: we are studying mathematical models for shadow FPN (banding) issues here: http://www.magiclantern.fm/forum/index.php?topic=10111.msg105075#msg105075

(if you are good at math, you are welcome to dissect the mathematical models there)
Title: Re: New and Old Banding Issues
Post by: arrinkiiii on March 14, 2014, 09:42:55 PM

I saw this and looks very good finding/development. But this will eradicate the need to upload a dark frame clip for subtraction?

Title: Re: New and Old Banding Issues
Post by: a1ex on March 14, 2014, 09:45:23 PM
That theory will answer how much improvement you can get with only OB data, with N dark frames, or with combined info from both dark frames and OB.
Title: Re: New and Old Banding Issues
Post by: arrinkiiii on March 14, 2014, 09:59:07 PM
This is wonderful.

I don't know other cameras but if this can be solved without the upload black frame subtraction in the 7D... Puffff, again and again, simple amazing.  The 7D in raw without this is almost unusable... Almost =)) Or you got all the image lit good or you will find this noise/pattern... Existed already a solution with the subtraction black frame but is not good workflow. For me everything is good... If people think, zebras in my canon? It's a bless!

Unfortunately my skills in math is with oranges, apples... Will not go forward then that. Hope someone read this 2 last post and can help with this math FPN.

Other things that I can help I'm glad do do it.
Title: Re: New and Old Banding Issues
Post by: claudewolke on May 27, 2014, 10:18:24 PM
hi folks,
I have an 5dmark 3 i am working on mlv with the 1.23 firmware. I also tried the 1.1.3 but there was no change the stripes are visible, and become more visible while make a grade.
I do not know how other peoble solve the problem with the vertical stripes but for me it is like that i cant work with this. I tried severals nightly builds.
here are two examples of .MLV you can see the stripes especialy in the white sky areas.

https://www.dropbox.com/sh/2g4nxocy131yqrv/AAA9WJAoKI6F8QBMsd-DQVMGa

For me it would be nice to get some advice.
PS. I make the conversion with mlrviewer. mlv2dng processed it more worse, and mlv_dump dont want to change this files to .raw so i was not able to do ohter tries.
When i capture .raw it looks same.

regards
c-.
Title: Re: New and Old Banding Issues
Post by: joeydingding on May 29, 2014, 04:09:48 PM
I really started to get annoyed by the banding on my 7D -

I use mlrawviewer

https://www.flickr.com/photos/75387828@N06/14294897161/
Title: Re: New and Old Banding Issues
Post by: baldand on May 29, 2014, 05:24:32 PM
Quote from: joeydingding on May 29, 2014, 04:09:48 PM
I really started to get annoyed by the banding on my 7D -

I use mlrawviewer

https://www.flickr.com/photos/75387828@N06/14294897161/

Did you try the new stripe preprocessing in MlRawViewer 1.1.6 (press 0/ZERO key to enable it)? I made it mainly to remove the stripes in my own 7D ISO 100/200 footage. Let me know in case it is not working well for your material.
Title: Re: New and Old Banding Issues
Post by: joeydingding on May 29, 2014, 06:25:23 PM
Heya I'll try it right now. So I need to press 0?

I first want to thank you for the good software you've made!!! It made my life easier

When I press 0 it does not doing anything I think.
Title: Re: New and Old Banding Issues
Post by: joeydingding on May 29, 2014, 06:31:26 PM
I use it on the mac, does that make any difference?
Title: Re: New and Old Banding Issues
Post by: baldand on May 29, 2014, 07:47:47 PM
Quote from: joeydingding on May 29, 2014, 06:31:26 PM
I use it on the mac, does that make any difference?

Mac should be fine. Just checking: You were using 1.1.6 (just released a few days ago) not an earlier version?

And you see no difference - stripes are still visible and just as strong as without? If you press 0 again it will turn off the correction so you can compare.

If you really see nothing, maybe you could send me one DNG file (exported with the stripe correction turned off) from your test material so I can check what is happening.
Title: Re: New and Old Banding Issues
Post by: joeydingding on May 29, 2014, 08:29:11 PM
yes sir! I used the the latest version I confirm. No difference, nothing happens at all. 

Hereby the DNG file.

https://www.dropbox.com/s/5eev7bgkbap47fh/M09-0225_000001.dng
Title: Re: New and Old Banding Issues
Post by: baldand on May 29, 2014, 09:44:58 PM
Quote from: joeydingding on May 29, 2014, 08:29:11 PM
yes sir! I used the the latest version I confirm. No difference, nothing happens at all. 

Hereby the DNG file.

https://www.dropbox.com/s/5eev7bgkbap47fh/M09-0225_000001.dng

Thanks. I tried it with 1.1.6 on Linux with NVIDIA, and Mac with AMD GPU running OS X Mavericks, and for me the stripes are removed fine.
I have no idea why it's not working for you :-(
Title: Re: New and Old Banding Issues
Post by: joeydingding on May 29, 2014, 10:13:43 PM
Ah maybe it is my hardware then sir.

IMAC: 10.1 MAVERICKS
Intel Core 2 Duo
3,06 GHz
12 GB
nVIDIA GeForce 9400
VRAM (totaal):   256 MB
Title: Re: New and Old Banding Issues
Post by: baldand on May 29, 2014, 10:35:39 PM
Quote from: joeydingding on May 29, 2014, 10:13:43 PM
Ah maybe it is my hardware then sir.

IMAC: 10.1 MAVERICKS
Intel Core 2 Duo
3,06 GHz
12 GB
nVIDIA GeForce 9400
VRAM (totaal):   256 MB

It could be. The GPU is a bit older (2008), though in theory it should still be ok (has OpenGL 3.3). It would be good if you could try it on some slightly newer machine.
Title: Re: New and Old Banding Issues
Post by: joeydingding on May 29, 2014, 10:37:51 PM
Will do chief. I really like the anamorphic desqueeze function as I shoot with anamorphic lenses 2x.
Title: Re: New and Old Banding Issues
Post by: claudewolke on May 31, 2014, 01:00:25 PM
Hello,
I wondering that there maybe different revisions of cameras, so some people have problems with vertical lines wich others do not have. Or is it like that all peoble have this line problems and nobody writes about it. Or is there some magic wisdom nobody shares? For example I tried this rawtherapy demosaic feature - in a way it works, but it changes the vertical stripes to a diagonal raster, and it takes much much time - its realy not a solution.
regards..
c.
Title: Re: New and Old Banding Issues
Post by: feureau on June 09, 2014, 03:23:41 PM
Quote from: claudewolke on May 31, 2014, 01:00:25 PM
Hello,
I wondering that there maybe different revisions of cameras, so some people have problems with vertical lines wich others do not have. Or is it like that all peoble have this line problems and nobody writes about it. Or is there some magic wisdom nobody shares? For example I tried this rawtherapy demosaic feature - in a way it works, but it changes the vertical stripes to a diagonal raster, and it takes much much time - its realy not a solution.
regards..
c.

To further my confusion.... I'm getting the weird banding only at 3X00 ISO but when it hits 4000 and above, the banding seems to disappear... even at 12800

@)@

The only magic wisdom so far seems to be only to use frame substraction. ANd I heard rawmagic somehow cleans up these vertical banding

http://www.schweinert.com/blog/files/13c6915054746061199bd8cbb982bc1a-50.html

EDIT: My response to the baseless accusation below has been removed without notice. Guess when you can't handle the truth, you just remove them.
Title: Re: New and Old Banding Issues
Post by: a1ex on June 09, 2014, 05:49:24 PM
I didn't progress much with studying this pattern, but test data is always welcome (DNG files).

The vertical stripes from 5D3 are in highlights, this pattern is in shadows. Two different issues, but I think I can come up with an algorithm to cover both cases as long as the pattern repeats every 8 pixels.

FYI: the algorithm for fixing these highlight patterns was implemented initially in raw2dng. Just so you know, since you seem to be good at giving credit to anyone else except the original authors.
Title: Re: New and Old Banding Issues
Post by: baskuipers on June 24, 2014, 09:11:41 PM
I've searched the forum but couldn't find anyone with a similar problem. I thought this would be the right topic to post it in. It ain't banding but it are Artifact issues.

I'm getting these ugly red and blue artifacts when recording MLV video on my 6D.
Resolution is set at 1536x642 but i am getting these results in other resolution as well. This image is shot with the Canon 24-105mm lens.

When i see this video the image is sooo much better then what i'm getting.


I don't have the VAF installed in my camera, could this solve all my problems and get me the same sharpness as in this video?
I can't be the card. Getting normal continous recording with the Sandisk Extreme Pro 32GB (95MB/s).

(http://82.75.207.247/share/Snapshot_6D-RAW_Bad_Artifacts.jpg)
Title: Re: New and Old Banding Issues
Post by: Steven on July 01, 2014, 07:20:24 PM
Looks like you need to get yourself a 5D3 or a mosaic engineering olpv filter ;)
Title: Re: New and Old Banding Issues
Post by: Frank7D on July 01, 2014, 07:22:52 PM
One other way to avoid that aliasing/moire is to use crop mode; the downside (or up?) is reduced FOV.
Title: Re: New and Old Banding Issues
Post by: QuickHitRecord on July 07, 2014, 06:26:32 AM
Does anyone have a good Before/After example of vertical stripe correction working? I have now used three different conversion apps that are supposed to correct vertical stripes, but the footage from my 5Diii (July 3 build) is still full of them, even at ISO400.
Title: Re: New and Old Banding Issues
Post by: ainotna on July 14, 2014, 10:09:40 AM
Hello,

I installed Magic Lantern last days on my 5d Mark iii. First I tried the February NEXT Feb. 2014 for 1.1.3.
First everything was great, all worked out well and i was happy with my new great material. but then
I realised these vertikale stripes specially in shades and bit higher iso (from 640 on)
in my raw & h.264 material. yesterday I put the 1.2.3. firmware and the latest ML-for it- same issue.
I checked the whole night for this bending issue. Now I somehow understand
that the sensor is affected and the answer is to shoot only in very low iso and bright situations, am i right?
Is my camera now more or less destroyed? because it also appears when i put out the sd with ml on it. i wanted to shoot
a feature-movie this friday with it and am searching desperately for any solution.

thx for your help

(http://schreibtisch_test_neu0001_c0000_00458.dng)
Title: Re: New and Old Banding Issues
Post by: Walter Schulz on July 14, 2014, 10:15:40 AM
ML is not able to alter IQ this way.
Downgrade to 1.1.3 and do some test shots.
Title: Re: New and Old Banding Issues
Post by: ainotna on July 14, 2014, 11:35:28 AM
i downgraded again, same vertikal stripes problem, also in low iso, only in shades.

Title: Re: New and Old Banding Issues
Post by: Stedda on July 14, 2014, 11:40:03 AM
Banding is a well known Canon issue, you just have to deal with it or try to reduce it through careful exposure...
Title: Re: New and Old Banding Issues
Post by: ainotna on July 14, 2014, 11:49:10 AM
Thx for your answers, I am trying to find out if there is any way to fix it. i was shooting the whole last months with my camera
in all sorts of lightning situations, my last movie was shown in cinema, a lot of deep black shades in it, but no vertical stripes. it appeared
after ML - do you have any suggestions if there is another way besides high-key shooting?
Title: Re: New and Old Banding Issues
Post by: Stedda on July 14, 2014, 11:58:11 AM
Have you used any post processing tools that include Alex's Vertical Stripe Correction? That's probably the best we'll get for now....
Title: Re: New and Old Banding Issues
Post by: ainotna on July 14, 2014, 12:48:30 PM
I used it in RAW-Magic, didnĀ“t work out
Title: Re: New and Old Banding Issues
Post by: Defkaunta on July 30, 2014, 02:49:45 PM
Okay, this is weird. I am using the Canon 5D Mark III .123 Nightly Firmware from July 16 and still get slight Banding (both visible on the mlv raw files & after conversion to dngs with "MLVMystic_v0.5". I haven't ticked on the Banding Correction for the Mark III in MLVMystic because it would just generate horribly pixelated/banded footage instead of correcting it.

Any help on how to get rid of the banding when shooting or getting it corrected afterwards? I looked through all other threads but they seem to focus on issues with .raw recording.

Should I rather record .raw files then .mlv files?

I am a little bit confused here. Is it a hardware issue with Canon's 5D which cant be fixed?
Title: Re: New and Old Banding Issues
Post by: chmee on September 05, 2014, 11:19:40 PM
could someone deliver me/us some samplefiles with horrible verticalbanding? 5-10 frames, put it into the samplefiles-thread (http://www.magiclantern.fm/forum/index.php?topic=11899.0).
Title: Re: New and Old Banding Issues
Post by: ariaelf on November 02, 2014, 09:44:45 AM
Would this be in the general category of "banding" or is there another word for what's going on here? Has this been seen before?

I wonder if it's an issue with the card, or the firmware. Haven't seen anything like this with my other cards, so perhaps the latest batch of KomputerBay64's was just too slow to handle RAW... shooting with 7D.

(http://s27.postimg.org/9im6kjwkj/GKitty_News_D1_C6_01_000005.jpg) (http://postimg.org/image/eh9oz30db/full/)
windows 7 screenshot (http://postimage.org/app.php)
Title: Re: New and Old Banding Issues
Post by: chmee on November 20, 2014, 12:23:10 AM
thats simply an error :) often happening, if the datarate is too high. lower the resolution and/or framerate.
Title: Re: New and Old Banding Issues
Post by: roybon_c on August 05, 2016, 08:53:33 PM
HELLO PEOPLE.

I got a problem.

Sometimes when i import my RAW files do rawmagiclite i cant open it up either. I cant export them to dng.

Why? Its very very annoying when i got footage wich is excellent but i cant use them.

Help me! >:(
Title: Re: New and Old Banding Issues
Post by: budafilms on September 29, 2016, 09:23:57 PM
@roybon_c

Try other one. Most people have problem with that soft, like me.
If not a problem soft, you have to check your shoot values, lights, etc.

Title: Re: New and Old Banding Issues
Post by: Danne on September 29, 2016, 09:35:47 PM
Tried exporting RAW with MLP? a1ex raw2dng refined by bouncyball(converts spanned files) included. Just download and install. Doesn,t need any additionals downloaded for simple raw to dng extraction.
http://www.magiclantern.fm/forum/index.php?topic=13512.0
Title: Re: New and Old Banding Issues
Post by: DeafEyeJedi on September 30, 2016, 09:08:18 AM
MLP is a must have for every ML OS X users, period!
Title: Re: New and Old Banding Issues
Post by: Audionut on September 18, 2018, 05:57:32 PM
I don't recall reading about any issues regarding banding, since forever.

Is this still relevant?
Title: Re: New and Old Banding Issues
Post by: sines on August 13, 2019, 10:48:15 PM
Below are 2 examples of DNG sequences from MLVs that I shot, and disposed of the MLVs from. They were decoded using MLV Viewer 1.4.3 and

Has anyone managed to develop a script to remove the banding in post? Since I only have the DNGs at this point, repackaging as MLV and re-decoding to DNGs is impossible, so I have to find another way to remove the stripes from what I have. I am entertaining a highly laborious idea of several vertical stripe "mattes" within Davinci Resolve that would allow for individual balancing of each series of 8 stripes to reduce the banding. But it seems like there has to be smarter "automagic" way to deal with it.

Thoughts?

No noise reduction
(http://toddsines.com/VerticalStripe_1.png)

Resolve temporal noise reduction filter applied
(http://toddsines.com/VerticalStripe_2.png)

The second image loses too much detail in the skin and water droplets.
It's a "look" but I want the detail back.

Thanks for any ideas or help!

Todd