MLV - Wrong black level - Pink/Magenta/Green casts in raw videos

[tom2]

one .MLV file: http://we.tl/UAb7JQYQDb
one .DNG file: http://we.tl/wkt9Is7dTG

I suspect a bug due to the fact that these clips were shot at 1280 50i...

thanx
tom

[ultimatemale]

This is a video tutorial to show you how i fixed the corrupt ML files that comes out looking black and green
Shot a music video on ML-RAW (not MLV)
Canon 5D3 1.2.3
ML build March 17th
Converted with RAWmagic lite
I use an apple Imac

[Audionut]

one .MLV file: http://we.tl/UAb7JQYQDb
one .DNG file: http://we.tl/wkt9Is7dTG

That's a white balance issue.  The green tint is from the lighting I suspect.  4200K +72 looks about right here.


@ultimatemale, great tutorial thanks.  I'll add it to the OP.

[tom2]

I'm glad to read that for you it seems to be only a color temperature issue with my clip (I was aware of that light shift).
What was your conversion method to go to this conclusion?
Unfortunatly, for me, it's much more than this: the mlv files are ok when read in MLRawviewer, but when I convert them to DNG, they appear to be dramaticaly green in Resolve  (debayer problem) and they make Resolve bug, and each time I'm forced to quit Resolve beacause it doesn't want to run these 50i clips!!!
Usually there is no problem, but with 25P clips.

[Audionut]

What was your conversion method to go to this conclusion?

I opened your DNG in Lightroom and adjusted WB. 

[tom2]

If you had the time to do the whole process from the mlv file I uploaded, maybe you will meet my bug (and solve it maybe?).
The issue may not be noticeable on one single frame, but on the whole video file.
Maybe there is something wrong in the fps metadata? (As I said, I meet this problem only with 50i videos)
thanks a lot!

[Audionut]

I don't have time for maybe.  Either upload corrupted images, or accept that your workflow is flawed. 

If there are only some corrupted images in the MLV file, then I expect you to find them and upload them. 

[vagavr]

Recently I experienced this wrong -Blacklevel problem with ~400GB of mk3 mixed RAW and MLV clips.
I dont like waste my time to do bot-work, so I write this two very simple windows batches.

First one exports RAW file to dng via raw2dng and correct -Blacklevel with exiftool.
To use you need to drop RAW (dont forget to concatenate RAW+R01+R02 etc.) files onto it.
https://docs.google.com/file/d/0B9mHlWQzMRjRNDd4ZUJ6MFFqOXc/edit

Second one corrects mlv files with mlv_dump. To use you need to drop folders with mlv files onto it.
https://docs.google.com/file/d/0B9mHlWQzMRjROGlTcVVIbHAtVTQ/edit

Do not forget to include path to folders with raw2dng, exiftool and mlv_dump into the Windows path variable, or use the full paths in the script.

This scrips are very stub and adapted to my case, but i hope they will be useful for somebody.

[Limelighter]

I have no idea what I'm doing wrong! I followed the instructions and when I go to add the "*.dng" part it says "0 image files updated
  628 image files unchanged" please help

[zelionprime]

I am getting my butt kicked by this problem! I can't seem to get ride of pink frames either. Here's what i've tried thus far after reading this thread.

I installed the following:
> Exiftool by Phil Harveyhttp://www.sno.phy.queensu.ca/~phil/exiftool/
>Raw2DNG

My Set up
> 5D MKII
> Force Black Levels OFF/On (I tried both off and on)
> Raw Recording is being used, I also tried MLV Recording as well

What I tried for my .RAW file
> Created DNGs with Raw2DNG but the DNGs. When I load said DNGs into DaVinci, it's all scrambled with black and pink flashes. Raw2DNG however does create a .MOV file for me that works fine but without sound.
> Created DNGs using RawMagic gave me pink frames. I uploaded 1 frame to my dropbox (https://www.dropbox.com/s/39f3ol60jaqc8l8/M21-2340_C0000_00769.dng)
> For the pink frames, I tried the terminal commands to no avail. Terminal returned a report of 0 Files Updated even when I used 1024 or 2048. Then I sent the .RAW file through Raw2DNG which produced new DNGs for me that were all scrambled. RAW2DNG did create a .mov file that played fine but had no sound.

What am I doing wrong here? I am using RAW2DNG now. On my 5D Mark II, I have shut off Force Black Levels. Any help is greatly appreciated. Soooo frustrated 

[Midphase]

I have no idea what I'm doing wrong! I followed the instructions and when I go to add the "*.dng" part it says "0 image files updated
  628 image files unchanged" please help

I keep getting the same error message and none of my files end up being changed at all. Does this have to do with the fact that I converted using RAWMagic? Unfortunately, I no longer have access to the original .raw file...does that mean I'm screwed?

[Audionut]

I get the same error from the DNG from zelionprime above.

Running that DNG through adobe DNG convertor, and I no longer get the error.  I would say that whatever program you are using to convert the MLV to DNG is causing the problems.  Suggest to contact the developer of that application.

@zelionprime, FWIW, --BlackLevel=1750 looks about right for that DNG.

[zelionprime]

I get the same error from the DNG from zelionprime above.

Running that DNG through adobe DNG convertor, and I no longer get the error.  I would say that whatever program you are using to convert the MLV to DNG is causing the problems.  Suggest to contact the developer of that application.

@zelionprime, FWIW, --BlackLevel=1750 looks about right for that DNG.

Thanks for responding Audionut. I am using Raw2DNG to convert the .RAW file from my camera. This is the file that Raw2DNG created for me (000000.dng) https://www.dropbox.com/s/02h4i1a6bpsppew/000000.dng. Note that it's not pink. I then ran that file in terminal using the code you recommended that uses exiftool and it produced the 000000.dng_original https://www.dropbox.com/s/mhfh2ygbyg2id0u/000000.dng_original.  There's seems to be something else wrong with it.

[Audionut]

White balance.  Try 2850K with 0 tint.

The command line should be overwriting the original, not producing some other output.  Not sure what you have going on there.

[Limelighter]

Thank you Audionut!!! It worked to convert the dng's!

[zelionprime]

White balance.  Try 2850K with 0 tint.

The command line should be overwriting the original, not producing some other output.  Not sure what you have going on there.

Ok well let's take it from the top:

For the Canon 5D Mark II, what settings should I use for video and any other settings?
Which ExifTool do you recommend?
I know I need Raw2DNG but what else do you recommend?
I am on an iMac 27" 2014 model

Is there anything at all I am missing please let me know. I am so dumfounded that others can get their DNGs to work but me. THnaks in advance!

[Audionut]

The best way to get the problem sorted, is to help the developers fix the issue in ML.  This would mean all of this post processing kludge would no longer be needed.

[tayz0n]

SOLVED
Hi, i have problem with terminal command with MLV_DUMP

What is "IN" and what is "OUT" .mlv file?
im dumb)

output file - its a new converted file from destenation *.MLV
mlv_dump was great, I have fix all my bug files

thanks for all

my command in terminal (for other noobs like me)

hack:zed hackpro$ /Users/hackpro/Desktop/zed/mlv_dump.osx --black-fix=2048 -o fixed.mlv m30-2010.mlv

 MLV Dumper v1.0
-----------------

Mode of operation:
   - Input MLV file: 'm30-2010.mlv'
   - Setting black level to 2048
   - Rewrite MLV
   - Output into 'fixed.mlv'
File m30-2010.mlv opened
File m30-2010.m00 opened
File m30-2010.m01 not existing.
Processing...
Reached end of chunk 1/2 after 1347 blocks
[ERROR] Invalid block size at position 0x00000000
Processed 638 video frames
Done

[stagsy]

Got the green cast - tried to fix using the exiftool method as in ultimatemale's video and get this....help!

exiftool -BlackLevel=2048 M29-0418_frame_000000t.dng
-bash: exiftool: command not found

[dmilligan]

did you install exiftool?

[stagsy]

Didn't install exiftool specifically as there was no mention of having to in ultimatemale's vid - I guess I thought it was something that just occurred.
How best to install - is there preferred approach e.g. perl(/) or not etc?

Also noticed a difference between mine and ultimatemale's initial "green" issue in that his preview image of the file was ok and it was only in photoshop that it turned green - whereas with mine, there is no preview, just the DNG logo. The green files became apparent when viewing in Bridge.

It would be profoundly useful to be able to preview them as thumbnails - is this an option?

[stagsy]

Ok. Installed Exif Tool and went throughout the whole process. Terminal says the image file was updated but when opening in photoshop, it still green.

[stagsy]

Switched on Fix black level, converted to DNG using mlvtodng, still no preview just logo, green cast when opening dng in Photoshop or Bridge.
Used ExifTool to correct and file updated but is still green.

Strange thing is in Camera Raw this green image's Temperature is set at the extreme end of the scale at 50000 and Tint is at the other extreme at -150 It looks ok when these are reined in to more normal levels but not sure this is the way to go as these are major adjustments being made just to get the image in the ball park to start with.

[dmilligan]

It sounds like the AsShotNeutral (white balance) in the DNG is wrong, not the black level. What converter are you using? What's the value of AsShotNeutral (use exiftool to find out)? Or just post a sample DNG.

[stagsy]

Using MLVtoDNG

https://www.dropbox.com/s/cgeijgif9lvzo61/M29-1224_frame_000015.dng?dl=0