The CinemaDNG Discussion (raw2cdng)

[ibrahim]

Hi,

I'm having issues with the lack of M00 for one of my large MLV footage. I have M01, M02 and M03.
I've tried to merge them with its associated .MLV in the Cmd on windows.

I notice that on mlRAwviewer (prior to merging and prior to export) there should be 3596 frames.
However after merging and then exporting the merged mlv on raw2cdng I get 3588 frames. Any idea what's wrong and why I'm not getting 3596 frames instead?

[Walter Schulz]

Merging files is contraproductive.
Merging files won't create missing file *.M00
-> I don't really care why there are 8 frames missing.

EDIT: If you wanted to ask if there is a way to convert frames stored in M01, M02 and M03 without M00: Yes, that's possible.

[chmee]

v1.7.5 is out
* please! treat it as a beta! i have no splitted files here (on my laptop).
* main patch - framebug solved (i think)
* toDo: Audiofix for Resolve (at home, then, in ~10days) | MLVlite-Support(need Samples) | tolerance on missing Files (see above M00-Example)

http://www.phreekz.de/wordpress/2014/04/magiclantern-raw2cdng-1-5-0/

regards chmee

[Kharak]

oooh snap!

I am testing this right now!

EDIT: So far so good! Converted 3 .MLV files, 2 of them 10 Gig, about 3000 Frames each and another 8.5 Gig and not one frame missing!

Good speed also! Very nice! Thank you so much for fixing this Chmee!

.mlv+audio
1920x1038
24 fps
non-Crop
5d3 113



May I request one tiny fix? The Convert button says "Converting" always, its not a big deal, but would be nice if it just said "Convert". It says "Converting" before and after clicking it, so might aswell just be "Convert"

[reddeercity]

Thanks chmee for the new build ,
 5D2 MLV+audio (1872x936) 3 spanning file total of 3:41 (4590 frames)
Check and all frames are there no missing frames at this point .
Tested New MLV Lite Support is there for spanning files (check out just only2 spanning files)  everything seems to be OK
not missing any frames , but there was a single first frame was total black , it wasn't there in other app thou , not a big deal thou.
In 3xCrop mode the cdng's all have pink cast it's like the black level is off .
Be on that,  No crashes very fast at extraction even on my very old Dell Inspiron 1764 i5 Laptop. 

Here is raw2cdng_mlv_lite_1856x1044 48-Cdng Frames there are normal looking and here is
raw2cdng_mlv-lite_1920x1038_3xCrop - 48 frames they have pink cast

I made a mini MLV for your mlvdiag.1.0.1 tool M23-1525.MLV.55mb.mlv this the 1856x1044 one &
here is the M23-1531.MLV.55mb.mlv for the 3xCrop 1920x1038 , it's the one that produces  pink cast over the image .

[ibrahim]

...
EDIT: If you wanted to ask if there is a way to convert frames stored in M01, M02 and M03 without M00: Yes, that's possible.

Does this mean that the M00 only contains 8 frames?

[Walter Schulz]

No.

[Ottoga]

Processed a number of std and mlv_lite mlv files through v1.7.5.

All files processed successfully. No lost frames and spot checks of various frames showed no abnormalities.

[chmee]

@reddeercity
will check that when i'm back home. net is awfully slow here in geneva.

@ottoga
thats good news.

@Kharak
will look into it. (because i revert after converting to "convert" but it doesnt..)

thanks for testing. regards chmee

[ibrahim]

How do I recover the M00? or fix this issue so that all my recordings include the M00.

[Walter Schulz]

M00 is not on the card anymore? Do you have reused the card (=writing to card) after M00 got lost?

[chmee]

@ibrahim
rename the last one to M00.. because all VIDF-Chunks (aka frames) have timestamps, its not necessary to hold the files (and frames) in the right order. but no one can recover files, you dont know, if they existed

[ibrahim]

M00 is not on the card anymore? Do you have reused the card (=writing to card) after M00 got lost?

I've noticed that M00 have never been recorded on the CF-card all the files (which are long) start with M01.
Does the absence of M00 mean that I'm lacking some frames from my filmed footage? In case, I've missunderstod the issue of lacking M00...

@ibrahim
rename the last one to M00.. because all VIDF-Chunks (aka frames) have timestamps, its not necessary to hold the files (and frames) in the right order. but no one can recover files, you dont know, if they existed

Ok, I'll try that to see if the application exports all the frames.

[Walter Schulz]

I've noticed that M00 have never been recorded on the CF-card all the files (which are long) start with M01.

Sorry, but that's not what you described earlier. In reply #1293 you located M00 files in the cam. Filemanager does not give correct file sizes for files > 4GB. So I suggest you take a good look again using your cardreader.

[Ake A.]

the Raw2CDNG stops working as soon as I drop my .RAW file on it.

here is the debug file.
I really need help on this.

PS. I use 5D mark III shot at 1920x1080
it's my first time shooting ML Raw with my 5D.

Code: [Select]

------------- 1.7.5 started at 59.03.14 09:58:11 --
[init][settings] -- ffmpeg Exists: false
[drop] started
[drop] Files dropped:
[drop] ------
[drop] -- file F:\5D3 Lantern RAW test\M13-2359.RAW.
[drop] ------
[drop] -- file F:\5D3 Lantern RAW test\M13-2359.RAW will be analyzed now.
[drop] is RAW
[setFileinfoData] set/changed Filedata
[drop] FileinfoData set
[getRAWAttrib] started
[getRAWAttrib] counting Splitfiles
[getRAWAttrib] found 1 Files
[getRAWAttrib] counted 4095 MB
[getRAWAttrib] reading RAW Footer and Attribs
[getRAWAttrib,RAW] deciding model on first colorMatrix-Value
 ***** [getMLVAttributes] metaData Object:
xResolution=61282
yResolution=11464
frames=-1862980394
bitsperSample=14
bitsperSampleChanged=0
isLog=False
colorMatrixA=System.Byte[]
colorMatrixB=
forwardMatrixA=
forwardMatrixB=
lostFrames=47369192
fpsNom=1110098057
fpsDen=1000
duration=255:32:01:164
dropFrame=False
fpsString=1110098.00
stripByteCount=1217323566
stripByteCountReal=155697660
modell=Canon EOS 7D
camId=MAGIC199e3d3
apiVersion=0
splitCount=1
photoRAW=False
photoRAWe=False
RGGBValues=System.Int32[]
RGBfraction=System.Int32[]
wb_R=0.540084388185654
wb_G=1
wb_B=0.547008547008547
whiteBalance=4500
whiteBalanceMode=0
whiteBalanceGM=0
whiteBalanceBA=0
blackLevelOld=1745391186
blackLevelNew=1745391186
whiteLevelOld=15000
whiteLevelNew=15000
maximize=True
maximizer=-3.75477793988877E-05
previewPic=
previewFrame=0
errorString=
isMLV=False
isFRSP=False
DNGHeader=
version=1.7.5
versionString=System.Byte[]
propertiesString=
verticalBandingCoeffs=
verticalBandingNeeded=False
deadSensel=System.Collections.Generic.List`1[raw2cdng_v2.point]
 *****
 ***** [getMLVAttributes] fileData Object:
fileName=F:\5D3 Lantern RAW test\M13-2359.RAW
fileNameOnly=M13-2359
fileNameShort=M132359P
fileNameNum=132359
tempPath=C:\Users\asutt\AppData\Local\Temp\
sourcePath=F:\5D3 Lantern RAW test
parentSourcePath=5D3 Lantern RAW test
basePath=
destinationPath=
extraPathInfo=
_changedPath=
outputFilename=
creationTime=14/3/2559 0:02:02
modificationTime=14/3/2559 0:00:14
fileSize=4095
VIDFBlock=
RAWBlock=
 *****
 ***** [getMLVAttributes] lensData Object:
lens=
focalLength=0
aperture=0
isoValue=0
shutter=
 *****
[drop] RAW Attributes read and set.
[createRAWBlocklist] started
[drop] RAW Blocklist created and sorted. Blocks: 0
[drop] adding M13-2359 to batchList
[showPicture] started


[reddeercity]

You used a 5d3 ? but according to the log file it's a 7d

modell=Canon EOS 7D

Try a older version of raw2cdng , the stable version I use from time to time when I have troubles is 1.6.5

[Ake A.]

Oh I just saw it said 7D. That's very weird! [I used the 5D3]
Thank you for pointing that out!

Will try the 1.6.5
Thanks a lot @Reddeercity

You used a 5d3 ? but according to the log file it's a 7dTry a older version of raw2cdng , the stable version I use from time to time when I have troubles is 1.6.5

[chmee]

@Ake A.
Please use MLV or MLVLite. i know, raw is not working well in this version. 

[Kharak]

@Chmee

Is the Vertical Banding fix disabled (in the latest version or 1.6.5)?

I have some footage with more visible Vertical stripes than normal due to the Shadows having to be pushed more and I can not see any difference with Vertical Banding ON and OFF

Or is the Vertical Banding tab something else than the Vertical Stripe Fix from A1ex?

[chmee]

@Kharak
Please give me some more footage. Generally its the Fix coded by a1ex, but sometimes my code inverts the analyse-decision.

[Kharak]

@Chmee,

Sorry for the late reply, I have been busy this weekend with Easter and everything.

It didn't get worse with the Vertical Banding, I did ask you about this in this thread many many pages back. Yes in that case it inverted the Vertical banding making it extremely visible for some reason.

Alas, I think it was the mistake of AE that it interpreted two CinemaDNG sequences as the same, because I had already imported the footage without Vertical Stripe Fix and then converted the same sequence with Vertical Stripe Fix and there was no difference, I assume After Effects saw the Sequences as identical and just re-imported the previous CDNG sequence, because I only changed the name of the folders for my sake to see the difference. I have since separated the two sequences and performed Vertical Stripe Fix on all the footage and imported in to a new composition and everything is A- OKEY!

But if you still require footage I can send you some?

[chmee]

easy

So, lets put some small footage into the samples thread.

http://www.magiclantern.fm/forum/index.php?topic=11899.0

[Kharak]

Sure thing!

But could you post a link or explain to me how it is I "Cut" or reduce a MLV file to a more reasonable size? 

[Ottoga]

@Kharak
Its an option in mlv_dump.

[Kharak]

okey, where do I get MLV_Dump?

Searching on forum the does not lead me to a download.

Also some commands ?

Sorry for being so demanding.