Author Topic: The CinemaDNG Discussion (raw2cdng)  (Read 872590 times)

ibrahim

  • Member
  • ***
  • Posts: 195
  • Physician & videographer
Re: The CinemaDNG Discussion (raw2cdng)
« Reply #1300 on: February 24, 2016, 03:37:34 PM »
Hi,

I'm having issues with the lack of M00 for one of my large MLV footage. I have M01, M02 and M03.
I've tried to merge them with its associated .MLV in the Cmd on windows.

I notice that on mlRAwviewer (prior to merging and prior to export) there should be 3596 frames.
However after merging and then exporting the merged mlv on raw2cdng I get 3588 frames. Any idea what's wrong and why I'm not getting 3596 frames instead?
Canon 5D Mark IIIs & Canon 600d | Ronin-M | Rokinon 35mm T1.5 Cine AS UMC | Samyang 85mm T1.5 UMC AS Cine VDSLR II   | Canon EF 24-105mm f/4L IS USM | Canon EF 50mm f/1.8 II | etc
Dual sound system: Tascam DR-60d MKII | Audio Technica AT899 | Sennheiser MKE 600

Walter Schulz

  • Contributor
  • Hero Member
  • *****
  • Posts: 7879
Re: The CinemaDNG Discussion (raw2cdng)
« Reply #1301 on: February 24, 2016, 04:31:16 PM »
Merging files is contraproductive.
Merging files won't create missing file *.M00
-> I don't really care why there are 8 frames missing.

EDIT: If you wanted to ask if there is a way to convert frames stored in M01, M02 and M03 without M00: Yes, that's possible.

chmee

  • Contributor
  • Hero Member
  • *****
  • Posts: 1031
  • raw2cdng
Re: The CinemaDNG Discussion (raw2cdng)
« Reply #1302 on: February 24, 2016, 07:01:59 PM »
v1.7.5 is out
* please! treat it as a beta! i have no splitted files here (on my laptop).
* main patch - framebug solved (i think)
* toDo: Audiofix for Resolve (at home, then, in ~10days) | MLVlite-Support(need Samples) | tolerance on missing Files (see above M00-Example)

http://www.phreekz.de/wordpress/2014/04/magiclantern-raw2cdng-1-5-0/

regards chmee

Kharak

  • Hero Member
  • *****
  • Posts: 1002
Re: The CinemaDNG Discussion (raw2cdng)
« Reply #1303 on: February 24, 2016, 11:32:45 PM »
oooh snap!

I am testing this right now!

EDIT: So far so good! Converted 3 .MLV files, 2 of them 10 Gig, about 3000 Frames each and another 8.5 Gig and not one frame missing! :)

Good speed also! Very nice! Thank you so much for fixing this Chmee!

.mlv+audio
1920x1038
24 fps
non-Crop
5d3 113



May I request one tiny fix? The Convert button says "Converting" always, its not a big deal, but would be nice if it just said "Convert". It says "Converting" before and after clicking it, so might aswell just be "Convert" :)
once you go raw you never go back

reddeercity

  • Contributor
  • Hero Member
  • *****
  • Posts: 2271
Re: The CinemaDNG Discussion (raw2cdng)
« Reply #1304 on: February 24, 2016, 11:47:54 PM »
Thanks chmee for the new build ,
 5D2 MLV+audio (1872x936) 3 spanning file total of 3:41 (4590 frames)
Check and all frames are there no missing frames at this point .
Tested New MLV Lite Support is there for spanning files (check out just only2 spanning files)  everything seems to be OK
not missing any frames , but there was a single first frame was total black , it wasn't there in other app thou , not a big deal thou.
In 3xCrop mode the cdng's all have pink cast it's like the black level is off .
Be on that,  No crashes very fast at extraction even on my very old Dell Inspiron 1764 i5 Laptop.  ;)

Here is raw2cdng_mlv_lite_1856x1044 48-Cdng Frames there are normal looking and here is
raw2cdng_mlv-lite_1920x1038_3xCrop - 48 frames they have pink cast

I made a mini MLV for your mlvdiag.1.0.1 tool M23-1525.MLV.55mb.mlv this the 1856x1044 one &
here is the M23-1531.MLV.55mb.mlv for the 3xCrop 1920x1038 , it's the one that produces  pink cast over the image .


ibrahim

  • Member
  • ***
  • Posts: 195
  • Physician & videographer
Re: The CinemaDNG Discussion (raw2cdng)
« Reply #1305 on: February 25, 2016, 07:28:56 AM »
...
EDIT: If you wanted to ask if there is a way to convert frames stored in M01, M02 and M03 without M00: Yes, that's possible.

Does this mean that the M00 only contains 8 frames?
Canon 5D Mark IIIs & Canon 600d | Ronin-M | Rokinon 35mm T1.5 Cine AS UMC | Samyang 85mm T1.5 UMC AS Cine VDSLR II   | Canon EF 24-105mm f/4L IS USM | Canon EF 50mm f/1.8 II | etc
Dual sound system: Tascam DR-60d MKII | Audio Technica AT899 | Sennheiser MKE 600

Walter Schulz

  • Contributor
  • Hero Member
  • *****
  • Posts: 7879
Re: The CinemaDNG Discussion (raw2cdng)
« Reply #1306 on: February 25, 2016, 10:52:38 AM »
No.

Ottoga

  • Member
  • ***
  • Posts: 202
  • The Ox is Slow but the Earth is Patient
Re: The CinemaDNG Discussion (raw2cdng)
« Reply #1307 on: February 25, 2016, 05:09:39 PM »
Processed a number of std and mlv_lite mlv files through v1.7.5.

All files processed successfully. No lost frames and spot checks of various frames showed no abnormalities.
EOS 7D.203, EFS 55-250mm, EF 75-300 III, Tamron 16-300 DiII VC PZD Macro, SpeedLite 580EX II.

chmee

  • Contributor
  • Hero Member
  • *****
  • Posts: 1031
  • raw2cdng
Re: The CinemaDNG Discussion (raw2cdng)
« Reply #1308 on: February 25, 2016, 08:38:49 PM »
@reddeercity
will check that when i'm back home. net is awfully slow here in geneva.

@ottoga
thats good news.

@Kharak
will look into it. (because i revert after converting to "convert" but it doesnt..)

thanks for testing. regards chmee

ibrahim

  • Member
  • ***
  • Posts: 195
  • Physician & videographer
Re: The CinemaDNG Discussion (raw2cdng)
« Reply #1309 on: February 26, 2016, 04:41:14 PM »
How do I recover the M00? or fix this issue so that all my recordings include the M00.
Canon 5D Mark IIIs & Canon 600d | Ronin-M | Rokinon 35mm T1.5 Cine AS UMC | Samyang 85mm T1.5 UMC AS Cine VDSLR II   | Canon EF 24-105mm f/4L IS USM | Canon EF 50mm f/1.8 II | etc
Dual sound system: Tascam DR-60d MKII | Audio Technica AT899 | Sennheiser MKE 600

Walter Schulz

  • Contributor
  • Hero Member
  • *****
  • Posts: 7879
Re: The CinemaDNG Discussion (raw2cdng)
« Reply #1310 on: February 26, 2016, 04:52:47 PM »
M00 is not on the card anymore? Do you have reused the card (=writing to card) after M00 got lost?

chmee

  • Contributor
  • Hero Member
  • *****
  • Posts: 1031
  • raw2cdng
Re: The CinemaDNG Discussion (raw2cdng)
« Reply #1311 on: February 26, 2016, 08:10:43 PM »
@ibrahim
rename the last one to M00.. because all VIDF-Chunks (aka frames) have timestamps, its not necessary to hold the files (and frames) in the right order. but no one can recover files, you dont know, if they existed ;)

ibrahim

  • Member
  • ***
  • Posts: 195
  • Physician & videographer
Re: The CinemaDNG Discussion (raw2cdng)
« Reply #1312 on: February 28, 2016, 10:55:55 PM »
M00 is not on the card anymore? Do you have reused the card (=writing to card) after M00 got lost?

I've noticed that M00 have never been recorded on the CF-card all the files (which are long) start with M01.
Does the absence of M00 mean that I'm lacking some frames from my filmed footage? In case, I've missunderstod the issue of lacking M00...

@ibrahim
rename the last one to M00.. because all VIDF-Chunks (aka frames) have timestamps, its not necessary to hold the files (and frames) in the right order. but no one can recover files, you dont know, if they existed ;)

Ok, I'll try that to see if the application exports all the frames.
Canon 5D Mark IIIs & Canon 600d | Ronin-M | Rokinon 35mm T1.5 Cine AS UMC | Samyang 85mm T1.5 UMC AS Cine VDSLR II   | Canon EF 24-105mm f/4L IS USM | Canon EF 50mm f/1.8 II | etc
Dual sound system: Tascam DR-60d MKII | Audio Technica AT899 | Sennheiser MKE 600

Walter Schulz

  • Contributor
  • Hero Member
  • *****
  • Posts: 7879
Re: The CinemaDNG Discussion (raw2cdng)
« Reply #1313 on: February 28, 2016, 11:06:22 PM »
I've noticed that M00 have never been recorded on the CF-card all the files (which are long) start with M01.

Sorry, but that's not what you described earlier. In reply #1293 you located M00 files in the cam. Filemanager does not give correct file sizes for files > 4GB. So I suggest you take a good look again using your cardreader.

Ake A.

  • New to the forum
  • *
  • Posts: 2
Re: The CinemaDNG Discussion (raw2cdng)
« Reply #1314 on: March 14, 2016, 04:05:04 AM »
the Raw2CDNG stops working as soon as I drop my .RAW file on it.

here is the debug file.
I really need help on this.

PS. I use 5D mark III shot at 1920x1080
it's my first time shooting ML Raw with my 5D.

Code: [Select]
------------- 1.7.5 started at 59.03.14 09:58:11 --
[init][settings] -- ffmpeg Exists: false
[drop] started
[drop] Files dropped:
[drop] ------
[drop] -- file F:\5D3 Lantern RAW test\M13-2359.RAW.
[drop] ------
[drop] -- file F:\5D3 Lantern RAW test\M13-2359.RAW will be analyzed now.
[drop] is RAW
[setFileinfoData] set/changed Filedata
[drop] FileinfoData set
[getRAWAttrib] started
[getRAWAttrib] counting Splitfiles
[getRAWAttrib] found 1 Files
[getRAWAttrib] counted 4095 MB
[getRAWAttrib] reading RAW Footer and Attribs
[getRAWAttrib,RAW] deciding model on first colorMatrix-Value
 ***** [getMLVAttributes] metaData Object:
xResolution=61282
yResolution=11464
frames=-1862980394
bitsperSample=14
bitsperSampleChanged=0
isLog=False
colorMatrixA=System.Byte[]
colorMatrixB=
forwardMatrixA=
forwardMatrixB=
lostFrames=47369192
fpsNom=1110098057
fpsDen=1000
duration=255:32:01:164
dropFrame=False
fpsString=1110098.00
stripByteCount=1217323566
stripByteCountReal=155697660
modell=Canon EOS 7D
camId=MAGIC199e3d3
apiVersion=0
splitCount=1
photoRAW=False
photoRAWe=False
RGGBValues=System.Int32[]
RGBfraction=System.Int32[]
wb_R=0.540084388185654
wb_G=1
wb_B=0.547008547008547
whiteBalance=4500
whiteBalanceMode=0
whiteBalanceGM=0
whiteBalanceBA=0
blackLevelOld=1745391186
blackLevelNew=1745391186
whiteLevelOld=15000
whiteLevelNew=15000
maximize=True
maximizer=-3.75477793988877E-05
previewPic=
previewFrame=0
errorString=
isMLV=False
isFRSP=False
DNGHeader=
version=1.7.5
versionString=System.Byte[]
propertiesString=
verticalBandingCoeffs=
verticalBandingNeeded=False
deadSensel=System.Collections.Generic.List`1[raw2cdng_v2.point]
 *****
 ***** [getMLVAttributes] fileData Object:
fileName=F:\5D3 Lantern RAW test\M13-2359.RAW
fileNameOnly=M13-2359
fileNameShort=M132359P
fileNameNum=132359
tempPath=C:\Users\asutt\AppData\Local\Temp\
sourcePath=F:\5D3 Lantern RAW test
parentSourcePath=5D3 Lantern RAW test
basePath=
destinationPath=
extraPathInfo=
_changedPath=
outputFilename=
creationTime=14/3/2559 0:02:02
modificationTime=14/3/2559 0:00:14
fileSize=4095
VIDFBlock=
RAWBlock=
 *****
 ***** [getMLVAttributes] lensData Object:
lens=
focalLength=0
aperture=0
isoValue=0
shutter=
 *****
[drop] RAW Attributes read and set.
[createRAWBlocklist] started
[drop] RAW Blocklist created and sorted. Blocks: 0
[drop] adding M13-2359 to batchList
[showPicture] started

reddeercity

  • Contributor
  • Hero Member
  • *****
  • Posts: 2271
Re: The CinemaDNG Discussion (raw2cdng)
« Reply #1315 on: March 14, 2016, 08:10:02 AM »
You used a 5d3 ? but according to the log file it's a 7d
Quote
modell=Canon EOS 7D
Try a older version of raw2cdng , the stable version I use from time to time when I have troubles is 1.6.5

Ake A.

  • New to the forum
  • *
  • Posts: 2
Re: The CinemaDNG Discussion (raw2cdng)
« Reply #1316 on: March 14, 2016, 01:48:04 PM »
Oh I just saw it said 7D. That's very weird! [I used the 5D3]
Thank you for pointing that out!

Will try the 1.6.5
Thanks a lot @Reddeercity

You used a 5d3 ? but according to the log file it's a 7dTry a older version of raw2cdng , the stable version I use from time to time when I have troubles is 1.6.5


chmee

  • Contributor
  • Hero Member
  • *****
  • Posts: 1031
  • raw2cdng
Re: The CinemaDNG Discussion (raw2cdng)
« Reply #1317 on: March 15, 2016, 10:12:38 AM »
@Ake A.
Please use MLV or MLVLite. i know, raw is not working well in this version. 

Kharak

  • Hero Member
  • *****
  • Posts: 1002
Re: The CinemaDNG Discussion (raw2cdng)
« Reply #1318 on: March 25, 2016, 02:06:36 PM »
@Chmee

Is the Vertical Banding fix disabled (in the latest version or 1.6.5)?

I have some footage with more visible Vertical stripes than normal due to the Shadows having to be pushed more and I can not see any difference with Vertical Banding ON and OFF

Or is the Vertical Banding tab something else than the Vertical Stripe Fix from A1ex?
once you go raw you never go back

chmee

  • Contributor
  • Hero Member
  • *****
  • Posts: 1031
  • raw2cdng
Re: The CinemaDNG Discussion (raw2cdng)
« Reply #1319 on: March 26, 2016, 08:46:04 PM »
@Kharak
Please give me some more footage. Generally its the Fix coded by a1ex, but sometimes my code inverts the analyse-decision.

Kharak

  • Hero Member
  • *****
  • Posts: 1002
Re: The CinemaDNG Discussion (raw2cdng)
« Reply #1320 on: March 29, 2016, 04:02:05 PM »
@Chmee,

Sorry for the late reply, I have been busy this weekend with Easter and everything.

It didn't get worse with the Vertical Banding, I did ask you about this in this thread many many pages back. Yes in that case it inverted the Vertical banding making it extremely visible for some reason.

Alas, I think it was the mistake of AE that it interpreted two CinemaDNG sequences as the same, because I had already imported the footage without Vertical Stripe Fix and then converted the same sequence with Vertical Stripe Fix and there was no difference, I assume After Effects saw the Sequences as identical and just re-imported the previous CDNG sequence, because I only changed the name of the folders for my sake to see the difference. I have since separated the two sequences and performed Vertical Stripe Fix on all the footage and imported in to a new composition and everything is A- OKEY!

But if you still require footage I can send you some?
once you go raw you never go back

chmee

  • Contributor
  • Hero Member
  • *****
  • Posts: 1031
  • raw2cdng
Re: The CinemaDNG Discussion (raw2cdng)
« Reply #1321 on: March 29, 2016, 06:19:27 PM »
:) easy :)

So, lets put some small footage into the samples thread.

http://www.magiclantern.fm/forum/index.php?topic=11899.0

Kharak

  • Hero Member
  • *****
  • Posts: 1002
Re: The CinemaDNG Discussion (raw2cdng)
« Reply #1322 on: March 31, 2016, 12:43:01 PM »
Sure thing!

But could you post a link or explain to me how it is I "Cut" or reduce a MLV file to a more reasonable size? 
once you go raw you never go back

Ottoga

  • Member
  • ***
  • Posts: 202
  • The Ox is Slow but the Earth is Patient
Re: The CinemaDNG Discussion (raw2cdng)
« Reply #1323 on: March 31, 2016, 02:08:41 PM »
@Kharak
Its an option in mlv_dump.
EOS 7D.203, EFS 55-250mm, EF 75-300 III, Tamron 16-300 DiII VC PZD Macro, SpeedLite 580EX II.

Kharak

  • Hero Member
  • *****
  • Posts: 1002
Re: The CinemaDNG Discussion (raw2cdng)
« Reply #1324 on: March 31, 2016, 03:25:28 PM »
okey, where do I get MLV_Dump?

Searching on forum the does not lead me to a download.

Also some commands ?

Sorry for being so demanding.
once you go raw you never go back