Author Topic: The CinemaDNG Discussion (raw2cdng) (Read 1080026 times)

feureau · « **Reply #1025 on:** December 06, 2014, 06:56:49 AM »

Hi, chmee. I now kept getting entirely black DNGs. Tested this from 1.5.0b6 up to 1.6.3b. I tried generating proxy, and resulted in this: http://i.imgur.com/sMEAyHv.png Otherwise, the dng is just a black frame.

Also, raw2cdng 1.6.3b seems to crash when I feed it 1 kb MLVs:

https://mega.co.nz/#!P9EklSra!bKh4OjnL8YuEdv4QA78JgPATRRV6d8gDViOqEHcbmYs

https://mega.co.nz/#!KhFFkSYL!0XwzGSNn-AGAaf8iPYoMacie-q_Wain7GZHaihm4P44

They were created when I hit record then quickly stop the recording. (usually pushing the wrong button)

How's that update coming along btw?

chmee · « **Reply #1026 on:** December 06, 2014, 05:20:21 PM »

those files are for sure invalid. so i could do a simple request, if a file is at least 1mb. sorry for the delay with next version, i have to work a lot. try it next days.

feureau · « **Reply #1027 on:** December 08, 2014, 08:48:54 AM »

I couldn't get one close to 1mb, but anything above that doesn't crash raw2cdng.

Still getting black DNGs though. Is this something to do with .net framework? Does raw2cdng write settings somewhere? It seems to remember certain options when I switch between version. Maybe I need to reset some settings..?

Thanks for this btw. Looking to try the next version in a few days.

ChadMuffin · « **Reply #1028 on:** December 10, 2014, 08:26:52 PM »

Just ran a test with raw2cdng 1.6.3. I was unable to import the cDNGs into AE. I recieved this error.

With 1.6.3 I used 12bit max with vertical banding on and chroma on and off. Normally, I can see the .dng's in Windows Explorer on Windows 8.1 but, they did not load and I was unable to see them in Windows Photo Viewer.

raw2cdng 1.6.1 worked just fine.

Here is the debug from raw2cdng 1.6.3

Code: [Select]

 ------------- 1.6.3.beta started at 14.12.10 11:45:38 -- 
[init][settings] -- ffmpeg Exists: false
[drop] started
[drop] Files dropped:
[drop] ------
[drop] -- file C:\Users\Chad\Desktop\M10-1231.MLV.
[drop] ------
[drop] -- file C:\Users\Chad\Desktop\M10-1231.MLV will be analyzed now.
[drop] is MLV 
[setFileinfoData] set/changed Filedata
[drop] FileinfoData set
[createMLVBlocklist] started
[createMLVBlocklist] splitFiles counted (1)
[createMLVBlocklist] indexing Blocks in C:\Users\Chad\Desktop\M10-1231.MLV
[getMLVAttrib] started
[getMLVAttrib] reading RAWI-Block
[getMLVAttrib] reading MLVI-Block
[getMLVAttrib] reading IDNT-Block
[getMLVAttrib] reading WBAL-Block
[getMLVAttrib] reading EXPO-Block
[getMLVAttrib] reading LENS-Block
[getMLVAttrib] reading WAVI-Block
 ***** [getMLVAttributes] audioData Object:
hasAudio=True
audioFile=
audioSamplingRate=48000
audioBitsPerSample=16
audioFormat=1
audioChannels=2
audioBytesPerSecond=192000
audioBlockAlign=4
 ***** 
 ***** [getMLVAttributes] metaData Object:
xResolution=1920
yResolution=818
frames=116
bitsperSample=14
bitsperSampleChanged=0
isLog=False
colorMatrix=System.Byte[]
lostFrames=0
fpsNom=23976
fpsDen=1000
duration=00:04:00
dropFrame=False
fpsString=23.98
stripByteCount=2748480
stripByteCountReal=2748480
modell=Canon EOS 5D Mark III
camId=MAGICf24bd98
apiVersion=0
splitCount=1
photoRAW=False
photoRAWe=False
RGGBValues=System.Int32[]
RGBfraction=System.Int32[]
wb_R=0.69235970250169
wb_G=1
wb_B=0.410092110532639
whiteBalance=3200
whiteBalanceMode=3
whiteBalanceGM=4900
whiteBalanceBA=4900
blackLevelOld=2047
blackLevelNew=2047
whiteLevelOld=15000
whiteLevelNew=15000
maximize=True
maximizer=5.05952289045009
previewPic=
previewFrame=0
errorString=
isMLV=True
DNGHeader=
version=1.6.3.beta
versionString=System.Byte[]
propertiesString=
verticalBandingCoeffs=
verticalBandingNeeded=False
deadSensel=System.Collections.Generic.List`1[raw2cdng_v2.point]
 ***** 
 ***** [getMLVAttributes] fileData Object:
fileName=C:\Users\Chad\Desktop\M10-1231.MLV
fileNameOnly=M10-1231
fileNameShort=M101231W
fileNameNum=101231
tempPath=C:\Users\Chad\AppData\Local\Temp\
sourcePath=C:\Users\Chad\Desktop
parentSourcePath=Desktop
basePath=
destinationPath=
extraPathInfo=
_changedPath=
outputFilename=
creationTime=12/10/2014 11:39:48 AM
modificationTime=12/10/2014 12:31:31 PM
VIDFBlock=
RAWBlock=
 ***** 
 ***** [getMLVAttributes] lensData Object:
lens=24-70mmP4I:
focalLength=70
aperture=0
isoValue=3200
shutter=1/64s
 ***** 
[drop] MLV Attributes and Blocklist created and sorted. Blocks: 393
[drop] hasAudio. AUDF-List created. Blocks: 25
[drop] VIDF-List created. Blocks: 114
[readVIDFBlockData] started
[readVIDFBlockData] done: [0][1][2][3][4][5][6][7][8][9][10][11][12][13][14][15][16][17][18][19][20][21][22][23][24]
[readVIDFBlockData] done: [25][26][27][28][29][30][31][32][33][34][35][36][37][38][39][40][41][42][43][44][45][46][47][48][49]
[readVIDFBlockData] done: [50][51][52][53][54][55][56][57][58][59][60][61][62][63][64][65][66][67][68][69][70][71][72][73][74]
[readVIDFBlockData] done: [75][76][77][78][79][80][81][82][83][84][85][86][87][88][89][90][91][92][93][94][95][96][97][98][99]
[drop] VIDF-Blockdata read and created.
[drop] adding M10-1231 to batchList
[showPicture] started
[drop] calculating verticalBandingCoeefs and searching hot/dead-pixels.. 
[drop] NO dead sensels found
[drop] verticalBanding enabled. decision: do it
[drop] verticalBanding CoEffs: 1 1.0008630905897 1.00138402455486 1.01540475086815 1.00000057378494 1.00183129887873 1.00058909931684 0.987164737274471 1 
[drop] ** Item M10-1231 imported | MLV
[drop] * res 1920x818px | 23.98fps | 114 frames | BL2047 | WL15000
[drop] * modell Canon EOS 5D Mark III | vidfblocks 114 | has audio
[convert_Click] all in all there are 114 frames to convert
[doWork] started
[doWork] 12 Cores used
[doWork] -> converting item M10-1231
[doWork] settings format 4 with BL0 WL4095 with+ maximizingvalue 5
[doWork] prefix - filename generator 1.6.3 Riggs
[doWork] destinationPath -> 1.6.3 Riggs
[doWork] outputFilename  -> 1.6.3 Riggs
[doWork] Directory C:\Users\Chad\Desktop\Video Test\1.6.3 Riggs created
[doWork] took DNGtemplate and changed values
[doWork] * init frameCount for multithreaded Convert
[doWork][for] read/convert MLV VIDF: [0]
[doWork][for] read/convert MLV VIDF: [1][2][3][4][5][6][7][8][9][10][11][12][13][14][15][16][17][18][19][20][21][22][23][24][25]
[doWork][for] read/convert MLV VIDF: [26][27][28][29][30][31][32][33][34][35][36][37][38][39][40][41][42][43][44][45][46][47][48][49][50]
[doWork][for] read/convert MLV VIDF: [51][52][53][54][55][56][57][58][59][60][61][62][63][64][65][66][67][68][69][70][71][72][73][74][75]
[doWork][for] read/convert MLV VIDF: [76][77][78][79][80][81][82][83][84][85][86][87][88][89][90][91][92][93][94][95][96][97][98][99][100]
[doWork] convert Done
[doWork] hasAudio file -> 1.6.3 Riggs.wav
[saveAudio] started
 ***** [saveAudio] audioData Object:
hasAudio=True
audioFile=
audioSamplingRate=48000
audioBitsPerSample=16
audioFormat=1
audioChannels=2
audioBytesPerSecond=192000
audioBlockAlign=4
 ***** 
[saveAudio] bextName: Canon EOS 5D Mark III
[saveAudio] UDI: DECanMAGICF24BD98123131484946241
[saveAudio] datetime: 2014:12:1012:31:31
[saveAudio] timeRefMultiplier: 1.001001001001
[saveAudio] time2frame: 42030.03003003
[saveAudio] timeRef (samplingRate*time2frame): 2017441441
[saveAudio] fpsString: 23976/1000
[saveAudio] DF: NDF
[saveAudio] subChunkSize :951652
[saveAudio] success

I can send you the MLV if you would like.

chmee · « **Reply #1029 on:** December 11, 2014, 12:25:02 AM »

i'm pretty sure, its about some wrong black/whitelevel. please be patient and use 1.6.1 by now.

ChadMuffin · « **Reply #1030 on:** December 11, 2014, 02:48:48 AM »

No problem! Thanks for all the effort you have put into the product.

ChadMuffin · « **Reply #1031 on:** December 11, 2014, 08:19:32 PM »

I was working in 1.6.1 and recieved black frames as well. This was after I used 1.6.3. I deleted all of the files for raw2cdng that I downloaded and redownloaded 1.6.1 and had the same issue. I also noticed all of my settings, such as the filename, were the same even after deleting the file. Does this product save files else where for settings? Should they be deleted to correct this issue? If you need me to run some test, or send you some files, I'll be glad to help.

chmee · « **Reply #1032 on:** December 12, 2014, 01:33:06 AM »

there is the settings-file inside User\[you]\appdata\roaming named raw2cdng.settings.json

regards chmee

feureau · « **Reply #1033 on:** December 12, 2014, 06:22:26 PM »

So that's where that is...

Might be a good idea to keep these things inside the same folder as the main program files. I mean, it's kinda hard to find...

ChadMuffin · « **Reply #1034 on:** December 14, 2014, 07:19:09 PM »

That did the trick! Thanks!

Kharak · « **Reply #1035 on:** December 15, 2014, 07:58:55 PM »

Hey Chmee.

I was converting files and this is the first time I try Vertical Banding fix. Not something usually pay attention to in my footage, but everyone is complaining about it so I thought I better "fix" the issue with my CDNG's.

Problem is that some of the shots now have extreme vertical banding and some dont.. Even though all were exported in one run.

Here is an example: https://www.dropbox.com/s/3ilasxv87den79i/Austria%201_M12-0712_140819_12071200000.dng?dl=0 You can see it especially in shadows. This cdng has VisionLog on it.

Could there be some setting that I am doing wrong or something just went wrong with the conversion?

Ver: 1.6.3 beta

16 bit (not maximized)

Vertical Banding on (Green)

no chroma smoothing

No proxy

No highlight fix

chmee · « **Reply #1036 on:** December 15, 2014, 08:14:42 PM »

sometimes the estimation of vertical differences fails, so yes, depending on footage it can deliver worse data. i wouldnt enable vertical banding by default.

[please be still patient solving bugs, i've got birthday today, and the next days i will party as well

]

regards chmee

Kharak · « **Reply #1037 on:** December 15, 2014, 09:12:55 PM »

Happy birthday!! Hope you have a great one

and thanks for the quick reply!

Yeah I will stick to my usual conversion without vertical fix and if I see vertical banding, I will try vertical fix.

DeafEyeJedi · « **Reply #1038 on:** December 15, 2014, 10:27:45 PM »

right on @chmee and Happy Birthday, mister!

Be safe.

andy kh · « **Reply #1039 on:** December 17, 2014, 01:40:04 PM »

happy birthday chmee

feureau · « **Reply #1040 on:** December 18, 2014, 08:40:16 AM »

Happy Birthday, chmee!

andy kh · « **Reply #1041 on:** December 18, 2014, 11:08:35 AM »

raw2cdng newer versions like 1.6.1 and 1.6.3 has problem while importing xml from premiere pro cc 2014 to resolve lite. older versions are ok. i also tried shootin@50fps and use version 1.6.3 but there was no problem but those which were shot @23.97 fps has problem. resolve keep on crashing while importing xml. i m unable to figure out why this is happenin. older version like 1.4.9.3 works fine

Ottoga · « **Reply #1042 on:** December 18, 2014, 01:37:00 PM »

Happy Birthday Chmee. Hope your party rocks/ed

chmee · « **Reply #1043 on:** December 19, 2014, 10:33:45 AM »

thanks. (today is the main party, so it didnt ended yet

so, i ll address bugs asap. one by one. important is the first one with the wrong black/whitelevel, then i will look for the problems with resolve/premiere roundtripping..

@andy_kh
i think its a problem with dropped-framerates. have to re-check/test my code for none-integer fps. did you tested with/without sound?

cheers chmee

andy kh · « **Reply #1044 on:** December 19, 2014, 03:38:28 PM »

yeah i hv done test with sound and without sound @chmee
BTW enjoy your party

anandkamal · « **Reply #1045 on:** December 20, 2014, 11:22:22 PM »

hi chmee, happy birthday

... I am using 1.6.1 meanwhile.. but,

1) I get black frames and the tool closes showing "raw2cdng stopped working" even after deleting the .json file in c/user/appdata folder
2) I drop six to seven files (around 1 to 3GB), the tool closes showing the above error. This also occurs when I drop seven files and uncheck five of them to extract only two.
3) The tool shows "converting" even after the files have been extracted to cdng... If I load despite that, the tool closes showing error.

The above all occurs in 1.6.1.... thanks..

Kharak · « **Reply #1046 on:** December 21, 2014, 01:38:20 AM »

Did you check if you are actually missing frames?

Cant help you with the other questions, sorry.

Why not try 1.6.3 ?

anandkamal · « **Reply #1047 on:** December 21, 2014, 03:29:09 PM »

hi kharak, there are no missing frames.
I used 1.6.3 beta after facing above problems in 1.6.1, but 1.6.3 beta also crashes upon loading even two files at a time, each with frames greater than 1000.
since then, I am uploading and extracting single file at a time (total includes 100s and 100s of files for serious video purpose), very laborious

... but seriously, glad to have this tool

Kharak · « **Reply #1048 on:** December 21, 2014, 08:20:16 PM »

CClean and Re-install, probably some registry still interferring from older version. Just a guess, I know this worked for me on Mlrawviewer.

Good luck!

chmee · « **Reply #1049 on:** December 21, 2014, 09:43:53 PM »

@anandkamal if you show a debug, i/we can assume, on what point it crashes - btw. the crash on closing is known but imho not essential for anything (!)and: my tool doesnt write any data into the registry. someone had installed mlvrawviewer and my tool crashes, ater deleting mlvrawviewer mine worked, so sometimes its only magic

News:

Author Topic: The CinemaDNG Discussion (raw2cdng) (Read 1080026 times)