The CinemaDNG Discussion (raw2cdng)

Started by chmee, May 23, 2013, 10:46:55 AM

Previous topic - Next topic

0 Members and 2 Guests are viewing this topic.

feureau

Hi, chmee. I now kept getting entirely black DNGs. Tested this from 1.5.0b6 up to 1.6.3b. I tried generating proxy, and resulted in this: http://i.imgur.com/sMEAyHv.png Otherwise, the dng is just a black frame.

Also, raw2cdng 1.6.3b seems to crash when I feed it 1 kb MLVs:

https://mega.co.nz/#!P9EklSra!bKh4OjnL8YuEdv4QA78JgPATRRV6d8gDViOqEHcbmYs

https://mega.co.nz/#!KhFFkSYL!0XwzGSNn-AGAaf8iPYoMacie-q_Wain7GZHaihm4P44

They were created when I hit record then quickly stop the recording. (usually pushing the wrong button)

How's that update coming along btw?

chmee

:) those files are for sure invalid. so i could do a simple request, if a file is at least 1mb. sorry for the delay with next version, i have to work a lot. try it next days.
[size=2]phreekz * blog * twitter[/size]

feureau

I couldn't get one close to 1mb, but anything above that doesn't crash raw2cdng.

Still getting black DNGs though. Is this something to do with .net framework? Does raw2cdng write settings somewhere? It seems to remember certain options when I switch between version. Maybe I need to reset some settings..?

Thanks for this btw. Looking to try the next version in a few days. :D

ChadMuffin

Just ran a test with raw2cdng 1.6.3. I was unable to import the cDNGs into AE. I recieved this error.



With 1.6.3 I used 12bit max with vertical banding on and chroma on and off. Normally, I can see the .dng's in Windows Explorer on Windows 8.1 but, they did not load and I was unable to see them in Windows Photo Viewer.

raw2cdng 1.6.1 worked just fine.

Here is the debug from raw2cdng 1.6.3

------------- 1.6.3.beta started at 14.12.10 11:45:38 --
[init][settings] -- ffmpeg Exists: false
[drop] started
[drop] Files dropped:
[drop] ------
[drop] -- file C:\Users\Chad\Desktop\M10-1231.MLV.
[drop] ------
[drop] -- file C:\Users\Chad\Desktop\M10-1231.MLV will be analyzed now.
[drop] is MLV
[setFileinfoData] set/changed Filedata
[drop] FileinfoData set
[createMLVBlocklist] started
[createMLVBlocklist] splitFiles counted (1)
[createMLVBlocklist] indexing Blocks in C:\Users\Chad\Desktop\M10-1231.MLV
[getMLVAttrib] started
[getMLVAttrib] reading RAWI-Block
[getMLVAttrib] reading MLVI-Block
[getMLVAttrib] reading IDNT-Block
[getMLVAttrib] reading WBAL-Block
[getMLVAttrib] reading EXPO-Block
[getMLVAttrib] reading LENS-Block
[getMLVAttrib] reading WAVI-Block
***** [getMLVAttributes] audioData Object:
hasAudio=True
audioFile=
audioSamplingRate=48000
audioBitsPerSample=16
audioFormat=1
audioChannels=2
audioBytesPerSecond=192000
audioBlockAlign=4
*****
***** [getMLVAttributes] metaData Object:
xResolution=1920
yResolution=818
frames=116
bitsperSample=14
bitsperSampleChanged=0
isLog=False
colorMatrix=System.Byte[]
lostFrames=0
fpsNom=23976
fpsDen=1000
duration=00:04:00
dropFrame=False
fpsString=23.98
stripByteCount=2748480
stripByteCountReal=2748480
modell=Canon EOS 5D Mark III
camId=MAGICf24bd98
apiVersion=0
splitCount=1
photoRAW=False
photoRAWe=False
RGGBValues=System.Int32[]
RGBfraction=System.Int32[]
wb_R=0.69235970250169
wb_G=1
wb_B=0.410092110532639
whiteBalance=3200
whiteBalanceMode=3
whiteBalanceGM=4900
whiteBalanceBA=4900
blackLevelOld=2047
blackLevelNew=2047
whiteLevelOld=15000
whiteLevelNew=15000
maximize=True
maximizer=5.05952289045009
previewPic=
previewFrame=0
errorString=
isMLV=True
DNGHeader=
version=1.6.3.beta
versionString=System.Byte[]
propertiesString=
verticalBandingCoeffs=
verticalBandingNeeded=False
deadSensel=System.Collections.Generic.List`1[raw2cdng_v2.point]
*****
***** [getMLVAttributes] fileData Object:
fileName=C:\Users\Chad\Desktop\M10-1231.MLV
fileNameOnly=M10-1231
fileNameShort=M101231W
fileNameNum=101231
tempPath=C:\Users\Chad\AppData\Local\Temp\
sourcePath=C:\Users\Chad\Desktop
parentSourcePath=Desktop
basePath=
destinationPath=
extraPathInfo=
_changedPath=
outputFilename=
creationTime=12/10/2014 11:39:48 AM
modificationTime=12/10/2014 12:31:31 PM
VIDFBlock=
RAWBlock=
*****
***** [getMLVAttributes] lensData Object:
lens=24-70mmP4I:
focalLength=70
aperture=0
isoValue=3200
shutter=1/64s
*****
[drop] MLV Attributes and Blocklist created and sorted. Blocks: 393
[drop] hasAudio. AUDF-List created. Blocks: 25
[drop] VIDF-List created. Blocks: 114
[readVIDFBlockData] started
[readVIDFBlockData] done: [0][1][2][3][4][5][6][7][8][9][10][11][12][13][14][15][16][17][18][19][20][21][22][23][24]
[readVIDFBlockData] done: [25][26][27][28][29][30][31][32][33][34][35][36][37][38][39][40][41][42][43][44][45][46][47][48][49]
[readVIDFBlockData] done: [50][51][52][53][54][55][56][57][58][59][60][61][62][63][64][65][66][67][68][69][70][71][72][73][74]
[readVIDFBlockData] done: [75][76][77][78][79][80][81][82][83][84][85][86][87][88][89][90][91][92][93][94][95][96][97][98][99]
[drop] VIDF-Blockdata read and created.
[drop] adding M10-1231 to batchList
[showPicture] started
[drop] calculating verticalBandingCoeefs and searching hot/dead-pixels..
[drop] NO dead sensels found
[drop] verticalBanding enabled. decision: do it
[drop] verticalBanding CoEffs: 1 1.0008630905897 1.00138402455486 1.01540475086815 1.00000057378494 1.00183129887873 1.00058909931684 0.987164737274471 1
[drop] ** Item M10-1231 imported | MLV
[drop] * res 1920x818px | 23.98fps | 114 frames | BL2047 | WL15000
[drop] * modell Canon EOS 5D Mark III | vidfblocks 114 | has audio
[convert_Click] all in all there are 114 frames to convert
[doWork] started
[doWork] 12 Cores used
[doWork] -> converting item M10-1231
[doWork] settings format 4 with BL0 WL4095 with+ maximizingvalue 5
[doWork] prefix - filename generator 1.6.3 Riggs
[doWork] destinationPath -> 1.6.3 Riggs
[doWork] outputFilename  -> 1.6.3 Riggs
[doWork] Directory C:\Users\Chad\Desktop\Video Test\1.6.3 Riggs created
[doWork] took DNGtemplate and changed values
[doWork] * init frameCount for multithreaded Convert
[doWork][for] read/convert MLV VIDF: [0]
[doWork][for] read/convert MLV VIDF: [1][2][3][4][5][6][7][8][9][10][11][12][13][14][15][16][17][18][19][20][21][22][23][24][25]
[doWork][for] read/convert MLV VIDF: [26][27][28][29][30][31][32][33][34][35][36][37][38][39][40][41][42][43][44][45][46][47][48][49][50]
[doWork][for] read/convert MLV VIDF: [51][52][53][54][55][56][57][58][59][60][61][62][63][64][65][66][67][68][69][70][71][72][73][74][75]
[doWork][for] read/convert MLV VIDF: [76][77][78][79][80][81][82][83][84][85][86][87][88][89][90][91][92][93][94][95][96][97][98][99][100]
[doWork] convert Done
[doWork] hasAudio file -> 1.6.3 Riggs.wav
[saveAudio] started
***** [saveAudio] audioData Object:
hasAudio=True
audioFile=
audioSamplingRate=48000
audioBitsPerSample=16
audioFormat=1
audioChannels=2
audioBytesPerSecond=192000
audioBlockAlign=4
*****
[saveAudio] bextName: Canon EOS 5D Mark III
[saveAudio] UDI: DECanMAGICF24BD98123131484946241
[saveAudio] datetime: 2014:12:1012:31:31
[saveAudio] timeRefMultiplier: 1.001001001001
[saveAudio] time2frame: 42030.03003003
[saveAudio] timeRef (samplingRate*time2frame): 2017441441
[saveAudio] fpsString: 23976/1000
[saveAudio] DF: NDF
[saveAudio] subChunkSize :951652
[saveAudio] success


I can send you the MLV if you would like.

chmee

i'm pretty sure, its about some wrong black/whitelevel. please be patient and use 1.6.1 by now.
[size=2]phreekz * blog * twitter[/size]

ChadMuffin

No problem! Thanks for all the effort you have put into the product.

ChadMuffin

I was working in 1.6.1 and recieved black frames as well. This was after I used 1.6.3. I deleted all of the files for raw2cdng that I downloaded and redownloaded 1.6.1 and had the same issue. I also noticed all of my settings, such as the filename, were the same even after deleting the file. Does this product save files else where for settings? Should they be deleted to correct this issue? If you need me to run some test, or send you some files, I'll be glad to help.

chmee

there is the settings-file inside User\[you]\appdata\roaming named raw2cdng.settings.json

regards chmee
[size=2]phreekz * blog * twitter[/size]

feureau

So that's where that is...

Might be a good idea to keep these things inside the same folder as the main program files. I mean, it's kinda hard to find...

ChadMuffin


Kharak

Hey Chmee.

I was converting files and this is the first time I try Vertical Banding fix. Not something usually pay attention to in my footage, but everyone is complaining about it so I thought I better "fix" the issue with my CDNG's.

Problem is that some of the shots now have extreme vertical banding and some dont.. Even though all were exported in one run.

Here is an example: https://www.dropbox.com/s/3ilasxv87den79i/Austria%201_M12-0712_140819_12071200000.dng?dl=0 You can see it especially in shadows. This cdng has VisionLog on it.

Could there be some setting that I am doing wrong or something just went wrong with the conversion?


Ver: 1.6.3 beta

16 bit (not maximized)

Vertical Banding on (Green)

no chroma smoothing

No proxy

No highlight fix



once you go raw you never go back

chmee

sometimes the estimation of vertical differences fails, so yes, depending on footage it can deliver worse data. i wouldnt enable vertical banding by default.

[please be still patient solving bugs, i've got birthday today, and the next days i will party as well :)]

regards chmee
[size=2]phreekz * blog * twitter[/size]

Kharak

Happy birthday!! Hope you have a great one :)

and thanks for the quick reply!

Yeah I will stick to my usual conversion without vertical fix and if I see vertical banding, I will try vertical fix.
once you go raw you never go back

DeafEyeJedi

right on @chmee and Happy Birthday, mister!

Be safe.
5D3.113 | 5D3.123 | EOSM.203 | 7D.203 | 70D.112 | 100D.101 | EOSM2.* | 50D.109

andy kh

5D Mark III - 70D

feureau


andy kh

raw2cdng newer versions like 1.6.1 and 1.6.3 has problem while importing xml from premiere pro cc 2014 to resolve lite. older versions are ok. i also tried shootin@50fps and use version 1.6.3 but there was no problem but those which were shot @23.97 fps has problem. resolve keep on crashing while importing xml. i m unable to figure out why this is happenin. older version like 1.4.9.3 works fine
5D Mark III - 70D

Ottoga

Happy Birthday Chmee. Hope your party rocks/ed

EOS 7D.203, EFS 55-250mm, EF 75-300 III, Tamron 16-300 DiII VC PZD Macro, SpeedLite 580EX II.

chmee

thanks. (today is the main party, so it didnt ended yet :)) so, i ll address bugs asap. one by one. important is the first one with the wrong black/whitelevel, then i will look for the problems with resolve/premiere roundtripping..

@andy_kh
i think its a problem with dropped-framerates. have to re-check/test my code for none-integer fps. did you tested with/without sound?

cheers chmee
[size=2]phreekz * blog * twitter[/size]

andy kh

yeah i hv done test with sound and without sound @chmee
BTW enjoy your party
5D Mark III - 70D

anandkamal

hi chmee, happy birthday  :) :)... I am using 1.6.1 meanwhile.. but,

1) I get black frames and the tool closes showing "raw2cdng stopped working" even after deleting the .json file in c/user/appdata folder
2) I drop six to seven files (around 1 to 3GB), the tool closes showing the above error. This also occurs when I drop seven files and uncheck five of them to extract only two.
3) The tool shows "converting" even after the files have been extracted to cdng... If I load despite that, the tool closes showing error.

The above all occurs in 1.6.1.... thanks.. :)

Kharak

Did you check if you are actually missing frames?

Cant help you with the other questions, sorry.


Why not try 1.6.3 ?
once you go raw you never go back

anandkamal

hi kharak, there are no missing frames.
I used 1.6.3 beta after facing above problems in 1.6.1, but 1.6.3 beta also crashes upon loading even two files at a time, each with frames greater than 1000.
since then, I am uploading and extracting single file at a time (total includes 100s and 100s of files for serious video purpose), very laborious :(... but seriously, glad to have this tool :)

Kharak

CClean and Re-install, probably some registry still interferring from older version. Just a guess, I know this worked for me on Mlrawviewer.

Good luck!
once you go raw you never go back

chmee

@anandkamal if you show a debug, i/we can assume, on what point it crashes - btw. the crash on closing is known but imho not essential for anything (!)and: my tool doesnt write any data into the registry. someone had installed mlvrawviewer and my tool crashes, ater deleting mlvrawviewer mine worked, so sometimes its only magic :)
[size=2]phreekz * blog * twitter[/size]