The CinemaDNG Discussion (raw2cdng)

[jose_ugs]

hmmm, will try that and report back and for the black level in cam, i'm pretty sure it is ON since whenever g3gg0 implemented it, will double check though

P.S. the simple fix did it!!! a thing of beauty thanks a ton, and btw i'll be using your tool a lot, so if you need material off a 5dm3, i'll be around

[feureau]

ah and look if you've got blacklevel-fix in body en- or disabled.

Btw, I have this turned on in my 7D. Without it the darks will have a weird green cast, especially in high ISO.

[jose_ugs]

Yeah, this one is a must! I thought it's a setting just for the 5DM3 & M2 ( as well as 50D ), but it's good to know it's also valid for the 7D

[anandkamal]

Hi.. before downloading 1.6.5, I had to do a video with 5d3 mlv extracted through earlier version (don't remember the version of raw2cdng). The procedure is premiere-resolve roundtrip. Roundtrip was successful. Every effects and cuts were maintained. Client was happy. Resolve (full), premiere cc 2014.

I now extracted new mlv files from 5d3 through 1.6.5 raw2cdng. I imported files to resolve after setting "master project settings" "assist reel name.." etc.,. I exported dnxhd 36 for proxy (as usual) and in premiere I did offline editing and exported finalcutpro XML for resolve roundtrip. This time I did not get the "FCP translation result.." notepad along with the xml (unlike in previous project). When i imported the XML to resolve 11. Resolve could not link the timeline to media pool, also nothing is seen under "reel name" section in resolve. Roundtrip failed and i had to manually link files.

Am i doing something wrong? any new tutorial on this roundtrip?

[feureau]

I think that was a resolve-premiere roundtripping issue. Did you uncheck the import material thingy when going back to resolve?

[anandkamal]

yes feureau.. i did uncheck the "automatically import..." The reel name is blank when i import the xml from premiere.... Is premeire-resolve roundtrip with mlv's extracted via 1.6.5 working for someone pls?? It worked a few days ago with old mlv files. Can u guide pls?

[andy kh]

i found a strange problem with cdng files. im unable to import xml in resolve  exported from premiere pro. i thought the problem may be with raw2cdng converter so i tried converting in mlvRawViewer  and found same problem. resolve keep crashing. i also test shoting at different framrates. only 23.97 has the problem. shot at other framerate like 25 and 50 works fine. unable to figure out where is the problem. i test some old mlv shot wit 550D and they all work fine again

[chmee]

@andy_kh

23,97fps is defined as 24000/1001, whereas ml writes 23976/1000. in earlier versions i readjusted manually broken frames from fi 59940/1000 to 60000/1001. maybe thats a solution.

regards chmee

[andy kh]

yeah i hope so. thanks for ur reply
regards andy kh

[anandkamal]

"23,97fps is defined as 24000/1001, whereas ml writes 23976/1000. in earlier versions i readjusted manually broken frames from fi 59940/1000 to 60000/1001. maybe thats a solution."

chmee.. sorry i don't understand. By earlier versions, do u mean raw2cdng tool?

How do i do that (manually adjusting broken frames)? thanks nd sorry for not knowing

[chmee]

fps are defined as fractions in cdng.

25/1 is 25fps, 25000/1000 also..

dropped frames look like

23.976fps = 23976/1000 or 24000/1001 (the first is the value ml saves, the second is the official definition)

i assume you can change them with exiftools (tag 51044 or C764.H), just for a test. its quite the same like changing black- or whitelevels. if this works, leave me an info, i will do back the handling for known broken framerates.


regards chmee

[anandkamal]

hi chmee...

may i know the preferred settings in raw2cdng 1.6.5 for direct cdng editing in premiere pro cc (2014), for DCP/theatrical projection output?

the info is all spread out in posts and a compiled answer could save many beginners like me

thanks

[Jotys]

Problem raw2cdng 1.6.5 won't allow me to load any mlv files. I am on windows7 64bit.

[andy kh]

Problem raw2cdng 1.6.5 won't allow me to load any mlv files. I am on windows7 64bit.

same problem with me

[chmee]

does it show anything in the debug-file?

@anandkamal
my last tests were with 12bit, 16bit and 16bit maximized WITHOUT highlightfix. Verticalbinding IF needed, Chromasmoothing IF needed. all these cdng's are usable in premiere - but i have to say, i didnt had done short- or musicvideos a long time - so i cant say, what are the optimum settings.

[Walter Schulz]

Opened RAW2CDNG and dropped a MLV file.

Code Select Expand

------------- 1.6.5 started at 15.01.11 20:54:16 --
[init][settings] -- ffmpeg Exists: false
[drop] started
[drop] Files dropped:
[drop] ------
[drop] -- file E:\RAW2CDNG\M11-1112.MLV.
[drop] ------
[drop] -- file E:\RAW2CDNG\M11-1112.MLV will be analyzed now.
[drop] is MLV
[setFileinfoData] set/changed Filedata
[drop] FileinfoData set
[createMLVBlocklist] started
[createMLVBlocklist] splitFiles counted (1)
[createMLVBlocklist] filesize counted (1348MB)
[createMLVBlocklist] indexing Blocks in E:\RAW2CDNG\M11-1112.MLV
[getMLVAttrib] started
[getMLVAttrib] reading RAWI-Block
[getMLVAttrib] reading MLVI-Block
[getMLVAttrib] reading IDNT-Block
[getMLVAttrib] reading WBAL-Block
[getMLVAttrib] reading EXPO-Block
[getMLVAttrib] reading LENS-Block
[getMLVAttrib] reading WAVI-Block
[getMLVAttrib] [!] NO WAVI Block
***** [getMLVAttributes] metaData Object:
xResolution=1344
yResolution=756
frames=792
bitsperSample=14
bitsperSampleChanged=0
isLog=False
colorMatrixA=System.Byte[]
colorMatrixB=
forwardMatrixA=
forwardMatrixB=
lostFrames=0
fpsNom=23973
fpsDen=1000
duration=00:33:09
dropFrame=False
fpsString=23,97
stripByteCount=1778112
stripByteCountReal=1778112
modell=ERR:1 md:0x       0 ml:0r
camId=MAGIC21edb63
apiVersion=0
splitCount=1
photoRAW=False
photoRAWe=False
RGGBValues=System.Int32[]
RGBfraction=System.Int32[]
wb_R=0,730385164051355
wb_G=1
wb_B=0,376886271623114
whiteBalance=3000
whiteBalanceMode=9
whiteBalanceGM=3000
whiteBalanceBA=3000
blackLevelOld=2047
blackLevelNew=2047
whiteLevelOld=15000
whiteLevelNew=15000
maximize=True
maximizer=5,05952289045009
previewPic=
previewFrame=0
errorString=
isMLV=True
DNGHeader=
version=1.6.5
versionString=System.Byte[]
propertiesString=
verticalBandingCoeffs=
verticalBandingNeeded=False
deadSensel=System.Collections.Generic.List`1[raw2cdng_v2.point]
*****
***** [getMLVAttributes] fileData Object:
fileName=E:\RAW2CDNG\M11-1112.MLV
fileNameOnly=M11-1112
fileNameShort=M111112V
fileNameNum=111112
tempPath=C:\Users\<Username>\AppData\Local\Temp\
sourcePath=E:\RAW2CDNG
parentSourcePath=RAW2CDNG
basePath=
destinationPath=
extraPathInfo=
_changedPath=
outputFilename=
creationTime=11.01.2015 18:34:27
modificationTime=11.01.2015 11:13:10
fileSize=1348
VIDFBlock=
RAWBlock=
*****
***** [getMLVAttributes] lensData Object:
lens=18-125mms9:
focalLength=18
aperture=0
isoValue=200
shutter=1/38s
*****

Left box looked like this:


Grey rectangle is there after drop. Red oval was added by me.

[chmee]

thanks. so:

modell=ERR:1 md:0x       0 ml:0r

is the problem. i assumed, the modellname will be written with no hickups (but im wrong). if the modell-name is not accordingly, it cant set colormatrix and forwardmatrix - this leads to another things. so, i will simulate that and fix it in the coming version.

(the same file opens fine in versions before 1.6.5?!)

[Walter Schulz]

(the same file opens fine in versions before 1.6.5?!)

Tested with 1.6.1: Working fine.

Code Select Expand

------------- 1.6.1 started at 15.01.12 00:37:03 --
[init][settings] -- ffmpeg Exists: false
[drop] started
[drop] Files dropped:
[drop] ------
[drop] -- file E:\RAW2CDNG\M11-1112.MLV.
[drop] ------
[drop] -- file E:\RAW2CDNG\M11-1112.MLV will be analyzed now.
[drop] is MLV
[setFileinfoData] set/changed Filedata
[drop] FileinfoData set
[createMLVBlocklist] started
[createMLVBlocklist] splitFiles counted (1)
[createMLVBlocklist] indexing Blocks in E:\RAW2CDNG\M11-1112.MLV
[getMLVAttrib] started
[getMLVAttrib] reading RAWI-Block
[getMLVAttrib] reading MLVI-Block
[getMLVAttrib] reading IDNT-Block
[getMLVAttrib] reading WBAL-Block
[getMLVAttrib] reading EXPO-Block
[getMLVAttrib] reading LENS-Block
[getMLVAttrib] reading WAVI-Block
[getMLVAttrib] [!] NO WAVI Block
***** [getMLVAttributes] metaData Object:
xResolution=1344
yResolution=756
frames=792
bitsperSample=14
bitsperSampleChanged=0
isLog=False
colorMatrix=System.Byte[]
lostFrames=0
fpsNom=23973
fpsDen=1000
duration=00:33:09
dropFrame=False
fpsString=23,97
stripByteCount=1778112
stripByteCountReal=1778112
modell=ERR:1 md:0x       0 ml:0r
camId=MAGIC5e57b61
apiVersion=0
splitCount=1
photoRAW=False
photoRAWe=False
RGGBValues=System.Int32[]
RGBfraction=System.Int32[]
wb_R=0,730385164051355
wb_G=1
wb_B=0,376886271623114
whiteBalance=3000
whiteBalanceMode=9
whiteBalanceGM=3000
whiteBalanceBA=3000
blackLevelOld=2047
blackLevelNew=2047
whiteLevelOld=15000
whiteLevelNew=15000
maximize=True
maximizer=5,05952289045009
previewPic=
previewFrame=0
errorString=
isMLV=True
DNGHeader=
version=1.6.1
versionString=System.Byte[]
propertiesString=
verticalBandingCoeffs=
verticalBandingNeeded=False
*****
***** [getMLVAttributes] fileData Object:
fileName=E:\RAW2CDNG\M11-1112.MLV
fileNameOnly=M11-1112
fileNameShort=M111112V
fileNameNum=111112
tempPath=C:\Users\<username>\AppData\Local\Temp\
sourcePath=E:\RAW2CDNG
parentSourcePath=RAW2CDNG
basePath=
destinationPath=
extraPathInfo=
_changedPath=
outputFilename=
creationTime=11.01.2015 18:34:27
modificationTime=11.01.2015 11:13:10
VIDFBlock=
RAWBlock=
*****
***** [getMLVAttributes] lensData Object:
lens=18-125mms9:
focalLength=18
aperture=0
isoValue=200
shutter=1/38s
*****
[drop] MLV Attributes and Blocklist created and sorted. Blocks: 1617
[drop] VIDF-List created. Blocks: 792
[readVIDFBlockData] started
[readVIDFBlockData] done: [0][1][2][3][4][5][6][7][8][9][10][11][12][13][14][15][16][17][18][19][20][21][22][23][24]
[readVIDFBlockData] done: [25][26][27][28][29][30][31][32][33][34][35][36][37][38][39][40][41][42][43][44][45][46][47][48][49]
[readVIDFBlockData] done: [50][51][52][53][54][55][56][57][58][59][60][61][62][63][64][65][66][67][68][69][70][71][72][73][74]
[readVIDFBlockData] done: [75][76][77][78][79][80][81][82][83][84][85][86][87][88][89][90][91][92][93][94][95][96][97][98][99]
[readVIDFBlockData] done: [100][101][102][103][104][105][106][107][108][109][110][111][112][113][114][115][116][117][118][119][120][121][122][123][124]
[readVIDFBlockData] done: [125][126][127][128][129][130][131][132][133][134][135][136][137][138][139][140][141][142][143][144][145][146][147][148][149]
[readVIDFBlockData] done: [150][151][152][153][154][155][156][157][158][159][160][161][162][163][164][165][166][167][168][169][170][171][172][173][174]
[readVIDFBlockData] done: [175][176][177][178][179][180][181][182][183][184][185][186][187][188][189][190][191][192][193][194][195][196][197][198][199]
[readVIDFBlockData] done: [200][201][202][203][204][205][206][207][208][209][210][211][212][213][214][215][216][217][218][219][220][221][222][223][224]
[readVIDFBlockData] done: [225][226][227][228][229][230][231][232][233][234][235][236][237][238][239][240][241][242][243][244][245][246][247][248][249]
[readVIDFBlockData] done: [250][251][252][253][254][255][256][257][258][259][260][261][262][263][264][265][266][267][268][269][270][271][272][273][274]
[readVIDFBlockData] done: [275][276][277][278][279][280][281][282][283][284][285][286][287][288][289][290][291][292][293][294][295][296][297][298][299]
[readVIDFBlockData] done: [300][301][302][303][304][305][306][307][308][309][310][311][312][313][314][315][316][317][318][319][320][321][322][323][324]
[readVIDFBlockData] done: [325][326][327][328][329][330][331][332][333][334][335][336][337][338][339][340][341][342][343][344][345][346][347][348][349]
[readVIDFBlockData] done: [350][351][352][353][354][355][356][357][358][359][360][361][362][363][364][365][366][367][368][369][370][371][372][373][374]
[readVIDFBlockData] done: [375][376][377][378][379][380][381][382][383][384][385][386][387][388][389][390][391][392][393][394][395][396][397][398][399]
[readVIDFBlockData] done: [400][401][402][403][404][405][406][407][408][409][410][411][412][413][414][415][416][417][418][419][420][421][422][423][424]
[readVIDFBlockData] done: [425][426][427][428][429][430][431][432][433][434][435][436][437][438][439][440][441][442][443][444][445][446][447][448][449]
[readVIDFBlockData] done: [450][451][452][453][454][455][456][457][458][459][460][461][462][463][464][465][466][467][468][469][470][471][472][473][474]
[readVIDFBlockData] done: [475][476][477][478][479][480][481][482][483][484][485][486][487][488][489][490][491][492][493][494][495][496][497][498][499]
[readVIDFBlockData] done: [500][501][502][503][504][505][506][507][508][509][510][511][512][513][514][515][516][517][518][519][520][521][522][523][524]
[readVIDFBlockData] done: [525][526][527][528][529][530][531][532][533][534][535][536][537][538][539][540][541][542][543][544][545][546][547][548][549]
[readVIDFBlockData] done: [550][551][552][553][554][555][556][557][558][559][560][561][562][563][564][565][566][567][568][569][570][571][572][573][574]
[readVIDFBlockData] done: [575][576][577][578][579][580][581][582][583][584][585][586][587][588][589][590][591][592][593][594][595][596][597][598][599]
[readVIDFBlockData] done: [600][601][602][603][604][605][606][607][608][609][610][611][612][613][614][615][616][617][618][619][620][621][622][623][624]
[readVIDFBlockData] done: [625][626][627][628][629][630][631][632][633][634][635][636][637][638][639][640][641][642][643][644][645][646][647][648][649]
[readVIDFBlockData] done: [650][651][652][653][654][655][656][657][658][659][660][661][662][663][664][665][666][667][668][669][670][671][672][673][674]
[readVIDFBlockData] done: [675][676][677][678][679][680][681][682][683][684][685][686][687][688][689][690][691][692][693][694][695][696][697][698][699]
[readVIDFBlockData] done: [700][701][702][703][704][705][706][707][708][709][710][711][712][713][714][715][716][717][718][719][720][721][722][723][724]
[readVIDFBlockData] done: [725][726][727][728][729][730][731][732][733][734][735][736][737][738][739][740][741][742][743][744][745][746][747][748][749]
[readVIDFBlockData] done: [750][751][752][753][754][755][756][757][758][759][760][761][762][763][764][765][766][767][768][769][770][771][772][773][774]
[drop] VIDF-Blockdata read and created.
[drop] adding M11-1112 to batchList
[showPicture] started
[drop] verticalBanding enabled. decision: not needed
[drop] verticalBanding CoEffs: 1 1,00241055350834 0,998533097079163 0,999124084358047 0,997837972587185 0,999753836807715 0,995905262997038 0,998138322767508 0
[drop] ** Item M11-1112 imported | MLV
[drop] * res 1344x756px | 23,97fps | 792 frames | BL2047 | WL15000
[drop] * modell ERR:1 md:0x       0 ml:0r | vidfblocks 792 | has no audio


[chmee]

ok. so i have to do a check against a list of models, if its not in, i have to set to one. (or recheck against the first value of the colormatrix inside the raw/mlv) thats not really perfect, but gives an output. (notice for me: giving an info to the user for those errors/bugs inside the gui).

what camera/ml-firmware do you've got?
i assume, 1.6.5 works ok, if you use a raw instead of a mlv-file (for raw-files i use the model-assumption on color-matrix-values)

[Walter Schulz]

7D and 650D available here. Testing different ML versions is not the problem. Some cards here, too.
File logged was created with 650D and ML version 2015Jan03.

EDIT: RAW seems to work fine.
EDITEDIT: I may revise that ...

Code Select Expand

[drop] * modell Canon EOS 700D | rawblocks 240 | has noaudio

[chmee]

hmm.. maybe its only the newest ml-version - i hope. can be a discussion thing for cameraspecific-thread or as general bug in newest ml-fw.

EDIT: yeah, the raw-module recognises the body out of the colormatrix (with raw the only way to define it). as i assumed, the model-writing inside the body seems faulty. from my sourcecode:

Code Select Expand


case 6602: // first value of colormatrix
                    rData.data.metaData.modell = "Canon EOS 700D"; // thats for 650D, 100D, EOSM as well

(bitbucket io.cs line ~770)

[Walter Schulz]

650D, ML build 2014Oct07 and MLV recording: No, same error.
And MLV created with ML version 2014Apr29 won't do, either.

[artyg]

I imported files to resolve after setting "master project settings" "assist reel name.." etc.,. I exported dnxhd 36 for proxy (as usual) and in premiere I did offline editing and exported finalcutpro XML for resolve roundtrip. This time I did not get the "FCP translation result.." notepad along with the xml (unlike in previous project). When i imported the XML to resolve 11. Resolve could not link the timeline to media pool, also nothing is seen under "reel name" section in resolve. Roundtrip failed and i had to manually link files.

Am i doing something wrong? any new tutorial on this roundtrip?

I test new workflow with raw2cdng 1.6.5 and AP CC 2014 (Davinci->AP->Davinci) and all work correct for me. If this topic is of interest to someone I could write a short lesson about it.

But one question for @anandkamal - in Resolve after AP you edit cdng or you render some kind of Log?

[anandkamal]

thanks Artyg.. in resolve i just go on with coloring after linking the offline-edited timeline to cdng mediapool. I don't render anything for resolve. But after I grade, I would render dnxhd 220 for final import into AP.

I am currently editing cdngs directly in premiere cc. Even if I get pink highlights or other issues, I don't have to worry as I will import the xml to resolve checking on "automatically import files from media pool." Resolve never shows issues with cdng files (like pink highlights etc.,.). After coloring, I render high quality footage back to premiere for final mastering.

It would be great to have a lesson on the resolve-premiere-resolve-premiere roundtrip, as things are updated now

[artyg]

I did a quick test with cdng (not log renders) and you are right - Resolve crash when I try import xml from AP. Only EDL I was able to import to Resolve. But content not linked. Only edit (cut) positions. Some problem with reel names. I will try tomorrow more detail test. BTW I recomend you to use Cinelog-C to render high quality log source and work with it, not cdng.