The CinemaDNG Discussion (raw2cdng)

[kaco]

(5a) thy will be done. static sync-TC set to 00:00:00:00 (because no one ever said something about it)
and/or
(5b) button switch for TimeOfDay?

regards chmee

Tested it with bigger project. Manually changed 50+ clips to 00:00:00:00 and applied Resolve's "Auto-sync Audio Based on Timecode" function and it doesn't work very well. It links wrong audio and video files from time to time. So, maybe the ML does not add correct (same) timecode to audio and video? Or is this raw2cdng problem?

I know it works good in Premiere (probably based on filename), but for many the Resolve is more important.

[kaco]

For now the only working solution for audio/video sync in Resolve is to manually select every audio/video and click chain icon to link the files:


(quite annoying if you have 100+ clips)

[chmee]

because plain wav cant hold timecode, its fixed to 00:00:00:00. so, the problem should be managed in other ways. it could be the naming-definitions for path and mediafiles inside. will look on that. has something to do with the clipNo, that should be in directory and filename. (will investigate)

Directory : M021234_C0001
Pictures : M021234_C0001.[0000-9999].dng
Audio maybe : M021234_C0001.wav

regards chmee

[kaco]

because plain wav cant hold timecode, its fixed to 00:00:00:00. so, the problem should be managed in other ways. it could be the naming-definitions for path and mediafiles inside. will look on that. has something to do with the clipNo, that should be in directory and filename. (will investigate)

Directory : M021234_C0001
Pictures : M021234_C0001.[0000-9999].dng
Audio maybe : M021234_C0001.wav

regards chmee

Thanks! I can provide you working BlackMagicDesign CDNG if you like.

[tonybeccar]

We're getting there!

For me it didnt work at all.. the frames, fps and camera model tags are wrong. The fps seems like it adds the previous value, so you end up with a huge number in the end. Fps shows 1.00.. maye that's the multiplier factor in mlv metadata? And when I hitted start, "raw2cdng stopped working". Oh also, i dragged and dropped 62 mlv files.. short ones, 9 seconds each.. and it took very long to add. Also, it added some wav files that were hanging around because of mlrawviewer.. it'll be wiser to filter it only for mlv's (and raw's).

But anyway, simple mistakes.. it's looking very promising!!!

Myself I'm coding at the moment.. making an interface update, to include dual iso, black image substraction, full mlv support and much much more.. please tell me you didnt forget about the command line? Cause then it will be perfect!!!

Cheers chmee, thanks so much for the hard work!
Tony.

[andy kh]

it seems like i cant add for than one mlv. its works if i add only one but if i do add two or more mlv and hit start "raw2cdng" stop working

[chmee]

ok, thanks for reports.

(1) framesCount reset . todo.
(2) Fps-show 1.00 - fixed
(3) right framerate in cdng - fixed
(4) modeltags are not taken from mlv, by now. todo.
(5) chaos-wav's - cant get the problem. think, will be fixed with other filename-definition.
(6) 69 mlv are a lot - every mlv has to be opened, properties have to be read and written into dngheader into ram while dragdrop-action. so, no great wonder.
(7) raw's dont have any wavs - because there is no mlv_dump-action anymore.
(8 multiple mlv's and raw. todo.
(9) command line maybe in 1.5

regards chmee

[chmee]

@g3gg0 and @a1ex
its strange, it doesnt fit to the definition of droppedframes: you write 23976/1000 into Nom/Denominator for 23.976fps. but by specification it should be 24000/1001. honestly saying, both leads (in my case) in premiere to 24fps. (page 10 in cdng-specs 1.1)

(fixed: 0x0a instead of 0x05 for C764)

regards chmee

[ted ramasola]

chmee,

I tested v 1.4.9.5 but it keeps crashing after outputing a folder with 4-5 frames. Same files I tested extracted ok using raw to dng converter by tonybeccar.

I tried doing it one by one. Sometimes it would convert a file and in another it would crash.

I'm trying to test how long it would take to covert files from a single 64gig cf card comparing it to raw converter 1.9 to dngs.
For the Dng converter it took me 29 min. I'm trying to see if converting via raw2cdng would be faster.

edited:
additional info,
I am using 7D and all files are MLV.

[melimelo]

no new bug to report but additional evidence for crashes commented on posts above:

1. unable to extract several mlvs together, always crashes
2. individual files, sometimes works, sometimes crashes (when it stops, it has already created the extract folder with the first 4-5 DNGs already extracted)

I'm on windows 8 (not 8.1) with mlvs coming from 5D2

pink in highlights as in previous versions (at least for me), only visible in premiere pro, not in ACR or Resolve

thanks for your work

[tonybeccar]

Hey chmee, strange.. in my converter I also look for like 6 fields of metadata while adding, and it's extremely fast.. maybe it's the method you're looking for the bytes? I always look for an exact byte, I know there's a command that searchs all bytes in the files which takes forever.. anyway, you're an awesome programmer so I might just be talking nonsense.. hehe

[chmee]

tony, thats not the point. i#m not an awesome coder, i just have ideas and try to realize them, often with a lot of oldschool-sequential-code i decided to read the whole file-blocks (VIDF/AUDF-Count) while drag/drop-action - just to get my properties right, when they are in the list. if its that important i'd do them into the convert-part..

btw. 1.4.9.6 is on the way, maybe today, maybe tomorrow.

[chmee]

short info: testing all output-formats on several apps. think, today 1.4.9.6

[chmee]

http://www.phreekz.de/wordpress/2013/06/magiclantern-raw2cdng-cinema-dng/

16.03.2014 – v1.4.9.6 – bug fixing
* timecode set to 00:00:00:00
* framerate in dng fixed
* mlv-batchmode fixed
* framesCount in GUI fixed

* 16bit and 12bit linear partymode are ok (in photoshop, acr, resolve and premiere, i think speedgrade as well, not tested)
* 12bit log/bmcc and 10bit are not really useable by now. investigating.

* linking video/audio in resolve via rightbutton link. searching for the according filename-conventions to get it automatically. 

[rrrmusic]

Today tried to convert mlv to dng directly with raw2cdng v1.4.9.6 with a canon 5dmk3 and problem continues with pink highlights in Premiere CC 7.2.1
Partymode enabled with gamma 1.0 bitdeph 16 linear
Tiff model tag Canon EOS 5D Mark III
The view in ACR looks OK and audio is in sync

Magic Lantern version v2.3.NEXT.2014Mar11.5D3113

 I don't know what i'm doing wrong. Please let me know

The only problem i have is the pink highlights in Premiere cc 7.2.1\
sorry for my bad english
Thanks

[chmee]

Yes, there are still pink highlights in Premiere. the dng-properties seems ok, because in acr, photoshop, afx its all ok.. by now im fiddling about the way to avoid them in premiere, but not to cut too much highlight-data.

all infos & hints about this are highly appreciated.

regards chmee

[vikado]

http://www.phreekz.de/wordpress/2013/06/magiclantern-raw2cdng-cinema-dng/

16.03.2014 – v1.4.9.6 – bug fixing
* timecode set to 00:00:00:00
* framerate in dng fixed
* mlv-batchmode fixed
* framesCount in GUI fixed

* 16bit and 12bit linear partymode are ok (in photoshop, acr, resolve and premiere, i think speedgrade as well, not tested)
* 12bit log/bmcc and 10bit are not really useable by now. investigating.

* linking video/audio in resolve via rightbutton link. searching for the according filename-conventions to get it automatically.

awesome, thanks chmee!
your tool has been by far my favorite.
i'll be sure to donate to your cause!
btw, would it be possible to import the same cdng footage back into raw2cdng and compress it down even more?

[anandkamal]

hi chmee, whenever raw2cdng crashes or even when i extract cdngs, there are additional empty folders with somewhat similar name styles created in the same directory. Example: M121643J_C0001_B16LINMAX (when software crashed while extracting .raw file), M121644K_C0001_B16LINNOR (empty folder1 after mlvs were extracted), M121643J_C0001_B16LINNOR (empty folder2, after mlvs were extracted)... the actual folder's name M121653K_C0001_B16LINNOR (contains all the cdngs from mlv file).. am i doing something wrong?

[chmee]

because i didnt tested the actual version with RAW, this could be a silly bug. thanks for info.
did you enabled the logfile? please link/show it via pastebin.
are you using a newer firmware with audio-support?

regards chmee

[Nang]

http://www.phreekz.de/wordpress/2013/06/magiclantern-raw2cdng-cinema-dng/

16.03.2014 – v1.4.9.6 – bug fixing
* timecode set to 00:00:00:00
* framerate in dng fixed
* mlv-batchmode fixed
* framesCount in GUI fixed

* 16bit and 12bit linear partymode are ok (in photoshop, acr, resolve and premiere, i think speedgrade as well, not tested)
* 12bit log/bmcc and 10bit are not really useable by now. investigating.

* linking video/audio in resolve via rightbutton link. searching for the according filename-conventions to get it automatically.

Not sure if I'm doing something wrong, but I downloaded this version and placed them into my raw folder. I checked "Partymode", 1.0 for gamma, changed output path, and drag my raw files onto the Batchlist. When I click on convert to CDNG, a pop-up appears that says 'raw2cdng has stopped working'. I tried doing it again and change bitdepth and such, but still getting the same pop-up. Any suggestions?

Thanks

[chmee]

@nang

did you enabled the logfile? please link/show it via pastebin.

Did You used RAW or MLV-Files?

because i didnt tested the actual version with RAW, this could be a silly bug.

are you using a newer firmware with audio-support?

[DitOnTheLoose]

My Debug Log for the instant crash on 1.4.9.6
Used with raw_rec, no audio.

And I have one feature request:
Can we have an option to change the output folder and filenaming?
Something like "Name folder and files after the original .raw" would be perfect.

Code: [Select]

14.03.19 11:40:01 --

----------- Application started ------------
14.03.19 11:40:01 -- - gamma loaded and set: 0
14.03.19 11:40:01 -- outputPath: M:\140318_Day_15\152
14.03.19 11:40:01 -- uniqueName: ML CDNG1.4.8 PHR
14.03.19 11:40:01 -- loading LogLists for 12bit
14.03.19 11:40:01 -- setting arrays for 12bit-Loglists
14.03.19 11:40:01 -- loaded GUI 1.4.9.6
14.03.19 11:42:14 -- **-- filesList_DragDrop started
14.03.19 11:42:14 -- * dragdropped File X:\140315_Day_13\138\138_M0001.RAW
14.03.19 11:42:14 -- is raw file
14.03.19 11:42:14 -- getting RAW-Attributes
14.03.19 11:42:14 -- ready. got all RAW-Attributes
14.03.19 11:42:14 -- set FileNameShort: 138M0001
14.03.19 11:42:14 -- added to fileData - batchlist
14.03.19 11:42:14 -- found Splitfiles: 1
14.03.19 11:42:14 -- new ListViewItem: 1920x1080 - 2016 frames - 25,00fps - 2047 - 15000 - Canon EOS 5D Mark III
14.03.19 11:42:14 -- added ListViewItems to GUI
14.03.19 11:42:14 -- **-- filesList_DragDrop Ended
14.03.19 11:42:18 -- **-- clicked startConvert and starting Workerthread _doWork
14.03.19 11:42:18 -- **-- _doWork Workerthread started
14.03.19 11:42:18 -- yes, there are Files in the list: 1
14.03.19 11:42:18 -- counting Frames
14.03.19 11:42:18 -- counted AllFrames: 2016
14.03.19 11:42:18 -- changing GUI because of work :)
14.03.19 11:42:18 -- * converting File: 138_M0001
14.03.19 11:42:18 -- changing bitsPerSample
14.03.19 11:42:18 -- bitdepth set to : 16
14.03.19 11:42:18 -- blackLevel Old - New : 2047 - 2047
14.03.19 11:42:18 -- whiteLevel Old - New : 15000 - 15000
14.03.19 11:42:18 -- set and change DNG-Values
14.03.19 11:42:18 -- changed uniqueName: ML CDNG1.4.8 PHR
14.03.19 11:42:18 -- byte Array DNGHeader written
14.03.19 11:42:18 -- set and changed OutputPath: M:\0000_Test\1
14.03.19 11:42:18 -- * Opening File and setting *delta for Splits*
14.03.19 11:42:18 -- - File 138_M0001.RAW split No 0
14.03.19 11:42:18 -- - delta Begin: 0
14.03.19 11:42:18 -- - delta End: 192
14.03.19 11:42:18 -- - framepos: 2016
14.03.19 11:42:18 -- * delta SplitValues done
14.03.19 11:42:18 -- created OutputPath: M:\0000_Test\1\138M0001_C0001_B16LINNOR
14.03.19 11:42:18 -- created helperClass parameter for Threading
14.03.19 11:42:18 -- set MaxThreads to 4
14.03.19 11:42:18 -- started CountdownEvent. starting threadloop for frame-converting.


[chmee]

[raw] ok, thanks a lot. i'll look on the raw-converter-modules - there will be a bug inside.

..Name folder and files after the original .raw..

just give me some days. by now there's on the list "pink highlights" (nearly done) and "raw".

regards chmee

[Nang]

@nangDid You used RAW or MLV-Files?

I tried on RAW files and I'm using August 13th build. Maybe that's the reason why? I haven't updated because everything's been working perfectly since August.

[chmee]

it should work with this older version as well - for sure its a bug in my code for raw-data - but, yours is really old