The CinemaDNG Discussion (raw2cdng)

[kaco]

btw: i implemented the WBAL-usage and resolve, premiere and photoshop behaves quite well. did some more exception-trapping and debug-writing. beta7 is near.

very nice!

[chmee]

raw2cdng 1.5.0 beta7 online

downloadlink

* 12bit shouldnt crash anymore with big/strange resolutions
* WBAL from MLV or CR2 (presets and manual as well) test!
* debuglog reorganized - readability
* if ffmpeg.exe in same folder - proxy output will be as mpeg2 as well (half resolution) (you see mpeg2 in button if ffmpeg is recognised)

regards chmee

[Jbowdach]

@chmee I think I figured my issue. I was bringing in all the files in one folder. Didnt realize I need to bring in EACH folder individually, and use the autosync option on the folder for each clip. Im going to try a mass sync tonight and see how it work along w beta7, as Ive had a few crashes w beta6 (mainly related to scrolling when it is reviewing the clips after dragging them).

Many thanks for the update and testing!

[chmee]

you can drag/drop them all first into the mediapool. after that you can select them (all) and use autosync. should work.

[chmee]

@jbowdach crash issues mentioned on bitbucket

first debug: [beta7] failure on DayFive/M01-0925.MLV (Exception listed at the end, couldnt read MLV because of negative fileofffset, zero frames?!)
second debug: [beta7] failure on DaySeven/M03-1132.MLV (fpsnom is zero and found no VIDF-Block)
third debuglog: [beta6] hmm. Day Five\M01-1214.MLV. somewhere while identifying VIDF-Blocks. please try this one with beta7.

mainly, it seems, something disturbes the reading of the vidf-blocks and/or the blocks at all. If you ha a shorter file from your recording you could send me, it would be great. Did you tried to read the files with mlvdiag? shorten a file with it and send it to me. or use HxD and copy the first ~50MB of M03-1132 (and/or M01-0925.MLV) into a new file. send this one.

bytheway: Thanks a lot for the help (and patience) to you all!!

edit:

This is raw2cdng 1.5.0 beta7 under win7/win8 with aero and enabled ffmpeg.exe

and an hour ago i put mlvdiag into the raw2cdng-zip (download it again if needed). now in version 1.0.1 with a light helper. just drag/drop a file on the rectangle on bottom, and it will be copied into a 55mb big file with the ending ".55mb.mlv". no checks, just to copy the first 55mb of the main file to give me a chance to deal with some of the mysterious files.

[Jbowdach]

Will do with the problem files so you can take a look at them. No clue why these are recording with errors, as they were all recorded at the same time with the same build on the same cards. What's strange as I had 4 previous days FULL of MLVs that decoded without any crashes......(confused). Not sure why it started having issues on Day 5 and 7 (didnt shoot on day 6)

No worries, thank you for your help in diagnosing the issues and debug logs.

[Jbowdach]

@chmee

Please find the links below to the files you requested.

https://dl.dropboxusercontent.com/u/787062/raw2cdng/M01-0925.MLV.55mb.mlv
https://dl.dropboxusercontent.com/u/787062/raw2cdng/M01-1214.MLV.55mb.mlv

[chmee]

please give me DaySeven/M03-1132.MLV as well. on a short test i could use both shortened mlv's without problems.
Are your problematic files seeable in mlvdiag (dragdrop into list)?

[Jbowdach]

The file appears to be damaged, this is the file as copied off the card. All files came up fine in mkvdiag.
https://dl.dropboxusercontent.com/u/787062/raw2cdng/M03-1132.MLV

On another note, I all of a sudden cant launch raw2cdng. Something happened w my system. ever seen anything like the following?


Problem signature:
  Problem Event Name:   CLR20r3
  Problem Signature 01:   raw2cdng.1.5.0.beta7.exe
  Problem Signature 02:   1.5.0.0
  Problem Signature 03:   53e3fb45
  Problem Signature 04:   System.Web.Extensions
  Problem Signature 05:   4.0.30319.18408
  Problem Signature 06:   523111a8
  Problem Signature 07:   1a2
  Problem Signature 08:   ed
  Problem Signature 09:   System.Windows.Markup.XamlParse
  OS Version:   6.1.7601.2.1.0.256.4
  Locale ID:   1033
  Additional Information 1:   0a9e
  Additional Information 2:   0a9e372d3b4ad19135b953a78882e789
  Additional Information 3:   0a9e
  Additional Information 4:   0a9e372d3b4ad19135b953a78882e789

EDIT: Not sure what caused it, uninstalled\reinstalled .net and still didnt work. Ended up restoring an image backup to a few days ago (lucky me!)

[pakal]

Hi, first of all thanks for that neat piece of software!
I use it to get mp4 proxies but I have an issue about the color though, the jpegs are off, lifted blacks, wrong gamma.

I copied ffmpeg in the folder and used the proxy option.
Is there a way to get jpegs with the same look as the dng please?

I searched the thread but couldn't find any workaround for this, I apologize if this has been answered before.

Thanks!

[chmee]

(answering from a smartphone) the proxy-option was/is only for cutting purposes. but i will optimize it in the next Version..

[pakal]

(answering from a smartphone) the proxy-option was/is only for cutting purposes. but i will optimize it in the next Version..

thanks for the quick answer and thanks for the work, it's the only program that has worked with MLVs for me so far

[kaco]

@chmee: in beta7 there is still present the bug that the app will crash when scrolling all loaded MLV files during convert

[kaco]

+ it would be perfect if folder drop will be working. Now I use 3 cameras -- I have to copy the mlvs into folders "card1, card2,.." because 2 cameras can create same named files. Then I convert MLVs to cdngs with namespace "[D2]_[F]_[P]_". But I have to manually drop every folder, which is time consuming if I have 40 cards and so.

[kaco]

And very nice future feature would be progress bar in the taskbar button. You know like when you copy files with explorer, the icon in the taskbar will start to fill its background with green. So you know the app is working and you'll see once it's done

[kaco]

I have a problem converting one file. It's the last file on the card, so maybe it's corrupted, but extracts with MLV Converter 1.9.2 fine.

Here's debug:

Code: [Select]

------------- 1.5.0.BETA7 started at 14.08.12 23:49:48 --
[init][settings] -- ffmpeg Exists: false
[drop] started
[drop] Files dropped:
[drop] ------
[drop] O:\2014-07-08 Freedomky dotacky MLV\k3\M08-1137.M00
[drop] O:\2014-07-08 Freedomky dotacky MLV\k3\M08-1137.M01
[drop] O:\2014-07-08 Freedomky dotacky MLV\k3\M08-1137.M02
[drop] O:\2014-07-08 Freedomky dotacky MLV\k3\M08-1137.M03
[drop] O:\2014-07-08 Freedomky dotacky MLV\k3\M08-1137.M04
[drop] O:\2014-07-08 Freedomky dotacky MLV\k3\M08-1137.M05
[drop] O:\2014-07-08 Freedomky dotacky MLV\k3\M08-1137.M06
[drop] O:\2014-07-08 Freedomky dotacky MLV\k3\M08-1137.M07
[drop] O:\2014-07-08 Freedomky dotacky MLV\k3\M08-1137.M08
[drop] O:\2014-07-08 Freedomky dotacky MLV\k3\M08-1137.MLV
[drop] ------
[drop] -- file O:\2014-07-08 Freedomky dotacky MLV\k3\M08-1137.M00 will be analyzed now.
[drop] -- file O:\2014-07-08 Freedomky dotacky MLV\k3\M08-1137.M01 will be analyzed now.
[drop] -- file O:\2014-07-08 Freedomky dotacky MLV\k3\M08-1137.M02 will be analyzed now.
[drop] -- file O:\2014-07-08 Freedomky dotacky MLV\k3\M08-1137.M03 will be analyzed now.
[drop] -- file O:\2014-07-08 Freedomky dotacky MLV\k3\M08-1137.M04 will be analyzed now.
[drop] -- file O:\2014-07-08 Freedomky dotacky MLV\k3\M08-1137.M05 will be analyzed now.
[drop] -- file O:\2014-07-08 Freedomky dotacky MLV\k3\M08-1137.M06 will be analyzed now.
[drop] -- file O:\2014-07-08 Freedomky dotacky MLV\k3\M08-1137.M07 will be analyzed now.
[drop] -- file O:\2014-07-08 Freedomky dotacky MLV\k3\M08-1137.M08 will be analyzed now.
[drop] -- file O:\2014-07-08 Freedomky dotacky MLV\k3\M08-1137.MLV will be analyzed now.
[drop] is MLV
[setFileinfoData] set/changed Filedata
[drop] FileinfoData set
[createMLVBlocklist] started
[createMLVBlocklist] splitFiles counted (10)
[createMLVBlocklist] indexing Blocks in O:\2014-07-08 Freedomky dotacky MLV\k3\M08-1137.MLV
[createMLVBlocklist] --- exception(!) ---
[createMLVBlocklist] blockTag|offset|fileNo : &???|-199613494|0
Message = Non-negative number required.
Parameter name: value
ActualValue =
ParamName = value
Data = System.Collections.ListDictionaryInternal
InnerException =
TargetSite = Void set_Position(Int64)
StackTrace =    at System.IO.FileStream.set_Position(Int64 value)
   at raw2cdng_v2.io.createMLVBlockList(String filename, raw raw)
HelpLink =
Source = mscorlib
HResult = -2146233086

Also won't open with mlv diag, probably the same problem. The progress is stuck on loading.

[edge11]

Is there any way to integrate pink dot removal or chromasoothing for us t4i users?

[chmee]

@kaco
thanks for ideas.
folderimport is coded (useable with P-Tag, as you've shown)
progress on taskicon, i will see, minor importance.

your file, thats crashes the app, seems to deliver wrong offset-data straight on first block. thats strange and could be a hint on a undeleted value somewhere. will do some longer recording to test it. could be equal to @jbowdachs problems.

@edge11
sorry, i didnt found the time to implement it.. its on the list and if this is done i'd change the versionnumber to some more if someone could help me, would be great.

by now i'm on holidays, for the next 10 days. i try to bugfix and implement as much as possible.

regards chmee

[zacshome]

chmee is there anyway to mass import the jpg sequences into premiere? it seems i have to do them all individually.

[ChadMuffin]

I don't know if debugging and impletementing your program is a holiday for you or not but, thanks for being a team player! I know ML users will be happy!

[kaco]

chmee is there anyway to mass import the jpg sequences into premiere? it seems i have to do them all individually.

in premiere open the import windows, select the first file of the sequence and in the window there should be checkbox "numbered stills". Then you import jpeg sequence as a "video" and you can change properties and set correct FPS.

[Jbowdach]

I don't know if debugging and impletementing your program is a holiday for you or not but, thanks for being a team player! I know ML users will be happy!

Another massive thanks for a happy ML \ Cdng user. You've created the best solution for MLV to cdng for windows so far, otherwise we'd still be stuck in DNG sequence land

[kaco]

very similar problem as the last one:

Code: [Select]

[drop] -- file O:\2014-06-23 Freedomky MLV\M23-1239.M00 will be analyzed now.
[drop] -- file O:\2014-06-23 Freedomky MLV\M23-1239.M01 will be analyzed now.
[drop] -- file O:\2014-06-23 Freedomky MLV\M23-1239.M02 will be analyzed now.
[drop] -- file O:\2014-06-23 Freedomky MLV\M23-1239.M03 will be analyzed now.
[drop] -- file O:\2014-06-23 Freedomky MLV\M23-1239.M04 will be analyzed now.
[drop] -- file O:\2014-06-23 Freedomky MLV\M23-1239.M05 will be analyzed now.
[drop] -- file O:\2014-06-23 Freedomky MLV\M23-1239.M06 will be analyzed now.
[drop] -- file O:\2014-06-23 Freedomky MLV\M23-1239.M07 will be analyzed now.
[drop] -- file O:\2014-06-23 Freedomky MLV\M23-1239.M08 will be analyzed now.
[drop] -- file O:\2014-06-23 Freedomky MLV\M23-1239.MLV will be analyzed now.
[drop] is MLV
[setFileinfoData] set/changed Filedata
[drop] FileinfoData set
[createMLVBlocklist] started
[createMLVBlocklist] splitFiles counted (10)
[createMLVBlocklist] indexing Blocks in O:\2014-06-23 Freedomky MLV\M23-1239.MLV
[createMLVBlocklist] --- exception(!) ---
[createMLVBlocklist] blockTag|offset|fileNo :
x6?|-1118282230|0
Message = Non-negative number required.
Parameter name: value
ActualValue =
ParamName = value
Data = System.Collections.ListDictionaryInternal
InnerException =
TargetSite = Void set_Position(Int64)
StackTrace =    at System.IO.FileStream.set_Position(Int64 value)
   at raw2cdng_v2.io.createMLVBlockList(String filename, raw raw)
HelpLink =
Source = mscorlib
HResult = -2146233086


[chmee]

sorry guys. debugging on bigger files does not work here where i am, instead of this i coded a neat extra and optimized the proxy output.

raw2cdng 1.5.0 beta8 is online.
* mlvplayer embedded - glue the file extension MLV to this app and lets play it RAW not tested yet. (no audio)
* whitebalance optimized (hopefully) on jpg/mpeg2 output
* no rec709-log/lut but gamma 2 on proxyoutput.
* fixed glitch on mpeg2-output (length was taken by audio, now it should be ok)
* folder dragdropable. Use P-tag.

for sure the playback is not accurate, but massively helps to overview recordings. and it looks better than ffplay (sorry, this was my first idea)

regards chmee

[Jbowdach]

sorry guys. debugging on bigger files does not work here where i am, instead of this i coded a neat extra and optimized the proxy output.

raw2cdng 1.5.0 beta8 is online.
* mlvplayer embedded - glue the file extension MLV to this app and lets play it RAW not tested yet. (no audio)
* whitebalance optimized (hopefully) on jpg/mpeg2 output
* no rec709-log/lut but gamma 2 on proxyoutput.
* fixed glitch on mpeg2-output (length was taken by audio, now it should be ok)
* folder dragdropable. Use P-tag.

for sure the playback is not accurate, but massively helps to overview recordings. and it looks better than ffplay (sorry, this was my first idea)

regards chmee

Many thanks for the folder option, what do you mean by using the p-tag? For what reason? Seems to work just by dragging a folder