hahahahaha... you are great!!!
this works pretty good here.. also with long folder names and spaces in between..
so when the app also supports batch processing it is perfect.
thank you very very much.
have you tried dropping a DCIM folder on 0.4?
Are Windows users being left behind here?Already exists a batchconversion tool for windows I believe?
MacBook-Pro-di-scrax:raw_rec scrax$ make
[ CC ] raw_rec.o
[ MODULE ] raw_rec.mo
[ GCC ] raw2dng
/Users/scrax/magic-lantern-fixes/modules/raw_rec/../../src/chdk-dng.c:134: warning: cast from pointer to integer of different size
/Users/scrax/magic-lantern-fixes/modules/raw_rec/../../src/chdk-dng.c:134: error: initializer element is not constant
/Users/scrax/magic-lantern-fixes/modules/raw_rec/../../src/chdk-dng.c:134: error: (near initialization for ‘ifd0[3].offset’)
/Users/scrax/magic-lantern-fixes/modules/raw_rec/../../src/chdk-dng.c:138: warning: cast from pointer to integer of different size
/Users/scrax/magic-lantern-fixes/modules/raw_rec/../../src/chdk-dng.c:138: error: initializer element is not constant
/Users/scrax/magic-lantern-fixes/modules/raw_rec/../../src/chdk-dng.c:138: error: (near initialization for ‘ifd0[7].offset’)
/Users/scrax/magic-lantern-fixes/modules/raw_rec/../../src/chdk-dng.c:139: warning: cast from pointer to integer of different size
/Users/scrax/magic-lantern-fixes/modules/raw_rec/../../src/chdk-dng.c:139: error: initializer element is not constant
/Users/scrax/magic-lantern-fixes/modules/raw_rec/../../src/chdk-dng.c:139: error: (near initialization for ‘ifd0[8].offset’)
/Users/scrax/magic-lantern-fixes/modules/raw_rec/../../src/chdk-dng.c:147: warning: cast from pointer to integer of different size
/Users/scrax/magic-lantern-fixes/modules/raw_rec/../../src/chdk-dng.c:147: error: initializer element is not constant
/Users/scrax/magic-lantern-fixes/modules/raw_rec/../../src/chdk-dng.c:147: error: (near initialization for ‘ifd0[16].offset’)
/Users/scrax/magic-lantern-fixes/modules/raw_rec/../../src/chdk-dng.c:148: warning: cast from pointer to integer of different size
/Users/scrax/magic-lantern-fixes/modules/raw_rec/../../src/chdk-dng.c:148: error: initializer element is not constant
/Users/scrax/magic-lantern-fixes/modules/raw_rec/../../src/chdk-dng.c:148: error: (near initialization for ‘ifd0[17].offset’)
/Users/scrax/magic-lantern-fixes/modules/raw_rec/../../src/chdk-dng.c:150: warning: cast from pointer to integer of different size
/Users/scrax/magic-lantern-fixes/modules/raw_rec/../../src/chdk-dng.c:150: error: initializer element is not constant
/Users/scrax/magic-lantern-fixes/modules/raw_rec/../../src/chdk-dng.c:150: error: (near initialization for ‘ifd0[19].offset’)
/Users/scrax/magic-lantern-fixes/modules/raw_rec/../../src/chdk-dng.c:155: warning: cast from pointer to integer of different size
/Users/scrax/magic-lantern-fixes/modules/raw_rec/../../src/chdk-dng.c:155: error: initializer element is not constant
/Users/scrax/magic-lantern-fixes/modules/raw_rec/../../src/chdk-dng.c:155: error: (near initialization for ‘ifd0[24].offset’)
/Users/scrax/magic-lantern-fixes/modules/raw_rec/../../src/chdk-dng.c:156: warning: cast from pointer to integer of different size
/Users/scrax/magic-lantern-fixes/modules/raw_rec/../../src/chdk-dng.c:156: error: initializer element is not constant
/Users/scrax/magic-lantern-fixes/modules/raw_rec/../../src/chdk-dng.c:156: error: (near initialization for ‘ifd0[25].offset’)
/Users/scrax/magic-lantern-fixes/modules/raw_rec/../../src/chdk-dng.c:157: warning: cast from pointer to integer of different size
/Users/scrax/magic-lantern-fixes/modules/raw_rec/../../src/chdk-dng.c:157: error: initializer element is not constant
/Users/scrax/magic-lantern-fixes/modules/raw_rec/../../src/chdk-dng.c:157: error: (near initialization for ‘ifd0[26].offset’)
/Users/scrax/magic-lantern-fixes/modules/raw_rec/../../src/chdk-dng.c:158: warning: cast from pointer to integer of different size
/Users/scrax/magic-lantern-fixes/modules/raw_rec/../../src/chdk-dng.c:158: error: initializer element is not constant
/Users/scrax/magic-lantern-fixes/modules/raw_rec/../../src/chdk-dng.c:158: error: (near initialization for ‘ifd0[27].offset’)
/Users/scrax/magic-lantern-fixes/modules/raw_rec/../../src/chdk-dng.c:159: warning: cast from pointer to integer of different size
/Users/scrax/magic-lantern-fixes/modules/raw_rec/../../src/chdk-dng.c:159: error: initializer element is not constant
/Users/scrax/magic-lantern-fixes/modules/raw_rec/../../src/chdk-dng.c:159: error: (near initialization for ‘ifd0[28].offset’)
/Users/scrax/magic-lantern-fixes/modules/raw_rec/../../src/chdk-dng.c:160: warning: cast from pointer to integer of different size
/Users/scrax/magic-lantern-fixes/modules/raw_rec/../../src/chdk-dng.c:160: error: initializer element is not constant
/Users/scrax/magic-lantern-fixes/modules/raw_rec/../../src/chdk-dng.c:160: error: (near initialization for ‘ifd0[29].offset’)
/Users/scrax/magic-lantern-fixes/modules/raw_rec/../../src/chdk-dng.c:161: warning: cast from pointer to integer of different size
/Users/scrax/magic-lantern-fixes/modules/raw_rec/../../src/chdk-dng.c:161: error: initializer element is not constant
/Users/scrax/magic-lantern-fixes/modules/raw_rec/../../src/chdk-dng.c:161: error: (near initialization for ‘ifd0[30].offset’)
/Users/scrax/magic-lantern-fixes/modules/raw_rec/../../src/chdk-dng.c:162: warning: cast from pointer to integer of different size
/Users/scrax/magic-lantern-fixes/modules/raw_rec/../../src/chdk-dng.c:162: error: initializer element is not constant
/Users/scrax/magic-lantern-fixes/modules/raw_rec/../../src/chdk-dng.c:162: error: (near initialization for ‘ifd0[31].offset’)
/Users/scrax/magic-lantern-fixes/modules/raw_rec/../../src/chdk-dng.c:171: warning: cast from pointer to integer of different size
/Users/scrax/magic-lantern-fixes/modules/raw_rec/../../src/chdk-dng.c:171: error: initializer element is not constant
/Users/scrax/magic-lantern-fixes/modules/raw_rec/../../src/chdk-dng.c:171: error: (near initialization for ‘ifd1[1].offset’)
/Users/scrax/magic-lantern-fixes/modules/raw_rec/../../src/chdk-dng.c:172: warning: cast from pointer to integer of different size
/Users/scrax/magic-lantern-fixes/modules/raw_rec/../../src/chdk-dng.c:172: error: initializer element is not constant
/Users/scrax/magic-lantern-fixes/modules/raw_rec/../../src/chdk-dng.c:172: error: (near initialization for ‘ifd1[2].offset’)
/Users/scrax/magic-lantern-fixes/modules/raw_rec/../../src/chdk-dng.c:173: warning: cast from pointer to integer of different size
/Users/scrax/magic-lantern-fixes/modules/raw_rec/../../src/chdk-dng.c:173: error: initializer element is not constant
/Users/scrax/magic-lantern-fixes/modules/raw_rec/../../src/chdk-dng.c:173: error: (near initialization for ‘ifd1[3].offset’)
/Users/scrax/magic-lantern-fixes/modules/raw_rec/../../src/chdk-dng.c:178: warning: cast from pointer to integer of different size
/Users/scrax/magic-lantern-fixes/modules/raw_rec/../../src/chdk-dng.c:178: error: initializer element is not constant
/Users/scrax/magic-lantern-fixes/modules/raw_rec/../../src/chdk-dng.c:178: error: (near initialization for ‘ifd1[8].offset’)
/Users/scrax/magic-lantern-fixes/modules/raw_rec/../../src/chdk-dng.c:179: warning: cast from pointer to integer of different size
/Users/scrax/magic-lantern-fixes/modules/raw_rec/../../src/chdk-dng.c:179: error: initializer element is not constant
/Users/scrax/magic-lantern-fixes/modules/raw_rec/../../src/chdk-dng.c:179: error: (near initialization for ‘ifd1[9].offset’)
/Users/scrax/magic-lantern-fixes/modules/raw_rec/../../src/chdk-dng.c:180: warning: cast from pointer to integer of different size
/Users/scrax/magic-lantern-fixes/modules/raw_rec/../../src/chdk-dng.c:180: error: initializer element is not constant
/Users/scrax/magic-lantern-fixes/modules/raw_rec/../../src/chdk-dng.c:180: error: (near initialization for ‘ifd1[10].offset’)
/Users/scrax/magic-lantern-fixes/modules/raw_rec/../../src/chdk-dng.c:181: warning: cast from pointer to integer of different size
/Users/scrax/magic-lantern-fixes/modules/raw_rec/../../src/chdk-dng.c:181: error: initializer element is not constant
/Users/scrax/magic-lantern-fixes/modules/raw_rec/../../src/chdk-dng.c:181: error: (near initialization for ‘ifd1[11].offset’)
/Users/scrax/magic-lantern-fixes/modules/raw_rec/../../src/chdk-dng.c:185: warning: cast from pointer to integer of different size
/Users/scrax/magic-lantern-fixes/modules/raw_rec/../../src/chdk-dng.c:185: error: initializer element is not constant
/Users/scrax/magic-lantern-fixes/modules/raw_rec/../../src/chdk-dng.c:185: error: (near initialization for ‘ifd1[15].offset’)
/Users/scrax/magic-lantern-fixes/modules/raw_rec/../../src/chdk-dng.c:186: warning: cast from pointer to integer of different size
/Users/scrax/magic-lantern-fixes/modules/raw_rec/../../src/chdk-dng.c:186: error: initializer element is not constant
/Users/scrax/magic-lantern-fixes/modules/raw_rec/../../src/chdk-dng.c:186: error: (near initialization for ‘ifd1[16].offset’)
/Users/scrax/magic-lantern-fixes/modules/raw_rec/../../src/chdk-dng.c:187: warning: cast from pointer to integer of different size
/Users/scrax/magic-lantern-fixes/modules/raw_rec/../../src/chdk-dng.c:187: error: initializer element is not constant
/Users/scrax/magic-lantern-fixes/modules/raw_rec/../../src/chdk-dng.c:187: error: (near initialization for ‘ifd1[17].offset’)
/Users/scrax/magic-lantern-fixes/modules/raw_rec/../../src/chdk-dng.c:188: warning: cast from pointer to integer of different size
/Users/scrax/magic-lantern-fixes/modules/raw_rec/../../src/chdk-dng.c:188: error: initializer element is not constant
/Users/scrax/magic-lantern-fixes/modules/raw_rec/../../src/chdk-dng.c:188: error: (near initialization for ‘ifd1[18].offset’)
/Users/scrax/magic-lantern-fixes/modules/raw_rec/../../src/chdk-dng.c:189: warning: cast from pointer to integer of different size
/Users/scrax/magic-lantern-fixes/modules/raw_rec/../../src/chdk-dng.c:189: error: initializer element is not constant
/Users/scrax/magic-lantern-fixes/modules/raw_rec/../../src/chdk-dng.c:189: error: (near initialization for ‘ifd1[19].offset’)
/Users/scrax/magic-lantern-fixes/modules/raw_rec/../../src/chdk-dng.c:190: warning: cast from pointer to integer of different size
/Users/scrax/magic-lantern-fixes/modules/raw_rec/../../src/chdk-dng.c:190: error: initializer element is not constant
/Users/scrax/magic-lantern-fixes/modules/raw_rec/../../src/chdk-dng.c:190: error: (near initialization for ‘ifd1[20].offset’)
/Users/scrax/magic-lantern-fixes/modules/raw_rec/../../src/chdk-dng.c:202: warning: cast from pointer to integer of different size
/Users/scrax/magic-lantern-fixes/modules/raw_rec/../../src/chdk-dng.c:202: error: initializer element is not constant
/Users/scrax/magic-lantern-fixes/modules/raw_rec/../../src/chdk-dng.c:202: error: (near initialization for ‘exif_ifd[0].offset’)
/Users/scrax/magic-lantern-fixes/modules/raw_rec/../../src/chdk-dng.c:203: warning: cast from pointer to integer of different size
/Users/scrax/magic-lantern-fixes/modules/raw_rec/../../src/chdk-dng.c:203: error: initializer element is not constant
/Users/scrax/magic-lantern-fixes/modules/raw_rec/../../src/chdk-dng.c:203: error: (near initialization for ‘exif_ifd[1].offset’)
/Users/scrax/magic-lantern-fixes/modules/raw_rec/../../src/chdk-dng.c:205: warning: cast from pointer to integer of different size
/Users/scrax/magic-lantern-fixes/modules/raw_rec/../../src/chdk-dng.c:205: error: initializer element is not constant
/Users/scrax/magic-lantern-fixes/modules/raw_rec/../../src/chdk-dng.c:205: error: (near initialization for ‘exif_ifd[3].offset’)
/Users/scrax/magic-lantern-fixes/modules/raw_rec/../../src/chdk-dng.c:207: warning: cast from pointer to integer of different size
/Users/scrax/magic-lantern-fixes/modules/raw_rec/../../src/chdk-dng.c:207: error: initializer element is not constant
/Users/scrax/magic-lantern-fixes/modules/raw_rec/../../src/chdk-dng.c:207: error: (near initialization for ‘exif_ifd[5].offset’)
/Users/scrax/magic-lantern-fixes/modules/raw_rec/../../src/chdk-dng.c:208: warning: cast from pointer to integer of different size
/Users/scrax/magic-lantern-fixes/modules/raw_rec/../../src/chdk-dng.c:208: error: initializer element is not constant
/Users/scrax/magic-lantern-fixes/modules/raw_rec/../../src/chdk-dng.c:208: error: (near initialization for ‘exif_ifd[6].offset’)
/Users/scrax/magic-lantern-fixes/modules/raw_rec/../../src/chdk-dng.c:209: warning: cast from pointer to integer of different size
/Users/scrax/magic-lantern-fixes/modules/raw_rec/../../src/chdk-dng.c:209: error: initializer element is not constant
/Users/scrax/magic-lantern-fixes/modules/raw_rec/../../src/chdk-dng.c:209: error: (near initialization for ‘exif_ifd[7].offset’)
/Users/scrax/magic-lantern-fixes/modules/raw_rec/../../src/chdk-dng.c:210: warning: cast from pointer to integer of different size
/Users/scrax/magic-lantern-fixes/modules/raw_rec/../../src/chdk-dng.c:210: error: initializer element is not constant
/Users/scrax/magic-lantern-fixes/modules/raw_rec/../../src/chdk-dng.c:210: error: (near initialization for ‘exif_ifd[8].offset’)
/Users/scrax/magic-lantern-fixes/modules/raw_rec/../../src/chdk-dng.c:211: warning: cast from pointer to integer of different size
/Users/scrax/magic-lantern-fixes/modules/raw_rec/../../src/chdk-dng.c:211: error: initializer element is not constant
/Users/scrax/magic-lantern-fixes/modules/raw_rec/../../src/chdk-dng.c:211: error: (near initialization for ‘exif_ifd[9].offset’)
/Users/scrax/magic-lantern-fixes/modules/raw_rec/../../src/chdk-dng.c:214: warning: cast from pointer to integer of different size
/Users/scrax/magic-lantern-fixes/modules/raw_rec/../../src/chdk-dng.c:214: error: initializer element is not constant
/Users/scrax/magic-lantern-fixes/modules/raw_rec/../../src/chdk-dng.c:214: error: (near initialization for ‘exif_ifd[12].offset’)
/Users/scrax/magic-lantern-fixes/modules/raw_rec/../../src/chdk-dng.c:215: warning: cast from pointer to integer of different size
/Users/scrax/magic-lantern-fixes/modules/raw_rec/../../src/chdk-dng.c:215: error: initializer element is not constant
/Users/scrax/magic-lantern-fixes/modules/raw_rec/../../src/chdk-dng.c:215: error: (near initialization for ‘exif_ifd[13].offset’)
/Users/scrax/magic-lantern-fixes/modules/raw_rec/../../src/chdk-dng.c:216: warning: cast from pointer to integer of different size
/Users/scrax/magic-lantern-fixes/modules/raw_rec/../../src/chdk-dng.c:216: error: initializer element is not constant
/Users/scrax/magic-lantern-fixes/modules/raw_rec/../../src/chdk-dng.c:216: error: (near initialization for ‘exif_ifd[14].offset’)
/Users/scrax/magic-lantern-fixes/modules/raw_rec/../../src/chdk-dng.c:217: warning: cast from pointer to integer of different size
/Users/scrax/magic-lantern-fixes/modules/raw_rec/../../src/chdk-dng.c:217: error: initializer element is not constant
/Users/scrax/magic-lantern-fixes/modules/raw_rec/../../src/chdk-dng.c:217: error: (near initialization for ‘exif_ifd[15].offset’)
/Users/scrax/magic-lantern-fixes/modules/raw_rec/../../src/chdk-dng.c: In function ‘create_dng_header’:
/Users/scrax/magic-lantern-fixes/modules/raw_rec/../../src/chdk-dng.c:284: warning: cast from pointer to integer of different size
/Users/scrax/magic-lantern-fixes/modules/raw_rec/../../src/chdk-dng.c:366: warning: cast to pointer from integer of different size
/Users/scrax/magic-lantern-fixes/modules/raw_rec/../../src/chdk-dng.c:395: warning: cast to pointer from integer of different size
lipo: can't figure out the architecture type of: /var/folders/93/ygydrxys37s1s77l9f05m5hw0000gn/T//cc4X1vSY.out
make: *** [raw2dng] Error 1
MacBook-Pro-di-scrax:raw_rec scrax$ make
[ GCC ] raw2dng
[ GCC ] raw2dng
../lv_rec/raw2dng.c: In function ‘main’:
../lv_rec/raw2dng.c:33: warning: format ‘%d’ expects type ‘int’, but argument 3 has type ‘long unsigned int’
../lv_rec/raw2dng.c:33: warning: format ‘%d’ expects type ‘int’, but argument 3 has type ‘long unsigned int’
../lv_rec/raw2dng.c: In function ‘main’:
../lv_rec/raw2dng.c:33: warning: format ‘%d’ expects type ‘int’, but argument 3 has type ‘long unsigned int’
../lv_rec/raw2dng.c:33: warning: format ‘%d’ expects type ‘int’, but argument 3 has type ‘long unsigned int’
[ GCC ] raw2dng
ld: warning: ignoring file chdk-dng.o, file was built for i386 which is not the architecture being linked (x86_64): chdk-dng.o
MacBook-Pro-di-scrax:raw_rec scrax$ ./raw2dng /Users/scrax/Movies/raw\ tests/M0000000.RAW
Error: sizeof(lv_rec_file_footer_t) = 200, should be 192
raw2dng: FORCE
$(call build,GCC,gcc -c $(SRC_DIR)/chdk-dng.c -m32 -O2 -Wall -I$(SRC_DIR) -arch i386)
$(call build,GCC,gcc -c ../lv_rec/raw2dng.c -m32 -O2 -Wall -I$(SRC_DIR) -arch i386 -arch x86_64 -D_FILE_OFFSET_BITS=64)
$(call build,GCC,gcc raw2dng.o chdk-dng.o -o raw2dng -lm -m32 -arch i386 -arch x86_64)
beta 0.4 (https://bitbucket.org/600dplus/magic-lantern-things/downloads/raw2dng.app.0.4.zip) is out with a first test for folder support, report any bugs found.
I think the reason the footer is of a different size on 64-bit Mac OS is because the pointer type is now 8 bytes wide and 8 byte aligned. raw_info has a pointer as the second field in the struct. The compiler skips 4 bytes to align the pointer to the next 8-byte word and it is 8 bytes wide. This would account for the size being 8 bytes off. Maybe changing the void* to an unsigned int might fix the alignment. Not sure what casting that will affect elsewhere. I will try later if I can find some time.
If compiled with chdk-dng.c in 32bit and raw2dng.c in 64bit I have a different error than not a raw file:Code: [Select]MacBook-Pro-di-scrax:raw_rec scrax$ make
[ GCC ] raw2dng
[ GCC ] raw2dng
../lv_rec/raw2dng.c: In function ‘main’:
../lv_rec/raw2dng.c:33: warning: format ‘%d’ expects type ‘int’, but argument 3 has type ‘long unsigned int’
../lv_rec/raw2dng.c:33: warning: format ‘%d’ expects type ‘int’, but argument 3 has type ‘long unsigned int’
../lv_rec/raw2dng.c: In function ‘main’:
../lv_rec/raw2dng.c:33: warning: format ‘%d’ expects type ‘int’, but argument 3 has type ‘long unsigned int’
../lv_rec/raw2dng.c:33: warning: format ‘%d’ expects type ‘int’, but argument 3 has type ‘long unsigned int’
[ GCC ] raw2dng
ld: warning: ignoring file chdk-dng.o, file was built for i386 which is not the architecture being linked (x86_64): chdk-dng.o
MacBook-Pro-di-scrax:raw_rec scrax$ ./raw2dng /Users/scrax/Movies/raw\ tests/M0000000.RAW
Error: sizeof(lv_rec_file_footer_t) = 200, should be 192
I think the reason the footer is of a different size on 64-bit Mac OS is because the pointer type is now 8 bytes wide and 8 byte aligned. raw_info has a pointer as the second field in the struct. The compiler skips 4 bytes to align the pointer to the next 8-byte word and it is 8 bytes wide. This would account for the size being 8 bytes off. Maybe changing the void* to an unsigned int might fix the alignment. Not sure what casting that will affect elsewhere. I will try later if I can find some time.
i can`t open the DNG files !
mac osx 10.7 + cameraraw 8.1 (newest update)
will not open the DNG´S !
any ideas ???
Scrax please check http://www.magiclantern.fm/forum/index.php?topic=5247.1375 post #1376.
The guy might have found a way to fix 2gb limit.
Just tested 0.5 on a 3gig file.. works here. Thanks Scrax!:)
I'm testing it ;)
EDIT: Seems working! is generating something :D
will update to 0.5 in a few minutes
Perfect! Mad props scrax and rodobot for getting this working. I did a batch with one file over 2Gb, it's good for any size now yeah?
doin it nowGreat!
system disk is full :-[ time to get that raid array. I recorded a 60Gb file on my 64Gb card and was going to stop recording @ 60Gb but it stopped automatically @ 60 and is 62Gb in length. Not sure if it's gonna be corrupted, just moving some files around first.
I like to break stuff, it's one thing I'm good at.;D
Just converted a 15.83GB file.. Thanks again Scrax, rodobot, A1ex, and all ML team. :)
Good to hear that, meanwhile I've recompiled from last source and now dng extracted from my raw can't be opened anymore in ACR, some changes in chdk-dng.c maybe broke it. Once solved will update the app to keep it up to date with last code changes
Is this another one since the 0.5 that I tested?Yes, 0.5 code was updated 18.05.2013 but with the 4Gb fix added today
Good to hear that, meanwhile I've recompiled from last source and now dng extracted from my raw can't be opened anymore in ACR
Tried a 52Gb file
/Applications/raw2dng.app/Contents/Resources/script: line 10: /bin/ls: Argument list too long
Nothing converted
:'(
It's being looked at, nobody's figured out how to do it yet.
The app only ballooned with the 52Gb file (twice). Saving to the app isn't a feature, it's a bug triggered by the 52Gb file, everything 42Gb and under is being saved where it's supposed to be. I haven't tested between 42 and 52Gb.I suppose that for the 52Gb it converted most of the stuff but since the dng are moved after finishing conversion they were not moved out from the app
It's quite slow with the larger files so a 64bit version would be a welcome addition.
Scrax - may need to replace "ls" with "find" or something similar?where? I don't get the difference but explain me more please, since probably it could be improved a lot.
I found this for the Cinema DNG's related tags : http://wwwimages.adobe.com/www.adobe.com/content/dam/Adobe/en/devnet/cinemadng/pdfs/CinemaDNG_Format_Specification_v1_1.pdf
To solve that wee need to investigate more the issue, so far I se two problems one is the swallowing of the app and another is the error from raw2dng, for the first I'll try to save dng in the final folder directly, but I don't know yet how.
*** Warning: IFD 0 Model is not NULL terminated ***
*** Warning: IFD 0 UniqueCameraModel is not NULL terminated ***
I don't get those with dng_validate, can you send me a broken dng?
It worked :) I just opened a 60Gb file. Thx Captain
This is the wrong thread i think, but cinemaDNG can simply be a folder of DNG files with sequential numbers so the spec that needs to be followed in just the plain DNG spec.
http://wwwimages.adobe.com/www.adobe.com/content/dam/Adobe/en/products/photoshop/pdfs/dng_spec_1.4.0.0.pdf
Currently using dng_validate (which is in the DNG SDK) gives these errors with DNG's from raw2dng which i've already let a1ex know about (this thread is about an OSX wrapper for that app):
*** Warning: IFD 0 Model is not NULL terminated ***
*** Warning: IFD 0 UniqueCameraModel is not NULL terminated ***
*** Warning: The ExposureTime is <= 0 ***
*** Warning: Too little padding on left edge of CFA image (possible interpolation artifacts) ***
*** Warning: Too little padding on top edge of CFA image (possible interpolation artifacts) ***
*** Warning: Too little padding on right edge of CFA image (possible interpolation artifacts) ***
*** Warning: Too little padding on bottom edge of CFA image (possible interpolation artifacts) ***
If there is a way for the DNG to be recognized in Da Vinci Resolve, the workflow would Become the same as the BMCC and could be used to make feature films. But it's more complicated if you have to go through Photoshop and After Effects before the editing.
This is using Scrax's app 0.5 - which i think he said uses and older raw2dng compile? Maybe you've fixed and it's not in Scrax's share yet, but here's a file anyway i just converted:
Hi scarx,
Thanks so much for the lightning fast development of an easy to use app that now seems very solid!
One thing though: You write Known Issues: None, but there's still that thing with the dng's not being cinemaDNG's. I just wanted to make sure you guys are aware of the importance of this part about the files being less easy to handle that way. Being able to import them into Resolve would make a huge difference for many as it would not only improve and enhance the workflow, but also make it a more professional solution in terms of consistency and file generations/handling.
Or is the issue somewhere else?
Thanks anyway for providing this great solution so far.
Your are right, the dng file are generated by raw2dng (developed by Alex) that's inside the raw2dng.app package so this is something that need to be solved there, the know issue are relative to the GUI wrapper that do the work of starting the command line tool for the raw dragged in.
Added it to first topic
I think alex is already working on it. I can't test that problem because don't know Resolve and all those raw video procedures with proxies and so on.
What is the basic raw video workflow?
RAW to DNG
folder that should be cinemaDNG
Editing software
I saw that there is a win batch converted that converts to tiff and makes proxy but didn't get why or what they are.
And there is a light version of Da Vinci Resolve which is free and can handle 1920 X 1080 resolution. So, perfect to test the Cinema DNG compatibility ;-)
I think in the first DNG file, there is the content of the metadata Cinema (Time Code, Frame Rate, T-Stop, Reel Name, Camera Label) + photo metadata record.
I think the cinemaDNG discussion belongs in this thread:
http://www.magiclantern.fm/forum/index.php?topic=5404.0
Not in BMCC DNG's.. each DNG just contains some of the DNG Tags as described in the DNG spec here (section 4):
http://wwwimages.adobe.com/www.adobe.com/content/dam/Adobe/en/products/photoshop/pdfs/dng_spec_1.4.0.0.pdf
They also use TIFF Tag 51043 for timecode and 51044 for framerate as defined in cinemaDNG spec:
http://wwwimages.adobe.com/www.adobe.com/content/dam/Adobe/en/devnet/cinemadng/pdfs/CinemaDNG_Format_Specification_v1_1.pdf
@Scrax - Registration for Resolve Lite can be filled in with any details, you don't have to be a customer. :)
i have been trying to find info on how to create CinemaDNG... since its open source everything seems available freely
adobe official page with white papers and specs: http://www.adobe.com/devnet/cinemadng.html
some interesting discussion about converting dng to cinemadng : http://forums.creativecow.net/thread/277/22358
im no coder but im trying hard to figure it out...it must be really a difference in metadata xmp data
The CinemaDNG Discussionthanks for the link it was really needed, will put it in the first topic
http://www.magiclantern.fm/forum/index.php?topic=5618.msg39228;topicseen#msg39228
Yes I were to download it but they asked registration. :)
This is fantastic! It's been able to handle everything I've thrown at it.
I would love to be able to set a destination for the output. That way I could read the RAW files straight off of the card and send the DNGs right into my hard drive. With the command line app, I would simply browse to the directory I wanted to files to be dumped into, and run the app from there. Worked like a charm.
Thanks for this Tool.
I have some complaints: I don't think it's very elegant to put the Converted Files into the Raw2Dng.app itself and copy them later... Converting Raw on external Drive - and everything gets copied twice, once to my System HD (Which is not thaat Big - SSD), and then back to drive. Sound like a hack to me ;-)
This as well messes things up, if one wants to convert multiple Raw at the same time, since they overwrite each others results...
Can't it be made that the conversion happens where the RAW file is? (without copying stuff)
This copy thing as well causes my Mac to freeze occasionally.. ;-)
That's a ridiculous workflow suggestion ;-) Why should i copy the App seven times to make seven Raw conversions (at the same time)? lol
Why does it need to copy the Dng at all? the raw2dng in terminal allows direct conversion, not? (raw2dng input output)
I have some complaints: I don't think it's very elegant to put the Converted Files into the Raw2Dng.app itself and copy them later... Converting Raw on external Drive - and everything gets copied twice, once to my System HD (Which is not thaat Big - SSD), and then back to drive. Sound like a hack to me ;-)
This as well messes things up, if one wants to convert multiple Raw at the same time, since they overwrite each others results...
Can't it be made that the conversion happens where the RAW file is? (without copying stuff)
This copy thing as well causes my Mac to freeze occasionally.. ;-)
Ok, great, thanks.
cool job.
Ok, the new version with the conversion directly inside the destination folder should work in 0.9 (https://bitbucket.org/600dplus/magic-lantern-things/downloads/raw2dng.app.0.9.zip), please test it and report back.
Worked perfectly! Didn,t try it with any larger files but should work fine. Very good workGood, since raw2dng is the same as 0.8 file size don't matter for testing it, thank's.
How can I batch convert multiple files to dng? Also, is there a way with other software to batch convert the dngs to tiff or similar?
I'm getting a couple errors that cause the app not to function if it's in a directory leading up to it's containing folder that contains a space in the name. For example: If have the app here "/Applications/RAWApps", it's fine. If it's here "/Applications/Magic Lantern/RAWApps" (space in Magic Lantern", no dice. This didn't occur with earlier versions. Aside from that, still handles the .RAWs like a champ.will try to reproduce and fix
Keep up the good work!
Ok, here is the INIT Code that works in all Cases:
INIT
for i in $*
do
if [ -d "$i" ]; then
FILES_FLDR=$i/
echo "SEARCHING: $FILES_FLDR"
checkFLDR
elif [ -f "$i" ]; then
file_is=$i
importFILE
else
echo "Drop a ML .RAW video file and/or folder here"
fi
done
exit 0
@scrax, would you mind testing it, and if it works maybe put it in app if you like?
0.9 does not work in my setup..
i have the raw2dng app in my dropbox folder, linked with my finder window (i can see the appicon in in the top of every finder window)
and when i drag my folders to the icon raw2dng0.8 worked as expected, but 0.9 did not convert the files (but created the dirs)
thx
INIT
for i in $*
do
if [ -d "$i" ]; then
FILES_FLDR=$i/
echo "SEARCHING: $FILES_FLDR"
checkFLDR
elif [ -f "$i" ]; then
file_is=$i
importFILE
else
echo "Drop a ML .RAW video file and/or folder here"
fi
done
exit 0
@scrax, would you mind testing it, and if it works maybe put it in app if you like?
Have you try this open source? I´m not programmer, maybe you can get something about it: http://www.squared5.com/svideo/mpeg-streamclip-mac.htmldidn't tried and from the site I can't find any source or opensource license, it's free but not open for what I could understand.
It´s free for mac , windows and linux.
Hi scrax,
I've been trying to edit the raw2dng app to allow me to choose a destination folder for the DNG shot folders (to save me copying the .RAW files from the CF card, and instead just extract the DNGs directly into a folder on my hard drive).
Have you got any pointers for how to edit the app in interface builder? I'm fine with the unix script, as long as there's a way to grab a chosen file path value from the GUI and use it in the script.
Thanks, will give that a look :)basically you should add cocoadialog.app in the package and putt something like this in the script
INIT() {
echo "raw2dng converter GUI for OsX"
echo "Beta ver.0.10"
#Make raw2dng working from any folder
#export PATH="$PATH":"$(pwd)"
mybin="$(pwd)"/
CD="CocoaDialog.app/Contents/MacOS/CocoaDialog"
rv=`$CD fileselect \
--text "Choose a folder where to import and save converted file. Now set: $workingDIR" \
--with-directory $HOME/ \
--select-only-directories`
if [ -n "$rv" ]; then
workingDIR="$rv"/
printf "Working folder: %s\n" $workingDIR
fi
}
importFILE() {
if [ "${file_is: -4}" == ".RAW" ] ; then
echo "$file_is File Supported"
name=$(basename -s .RAW "$file_is")
fldr="$(dirname "$file_is")"/
if [ "$workingDIR" ] ; then
fldr="$workingDIR"
mv "$file_is" "$workingDIR$name".RAW
fi
if [ ! -d "$fldr$name" ] ; then
mkdir "$fldr$name"
fi
cd "$fldr$name"
"$mybin"raw2dng "$fldr$name".RAW
#find . -type f -name "*.dng" -print | \
#while read filename
#do
# mv "${filename}" "$fldr$name"/
#done
else
echo "$file_is File not Supported"
fi
}
Hi alex.
When i compare (in the upper left corner between the windows) the raw photo and the raw dng i can identify vertical lines in the dng. When you are ok with that i am too, but i can see them..
Greets and thx you so much for your time and effort.
sw
I understand. But I'm a mac user, and would love to have it for me and my kind. ;-)I'll upload a new version later, didn't noticed that change
Scrax, your work is incredible, I have been using raw2dng.app since it's first beta, and the progress is truly amazing (also thank you to captain hook and the others who helped with dev).
Chmee is currently working on a cinemadng converter and is getting some workable cdngs imported to resolve on a pc.
Scrax, any plans to port this to mac?
Here's the link for the thread http://www.magiclantern.fm/forum/index.php?topic=5618.25
As always, thank you all for your hard work.
mono and then drop raw2cdng.exe in the terminal window you should end with something like this:mono /Users/scrax/Downloads/raw2cdng.0.99.exepress enter and the app should load.
Code: [Select]monoand then drop raw2cdng.exe in the terminal window you should end with something like this:Code: [Select]mono /Users/scrax/Downloads/raw2cdng.0.99.exepress enter and the app should load.
/Users/sicetime/Downloads/misc-master/raw2cdng.0.99.exe: cannot execute binary file any ideas?
Jun 3 14:01:16 Andrew-Siceloffs-MacBook-Pro.local mono[1455] <Error>: kCGErrorInvalidConnection: CGSGetWindowTags: Invalid connection
Jun 3 14:01:16 Andrew-Siceloffs-MacBook-Pro.local mono[1455] <Error>: kCGErrorFailure: Set a breakpoint @ CGErrorBreakpoint() to catch errors as they are logged.
scrax that worked perfectly. got it running on parralels too. I get these errors though, have you been able to process things? I am at work currently but will be testing soon and don't have any raw files here.I have the seame errors and files generated have wrong names but if you convert hem to 16 bit they will be visible in preview so i think it works. Probably in parallels you will have no problem with files namesCode: [Select]Jun 3 14:01:16 Andrew-Siceloffs-MacBook-Pro.local mono[1455] <Error>: kCGErrorInvalidConnection: CGSGetWindowTags: Invalid connection
Jun 3 14:01:16 Andrew-Siceloffs-MacBook-Pro.local mono[1455] <Error>: kCGErrorFailure: Set a breakpoint @ CGErrorBreakpoint() to catch errors as they are logged.
Last week and monday I had no issues with RAW. Shot a video yesterday and now Lightroom/Photoshop won't read any of the files. Is this a raw2dng problem that I might fix by reconverting from a PC instead of the mac side? I'm using .10I had that problem some time ago when updating 0.4 IIRC, have you updated ML since last week?
Will upload a new app with the last raw2dng bin with vertical banding in a few hours
Have you updated ML since last week?
I'm not sure to have understood right, I suppose was ML making wrong raw and not raw2dngI'm not really sure where the problem is lying. All I know is that I took a new clip and it was fine in the current raw2dng.
I'm not really sure where the problem is lying. All I know is that I took a new clip and it was fine in the current raw2dng.Once I got that problem to but solved updating from source, so now you have some dng that can't be opened and not anymore the raw file?
Once I got that problem to but solved updating from source, so now you have some dng that can't be opened and not anymore the raw file?
btw
/doing last test and refinement to 0.11
Will upload a new app with the last raw2dng bin with vertical banding in a few hours, also added jpg and avi converter. i have no clue if they will be useful to somebody so post your opinions, but keep in mind that for raw2dng I prefer to keep it without options to keep it simple to use.
I had that problem some time ago when updating 0.4 IIRC, have you updated ML since last week?
Hey Scrax! How are you buddy? Just tested the latest version with 32gb file and this is what I got:
raw2dng converter GUI for OsX
Beta ver.0.11
M05-1921 File Supported
Generating jpg preview
dyld: Library not loaded: /usr/local/lib/libexiv2.10.dylib
Referenced from: /Users/KMA_WWC/Desktop/RAWToDNG/raw2dng.app/Contents/Resources/ufraw-batch
Reason: image not found
/Users/KMA_WWC/Desktop/RAWToDNG/raw2dng.app/Contents/Resources/script: line 31: 1674 Trace/BPT trap: 5 "$UFRAW" --out-type=jpg --out-path=../"$FILE_NAME"_jpg *.dng >> "$LOG"
Generating avi preview
dyld: Library not loaded: /usr/local/Cellar/ffmpeg/1.1.3/lib/libavdevice.54.dylib
Referenced from: /Users/KMA_WWC/Desktop/RAWToDNG/raw2dng.app/Contents/Resources/ffmpeg
Reason: image not found
/Users/KMA_WWC/Desktop/RAWToDNG/raw2dng.app/Contents/Resources/script: line 31: 1676 Trace/BPT trap: 5 "$FFMPEG" -i ../"$FILE_NAME"_jpg/%6d.jpg -vcodec mjpeg -qscale 1 ../"$FILE_NAME".avi >> "$LOG"
Is this normal? It also created txt log file inside the dng folder, and also created separate empty jpeg folder. Not sure if its ok or not, but just wanted to report it.
Nicely done with the update. Now, I had a dream last night about adding ProResHQ 422 or 444 and cinema DNG to the jpg and avi converter ;). Would that be possible?
Thanks again Scrax, for the app of the year
//D
On 29 October 2011, FFmpeg introduced a free encoder, enabling ProRes 422 encoding on all FFmpeg supported platforms.
"$FFMPEG" -i ../"$FILE_NAME"_jpg/%6d.jpg -vcodec mjpeg -qscale 1 ../"$FILE_NAME".avi
and change it to that: "$FFMPEG" -i ../"$FILE_NAME"_jpg/%6d.jpg -vcodec prores -profile:v 3 -qscale:v 1 ../"$FILE_NAME".mov
I've already updated the code for using already installed tools, will add dcraw.
I've an idea for add a way to open an options menu. Maybe here we can let user chose default workflow:
So far they could be:
1. Only raw2dng (simple/default)
2. dng, tiff prores (prores)
3. dng, tiff jpg prores mjpg (all)
4. toggle use dcraw or ufraw
5. Set work folder (to import and convert from card)
Hi. Thanks so much for your continued work on this.Can you check if with 0.10 they are correct using the same .RAW
This version breaks the 5D2 metadata -- .dng files open up as Camera model "Canikon" in Photoshop on Mac, and picture styles are no longer available.
For reference, here are the metadata tags from a v0.10 that correctly identify the 5D2:
Make : Canon
Model : Canon EOS 5D Mark II
UniqueCameraModel : Canon EOS 5D Mark II
If you can include these again in the next compile, that would be fabulous.
Thank you!
the jpg folder is empty because of ffmpeg error
Can you check if with 0.10 they are correct using the same .RAW
I just checked on the same raw file and yes, the older version that I have adds the 5d2 metadata, whereas 0.11 does not. Thomas Worth on the RawMagic thread indicated that there is no camera metadata in the actual .RAW files. So it would seem that the older version that I'm using must have "Canon 5D Mark II" hard-coded. This may be a custom version that was uploaded at one point just for the 5D2.
If that is indeed the case, it would be great if Raw2DNG had some kind of drop-down to specify which camera you're using, so it could set the correct metadata.
Eventually, the best solution would be for the .RAW files themselves to be set with the correct metadata at capture time -- camera model, white balance, and so forth. Of course everybody's plate is pretty full right no, so we'll get there when we get there.
Anyway thanks again for your work on this!
Hi, thanks for this GUI its been great so far...can you post somewhere the log and where you have raw2dng.app and the raw file (full addres),is strange that someone can use 0.11 and someothers have problem generating the .dng, but could be that in the clean-up I've made some typos. will try to find the problem tomorrow and post a 0.12 withthe lates rawa2dng sources
However, with the latest 60D compile v.11 just produces empty folders - both DNG & JPEG (but Jpeg was always like this).
In the DNG folder it has produced a log file & it has the normal stuff on it, apart from it just says processing file 1 of 129 & then nothing else...
I have reverted back to v.10 & it works just fine...strange?!
Hi Scrax! I see Alex updated the rawtodng.exe today, some kind of purple fringing issue? Are those issues exactly the same on your app? Are you using the same source coed for both mac and windows?
can you post somewhere the log and where you have raw2dng.app and the raw file (full addres),is strange that someone can use 0.11 and someothers have problem generating the .dng, but could be that in the clean-up I've made some typos. will try to find the problem tomorrow and post a 0.12 withthe lates rawa2dng sources
for f in "$@"; do shell script
cd $f
/opt/local/bin/dcraw -c -H 0 -6 -W -q 3 -S 13000 -a -o 1 ******.dng | /opt/local/bin/ffmpeg -f image2pipe -vcodec ppm -r 24 -i pipe:0 -vcodec prores_kostya -profile:v 3 -qscale:v 5 -vendor ap10 -pix_fmt yuv422p10le -threads 4 -y -r 24 $f/ProResHigh.mov
echo "$f converted"
done@scrax
there is away to convert from dng directly to video, without saving images. Using PIPE function. I'm new to this stuff, so i don't really know much about, but here a shell script that works:Code: [Select]for f in "$@"; do shell script
cd $f
/opt/local/bin/dcraw -c -H 0 -6 -W -q 3 -S 13000 -a -o 1 ******.dng | /opt/local/bin/ffmpeg -f image2pipe -vcodec ppm -r 24 -i pipe:0 -vcodec prores_kostya -profile:v 3 -qscale:v 5 -vendor ap10 -pix_fmt yuv422p10le -threads 4 -y -r 24 $f/ProResHigh.mov
echo "$f converted"
done
input $@ in this case folders with the dng
the important thing is in draw the "-c" = Write image data to standard output
and in ffmpeg the "-f image2pipe -vcodec ppm" and the " -i pipe:0"
This way is faster plus it does not need that much disk space.
dcraw -c -H 0 -6 -W -q 3 -S 13000 -a -o 1 ******.dng | ffmpeg -f image2pipe -vcodec ppm -r 24 -i pipe:0 -vcodec prores_kostya -profile:v 2 -qscale:v 6 -vendor ap10 -pix_fmt yuv422p10le -y -r 24 ProResHigh.mov &Latest version of raw2dng not working with the latest compile of MLI've compiled a new raw2dng from source I suppose recent changes broke it., time to goto 0.12
I drag the folder(or individual file) onto the app, it starts to process but only takes a fraction of a second for each raw. Creates both the dng and jpg folders, and they're both empty
as addition: if we add a & behind it it gets even faster since all the conversion is done simultaneously with background jobs. (tried to explain as good as possible)so far the other code can generate the mov but it's empty, i need to make some more test.
so in my example it looks like:Code: [Select]dcraw -c -H 0 -6 -W -q 3 -S 13000 -a -o 1 ******.dng | ffmpeg -f image2pipe -vcodec ppm -r 24 -i pipe:0 -vcodec prores_kostya -profile:v 2 -qscale:v 6 -vendor ap10 -pix_fmt yuv422p10le -y -r 24 ProResHigh.mov &
(i removed the -threads 4 from ffmpeg too - doesn't make sense anymore)
a concern for me is still how to set proper White balance and avoid the automatic there...
convert_file() {
cd "$FLDR$FILE_NAME"_dng
"$RAW2DNG" "$FLDR$FILE_NAME".RAW
/opt/local/bin/dcraw -c -H 0 -6 -W -q 3 -S 13000 -a -o 1 *.dng | /usr/local/bin/ffmbc -f image2pipe -vcodec ppm -r 24 -i pipe:0 -vcodec prores -profile hq -b 120M -pix_fmt yuv444p10 -y -r 24 "$FILE_NAME".mov & >> "$LOG"
}convert_file() {
cd "$FLDR$FILE_NAME"_dng
"$RAW2DNG" "$FLDR$FILE_NAME".RAW
/opt/local/bin/dcraw -c -H 0 -6 -W -q 3 -a -o 1 *.dng | /usr/local/bin/ffmpeg -f image2pipe -vcodec ppm -r 24 -i pipe:0 -vcodec prores_kostya -profile:v 2 -pix_fmt yuv444p10 -y -r 24 "$FILE_NAME".mov & >> "$LOG"
}can the ones of you that have issues please do the following:
-right-click on raw2dng.app and select "Show Package Contents"
go to raw2dng.app/Contents/MacOS/
and double-click raw2dng there
this will start raw2dng together with a terminal console
now drag-drop your .raw file on it
look at the Terminal Console and copy/paste the stuff that is output there into here as a comment
this gives at least the chance of seeing where the problem is.
Hey guys, dont know if this was mentioned before, but:Hi, download (free) Adobe DNG Converter from the Adobe website (Windows and Mac versions) and use it to process your files into camera raw DNG files which Aperture can import and process.
Had no problem converting to dng, but I use the program Aperture, not Photoshop. When I try to open the files in Aperture, It says that the file format is unrecognized.
Solutions?
Hey, I have noticed that our the raw2dng.app inserting vertical lines into digital negatives. If i export in Apple Pro Res 4444, the vertical lines are still present, but if I convert the dng .RAW video sequence into an h.264 mp4 video file, it compresses them away.
I am not sure if this is our Mark III sensor, or an issue with compression.
It's a sensor issue and we're not sure what causes it. The strange thing is it doesn't affect every 5D, I've never had a problem with it. http://www.magiclantern.fm/forum/index.php?topic=5614.0
New version uploaded, updated the app with last bin (so it should work with also latest ML generated raw files). ffmpeg and dcraw should work now. link (https://bitbucket.org/600dplus/magic-lantern-things/downloads/raw2dng.app.0.12.zip)
For vertical lines latest ML code and 0.12 should fix it
New version uploaded, updated the app with last bin (so it should work with also latest ML generated raw files). ffmpeg and dcraw should work now. link (https://bitbucket.org/600dplus/magic-lantern-things/downloads/raw2dng.app.0.12.zip)
For vertical lines latest ML code and 0.12 should fix it
Thanks Scrax! It,s working fine :). Good work. The ProRes looks fine. Also the white balance issue seems fine. Is the white balance information recorded from what you see in the camera to the ProRes files?
I got a few questions. When I remove the dcraw and ffmpeg from your app, It simply converts the dng;s again. Is that the way I should do if I want to skip the ProRes part? Sometimes only the dng,s would be enough.
Also, is there an alternative If I simply only wants the ProRes files and skip the dng,s? Also, what bitrate and quality is the ProRes in? 422HQ, 444?
A lot of questions, I know. Still, I believe this is one of the best converters out there.
Thanks a lot Scrax!
//D
off topic
Could someone explain or link me to how to convert spanned files on the rawtodng converter? Seem that I,ve missed that part of my raw-education lessons ;).
convert_file() {
cd "$FLDR$FILE_NAME"_dng
"$RAW2DNG" "$FLDR$FILE_NAME".RAW > r2dlog.txt
FPS=`awk '/FPS/ { print $3; }' "$FLDR$FILE_NAME"_dng/r2dlog.txt`
rm r2dlog.txt
printf "Generating ProResHQ 422\n"cat drop_first.RAW drop_other.R00 again_with.R01 and_so_on.R02 >> merged.RAWcat is the command used to merge the files, then you have to drop them in the correct order into the terminal window so they will have the correct addressWhite Balance currently uses dcraw automatic - quite ok in lot of cases - not in all...
unfortunately ml does not seem to be record WB in Raw...
the ProRes is about 422HQ with qscale 5 - about 76MBit/s - but it is somewhat dependend on input.
@scrax: to get FPS out of raw2dng:Code: [Select]convert_file() {
cd "$FLDR$FILE_NAME"_dng
"$RAW2DNG" "$FLDR$FILE_NAME".RAW > r2dlog.txt
FPS=`awk '/FPS/ { print $3; }' "$FLDR$FILE_NAME"_dng/r2dlog.txt`
rm r2dlog.txt
printf "Generating ProResHQ 422\n"
and then in ffmpeg replace the two -r 24 by -r $FPS
there might be a way without saving r2dlog...
i have been playing around with gui creation based on your script - there is pasha to make ui from script. I have it working here with Image preview and manual WB and some more options.
Included ffmbc and dcrawU (i guess U means universal?), tried to build with static libs (no idea if it worked ;-)
https://www.dropbox.com/s/gxm2vvdtbjxl9tl/r2v.zip (https://www.dropbox.com/s/gxm2vvdtbjxl9tl/r2v.zip)
i have seen you started with white balance option and cocoadialog... (I will get the rgbg multipliers for the 5d III, can send them to you)
My hard drives are getting full. Im recording, but unable to actually convert anything0.12 works?
downloading now, Good to hear that you are working on this too :)
do you think it will be better to have a repo to share our code?
TO DO:
Extract dead pixel list from dng and use it in dcraw to remove dead pixels.
Dcraw wont read the dead pixel information from the source file but needs an external list file.
this is a feature request?Yes it is.
set_wb(){
"$CD" standard-dropdown \
--text "Pick a wb" --title "wb Options" --items "Auto" "Daylight" "Shade" "Cloudy" "Tungsten" "White Fluorescent"\
--string-output | tail -1 > wb.txt
wb=`awk ' { print $1; }' "$FLDR$FILE_NAME"_dng/wb.txt`
rm wb.txt
#Set rgb multiplier
if [[ $wb = Auto ]]
then
Wtemp="-a"
elif [[ $wb = *Daylight* ]]
then
Wtemp="-r 1.950195 1.000000 1.605469 1.000000"
elif [[ $wb = *Shade* ]]
then
Wtemp="-r 2.226562 1.000000 1.369141 1.000000"
elif [[ $wb = *Cloudy* ]]
then
Wtemp="-r 2.089844 1.000000 1.477539 1.000000"
elif [[ $wb = *Tungsten* ]]
then
Wtemp="-r 1.412109 1.000000 2.392578 1.000000"
elif [[ $wb = *White* ]]
then
Wtemp="-r 1.720703 1.000000 2.291016 1.000000"
fi
}
convert_file() {
cd "$FLDR$FILE_NAME"_dng
"$RAW2DNG" "$FLDR$FILE_NAME".RAW > r2dlog.txt
FPS=`awk '/FPS/ { print $3; }' "$FLDR$FILE_NAME"_dng/r2dlog.txt`
rm r2dlog.txt
set_wb
printf "Generating ProResHQ 422\n"
#find "$FLDR$FILE_NAME"_dng -type f -name "*.dng" -print | \
#while read dng
#do
"$DCRAW" -c -H 0 -6 $Wtemp -W -q 3 *.dng | "$FFMPEG" -f image2pipe -vcodec ppm -r $FPS -i pipe:0 -vcodec prores_kostya -profile:v 3 -vendor ap10 -pix_fmt yuv422p10le -y -r $FPS "$FLDR$FILE_NAME".mov
#done
printf "Done\n"
}
Yes it is.
All the 3x and 5x zoom mode raw recording have more than 5 dead pixels, at least on my camera.
It is funny that nobody else is seeing them. (or dont care)
To me red, green and blue pixels in video is a NO NO. :)
And manual removal is too painful process.
Adobe camera raw and Ufraw can read the dead (hot) pixel list from the source file but dcraw cant.
@scrax
here your script edited for fps and white balance dialog with cocoadialog working:
I've added fps as you suggested early, now I'm looking into a way for having some options to set, but they should be optional (for advanced use only).
set_pref(){
printf "Preference panel to be added!\n"
}
##### Main
if [[ ! "$1" ]]; then
usage
else
if [[ "$1" == *raw2dng.app ]]; then
set_pref
fi
#set_workdir
...
We should consider use pashua instead of cocoadialog and keep Platypus as wrapper. Pashua will be good for the preference page maybe.
Your app is working in making the dng, then it show the options for video rendering but video is not generated.
The big issue I see so far is that in batch conversion setting wb for each file will be not ideal.
My idea is that settings should be something that is related to app and not to raw file. For example if we enable ProRes conversion in settings all the file imported will be converted, if we set a working folder all file go in that folder and so on.
Things like wb, fps etc. should be automatic and right. Maybe ML could make a video.log of raw captures too like for normal video, and we can use that for finding out needed settings...
EDIT: I can open a settings dialog by dropping raw2dng.app into his window ;)Code: [Select]set_pref(){
printf "Preference panel to be added!\n"
}
##### Main
if [[ ! "$1" ]]; then
usage
else
if [[ "$1" == *raw2dng.app ]]; then
set_pref
fi
#set_workdir
...
Since we,re on the ProRes topic. Will the files contain similar dynamic range possibilities as with the dng,s? I compared the raw imported with the ginger plugin(trial) and the generated ProRes file. It seems contrasts and highlight information differs. Maybe one could get a flatter profile ProRes file somehow? The first three are the ginger plugin one and the other three are the ProRes. Might it be a white balance thing?
Hello and thank you for the new version of raw2dng. Just wanted to report that when the app is generating the prores file it doesn't seem to be able to make a file greater than 645 frames. Any else experienced this ?
Thank You Again !!
@Bashi
I just tried it again and now it seems to have converted the entire clip to a prores file. I'll try more and let you know if I discover anything.
just converted some files with 0.12 to me its worked pretty good... i still prefer to proRes4444 with AE. It would be amazing if we could batch convert with raw2dng and have the option to create just DNG's or DNG's and proRes... anyway its killing it. thanks guys!
we can do that. ;-)
so this would be prores 4444 12bit.
(until now i had some confusion with those pixel formats)
the option to make dng and/or video will come soon.
that's awesome thanks!!! its possible to batch convert multiple .RAW files with raw2dng? I went through a lot of time going one by one :P
Hi Guys, what kind of Pro Res is the file created by RAW2DNG: 422, 4444, LT? Because in Quicktime information only said the creator´s name. Thanks!
Is there a way to stop the program from making prores files?0.13 (https://bitbucket.org/600dplus/magic-lantern-things/downloads/raw2dng.app.0.13.zip)
Great program!
Is it possible to have this JUST convert to ProRes? Any chance we could select options for the ProRes output? It'd be great to get a ProRes 422 HQ option.
To open the options dialogs you have to double click raw2dng.app and then drop the app inside it's windows like if it was a raw file, the app will recognize it and open the options instead of trying to convert it ;)
0.13 (https://bitbucket.org/600dplus/magic-lantern-things/downloads/raw2dng.app.0.13.zip)will havehas an option to toggle it.
To open the options dialogs you have to double click raw2dng.app and then drop the app inside it's windows like if it was a raw file, the app will recognize it and open the options instead of trying to convert it ;)
Hm, nice idea, but the ProRes files I get are quite unusable. Correctly exposed RAW files turn into 3 stops underexposed .mov's that don't seem to have the color information needed to get them back up, results in extreme overall noise.
Also I'm not sure the automatic WB is needed since it should have been set correctly in camera, right? Only Green/Magenta Shift should be set to 0.
Thanks
Hm, nice idea, but the ProRes files I get are quite unusable. Correctly exposed RAW files turn into 3 stops underexposed .mov's that don't seem to have the color information needed to get them back up, results in extreme overall noise.
Also I'm not sure the automatic WB is needed since it should have been set correctly in camera, right? Only Green/Magenta Shift should be set to 0.
Thanks
VEry nice! I think it,s the gamma curve who gives a pretty hard contrast. It,s pretty simple to get it back in post as it,s ton of information in the ProRes444. An added alternative creating proxies could be nice for fast viewing and editing.
Thanks for all the develompment. Really good stuff
To open the options dialogs you have to double click raw2dng.app and then drop the app inside it's windows like if it was a raw file, the app will recognize it and open the options instead of trying to convert it ;)
No beans. Don't see the option to toggle.
just drag 'n drop all files on it, or folder containing them.
currently it's 422 HQ, but 4444 is possible and will be enabled.
App seems great, tho could the combining of the first .RAW with the subsequent .R00, .R01, .R02 be done automatically for all us 5Dmk2 users ? if so that would be super great ! Jso yeah any thoughts on auto joining the 5d2 4GB files?
Not sure if I was using an older raw2dng osx, but I grabbed it from the MKii thread. I was getting a green dot in the mov previews that raw2dng made. It was pretty annoying. I figured out that the actual dng files didn't have the green dot so if I followed the normal workflow (raw2dng->PS->QT7) then everything is fine. Is this a known issue or do I have the wrong version? The one I have says raw2dng converter GUI for 5D2 // Beta 1.0 ThanksWe never reached 1.0, is possible that it's rawmagic what you have?
so yeah any thoughts on auto joining the 5d2 4GB files?It's just a matter of finding time to code it, but it will be added in future release.
Thanks. James
Hi, Used 0.13. Computer says it can't open the prores sequence. It's not a video.0.12 works?
The end of the verbose inside the app:
"frame= 409 fps=1.7 q=0.0 size= 385499kB time=00:00:17.05 bitrate=185125.8kbits/s
/Applications/raw2dng0.13.app/Contents/Resources/script: line 40: 2216 Done "$DCRAW" -c -H 0 -6 -W -q 3 "$Wtemp" *.dng
2217 Segmentation fault: 11 | "$FFMPEG" -f image2pipe -vcodec ppm -r "$FPS" -i pipe:0 -vcodec prores_kostya -profile:v 3 -vendor ap10 -pix_fmt yuv444p10 -y -r "$FPS" "$FLDR$FILE_NAME".mov
Done"
If that can help you.
0.12 works?
Hello,
With 0.13 i activate in the options ProResHQ 4444, but the generated .mov is in ProRes 422 HQ (With cmd + i or in FCPX)
What i do wrong ?
Best regards
so yeah any thoughts on auto joining the 5d2 4GB files?
Thanks. James
You do nothing wrong. the movie is 4444, but it gets the wrong codec flag (its apch, shoult be ap4h) . this is an issue from ffmpeg. If you open the movie in vlc, you can see in info (cmd+i) decoded Format Planar 4:4:4 YUV. As well you can see the difference from 422 to 444 in some places, like very hard contrast, for example the canyon scene from lukas neumann. Not sure if this causes any problems - haven't found one.
Ok thanks for the info, in vlc 444 10 bits !
It exist a 14bits mov codecs ?
Best regards
Hi, Used 0.13. Computer says it can't open the prores sequence. It's not a video.
The end of the verbose inside the app:
"frame= 409 fps=1.7 q=0.0 size= 385499kB time=00:00:17.05 bitrate=185125.8kbits/s
/Applications/raw2dng0.13.app/Contents/Resources/script: line 40: 2216 Done "$DCRAW" -c -H 0 -6 -W -q 3 "$Wtemp" *.dng
2217 Segmentation fault: 11 | "$FFMPEG" -f image2pipe -vcodec ppm -r "$FPS" -i pipe:0 -vcodec prores_kostya -profile:v 3 -vendor ap10 -pix_fmt yuv444p10 -y -r "$FPS" "$FLDR$FILE_NAME".mov
Done"
If that can help you.
has this video 409 or 410 frames? if so try to delete the last frame and re-run. I got this error on a video, where the last .dng file is messed up.
otherwise try to open the .dng around frame 409 (408, 410) - are they ok?
Yo
You are right. The last DNG is messed up. It happened to all the shots I have checked. I'd be glad to rerun one. You suggest to remove the last frame but how can I remove the last frame of the RAW file ??? The problem happens when I want the Prores 4444 from the Raw file. Thanks for helping.
prores is made from .dng anyway, so you can delete it after all the dng's are copied over and while the prores is made...
it is possible to see the fps of the file you're converting, like some older versions?? thanks guys !!Yep, restored back in 0.14
Hello, guys.
I don't think it's a bug. But i think it will be good if you can add these options in upcoming builds:
1) please add an option to proceed apple prores 4444 WITHOUT auto white balance either any whitebalance presets (cloudy, shade, tungsten etc,)
Here's the short movie where you can see how auto white balance does really bad thing
I think it's really useful to be able to get prores 4444 on the go, but in some cases auto white balance works just not right.
2)add an option for user to be able not to procced DNGs but to result only in MOV file instead.
If i need a MOV why would i need a DNG's?
Add an option to chose whether we need both DNG and MOV neither we need only DNGs or only MOV.
They have the raw2dng.app becoming very self INTUATIVE, so open the app then just like dropping a .RAW file into the window drop the raw2dng.app into the window, then it will give you the option of turning off the progress 4444 white balance also.
Pro Res 4444 should be the only format you should put into you editor.
You can,t get "as shot whitebalance". Magic L raw mode doesn,t record it to the file. I all has to be done in acr if you want to be 100%
Previous workflow used conversion from DNGs to TIFFs in Photoshop and user was able to just select all frames in sequence WITHOUT doing any corrections. Can you add this "WITHOUT CORRECTION" feature to raw2dng to proceed prores 4444 video files? Is it clear to you?
Regarding the whitebalance settings in raw to dng. Are the presets consistent kelvin-numbers? I understand auto is doing some kind of frame by frame stuff but maybe not the other presets? Would be golden with some kind of tumbnail before applying the whitebalance to the ProRes but it,s not necessary.
Awesome app guys!
Pro Res 4444 should be the only format you should put into you editor.
Isn't the raw data 442? If so, wouldn't Pro Res 444 be a waste of space?
My version of raw2dng.app has full preview ;-) don't know if scrax is going to implement it... maybe i release my version separate...
Hello,
The dng files dont work with resolve 9.1.4
regards
what we use currently, dcraw, has no kelvin, unfortunately, but rgb multipliers. Auto setting currently does frame by frame - like to change that to take the wb setting from first (or whatever) frame and then apply this to all frames.
My version of raw2dng.app has full preview ;-) don't know if scrax is going to implement it... maybe i release my version separate...
Very interesting! But how to keep this dcraw to wb ratio and bring it to a prores 4444 video?What kind of correlation there's between dcraw and final wb kelvin number in final prores 4444 video? Are you trying to say that we don't need this information anymore?! Neither are we enabled to obtain this information in a different way?
Hello,
The dng files dont work with resolve 9.1.4 or 9.1.3, i have this strange low-res files :
(https://www.magiclantern.fm/forum/proxy.php?request=http%3A%2F%2Fwww.franck-rondot.com%2Fimages%2Fdivers%2Fraw2dngbug.jpg&hash=0fd1dffd54869ed01e820e97a606aca9)
regards
What's the command line to convert to ProRes? I'd like first to work on dng's in Lightroom then export tif's to ProRes
ffmpeg -vcodec tiff -i &6d.tiff -r FPS -vcodec prores_kostya -profile:v 3 -vendor ap10 -pix_fmt yuv444p10be -y -r FPS OUTPUT.mov
cd to your folder containing tiff.
replace both FPS with your actual fps!
It's just a matter of finding time to code it, but it will be added in future release.Great! Would remove one big step for me having to join files ! So looking forward to it :-)
the prores4444 files are created but can't be ready by Premiere or Quicktime, anyone else having this issue? Also I can't find out how to turn off the creation of the prores files to save space since they don't work.
10.8.4
QT x
CS6 all the newest stuff
and I have Apple Compressor installed for the ProRes components.
Here's the weird thing. The only file that worked (aka was recognized by quicktime) was one that I hit the cancel button part way thru the conversion.
this raw2dng gives me directly Prores4444, Just Drag and Drop. cool.
But now i checked the prores files and they are shit.
The color within a shot keeps changing. Not really from frame to frame,
but with in 3 or 4 frames, skin tones suddenly green or blue.
Sucks.
But when i do Photoshop then export to tiff then quicktime pro to sequence,
everything fine.
Now I need a new converter from raw to dng,
cause raw2dng does the prores transfer automatically and that keeps ages.
raw2dng converter GUI for OsX
Beta ver.0.13
M28-1957 File Supported
Generating ProResHQ 4444 with FPS: 23.976
ffmpeg version 1.2.1-tessus Copyright (c) 2000-2013 the FFmpeg developers
built on May 9 2013 21:58:14 with llvm-gcc 4.2.1 (LLVM build 2336.1.00)
configuration: --prefix=/Users/tessus/data/ext/ffmpeg/sw --as=yasm --extra-version=tessus --disable-shared --enable-static --disable-ffplay --enable-gpl --enable-pthreads --enable-postproc --enable-libmp3lame --enable-libtheora --enable-libvorbis --enable-libx264 --enable-libxvid --enable-libspeex --enable-bzlib --enable-zlib --enable-libopencore-amrnb --enable-libopencore-amrwb --enable-libxavs --enable-version3 --enable-libvo-aacenc --enable-libvo-amrwbenc --enable-libvpx --enable-libgsm --enable-libopus --enable-fontconfig --enable-libfreetype --enable-libass --enable-filters --enable-runtime-cpudetect
libavutil 52. 18.100 / 52. 18.100
libavcodec 54. 92.100 / 54. 92.100
libavformat 54. 63.104 / 54. 63.104
libavdevice 54. 3.103 / 54. 3.103
libavfilter 3. 42.103 / 3. 42.103
libswscale 2. 2.100 / 2. 2.100
libswresample 0. 17.102 / 0. 17.102
libpostproc 52. 2.100 / 52. 2.100
[image2pipe @ 0x102019600] Stream #0: not enough frames to estimate rate; consider increasing probesize
[image2pipe @ 0x102019600] Estimating duration from bitrate, this may be inaccurate
Input #0, image2pipe, from 'pipe:0':
Duration: N/A, bitrate: N/A
Stream #0:0: Video: ppm, rgb48be, 1920x1080, 23.98 tbr, 23.98 tbn, 23.98 tbc
Output #0, mov, to '/Users/oscarmoreno/Desktop/test/M28-1957.mov':
Metadata:
encoder : Lavf54.63.104
Stream #0:0: Video: prores (apch / 0x68637061), yuv444p10le, 1920x1080, q=2-31, 200 kb/s, 11988 tbn, 23.98 tbc
Stream mapping:
Stream #0:0 -> #0:0 (ppm -> prores_kostya)
frame= 3 fps=2.1 q=0.0 size= 2844kB time=00:00:00.12 bitrate=186177.9kbits/s
frame= 4 fps=1.6 q=0.0 size= 3792kB time=00:00:00.16 bitrate=186204.1kbits/s
frame= 5 fps=1.4 q=0.0 size= 4740kB time=00:00:00.20 bitrate=186198.5kbits/s
frame= 6 fps=1.3 q=0.0 size= 5688kB time=00:00:00.25 bitrate=186211.6kbits/s
frame= 7 fps=1.3 q=0.0 size= 6637kB time=00:00:00.29 bitrate=186225.3kbits/s
frame= 8 fps=1.2 q=0.0 size= 7585kB time=00:00:00.33 bitrate=186231.5kbits/s
frame= 9 fps=1.2 q=0.0 size= 8533kB time=00:00:00.37 bitrate=186225.4kbits/s
frame= 10 fps=1.2 q=0.0 size= 9481kB time=00:00:00.41 bitrate=186221.4kbits/s
frame= 11 fps=1.1 q=0.0 size= 10428kB time=00:00:00.45 bitrate=186206.4kbits/s
frame= 12 fps=1.1 q=0.0 size= 11377kB time=00:00:00.50 bitrate=186209.4kbits/s
frame= 13 fps=1.1 q=0.0 size= 12325kB time=00:00:00.54 bitrate=186211.3kbits/s
frame= 14 fps=1.1 q=0.0 size= 13273kB time=00:00:00.58 bitrate=186209.0kbits/s
frame= 15 fps=1.1 q=0.0 size= 14221kB time=00:00:00.62 bitrate=186216.2kbits/s
frame= 16 fps=1.1 q=0.0 size= 15169kB time=00:00:00.66 bitrate=186212.7kbits/s
frame= 17 fps=1.1 q=0.0 size= 16118kB time=00:00:00.70 bitrate=186218.8kbits/s
frame= 18 fps=1.1 q=0.0 size= 17065kB time=00:00:00.75 bitrate=186210.9kbits/s
frame= 19 fps=1.1 q=0.0 size= 18013kB time=00:00:00.79 bitrate=186204.8kbits/s
frame= 20 fps=1.1 q=0.0 size= 18961kB time=00:00:00.83 bitrate=186203.5kbits/s
frame= 21 fps=1.1 q=0.0 size= 19909kB time=00:00:00.87 bitrate=186204.9kbits/s
frame= 22 fps=1.0 q=0.0 size= 20857kB time=00:00:00.91 bitrate=186204.0kbits/s
frame= 23 fps=1.0 q=0.0 size= 21805kB time=00:00:00.95 bitrate=186202.9kbits/s
frame= 24 fps=1.0 q=0.0 size= 22752kB time=00:00:01.00 bitrate=186202.0kbits/s
frame= 25 fps=1.0 q=0.0 size= 23701kB time=00:00:01.04 bitrate=186206.6kbits/s
frame= 26 fps=1.0 q=0.0 size= 24650kB time=00:00:01.08 bitrate=186209.7kbits/s
frame= 27 fps=1.0 q=0.0 size= 25597kB time=00:00:01.12 bitrate=186208.6kbits/s
frame= 28 fps=1.0 q=0.0 size= 26546kB time=00:00:01.16 bitrate=186211.4kbits/s
frame= 29 fps=1.0 q=0.0 size= 27494kB time=00:00:01.20 bitrate=186211.7kbits/s
frame= 30 fps=1.0 q=0.0 size= 28442kB time=00:00:01.25 bitrate=186208.4kbits/s
frame= 31 fps=1.0 q=0.0 size= 29389kB time=00:00:01.29 bitrate=186205.5kbits/s
frame= 32 fps=1.0 q=0.0 size= 30337kB time=00:00:01.33 bitrate=186203.8kbits/s
frame= 33 fps=1.0 q=0.0 size= 31284kB time=00:00:01.37 bitrate=186198.8kbits/s
frame= 34 fps=1.0 q=0.0 size= 32233kB time=00:00:01.41 bitrate=186201.7kbits/s
frame= 35 fps=1.0 q=0.0 size= 33181kB time=00:00:01.45 bitrate=186202.6kbits/s
frame= 36 fps=1.0 q=0.0 size= 34129kB time=00:00:01.50 bitrate=186203.7kbits/s
frame= 37 fps=1.0 q=0.0 size= 35077kB time=00:00:01.54 bitrate=186202.6kbits/s
frame= 38 fps=1.0 q=0.0 size= 36026kB time=00:00:01.58 bitrate=186206.1kbits/s
frame= 39 fps=1.0 q=0.0 size= 36973kB time=00:00:01.62 bitrate=186205.2kbits/s
frame= 40 fps=1.0 q=0.0 size= 37922kB time=00:00:01.66 bitrate=186205.4kbits/s
frame= 41 fps=1.0 q=0.0 size= 38869kB time=00:00:01.71 bitrate=186203.8kbits/s
frame= 42 fps=1.0 q=0.0 size= 39817kB time=00:00:01.75 bitrate=186205.0kbits/s
frame= 43 fps=1.0 q=0.0 size= 40765kB time=00:00:01.79 bitrate=186204.8kbits/s
frame= 44 fps=1.0 q=0.0 size= 41713kB time=00:00:01.83 bitrate=186201.0kbits/s
frame= 45 fps=1.0 q=0.0 size= 42660kB time=00:00:01.87 bitrate=186196.7kbits/s
frame= 46 fps=1.0 q=0.0 size= 43608kB time=00:00:01.91 bitrate=186196.9kbits/s
frame= 47 fps=1.0 q=0.0 size= 44556kB time=00:00:01.96 bitrate=186196.1kbits/s
frame= 48 fps=1.0 q=0.0 size= 45503kB time=00:00:02.00 bitrate=186195.8kbits/s
frame= 49 fps=1.0 q=0.0 size= 46452kB time=00:00:02.04 bitrate=186197.0kbits/s
frame= 50 fps=1.0 q=0.0 size= 47401kB time=00:00:02.08 bitrate=186200.4kbits/s
frame= 51 fps=1.0 q=0.0 size= 48349kB time=00:00:02.12 bitrate=186202.9kbits/s
frame= 52 fps=1.0 q=0.0 size= 49298kB time=00:00:02.16 bitrate=186206.9kbits/s
frame= 53 fps=1.0 q=0.0 size= 50247kB time=00:00:02.21 bitrate=186210.0kbits/s
frame= 54 fps=1.0 q=0.0 size= 51195kB time=00:00:02.25 bitrate=186209.3kbits/s
frame= 55 fps=1.0 q=0.0 size= 52144kB time=00:00:02.29 bitrate=186211.3kbits/s
frame= 56 fps=1.0 q=0.0 size= 53092kB time=00:00:02.33 bitrate=186213.0kbits/s
frame= 57 fps=1.0 q=0.0 size= 54041kB time=00:00:02.37 bitrate=186213.6kbits/s
frame= 58 fps=1.0 q=0.0 size= 54988kB time=00:00:02.41 bitrate=186213.1kbits/s
frame= 59 fps=1.0 q=0.0 size= 55936kB time=00:00:02.46 bitrate=186211.6kbits/s
frame= 60 fps=1.0 q=0.0 size= 56884kB time=00:00:02.50 bitrate=186212.4kbits/s
frame= 61 fps=1.0 q=0.0 size= 57832kB time=00:00:02.54 bitrate=186209.4kbits/s
frame= 62 fps=1.0 q=0.0 size= 58779kB time=00:00:02.58 bitrate=186209.0kbits/s
frame= 63 fps=1.0 q=0.0 size= 59727kB time=00:00:02.62 bitrate=186208.0kbits/s
frame= 64 fps=1.0 q=0.0 size= 60675kB time=00:00:02.66 bitrate=186208.5kbits/s
frame= 65 fps=1.0 q=0.0 size= 61624kB time=00:00:02.71 bitrate=186208.7kbits/s
frame= 66 fps=1.0 q=0.0 size= 62572kB time=00:00:02.75 bitrate=186208.7kbits/s
frame= 67 fps=1.0 q=0.0 size= 63519kB time=00:00:02.79 bitrate=186206.9kbits/s
frame= 68 fps=1.0 q=0.0 size= 64467kB time=00:00:02.83 bitrate=186207.1kbits/s
frame= 69 fps=1.0 q=0.0 size= 65415kB time=00:00:02.87 bitrate=186206.6kbits/s
frame= 70 fps=1.0 q=0.0 size= 66364kB time=00:00:02.91 bitrate=186209.1kbits/s
frame= 71 fps=1.0 q=0.0 size= 67312kB time=00:00:02.96 bitrate=186209.0kbits/s
frame= 72 fps=1.0 q=0.0 size= 68261kB time=00:00:03.00 bitrate=186210.4kbits/s
frame= 73 fps=1.0 q=0.0 size= 69208kB time=00:00:03.04 bitrate=186209.6kbits/s
frame= 74 fps=1.0 q=0.0 size= 70158kB time=00:00:03.08 bitrate=186213.7kbits/s
frame= 75 fps=1.0 q=0.0 size= 71106kB time=00:00:03.12 bitrate=186213.8kbits/s
frame= 613 fps=1.0 q=0.0 size= 581090kB time=00:00:25.56 bitrate=186187.0kbits/s
/Applications/raw2dng.app/Contents/Resources/script: line 40: 4661 Done "$DCRAW" -c -H 0 -6 -W -q 3 "$Wtemp" *.dng
4662 Segmentation fault: 11 | "$FFMPEG" -f image2pipe -vcodec ppm -r "$FPS" -i pipe:0 -vcodec prores_kostya -profile:v 3 -vendor ap10 -pix_fmt yuv444p10 -y -r "$FPS" "$FLDR$FILE_NAME".mov
Done
Also OSX 10.8.4 here. But works fine with me.
What version of FCP you have?
Well... that makes sense.
But wait so long just for a preview? without having the option to skip this process and stay with your dngs?
Strange.
This doesn't work for me. When the app is on an external I don't get the options. When the app is on my desktop, I get the options but when I select the external as my output drive, it still puts the files on my desktop where the app is. So I can only have one or the either. Files get placed on my external, but I can't stop the pro res, or I can stop the pro res, but files must be on the desktop.
Is this still a problem with raw2dng?
For some reason, the proresHQ 4444 file put out by raw2dng is unrecognized by my system - OSX 10.8.4
(https://www.magiclantern.fm/forum/proxy.php?request=http%3A%2F%2Fi.imgbox.com%2FabgLd3AS.png&hash=11b4b54e341c31e7296953c5c1d04950)
Anybody has any idea why? Here's the resultant text:Code: [Select]
raw2dng converter GUI for OsX
Beta ver.0.13
M28-1957 File Supported
Generating ProResHQ 4444 with FPS: 23.976
ffmpeg version 1.2.1-tessus Copyright (c) 2000-2013 the FFmpeg developers
built on May 9 2013 21:58:14 with llvm-gcc 4.2.1 (LLVM build 2336.1.00)
configuration: --prefix=/Users/tessus/data/ext/ffmpeg/sw --as=yasm --extra-version=tessus --disable-shared --enable-static --disable-ffplay --enable-gpl --enable-pthreads --enable-postproc --enable-libmp3lame --enable-libtheora --enable-libvorbis --enable-libx264 --enable-libxvid --enable-libspeex --enable-bzlib --enable-zlib --enable-libopencore-amrnb --enable-libopencore-amrwb --enable-libxavs --enable-version3 --enable-libvo-aacenc --enable-libvo-amrwbenc --enable-libvpx --enable-libgsm --enable-libopus --enable-fontconfig --enable-libfreetype --enable-libass --enable-filters --enable-runtime-cpudetect
libavutil 52. 18.100 / 52. 18.100
libavcodec 54. 92.100 / 54. 92.100
libavformat 54. 63.104 / 54. 63.104
libavdevice 54. 3.103 / 54. 3.103
libavfilter 3. 42.103 / 3. 42.103
libswscale 2. 2.100 / 2. 2.100
libswresample 0. 17.102 / 0. 17.102
libpostproc 52. 2.100 / 52. 2.100
[image2pipe @ 0x102019600] Stream #0: not enough frames to estimate rate; consider increasing probesize
[image2pipe @ 0x102019600] Estimating duration from bitrate, this may be inaccurate
Input #0, image2pipe, from 'pipe:0':
Duration: N/A, bitrate: N/A
Stream #0:0: Video: ppm, rgb48be, 1920x1080, 23.98 tbr, 23.98 tbn, 23.98 tbc
Output #0, mov, to '/Users/oscarmoreno/Desktop/test/M28-1957.mov':
Metadata:
encoder : Lavf54.63.104
Stream #0:0: Video: prores (apch / 0x68637061), yuv444p10le, 1920x1080, q=2-31, 200 kb/s, 11988 tbn, 23.98 tbc
Stream mapping:
Stream #0:0 -> #0:0 (ppm -> prores_kostya)
frame= 3 fps=2.1 q=0.0 size= 2844kB time=00:00:00.12 bitrate=186177.9kbits/s
frame= 4 fps=1.6 q=0.0 size= 3792kB time=00:00:00.16 bitrate=186204.1kbits/s
frame= 5 fps=1.4 q=0.0 size= 4740kB time=00:00:00.20 bitrate=186198.5kbits/s
frame= 6 fps=1.3 q=0.0 size= 5688kB time=00:00:00.25 bitrate=186211.6kbits/s
frame= 7 fps=1.3 q=0.0 size= 6637kB time=00:00:00.29 bitrate=186225.3kbits/s
frame= 8 fps=1.2 q=0.0 size= 7585kB time=00:00:00.33 bitrate=186231.5kbits/s
frame= 9 fps=1.2 q=0.0 size= 8533kB time=00:00:00.37 bitrate=186225.4kbits/s
frame= 10 fps=1.2 q=0.0 size= 9481kB time=00:00:00.41 bitrate=186221.4kbits/s
frame= 11 fps=1.1 q=0.0 size= 10428kB time=00:00:00.45 bitrate=186206.4kbits/s
frame= 12 fps=1.1 q=0.0 size= 11377kB time=00:00:00.50 bitrate=186209.4kbits/s
frame= 13 fps=1.1 q=0.0 size= 12325kB time=00:00:00.54 bitrate=186211.3kbits/s
frame= 14 fps=1.1 q=0.0 size= 13273kB time=00:00:00.58 bitrate=186209.0kbits/s
frame= 15 fps=1.1 q=0.0 size= 14221kB time=00:00:00.62 bitrate=186216.2kbits/s
frame= 16 fps=1.1 q=0.0 size= 15169kB time=00:00:00.66 bitrate=186212.7kbits/s
frame= 17 fps=1.1 q=0.0 size= 16118kB time=00:00:00.70 bitrate=186218.8kbits/s
frame= 18 fps=1.1 q=0.0 size= 17065kB time=00:00:00.75 bitrate=186210.9kbits/s
frame= 19 fps=1.1 q=0.0 size= 18013kB time=00:00:00.79 bitrate=186204.8kbits/s
frame= 20 fps=1.1 q=0.0 size= 18961kB time=00:00:00.83 bitrate=186203.5kbits/s
frame= 21 fps=1.1 q=0.0 size= 19909kB time=00:00:00.87 bitrate=186204.9kbits/s
frame= 22 fps=1.0 q=0.0 size= 20857kB time=00:00:00.91 bitrate=186204.0kbits/s
frame= 23 fps=1.0 q=0.0 size= 21805kB time=00:00:00.95 bitrate=186202.9kbits/s
frame= 24 fps=1.0 q=0.0 size= 22752kB time=00:00:01.00 bitrate=186202.0kbits/s
frame= 25 fps=1.0 q=0.0 size= 23701kB time=00:00:01.04 bitrate=186206.6kbits/s
frame= 26 fps=1.0 q=0.0 size= 24650kB time=00:00:01.08 bitrate=186209.7kbits/s
frame= 27 fps=1.0 q=0.0 size= 25597kB time=00:00:01.12 bitrate=186208.6kbits/s
frame= 28 fps=1.0 q=0.0 size= 26546kB time=00:00:01.16 bitrate=186211.4kbits/s
frame= 29 fps=1.0 q=0.0 size= 27494kB time=00:00:01.20 bitrate=186211.7kbits/s
frame= 30 fps=1.0 q=0.0 size= 28442kB time=00:00:01.25 bitrate=186208.4kbits/s
frame= 31 fps=1.0 q=0.0 size= 29389kB time=00:00:01.29 bitrate=186205.5kbits/s
frame= 32 fps=1.0 q=0.0 size= 30337kB time=00:00:01.33 bitrate=186203.8kbits/s
frame= 33 fps=1.0 q=0.0 size= 31284kB time=00:00:01.37 bitrate=186198.8kbits/s
frame= 34 fps=1.0 q=0.0 size= 32233kB time=00:00:01.41 bitrate=186201.7kbits/s
frame= 35 fps=1.0 q=0.0 size= 33181kB time=00:00:01.45 bitrate=186202.6kbits/s
frame= 36 fps=1.0 q=0.0 size= 34129kB time=00:00:01.50 bitrate=186203.7kbits/s
frame= 37 fps=1.0 q=0.0 size= 35077kB time=00:00:01.54 bitrate=186202.6kbits/s
frame= 38 fps=1.0 q=0.0 size= 36026kB time=00:00:01.58 bitrate=186206.1kbits/s
frame= 39 fps=1.0 q=0.0 size= 36973kB time=00:00:01.62 bitrate=186205.2kbits/s
frame= 40 fps=1.0 q=0.0 size= 37922kB time=00:00:01.66 bitrate=186205.4kbits/s
frame= 41 fps=1.0 q=0.0 size= 38869kB time=00:00:01.71 bitrate=186203.8kbits/s
frame= 42 fps=1.0 q=0.0 size= 39817kB time=00:00:01.75 bitrate=186205.0kbits/s
frame= 43 fps=1.0 q=0.0 size= 40765kB time=00:00:01.79 bitrate=186204.8kbits/s
frame= 44 fps=1.0 q=0.0 size= 41713kB time=00:00:01.83 bitrate=186201.0kbits/s
frame= 45 fps=1.0 q=0.0 size= 42660kB time=00:00:01.87 bitrate=186196.7kbits/s
frame= 46 fps=1.0 q=0.0 size= 43608kB time=00:00:01.91 bitrate=186196.9kbits/s
frame= 47 fps=1.0 q=0.0 size= 44556kB time=00:00:01.96 bitrate=186196.1kbits/s
frame= 48 fps=1.0 q=0.0 size= 45503kB time=00:00:02.00 bitrate=186195.8kbits/s
frame= 49 fps=1.0 q=0.0 size= 46452kB time=00:00:02.04 bitrate=186197.0kbits/s
frame= 50 fps=1.0 q=0.0 size= 47401kB time=00:00:02.08 bitrate=186200.4kbits/s
frame= 51 fps=1.0 q=0.0 size= 48349kB time=00:00:02.12 bitrate=186202.9kbits/s
frame= 52 fps=1.0 q=0.0 size= 49298kB time=00:00:02.16 bitrate=186206.9kbits/s
frame= 53 fps=1.0 q=0.0 size= 50247kB time=00:00:02.21 bitrate=186210.0kbits/s
frame= 54 fps=1.0 q=0.0 size= 51195kB time=00:00:02.25 bitrate=186209.3kbits/s
frame= 55 fps=1.0 q=0.0 size= 52144kB time=00:00:02.29 bitrate=186211.3kbits/s
frame= 56 fps=1.0 q=0.0 size= 53092kB time=00:00:02.33 bitrate=186213.0kbits/s
frame= 57 fps=1.0 q=0.0 size= 54041kB time=00:00:02.37 bitrate=186213.6kbits/s
frame= 58 fps=1.0 q=0.0 size= 54988kB time=00:00:02.41 bitrate=186213.1kbits/s
frame= 59 fps=1.0 q=0.0 size= 55936kB time=00:00:02.46 bitrate=186211.6kbits/s
frame= 60 fps=1.0 q=0.0 size= 56884kB time=00:00:02.50 bitrate=186212.4kbits/s
frame= 61 fps=1.0 q=0.0 size= 57832kB time=00:00:02.54 bitrate=186209.4kbits/s
frame= 62 fps=1.0 q=0.0 size= 58779kB time=00:00:02.58 bitrate=186209.0kbits/s
frame= 63 fps=1.0 q=0.0 size= 59727kB time=00:00:02.62 bitrate=186208.0kbits/s
frame= 64 fps=1.0 q=0.0 size= 60675kB time=00:00:02.66 bitrate=186208.5kbits/s
frame= 65 fps=1.0 q=0.0 size= 61624kB time=00:00:02.71 bitrate=186208.7kbits/s
frame= 66 fps=1.0 q=0.0 size= 62572kB time=00:00:02.75 bitrate=186208.7kbits/s
frame= 67 fps=1.0 q=0.0 size= 63519kB time=00:00:02.79 bitrate=186206.9kbits/s
frame= 68 fps=1.0 q=0.0 size= 64467kB time=00:00:02.83 bitrate=186207.1kbits/s
frame= 69 fps=1.0 q=0.0 size= 65415kB time=00:00:02.87 bitrate=186206.6kbits/s
frame= 70 fps=1.0 q=0.0 size= 66364kB time=00:00:02.91 bitrate=186209.1kbits/s
frame= 71 fps=1.0 q=0.0 size= 67312kB time=00:00:02.96 bitrate=186209.0kbits/s
frame= 72 fps=1.0 q=0.0 size= 68261kB time=00:00:03.00 bitrate=186210.4kbits/s
frame= 73 fps=1.0 q=0.0 size= 69208kB time=00:00:03.04 bitrate=186209.6kbits/s
frame= 74 fps=1.0 q=0.0 size= 70158kB time=00:00:03.08 bitrate=186213.7kbits/s
frame= 75 fps=1.0 q=0.0 size= 71106kB time=00:00:03.12 bitrate=186213.8kbits/s
frame= 613 fps=1.0 q=0.0 size= 581090kB time=00:00:25.56 bitrate=186187.0kbits/s
/Applications/raw2dng.app/Contents/Resources/script: line 40: 4661 Done "$DCRAW" -c -H 0 -6 -W -q 3 "$Wtemp" *.dng
4662 Segmentation fault: 11 | "$FFMPEG" -f image2pipe -vcodec ppm -r "$FPS" -i pipe:0 -vcodec prores_kostya -profile:v 3 -vendor ap10 -pix_fmt yuv444p10 -y -r "$FPS" "$FLDR$FILE_NAME".mov
Done
this raw2dng gives me directly Prores4444, Just Drag and Drop. cool.
But now i checked the prores files and they are shit.
The color within a shot keeps changing. Not really from frame to frame,
but with in 3 or 4 frames, skin tones suddenly green or blue.
Sucks.
But when i do Photoshop then export to tiff then quicktime pro to sequence,
everything fine.
Now I need a new converter from raw to dng,
cause raw2dng does the prores transfer automatically and that keeps ages.
Hey, thanks for the program but, How to deactivate DNGs for keep only prores 4444?
you can,t at the moment. I fiddled around with adobe media encoder and managed to export rawfiles to ProRes by adding the ginger-plugin to the media encoder encoder. You could try that if you work with adobe software.
Instructions
http://www.magiclantern.fm/forum/index.php?topic=6550.msg51797#msg51797
Has development stopped for this fantastic app?
I really hope not as it shows a lot of promis but features people were looking for include:
1) joining of multiple .r001 .r002 etc.. Files for the 5d2, 50d and others that require 4gb split files
2) a better GUI for selecting options such as if it makes a pro-res file and options for it ( as opposed to dragging in the GUI into its self with limited options )
3) some kind of preview of clips before they are converted over .. Maybe dropping frames or even B&W but this would be a huge time saver as I could know what clips are what
Anyway love to see some more progress ! James
I second these suggestions!
If you doubleclick the app and the drag and drop the app onto the app a bunch of options appear in front of you. In there you can skip the ProRes and also choose white balance presets. I suggest you choose cloudy for your ProRes instead of automatic.
Download link works fine. It,s on the first page, the first topic.
raw2dng converter GUI for OsX
Beta ver.0.13
SEARCHING: /Volumes/.../RAWtoDNG/raw2dng_0.13.app/
Nothing found
It seems the latest version of raw2dng is .13 - but it also seems to be older than latest builds of ML.
Renato mentioned in another forum (or responded to someone) that there are several identically labeled versions of raw2dng.
Really? How would we know which is which?
And better yet someone posts they finally found the newest one but provided no link or details.
Please...
I also am finding that it seems to be outputting 422 not 444. Asked once or twice if others could confirm and I only see a few others claiming output is 422.
If you know where the answers are in the forum please post or private message me.
Thx
Mike
Hello,
I have some problems with prores files converted from sequences of over 4,3GB. I read somewhere that it was possible to drag and drop directly .RAW and .R00 files in rawtodng but it doesn't work for me, so I first join them using terminal like explained here on other topics and then convert the resulting .RAW file. Converting it to .dng seems to work well (apart from a pink picture on the last frame) but the prores file does not seem to work. I'm doing this on a OS X Maverick platform. I am doing right now some intense work using a 50D with huge amount of footage, so I need the simplest solution possible to have prores files. Anybody might have an insight ?
Best Regards,
Tom
How do you use the .R00 files? I have a few from my project today.
it's not working in Mavericks, the last OSX from Apple!
How do you use the .R00 files? I have a few from my project today.
Can you post your version? I can't run in Mavericks, I have three computers and is not working.
Is there a way to convert .MLV files to DNG? (an what are the .idx files for?)
The horizontal resolution is restricted to multiples of 8 bytes and 16 pixels according to latest findings. This restriction is valid at least for 5D3 and 6D (didn't do much testing on other cameras), but I'd like to keep the code portable without camera-specific exceptions.
So, before including this change in nightly builds, I'd like to ask you which is better: 1888 with 8 pixels of black border that you will have to crop, or 1856 without any border pixels? Between these 2 values, there are no valid resolutions that respect the alignment restrictions.
This change was discussed here:
http://www.magiclantern.fm/forum/index.php?topic=3904.msg106087#msg106087
https://bitbucket.org/hudson/magic-lantern/pull-request/438/raw-recording-force-line-size-to-be/diff
...and it's also no coding effort to discard pixels while converting to dng. The user wouldn't even realize it!
This way, no one has to crop anything actively in post! It's simply done in background in the ever necessary converting (to dng) step.