5D2 RAW video Builds 14-Bit

[ted ramasola]

using may 30 build posted by a.d.

Spanned files more than 4gig in size, the following observation.

1.) If I use "copy/B file 1+ file2 new filename" method in command prompt to combine 2 files then extract
Frames would be ok until 1:01:06  after that everything is pink noise. I tried this with 2 separate recordings. My estimate based on the frame number is that the second spanned file is corrupted.

2.) Using the same files as above,  I use drag over raw2dng.exe method, by dragging the 2nd file in the span. They would all extract but upon opening in ACR all frames are pink noise.

[a1ex]

What file sizes do you get? (exact values)

[ted ramasola]

What file sizes do you get? (exact values)

xxx .RAW file is at 4,185,570 KB
per DNG frame is 2,857 KB

this is at 1720 x 968 16:9

[a1ex]

Exact values in bytes please, for all files you've got from the camera.

[Clemens]

xxx .RAW file is at 4,185,570 KB
per DNG frame is 2,857 KB

this is at 1720 x 968 16:9

Stupid question maybe... but as the processor is not used in this case for converting to h264, could there not be the possibility to encode directly into dng or is the buffer to small for this?
Cheers
Clemens

[ted ramasola]

Exact values in bytes please, for all files you've got from the camera.

all the DNGs extracted are the same at 2.78 MB (2,925,230 bytes)
the first .RAW file is 3.99 GB (4,286,023,280 bytes)

[a.d.]

Build 717c5fb95219

Resolution  : 960 x 960
Frames      : 3399
Frame size  : 1612800 bytes
Frame skip  : 1
FPS         : 23.976

split:
M31-1122.RAW   4.280.371.200
M31-1122.R00   1.186.940.097

join:
M31-1122.RAW   5.467.311.297

confirm.
The Playback works well with out a glitch.
0000-2637       ok
2637-3398       corrupt

[a1ex]

So, 5D2 does not write anything if it would exceed 4GB, unlike 5D3 which writes exactly 4294967295 bytes.

Try this: if (r == -1) r = 0;

or this: https://bitbucket.org/hudson/magic-lantern/commits/d6786d675069

[ted ramasola]

reinstalled build may 29 posted by a.d.

first file 3.99 GB (4,286,023,280 bytes)
2nd file 1.28 GB (1,378,170,832 bytes)

single DNG frame 2.81 MB (2,952,080 bytes)

same resolution as previous test 1720x968 at 23.976

timeline length 1:21:00

NO corrupt frames using command prompt join then raw2dng extract method.

Using drag 2nd file over raw2dng method CORRUPT FRAMES/PINK Noise starting at 0:19:17 up to last.

[a.d.]

it looks good.
4.294.967.295 
I'm on USB2 it takes times before confirm!

Update:
works with OSX+WIN
I'll update the build + converter in the next release

[ted ramasola]

-

[Kabuto1138]

Hey guys,

So I tried the latest raw2dng for MAC and it won't open any files, not even of a few seconds.  This is the "error" I'm getting.

raw2dng converter GUI for 5D2
Beta ver.0.3
/script: line 10:   506 Segmentation fault: 11  raw2dng "$fldr$name".RAW


All it does is it creates a folder in my desktop with the name of the RAW file and does nothing else.

On a separate note, with the latest build for the 5d2 I'm getting 272 frames at 16x9 = 1880x1058.  That's the most I've gotten since RAW became a reality.  Using  Lexar 1000x 16gb.

[mvejerslev]

Tried latest Raw2DNG, and there's no camera profile in the files! There used to be at least the camera make and model in the exif, and camera Raw needs this info for its noise profiling etc.

[mvejerslev]

Ehm. reverted to my last functioning raw2dng, and Bridge still doesnt see exif data in my DNGs... For camera Make it says 'Canikon'. What could I be doing wrong? Same ML and Raw module I've used before with success. Perplexed.

[NitromanX]

@ Kabuto1138

Good news about 14bit 1880 x 1058 recording duration of 272 frames. Is that at 24 or 25 fps ?

What made you buy Lexar 1000x CF card ? They are pretty expensive compared to Komputer Bay / Transcend cards ? I'm looking to buy new card and wonder which to get.

Is there still a 2Gb limit on raw to .dng files with Mac using ML converter ? Is it possible to use the free Adobe raw to dng converter ?

I've just installed ML today and would like to try raw recording soon. 

Is it likely that we will ever get perpetual 14bit raw recording with 5D2 ?

 

[TekAzurik]

Hey guys,

So I tried the latest raw2dng for MAC and it won't open any files, not even of a few seconds.  This is the "error" I'm getting.

raw2dng converter GUI for 5D2
Beta ver.0.3
/script: line 10:   506 Segmentation fault: 11  raw2dng "$fldr$name".RAW


All it does is it creates a folder in my desktop with the name of the RAW file and does nothing else.

I had this same problem with the file from bitbucket, I went to the forum page for the GUI and downloaded the current version there.  That seems to work fine.

I have no problems with smaller files but I am unable to get some combined files for videos over 4gb to read in raw2dng, it comes back with the "This ain't a lv_rec RAW file" error. 

video specs are below:

5d2
5/31 build d6786d675069
transcend 400x 32gb
Global draw on
1320x562
file 1: M31-1319.RAW - 4.294.967.295 bytes
file 2: M31-1319.R00 - 2.255.851.017 bytes
combined file - 6.550.818.312 bytes

I have seen elsewhere people having problems with certain aspect ratios, so I tried 1280x544 and was able to get raw2dng to recognize it.  I haven't tried any higher aspect ratios as these are the only cards I have.

[Kabuto1138]

@ Kabuto1138

Good news about 14bit 1880 x 1058 recording duration of 272 frames. Is that at 24 or 25 fps ?

What made you buy Lexar 1000x CF card ? They are pretty expensive compared to Komputer Bay / Transcend cards ? I'm looking to buy new card and wonder which to get.

Is there still a 2Gb limit on raw to .dng files with Mac using ML converter ? Is it possible to use the free Adobe raw to dng converter ?

I've just installed ML today and would like to try raw recording soon. 

Is it likely that we will ever get perpetual 14bit raw recording with 5D2 ?

 

I got the card way before the RAW revolution.  That's the best card I have.  I am dying to get a 64gb card, but still undecided which one to get.  Waiting for more Toshiba 1066x reviews, otherwise I'll get a Komputerbay.  I recorded 272 at 24fps.

You said you want to use Adobe raw to dng converter?  I don't understand that one. 

[Hazer]

@a.d.

First, thanks for all the work on the builds and continued updates to this thread -- appreciated.

I see on the first page that "Canon 5D Mark II in Exif" is listed as being added to raw2dng.  However I'm still seeing "Canikon" listed as the camera model.  I'm on OS X.  I've tested this with today's build and also the most recent versions of raw2dng (app and command-line).  Has this not been implemented yet in the Mac builds?

Currently, .dng files do not display the usual Canon picture styles in Photoshop / Adobe Camera Raw, and I think this is because the camera is not being correctly identified.

Thanks!

[reddeercity]

Success ! i recorded 5145 Frames @1880x854 24p 13.6 GB (14,656,130,312 bytes)
Joined the 3 segmented 3.99 GB (4,294,967,295 bytes)=9.46 GB (10,163,543,257 bytes
Join A File  with B file 3.99 GB (4,294,967,295 bytes)=13.6 GB

Drop on the new raw2dng.exe & everything look Great no more Pink Noise Frame
I still need to do a Full Card Record which is a Lexar 1000x 32GB
to see if there is any frame corruption, that when i had all my problems

i use the May 31st Bulit with the new raw2dng.exe
it looks like there maybe a little Speed increase, i was recording @ 64.2 MB/s
with only 1 Buffer Star   no frame drops.
As long as i have no problem with a full Card record i Have plans to
completely  Film in RAW a 60 Mintue  Documentry about  a Young Street Artist in Central Alberta.
i should get about 8 Mintue per 32 GB card @ 1880x854 24p 

[reddeercity]

I converted my DNG to tiff with Adobe PhotoShop and Camera
Info is diplay right, but i convert with my Windows PC and edit with my MacPro

You can also use adobe Photoshop Elements to read, edit dng's or convert Tiff
i used it a little slow compared to Full blow Photoshop but works
it also read the MetaData right.

[vikado]

Success ! i recorded 5145 Frames @1880x854 24p 13.6 GB (14,656,130,312 bytes)
Joined the 3 segmented 3.99 GB (4,294,967,295 bytes)=9.46 GB (10,163,543,257 bytes
Join A File  with B file 3.99 GB (4,294,967,295 bytes)=13.6 GB

Drop on the new raw2dng.exe & everything look Great no more Pink Noise Frame
I still need to do a Full Card Record which is a Lexar 1000x 32GB
to see if there is any frame corruption, that when i had all my problems

i use the May 31st Bulit with the new raw2dng.exe
it looks like there maybe a little Speed increase, i was recording @ 64.2 MB/s
with only 1 Buffer Star   no frame drops.
As long as i have no problem with a full Card record i Have plans to
completely  Film in RAW a 60 Mintue  Documentry about  a Young Street Artist in Central Alberta.
i should get about 8 Mintue per 32 GB card @ 1880x854 24p 

wait, i've been away on a production shoot. what did i miss about stitching consecutive files together?
how is it done? i  dont have to buy a mark iii now to record past 4gb?

[Hazer]

I converted my DNG to tiff with Adobe PhotoShop and Camera
Info is diplay right, but i convert with my Windows PC and edit with my MacPro

You can also use adobe Photoshop Elements to read, edit dng's or convert Tiff
i used it a little slow compared to Full blow Photoshop but works
it also read the MetaData right.

Thanks for the feedback.  Sounds like it might be a Win vs Mac thing.  What happens if you use Raw2Dng on your Pro, does the exif still display properly?

[TekAzurik]

wait, i've been away on a production shoot. what did i miss about stitching consecutive files together?
how is it done? i  dont have to buy a mark iii now to record past 4gb?

The most recent build starts a new clip once the 4gb limit has been reached.  You can use terminal or command prompt to stitch them together.  On mac open a terminal window in the folder you have the clips, enter the following

cat [file1name].RAW [file2name].R00> [newfilename].RAW

hit enter.  The file will take a bit of time to compile, so don't try to convert it or move it until it shows the right file size.

Don't have a PC but I've seen comments on that process around as well.

[reddeercity]

The most recent build starts a new clip once the 4gb limit has been reached.  You can use terminal or command prompt to stitch them together.  On mac open a terminal window in the folder you have the clips, enter the following

cat [file1name].RAW [file2name].R00> [newfilename].RAW

hit enter.  The file will take a bit of time to compile, so don't try to convert it or move it until it shows the right file size.

Don't have a PC but I've seen comments on that process around as well.

will on the pc Its that easy too, when you get the first 4 GB file and the rest are segmented in 4 GB files
i used "Total Commander" program that joins the file together, there is a Mac Verion i just found at "http://www.codeweavers.com/via/totalcommander8 there is a trial verion there.
then i use the Copy command in a dos window (go to the Start window and type "cmd" )Navigate
to where your 2 files are & input the file names @ the cmd promp type ("copy/B file 1+ file2 new filename" )
just  let it run

[reddeercity]

Thanks for the feedback.  Sounds like it might be a Win vs Mac thing.  What happens if you use Raw2Dng on your Pro, does the exif still display properly?

Just Run the RAW2DNG on my Pro 
yes it look like it, the only thing i don't see is Len info, and iso rating
i just run a quick test on a frame
i was checking the metadata in Adobe Photoshop Elements verion 9
I'm still looking for a alternative to Adobe workflow, without stepping on the
quality.