uncompressed 14-bit RAW video recording

[dfsgfeiuhd]

On the 600d there is no Menu to set the resolution for me, yet people reported that was working before. I am a bit confused. Also, the buffer always fills first before writing the files to card, no co-recording while buffering.

I use the latest nightly build and the latest BeepsTwice.zip.

Is there more files required? I tried two different cards and the feature is not hidden in ML Menu either. Might be a bug.

[DjJuvan]

Developers... this is maybe just my wild idea, but what about using SD card as backup temporary buffer for writing RAW video on CF cards? It could lower the chances of dropping frames because of too slow writing on CF cards and filling the in-camera buffer to quick. It could be than possible to record 1080p videos with slower CF cards too.

Just a thought?

[N/A]

On the 600d there is no Menu to set the resolution for me, yet people reported that was working before. I am a bit confused. Also, the buffer always fills first before writing the files to card, no co-recording while buffering.

I use the latest nightly build and the latest BeepsTwice.zip.

Is there more files required? I tried two different cards and the feature is not hidden in ML Menu either. Might be a bug.

Did you put raw_rec module into the modules folder of the sd card? Works great on my 600D.

[swinxx]

@DjJuvan

check Reply #1117, nearly identical thoughts..

greets

[jpgentry]

The bigger incentive for this would be pushing past 1080P to 2 or 2.5K resolution...

Developers... this is maybe just my wild idea, but what about using SD card as backup temporary buffer for writing RAW video on CF cards? It could lower the chances of dropping frames because of too slow writing on CF cards and filling the in-camera buffer to quick. It could be than possible to record 1080p videos with slower CF cards too.

Just a thought?

[a1ex]

Benchmarks show a speed increase of about 20MB/s. The workflow and coding will be a bit more complex though.

For now, you have a CF+SD benchmark in Debug menu.

[Grunf]

Quick question (please ignore if I'm off kilter here):

Is it feasible to use CPU to shift away 4 bits and generate 8-bit 47MB/s 1080p24 raw file?
It would tax the CPU but it will lower the write speed to "manageable" 47MB/sec for those who don't need full 14-bit of colour?

CPU-assisted memcopy() should be good for approx 73MB/sec, so maybe it would suffice to copy the buffer to memory, do the quick "compression" by shifting away least significant 4 bits in CPU, and then using EDMAC to dump it to CF-card? (if this ARM-implementation has vector OP's that can do shift ops on wide-registers then it might not get so hot )

It would allow 1080p24 4:4:4 8-bit "raw" as many of us sought after for long time and still fit into reasonably quick CF-card bandwith

[savale]

As developer (but not yet involved in the raw_rec recording dev) I see some options to improve the raw recording or add an option for slower cards:

1) if there is enough RAM / Cpu cycles left: I think the best way would be to use lossless compression to do the job. I can imagine this will move the problem to the processor, but there is a chance...

2) add an option to convert to 8bit raw? This will most probably introduces some nasty banding effects, but I am not sure if that is noticeable in real situations? This is quite easy to test and code I guess.

[g3gg0]

As developer (but not yet involved in the raw_rec recording dev) I see some options to improve the raw recording or add an option for slower cards:

1) if there is enough RAM / Cpu cycles left: I think the best way would be to use lossless compression to do the job. I can imagine this will move the problem to the processor, but there is a chance...

2) add an option to convert to 8bit raw? This will most probably introduces some nasty banding effects, but I am not sure if that is noticeable in real situations? This is quite easy to test and code I guess.

both impossible due to CPU being way too slow

[bumkicho]

As developer (but not yet involved in the raw_rec recording dev) I see some options to improve the raw recording or add an option for slower cards:

1) if there is enough RAM / Cpu cycles left: I think the best way would be to use lossless compression to do the job. I can imagine this will move the problem to the processor, but there is a chance...

2) add an option to convert to 8bit raw? This will most probably introduces some nasty banding effects, but I am not sure if that is noticeable in real situations? This is quite easy to test and code I guess.

I can't see why I would want either one of these options for myself. Just buy faster cards.

[ajay]

Another RAW video, but from a perspective as a bird photographer/videoagrapher. I was quite anxious to see how the 5DM3's RAW output would look using birds as a model. Here's a pair of Eastern Bluebirds preening. I filmed in 1920x840 perspective due to bandwidth limitations when using 5x zoom using Trancend's 1000x 32GB card. I have gotten it to work reliably now at 1920 x 1080 but only at 1x not 5x. 5x drops frames @ 1080p.

Also...I have no idea if I am correctly using the 5x mode. I set zoom to 5x, then record through ML's menu. Is this correct? I found that in 5x mode, what I see on the LCD screen is not what is being recorded. The subject that I want centered is usually off to the right or left of the zoomed display. (That's why in 5x mode in this video, the birds are chopped off frame. This test was really to see how the resolution looked at 5x.)

Anyhow...I am so elated to finally get excellent quality video from the 5DM3. I can't thank you guys enough for doing this. I will make a donation today!

Here's the clip...I did color correction and a bit of sharpening to the DNG's.

Thank you ML team!

[a1ex]

I've added live preview in 5x mode, so you can see exactly what you are recording. Just wait for next build.

[ajay]

I've added live preview in 5x mode, so you can see exactly what you are recording. Just wait for next build.

Thanks Alex. I don't know if you realize this, but you guys are making A LOT of frustrated Canon users very happy. 

[savale]

I've added live preview in 5x mode, so you can see exactly what you are recording. Just wait for next build.

Thanks! I suggested probably impossible raw_rec features: (8bit raw or lossless compression). But do you see any other improvement possible for the 5d2 users (because the compact flash card interface seems to be maxed out...)

[g3gg0]

Thanks! I suggested probably impossible raw_rec features: (8bit raw or lossless compression). But do you see any other improvement possible for the 5d2 users (because the compact flash card interface seems to be maxed out...)

answered here:

both impossible due to CPU being way too slow

and we had inspected 14->12 bit reduction hardware, but its too complex yet.

[Mr. Propaganda Guy]

If you guys get this running on the 7D, "Hope you do" you think it'll be possible to use the 2nd processor to add compression to the RAW? If so, what compression would be possible, Mjpeg, ProRes, DNxHD?

[tihon]

Do you mean: recording with 12bit dng raw?

Gonna be really cool! 14 bit is too much as  i think and make the file size to big to rec

[mnememedia]

Hi all,

First, many thanks to the team and all the work they've done so far. Keep it up! The quality afforded by RAW capture is simply stunning. Let me know what you think of my quick sunset shoot I did this evening. As always, be sure to download the original to see the full detail.

[Mr. Propaganda Guy]

What would be the file size of 1 frame at 1920x1080 12bit RAW?

[Brian@202020]

Any chance any of the SD card based Canon DSLR's internal SD hardware can harness the fast data rates of the new Panasonic MicroP2 SD cards? At 2Gb/s they are currently the only UHS-II cards I know of.

http://www.videomaker.com/videonews/2013/04/nab-2013-panasonic-microp2-resizes-p2-to-sd

[Danne]

An easy to follow mac-tutorial focusing on fast conversion to AppleProRes422HQ and a bunch of other stuff like creating xmp-templates, setting upp after effects, premiere pro.

Thanks!
//D

[tihon]

What would be the file size of 1 frame at 1920x1080 12bit RAW?

Approximate RAW file
size on a Nikon D7000   12 bit   14 bit
compressed   12.6 MB   15.7 MB
uncompressed   14.9 MB   18.8 MB

sooo. we can see the difference in %. The filesize is 20% less in 12 bit then 14 bit

[g3gg0]

If you guys get this running on the 7D, "Hope you do" you think it'll be possible to use the 2nd processor to add compression to the RAW? If so, what compression would be possible, Mjpeg, ProRes, DNxHD?

no, none

[g3gg0]

Do you mean: recording with 12bit dng raw?

Gonna be really cool! 14 bit is too much as  i think and make the file size to big to rec

as said, its too complex yet. maybe in 1-2 years

[Grunf]

OK, if using CPU is out of the question then only option is to try to offload the data to CF interface as quick as possible.

As far as I understand, EDMAC has >600MB/sec throughput so as long as CF can swallow it, there is nothing stopping you to record higher resolutions and/or framerates.

Theoretically there is nothing preventing someone from using for example , Ti TMS320VC54x DSP as "faux CF-card" and letting it shuffle data further to SSD.

Current CF UDMA7 raw-interface speed is 167MB/sec so that would suffice for 1080p50 raw