Author Topic: uncompressed 14-bit RAW video recording  (Read 747161 times)

lourenco

  • Member
  • ***
  • Posts: 101
Re: uncompressed 14-bit RAW video recording
« Reply #1075 on: May 17, 2013, 01:36:21 AM »
Current 5D3 update files only : https://drive.google.com/folderview?id=0B7QlH_BH2m32cW5mUW80VFlzSWc&usp=sharing

Complete Current 5D3 : https://docs.google.com/file/d/0B7QlH_BH2m32dWpOOEpkWktXMXM/edit?usp=sharing

Current as of last commit : fixed edmac_memcpy to clean up CBRs correctly.
5D Mark III, CF Lexar 1000X 32GB, 24-105 F4L

g3gg0

  • Developer
  • Hero Member
  • *****
  • Posts: 3143
Re: uncompressed 14-bit RAW video recording
« Reply #1076 on: May 17, 2013, 01:40:43 AM »
i just committed another fix (rev 6919)
Help us with datasheets - Help us with register dumps
magic lantern: 1Magic9991E1eWbGvrsx186GovYCXFbppY, server expenses: paypal@g3gg0.de
ONLY donate for things we have done, not for things you expect!

cinema5D

  • New to the forum
  • *
  • Posts: 14
Re: uncompressed 14-bit RAW video recording
« Reply #1077 on: May 17, 2013, 01:53:58 AM »
You may want to avoid recommending the 128GB version of the KomputerBay CF card. Evidence is building that the 128 version had slower real world write speeds than the 64.

Hey there. We're using 2 Komputerbay 128GB cards and they're both holding up great, we never get dropped frames except for the first recording after formatting usually and we shot lots and lots of things already, on both cards. We also tried the higher resolutions, but the firmware limits it to not much more than 1080p.

Here's the simplest post workflow in OSX we found around here, and we think it's most easy after going through hell two days ago: https://vimeo.com/66355682

After that we tried to do some nightshots but unfortunately we couldn't manage to get the shutter locked. If there is any info you can give us, or if that is a feature not yet enabled please let us know.
Specifically since we're in Europe we need a 1/50th shutter, but the system keeps jumping back to 1/46th no matter what we do/change/select/lock in the menu. Thanks for any hints.

Also 25p would be tremendous. We had a discussion today about wether the Europeans would be taken care of. We've had very bad experience there with the manufacturers in the past  :-X.

Keep up the amazing work, you guys are building something thats exciting for all movieshooters :)

aaphotog

  • Senior
  • ****
  • Posts: 356
Re: uncompressed 14-bit RAW video recording
« Reply #1078 on: May 17, 2013, 01:54:31 AM »
Current 5D3 update files only : https://drive.google.com/folderview?id=0B7QlH_BH2m32cW5mUW80VFlzSWc&usp=sharing

Complete Current 5D3 : https://docs.google.com/file/d/0B7QlH_BH2m32dWpOOEpkWktXMXM/edit?usp=sharing

Current as of last commit : fixed edmac_memcpy to clean up CBRs correctly.
I have a question. Is there a reason as to why you add the 'raw2dng' file in all of the uploads?
Im just curious if thats something thats supposed to be placed on my memory stick, or is that simply for the computer to convert the recorded raw files and you only upload so the downloaders will have it in case they never got it?

KMA_WWC

  • Freshman
  • **
  • Posts: 70
Re: uncompressed 14-bit RAW video recording
« Reply #1079 on: May 17, 2013, 01:57:45 AM »
A little update regarding the KomputerBay cards...

You may want to avoid recommending the 128GB version of the KomputerBay CF card. Evidence is building that the 128 version had slower real world write speeds than the 64. This prevents 1080p raw recording since the 128 doesn’t seem to attain the 83MB/s minimum write required for 1080p raw recording. The 64GB version seems to test at 90+ MB/s write while the 128GB version tests at 60-70 MB/s write.  It turns out that Andrew from EOSHD was using the 64gb variety of the KomputerBay card for his Raw tests, which is why he was able to utilize even greater than 1080p raw without dropped frames.  This is all still unproven but I just returned my 128gb and ordered two 64gb to see for myself.
Hey there! That's what I did today! Check reply #1067
I also noticed that komputerbay tests itself show that 64gb is much faster than 128gb, I don't know how I missed that before buying.
Canon 5D Mark III

N/A

  • Hero Member
  • *****
  • Posts: 576
  • Dreaming in 14 bit
Re: uncompressed 14-bit RAW video recording
« Reply #1080 on: May 17, 2013, 01:58:47 AM »
Another 600D Raw video.


Rokinon Cine, Sandisk 95. Rendering the DNG's out of After Effects into ProRes 4444, loading them up into FCPX and doing the rest of the editing.

Compressed with Mpeg StreamClip from ProRes 4444 to mp4 for Youtube uploading.
7D. 600D. Rokinon 35 cine. Sigma 30 1.4
Audio and video recording/production, Random Photography
Want to help with the latest development but don't know how to compile?

lourenco

  • Member
  • ***
  • Posts: 101
Re: uncompressed 14-bit RAW video recording
« Reply #1081 on: May 17, 2013, 01:59:32 AM »
I have a question. Is there a reason as to why you add the 'raw2dng' file in all of the uploads?
Im just curious if thats something thats supposed to be placed on my memory stick, or is that simply for the computer to convert the recorded raw files and you only upload so the downloaders will have it in case they never got it?

You may not need to worry about the raw2dng  file if you have one. There was a update about 2 days ago. If you already have that current version, you do not need to replace it.
5D Mark III, CF Lexar 1000X 32GB, 24-105 F4L

aaphotog

  • Senior
  • ****
  • Posts: 356
Re: uncompressed 14-bit RAW video recording
« Reply #1082 on: May 17, 2013, 02:04:13 AM »
You may not need to worry about the raw2dng  file if you have one. There was a update about 2 days ago. If you already have that current version, you do not need to replace it.
O Ok, thanks for clarifying that.
Im using the one built by a forum member here.
the mac app version.
Hopefully it doesn't need an update. If you don't mind me asking, what was updated in it? Was it the ability to correctly split the 4gb files or something like that?

lourenco

  • Member
  • ***
  • Posts: 101
Re: uncompressed 14-bit RAW video recording
« Reply #1083 on: May 17, 2013, 02:06:19 AM »
O Ok, thanks for clarifying that.
Im using the one built by a forum member here.
the mac app version.
Hopefully it doesn't need an update. If you don't mind me asking, what was updated in it? Was it the ability to correctly split the 4gb files or something like that?
"a1ex committed 2 days ago (raw commit)
raw2dng: fix for files larger than 2GB
"
It works fine on 4GB files.
5D Mark III, CF Lexar 1000X 32GB, 24-105 F4L

KMA_WWC

  • Freshman
  • **
  • Posts: 70
Re: uncompressed 14-bit RAW video recording
« Reply #1084 on: May 17, 2013, 02:08:31 AM »
Lourenco, first of all huge thanks for the new build. Just installed it. One question though. Is there any way to change the resolution like in old builds or is it 1080p only? thanks in advance!

UPD: Never mind found it :) thanks
Canon 5D Mark III

rossangeles

  • New to the forum
  • *
  • Posts: 1
Re: uncompressed 14-bit RAW video recording
« Reply #1085 on: May 17, 2013, 02:22:36 AM »
Did a quick test under less than ideal circumstances. The kind that I'm usually shooting in. Movement. Shadows and light. Highlight recovery. Skin tones. Canon 5d Mark III. 24 mm L series. 3.2 KomputerBay 128 mb. 1080 x 720  http://rossangeles.org/rosspile/trucking_web.mov 

eatstoomuchjam

  • New to the forum
  • *
  • Posts: 41
Re: uncompressed 14-bit RAW video recording
« Reply #1086 on: May 17, 2013, 02:57:16 AM »
1920x1080p on my 5D Mark III (and 24-105/4L) from a few days ago at the celebration for legal marriage equality in Minnesota.  The footage is pretty crude since I was just  goofing around handheld.  This was done with a build known for light frame skipping so I was getting about 8 skipped frames per 4G file on a Lexar 32G 1000x card.  After tweaking the footage in AE, the intermediate renders in 10-bit DNxHD look good enough to keep (and Premiere plays them back like a dream).
Incidentally, it was about 90 degrees and I was shooting off and on for a couple of hours.  No overheating problems evident.


squig

  • Hero Member
  • *****
  • Posts: 515
  • Crash test dummy MK3
Re: uncompressed 14-bit RAW video recording
« Reply #1087 on: May 17, 2013, 02:58:43 AM »
How many secs do you get on a take?

I haven't timed it but I can keep recording up to the 4.2Gb limit.

squig

  • Hero Member
  • *****
  • Posts: 515
  • Crash test dummy MK3
Re: uncompressed 14-bit RAW video recording
« Reply #1088 on: May 17, 2013, 03:02:55 AM »
VisionColor is developing VisionColor, VisionLog, and CineTech for Adobe Camera Raw and Lightroom.

Perfect! I guess I can stop working on the sLUT then. I really like visioncolor/tech, it's a good improvement on prolost.

1%

  • Developer
  • Hero Member
  • *****
  • Posts: 5936
  • 600D/6D/50D/EOSM/7D
Re: uncompressed 14-bit RAW video recording
« Reply #1089 on: May 17, 2013, 03:06:58 AM »
I feel like the refactoring lowered write speed somehow.. I'm getting less frames.... either that or the card is getting slower?

Now in photo mode non LV it takes all the memory and you have to turn it off before LV will start.

Digital Corpus

  • Freshman
  • **
  • Posts: 64
Re: uncompressed 14-bit RAW video recording
« Reply #1090 on: May 17, 2013, 03:09:48 AM »
@platu, glad I can give some insight.

I'll try this new one. It frames fall!

It is on this I was able to record 1920 x 1080 25 fps and 1920 x 1280 25 fps :D
http://yadi.sk/d/0ogqyTkb4uUvL
1920x1280 @ 25 fps --> 2,457,600 pixels, 14 bpp @ 25 fps --> 102.5 MB/sec
If it was at 24 fps, you'd only need about 98.4 MB/sec.

As demonstrated by real world testing of 1080p RAW video, on would need a card that performs few extra percent, ~3%-5%, above this number in order to safely record the video without dropped frames.

These are my little tests. The very short edits are because this is how long I can record at 1880x720. You may also notice some jumping too. Of course this is far from perfect.

http://www.youtube.com/watch?feature=player_detailpage&v=p9uZXUGDJSA

Recorded on the 5DMKII with DURACELL Pro Photo 600x UDMA 16GB CF card. I think the build I was using was the one from the 13th?

I have ordered a Komputerbay 1000x 32Gb and am hoping that it will improve the situation (reading the posts on here I am glad I chose the 32Gb one instead of the 128Gb)
1880x720 @ 24 fps --> 1,353,600 pixels, 14 bpp @ 24 fsp --> ~54.2 MB/sec
This speed coincides directly with your memory card. That KomputerBay one will do the trick.

I feel like the refactoring lowered write speed somehow.. I'm getting less frames.... either that or the card is getting slower?

Now in photo mode non LV it takes all the memory and you have to turn it off before LV will start.
If you're still having write speed issues, try a low level or full format of the card to see if that helps.
7D w/ ML | 30D | 17-55 f/2.8 IS | 70-200 f/4 L | Tokina ATX 116

platu

  • Freshman
  • **
  • Posts: 98
  • 5D3, 60D
Re: uncompressed 14-bit RAW video recording
« Reply #1091 on: May 17, 2013, 03:15:23 AM »
I feel like the refactoring lowered write speed somehow.. I'm getting less frames.... either that or the card is getting slower?

Now in photo mode non LV it takes all the memory and you have to turn it off before LV will start.

Same here... getting less frames as well.   Also, the 900 vertical resolution was removed since the last build.  1920x900 was my maximum baseline resolution I was using that had no dropped frames.  Can this be added back?

1%

  • Developer
  • Hero Member
  • *****
  • Posts: 5936
  • 600D/6D/50D/EOSM/7D
Re: uncompressed 14-bit RAW video recording
« Reply #1092 on: May 17, 2013, 03:30:40 AM »
I still kept 900. Now it seems write starts of fast and then drops off slowly. I was doing 1500 frames now doing way less same res.

lourenco

  • Member
  • ***
  • Posts: 101
Re: uncompressed 14-bit RAW video recording
« Reply #1093 on: May 17, 2013, 03:34:54 AM »
Same here... getting less frames as well.   Also, the 900 vertical resolution was removed since the last build.  1920x900 was my maximum baseline resolution I was using that had no dropped frames.  Can this be added back?

https://drive.google.com/folderview?id=0B7QlH_BH2m32Q1FMeHBBQVVmb3M&usp=sharing 
5D Mark III, CF Lexar 1000X 32GB, 24-105 F4L

Luiz Roberto dos Santos

  • Member
  • ***
  • Posts: 162
  • be.net/LuizRoberto vimeo.com/luizroberto
Re: uncompressed 14-bit RAW video recording
« Reply #1094 on: May 17, 2013, 03:35:29 AM »
Another 600D Raw video.


Rokinon Cine, Sandisk 95. Rendering the DNG's out of After Effects into ProRes 4444, loading them up into FCPX and doing the rest of the editing.

Compressed with Mpeg StreamClip from ProRes 4444 to mp4 for Youtube uploading.


What is your maximum recording time?
Very good, we are progressing here! :D

KMA_WWC

  • Freshman
  • **
  • Posts: 70
Re: uncompressed 14-bit RAW video recording
« Reply #1095 on: May 17, 2013, 03:48:45 AM »
Not trying to be a controversial, but new build is much improved for me.

Here are the results:

Old build May 14:

No drop frames before 1080p
1920x1080 7-9 dropped frames
1920x1152 3-5 seconds of recording and after that drop frames all over the place

New build, today's:
1920x1080 no drop frames at all.
1920x1152 15-20 second of recording/vary

I use SanDisk 32BG Extreme Pro card which performs btw pretty good.
Canon 5D Mark III


bumkicho

  • Member
  • ***
  • Posts: 102
Re: uncompressed 14-bit RAW video recording
« Reply #1097 on: May 17, 2013, 03:58:34 AM »
Does anyone know when we may expect to be able to test file spanning?

Roars

  • New to the forum
  • *
  • Posts: 1
Re: uncompressed 14-bit RAW video recording
« Reply #1098 on: May 17, 2013, 04:19:49 AM »
so i have a couple of thought to throw out hear

what is the Colour Chroma Subsampling when shooting in Raw is it 4:2:2 or 4:4:4 the 5d is 4:2:0 as standerd

could some of the issues with the Sd cards be solved by using a SSd, ie a ninja (cos you can get a better bit rate [10-12mb] out of the hdmi export onto a ninja than you can standerd [8mb]) but i dont think that would work cos you cant export raw data down the hdmi maybe if you could retro fit a ssd direct to the 5d.

and the bit rate is that hardwere limeted to 14 bits or the hack or the card

more over how do these raw files stack up to red as to my knowledge there the only people to use raw (i think arri might to)

why does all the raw test footage look abit darker is that simply a byproduct of more detail

so raw on dslrs has been proven so why has cannon not thought of this

also what are you guy editing on final cut 7 cant realy handle HD let alone raw. i was told only avid could truly edit .raw but you can convert it [woudnt you loos the ability to edit the exposure and stuff if you did that]

are you useing redcode edding ?

N/A

  • Hero Member
  • *****
  • Posts: 576
  • Dreaming in 14 bit
Re: uncompressed 14-bit RAW video recording
« Reply #1099 on: May 17, 2013, 04:21:44 AM »

What is your maximum recording time?
Very good, we are progressing here! :D
The colors are mind blowing compared to h264. Haven't tested maximum yet, Ive done a solid 20 secs of frames though.
7D. 600D. Rokinon 35 cine. Sigma 30 1.4
Audio and video recording/production, Random Photography
Want to help with the latest development but don't know how to compile?