Author Topic: uncompressed 14-bit RAW video recording  (Read 1115568 times)

CFP

  • Member
  • ***
  • Posts: 185
Re: uncompressed YUV422 and 14-bit RAW video recording
« Reply #200 on: May 10, 2013, 11:41:00 PM »
I can't say CPU doesn't matter... running those benchmarks with new peaking enabled absolutely kills memcpy.
I can confirm this. I've just tried the card benchmark with Global Draw on (All features enabled) and off like you suggested, a1ex. And with GD I've got about 1/3 of the writing speed that I've got without GD. At the end my 600D actually overheated!  :(

I hope that helps you a little bit, because I'd really like to see how much DNG frames you'll get out of our cameras in the future.

May I ask if you have already found a way to edit the LV_Rec images? I know that things like this need time and I don't want to push you. I am just curious. And I'm still very excited about this feature. Are you more pessimistic or optimistic regarding the development?

I apologize if I'm bothering you. Just don't answer if you don't want to :)

Anyway, thanks a lot for what you've already done. I really appreciate your work! ML is fantastic  :D

Also I would like to help you, but since I'm only familiar with Java, I guess there's no way I can help you apart from testing?

N.Mendes

  • New to the forum
  • *
  • Posts: 43
Re: uncompressed YUV422 and 14-bit RAW video recording
« Reply #201 on: May 10, 2013, 11:52:39 PM »
It was in 422 YUV. Not in Raw mode.

Thanks, did you try to enable the raw mode (by hitting "don't click me")?

Some guys tested it (CF+SD) and i don't know if they were able to obtain a continuous recording, it would be awesome..

g3gg0

  • Developer
  • Hero Member
  • *****
  • Posts: 3190
Re: uncompressed YUV422 and 14-bit RAW video recording
« Reply #202 on: May 11, 2013, 12:07:57 AM »
I can't say CPU doesn't matter...

i think he meant EDMAC performance which is decoupled from CPU
Help us with datasheets - Help us with register dumps
magic lantern: 1Magic9991E1eWbGvrsx186GovYCXFbppY, server expenses: paypal@g3gg0.de
ONLY donate for things we have done, not for things you expect!

1%

  • Developer
  • Hero Member
  • *****
  • Posts: 5936
  • 600D/6D/50D/EOSM/7D
Re: uncompressed YUV422 and 14-bit RAW video recording
« Reply #203 on: May 11, 2013, 01:15:52 AM »
I guess it wouldn't. The benchmark for edmac does drop when new peaking is enabled. GD and no GD also makes some difference.

I think its not as much of a problem for the edmac anyway... mainly how many frames can be stored and how fast they can be written. Extra 20MB even goes a ways.... it did on 600D with sraw. I get almost as many frames as on 6D.

budafilms

  • Hero Member
  • *****
  • Posts: 711
  • 5D Mark a1ex
Re: uncompressed YUV422 and 14-bit RAW video recording
« Reply #204 on: May 11, 2013, 07:35:52 AM »
A simple question: can the hardware of any CANON DSRL process all that information that we are trying to get?

a1ex

  • Administrator
  • Hero Member
  • *****
  • Posts: 12564
Re: uncompressed YUV422 and 14-bit RAW video recording
« Reply #205 on: May 11, 2013, 02:50:50 PM »
Just added a RAW to DNG converter: https://bitbucket.org/hudson/magic-lantern/commits/5bc3488c7a78

It's just a small command-line tool. Feel free to build a nice GUI on top of it.

For some reason, I couldn't compile it in 64-bit mode, so you may need the 32-bit compatibility libraries. Fixes are welcome ;)

With a little luck, this program may work under Windows too.

lourenco

  • Member
  • ***
  • Posts: 101
Re: uncompressed YUV422 and 14-bit RAW video recording
« Reply #206 on: May 11, 2013, 04:17:15 PM »
In raw mode?
I did a quick test in Raw mode. I wanted to see how much higher I could do above 720p. I tried 1928x850 and 1928x902. I think it was 902. 902 the buffer would fill up and video stops after 700 frames or so.  At 850 I am able to get continuous recordings.

The best I am able to obtain in Raw mode right now is continuous 1928x850 at 24fps. I plan to crop the video to 1920x817 to do 2.35:1 wide screen aspect ratio, which is about 1920x817. The video will have black bars on top and bottom to output at 1920x1080.
5D Mark III, CF Lexar 1000X 32GB, 24-105 F4L

1%

  • Developer
  • Hero Member
  • *****
  • Posts: 5936
  • 600D/6D/50D/EOSM/7D
Re: uncompressed YUV422 and 14-bit RAW video recording
« Reply #207 on: May 11, 2013, 04:23:59 PM »
Raw mode accounts for size like yuv mode? Looks like 1 size hardcoded from what I see. Also how to unload modules, right now it just beeps.... I think it was supposed to be something like prop_unregister_slave but I don't see it defined on 5d3.

I get seg fault with the converter for some reason:

raw2dng[15429]: segfault at b7788f08 ip 08048dd0 sp bfda8dfc error 4 in raw2dng[8048000+2000]

segfaults on both PCs

lourenco

  • Member
  • ***
  • Posts: 101
Re: uncompressed YUV422 and 14-bit RAW video recording
« Reply #208 on: May 11, 2013, 07:04:47 PM »
Just added a RAW to DNG converter: https://bitbucket.org/hudson/magic-lantern/commits/5bc3488c7a78

Cool. I compiled it and works for me. I was able to convert my raw movie file to DNG files.
5D Mark III, CF Lexar 1000X 32GB, 24-105 F4L

kgv5

  • Hero Member
  • *****
  • Posts: 643
Re: uncompressed YUV422 and 14-bit RAW video recording
« Reply #209 on: May 11, 2013, 07:14:18 PM »
Did you make it for windows? Could you share your compilation with the rest? Thanks
www.pilotmovies.pl   5D Mark III, 6D, 550D

1%

  • Developer
  • Hero Member
  • *****
  • Posts: 5936
  • 600D/6D/50D/EOSM/7D
Re: uncompressed YUV422 and 14-bit RAW video recording
« Reply #210 on: May 11, 2013, 07:30:22 PM »
Worked on a raw movie but for 5d3, right?

lourenco

  • Member
  • ***
  • Posts: 101
Re: uncompressed YUV422 and 14-bit RAW video recording
« Reply #211 on: May 11, 2013, 07:55:36 PM »
Worked on a raw movie but for 5d3, right?
Yes.
5D Mark III, CF Lexar 1000X 32GB, 24-105 F4L

lourenco

  • Member
  • ***
  • Posts: 101
Re: uncompressed YUV422 and 14-bit RAW video recording
« Reply #212 on: May 11, 2013, 07:57:13 PM »
Did you make it for windows? Could you share your compilation with the rest? Thanks

It is just for Linux for now. This would be a good project for mindogas given he already has the 422 converter for Windows.
5D Mark III, CF Lexar 1000X 32GB, 24-105 F4L

1%

  • Developer
  • Hero Member
  • *****
  • Posts: 5936
  • 600D/6D/50D/EOSM/7D
Re: uncompressed YUV422 and 14-bit RAW video recording
« Reply #213 on: May 11, 2013, 08:07:33 PM »
I keep getting seg faults from the size, no matter what size I set:

Single file from 600D, W/H set to what dng burst reports

http://www.qfpost.com/file/d?g=4ED0ZAaJN

Single file from 6D http://www.qfpost.com/file/d?g=v8T0Ryl5m

minimimi

  • Freshman
  • **
  • Posts: 68
Re: uncompressed YUV422 and 14-bit RAW video recording
« Reply #214 on: May 11, 2013, 08:34:20 PM »
I keep getting seg faults from the size, no matter what size I set:

Single file from 600D, W/H set to what dng burst reports

http://www.qfpost.com/file/d?g=4ED0ZAaJN

Single file from 6D http://www.qfpost.com/file/d?g=v8T0Ryl5m

I tried your 2files. Both are ...
Code: [Select]
$ ./raw2dng I0000000.RAW
Error: This ain't a lv_rec RAW file

So I guess you may upgrade lv_rec.mo first.
Alex added file footer to RAW in current code.
YOur file has no footer I guess.

1%

  • Developer
  • Hero Member
  • *****
  • Posts: 5936
  • 600D/6D/50D/EOSM/7D
Re: uncompressed YUV422 and 14-bit RAW video recording
« Reply #215 on: May 11, 2013, 08:38:50 PM »
Its a single file, lv_rec is latest one. For some reason footers aren't being written/read for single files.... After getting rid of thumbnail now my problem is size.

Files come out purple with line skips... I think width is wrong somehow.

Here is a big 600D with footer:

http://www.qfpost.com/file/d?g=upRO7f8YH

lourenco

  • Member
  • ***
  • Posts: 101
Re: uncompressed YUV422 and 14-bit RAW video recording
« Reply #216 on: May 11, 2013, 09:17:13 PM »
Its a single file, lv_rec is latest one. For some reason footers aren't being written/read for single files
I also having the same problem just tried individual frames and single file for yuv 422 and both do not have any footer information on the latest lv_rec.
5D Mark III, CF Lexar 1000X 32GB, 24-105 F4L

a1ex

  • Administrator
  • Hero Member
  • *****
  • Posts: 12564
Re: uncompressed YUV422 and 14-bit RAW video recording
« Reply #217 on: May 11, 2013, 09:18:47 PM »
This converter is only for movie files, not for single frames.

1%

  • Developer
  • Hero Member
  • *****
  • Posts: 5936
  • 600D/6D/50D/EOSM/7D
Re: uncompressed YUV422 and 14-bit RAW video recording
« Reply #218 on: May 12, 2013, 12:11:51 AM »
How can I find the correct sizes? Shouldn't they match what DNG burst outputs?

lourenco

  • Member
  • ***
  • Posts: 101
Re: uncompressed YUV422 and 14-bit RAW video recording
« Reply #219 on: May 12, 2013, 02:20:01 AM »
Raw video test 12 seconds 2.35:1 aspect ratio
vs
standard i-frame
5D Mark III, CF Lexar 1000X 32GB, 24-105 F4L

ted ramasola

  • Moderators
  • Hero Member
  • *****
  • Posts: 1251
Re: uncompressed YUV422 and 14-bit RAW video recording
« Reply #220 on: May 12, 2013, 02:31:08 AM »
If those 2 videos have the same lens settings... that is a wow in terms of detail!

Is 12 sec the max right now at the current build?
5DmkII  / 7D
www.ramasolaproductions.com
Texas

lourenco

  • Member
  • ***
  • Posts: 101
Re: uncompressed YUV422 and 14-bit RAW video recording
« Reply #221 on: May 12, 2013, 02:36:59 AM »
If those 2 videos have the same lens settings... that is a wow in terms of detail!

Is 12 sec the max right now at the current build?

At that aspect ratio I can record continuous at 24fps. It helps to have a 5d Mark III with Lexar CF 1000x 32GB card. DNG files take awhile to process on my computer in AE. Yes, the settings were the same. when I was recording i-frame, I used Technicolor CineStyle.
5D Mark III, CF Lexar 1000X 32GB, 24-105 F4L

ted ramasola

  • Moderators
  • Hero Member
  • *****
  • Posts: 1251
Re: uncompressed YUV422 and 14-bit RAW video recording
« Reply #222 on: May 12, 2013, 02:50:04 AM »
Thanks. Wow!

Please clarify when you say continuous, do you mean you can shoot longer than 12 seconds? Have you tested how long you can go?
5DmkII  / 7D
www.ramasolaproductions.com
Texas

squig

  • Hero Member
  • *****
  • Posts: 518
  • Crash test dummy MK3
Re: uncompressed YUV422 and 14-bit RAW video recording
« Reply #223 on: May 12, 2013, 02:52:59 AM »
What's the file size of each 1928x850 DNG frame?

lourenco

  • Member
  • ***
  • Posts: 101
Re: uncompressed YUV422 and 14-bit RAW video recording
« Reply #224 on: May 12, 2013, 03:15:16 AM »
What's the file size of each 1928x850 DNG frame?
It is about 3.08MB. I have since deleted those files. My youtube video has 1928x820 frames, which is closer to the accepted 2.35:1 aspect ratio. The file size is 2.98MB for those.
5D Mark III, CF Lexar 1000X 32GB, 24-105 F4L