Author Topic: New writing strategy - variable buffering  (Read 76035 times)

aaphotog

  • Senior
  • ****
  • Posts: 356
Re: New writing strategy - variable buffering
« Reply #25 on: June 20, 2013, 10:05:49 PM »
Straight from the card, not packaged:

autoexec.bin, raw_rec.mo and 5D3_113.sym
I replaced the files on my sd with these 3 files and the camera wont boot.
Should I be doing something additional?

dariSSight#1

  • New to the forum
  • *
  • Posts: 47
  • Canon 5D Mark II
Re: New writing strategy - variable buffering
« Reply #26 on: June 20, 2013, 10:15:49 PM »
Correct me if I'm mistaking but it's the 5D Mark II & III the top DSLR from Canon and isn't Magic Lantern pulling the most out of these 2 DSLR? I'm just asking because I'm extremely grateful by the work you guys do and I'm hoping you don't stop pushing the 5D Mark II, because I read a lot on these forum about the 6D and other Canon cameras. I just want you guys to give me a straighten out, I would love to hear that 5D Mark II can get variable buffering before I start reading 60D is been tested. I know I know I know, I'm selfish. I'm working on it ;)

g3gg0

  • Developer
  • Hero Member
  • *****
  • Posts: 3183
Re: New writing strategy - variable buffering
« Reply #27 on: June 20, 2013, 10:16:06 PM »
with my buggy CF card it gets now >1k instead of ~100 frames when recording in 1080
Help us with datasheets - Help us with register dumps
magic lantern: 1Magic9991E1eWbGvrsx186GovYCXFbppY, server expenses: paypal@g3gg0.de
ONLY donate for things we have done, not for things you expect!

a1ex

  • Administrator
  • Hero Member
  • *****
  • Posts: 12564
Re: New writing strategy - variable buffering
« Reply #28 on: June 20, 2013, 10:22:03 PM »
Cool :D

The strategy is universal, it's trying to use the available resources in the best possible way. It measures the card speed on the fly.

You can use the module from my previous post on any camera (the code is portable). The autoexec and sym are only for 5D3.

aaphotog

  • Senior
  • ****
  • Posts: 356
Re: New writing strategy - variable buffering
« Reply #29 on: June 20, 2013, 10:27:39 PM »
I figured it out.
SHIT Alex, this is amazing!!!


Recording 2560x1090 on a Sandisk 600x CF 16GB card

with the june 16th build
72 frames with memory hack off, and preview set to auto
120 frames with memory hack on, and preview set to 'HaCKed'



With the new 3 files you posted, i;m getting
142 frames with memory hack off, and preview set to auto
258 frames with memory hack on, and preview set to 'HaCKed'

as you can see, it doubled!

With the CF that I have, I've always been able to get continuous 1920x1080, so I thought I'd go with something a little more demanding.

BRAVO!!!

dubarry

  • New to the forum
  • *
  • Posts: 32
Re: New writing strategy - variable buffering
« Reply #30 on: June 20, 2013, 10:38:14 PM »
WOW!

60D 304 frames  1280x720  16x9   (previously 175 frames)

1728x692  185 frames 2.50

Very nice.

kgv5

  • Hero Member
  • *****
  • Posts: 643
Re: New writing strategy - variable buffering
« Reply #31 on: June 20, 2013, 10:49:56 PM »
I figured it out.

So could you please tell us how did you do that?
I replaced the old raw_rec.mo with the new one from the post #7 in my 6D but no difference. :-\
www.pilotmovies.pl   5D Mark III, 6D, 550D

Viente

  • New to the forum
  • *
  • Posts: 44
Re: New writing strategy - variable buffering
« Reply #32 on: June 20, 2013, 11:04:16 PM »
Awesome job! Got 200 frames in 1920x on 50D in crop mode, was about 70 before.

dariSSight#1

  • New to the forum
  • *
  • Posts: 47
  • Canon 5D Mark II
Re: New writing strategy - variable buffering
« Reply #33 on: June 20, 2013, 11:23:46 PM »
Cool :D

The strategy is universal, it's trying to use the available resources in the best possible way. It measures the card speed on the fly.

You can use the module from my previous post on any camera (the code is portable). The autoexec and sym are only for 5D3.


Cool, I will install and get back to you. By the way does the AutoExec Bin activate the module?

Mido

  • New to the forum
  • *
  • Posts: 7
Re: New writing strategy - variable buffering
« Reply #34 on: June 20, 2013, 11:24:37 PM »
Very nice.
5D3, KomputerBay 128GB 1000x
1920x1080 @25
Before 300 frames
Now 500 frames
Thank you!

a1ex

  • Administrator
  • Hero Member
  • *****
  • Posts: 12564
Re: New writing strategy - variable buffering
« Reply #35 on: June 20, 2013, 11:28:13 PM »
And I've just got a proof that this strategy is far from optimal :D

(read: some more improvements may be coming soon)

Jakobmen

  • Member
  • ***
  • Posts: 122
  • Canon 5D3
Re: New writing strategy - variable buffering
« Reply #36 on: June 20, 2013, 11:58:39 PM »
the Force is strong with you A1EX!  :o
Canon 5D3

dariSSight#1

  • New to the forum
  • *
  • Posts: 47
  • Canon 5D Mark II
Re: New writing strategy - variable buffering
« Reply #37 on: June 21, 2013, 12:01:18 AM »
A1ex are we losing some resolution with variable buffering because the highest resolution with 2.20.1 was 1880x854 but now it's 1872x850 and its not continuous on a Lexar 1000x, but 1856x844 is continuous.

noisyboy

  • Guest
Re: New writing strategy - variable buffering
« Reply #38 on: June 21, 2013, 12:13:49 AM »
Damn A1ex! Congrats  8)

Rush

  • Member
  • ***
  • Posts: 159
  • 5D3, EOS M
Re: New writing strategy - variable buffering
« Reply #39 on: June 21, 2013, 12:18:34 AM »
Canon 600D 24p variable buffer improvements vs old method
(before max seconds -> now max seconds).

W/o line skipping:
1280x720 - 3 > 6 (crop-factor = 2.16)
1280x536 - 6 > 14 (crop-factor = 2.16)

16:9 line skipping (unsqueezed resolution in brackets)
1280x434(720) - 29 > 42 (crop-factor = 2.16)
1344x456(756) - 11 > 27 (crop-factor = 2.06)
1472x500(828) - 5 > 11 (crop-factor = 1.88)
1600x542(900) - 3 > 7 (crop-factor = 1.72)
1728x586(972) - 2 > 5 (crop-factor = 1.6)

2.39:1 line skipping (unsqueezed resolution in brackets)
1472x370(616) - 50 > very long (crop-factor = 1.88)
1600x404(670) - 8 > 19 (crop-factor = 1.72)
1728x436(724) - 5 > 10 (crop-factor = 1.6)

Thank you, a1ex!
Greetings from Russia!

1%

  • Developer
  • Hero Member
  • *****
  • Posts: 5936
  • 600D/6D/50D/EOSM/7D
Re: New writing strategy - variable buffering
« Reply #40 on: June 21, 2013, 01:20:00 AM »
Promising... I wonder what it will do on 600D w/ dialog timers disabled.

lourenco

  • Member
  • ***
  • Posts: 101
Re: New writing strategy - variable buffering
« Reply #41 on: June 21, 2013, 01:58:15 AM »
2560 x 1072 23.976 fps over 700 frames before frame skipping.  104 MB/s.
5D Mark III, CF Lexar 1000X 32GB, 24-105 F4L

squig

  • Hero Member
  • *****
  • Posts: 518
  • Crash test dummy MK3
Re: New writing strategy - variable buffering
« Reply #42 on: June 21, 2013, 02:15:08 AM »
1920x448 (720) 60p 309 frames pre variable buffer, 436 frames with variable buffer. That's about 18 seconds of 2.67:1 slo-mo, very usable. 1968 frames hacked. The pre variable build needed 4 or 5 recordings to warm up to the 309 frames.

2560x960 24p continuous in crop mode.  ;D

1920 x 508 (818) 48p continuous.

Lexar 1000x 64Gb GD off.

1920x448 60p 568 frames with the Toshiba 1066x 64Gb.

Edgar Matos

  • Freshman
  • **
  • Posts: 60
Re: New writing strategy - variable buffering
« Reply #43 on: June 21, 2013, 03:06:45 AM »
Promising... I wonder what it will do on 600D w/ dialog timers disabled.

Magic! But I'm still fixing the wetting problem. I think a bib can do wonders.

xNiNELiVES

  • Senior
  • ****
  • Posts: 461
  • 5D II, 17-35mm F2.8L, 50mm F1.4, 70-200 F4L
Re: New writing strategy - variable buffering
« Reply #44 on: June 21, 2013, 03:31:46 AM »
Where Do you enable this? Do I need to format the card to have certain buffer size for this to work optimally?

ilguercio

  • Hero Member
  • *****
  • Posts: 845
Re: New writing strategy - variable buffering
« Reply #45 on: June 21, 2013, 03:52:09 AM »
1280*720 on my 60D went from 335 to 379-381 frames before skipping at 23.976 fps.
Canon EOS 6D, 60D, 50D.
Sigma 70-200 EX OS HSM, Sigma 70-200 Apo EX HSM, Samyang 14 2.8, Samyang 35 1.4, Samyang 85 1.4.
Proud supporter of Magic Lantern.

squig

  • Hero Member
  • *****
  • Posts: 518
  • Crash test dummy MK3
Re: New writing strategy - variable buffering
« Reply #46 on: June 21, 2013, 03:52:24 AM »
You don't enable it, it's built into the raw_rec code.

xNiNELiVES

  • Senior
  • ****
  • Posts: 461
  • 5D II, 17-35mm F2.8L, 50mm F1.4, 70-200 F4L
Re: New writing strategy - variable buffering
« Reply #47 on: June 21, 2013, 03:54:54 AM »
You don't enable it, it's built into the raw_rec code.


But what about setting the buffer size on the card?

ilguercio

  • Hero Member
  • *****
  • Posts: 845
Re: New writing strategy - variable buffering
« Reply #48 on: June 21, 2013, 03:59:54 AM »


But what about setting the buffer size on the card?
And what would this mean?
A card is a card, a buffer is a buffer.
The buffer is in the camera, the card can just do whatever possible to sustain the data rate if it's capable of doing it.
Canon EOS 6D, 60D, 50D.
Sigma 70-200 EX OS HSM, Sigma 70-200 Apo EX HSM, Samyang 14 2.8, Samyang 35 1.4, Samyang 85 1.4.
Proud supporter of Magic Lantern.

xNiNELiVES

  • Senior
  • ****
  • Posts: 461
  • 5D II, 17-35mm F2.8L, 50mm F1.4, 70-200 F4L
Re: New writing strategy - variable buffering
« Reply #49 on: June 21, 2013, 04:00:48 AM »
And what would this mean?
A card is a card, a buffer is a buffer.

I meant cluster size  :-\