Author Topic: Magic Lantern (RAW) Video format v2.0 (mlv_rec.mo)  (Read 1450103 times)

RenatoPhoto

  • Moderators
  • Hero Member
  • *****
  • Posts: 1509
  • 5DM3 / 7D
Re: Magic Lantern (RAW) Video format v2.0
« Reply #650 on: October 13, 2013, 01:44:20 AM »
Yes, I get a drop in rate every 4 seconds approximately.
It is a repeatable drop, sometimes it skips on cycle and drops at 8 seconds, etc
http://www.pululahuahostal.com  |  EF 300 f/4, EF 100-400 L, EF 180 L, EF-S 10-22, Samyang 14mm, Sigma 28mm EX DG, Sigma 8mm 1:3.5 EX DG, EF 50mm 1:1.8 II, EF 1.4X II, Kenko C-AF 2X

RenatoPhoto

  • Moderators
  • Hero Member
  • *****
  • Posts: 1509
  • 5DM3 / 7D
Re: Magic Lantern (RAW) Video format v2.0
« Reply #651 on: October 13, 2013, 01:55:01 AM »
Also I noticed it is related to idle % calculation.  When the idle shows, the drop in rate becomes regular.  If you push the speed so the idle % disappears also the drop in rate disappears.

For some reason I am also getting these images as if I was pressing screen capture.
http://www.pululahuahostal.com  |  EF 300 f/4, EF 100-400 L, EF 180 L, EF-S 10-22, Samyang 14mm, Sigma 28mm EX DG, Sigma 8mm 1:3.5 EX DG, EF 50mm 1:1.8 II, EF 1.4X II, Kenko C-AF 2X

g3gg0

  • Developer
  • Hero Member
  • *****
  • Posts: 3190
Re: Magic Lantern (RAW) Video format v2.0
« Reply #652 on: October 13, 2013, 02:00:40 AM »
wait, i didnt understand the last post.
you mean CPU idle calculation?
Help us with datasheets - Help us with register dumps
magic lantern: 1Magic9991E1eWbGvrsx186GovYCXFbppY, server expenses: paypal@g3gg0.de
ONLY donate for things we have done, not for things you expect!

RenatoPhoto

  • Moderators
  • Hero Member
  • *****
  • Posts: 1509
  • 5DM3 / 7D
Re: Magic Lantern (RAW) Video format v2.0
« Reply #653 on: October 13, 2013, 02:22:02 AM »
While recording RAW there is a speed indicator in MB/s and next to it appear an idle calculation.  If I start recording at low speeds where I show a big idle then the drop becomes regular every approximately 4 seconds.  If I speed up recording (by increasing frame size or fps) until idle is gone then I get less drops in speed.  If I continue to get close to the maximum speed I get no drops in speed.
http://www.pululahuahostal.com  |  EF 300 f/4, EF 100-400 L, EF 180 L, EF-S 10-22, Samyang 14mm, Sigma 28mm EX DG, Sigma 8mm 1:3.5 EX DG, EF 50mm 1:1.8 II, EF 1.4X II, Kenko C-AF 2X

RenatoPhoto

  • Moderators
  • Hero Member
  • *****
  • Posts: 1509
  • 5DM3 / 7D
Re: Magic Lantern (RAW) Video format v2.0
« Reply #654 on: October 13, 2013, 03:06:37 AM »
Have you enabled some automatic screen capture?  I get bmp files and I never pressed Screen Capture.

I get best speed results with buffer fill method = 0 and  CF-only buffers= 0  At high speed like 95 to 103 MB/s.  (Sometimes zero drops)

Also at the 4GB mark always get drops in speed.
http://www.pululahuahostal.com  |  EF 300 f/4, EF 100-400 L, EF 180 L, EF-S 10-22, Samyang 14mm, Sigma 28mm EX DG, Sigma 8mm 1:3.5 EX DG, EF 50mm 1:1.8 II, EF 1.4X II, Kenko C-AF 2X

swinxx

  • Hero Member
  • *****
  • Posts: 606
Re: Magic Lantern (RAW) Video format v2.0
« Reply #655 on: October 13, 2013, 09:26:23 AM »
Can anyone test mlv format with 48fps?

On a 5d mk3 i have problems with raw and highest resolution. The writing speed is much lower than in 24fps mode. So it is not possible to record more than 500frames.
Greets re

g3gg0

  • Developer
  • Hero Member
  • *****
  • Posts: 3190
Re: Magic Lantern (RAW) Video format v2.0
« Reply #656 on: October 13, 2013, 10:04:04 AM »
Higher fps -> more dma bandwidth needed -> reduced write speed
this is inavoidable.
you can try to switch preview mode to hacked, which will disable the live view functionality.
this squeezes some MiB/s out
Help us with datasheets - Help us with register dumps
magic lantern: 1Magic9991E1eWbGvrsx186GovYCXFbppY, server expenses: paypal@g3gg0.de
ONLY donate for things we have done, not for things you expect!

swinxx

  • Hero Member
  • *****
  • Posts: 606
Re: Magic Lantern (RAW) Video format v2.0
« Reply #657 on: October 13, 2013, 10:55:01 AM »
thx, will try that out.

is there a possibility to record unsqueezed one day or is this not possible?
thx.

RenatoPhoto

  • Moderators
  • Hero Member
  • *****
  • Posts: 1509
  • 5DM3 / 7D
Re: Magic Lantern (RAW) Video format v2.0
« Reply #658 on: October 13, 2013, 02:21:16 PM »
is there a possibility to record unsqueezed one day or is this not possible?
Not possible, line skipping is required to get high fps.
http://www.pululahuahostal.com  |  EF 300 f/4, EF 100-400 L, EF 180 L, EF-S 10-22, Samyang 14mm, Sigma 28mm EX DG, Sigma 8mm 1:3.5 EX DG, EF 50mm 1:1.8 II, EF 1.4X II, Kenko C-AF 2X

vstrglv

  • Senior
  • ****
  • Posts: 253
Re: Magic Lantern (RAW) Video format v2.0
« Reply #659 on: October 13, 2013, 10:04:00 PM »
Tested todays build on 5D3.
Can you upload mlv module for latest build please? (5D3). I can not compile it myself, sorry.
Canon 5D3,1.1.3; Canon EOS M,202,  CF-SanDisk Extreme PRO,160MB/s, 256GB, SD-SanDisk Extreme Pro, 170MB/s, 128GB.

RenatoPhoto

  • Moderators
  • Hero Member
  • *****
  • Posts: 1509
  • 5DM3 / 7D
Re: Magic Lantern (RAW) Video format v2.0
« Reply #660 on: October 13, 2013, 10:18:43 PM »
Can you upload mlv module for latest build please? (5D3). I can not compile it myself, sorry.
You can get it from first page look for pre built
http://www.pululahuahostal.com  |  EF 300 f/4, EF 100-400 L, EF 180 L, EF-S 10-22, Samyang 14mm, Sigma 28mm EX DG, Sigma 8mm 1:3.5 EX DG, EF 50mm 1:1.8 II, EF 1.4X II, Kenko C-AF 2X

vstrglv

  • Senior
  • ****
  • Posts: 253
Re: Magic Lantern (RAW) Video format v2.0
« Reply #661 on: October 13, 2013, 11:36:19 PM »
Thank you very much! I tried this link before - it was very old.
Canon 5D3,1.1.3; Canon EOS M,202,  CF-SanDisk Extreme PRO,160MB/s, 256GB, SD-SanDisk Extreme Pro, 170MB/s, 128GB.

g3gg0

  • Developer
  • Hero Member
  • *****
  • Posts: 3190
Re: Magic Lantern (RAW) Video format v2.0
« Reply #662 on: October 14, 2013, 12:02:23 AM »
Also I noticed it is related to idle % calculation.  When the idle shows, the drop in rate becomes regular.  If you push the speed so the idle % disappears also the drop in rate disappears.

For some reason I am also getting these images as if I was pressing screen capture.

screenshots are nothing new. they are made on stop so you can upload your buffer graph.

the idle time and similar stuff is calculated nearly every write and has no correlation to the performance drop.
see the logs: http://upload.g3gg0.de/pub_files/1ccce7e3382250447649960595a0343e/RAW_REC.TXT
Help us with datasheets - Help us with register dumps
magic lantern: 1Magic9991E1eWbGvrsx186GovYCXFbppY, server expenses: paypal@g3gg0.de
ONLY donate for things we have done, not for things you expect!

g3gg0

  • Developer
  • Hero Member
  • *****
  • Posts: 3190
Re: Magic Lantern (RAW) Video format v2.0
« Reply #663 on: October 14, 2013, 12:03:16 AM »
Also at the 4GB mark always get drops in speed.

thats normal and its better than in the original raw_rec versions.
file open/close operations take their time.
Help us with datasheets - Help us with register dumps
magic lantern: 1Magic9991E1eWbGvrsx186GovYCXFbppY, server expenses: paypal@g3gg0.de
ONLY donate for things we have done, not for things you expect!

RenatoPhoto

  • Moderators
  • Hero Member
  • *****
  • Posts: 1509
  • 5DM3 / 7D
Re: Magic Lantern (RAW) Video format v2.0
« Reply #664 on: October 14, 2013, 01:25:14 AM »
the idle time and similar stuff is calculated nearly every write and has no correlation to the performance drop.

Ok, but I have seen some kind of cycle on 5D3 tests.  The drop sometimes repeats every 4 seconds, sometimes every 2 seconds, sometimes every 8 seconds.  It is not totally repeatable by I see some correlation.  The drop disappears with high demanding rates and appears more frequent when there is some idle % showing.

I hope you can find the couse
http://www.pululahuahostal.com  |  EF 300 f/4, EF 100-400 L, EF 180 L, EF-S 10-22, Samyang 14mm, Sigma 28mm EX DG, Sigma 8mm 1:3.5 EX DG, EF 50mm 1:1.8 II, EF 1.4X II, Kenko C-AF 2X

g3gg0

  • Developer
  • Hero Member
  • *****
  • Posts: 3190
Re: Magic Lantern (RAW) Video format v2.0
« Reply #665 on: October 14, 2013, 08:25:57 AM »
it could be vice versa - as soon the drop rate goes down (due to some other stuff being calcuated or so) the idle time rises.
hard to tell. i guess i will have to start a tskmon trace.
Help us with datasheets - Help us with register dumps
magic lantern: 1Magic9991E1eWbGvrsx186GovYCXFbppY, server expenses: paypal@g3gg0.de
ONLY donate for things we have done, not for things you expect!

escho

  • Contributor
  • Hero Member
  • *****
  • Posts: 563
Re: Magic Lantern (RAW) Video format v2.0
« Reply #666 on: October 15, 2013, 09:26:51 PM »
600D:

Any reasons not to append these changes to the mlv-sources?  mlv_dump doesnt run wifhout for me

Edgar

Shall I create a pull request to ML with the changes in raw.h or will this conflict with existing stuff?

Edgar
https://sternenkarten.com/
600D, 6D, openSUSE Tumbleweed

g3gg0

  • Developer
  • Hero Member
  • *****
  • Posts: 3190
Re: Magic Lantern (RAW) Video format v2.0
« Reply #667 on: October 15, 2013, 10:13:09 PM »
Shall I create a pull request to ML with the changes in raw.h or will this conflict with existing stuff?

Edgar

ah sorry, forgot to reply.
i am afraid this shotgun approach could raise some other problems :)
can you create a pull request for the main repository and check if the original raw_rec still works fine?

Help us with datasheets - Help us with register dumps
magic lantern: 1Magic9991E1eWbGvrsx186GovYCXFbppY, server expenses: paypal@g3gg0.de
ONLY donate for things we have done, not for things you expect!

escho

  • Contributor
  • Hero Member
  • *****
  • Posts: 563
Re: Magic Lantern (RAW) Video format v2.0
« Reply #668 on: October 15, 2013, 11:29:25 PM »
...
can you create a pull request for the main repository and check if the original raw_rec still works fine?

I changed it in my clone of ML-Repo. Raw-Video seems to run fine. I found no problems at the moment.

But

Compiling this whole stuff shows a bunch of compiler warnings like that:

Code: [Select]
../../src/raw.c:858:33: warning: initialization makes pointer from integer without a cast [enabled by default]
../../src/raw.c: In function 'raw_red_pixel_bright':
../../src/raw.c:866:33: warning: initialization makes pointer from integer without a cast [enabled by default]
../../src/raw.c: In function 'raw_green_pixel_bright':

So, regarding these warnings, I don“t have the courage to create a pull request

Edgar
https://sternenkarten.com/
600D, 6D, openSUSE Tumbleweed

1%

  • Developer
  • Hero Member
  • *****
  • Posts: 5936
  • 600D/6D/50D/EOSM/7D
Re: Magic Lantern (RAW) Video format v2.0
« Reply #669 on: October 15, 2013, 11:50:40 PM »
It just makes warnings about comparing those uint_32 to int in other parts of ML source.

RenatoPhoto

  • Moderators
  • Hero Member
  • *****
  • Posts: 1509
  • 5DM3 / 7D
Re: Magic Lantern (RAW) Video format v2.0
« Reply #670 on: October 18, 2013, 01:55:10 PM »
Congratulations g3goo and Alex,  I see you merged the new format RAW 2.0 to the main branch!  I have done a quick test on the 5D3 with and without the spanning function and all seems to work properly.  I will be doing more detailed testing and reporting of the new mlv_rec.mo!

This gives me a very positive feeling for the power that the ML team has, and hope that this serves as a very good example for others to follow.  The cooperation of all the players to bring their knowledge merging their code (and knowledge) back to the main branch is essential to the benefit of ML Team as a whole.   ;D
http://www.pululahuahostal.com  |  EF 300 f/4, EF 100-400 L, EF 180 L, EF-S 10-22, Samyang 14mm, Sigma 28mm EX DG, Sigma 8mm 1:3.5 EX DG, EF 50mm 1:1.8 II, EF 1.4X II, Kenko C-AF 2X

RenatoPhoto

  • Moderators
  • Hero Member
  • *****
  • Posts: 1509
  • 5DM3 / 7D
Re: Magic Lantern (RAW) Video format v2.0
« Reply #671 on: October 18, 2013, 04:32:54 PM »
Only bug so far under cropped mode with preview MLGray or Hacked the LV sometimes remains frozen and requires a re-boot to enable LV.
http://www.pululahuahostal.com  |  EF 300 f/4, EF 100-400 L, EF 180 L, EF-S 10-22, Samyang 14mm, Sigma 28mm EX DG, Sigma 8mm 1:3.5 EX DG, EF 50mm 1:1.8 II, EF 1.4X II, Kenko C-AF 2X

kgv5

  • Hero Member
  • *****
  • Posts: 643
Re: Magic Lantern (RAW) Video format v2.0
« Reply #672 on: October 18, 2013, 07:55:18 PM »
Congratulations g3goo and Alex,  I see you merged the new format RAW 2.0 to the main branch!  I have done a quick test on the 5D3 with and without the spanning function and all seems to work properly.  I will be doing more detailed testing and reporting of the new mlv_rec.mo!

What does it mean exactly? Is mlv in nightly builds now?
www.pilotmovies.pl   5D Mark III, 6D, 550D

RenatoPhoto

  • Moderators
  • Hero Member
  • *****
  • Posts: 1509
  • 5DM3 / 7D
Re: Magic Lantern (RAW) Video format v2.0
« Reply #673 on: October 18, 2013, 08:28:20 PM »
Probably soon.
http://www.pululahuahostal.com  |  EF 300 f/4, EF 100-400 L, EF 180 L, EF-S 10-22, Samyang 14mm, Sigma 28mm EX DG, Sigma 8mm 1:3.5 EX DG, EF 50mm 1:1.8 II, EF 1.4X II, Kenko C-AF 2X

xNiNELiVES

  • Senior
  • ****
  • Posts: 461
  • 5D II, 17-35mm F2.8L, 50mm F1.4, 70-200 F4L
Re: Magic Lantern (RAW) Video format v2.0
« Reply #674 on: October 19, 2013, 12:03:22 AM »
Have the bugs really been sorted out for cameras other than the 5D3? Like the 7D, and 5D2.