Magic Lantern (RAW) Video format v2.0 (mlv_rec.mo)

Started by g3gg0, July 15, 2013, 10:58:23 PM

Previous topic - Next topic

0 Members and 1 Guest are viewing this topic.

RenatoPhoto

Yes, I get a drop in rate every 4 seconds approximately.
It is a repeatable drop, sometimes it skips on cycle and drops at 8 seconds, etc
http://www.pululahuahostal.com  |  EF 300 f/4, EF 100-400 L, EF 180 L, EF-S 10-22, Samyang 14mm, Sigma 28mm EX DG, Sigma 8mm 1:3.5 EX DG, EF 50mm 1:1.8 II, EF 1.4X II, Kenko C-AF 2X

RenatoPhoto

Also I noticed it is related to idle % calculation.  When the idle shows, the drop in rate becomes regular.  If you push the speed so the idle % disappears also the drop in rate disappears.

For some reason I am also getting these images as if I was pressing screen capture.
http://www.pululahuahostal.com  |  EF 300 f/4, EF 100-400 L, EF 180 L, EF-S 10-22, Samyang 14mm, Sigma 28mm EX DG, Sigma 8mm 1:3.5 EX DG, EF 50mm 1:1.8 II, EF 1.4X II, Kenko C-AF 2X

g3gg0

wait, i didnt understand the last post.
you mean CPU idle calculation?
Help us with datasheets - Help us with register dumps
magic lantern: 1Magic9991E1eWbGvrsx186GovYCXFbppY, server expenses: [email protected]
ONLY donate for things we have done, not for things you expect!

RenatoPhoto

While recording RAW there is a speed indicator in MB/s and next to it appear an idle calculation.  If I start recording at low speeds where I show a big idle then the drop becomes regular every approximately 4 seconds.  If I speed up recording (by increasing frame size or fps) until idle is gone then I get less drops in speed.  If I continue to get close to the maximum speed I get no drops in speed.
http://www.pululahuahostal.com  |  EF 300 f/4, EF 100-400 L, EF 180 L, EF-S 10-22, Samyang 14mm, Sigma 28mm EX DG, Sigma 8mm 1:3.5 EX DG, EF 50mm 1:1.8 II, EF 1.4X II, Kenko C-AF 2X

RenatoPhoto

Have you enabled some automatic screen capture?  I get bmp files and I never pressed Screen Capture.

I get best speed results with buffer fill method = 0 and  CF-only buffers= 0  At high speed like 95 to 103 MB/s.  (Sometimes zero drops)

Also at the 4GB mark always get drops in speed.
http://www.pululahuahostal.com  |  EF 300 f/4, EF 100-400 L, EF 180 L, EF-S 10-22, Samyang 14mm, Sigma 28mm EX DG, Sigma 8mm 1:3.5 EX DG, EF 50mm 1:1.8 II, EF 1.4X II, Kenko C-AF 2X

swinxx

Can anyone test mlv format with 48fps?

On a 5d mk3 i have problems with raw and highest resolution. The writing speed is much lower than in 24fps mode. So it is not possible to record more than 500frames.
Greets re

g3gg0

Higher fps -> more dma bandwidth needed -> reduced write speed
this is inavoidable.
you can try to switch preview mode to hacked, which will disable the live view functionality.
this squeezes some MiB/s out
Help us with datasheets - Help us with register dumps
magic lantern: 1Magic9991E1eWbGvrsx186GovYCXFbppY, server expenses: [email protected]
ONLY donate for things we have done, not for things you expect!

swinxx

thx, will try that out.

is there a possibility to record unsqueezed one day or is this not possible?
thx.

RenatoPhoto

Quote from: swinxx on October 13, 2013, 10:55:01 AM
is there a possibility to record unsqueezed one day or is this not possible?
Not possible, line skipping is required to get high fps.
http://www.pululahuahostal.com  |  EF 300 f/4, EF 100-400 L, EF 180 L, EF-S 10-22, Samyang 14mm, Sigma 28mm EX DG, Sigma 8mm 1:3.5 EX DG, EF 50mm 1:1.8 II, EF 1.4X II, Kenko C-AF 2X

vstrglv

Quote from: RenatoPhoto on October 12, 2013, 05:19:56 PM
Tested todays build on 5D3.
Can you upload mlv module for latest build please? (5D3). I can not compile it myself, sorry.
Canon 5D3,1.1.3; Canon EOS M,202,  CF-SanDisk Extreme PRO,160MB/s, 256GB, SD-SanDisk Extreme Pro, 170MB/s, 128GB.

RenatoPhoto

Quote from: vstrglv on October 13, 2013, 10:04:00 PM
Can you upload mlv module for latest build please? (5D3). I can not compile it myself, sorry.
You can get it from first page look for pre built
http://www.pululahuahostal.com  |  EF 300 f/4, EF 100-400 L, EF 180 L, EF-S 10-22, Samyang 14mm, Sigma 28mm EX DG, Sigma 8mm 1:3.5 EX DG, EF 50mm 1:1.8 II, EF 1.4X II, Kenko C-AF 2X

vstrglv

Thank you very much! I tried this link before - it was very old.
Canon 5D3,1.1.3; Canon EOS M,202,  CF-SanDisk Extreme PRO,160MB/s, 256GB, SD-SanDisk Extreme Pro, 170MB/s, 128GB.

g3gg0

Quote from: RenatoPhoto on October 13, 2013, 01:55:01 AM
Also I noticed it is related to idle % calculation.  When the idle shows, the drop in rate becomes regular.  If you push the speed so the idle % disappears also the drop in rate disappears.

For some reason I am also getting these images as if I was pressing screen capture.

screenshots are nothing new. they are made on stop so you can upload your buffer graph.

the idle time and similar stuff is calculated nearly every write and has no correlation to the performance drop.
see the logs: http://upload.g3gg0.de/pub_files/1ccce7e3382250447649960595a0343e/RAW_REC.TXT
Help us with datasheets - Help us with register dumps
magic lantern: 1Magic9991E1eWbGvrsx186GovYCXFbppY, server expenses: [email protected]
ONLY donate for things we have done, not for things you expect!

g3gg0

Quote from: RenatoPhoto on October 13, 2013, 03:06:37 AM
Also at the 4GB mark always get drops in speed.

thats normal and its better than in the original raw_rec versions.
file open/close operations take their time.
Help us with datasheets - Help us with register dumps
magic lantern: 1Magic9991E1eWbGvrsx186GovYCXFbppY, server expenses: [email protected]
ONLY donate for things we have done, not for things you expect!

RenatoPhoto

Quote from: g3gg0 on October 14, 2013, 12:02:23 AM
the idle time and similar stuff is calculated nearly every write and has no correlation to the performance drop.

Ok, but I have seen some kind of cycle on 5D3 tests.  The drop sometimes repeats every 4 seconds, sometimes every 2 seconds, sometimes every 8 seconds.  It is not totally repeatable by I see some correlation.  The drop disappears with high demanding rates and appears more frequent when there is some idle % showing.

I hope you can find the couse
http://www.pululahuahostal.com  |  EF 300 f/4, EF 100-400 L, EF 180 L, EF-S 10-22, Samyang 14mm, Sigma 28mm EX DG, Sigma 8mm 1:3.5 EX DG, EF 50mm 1:1.8 II, EF 1.4X II, Kenko C-AF 2X

g3gg0

it could be vice versa - as soon the drop rate goes down (due to some other stuff being calcuated or so) the idle time rises.
hard to tell. i guess i will have to start a tskmon trace.
Help us with datasheets - Help us with register dumps
magic lantern: 1Magic9991E1eWbGvrsx186GovYCXFbppY, server expenses: [email protected]
ONLY donate for things we have done, not for things you expect!

escho

Quote from: escho on October 12, 2013, 10:12:34 PM
600D:

Any reasons not to append these changes to the mlv-sources?  mlv_dump doesnt run wifhout for me

Edgar

Shall I create a pull request to ML with the changes in raw.h or will this conflict with existing stuff?

Edgar
https://sternenkarten.com/
600D, 6D, openSUSE Tumbleweed

g3gg0

Quote from: escho on October 15, 2013, 09:26:51 PM
Shall I create a pull request to ML with the changes in raw.h or will this conflict with existing stuff?

Edgar

ah sorry, forgot to reply.
i am afraid this shotgun approach could raise some other problems :)
can you create a pull request for the main repository and check if the original raw_rec still works fine?

Help us with datasheets - Help us with register dumps
magic lantern: 1Magic9991E1eWbGvrsx186GovYCXFbppY, server expenses: [email protected]
ONLY donate for things we have done, not for things you expect!

escho

Quote from: g3gg0 on October 15, 2013, 10:13:09 PM
...
can you create a pull request for the main repository and check if the original raw_rec still works fine?

I changed it in my clone of ML-Repo. Raw-Video seems to run fine. I found no problems at the moment.

But

Compiling this whole stuff shows a bunch of compiler warnings like that:

../../src/raw.c:858:33: warning: initialization makes pointer from integer without a cast [enabled by default]
../../src/raw.c: In function 'raw_red_pixel_bright':
../../src/raw.c:866:33: warning: initialization makes pointer from integer without a cast [enabled by default]
../../src/raw.c: In function 'raw_green_pixel_bright':


So, regarding these warnings, I donĀ“t have the courage to create a pull request

Edgar
https://sternenkarten.com/
600D, 6D, openSUSE Tumbleweed

1%

It just makes warnings about comparing those uint_32 to int in other parts of ML source.

RenatoPhoto

Congratulations g3goo and Alex,  I see you merged the new format RAW 2.0 to the main branch!  I have done a quick test on the 5D3 with and without the spanning function and all seems to work properly.  I will be doing more detailed testing and reporting of the new mlv_rec.mo!

This gives me a very positive feeling for the power that the ML team has, and hope that this serves as a very good example for others to follow.  The cooperation of all the players to bring their knowledge merging their code (and knowledge) back to the main branch is essential to the benefit of ML Team as a whole.   ;D
http://www.pululahuahostal.com  |  EF 300 f/4, EF 100-400 L, EF 180 L, EF-S 10-22, Samyang 14mm, Sigma 28mm EX DG, Sigma 8mm 1:3.5 EX DG, EF 50mm 1:1.8 II, EF 1.4X II, Kenko C-AF 2X

RenatoPhoto

Only bug so far under cropped mode with preview MLGray or Hacked the LV sometimes remains frozen and requires a re-boot to enable LV.
http://www.pululahuahostal.com  |  EF 300 f/4, EF 100-400 L, EF 180 L, EF-S 10-22, Samyang 14mm, Sigma 28mm EX DG, Sigma 8mm 1:3.5 EX DG, EF 50mm 1:1.8 II, EF 1.4X II, Kenko C-AF 2X

kgv5

Quote from: RenatoPhoto on October 18, 2013, 01:55:10 PM
Congratulations g3goo and Alex,  I see you merged the new format RAW 2.0 to the main branch!  I have done a quick test on the 5D3 with and without the spanning function and all seems to work properly.  I will be doing more detailed testing and reporting of the new mlv_rec.mo!

What does it mean exactly? Is mlv in nightly builds now?
www.pilotmovies.pl   5D Mark III, 6D, 550D

RenatoPhoto

http://www.pululahuahostal.com  |  EF 300 f/4, EF 100-400 L, EF 180 L, EF-S 10-22, Samyang 14mm, Sigma 28mm EX DG, Sigma 8mm 1:3.5 EX DG, EF 50mm 1:1.8 II, EF 1.4X II, Kenko C-AF 2X

xNiNELiVES

Have the bugs really been sorted out for cameras other than the 5D3? Like the 7D, and 5D2.