Magic Lantern (RAW) Video format v2.0 (mlv_rec.mo)

Started by g3gg0, July 15, 2013, 10:58:23 PM

Previous topic - Next topic

0 Members and 1 Guest are viewing this topic.

Stedda

I get it you're special. You're a director/professional/editor and because of that you have a right to the features you demand. 

I'm not going to argue with you because you're all over the place.  Just remember you're using a tool that wasn't designed to do what YOU want it to do for your one specific use be happy with what you're getting for FREE or use the proper tool. As a professional you should already know this.
5D Mark III -- 7D   SOLD -- EOS M 22mm 18-55mm STM -- Fuji X-T1 18-55 F2.8-F4 & 35 F1.4
Canon Glass   100L F2.8 IS -- 70-200L F4 -- 135L F2 -- 85 F1.8 -- 17-40L --  40 F2.8 -- 35 F2 IS  Sigma Glass  120-300 F2.8 OS -- 50 F1.4 -- 85 F1.4  Tamron Glass   24-70 2.8 VC   600EX-RT X3

AnotherDave

Quote from: Stedda on August 01, 2013, 06:25:09 PM
I get it you're special. You're a director/professional/editor and because of that you have a right to the features you demand. 

I'm not going to argue with you because you're all over the place.  Just remember you're using a tool that wasn't designed to do what YOU want it to do for your one specific use be happy with what you're getting for FREE or use the proper tool. As a professional you should already know this.

I just don't know why you're arguing with me over this... 

There is a reason things work they way they do.  I'm not trying to annoy the developer and I think what he has been able to get out this camera to do is insane!

I'm not special at all, but I'm willing to offer my experience to the developers to help them shape this into something even more awesome.

Honestly, I could be like every other professional and say "psshhh... shoot with the F55", "Yea, but it'll make your camera explode"...

I even went as far as to test this on a paid, 5 day job... had it failed, I could have been sued.  But it worked perfectly, and I've been singing it's praises ever since!

It's great!  Amazing!  I can't believe this quality is THIS accessible for SO CHEAP!  But... the display covers actors faces, and sometimes the images look like vomit before you CC then in Resolve.  I think those issues need to be solved before spanning the data across 2 cards.

Why is that such a threat to you?

g3gg0

Help us with datasheets - Help us with register dumps
magic lantern: 1Magic9991E1eWbGvrsx186GovYCXFbppY, server expenses: [email protected]
ONLY donate for things we have done, not for things you expect!

g3gg0

5D3 users:
can you test this version for write speeds with spanning OFF and ON (see menu)
hacks both work on my 5D3, so please try with all hacks enabled.

you should see a clean write speed display for SD and CF (upper is CF, lower one is SD)
Help us with datasheets - Help us with register dumps
magic lantern: 1Magic9991E1eWbGvrsx186GovYCXFbppY, server expenses: [email protected]
ONLY donate for things we have done, not for things you expect!

Audionut

Do I need to compile from your source tree?

Linking..
tcc: error: undefined symbol 'msg_queue_count '
  [E]  failed to link modules

CoresNZ

Looking very promising thanks g3gg0, excited to see where this ends up!

Any chance of posting a compiled version of the mlv_dump utility?

I Would love to have a go at testing this end to end but I'm not set up to compile.

dadinio13

https://docs.google.com/file/d/0B-tM9Z6JauKNTjBRS2dIWE5LUDA/edit

MLV_DUMP

BUT you can't actually convert the .RAW converted from your .MLV with raw2dng for now.

CoresNZ

Quote from: dadinio13 on August 02, 2013, 06:03:34 AM
https://docs.google.com/file/d/0B-tM9Z6JauKNTjBRS2dIWE5LUDA/edit

MLV_DUMP

BUT you can't actually convert the .RAW converted from your .MLV with raw2dng for now.

Cheers for that. yeah jumping the gun a bit, but I'll be prepped and ready for when we can convert them ;)

g3gg0

did all that tonight.

- recording a card spanning movie
- concatenating using "cat M01-xxx.M01 >> M01-xxx.MLV"
- converting to raw using "./mlv_dump M01-xxx.MLV out.raw"
- converting to dng using "./raw2dng out.raw"
- and finally making a movie from it

works without any problems here.

make sure you have the HEAD revision (the one from today 02 PM GMT+1)
Help us with datasheets - Help us with register dumps
magic lantern: 1Magic9991E1eWbGvrsx186GovYCXFbppY, server expenses: [email protected]
ONLY donate for things we have done, not for things you expect!

Danne

So, for now I have only a 15mb/s sd card so I can,t really try the capabilities here but gave it a go. When cardspanning is on I get about 7mb/s on the sd card and around 72mb/s on the cf card. With only cf I once got 84mb/s. Small test below. For now I get less recordingspeed with cardspanning on. Might change with a faster sd-card.

1920x1080 25fps

With filespanning of
about 592 frames
maxspeed on card 84mb/s

With filespanning on
74mb/s (cf-card)
7mb/s (sd-card)
400 frames

Thanks for your efforts g3gg0




g3gg0

okay i see. its not that straight forward as thought.
thanks again.
Help us with datasheets - Help us with register dumps
magic lantern: 1Magic9991E1eWbGvrsx186GovYCXFbppY, server expenses: [email protected]
ONLY donate for things we have done, not for things you expect!

Danne

I tried it again and now it seems that its the other way around. It does give a little boost with the sd-card. However I think when my cf was warmed and suddenly gave me 84mb peaks that the cf itself gave longer recording times than with spanning on. I really like to try a faster sd, should speed up things considerably. This is a great speedboost. Good work

kgv5

Quote from: g3gg0 on August 02, 2013, 02:41:56 AM
5D3 users:
can you test this version for write speeds with spanning OFF and ON (see menu)
hacks both work on my 5D3, so please try with all hacks enabled.

you should see a clean write speed display for SD and CF (upper is CF, lower one is SD)

5D3,global draw OFF
CF: komputerbay 1000x 64GB (not the fastest one, benchmarks up to 90-92MB/s), SD: Sandisk Extreme 45MB/s 64GB

Tried couple of times with 1920x1080p 30p
CF: write speeds: 83,5-84,5
SD: 17-18,5
The longest clip I managed to record was over 3000 frames, 1:43. But that was once and I didn't take screenshot. Normally many times i get over 1:10.
https://www.dropbox.com/s/id6jjgb6elrftpc/spanning%201.jpg
https://www.dropbox.com/s/asnel2b6tzb36o5/spanning%202.jpg

With "classic" build from 28th July i believe i was getting about 30 seconds or so 30p. MASSIVE IMPROVEMENT!!!

!!!  EDIT - OMG, 2560x1072 24p- previously 370-400 frames. Now i recorded 1:23, over 1900 frames  :D
It was saying continous OK but stopped after 1:23.
Second time i get 2,5K 2,39:1 continous ok - almost 5 minutes !!! and probably card just filled up.
Write speed: CF up to 93MB/s, SD about 17-17,5.

EDIT 2: 2880x1080 (2,67:1) - about 7 seconds, ~300 frames.

Seems 2,5K 2,39:1 would be fully usable  :D
Well...if someone finds a way to process the files.
www.pilotmovies.pl   5D Mark III, 6D, 550D

MA Visuals

g3gg0... I'm getting different results then the last couple of tests posted here.  For me it's slower for some reason.  Here are my results on 5D3 using your lastest raw_rec (with spanning support). Once the card was warmed up, I ran it 5 times for each test.

1920x1080 33 fps
Komputerbay 64gb 1000X CF
Sandisk Extreme 16gb

raw_rec V2 (CF card only)
177
173
210
157
173
Avg frames: 178

raw_rec V2 (w/Card Spanning to sd)
235
278
239
276
247
Avg frames: 255

Using most recent V1 raw_rec (commit 707c75f)
381
345
430
426
Avg frames: 383


xNiNELiVES


g3gg0

thanks for testing.

here is some new version, but i think its not much better.
Help us with datasheets - Help us with register dumps
magic lantern: 1Magic9991E1eWbGvrsx186GovYCXFbppY, server expenses: [email protected]
ONLY donate for things we have done, not for things you expect!

Danne

@kgv5
Nice results. Could you try 50fps in 1920 mode.? Thanks

g3gg0

Quote from: kgv5 on August 02, 2013, 11:00:43 PM
Seems 2,5K 2,39:1 would be fully usable  :D
Well...if someone finds a way to process the files.

thanks for the tests.
as described above, it is already possible to process them.
concatenate them with any tool (even the file order should not matter)
and process them with mlv_dump
Help us with datasheets - Help us with register dumps
magic lantern: 1Magic9991E1eWbGvrsx186GovYCXFbppY, server expenses: [email protected]
ONLY donate for things we have done, not for things you expect!

kgv5

Quote from: Danne on August 03, 2013, 12:28:54 AM
@kgv5
Nice results. Could you try 50fps in 1920 mode.? Thanks

Sure.
canon menu - 1280x720 50p PAL

RAW (requires stretch 1.61x)
1920x672 16:9 360 frames
1920x646 1.85:1 380 frames
1920x544 2.20:1 continous OK

1856x650 16:9 460-480 frames
1856x624 1.85:1 700 frames
1728x606 16:9 continous

Frame numbers varies sometimes, these are more or less the best scores i get.
www.pilotmovies.pl   5D Mark III, 6D, 550D

Danne


g3gg0

Help us with datasheets - Help us with register dumps
magic lantern: 1Magic9991E1eWbGvrsx186GovYCXFbppY, server expenses: [email protected]
ONLY donate for things we have done, not for things you expect!

xNiNELiVES

Quote from: g3gg0 on August 03, 2013, 03:18:56 AM
another update:
http://upload.g3gg0.de/pub_files/9f2c26461c25ba24997aa22b9a47547a/raw_rec.mo

thats giving me maximum performance on my card setup.
up to 74 + 17 MiB/s

Wasn't the speed with CF cards 90mb/s+? Nevertheless its good progress. Should be plenty for 1080p etc.

kgv5

Quote from: g3gg0 on August 03, 2013, 03:18:56 AM
another update:
http://upload.g3gg0.de/pub_files/9f2c26461c25ba24997aa22b9a47547a/raw_rec.mo

thats giving me maximum performance on my card setup.
up to 74 + 17 MiB/s

When i put the new raw_rec.mo to the ML folder (yesterday build) it is getting me an error (cannot load any module)., does it need other autoexec.bin?

Bug maybe: when i swith cam on, start shooting with spanning OFF, than turn spanning ON - it cannot initialize SD card. When I restart the cam and shoot spanning ON from the beginning - its OK.

EDIT
Yesterday build further testing:
1920x1280 3:2 24 and 25p - continous OK.
2048x1152 16:9 24 and 25p - continous OK
2048x1228 5:3 24 and 25p - continous OK >>> (should be great for some stabilizing in post and crop to 1920x1080)
2240x1120 2:1 24 and 25p - continous OK

When switching between resolution i get many err70, some examples:
https://www.dropbox.com/s/ezdpxgfoomya6g1/CRASH02.LOG
https://www.dropbox.com/s/oa44zy391pc2rx7/CRASH01.LOG
https://www.dropbox.com/s/2la6kiiacyaioji/CRASH03.LOG
www.pilotmovies.pl   5D Mark III, 6D, 550D

g3gg0

Which symbol is missing?
Enable console messages in module menu
Help us with datasheets - Help us with register dumps
magic lantern: 1Magic9991E1eWbGvrsx186GovYCXFbppY, server expenses: [email protected]
ONLY donate for things we have done, not for things you expect!

kgv5

I just copy/paste .mo from the link to existing and working yesterday build. This is what i get when switch show console ON

tcc: error: undefined symbol 'edmac_memspy_res_unlock'
tcc: error: undefined symbol 'edmac_memspy_res_lock'
[E] failed to link modules

Every modules gives Err
www.pilotmovies.pl   5D Mark III, 6D, 550D