Magic Lantern (RAW) Video format v2.0 (mlv_rec.mo)

Started by g3gg0, July 15, 2013, 10:58:23 PM

Previous topic - Next topic

0 Members and 3 Guests are viewing this topic.

morphers

What is the command to dump an mlv file to raw file for the windows build?

Quote from: g3gg0 on August 11, 2013, 12:58:06 AM
here is a windows build of mlv_dump

did not test it for 4GiB problems. can someone else try?

Canon eos m

Quote from: Canon eos m on August 10, 2013, 01:18:09 PM
Hi g3gg0

With the Lexar 32 CF 1000X, SD Scandisk Extreme Pro HD HC 1 95mb/s, I get the following (Recording at 1920X1080 16:9 Aspect):

1. Memory Hack: ON; Small Hack: ON; Frame Skipping: Allow; Buffer fill: 0; Card Spanning: OFF - Touched 94.5 mb/s

2. Memory Hack: OFF; Small Hack: OFF; Frame Skipping: Allow; Buffer fill: 0; Card Spanning: OFF  - Touched 88.2 mb/s

3. Memory Hack: ON; Small Hack: ON; Frame Skipping: Allow; Buffer fill: 0; Card Spanning: ON  - Touched 102 mb/s FIRST 1500 FRAMES NO SKIPPING

4. Memory Hack: ON; Small Hack: ON; Frame Skipping: Allow; Buffer fill: 0; Card Spanning: ON  - Touched 101.7 mb/s FIRST 1500 FRAMES NO SKIPPING

5. Memory Hack: ON; Small Hack: ON; Frame Skipping: Allow; Buffer fill: 0; Card Spanning: ON  - Touched 101.9 mb/s FIRST 1500 FRAMES NO SKIPPING

Small correction (typo error  - by mistake mentioned all buffers fills as 0; whereas, these were 0, 1, 2 in that order):

3. Memory Hack: ON; Small Hack: ON; Frame Skipping: Allow; Buffer fill: 0; Card Spanning: ON  - Touched 102 mb/s FIRST 1500 FRAMES NO SKIPPING

4. Memory Hack: ON; Small Hack: ON; Frame Skipping: Allow; Buffer fill: 1; Card Spanning: ON  - Touched 101.7 mb/s FIRST 1500 FRAMES NO SKIPPING

5. Memory Hack: ON; Small Hack: ON; Frame Skipping: Allow; Buffer fill: 2; Card Spanning: ON  - Touched 101.9 mb/s FIRST 1500 FRAMES NO SKIPPING

Agree with kgv5 that buff 0 and 2 produce the fastest write speeds.
Canon 5D Mark III, Gopro Hero Blacks with 3D Casing, A Few Lenses, Adobe CC 2014, MacBook Pro, Windows 8 PC, Lots of Video Rig!

Started Nuke. Loved it but then the 15 day trial ran out. Back to After Effects and loving it :-)

xNiNELiVES

Quote from: g3gg0 on August 11, 2013, 02:04:14 AM
5D2: autoexec  symbol

can you try it?

Well it seems like a user already did. To repeat what he said: it froze. Sorry I couldn't test, I was at traveling 300 miles by car 700 miles by plane... Will test all new builds posted. Thanks for the hard work.

g3gg0

Help us with datasheets - Help us with register dumps
magic lantern: 1Magic9991E1eWbGvrsx186GovYCXFbppY, server expenses: [email protected]
ONLY donate for things we have done, not for things you expect!

Toffifee

Tried to get the mlv_dump for windows through parallels 8, but I couldn't get it working.
Has somebody been more successful than me?

RenatoPhoto

mlv_dump.exe works in windows with comand:
mlv_dump.exe -o mlv.raw m10-2205.mlv

Where mlv.raw is the name of the new raw file
m10-2205.mlv is the name of the spanned file, it automatically finds the others i.e. M00

How to make it work:
copy the mlv_dump.exe to the directory where the .mlv file is located.
To excecute this command use the dos terminal, navegate to the same directory and type:
mlv_dump.exe -o mlv.raw m10-2205.mlv with your own file names.

It joins the spanned file.....

PROBLEM:   I cannot make the raw2dng.exe (old) work.  I receive the:
This ain't a lv_rec RAW file
message...  when doing it in windows under dos command
raw2dng.exe mlv.raw

I have also tried in linux but I have a virtual disk size which does not allow me to work with the large files, so I can not use the linux commands until I successfully re-size my virtualbox machine.

http://www.pululahuahostal.com  |  EF 300 f/4, EF 100-400 L, EF 180 L, EF-S 10-22, Samyang 14mm, Sigma 28mm EX DG, Sigma 8mm 1:3.5 EX DG, EF 50mm 1:1.8 II, EF 1.4X II, Kenko C-AF 2X

RenatoPhoto

Holy crap!!  New compile 8961e22b getting 15% more speed.

Both CF and SD write faster!!!!!!  Getting 110 to 115 MB/s with hacks on.
http://www.pululahuahostal.com  |  EF 300 f/4, EF 100-400 L, EF 180 L, EF-S 10-22, Samyang 14mm, Sigma 28mm EX DG, Sigma 8mm 1:3.5 EX DG, EF 50mm 1:1.8 II, EF 1.4X II, Kenko C-AF 2X

kgv5

 :o ok, where is it?
110 to 115 with 1920x1080 32fps??
www.pilotmovies.pl   5D Mark III, 6D, 550D

g3gg0

You forgot to add -r to write it as legacy raw.
See the help.
Help us with datasheets - Help us with register dumps
magic lantern: 1Magic9991E1eWbGvrsx186GovYCXFbppY, server expenses: [email protected]
ONLY donate for things we have done, not for things you expect!

Canon eos m

g3gg0,

Sorry to be so difficult, but could you please post the exact command for a windows machine:

Would it be: mlv_dump.exe -o mlv.raw -r m10-2205.mlv ?
Canon 5D Mark III, Gopro Hero Blacks with 3D Casing, A Few Lenses, Adobe CC 2014, MacBook Pro, Windows 8 PC, Lots of Video Rig!

Started Nuke. Loved it but then the 15 day trial ran out. Back to After Effects and loving it :-)

g3gg0

Uhm i am on mobile only.
But i am so confident that i already posted an excessive list of commandline examples...
Help us with datasheets - Help us with register dumps
magic lantern: 1Magic9991E1eWbGvrsx186GovYCXFbppY, server expenses: [email protected]
ONLY donate for things we have done, not for things you expect!

Danne

Quote from: RenatoPhoto on August 11, 2013, 02:57:38 PM
Holy crap!!  New compile 8961e22b getting 15% more speed.

Both CF and SD write faster!!!!!!  Getting 110 to 115 MB/s with hacks on.

Got damn, holy balony. Gotta test this one. g3gg0 rocks this joint

RenatoPhoto

Quote from: Canon eos m on August 11, 2013, 03:42:22 PM
Would it be: mlv_dump.exe -o mlv.raw -r m10-2205.mlv ?

I just tried the mlv_dump.exe -o mlv.raw -r m10-2205.mlv

and ....  made the mlv.raw file

and ... drag and drop on raw2dng.exe and Yes!!!!!!!

Got dng files!
http://www.pululahuahostal.com  |  EF 300 f/4, EF 100-400 L, EF 180 L, EF-S 10-22, Samyang 14mm, Sigma 28mm EX DG, Sigma 8mm 1:3.5 EX DG, EF 50mm 1:1.8 II, EF 1.4X II, Kenko C-AF 2X

Danne

@RenatoPhoto, Where do you find this build? do you hit the extra megabytes filming raw normal 1920x1080 or in 3x crop?
Thanks
//D

RenatoPhoto

In linux type

./mlv_dump -h and get the usage RULES

Usage: ./mlv_dump [-o output_file] [-rscd] [-l compression_level(0-9)] <inputfile>
Parameters:
-o output_file      set the filename to write into
-v                  verbose output
-r                  output into a legacy raw file for e.g. raw2dng
-b bits             convert image data to given bit depth per channel (1-16)
-f frames           stop after that number of frames
-c, -d, -l          NOT AVAILABLE: compression support was not compiled into this release
http://www.pululahuahostal.com  |  EF 300 f/4, EF 100-400 L, EF 180 L, EF-S 10-22, Samyang 14mm, Sigma 28mm EX DG, Sigma 8mm 1:3.5 EX DG, EF 50mm 1:1.8 II, EF 1.4X II, Kenko C-AF 2X

RenatoPhoto

Quote from: Danne on August 11, 2013, 04:12:31 PM
@RenatoPhoto, Where do you find this build? do you hit the extra megabytes filming raw normal 1920x1080 or in 3x crop?
Thanks
//D

I compiled it myself.  Finally able to do this with VM machine see> http://www.magiclantern.fm/forum/index.php?topic=7579.0

Yes get 15% more on cropped video mode!!!!!!!!!
http://www.pululahuahostal.com  |  EF 300 f/4, EF 100-400 L, EF 180 L, EF-S 10-22, Samyang 14mm, Sigma 28mm EX DG, Sigma 8mm 1:3.5 EX DG, EF 50mm 1:1.8 II, EF 1.4X II, Kenko C-AF 2X

gnarr


Danne

@RenatoPhoto. Sweet. Did you by any chance tried this on 50fps?
Thanks
//D

Canon eos m

Quote from: RenatoPhoto on August 11, 2013, 04:01:16 PM
I just tried the mlv_dump.exe -o mlv.raw -r m10-2205.mlv

and ....  made the mlv.raw file

and ... drag and drop on raw2dng.exe and Yes!!!!!!!

Got dng files!

I cracked it too. 1973 DNG files at my disposal from a single shoot. Awesome! Long live g3gg0.
Canon 5D Mark III, Gopro Hero Blacks with 3D Casing, A Few Lenses, Adobe CC 2014, MacBook Pro, Windows 8 PC, Lots of Video Rig!

Started Nuke. Loved it but then the 15 day trial ran out. Back to After Effects and loving it :-)

RenatoPhoto

Quote from: Danne on August 11, 2013, 04:28:19 PM
@RenatoPhoto. Sweet. Did you by any chance tried this on 50fps?
Thanks
//D
Yes 1920x672 get 103 to 106 MB/s  I get 1800 to 2600 frames

http://www.pululahuahostal.com  |  EF 300 f/4, EF 100-400 L, EF 180 L, EF-S 10-22, Samyang 14mm, Sigma 28mm EX DG, Sigma 8mm 1:3.5 EX DG, EF 50mm 1:1.8 II, EF 1.4X II, Kenko C-AF 2X

Danne

Quote from: RenatoPhoto on August 11, 2013, 04:44:15 PM
Yes 1920x672 get 103 to 106 MB/s  I get 1800 to 2600 frames

Fantastic!
I, m not a programmer. Could youupload the compile or do I wait for g3gg0 uploading?
Thanks

Canon eos m

Quote from: Canon eos m on August 11, 2013, 04:36:47 PM
I cracked it too. 1973 DNG files at my disposal from a single shoot. Awesome! Long live g3gg0.

In case anyone is wondering what this is all about.

A few days ago, g3gg0 has coded a new format such that the 5D Mark III can harness the power of the CF + SD at the same time for speeds touching 102-110 mb/s for long record of full HD (2.5K) RAW video that was previously impossible even with a fast card unless one was willing to live with dropped frames or compromise on the file size. The files are saved in a new format : MLV (Magic Lantern Video)

The Windows workflow (cannot say for Apple OS, Linux):

1. Download the mlv_dump.exe file from post #228 #218 of this thread. Unzip and extract.

2. Then bring the files recorded in the mlv format (& its shadow in *.m00 format) to the same directory as the unzipped mlv_dump.exe folder (to learn how to record in the new mlv format please scan through g3gg0's posts in this thread these past few days). Note: To begin, you will first have to download the latest modules and autoexe.bin files for recording in mlv format (post #200). The new build is also in one of g3gg0's posts

3. Each footage will be generated in two formats (*.mlv and *.m00 extensions).

4. Then in C:\ type the following thread: cd [with name of main folder (root folder), example, "cd desktop" (without the inverted commas)]
Then type the name of the folder next in the path: Same "cd XXXX"

5. Repeat this process till you reach the folder where the "mlv_dump.exe" file stored

6. Lastly, type:

mlv_dump.exe -o mlv.raw -r m10-2345.mlv
Note: In your case the "m10-2345" will be replaced with the name of your mlv file.
Note: mlv-dump will pick up the *.m00 on its own. The process will be slow - be patient

8. Then the file that is generated is to be brought over the raw2dng.exe file (also in the same folder) to generate DNG's
Canon 5D Mark III, Gopro Hero Blacks with 3D Casing, A Few Lenses, Adobe CC 2014, MacBook Pro, Windows 8 PC, Lots of Video Rig!

Started Nuke. Loved it but then the 15 day trial ran out. Back to After Effects and loving it :-)

RenatoPhoto

http://www.pululahuahostal.com  |  EF 300 f/4, EF 100-400 L, EF 180 L, EF-S 10-22, Samyang 14mm, Sigma 28mm EX DG, Sigma 8mm 1:3.5 EX DG, EF 50mm 1:1.8 II, EF 1.4X II, Kenko C-AF 2X

Danne

Thanks Canon eos m. Will try it out. The version you,re referring to, Is it the upload from the post 200?
THanks
//D

Canon eos m

The damn thing is so awesome! I just pulled out one frame from the 1973 frames that were generated. Ran it through the ACR 8.1 and used the 'Flatz1' preset that I got from www.dlwatson.net. The result just without anything else straight from the camera (with a few changes to exposure, contract, shadows) is so amazing. A result to die for.

The worry now is how to process such huge amount of RAW data!  :'(
Canon 5D Mark III, Gopro Hero Blacks with 3D Casing, A Few Lenses, Adobe CC 2014, MacBook Pro, Windows 8 PC, Lots of Video Rig!

Started Nuke. Loved it but then the 15 day trial ran out. Back to After Effects and loving it :-)