Author Topic: Magic Lantern (RAW) Video format v2.0 (mlv_rec.mo)  (Read 1032708 times)

morphers

  • New to the forum
  • *
  • Posts: 2
Re: Magic Lantern (RAW) Video format v2.0
« Reply #225 on: August 11, 2013, 05:34:42 AM »
What is the command to dump an mlv file to raw file for the windows build?

here is a windows build of mlv_dump

did not test it for 4GiB problems. can someone else try?

Canon eos m

  • Hero Member
  • *****
  • Posts: 562
  • 5D Mark III, Canon EOS M
Re: Magic Lantern (RAW) Video format v2.0
« Reply #226 on: August 11, 2013, 06:01:23 AM »
Hi g3gg0

With the Lexar 32 CF 1000X, SD Scandisk Extreme Pro HD HC 1 95mb/s, I get the following (Recording at 1920X1080 16:9 Aspect):

1. Memory Hack: ON; Small Hack: ON; Frame Skipping: Allow; Buffer fill: 0; Card Spanning: OFF - Touched 94.5 mb/s

2. Memory Hack: OFF; Small Hack: OFF; Frame Skipping: Allow; Buffer fill: 0; Card Spanning: OFF  - Touched 88.2 mb/s

3. Memory Hack: ON; Small Hack: ON; Frame Skipping: Allow; Buffer fill: 0; Card Spanning: ON  - Touched 102 mb/s FIRST 1500 FRAMES NO SKIPPING

4. Memory Hack: ON; Small Hack: ON; Frame Skipping: Allow; Buffer fill: 0; Card Spanning: ON  - Touched 101.7 mb/s FIRST 1500 FRAMES NO SKIPPING

5. Memory Hack: ON; Small Hack: ON; Frame Skipping: Allow; Buffer fill: 0; Card Spanning: ON  - Touched 101.9 mb/s FIRST 1500 FRAMES NO SKIPPING

Small correction (typo error  - by mistake mentioned all buffers fills as 0; whereas, these were 0, 1, 2 in that order):

3. Memory Hack: ON; Small Hack: ON; Frame Skipping: Allow; Buffer fill: 0; Card Spanning: ON  - Touched 102 mb/s FIRST 1500 FRAMES NO SKIPPING

4. Memory Hack: ON; Small Hack: ON; Frame Skipping: Allow; Buffer fill: 1; Card Spanning: ON  - Touched 101.7 mb/s FIRST 1500 FRAMES NO SKIPPING

5. Memory Hack: ON; Small Hack: ON; Frame Skipping: Allow; Buffer fill: 2; Card Spanning: ON  - Touched 101.9 mb/s FIRST 1500 FRAMES NO SKIPPING

Agree with kgv5 that buff 0 and 2 produce the fastest write speeds.
Canon 5D Mark III, Gopro Hero Blacks with 3D Casing, A Few Lenses, Adobe CC 2014, MacBook Pro, Windows 8 PC, Lots of Video Rig!

Started Nuke. Loved it but then the 15 day trial ran out. Back to After Effects and loving it :-)

xNiNELiVES

  • Senior
  • ****
  • Posts: 461
  • 5D II, 17-35mm F2.8L, 50mm F1.4, 70-200 F4L
Re: Magic Lantern (RAW) Video format v2.0
« Reply #227 on: August 11, 2013, 07:49:00 AM »
5D2: autoexec  symbol

can you try it?

Well it seems like a user already did. To repeat what he said: it froze. Sorry I couldn't test, I was at traveling 300 miles by car 700 miles by plane... Will test all new builds posted. Thanks for the hard work.

g3gg0

  • Developer
  • Hero Member
  • *****
  • Posts: 3154
Re: Magic Lantern (RAW) Video format v2.0
« Reply #228 on: August 11, 2013, 09:46:35 AM »
5D2:

can you try this module version if it is any better?
http://upload.g3gg0.de/pub_files/c73635e82eca629043f7f5d442e82265/raw_rec.mo
Help us with datasheets - Help us with register dumps
magic lantern: 1Magic9991E1eWbGvrsx186GovYCXFbppY, server expenses: paypal@g3gg0.de
ONLY donate for things we have done, not for things you expect!

Toffifee

  • Member
  • ***
  • Posts: 104
  • 5D Mark III Happy tester
Re: Magic Lantern (RAW) Video format v2.0
« Reply #229 on: August 11, 2013, 01:16:00 PM »
Tried to get the mlv_dump for windows through parallels 8, but I couldn't get it working.
Has somebody been more successful than me?

RenatoPhoto

  • Moderators
  • Hero Member
  • *****
  • Posts: 1509
  • 5DM3 / 7D
Re: Magic Lantern (RAW) Video format v2.0
« Reply #230 on: August 11, 2013, 02:52:23 PM »
mlv_dump.exe works in windows with comand:
mlv_dump.exe -o mlv.raw m10-2205.mlv

Where mlv.raw is the name of the new raw file
m10-2205.mlv is the name of the spanned file, it automatically finds the others i.e. M00

How to make it work:
copy the mlv_dump.exe to the directory where the .mlv file is located.
To excecute this command use the dos terminal, navegate to the same directory and type:
mlv_dump.exe -o mlv.raw m10-2205.mlv with your own file names.

It joins the spanned file.....

PROBLEM:   I cannot make the raw2dng.exe (old) work.  I receive the:
This ain't a lv_rec RAW file
message...  when doing it in windows under dos command
raw2dng.exe mlv.raw

I have also tried in linux but I have a virtual disk size which does not allow me to work with the large files, so I can not use the linux commands until I successfully re-size my virtualbox machine.

http://www.pululahuahostal.com  |  EF 300 f/4, EF 100-400 L, EF 180 L, EF-S 10-22, Samyang 14mm, Sigma 28mm EX DG, Sigma 8mm 1:3.5 EX DG, EF 50mm 1:1.8 II, EF 1.4X II, Kenko C-AF 2X

RenatoPhoto

  • Moderators
  • Hero Member
  • *****
  • Posts: 1509
  • 5DM3 / 7D
Re: Magic Lantern (RAW) Video format v2.0
« Reply #231 on: August 11, 2013, 02:57:38 PM »
Holy crap!!  New compile 8961e22b getting 15% more speed.

Both CF and SD write faster!!!!!!  Getting 110 to 115 MB/s with hacks on.
http://www.pululahuahostal.com  |  EF 300 f/4, EF 100-400 L, EF 180 L, EF-S 10-22, Samyang 14mm, Sigma 28mm EX DG, Sigma 8mm 1:3.5 EX DG, EF 50mm 1:1.8 II, EF 1.4X II, Kenko C-AF 2X

kgv5

  • Hero Member
  • *****
  • Posts: 643
Re: Magic Lantern (RAW) Video format v2.0
« Reply #232 on: August 11, 2013, 03:17:09 PM »
 :o ok, where is it?
110 to 115 with 1920x1080 32fps??
www.pilotmovies.pl   5D Mark III, 6D, 550D

g3gg0

  • Developer
  • Hero Member
  • *****
  • Posts: 3154
Re: Magic Lantern (RAW) Video format v2.0
« Reply #233 on: August 11, 2013, 03:33:58 PM »
You forgot to add -r to write it as legacy raw.
See the help.
Help us with datasheets - Help us with register dumps
magic lantern: 1Magic9991E1eWbGvrsx186GovYCXFbppY, server expenses: paypal@g3gg0.de
ONLY donate for things we have done, not for things you expect!

Canon eos m

  • Hero Member
  • *****
  • Posts: 562
  • 5D Mark III, Canon EOS M
Re: Magic Lantern (RAW) Video format v2.0
« Reply #234 on: August 11, 2013, 03:42:22 PM »
g3gg0,

Sorry to be so difficult, but could you please post the exact command for a windows machine:

Would it be: mlv_dump.exe -o mlv.raw -r m10-2205.mlv ?
Canon 5D Mark III, Gopro Hero Blacks with 3D Casing, A Few Lenses, Adobe CC 2014, MacBook Pro, Windows 8 PC, Lots of Video Rig!

Started Nuke. Loved it but then the 15 day trial ran out. Back to After Effects and loving it :-)

g3gg0

  • Developer
  • Hero Member
  • *****
  • Posts: 3154
Re: Magic Lantern (RAW) Video format v2.0
« Reply #235 on: August 11, 2013, 03:45:32 PM »
Uhm i am on mobile only.
But i am so confident that i already posted an excessive list of commandline examples...
Help us with datasheets - Help us with register dumps
magic lantern: 1Magic9991E1eWbGvrsx186GovYCXFbppY, server expenses: paypal@g3gg0.de
ONLY donate for things we have done, not for things you expect!

Danne

  • Contributor
  • Hero Member
  • *****
  • Posts: 6224
Re: Magic Lantern (RAW) Video format v2.0
« Reply #236 on: August 11, 2013, 03:53:45 PM »
Holy crap!!  New compile 8961e22b getting 15% more speed.

Both CF and SD write faster!!!!!!  Getting 110 to 115 MB/s with hacks on.

Got damn, holy balony. Gotta test this one. g3gg0 rocks this joint

RenatoPhoto

  • Moderators
  • Hero Member
  • *****
  • Posts: 1509
  • 5DM3 / 7D
Re: Magic Lantern (RAW) Video format v2.0
« Reply #237 on: August 11, 2013, 04:01:16 PM »
Would it be: mlv_dump.exe -o mlv.raw -r m10-2205.mlv ?

I just tried the mlv_dump.exe -o mlv.raw -r m10-2205.mlv

and ....  made the mlv.raw file

and ... drag and drop on raw2dng.exe and Yes!!!!!!!

Got dng files!
http://www.pululahuahostal.com  |  EF 300 f/4, EF 100-400 L, EF 180 L, EF-S 10-22, Samyang 14mm, Sigma 28mm EX DG, Sigma 8mm 1:3.5 EX DG, EF 50mm 1:1.8 II, EF 1.4X II, Kenko C-AF 2X

Danne

  • Contributor
  • Hero Member
  • *****
  • Posts: 6224
Re: Magic Lantern (RAW) Video format v2.0
« Reply #238 on: August 11, 2013, 04:12:31 PM »
@RenatoPhoto, Where do you find this build? do you hit the extra megabytes filming raw normal 1920x1080 or in 3x crop?
Thanks
//D

RenatoPhoto

  • Moderators
  • Hero Member
  • *****
  • Posts: 1509
  • 5DM3 / 7D
Re: Magic Lantern (RAW) Video format v2.0
« Reply #239 on: August 11, 2013, 04:17:56 PM »
In linux type

./mlv_dump -h and get the usage RULES

Usage: ./mlv_dump [-o output_file] [-rscd] [-l compression_level(0-9)] <inputfile>
Parameters:
 -o output_file      set the filename to write into
 -v                  verbose output
 -r                  output into a legacy raw file for e.g. raw2dng
 -b bits             convert image data to given bit depth per channel (1-16)
 -f frames           stop after that number of frames
 -c, -d, -l          NOT AVAILABLE: compression support was not compiled into this release
http://www.pululahuahostal.com  |  EF 300 f/4, EF 100-400 L, EF 180 L, EF-S 10-22, Samyang 14mm, Sigma 28mm EX DG, Sigma 8mm 1:3.5 EX DG, EF 50mm 1:1.8 II, EF 1.4X II, Kenko C-AF 2X

RenatoPhoto

  • Moderators
  • Hero Member
  • *****
  • Posts: 1509
  • 5DM3 / 7D
Re: Magic Lantern (RAW) Video format v2.0
« Reply #240 on: August 11, 2013, 04:22:08 PM »
@RenatoPhoto, Where do you find this build? do you hit the extra megabytes filming raw normal 1920x1080 or in 3x crop?
Thanks
//D

I compiled it myself.  Finally able to do this with VM machine see> http://www.magiclantern.fm/forum/index.php?topic=7579.0

Yes get 15% more on cropped video mode!!!!!!!!!
http://www.pululahuahostal.com  |  EF 300 f/4, EF 100-400 L, EF 180 L, EF-S 10-22, Samyang 14mm, Sigma 28mm EX DG, Sigma 8mm 1:3.5 EX DG, EF 50mm 1:1.8 II, EF 1.4X II, Kenko C-AF 2X

gnarr

  • New to the forum
  • *
  • Posts: 44
Re: Magic Lantern (RAW) Video format v2.0
« Reply #241 on: August 11, 2013, 04:27:38 PM »
5D2:

can you try this module version if it is any better?
http://upload.g3gg0.de/pub_files/c73635e82eca629043f7f5d442e82265/raw_rec.mo

It seems to behave in the same way as the other one for me.

Danne

  • Contributor
  • Hero Member
  • *****
  • Posts: 6224
Re: Magic Lantern (RAW) Video format v2.0
« Reply #242 on: August 11, 2013, 04:28:19 PM »
@RenatoPhoto. Sweet. Did you by any chance tried this on 50fps?
Thanks
//D

Canon eos m

  • Hero Member
  • *****
  • Posts: 562
  • 5D Mark III, Canon EOS M
Re: Magic Lantern (RAW) Video format v2.0
« Reply #243 on: August 11, 2013, 04:36:47 PM »
I just tried the mlv_dump.exe -o mlv.raw -r m10-2205.mlv

and ....  made the mlv.raw file

and ... drag and drop on raw2dng.exe and Yes!!!!!!!

Got dng files!

I cracked it too. 1973 DNG files at my disposal from a single shoot. Awesome! Long live g3gg0.
Canon 5D Mark III, Gopro Hero Blacks with 3D Casing, A Few Lenses, Adobe CC 2014, MacBook Pro, Windows 8 PC, Lots of Video Rig!

Started Nuke. Loved it but then the 15 day trial ran out. Back to After Effects and loving it :-)

RenatoPhoto

  • Moderators
  • Hero Member
  • *****
  • Posts: 1509
  • 5DM3 / 7D
Re: Magic Lantern (RAW) Video format v2.0
« Reply #244 on: August 11, 2013, 04:44:15 PM »
@RenatoPhoto. Sweet. Did you by any chance tried this on 50fps?
Thanks
//D
Yes 1920x672 get 103 to 106 MB/s  I get 1800 to 2600 frames

http://www.pululahuahostal.com  |  EF 300 f/4, EF 100-400 L, EF 180 L, EF-S 10-22, Samyang 14mm, Sigma 28mm EX DG, Sigma 8mm 1:3.5 EX DG, EF 50mm 1:1.8 II, EF 1.4X II, Kenko C-AF 2X

Danne

  • Contributor
  • Hero Member
  • *****
  • Posts: 6224
Re: Magic Lantern (RAW) Video format v2.0
« Reply #245 on: August 11, 2013, 04:51:16 PM »
Yes 1920x672 get 103 to 106 MB/s  I get 1800 to 2600 frames

Fantastic!
I, m not a programmer. Could youupload the compile or do I wait for g3gg0 uploading?
Thanks

Canon eos m

  • Hero Member
  • *****
  • Posts: 562
  • 5D Mark III, Canon EOS M
Re: Magic Lantern (RAW) Video format v2.0
« Reply #246 on: August 11, 2013, 04:58:37 PM »
I cracked it too. 1973 DNG files at my disposal from a single shoot. Awesome! Long live g3gg0.

In case anyone is wondering what this is all about.

A few days ago, g3gg0 has coded a new format such that the 5D Mark III can harness the power of the CF + SD at the same time for speeds touching 102-110 mb/s for long record of full HD (2.5K) RAW video that was previously impossible even with a fast card unless one was willing to live with dropped frames or compromise on the file size. The files are saved in a new format : MLV (Magic Lantern Video)

The Windows workflow (cannot say for Apple OS, Linux):

1. Download the mlv_dump.exe file from post #228 #218 of this thread. Unzip and extract.

2. Then bring the files recorded in the mlv format (& its shadow in *.m00 format) to the same directory as the unzipped mlv_dump.exe folder (to learn how to record in the new mlv format please scan through g3gg0's posts in this thread these past few days). Note: To begin, you will first have to download the latest modules and autoexe.bin files for recording in mlv format (post #200). The new build is also in one of g3gg0's posts

3. Each footage will be generated in two formats (*.mlv and *.m00 extensions).

4. Then in C:\ type the following thread: cd [with name of main folder (root folder), example, "cd desktop" (without the inverted commas)]
Then type the name of the folder next in the path: Same "cd XXXX"

5. Repeat this process till you reach the folder where the "mlv_dump.exe" file stored

6. Lastly, type:

mlv_dump.exe -o mlv.raw -r m10-2345.mlv
Note: In your case the "m10-2345" will be replaced with the name of your mlv file.
Note: mlv-dump will pick up the *.m00 on its own. The process will be slow - be patient

8. Then the file that is generated is to be brought over the raw2dng.exe file (also in the same folder) to generate DNG's
Canon 5D Mark III, Gopro Hero Blacks with 3D Casing, A Few Lenses, Adobe CC 2014, MacBook Pro, Windows 8 PC, Lots of Video Rig!

Started Nuke. Loved it but then the 15 day trial ran out. Back to After Effects and loving it :-)

RenatoPhoto

  • Moderators
  • Hero Member
  • *****
  • Posts: 1509
  • 5DM3 / 7D
Re: Magic Lantern (RAW) Video format v2.0
« Reply #247 on: August 11, 2013, 05:06:43 PM »
Latest compile: https://docs.google.com/file/d/0B9z8Y0rg-pu8eFE0ckFlWkpiR1U/edit?usp=sharing

ps. not responsible for anything. 
http://www.pululahuahostal.com  |  EF 300 f/4, EF 100-400 L, EF 180 L, EF-S 10-22, Samyang 14mm, Sigma 28mm EX DG, Sigma 8mm 1:3.5 EX DG, EF 50mm 1:1.8 II, EF 1.4X II, Kenko C-AF 2X

Danne

  • Contributor
  • Hero Member
  • *****
  • Posts: 6224
Re: Magic Lantern (RAW) Video format v2.0
« Reply #248 on: August 11, 2013, 05:07:03 PM »
Thanks Canon eos m. Will try it out. The version you,re referring to, Is it the upload from the post 200?
THanks
//D

Canon eos m

  • Hero Member
  • *****
  • Posts: 562
  • 5D Mark III, Canon EOS M
Re: Magic Lantern (RAW) Video format v2.0
« Reply #249 on: August 11, 2013, 05:07:10 PM »
The damn thing is so awesome! I just pulled out one frame from the 1973 frames that were generated. Ran it through the ACR 8.1 and used the 'Flatz1' preset that I got from www.dlwatson.net. The result just without anything else straight from the camera (with a few changes to exposure, contract, shadows) is so amazing. A result to die for.

The worry now is how to process such huge amount of RAW data!  :'(
Canon 5D Mark III, Gopro Hero Blacks with 3D Casing, A Few Lenses, Adobe CC 2014, MacBook Pro, Windows 8 PC, Lots of Video Rig!

Started Nuke. Loved it but then the 15 day trial ran out. Back to After Effects and loving it :-)