Author Topic: Magic Lantern (RAW) Video format v2.0 (mlv_rec.mo) (Read 1400323 times)

DeafEyeJedi · « **Reply #1950 on:** May 07, 2015, 07:47:07 AM »

For those who are curious or in need of files (Dual-ISO RAW, MLV, CR2, MLV/RAW, FRSP DNG/MLV) from certain models such as 70D, 5D3 & the M... Perhaps to help speed up the process on getting the binaries up to date.

Or just want to play with certain files for testing/practice purposes.

https://mega.co.nz/#F!DokxSIhC!q5iOd_rIQTRbCXA51Kyz5Q

Happy Updates!

tidelander · « **Reply #1951 on:** June 08, 2015, 03:25:44 AM »

Is it possible to specify output directory (not output file) for mlv_dump.exe?
I have gigabytes of mlv files (silent picture time lapse) that I want to export to DNG and then to Lightroom. Currently I first copy files from CF card to hard drive, then export to DNG and then to Lightroom.
It would be nice if I could point mlv_dump.exe to mlv file on CF card and specify output directory for DNG files on my hard drive.
However, I was not able to find such feature in documentation. Does it exist?
I tried something like this:

Code: [Select]

mlv_dump --dng outdir in.mlv
But it does not work and complains "Error: Failed to open file outdir"

g3gg0 · « **Reply #1952 on:** June 08, 2015, 08:36:28 AM »

Code: [Select]

mlv_dump --dng -o /path/to/dir/fileprefix_ in.mlvit will automatically append the frame number

Danne · « **Reply #1953 on:** June 21, 2015, 09:11:13 PM »

I,m really curious about this. According to below user he claims white balance is correctly translated from windows version of mlv_dump(not sure which version)
user mothaibaphoto

Quote

...mlv_dump produces dng sequence with correct WB from camera.

http://www.magiclantern.fm/forum/index.php?topic=13152.msg149992#msg149992

When I run mlv_dump for mac(latest 2 may upload) dng files still have hard coded as shot neutral values?
Could this windows claim be confirmed by somebody?
Thanks

*Update
Correction here regarding mlv_dump white balance
http://www.magiclantern.fm/forum/index.php?topic=13152.msg150044#msg150044

Tao · « **Reply #1954 on:** June 26, 2015, 10:46:48 PM »

Hi, I've done a quick search but I didn't find any answer, I started shooting MLV with a 5D3 (I used raw on 70D or 5D2) : is it normal than I have vertical lines when shooting ? Can I remove them ? It's quite disturbing but I don't see the in MLrawviewer.

Also, is MLV good for something like 48fps@maxrespossible-videos ? or should I go back to RAW just for that ? (I understand RAW had better writing speeds, I have 2 Lexar 64go 1066x)

Thanks to you all

Markus · « **Reply #1955 on:** July 03, 2015, 09:14:25 PM »

The vertical lines are known issue. Some programs have a remove stripes function to remove them. I have suspected this issue occurs when you film raw in non native in between iso's. I haven't had this problem since only using "true" iso's.
100, 200, 400, 800, 1600 and so on. I set the camera iso setting's in canon menu so I can only use these when shooting raw.
Haven't confirmed this theory yet though.
Note you can also get vertical lines if filming at very high iso's...

Greg · « **Reply #1956 on:** August 12, 2015, 05:08:36 PM »

Averaging in MLV_dump in combination with FRSP is a great feature.

4 frames = 1EV more into the shadows.
16 frames = 2EV more into the shadows.
With this we do not need HDR (bracketing), we get smooth movement of water or clouds.

I would like to reduce banding/FPN (vertical stripes).
I wonder how to fix it, maybe averaging function should median optical black (OB) area?

dmilligan · « **Reply #1957 on:** August 12, 2015, 05:17:24 PM »

Quote from: Greg on August 12, 2015, 05:08:36 PM

I would like to reduce banding/FPN (vertical stripes).
I wonder how to fix it, maybe averaging function should median optical black (OB) area?

Capture a 'dark frame' (put lens cap on). Then subtract that .mlv from your real .mlv (there's an option to do this in mlv_dump, I think it's -s).

Greg · « **Reply #1958 on:** August 15, 2015, 01:46:13 AM »

Code: [Select]

mlv_dump -o o.mlv -s dark.MLV light.MLV

 MLV Dumper v1.0
-----------------

Mode of operation:
   - Input MLV file: 'light.MLV'
   - Rewrite MLV
   - Subtract reference frame 'dark.MLV' from single images
   - Output into 'o.mlv'
File light.MLV opened
File light.M00 not existing.
[ERROR] File 'dark.MLV' ends in the middle of a block
[ERROR] Failed to load subtract frame (4)

g3gg0 · « **Reply #1959 on:** August 16, 2015, 11:50:09 AM »

can you provide me the dark.mlv?

Greg · « **Reply #1960 on:** August 16, 2015, 02:05:53 PM »

The original file is 3.6GB
I should create a new single frame, or averaged this?

In mlv_dump error will be the same.

g3gg0 · « **Reply #1961 on:** August 16, 2015, 09:30:17 PM »

the new single frame.
can you run the mlv_dump run that produces the single frame with parameter '-v' and upload the log?

g3gg0 · « **Reply #1962 on:** August 17, 2015, 09:07:58 PM »

confirmed

g3gg0 · « **Reply #1963 on:** August 17, 2015, 09:41:29 PM »

can you try this one?
http://www.magiclantern.fm/modules/modules/mlv_dump.zip/mlv_dump.zip
(win32/linux only fixed yet)

Greg · « **Reply #1964 on:** August 17, 2015, 10:35:43 PM »

WOW vertical stripes gone, it works.

The dark frame subtract hot pixels (works well in the shadows).
In highlights create a cold pixels.

I think the ideal solution is to average/median vertical lines in the dark frame.

g3gg0 · « **Reply #1965 on:** August 18, 2015, 01:31:07 AM »

redownload

--avg-vertical [DARKFRAME ONLY] average the resulting frame in vertical direction, so we will extract vertical banding
--avg-horizontal [DARKFRAME ONLY] average the resulting frame in horizontal direction, so we will extract horizontal banding

and please test by adding one of them along with option -a

mesebar2 · « **Reply #1966 on:** December 20, 2015, 11:23:13 AM »

Hello everybody, and thank you for your amazing works!!!

I was wondering if it was possible to re-create a MLV video from its DNG files.
(A MLV i shot is not working properly, but i have the whole DNG sequence and would love to be able to create a new MLV out of it.)

Thank you in advance

Walter Schulz · « **Reply #1967 on:** December 20, 2015, 11:35:16 AM »

So you have DNG and want to go back to MLV to create DNG?

mesebar2 · « **Reply #1968 on:** December 20, 2015, 11:40:42 AM »

Yes, that is the idea

For having 1 single file and playing with Mlrawviewer. When and if needed i can create DNGs again.

Danne · « **Reply #1969 on:** December 20, 2015, 12:06:51 PM »

I thought of this to. Could be a handy container for mlvfs. Could even open up other dng relate stuff from other cameras.

Markus · « **Reply #1970 on:** December 20, 2015, 05:45:55 PM »

To be able to do this with compressed DNGs would be ideal. The compressed size but in mlv container = dream come true! ;-)

dmilligan · « **Reply #1971 on:** January 11, 2016, 06:15:54 PM »

Quote from: Markus on December 20, 2015, 05:45:55 PM

The compressed size but in mlv container = dream come true! ;-)

The dream is already true see the OP:

Quote

mlv_dump
- used for debugging and converting .mlv files
- can dump .mlv to legacy .raw + .wav files
- can dump .mlv to .dng + .wav
- can compress and decompress frames using LZMA
- convert bit depth (any depth in range from 1 to 16 bits)

compression:
you can get a data reduction of ~60% with 12 bit files.
downconverting to 8 bits gives you about 90% data reduction.
this feature is for archiving your footage.

LZMA is kinda slow and doesn't compress as well, but LJ92 is superfast:
https://bitbucket.org/hudson/magic-lantern/branch/mlv_rec_lj92

I don't really know why this hasn't been merged, but I have implemented it for MLVFS.
So you can use this to compress stuff:
https://bitbucket.org/dmilligan/magic-lantern/branch/ml_dng_lj92 or mac binary
and MLVFS will decompress it on the fly (in realtime, in if you are limited by HDD speed, using this compression can actually make MLVFS faster).

MLVFS will also decompress LZMA compressed MLV files, but it's excruciatingly slow. MLVFS does not support the frame diff option however (MLVFS needs to provide "random access" to frames).

jmanord · « **Reply #1972 on:** January 11, 2016, 09:59:36 PM »

Awesome! I may be misunderstanding the intended workflow, but is the attached mac binary used on an MLV file straight from the camera to compress it using the aforementioned LJ92? I received an immediate notification that the compression is complete and the resulting file is zero bytes. I extracted mlv_dump and tried running it from the command line, but received [ERROR] Missing file header. I tried using the normal mlv_dump.osx, the one included in the OP, and it seemed to work fine. Am I using your version on an incorrect target file? Thank you!

Full output:

MacDesktops-iMac:Test MLV Folder macdesktop$ ./mlv_dump -c -v -o test.MLV M30-0950.MLV

MLV Dumper v1.0
-----------------

Mode of operation:
- Input MLV file: 'M30-0950.MLV'
- Verbose messages
- Rewrite MLV
- Compress frame data
- Output into 'test.MLV'
File M30-0950.MLV opened
File M30-0950.M00 not existing.
File M30-0950.IDX opened (XREF)
XREF table contains 1484 entries
Processing...
[ERROR] Missing file header
Processed 0 video frames
[ERROR] Failed to rewrite header in .MLV file
Done

flostro · « **Reply #1973 on:** January 11, 2016, 10:06:53 PM »

Quote from: dmilligan on January 11, 2016, 06:15:54 PM

The dream is already true see the OP:
LZMA is kinda slow and doesn't compress as well, but LJ92 is superfast

Does this mean it is possible to use the LJ92 compression for mlv files? With mlv dump?

g3gg0 · « **Reply #1974 on:** January 11, 2016, 11:40:32 PM »

dmilligan can you make a pull request that i can merge?

News:

Author Topic: Magic Lantern (RAW) Video format v2.0 (mlv_rec.mo) (Read 1400323 times)