Author Topic: Magic Lantern (RAW) Video format v2.0 (mlv_rec.mo)  (Read 1421412 times)

g3gg0

  • Developer
  • Hero Member
  • *****
  • Posts: 3190
Re: Magic Lantern (RAW) Video format v2.0
« Reply #525 on: September 13, 2013, 09:55:03 PM »
And as someone hinted - will there be raw container support for sync-sound?

the container is designed to get perfect sync between audio and video.
there is just no implementation for audio yet.

anyone wants to implement?

about performance:
yeah, the new format sacrifices a few MiB/s, but i think there is still some room for optimization.
but the numbers are not always that important - with the new format a lot of other advantages come up - metadata on nearly per-frame basis :)

Help us with datasheets - Help us with register dumps
magic lantern: 1Magic9991E1eWbGvrsx186GovYCXFbppY, server expenses: paypal@g3gg0.de
ONLY donate for things we have done, not for things you expect!

RenatoPhoto

  • Moderators
  • Hero Member
  • *****
  • Posts: 1509
  • 5DM3 / 7D
Re: Magic Lantern (RAW) Video format v2.0
« Reply #526 on: September 14, 2013, 04:25:40 PM »
the container is designed to get perfect sync between audio and video.
there is just no implementation for audio yet.

anyone wants to implement?


I love RAW but all my videos are muted!  I will not carry additional recording audio because it is too complex for wildlife videos.  I really would love to have this implemented or to bring back the out of synch video-audio option.  There is a lot of people like me that could use it!  Not all video recording is done in a studio!
http://www.pululahuahostal.com  |  EF 300 f/4, EF 100-400 L, EF 180 L, EF-S 10-22, Samyang 14mm, Sigma 28mm EX DG, Sigma 8mm 1:3.5 EX DG, EF 50mm 1:1.8 II, EF 1.4X II, Kenko C-AF 2X

Muf

  • New to the forum
  • *
  • Posts: 9
Re: Magic Lantern (RAW) Video format v2.0
« Reply #527 on: September 14, 2013, 04:27:41 PM »
I love RAW but all my videos are muted!  I will not carry additional recording audio because it is too complex for wildlife videos.  I really would love to have this implemented or to bring back the out of synch video-audio option.  There is a lot of people like me that could use it!  Not all video recording is done in a studio!
Then you'll have to wait. RAW video is after all still experimental.

xNiNELiVES

  • Senior
  • ****
  • Posts: 461
  • 5D II, 17-35mm F2.8L, 50mm F1.4, 70-200 F4L
Re: Magic Lantern (RAW) Video format v2.0
« Reply #528 on: September 14, 2013, 05:35:35 PM »
An audio thread pertaining to the current sub-discussion: http://www.magiclantern.fm/forum/index.php?topic=7890.msg70058#msg70058
It would should also work for the H4N...

1%

  • Developer
  • Hero Member
  • *****
  • Posts: 5936
  • 600D/6D/50D/EOSM/7D
Re: Magic Lantern (RAW) Video format v2.0
« Reply #529 on: September 14, 2013, 05:49:13 PM »
Quote
yeah, the new format sacrifices a few MiB/s, but i think there is still some room for optimization.

There definitely is... write test LV open in play mode gives 91.8MB/s... something is using the CPU/taking edmac time.

Doyle4

  • Hero Member
  • *****
  • Posts: 690
  • Canon 5DRAWii & 600Dual-Iso
Re: Magic Lantern (RAW) Video format v2.0
« Reply #530 on: September 15, 2013, 01:47:26 PM »
Im sure there was a build for 600d that had the mlv module with it... cant seem too find it anymore  :(

oddname

  • New to the forum
  • *
  • Posts: 45
Re: Magic Lantern (RAW) Video format v2.0
« Reply #531 on: September 15, 2013, 03:31:03 PM »
So how is this module coming along? Feels like it is some time since one read news :)
Still waiting eagerly for the 5d2 version :P

RenatoPhoto

  • Moderators
  • Hero Member
  • *****
  • Posts: 1509
  • 5DM3 / 7D
Re: Magic Lantern (RAW) Video format v2.0
« Reply #532 on: September 16, 2013, 04:21:34 PM »
@ g3g00:  When I compile the modules in https://bitbucket.org/g3gg0/magic-lantern/commits/all  I get the same error in all modules:

Any help would be appreciated.

magiclantern@magiclantern-VirtualBox:~/G3GGo/magic-lantern/modules/autoexpo$ make clean
[ RM ]  autoexpo.o autoexpo.mo autoexpo.sym autoexpo.dep module_strings.h *.o *.d *.bmp *.dep *.sym
magiclantern@magiclantern-VirtualBox:~/G3GGo/magic-lantern/modules/autoexpo$ make
[ README   ]   module_strings.h
[ DIFF     ]   module_strings.h
/bin/sh: 1: ../module_hginfo_create.sh: Permission denied
make: *** [module_strings.h] Error 126

http://www.pululahuahostal.com  |  EF 300 f/4, EF 100-400 L, EF 180 L, EF-S 10-22, Samyang 14mm, Sigma 28mm EX DG, Sigma 8mm 1:3.5 EX DG, EF 50mm 1:1.8 II, EF 1.4X II, Kenko C-AF 2X

escho

  • Contributor
  • Hero Member
  • *****
  • Posts: 563
Re: Magic Lantern (RAW) Video format v2.0
« Reply #533 on: September 16, 2013, 05:20:26 PM »
Make module_hginfo_create.sh executable

or change Makefile.modules like this:

Code: [Select]
diff -r e428f411e2ca modules/Makefile.modules
--- a/modules/Makefile.modules  Sun Sep 15 10:55:26 2013 +0200
+++ b/modules/Makefile.modules  Sun Sep 15 14:50:52 2013 +0200
@@ -26,7 +26,7 @@
 
 module_strings.h: FORCE README.rst
        $(call build,README, $(PYTHON) ../readme2modulestrings.py > $@)
-       $(call build,DIFF, ../module_hginfo_create.sh >> $@)
+       $(call build,DIFF, sh ../module_hginfo_create.sh >> $@)
 
 README.rst:
        $(call build,README,echo -e "$(MODULE_NAME)\n========\n\nPlease write a one-page description for your module here.\n\nYou may also add some metadata:\n\n:Author: <your name here>\n:License: <your license here>\n:Website: <your website here>\n\n" > $@)

Edgar
https://sternenkarten.com/
600D, 6D, openSUSE Tumbleweed

g3gg0

  • Developer
  • Hero Member
  • *****
  • Posts: 3190
Re: Magic Lantern (RAW) Video format v2.0
« Reply #534 on: September 16, 2013, 09:01:50 PM »
Make module_hginfo_create.sh executable

can you provide a patch for this?
on windows i cant do that :)
Help us with datasheets - Help us with register dumps
magic lantern: 1Magic9991E1eWbGvrsx186GovYCXFbppY, server expenses: paypal@g3gg0.de
ONLY donate for things we have done, not for things you expect!

escho

  • Contributor
  • Hero Member
  • *****
  • Posts: 563
Re: Magic Lantern (RAW) Video format v2.0
« Reply #535 on: September 16, 2013, 11:33:04 PM »
Oh, Windows, I see! I didn´t realize, that there exist a operating system called Windows, too. :)
My solution is for compiling from a Linux-machine.

I´m not sure, Windows can understand bash-scripts (foo.sh) natively.

Using Windows I cannot help, because I only use Linux

Edgar
https://sternenkarten.com/
600D, 6D, openSUSE Tumbleweed

1%

  • Developer
  • Hero Member
  • *****
  • Posts: 5936
  • 600D/6D/50D/EOSM/7D
Re: Magic Lantern (RAW) Video format v2.0
« Reply #536 on: September 17, 2013, 01:15:24 AM »
MSYS is really nice... like power shell + cmd + bash all together... it let me use wildcards in cr2hdr when normal cmd wouldn't. Would probably execute the .sh scripts.

AnotherDave

  • Senior
  • ****
  • Posts: 348
Re: Magic Lantern (RAW) Video format v2.0
« Reply #537 on: September 17, 2013, 04:12:58 AM »
Been out of a loop for a bit here... wondering where I can find the newest compiled version.

Things in this forum are getting a bit hard to follow...

kaktus

  • New to the forum
  • *
  • Posts: 9
Re: Magic Lantern (RAW) Video format v2.0
« Reply #538 on: September 20, 2013, 12:52:16 AM »
Cant use mlv_rec.mo on 6D. Message "OldAPI". I dont known why... Using "DualIso-FullPack" at 2013-08-11. What am doing wrong? What do I need to adjust?

g3gg0

  • Developer
  • Hero Member
  • *****
  • Posts: 3190
Re: Magic Lantern (RAW) Video format v2.0
« Reply #539 on: September 21, 2013, 02:43:29 AM »
in the main post in this thread thread is a _very_ simple and hackish MLV viewer to check your footage
it will read uncompressed MLV files and display the frames with just a few frames per second.
this tool was programmed in C# on windows, but it uses nothing windows-specific, so it should run on any OS using mono.

please remind:
 - this tool is just a PROOF OF CONCEPT
 - it is not meant as productional tool
 - i used it to check what is necessary to decode and view MLV files, its just my playground
 - it has bugs!
 - it will most likely not be continued
 - i shared it as a last resort tool in case you need something like that


notes:
 - shows the video in half resolution to simplify debayering
 - ramps exposure up/down if there is under/overexposure (so it may not be accurate enough for some of you)
 - has no white balance algorithm
 - just tested on 5D3, other cameras have different bayer patterns - didnt check them yet
 - it uses the coefficients from the raw info block, so color weighting should be correct
 - the scene is scaled to TV black and white levels (16..235) for a better looking playback

thanks to alex for giving me a lot of hints on how to process raw data efficiently


Help us with datasheets - Help us with register dumps
magic lantern: 1Magic9991E1eWbGvrsx186GovYCXFbppY, server expenses: paypal@g3gg0.de
ONLY donate for things we have done, not for things you expect!

arrinkiiii

  • Hero Member
  • *****
  • Posts: 1104
  • ML ADDICTED 7D & 5D III
Re: Magic Lantern (RAW) Video format v2.0
« Reply #540 on: September 21, 2013, 02:54:16 AM »
Sweet  :D THANKS  :D

britom

  • Member
  • ***
  • Posts: 113
Re: Magic Lantern (RAW) Video format v2.0
« Reply #541 on: September 21, 2013, 04:55:53 AM »
NICE!
7D Builds with RAW support: http://bit.ly/14Llzda

oddname

  • New to the forum
  • *
  • Posts: 45
Re: Magic Lantern (RAW) Video format v2.0
« Reply #542 on: September 21, 2013, 08:21:03 AM »
That is awesome, allways wanted to be able to preview files before extracting etc =)

Stedda

  • Hero Member
  • *****
  • Posts: 504
Re: Magic Lantern (RAW) Video format v2.0
« Reply #543 on: September 21, 2013, 01:58:17 PM »
Awesome work!
5D Mark III -- 7D   SOLD -- EOS M 22mm 18-55mm STM -- Fuji X-T1 18-55 F2.8-F4 & 35 F1.4
Canon Glass   100L F2.8 IS -- 70-200L F4 -- 135L F2 -- 85 F1.8 -- 17-40L --  40 F2.8 -- 35 F2 IS  Sigma Glass  120-300 F2.8 OS -- 50 F1.4 -- 85 F1.4  Tamron Glass   24-70 2.8 VC   600EX-RT X3

RenatoPhoto

  • Moderators
  • Hero Member
  • *****
  • Posts: 1509
  • 5DM3 / 7D
Re: Magic Lantern (RAW) Video format v2.0
« Reply #544 on: September 21, 2013, 03:04:47 PM »
here is a _very_ simple and hackish MLV viewer to check your footage
it will read uncompressed MLV files and display the frames with just a few frames per second.
this tool was programmed in C# on windows, but it uses nothing windows-specific, so it should run on any OS using mono.

Thank you g3g00, and Alex for the help!

I tried it with mlv files from 5D3 and 7D and works very well at all resolutions, cropped video, and 60 fps.  Also payed spanned files!

In windows 7 64 bits I open the program and the drag the file, after a little delay the player functions properly.

I hope your pull request is merged to unified soon!

Thanks for your great work and support. ;D ;D
http://www.pululahuahostal.com  |  EF 300 f/4, EF 100-400 L, EF 180 L, EF-S 10-22, Samyang 14mm, Sigma 28mm EX DG, Sigma 8mm 1:3.5 EX DG, EF 50mm 1:1.8 II, EF 1.4X II, Kenko C-AF 2X

g3gg0

  • Developer
  • Hero Member
  • *****
  • Posts: 3190
Re: Magic Lantern (RAW) Video format v2.0
« Reply #545 on: September 21, 2013, 04:22:58 PM »
thanks for the feedback.
the initial delay is when the tool scans all MLV chunks and creates an index.
so it knows the order of the blocks to process.
Help us with datasheets - Help us with register dumps
magic lantern: 1Magic9991E1eWbGvrsx186GovYCXFbppY, server expenses: paypal@g3gg0.de
ONLY donate for things we have done, not for things you expect!

g3gg0

  • Developer
  • Hero Member
  • *****
  • Posts: 3190
Re: Magic Lantern (RAW) Video format v2.0
« Reply #546 on: September 21, 2013, 05:18:54 PM »
update:

 - fixed some crashing situations e.g. when pressing alt (downside: inefficient code)
 - use color matrix from the raw info instead of hardcoded, so the colors should look better
 - scaled colors to TV range (16..235) for a nicer look
Help us with datasheets - Help us with register dumps
magic lantern: 1Magic9991E1eWbGvrsx186GovYCXFbppY, server expenses: paypal@g3gg0.de
ONLY donate for things we have done, not for things you expect!

hookah

  • New to the forum
  • *
  • Posts: 29
Re: Magic Lantern (RAW) Video format v2.0
« Reply #547 on: September 21, 2013, 06:28:11 PM »
Wow what a great tool !!!! VERY useful..
Just cleaned-up/deleted all my small test MLV videos  :)
5D3, Sigma Art 35mm 1.4, Tamron 24-70mm 2.8 VC, Tokina 11-16 2.8, Canon 50mm 1.4 + 100mm 2.8 macro + 15mm

oddname

  • New to the forum
  • *
  • Posts: 45
Re: Magic Lantern (RAW) Video format v2.0
« Reply #548 on: September 21, 2013, 08:20:12 PM »
Does one dare to ask if there is a module that works on the 5D2 yet? =)

g3gg0

  • Developer
  • Hero Member
  • *****
  • Posts: 3190
Re: Magic Lantern (RAW) Video format v2.0
« Reply #549 on: September 21, 2013, 10:35:09 PM »
i dont know what is wrong on 5D2. there were just reports of "hanging" module.
can you explain the problem in detail?
Help us with datasheets - Help us with register dumps
magic lantern: 1Magic9991E1eWbGvrsx186GovYCXFbppY, server expenses: paypal@g3gg0.de
ONLY donate for things we have done, not for things you expect!