Author Topic: Magic Lantern (RAW) Video format v2.0 (mlv_rec.mo)  (Read 1233666 times)

dfort

  • Developer
  • Hero Member
  • *****
  • Posts: 3751
Re: Magic Lantern (RAW) Video format v2.0 (mlv_rec.mo)
« Reply #2025 on: October 14, 2016, 10:14:28 PM »
Something is going on with bitbucket's issue tracker. I posted a bug report about the issues we've been discussing but it isn't showing up on the issues tracker list.

In any case, hope @a1ex and/or @g3gg0 are reading this.
5D3.* 7D.206 700D.115 EOSM.203 EOSM2.103 M50.102

dfort

  • Developer
  • Hero Member
  • *****
  • Posts: 3751
Re: Magic Lantern (RAW) Video format v2.0 (mlv_rec.mo)
« Reply #2026 on: October 15, 2016, 07:18:41 PM »
@dfort:  Update mlv_dump topic is great idea and i have various workarounds for issue i encounter,
but all this has nothing to do with message i want to bring to public:
Last version of vertical stripes correction code incompatible with DualISO.
Cromatic Aberrations/Purple FringingI mean I extracted 2 frames from 300 frames sequence, this why it contains too much metadata.

Updating cr2hdr is also needed. If you process your file with MLVFS or Danne's cr2hdr.app you'll see that the white balance on your shot is 2550K, not even close for a sunny daylight scene.



That's the first thing that I saw and thought it was related to this bug report:

https://bitbucket.org/hudson/magic-lantern/issues/2612/wb-issue-with-dual_iso-in-mlv_dump
5D3.* 7D.206 700D.115 EOSM.203 EOSM2.103 M50.102

g3gg0

  • Developer
  • Hero Member
  • *****
  • Posts: 3176
Re: Magic Lantern (RAW) Video format v2.0 (mlv_rec.mo)
« Reply #2027 on: October 15, 2016, 09:05:57 PM »
i don't understand what the problem is.

can someone explain it to me?
Help us with datasheets - Help us with register dumps
magic lantern: 1Magic9991E1eWbGvrsx186GovYCXFbppY, server expenses: paypal@g3gg0.de
ONLY donate for things we have done, not for things you expect!

Danne

  • Developer
  • Hero Member
  • *****
  • Posts: 7195
Re: Magic Lantern (RAW) Video format v2.0 (mlv_rec.mo)
« Reply #2028 on: October 15, 2016, 09:28:36 PM »
The problem in unified version atm is this.
http://www.magiclantern.fm/forum/index.php?topic=7122.msg173295#msg173295

It only affects dual iso files and it seems vertical stripes causing it.

The rest going on. I,d say mainly a call out for implementing ufraw white balance code the way dmilligan has been doing it in mlvfs which Bouncyball took on with ml_dng branch. Quite confusing right now with all fruits at once in the mix...

dfort

  • Developer
  • Hero Member
  • *****
  • Posts: 3751
Re: Magic Lantern (RAW) Video format v2.0 (mlv_rec.mo)
« Reply #2029 on: October 15, 2016, 09:41:20 PM »
i don't understand what the problem is.

can someone explain it to me?

The image on this post shows the issue clearly:
http://www.magiclantern.fm/forum/index.php?topic=7122.msg173321#msg173321
5D3.* 7D.206 700D.115 EOSM.203 EOSM2.103 M50.102

g3gg0

  • Developer
  • Hero Member
  • *****
  • Posts: 3176
Re: Magic Lantern (RAW) Video format v2.0 (mlv_rec.mo)
« Reply #2030 on: October 15, 2016, 10:10:35 PM »
uhm, thats what i get. thus my dumb question...
but not sure if the mlv_dump contains all fixes, so would have to recompile.
Help us with datasheets - Help us with register dumps
magic lantern: 1Magic9991E1eWbGvrsx186GovYCXFbppY, server expenses: paypal@g3gg0.de
ONLY donate for things we have done, not for things you expect!

g3gg0

  • Developer
  • Hero Member
  • *****
  • Posts: 3176
Re: Magic Lantern (RAW) Video format v2.0 (mlv_rec.mo)
« Reply #2031 on: October 16, 2016, 12:10:14 AM »
to fix that issue, just undo this change and it should work again
Help us with datasheets - Help us with register dumps
magic lantern: 1Magic9991E1eWbGvrsx186GovYCXFbppY, server expenses: paypal@g3gg0.de
ONLY donate for things we have done, not for things you expect!

dfort

  • Developer
  • Hero Member
  • *****
  • Posts: 3751
Re: Magic Lantern (RAW) Video format v2.0 (mlv_rec.mo)
« Reply #2032 on: October 16, 2016, 04:51:04 AM »
Thanks @g3gg0 verified the fix works over here.
5D3.* 7D.206 700D.115 EOSM.203 EOSM2.103 M50.102

dfort

  • Developer
  • Hero Member
  • *****
  • Posts: 3751
Re: Magic Lantern (RAW) Video format v2.0 (mlv_rec.mo)
« Reply #2033 on: October 19, 2016, 01:00:49 AM »
Another issue, this time one that was reported a while back in this discussion but I can't find a bug report in bitbucket on it. Segfault when applying chroma smoothing.

The fix came up in another discussion with some off topic comments.

http://www.magiclantern.fm/forum/index.php?topic=17955.msg173530#msg173530

Long story short, mlv_dump segfaults when applying chroma smoothing. There is a fix for that but it wasn't explained in the pull request so it hasn't been merged yet.
5D3.* 7D.206 700D.115 EOSM.203 EOSM2.103 M50.102

DeafEyeJedi

  • Hero Member
  • *****
  • Posts: 3401
  • 5D3 | M1 | 7D | 70D | SL1 | M2 | 50D
Re: Magic Lantern (RAW) Video format v2.0 (mlv_rec.mo)
« Reply #2034 on: October 19, 2016, 02:11:57 AM »
Nice find @Danne and Thanks for the reminder @dfort!
5D3.113 | 5D3.123 | EOSM.203 | 7D.203 | 70D.112 | 100D.101 | EOSM2.* | 50D.109

g3gg0

  • Developer
  • Hero Member
  • *****
  • Posts: 3176
Help us with datasheets - Help us with register dumps
magic lantern: 1Magic9991E1eWbGvrsx186GovYCXFbppY, server expenses: paypal@g3gg0.de
ONLY donate for things we have done, not for things you expect!

dfort

  • Developer
  • Hero Member
  • *****
  • Posts: 3751
Re: Magic Lantern (RAW) Video format v2.0 (mlv_rec.mo)
« Reply #2036 on: November 09, 2016, 06:16:59 AM »
5D3.* 7D.206 700D.115 EOSM.203 EOSM2.103 M50.102

andy kh

  • Hero Member
  • *****
  • Posts: 537
Re: Magic Lantern (RAW) Video format v2.0 (mlv_rec.mo)
« Reply #2037 on: November 09, 2016, 07:38:45 AM »
Wil mlv implement 10/12 bit mlv raw rec?
5D Mark III - 70D

g3gg0

  • Developer
  • Hero Member
  • *****
  • Posts: 3176
Re: Magic Lantern (RAW) Video format v2.0 (mlv_rec.mo)
« Reply #2038 on: November 09, 2016, 06:40:50 PM »
@dfort:
first: ok
second: well, alex has some comments about that and i do not exactly know the impact of this patch.

@andy kh:
i am not aware of the progress on this topic. will check.
Help us with datasheets - Help us with register dumps
magic lantern: 1Magic9991E1eWbGvrsx186GovYCXFbppY, server expenses: paypal@g3gg0.de
ONLY donate for things we have done, not for things you expect!

dfort

  • Developer
  • Hero Member
  • *****
  • Posts: 3751
Re: Magic Lantern (RAW) Video format v2.0 (mlv_rec.mo)
« Reply #2039 on: November 09, 2016, 08:07:14 PM »
first: ok
second: well, alex has some comments about that and i do not exactly know the impact of this patch.

Thanks!

Just a suggestion--in your examples on the first post you have:

Quote
# will dump the first 123 frames into a new file
./mlv_dump -f 123 -o out.mlv in.mlv

That will actually dump out frames 0 through 123 which are 124 frames. Perhaps it should say:

Quote
# will dump frames 0 through 123 into a new file

Note that ./mlv_dump --dng -f 0 in.mlv (or ./mlv_dump --dng -f 0-0 in.mlv) will now extract just frame 0 instead of all of the frames.
5D3.* 7D.206 700D.115 EOSM.203 EOSM2.103 M50.102

Danne

  • Developer
  • Hero Member
  • *****
  • Posts: 7195
Re: Magic Lantern (RAW) Video format v2.0 (mlv_rec.mo)
« Reply #2040 on: November 09, 2016, 10:02:32 PM »
Nicely done. How good to see mlv_dump still growing.

g3gg0

  • Developer
  • Hero Member
  • *****
  • Posts: 3176
Re: Magic Lantern (RAW) Video format v2.0 (mlv_rec.mo)
« Reply #2041 on: November 09, 2016, 10:17:11 PM »
what is missing in mlv_rec/mlv_dump for 10 bit support? (aside of post processing)
Help us with datasheets - Help us with register dumps
magic lantern: 1Magic9991E1eWbGvrsx186GovYCXFbppY, server expenses: paypal@g3gg0.de
ONLY donate for things we have done, not for things you expect!

DeafEyeJedi

  • Hero Member
  • *****
  • Posts: 3401
  • 5D3 | M1 | 7D | 70D | SL1 | M2 | 50D
Re: Magic Lantern (RAW) Video format v2.0 (mlv_rec.mo)
« Reply #2042 on: November 09, 2016, 10:28:26 PM »
Re: 10/12-bit -- Could this be related to headers being incomplete? Not sure tho...
5D3.113 | 5D3.123 | EOSM.203 | 7D.203 | 70D.112 | 100D.101 | EOSM2.* | 50D.109

dfort

  • Developer
  • Hero Member
  • *****
  • Posts: 3751
Re: Magic Lantern (RAW) Video format v2.0 (mlv_rec.mo)
« Reply #2043 on: November 09, 2016, 10:34:38 PM »
what is missing in mlv_rec/mlv_dump for 10 bit support? (aside of post processing)

There is this commit in the raw_video_10bit_12_bit branch so mlv_dump can work with the lower bit depths.

Quote
mlv_dump: fix DNG output for lower bit depths
You need to disable all processing, e.g. mlv_dump M00-1234.MLV --dng --no-fixcp --no-stripes
5D3.* 7D.206 700D.115 EOSM.203 EOSM2.103 M50.102

g3gg0

  • Developer
  • Hero Member
  • *****
  • Posts: 3176
Re: Magic Lantern (RAW) Video format v2.0 (mlv_rec.mo)
« Reply #2044 on: November 09, 2016, 11:57:22 PM »
ah thanks. yeah, guess that was a dumb copy paste error :)
Help us with datasheets - Help us with register dumps
magic lantern: 1Magic9991E1eWbGvrsx186GovYCXFbppY, server expenses: paypal@g3gg0.de
ONLY donate for things we have done, not for things you expect!

GutterPump

  • Member
  • ***
  • Posts: 184
  • 5DIII/5DII/550D
Re: Magic Lantern (RAW) Video format v2.0 (mlv_rec.mo)
« Reply #2045 on: December 24, 2016, 01:04:48 PM »
I have a small question related to MLV_DUMP, when i extract DNG from mlv_dump i can't import DNG into Premiere Pro CC 2015, but if i use the soft raw2cdng 1.7.9 it is possible.
Is this a known problem?

I use the last mlv_dump  (09 dec) made for extract 10 and 12bits MLV/RAW, but i tried with standard 14bits MLV.

I don't especially use Premiere Pro for color grading with DNG, with davinci resolve i don't get any problem, i was just curious about this issue.

Danne

  • Developer
  • Hero Member
  • *****
  • Posts: 7195
Re: Magic Lantern (RAW) Video format v2.0 (mlv_rec.mo)
« Reply #2046 on: December 24, 2016, 02:33:09 PM »
Here is a version of mlv_dump which is built upon dmilligan ml-dng code. The code has been worked upon even more by Bouncyball and a little by me. It applies correct white balance and needed cdng tags and also corrects any local camera model tags so acr can read and apply dcp profiles unique to every camera model.
https://bitbucket.org/Dannephoto/ml-dng-dannephoto/downloads/mlv_dump
Code here
https://bitbucket.org/Dannephoto/ml-dng-dannephoto/overview

*oops, windows user. Maybe somebody can compile this for windows.

GutterPump

  • Member
  • ***
  • Posts: 184
  • 5DIII/5DII/550D
Re: Magic Lantern (RAW) Video format v2.0 (mlv_rec.mo)
« Reply #2047 on: December 24, 2016, 03:06:29 PM »
Very interesting and thanks for reply !

I will wait a Windows build if someone could take the time to compile this.

Danne

  • Developer
  • Hero Member
  • *****
  • Posts: 7195
Re: Magic Lantern (RAW) Video format v2.0 (mlv_rec.mo)
« Reply #2048 on: December 24, 2016, 03:10:19 PM »
Here is Bouncyballs downloads area. I think there,s a version of mlv_dump for windows. Have a look. Hopefully working for 10/12bit.
https://bitbucket.org/bouncyball/mlv-tools/downloads

GutterPump

  • Member
  • ***
  • Posts: 184
  • 5DIII/5DII/550D
Re: Magic Lantern (RAW) Video format v2.0 (mlv_rec.mo)
« Reply #2049 on: December 24, 2016, 03:44:32 PM »
Just tried now and yes it work on Premiere CC 2015 !

But unfortunately does not work for the extraction of MLV 12 and 10bits