Author Topic: Magic Lantern (RAW) Video format v2.0 (mlv_rec.mo)  (Read 1334957 times)

Danne

  • Developer
  • Hero Member
  • *****
  • Posts: 7368
Re: Magic Lantern (RAW) Video format v2.0 (mlv_rec.mo)
« Reply #2050 on: December 24, 2016, 03:46:01 PM »
Did you specify --no-stripes, and the setting for no cold pixels?

GutterPump

  • Member
  • ***
  • Posts: 185
  • 5DIII/5DII/550D
Re: Magic Lantern (RAW) Video format v2.0 (mlv_rec.mo)
« Reply #2051 on: December 24, 2016, 04:11:54 PM »
Yes of course.

Code: [Select]
--dng --no-fixcp --no-stripes

dfort

  • Guest
Re: Magic Lantern (RAW) Video format v2.0 (mlv_rec.mo)
« Reply #2052 on: December 24, 2016, 06:57:39 PM »
Here is Bouncyballs downloads area. I think there,s a version of mlv_dump for windows. Have a look. Hopefully working for 10/12bit.
https://bitbucket.org/bouncyball/mlv-tools/downloads

Feel we've been down this path before:

From the ml_dng pull request:
Quote from: g3gg0
well, don't get me wrong. but that doesn't help ML development at all.
i just see some fork-off with a patch that says "mlv_dump dng output fixes" for example and a few "global" changes too. and when merging the branch into the main, i am quite sure it contains 64 different stray changes that will not merge nicely.
please just create a fork, incorporate a small change like "fix mlv_dump crash situation" and file a pull request.
i will then accept that pull request and the bug is fixed for everyone, not just the two people that use bouncyball's repository.

It would be helpful if mlv_dump could create valid cdng files that will import into Adobe Premiere but until ml_dng is merged it probably won't happen. (That pull request currently has some conflicts that need to be resolved.)

In the meantime I'd suggest using MLVFS which works on Mac, Windows and Linux and it creates valid cdng files that work in Premiere.

Danne

  • Developer
  • Hero Member
  • *****
  • Posts: 7368
Re: Magic Lantern (RAW) Video format v2.0 (mlv_rec.mo)
« Reply #2053 on: December 24, 2016, 07:16:03 PM »
Or download my repository and compile a fully working mlv_dump for windows and mac meanwhile. Good to have alternatives...

g3gg0

  • Developer
  • Hero Member
  • *****
  • Posts: 3183
Re: Magic Lantern (RAW) Video format v2.0 (mlv_rec.mo)
« Reply #2054 on: December 25, 2016, 12:04:31 AM »
fixes are in progress.
Help us with datasheets - Help us with register dumps
magic lantern: 1Magic9991E1eWbGvrsx186GovYCXFbppY, server expenses: paypal@g3gg0.de
ONLY donate for things we have done, not for things you expect!

g3gg0

  • Developer
  • Hero Member
  • *****
  • Posts: 3183
Re: Magic Lantern (RAW) Video format v2.0 (mlv_rec.mo)
« Reply #2055 on: December 25, 2016, 10:45:55 AM »
updated the mlv_dump binary zip with the 10/12/14 bit branch mlv_dump.
when converting to DNG, it will upconvert frames to 14bpp. should fix issues with lower depths.
Help us with datasheets - Help us with register dumps
magic lantern: 1Magic9991E1eWbGvrsx186GovYCXFbppY, server expenses: paypal@g3gg0.de
ONLY donate for things we have done, not for things you expect!

Danne

  • Developer
  • Hero Member
  • *****
  • Posts: 7368
Re: Magic Lantern (RAW) Video format v2.0 (mlv_rec.mo)
« Reply #2056 on: December 25, 2016, 11:32:38 AM »
Great g3gg0. Tested 10bit files and applying chroma smooth 2x2 is working(otherwise completely corrupted). I also tried darkframe averaging with 10bit files and all seems to work in that regard as well!!. Really great. If anybody wants to test more here is a compiled mlv_dump build with g3gg0 latest inserts.
This means 10/12bit can be treated as any14bit mlv footage just as before.


*g3gg0 already provides the mlv_dump binary. Missed that one.

*I also just updated ml-dng code(used in MLP, cr2hdr.app) with these latest total awesome changes as well. Darkframe averaging with 10bit is a beauty.

g3gg0

  • Developer
  • Hero Member
  • *****
  • Posts: 3183
Re: Magic Lantern (RAW) Video format v2.0 (mlv_rec.mo)
« Reply #2057 on: December 25, 2016, 07:11:16 PM »
how does the mac binary differ from the one i posted?
does it contain the cdng code?
Help us with datasheets - Help us with register dumps
magic lantern: 1Magic9991E1eWbGvrsx186GovYCXFbppY, server expenses: paypal@g3gg0.de
ONLY donate for things we have done, not for things you expect!

Danne

  • Developer
  • Hero Member
  • *****
  • Posts: 7368
Re: Magic Lantern (RAW) Video format v2.0 (mlv_rec.mo)
« Reply #2058 on: December 25, 2016, 08:06:15 PM »
Sorry, no it,s the same as you posted. I,ll remove it. However I updated a ml-dng code version which has a version of mlv_dump with cdng tags and which calculates white balance. I guess that is not in the pipeline for now :)
Thanks again for working the mlv_dump code. Filmed a lot of 10bit material and ran it with darkframe averaging. Footage looks great.

g3gg0

  • Developer
  • Hero Member
  • *****
  • Posts: 3183
Re: Magic Lantern (RAW) Video format v2.0 (mlv_rec.mo)
« Reply #2059 on: December 25, 2016, 10:09:46 PM »
good to hear. does the dark frame really make so much difference?
nice.
Help us with datasheets - Help us with register dumps
magic lantern: 1Magic9991E1eWbGvrsx186GovYCXFbppY, server expenses: paypal@g3gg0.de
ONLY donate for things we have done, not for things you expect!

Danne

  • Developer
  • Hero Member
  • *****
  • Posts: 7368
Re: Magic Lantern (RAW) Video format v2.0 (mlv_rec.mo)
« Reply #2060 on: December 25, 2016, 10:42:57 PM »
I,m building a storage with darkframes. Personally I tend to not shooting exposing to the right when using darkframes, the color noise cleanup is significant. I,ll put up some footage when I have something useful to show. Probably involving a white cat...

DeafEyeJedi

  • Hero Member
  • *****
  • Posts: 3411
  • 5D3 | M1 | 7D | 70D | SL1 | M2 | 50D
Magic Lantern (RAW) Video format v2.0 (mlv_rec.mo)
« Reply #2061 on: December 26, 2016, 08:53:18 AM »
...does the dark frame really make so much difference?

Absolutely it does... Kudos to @Danne for pointing this out and thanks to you @g3gg0 for your never ending magic!
5D3.113 | 5D3.123 | EOSM.203 | 7D.203 | 70D.112 | 100D.101 | EOSM2.* | 50D.109

-Rogue5-

  • New to the forum
  • *
  • Posts: 7
Re: Magic Lantern (RAW) Video format v2.0 (mlv_rec.mo)
« Reply #2062 on: January 06, 2017, 10:25:57 PM »
At the risk of asking a total newb question, the sampling rate (1x1, 3x3, or 3x5) and bit-depth (10, 12, or 14bit) can't be chosen in-camera at data capture on a 5D2, can it?  Like to lower the data rate (potentially opening up higher resolutions) or get smaller file sizes (so cards last longer)?

And yes, I was definitely late to the MLV party (not even fashionably late, but just late-late...)

ilia3101

  • Global Moderator
  • Hero Member
  • *****
  • Posts: 984
Re: Magic Lantern (RAW) Video format v2.0 (mlv_rec.mo)
« Reply #2063 on: January 07, 2017, 12:28:57 AM »
@-Rogue5- 'sampling rate' can be 'chosen' on 5D2, normal full frame raw is 3x3, crop mode is 1x1, 3x5 isn't available. Also sampling doesn't affect data rate, resolution does. 10 bit and 12 bit can be used on the 5D2, you just need a build of that branch, right now you can record corruption free 10/12bit on this camera only if you use crop mode.

Follow the 10-12bit thread: http://www.magiclantern.fm/forum/index.php?topic=5601.950 @dfort is posting builds every now and then
Also watch reddeercity's video here: http://www.magiclantern.fm/forum/index.php?topic=11205.msg177721;topicseen#msg177721

-Rogue5-

  • New to the forum
  • *
  • Posts: 7
Re: Magic Lantern (RAW) Video format v2.0 (mlv_rec.mo)
« Reply #2064 on: January 07, 2017, 12:42:38 AM »
@-Rogue5- 'sampling rate' can be 'chosen' on 5D2, normal full frame raw is 3x3, crop mode is 1x1, 3x5 isn't available. Also sampling doesn't affect data rate, resolution does. 10 bit and 12 bit can be used on the 5D2, you just need a build of that branch, right now you can record corruption free 10/12bit on this camera only if you use crop mode.

Follow the 10-12bit thread: http://www.magiclantern.fm/forum/index.php?topic=5601.950 @dfort is posting builds every now and then
Also watch reddeercity's video here: http://www.magiclantern.fm/forum/index.php?topic=11205.msg177721;topicseen#msg177721

Awesome stuff!  Thanks for the thread-links!

Very interested to see if it makes 1920x1080 possible (presuming the cause for the 1854x1044 limitation was data throughput)..

dfort

  • Guest
Re: Magic Lantern (RAW) Video format v2.0 (mlv_rec.mo)
« Reply #2065 on: January 07, 2017, 12:58:08 AM »
3x5 isn't available.

Actually it is. 3x5 is mv720 a.k.a. 720p mode which records at 50/60 fps. It skips 3 lines horizontally 5 lines vertically so as you can imagine the aliasing is much worse at this setting.

-Rogue5-

  • New to the forum
  • *
  • Posts: 7
Re: Magic Lantern (RAW) Video format v2.0 (mlv_rec.mo)
« Reply #2066 on: January 07, 2017, 01:15:46 AM »
Actually it is. 3x5 is mv720 a.k.a. 720p mode which records at 50/60 fps. It skips 3 lines horizontally 5 lines vertically so as you can imagine the aliasing is much worse at this setting.

I think he was talking explicitly about the 5D2 (which didn't have 720/60p)...  Though, I'd be curious to know the cause of the limitation at this point (being that the data rate is achievable.)

ilia3101

  • Global Moderator
  • Hero Member
  • *****
  • Posts: 984
Re: Magic Lantern (RAW) Video format v2.0 (mlv_rec.mo)
« Reply #2067 on: January 07, 2017, 01:29:17 AM »
I think the 5D2's sensor simply can't do 60fps, but would be interesting if mv720 could be achieved, don't know what use it would be though.
Very interested to see if it makes 1920x1080 possible (presuming the cause for the 1854x1044 limitation was data throughput)..
Sadly it won't, the video resolution limit is photo resolution/3, which in the 5D2's case is 5616px and 5616/3 = 1872, although 1880 is also available, probably from some hidden pixels, 1872 & 1880 can be accessed again from raw_rec in the 10/12bit branch, mlv_rec still limited to 1856.
Also crop mode allows 2144x1076

Danne

  • Developer
  • Hero Member
  • *****
  • Posts: 7368
Re: Magic Lantern (RAW) Video format v2.0 (mlv_rec.mo)
« Reply #2068 on: January 09, 2017, 10:37:09 PM »
Reprting a bug.
I tried some more around adding black level through mlv_dump using the --black-fix=2048 option. Just as Renatophoto described here http://www.magiclantern.fm/forum/index.php?topic=5601.msg177842#msg177842 it will not work properly with 10bit and 12bit files. With 14bit it,s ok. What happens is following. I used the 25 dec mlv_dump build and tested on two 5D mark III files.

10bit gives
mlv_dump --black-fix=2048 --dng 10bit.MLV delivers
Black Level                     : 32768

12bit gives
mlv_dump --black-fix=2048 --dng 12bit.MLV delivers
Black Level                     : 8192

Above also occurs when --no-fixcp is set.
14bit files works with the --black-fix option just as before.

Testfiles here
10bit
https://drive.google.com/file/d/0B4tCJMlOYfirYUJxZ0JPVzJsX0k/view?usp=sharing
12bit
https://drive.google.com/file/d/0B4tCJMlOYfirckp3bFBqanNmbXc/view?usp=sharing

g3gg0

  • Developer
  • Hero Member
  • *****
  • Posts: 3183
Help us with datasheets - Help us with register dumps
magic lantern: 1Magic9991E1eWbGvrsx186GovYCXFbppY, server expenses: paypal@g3gg0.de
ONLY donate for things we have done, not for things you expect!

Danne

  • Developer
  • Hero Member
  • *****
  • Posts: 7368
Re: Magic Lantern (RAW) Video format v2.0 (mlv_rec.mo)
« Reply #2070 on: January 10, 2017, 02:43:37 AM »
Commented on a white level issue.

g3gg0

  • Developer
  • Hero Member
  • *****
  • Posts: 3183
Re: Magic Lantern (RAW) Video format v2.0 (mlv_rec.mo)
« Reply #2071 on: January 10, 2017, 03:02:56 PM »
yeah, i expected that to fail t.b.h. but it was already too late :)

it should be working correctly now
also added a white level option
Help us with datasheets - Help us with register dumps
magic lantern: 1Magic9991E1eWbGvrsx186GovYCXFbppY, server expenses: paypal@g3gg0.de
ONLY donate for things we have done, not for things you expect!

Danne

  • Developer
  • Hero Member
  • *****
  • Posts: 7368
Re: Magic Lantern (RAW) Video format v2.0 (mlv_rec.mo)
« Reply #2072 on: January 10, 2017, 03:08:42 PM »
Cool, tested, made a comment.

DeafEyeJedi

  • Hero Member
  • *****
  • Posts: 3411
  • 5D3 | M1 | 7D | 70D | SL1 | M2 | 50D
Re: Magic Lantern (RAW) Video format v2.0 (mlv_rec.mo)
« Reply #2073 on: January 10, 2017, 07:03:35 PM »
Thanks @Danne & @g3gg0 for the quick fixes!
5D3.113 | 5D3.123 | EOSM.203 | 7D.203 | 70D.112 | 100D.101 | EOSM2.* | 50D.109

TrEK

  • New to the forum
  • *
  • Posts: 20
  • Canon 5d mk2 , CF Sandisk Extreme PRO 64gb 160MB/s
Re: Magic Lantern (RAW) Video format v2.0 (mlv_rec.mo)
« Reply #2074 on: January 12, 2017, 07:04:07 PM »
i make video RAW on my Canon 5d MK2 , and choose resolution 1600*900 25p 16:9 ,
Global Draw - OFF
Frame Skipping - OFF
Preview Option - Hacked No Prev
Status When Recording - ICON
Start Delay - 2 sec
Digital Dolly - OFF
Card Warm-up - OFF
Use SRM Job Memory - ON
Extra Hacks - ON
Debug Trace - OFF
Show Buffer Graph - OFF
Buffer Fill Method - 4
Reserve Card Space - ON
Tag Text - none
Tag Take - none

1/Correct settings?
2/And how correct resize in Adobe Premiere via importing DNG-sequence ?
3/And which pixel size choose when creating sequence in Adobe Premiere ?

i have card CF Sandisk Extreme PRO 64gb 160MB/sec