Author Topic: crop_rec on steroids: 3K, 4K, 1080p48, full-resolution LiveView  (Read 882834 times)

baksh

  • New to the forum
  • *
  • Posts: 3
Re: crop_rec on steroids: 3K, 4K, 1080p48, full-resolution LiveView
« Reply #600 on: April 30, 2017, 09:58:39 PM »
Hello everyone!

Just a quick video shot in Roma last week to show that everything just works perfectly !
Thanks to the team !

For informations
//4k Settings //
- Resolution : 3072x1024 px
- Bits : 14 bpp Lossless
- Aspect Ratio : 3:1

I was able to shoot continuously.


Quentin

  • Member
  • ***
  • Posts: 150
Re: crop_rec on steroids: 3K, 4K, 1080p48, full-resolution LiveView
« Reply #601 on: May 01, 2017, 12:00:18 AM »
Yes, I did some continuous flawless 3K shots. Incredibly awesome!
The 1st of April is ML special day.
I hope MLV_Sound returns some time and works in hand with video.

hjfilmspeed

  • Senior
  • ****
  • Posts: 479
  • 5D III and IV
Re: crop_rec on steroids: 3K, 4K, 1080p48, full-resolution LiveView
« Reply #602 on: May 01, 2017, 02:37:01 AM »
Wow!!!!!! 29th build!!!!!!

goldenchild9to5

  • Hero Member
  • *****
  • Posts: 534
Re: crop_rec on steroids: 3K, 4K, 1080p48, full-resolution LiveView
« Reply #603 on: May 01, 2017, 02:51:46 AM »
@baksh Great job.. awesome footage.

a1ex

  • Administrator
  • Hero Member
  • *****
  • Posts: 12564
Re: crop_rec on steroids: 3K, 4K, 1080p48, full-resolution LiveView
« Reply #604 on: May 01, 2017, 03:18:45 AM »
Hello :)
I wanted to ask, if, with all the new development and discoveries you guys made lately, there is a way to improve/shorten rolling shutter ms for normal 1080p recording.

Already done a long time ago (actually since 2012; we just didn't know what we had done, back then).

It might be possible to push it a little lower. With adtg_gui and enough patience, you can probably figure it out. All you have to do is to reduce FPS timer A as much as you can, but you'll also have to reconfigure some other parameters to allow this (don't know which ones - that's what you have to find out).

hindra

  • New to the forum
  • *
  • Posts: 41
Re: crop_rec on steroids: 3K, 4K, 1080p48, full-resolution LiveView
« Reply #605 on: May 01, 2017, 03:50:21 AM »
Sorry guys, with the new MLV_Dump the DNG file sizes are coming out much larger, for 3k 12 bit they are 7mb each. I am using this script to run MLV_Dump, please help me make corrections. Also, it seems to be taking much longer as well.

Quote
@echo off
for %%a in ( %* ) do ( md "%%~na" 2>nul )&( C:\MLVFS\mlv_dump.exe -o %%~na\%%~na_ --dng %%~na.MLV )

EDIT: MLV files are 16.6gb, dng output are closer to 30gb.
SL1 100D.100A - 5D - 7D2 - 5D3 1.2.3

Levas

  • Contributor
  • Hero Member
  • *****
  • Posts: 1741
  • 6d - Nightly build user
Re: crop_rec on steroids: 3K, 4K, 1080p48, full-resolution LiveView
« Reply #606 on: May 01, 2017, 10:23:28 AM »
If you used compressed raw, the MLV files are always smaller. The dng files that are made by MLV_dump are not compressed, so bigger.
And as far as I know, the output in dng from MLV_dump is always in 14 bit.
So you could have a compressed 12 bit MLV file, but the dng's that come out mlv_dump are uncompressed 14 bit.

hindra

  • New to the forum
  • *
  • Posts: 41
Re: crop_rec on steroids: 3K, 4K, 1080p48, full-resolution LiveView
« Reply #607 on: May 01, 2017, 02:54:18 PM »
If you used compressed raw, the MLV files are always smaller. The dng files that are made by MLV_dump are not compressed, so bigger.
And as far as I know, the output in dng from MLV_dump is always in 14 bit.
So you could have a compressed 12 bit MLV file, but the dng's that come out mlv_dump are uncompressed 14 bit.

That makes perfect sense! Thank you for clearing that up for me.
SL1 100D.100A - 5D - 7D2 - 5D3 1.2.3

DLM

  • New to the forum
  • *
  • Posts: 2
Re: crop_rec on steroids: 3K, 4K, 1080p48, full-resolution LiveView
« Reply #608 on: May 01, 2017, 03:25:50 PM »
Hello!

I installed the firmware version magiclantern-crop_rec_4k.2017Apr26.5D3113. I shoot 1920x1080 30p 14bit losless, it works fine, but when I open the video on the computer, in all the videos I see on the left a black bar about two pixels wide. What is the problem?


jankrueck

  • New to the forum
  • *
  • Posts: 33
Re: crop_rec on steroids: 3K, 4K, 1080p48, full-resolution LiveView
« Reply #609 on: May 01, 2017, 04:44:32 PM »
kinda offtopic. just wanted to show some testfootage.
just wanted to thank Alex and team for their work!

Can't wait for final release and having sound recorded. keep it up!


3k 1:1 | 3072x1320 | 14bit lostless
Sandisk Pro 160mb/s 64GB card
ISO100-200 continous

3840x2160 (1650 w/o letterbox) upscaling, sharpening and some lightadjustments done in resolve 12.5.
very rough and fast, noch "real" grading or so.


g3gg0

  • Developer
  • Hero Member
  • *****
  • Posts: 3190
Re: crop_rec on steroids: 3K, 4K, 1080p48, full-resolution LiveView
« Reply #610 on: May 02, 2017, 01:34:03 AM »
Sorry guys, with the new MLV_Dump the DNG file sizes are coming out much larger, for 3k 12 bit they are 7mb each. I am using this script to run MLV_Dump, please help me make corrections. Also, it seems to be taking much longer as well.

EDIT: MLV files are 16.6gb, dng output are closer to 30gb.

you now can choose between
a) output uncompressed DNGs
b) compress DNG content (bit slower bit same as uncompressed, just many tools have trouble with lossless compressed DNG)
c) pass through the original lossless data (which will be fast but skip all processing like stripe and hot pixel detection)

this can be done by adding "-c" multiple times to the commandline.

e.g.
Code: [Select]
./mlv_dump in.mlv --dng   # outputs uncompressed DNGs
./mlv_dump in.mlv --dng -c  # outputs compressed DNGs using mlv_dump's LJ92 algorithm
./mlv_dump in.mlv --dng -c -c  # outputs uncompressed DNGs by passing through unmodified lossless data
Help us with datasheets - Help us with register dumps
magic lantern: 1Magic9991E1eWbGvrsx186GovYCXFbppY, server expenses: paypal@g3gg0.de
ONLY donate for things we have done, not for things you expect!

hindra

  • New to the forum
  • *
  • Posts: 41
Re: crop_rec on steroids: 3K, 4K, 1080p48, full-resolution LiveView
« Reply #611 on: May 02, 2017, 05:09:25 AM »
you now can choose between
a) output uncompressed DNGs
b) compress DNG content (bit slower bit same as uncompressed, just many tools have trouble with lossless compressed DNG)
c) pass through the original lossless data (which will be fast but skip all processing like stripe and hot pixel detection)

this can be done by adding "-c" multiple times to the commandline.

e.g.
Code: [Select]
./mlv_dump in.mlv --dng   # outputs uncompressed DNGs
./mlv_dump in.mlv --dng -c  # outputs compressed DNGs using mlv_dump's LJ92 algorithm
./mlv_dump in.mlv --dng -c -c  # outputs uncompressed DNGs by passing through unmodified lossless data

Thank you for that. It is nice having options.
SL1 100D.100A - 5D - 7D2 - 5D3 1.2.3

goldenchild9to5

  • Hero Member
  • *****
  • Posts: 534
Re: crop_rec on steroids: 3K, 4K, 1080p48, full-resolution LiveView
« Reply #612 on: May 02, 2017, 05:24:12 AM »
@jankrueck Great job footage looks awesome.. You also captured great dynamic range, windows are well exposed & still having enough dynamic range for the interior superb. 

Danne

  • Developer
  • Hero Member
  • *****
  • Posts: 7701
Re: crop_rec on steroids: 3K, 4K, 1080p48, full-resolution LiveView
« Reply #613 on: May 02, 2017, 09:35:00 AM »
g3gg0, thanks!
Here´s latest mlv_dump for mac which beautifully applies lossless compression to dng files!
https://bitbucket.org/Dannephoto/magic-lantern/downloads/mlv_dump_compress_dng.zip

try:
Code: [Select]
mlv_dump --dng -c INPUT.MLV
And watch dng files process lossles with less than half it´s size. This works with uncompressed footage as well.

bouncyball

  • Contributor
  • Hero Member
  • *****
  • Posts: 850
Re: crop_rec on steroids: 3K, 4K, 1080p48, full-resolution LiveView
« Reply #614 on: May 02, 2017, 10:43:09 AM »
@g3gg0

you now can choose between
a) output uncompressed DNGs
b) compress DNG content (bit slower bit same as uncompressed, just many tools have trouble with lossless compressed DNG)
c) pass through the original lossless data (which will be fast but skip all processing like stripe and hot pixel detection)
Haha, I was doing the same pass-trough stuff yesterday but you really did it a lot better (and faster) than me!!! :D plus there are also some more fixes/changes. Thank you so much!

There is a small question. When -c not specifyed e.g. 'mlv_dump -o result.mlv source.mlv', the standard output is:
Code: [Select]
Processing...
  saving: 3628800 -> 1906112  (52.53% ratio)
  saving: 3628800 -> 1906112  (52.53% ratio)
  saving: 3628800 -> 1905600  (52.51% ratio)

In case of "!verbose":
Code: [Select]
if(frame_buffer_size != (uint32_t)frame_size && !verbose)
{
   print_msg(MSG_INFO, "  saving: "FMT_SIZE" -> "FMT_SIZE"  (%2.2f%% ratio)\n", frame_size, frame_buffer_size, ((float)frame_buffer_size * 100.0f) / (float)frame_size);
}
Do we really need this info (calculated uncompressed size to already hw compressed size comparizon) during MLV->MLV pass-trough? Maybe make it somewhat optional.

bb

beauchampy

  • Senior
  • ****
  • Posts: 302
Re: crop_rec on steroids: 3K, 4K, 1080p48, full-resolution LiveView
« Reply #615 on: May 02, 2017, 10:46:24 AM »
g3gg0, thanks!
Here´s latest mlv_dump for mac which beautifully applies lossless compression to dng files!
https://bitbucket.org/Dannephoto/magic-lantern/downloads/mlv_dump_compress_dng.zip

try:
Code: [Select]
mlv_dump --dng -c INPUT.MLV
And watch dng files process lossles with less than half it´s size. This works with uncompressed footage as well.

Fantastic! Look forward to seeing this with cr2hdr!

bouncyball

  • Contributor
  • Hero Member
  • *****
  • Posts: 850
Re: crop_rec on steroids: 3K, 4K, 1080p48, full-resolution LiveView
« Reply #616 on: May 02, 2017, 10:48:05 AM »
try:
Code: [Select]
mlv_dump --dng -c INPUT.MLV
And watch dng files process lossles with less than half it´s size. This works with uncompressed footage as well.
Produced (processed and recompressed) DNGs are even a bit smaller than passed-trough ones :) I guess also becase of there is no padding bytes.

bb

jankrueck

  • New to the forum
  • *
  • Posts: 33
Re: crop_rec on steroids: 3K, 4K, 1080p48, full-resolution LiveView
« Reply #617 on: May 02, 2017, 01:14:22 PM »
@jankrueck Great job footage looks awesome.. You also captured great dynamic range, windows are well exposed & still having enough dynamic range for the interior superb.

thanks!  my maingoal was to test around with DR, detail and cameramoving, as most of the test I saw where handheld or tripod landscape.
the Dynamic Range is just insane. Its out of Camera. Didnt lift shadows or saved highlights at all.


cherrio!

jimiz

  • Freshman
  • **
  • Posts: 64
Re: crop_rec on steroids: 3K, 4K, 1080p48, full-resolution LiveView
« Reply #618 on: May 02, 2017, 03:03:53 PM »
* 1920x960 @ 50p (both 1:1 crop and full-frame - 3x3 pixel binning) last exp.4k 29 april



crash (freeze) on ML menu options, in few seconds when push upd and down select.... and must put out battery ....

any one confirm ?

5D3-123

pc_bel

  • Member
  • ***
  • Posts: 132
Re: crop_rec on steroids: 3K, 4K, 1080p48, full-resolution LiveView
« Reply #619 on: May 02, 2017, 04:03:56 PM »
@jimiz
For me that mode is no more continuous recording with the last build, I don't know why... I return to April14th, the most reliable for me... :-[

a1ex

  • Administrator
  • Hero Member
  • *****
  • Posts: 12564
Re: crop_rec on steroids: 3K, 4K, 1080p48, full-resolution LiveView
« Reply #620 on: May 02, 2017, 04:53:59 PM »
If you want the future builds to improve...

http://www.chiark.greenend.org.uk/~sgtatham/bugs.html

Before reporting any differences in recording times, please make sure they are not caused by small variations in the data rate (unavoidable with lossless compression) or by different settings (e.g. global draw, preview options).

I'm currently benchmarking the two builds with this method (this script).

Just FYI, it's not the first time people are reporting speed differences between nearly identical builds (where the only change was something like fixing a typo in XYZ language).

jimiz

  • Freshman
  • **
  • Posts: 64
Re: crop_rec on steroids: 3K, 4K, 1080p48, full-resolution LiveView
« Reply #621 on: May 02, 2017, 06:35:29 PM »
@jimiz
For me that mode is no more continuous recording with the last build, I don't know why... I return to April14th, the most reliable for me... :-[

yes to me too , no possibile to rec. in 1920x920 50p  , around 20 seconds not more...little bit better in x800....but not continued.
5D3-123

a1ex

  • Administrator
  • Hero Member
  • *****
  • Posts: 12564
Re: crop_rec on steroids: 3K, 4K, 1080p48, full-resolution LiveView
« Reply #622 on: May 02, 2017, 06:51:24 PM »
With the settings recommended in the first post, 1920x960 50p is continuous here (orange icon at first, green after ~30 seconds).

Benchmark results tomorrow (will let the script test the two builds overnight).

g3gg0

  • Developer
  • Hero Member
  • *****
  • Posts: 3190
Re: crop_rec on steroids: 3K, 4K, 1080p48, full-resolution LiveView
« Reply #623 on: May 02, 2017, 07:50:33 PM »
Do we really need this info (calculated uncompressed size to already hw compressed size comparizon) during MLV->MLV pass-trough? Maybe make it somewhat optional.

no, good point.
reworked a lot of stuff (so errors may appear that weren't present before).
this is one thing. got to fix that, right.
Help us with datasheets - Help us with register dumps
magic lantern: 1Magic9991E1eWbGvrsx186GovYCXFbppY, server expenses: paypal@g3gg0.de
ONLY donate for things we have done, not for things you expect!

jimiz

  • Freshman
  • **
  • Posts: 64
Re: crop_rec on steroids: 3K, 4K, 1080p48, full-resolution LiveView
« Reply #624 on: May 02, 2017, 08:11:42 PM »
With the settings recommended in the first post, 1920x960 50p is continuous here (orange icon at first, green after ~30 seconds).

Benchmark results tomorrow (will let the script test the two builds overnight).

Thanks A1ex

to me and a friend (we have same CF   CBx1066 tested)    with 27 and 29 april , vers. 123  ,   orange icon at first 20 seconds circa  red after and stop!  no way ...tryed 20 times...
if we set 1920x800  orange icon at first 10-15 seconds...green , orange, green.... but seem to be continued...(i try more of 2-3 minutes without stop)

so I don't know if 1920x960 50p was working better in old version...this I can't say....

5D3-123