12-bit (and 10-bit) RAW video development discussion

[danilaswift]

Hello. Guys please lend the old assembly for canon 650d. In the new build of 2017 I was not happy with the video quality (ie, 12bit). Video is too sharp and a lot of red dots. In the old version, this was not.

[honza123]

Short video test of 10bit raw with EOS 600D:

Build dfort: magiclantern-raw_video_10bit_12bit.2017Jan02.600D102
I recorded 32 pcs of mlv files (raw_rec.mo). All was withouth damage or green cast.
The shutter time 1/30s was not good choice -> flickering
Original video file: https://ulozto.cz/!FwuHK8wc9CET/10bitraw-video-test-karvina-frystat-mp4

[reddeercity]

Thanks a lot Reddeercity !Yours settings files rules ! Now I have greyscale liveview on 5D2 , great ! On my settings I changed PAL to NTSC without results on unfreezing.
But with yours settings, I changed NTSC to PAL and liveview freezes ... so NTSC with your settings is the graal.
So I think, NTSC is not the only one parameter to tweak.
I post my old settings to find the differences with yours because I don't understand the meaning of each parameter on these config files.
magic.cfg :

Code: [Select]

# Magic Lantern Nightly.2016Dec01.5D2212 (b3dfbe7194f3 (x-perimental) tip)
# Built on 2016-12-01 22:52:58 UTC by rosiefort@RosieFoComputer
# Configuration saved on 2017/01/05 09:04:53
beta.warn = 5
menu.first = -7
time.indicator = 1
movie.log = 1
bv.av = 35
bv.tv = 99
bv.iso = 117
bv.auto = 1
rec.notify = 4
screen_layout.ext = 0
shutter.lock.value = 99
shutter.lock = 1
enable-liveview = 2
movie.restart = 1
fps.preset = 1
fps.override.idx = 32
fps.override = 1
zoom.disable.x10 = 1
hdrv.iso.b = 112
hdrv.iso.a = 88
battery.drain.rate.rev = 149
hist.meter = 0
audio.mgain = 0
audio.dgain.r = 18
audio.dgain.l = 18
audio.monitoring = 0
audio.input-choice = 0
crop.playback = 1
spotmeter.draw = 0
clear.preview = 4
waveform.draw = 0
zebra.draw = 0
global.draw = 0
disp.mode.x = 4

Looks like you have Auto Settings enabled , all my settings are manual .
So set the programs dial on the top left hand side to "M" and I use manual WB in Kevlin also ISO .
I use no Auto setting (only exception is ML Liveview Preview).
Only load the min needed for raw video to avoid problems .

[dfort]

New test builds posted.

https://bitbucket.org/daniel_fort/magic-lantern/downloads

Downloads for the Jan 2 test builds. Checkmarks are for cameras that are working with CONFIG_EDMAC_RAW_SLURP:

5D3.113	-	35	√
5D2.212	-	27
5D3.123	-	23	√
6D.116	-	13	√
60D.111	-	9	√
7D.203	-	8
50D.109	-	8
600D.102	-	8	√
EOSM.202	-	7	√
700D.114	-	7	√
550D.109	-	7
650D.104	-	5	√
500D.111	-	1

[MitchLally]

I shot a wedding last week – 10bit MLV lite on 5D3. All shot at 60p. It is quite stable. Had 2 clips with black level issues much like aforementioned in this thread. 1 clip completely corrupt, not sure why. Here's the link:

[a1ex]

Added 10/12-bit builds to the nightly server:

http://builds.magiclantern.fm/experiments.html

Current builds are probably identical to dfort's (didn't really check); future builds will just track the raw_video_10bit_12bit branch. 1100D is included as well, but raw recording support is quite incomplete. Please report and fill in the missing bits.

[RenatoPhoto]

Would love to test 5D3 123..  but it is missing..
Thanks for your support!

[maxotics]

I'm looking forward to the 7D.  FYI, it doesn't seem you can use normal MLV with the EOS-M 10/12-bit build.  It will say "thread not starting" or something like that.   So seems like that is a 10-bit build only.

[Danne]

Turn off raw_twk. That and snd.mo don,t go well together.

[D_Odell]

Beginners question: what is and what does CONFIG_EDMAC_RAW_SLURP do? Curious..

[a1ex]

A method that retrieves the raw data from Canon's image processing pipeline to main memory by configuring the DMA (EDMAC) directly, with our own parameters, rather than calling Canon code (lv_save_raw).

See here and look it up in the source code, or here on the forum.

Initially implemented for 5D3 1.2.3 to fix corrupted frames.

[DeafEyeJedi]

It seems it also can be used as a cheat sheet for dev's to pick up certain EDM addresses already provided for each specific settings in order to save time and get things implemented rather quicker basically.

Here's what the first page upon running EDMAC (after 'Don't click me!') looks like:

[RTI]

Currently testing 10bit on my canon 6D
-I'm getting random slowdowns (using a lexar UHS-I 128 633, max write speed with 6D is around 38-39Mb/s) - quite often I get 9-10 MB when trying to record (can't reproduce it).
-Also, battery percentage always shows 100% (when in global draw ofc, in canon menu the right values are displayed).
-ISO display seems to show only full EV values, no 1/3EV.
-mlv_play doesn't work, shows some corrupt images.

[dfort]

If you want the latest builds, bookmark this address:

https://builds.magiclantern.fm/experiments.html

I'm still putting up builds for the 5D3.123 and the platforms without CONFIG_EDMAC_RAW_SLURP. Seems that there is still some limited 10bit/12bit functionality on the 5D2 and maybe 7D. It is also a way to keep track on which platforms still need to catch up.

https://bitbucket.org/daniel_fort/magic-lantern/downloads

Hum, 121 downloads for the 550D?

[Frank7D]

Yes, the 7D works fine (for my purposes) in 5x crop mode with the exception of not having true live framing (but I wasn't using that even with 14 bit). I have seen no corruption issues in crop mode with 10 and 12 bit.

[NoCp_Albert]

Hallo dfort

the last build from https://bitbucket.org/daniel_fort/magic-lantern/downloads/magiclantern-raw_video_10bit_12bit.2017Jan05.5D3123.zip shows me the problem during mlv_play, without loading the raw_rec module I get corrupted files to see, if I see the recorded frames at MLVProducer everything is ok. If I load the raw-rec module and record with mlv_rec also in mlv-play I see the clip correct. This was not happen on your build from 2 January 2017.

If I like to go back from 5xCrop used with 50fps by 10bit 1920x648 to 5xCrop 233x1314 25fps 10bit must switch of and on to work with the new setting. With 5x crop the lifeview shows the the images are jumping from normal size to 5x crop sometimes, if you like i prepare a video to show what I mean.

When I try to use normaly 1920x1080 25fps by 10, 12, 14 bit the record stops after 12 seconds bei "Frame skipping"

[Levas]

I tried the -a(average all frames) option in mlv_dump.osx on some 12 bit files for creating darkframes.
But the average file doesn't look right...it looks like a weird purple frame (when extracting the MLV files to dng's, I get normal black frames...)
Could it be that the average all frames option in mlv_dump doesn't work (yet ) on 10 and 12 bit files ?

[Danne]

Do you get the same with 10-bit? I use it without issues in cr2hdr.app.
g3gg0 rewrote code so it works with 14bit code in mlv_dump. Very great.

[g3gg0]

I tried the -a(average all frames) option in mlv_dump.osx on some 12 bit files for creating darkframes.
But the average file doesn't look right...it looks like a weird purple frame (when extracting the MLV files to dng's, I get normal black frames...)
Could it be that the average all frames option in mlv_dump doesn't work (yet ) on 10 and 12 bit files ?

will investigate that

[Danne]

Just ran darkframe averaging on my eos m in 12bit and all was working fine on that particular cam. Make sure to use the very latest version of mlv_dump.

[g3gg0]

ok thanks. you ran it on osx ?

[Danne]

Yup macOS Sierra.

[Levas]

Sounds like I'm doing something wrong here...
I'll try the latest mlv_dump, is there a standard download location for the newest mlv_dump?

[Danne]

It,s in the 10/12bit branch.
http://www.magiclantern.fm/forum/index.php?topic=7122.msg177020#msg177020

[teatotalTED]

Hum, 121 downloads for the 550D?

That'll be because there's a lot of 550D users, more than EOS M and for good reason. Joking aside, 12bit works so some improvement for limited card write speed, obvious 10bit is eagerly awaited no doubt.