Magic Lantern Cinema Camera - Dual ISO without aliasing & without quality loss!

Started by theBilalFakhouri, September 18, 2018, 10:00:59 AM

Previous topic - Next topic

0 Members and 1 Guest are viewing this topic.

a1ex

Quote from: Danne on November 01, 2018, 08:43:40 PM
Changed this to following and image is corruption free!:
                int fps_timer_b = (shamem_read(0xC0F06014) & 0xFFFF) - 3;

Also tested below but wouldn´t work:
                int fps_timer_b = (shamem_read(0xC0F06014) & 0xFFFF) - 1;

Very nice find!

The FPS timer itself is correct with +1; the issue is what gets computed afterwards.

Is it enough to reduce the value just for 0x8179 and 0x8197 (i.e. fps_timer_b - 5 or maybe lower)?

Canon values: https://www.magiclantern.fm/forum/index.php?topic=19300.msg202783#msg202783

Quote from: a1ex on October 29, 2018, 05:38:24 AM


squig


mothaibaphoto

Wow, Danne, congratulations!!!
Greatly appreciate your efforts, you get something new and interesting to experiment with.
Shoot "Battleship Potemkin" remake for example :)
This is what I like about ML most: a big journey could be started just by uncommenting a couple of strings in sourcecode :)

Danne


squig

Oops, my bad.

I tested the latest build 12bit 1920x2352 3200/100 ISO, same lighting/shot as my earlier tests: it looks completely clean, no vertical stripes or noise. Nice work.

70MM13

For me, only the 3240 versions are stable.  Extremely bright areas get that interlacing failure on the 23.976 FPS versions in almost every instance.

But the 3240 versions are very nice.

The stripes are still there but now at the same level as the noise floor, only visible if pushed really hard.

Here's a sample MLV (1 frame) of a good test.  Raise the exposure by 2.5 stops and drop the shadow strength to 8 and you're in the right area.

That light bulb is very unique.  It is a point source with a cylindrical lens, so it's almost as bright as the sun but it puts out very little light.  The scene is actually quite dark.

https://drive.google.com/file/d/1F1n39758QmkMqapsJLWnogDTljBEGw51/view?usp=drivesdk

Here's a video with the same bulb in an even darker scene I shot using the ISO experiments.  The artifacting is thanks to YouTube.

https://youtu.be/Dcj16103JF8

I'm shooting a video on Sunday.  I'd love to try this dual ISO if it can be stable at 24 FPS at 2.35:1

vstrglv

Canon 5D3,1.1.3; Canon EOS M,202,  CF-SanDisk Extreme PRO,160MB/s, 256GB, SD-SanDisk Extreme Pro, 170MB/s, 128GB.

70MM13

Vertical, but they're basically gone unless you are digging in the shadows, but the noise there is just as strong.

For "easy" lighting conditions, this is fantastic now.  I just really need 24fps (or 23.976) at 2.35:1 working without problems...

Danne

Quote from: 70MM13 on November 02, 2018, 05:46:03 PM
Vertical, but they're basically gone unless you are digging in the shadows, but the noise there is just as strong.

For "easy" lighting conditions, this is fantastic now.  I just really need 24fps (or 23.976) at 2.35:1 working without problems...
But these issues are probably the same or worse with regular raw shooting no?

By the way. Just set Resolution to 1840x2353 and you got 2.35:1

And here is also 23.976:
https://bitbucket.org/Dannephoto/magic-lantern/downloads/crop_rec_4k_mlv_snd_1x3_10bit.5D3113_presets.zip

70MM13

Thanks, Danne.

I will play with it!

It's so great to have these capabilities from our outdated cameras!

vstrglv

Quote from: 70MM13 on November 02, 2018, 05:46:03 PM
Vertical, but they're basically gone unless you are digging in the shadows, but the noise there is just as strong.
But there is a lot of horizontal stripes. Is it normal?
Canon 5D3,1.1.3; Canon EOS M,202,  CF-SanDisk Extreme PRO,160MB/s, 256GB, SD-SanDisk Extreme Pro, 170MB/s, 128GB.

dfort

Quote from: 70MM13 on November 02, 2018, 05:46:03 PM
I just really need 24fps (or 23.976) at 2.35:1 working without problems...

Quote from: Danne on November 02, 2018, 06:02:24 PM
Just set Resolution to 1840x2353 and you got 2.35:1

Might be asking for too much and I haven't played around with it yet but would a resolution of 1920x2488 at 23.976 fps be possible?

2488/3 = 816
1920x816 = 2.35:1

70MM13

Quote from: vstrglv on November 02, 2018, 07:17:36 PM
But there is a lot of horizontal stripes. Is it normal?

Do you mean in the sample MLV I uploaded?

If so, I don't see any horizontal stripes.  Are you sure you turned on dual ISO under the raw correction tab on mlvapp?

Danne

Quote from: dfort on November 02, 2018, 07:26:28 PM
Might be asking for too much and I haven't played around with it yet but would a resolution of 1920x2488 at 23.976 fps be possible?

2488/3 = 816
1920x816 = 2.35:1
Got some good schooling from both Bilal and Levas on pushing the timers and did a fair amount of testing so personally I am pretty much out of ideas atm. I did push the timer a few more steps and it gave me a wee more height but instead it was getting more prone to corruption.
There is some cutting on the image which I don't know why except that it do gives a black border without it so don't think that is an option to tweak.
Good part doing the 2.35:1 a I described is that you get continuous shooting with the 12bit opotion.

theBilalFakhouri

Quote from: theBilalFakhouri on October 18, 2018, 06:33:44 PM
5D3 can already do 3072x1920 in 1x1 @24 FPS so it can do also 1920x3072 in 1x3 resized to 1920x1024 (I have tested it in 700D I can do 2306x1736 in 1x1 and also 1736x2306 in 1x3 so same thing here). Write speed will be very high 1920x3072 @24 10-bit lossless about ~120MB/s in 5D3

I think it's possible but it needs to tweak something. I got above results in new crop_rec.

Danne

What are your results on the 700D? 2306x1736? Far from 16:9. Are the limits the same for 1x1 and 1x3? Didn't Levas get around 100fps from 1x1 but downsized? If we havn't hit rooftop yet we should keep looking  8).

vstrglv

Quote from: 70MM13 on November 02, 2018, 07:49:20 PM
Do you mean in the sample MLV I uploaded?

If so, I don't see any horizontal stripes.  Are you sure you turned on dual ISO under the raw correction tab on mlvapp?
Sorry, my fault.
Canon 5D3,1.1.3; Canon EOS M,202,  CF-SanDisk Extreme PRO,160MB/s, 256GB, SD-SanDisk Extreme Pro, 170MB/s, 128GB.

Karim

Quote from: theBilalFakhouri on September 22, 2018, 12:43:37 AM
@Karim

Yes 3x3 and 1x3 is about line skipping in sensor.


Doing Dual ISO after the Binning process it will show a lot of artifacts and aliasing here will come the big benefit of 1x3 mode applying Dual ISO in full sensor height (using more pixels for dual iso) then stretching it down to the correct aspect ratio. In this way the details will be restored with less aliasing and less noise too.

In MLVApp there are no problems when using Dual ISO with

And you can speak Arabic you are from Egypt? I am from Syria nice to meet you here in the forum :D

أهلاا و سهلاا

Nice to meet you too Bilal  :D
أهلا وسهلا بيك يا بلال و مبسوط جداً من ابحاثك و تجاربك فى الكاميرا انت عبقري  8)

I was confused about 1x3 and 3x3 but I think I started to catch it right

I tried MLVapp v1.2 and it gave me stable dual iso results, not like the crappy test I made on v1.0
but still, I got minor artifacts like red and white dots it appears like for 1 frame long.

I shooted a 10-sec video and I spotted like 7 or 10 dots in total that appear and disappear instantly
I tried to mess with some setting in mlv app dots almost gone like 1 or 2 dots

It was 14bit lossless 30fps out of 6d
I used:
in details panel
Denoise window 3x3
strength: 35

export settings
prores4444
ffmpeg kostya
LMMSE
resize 1920x1080 (was 1824x1026)
smooth aliasing tried off, 1 pass , 3 pass
seems like 3 pass was softest image but no small dots also less aliasing (straight lines still looks like a zigzag)


Sorry if it's not even related to your 700d research I just wanna to share with you my experience to know if its common or im having trouble in my raw mlv workflow, I feel that I can't rely on it in serious projects yet :(

Karim

Quote from: Levas on September 22, 2018, 11:31:06 AM
@Karim, are you sure you didn't accidentally enabled other options in MLVapp, like the option to fix 'pattern noise', right below dual-iso settings in MLVapp ?
Pattern noise option really messes up my dual iso video.
I tried to turn them on / off.. but now I got stable dual iso results on v:1.2 of MLVapp
thanks for your help dude  :D

bouncyball

Quote from: Karim on November 12, 2018, 05:15:22 AM
but still, I got minor artifacts like red and white dots it appears like for 1 frame long.
Try turning off the bad pixel removal. This might help.

Tyronetheterrible

I apologize for the naive question, but I was looking into the 1x3 binning module for my 6D.

Are there any advantages in terms of picture quality to using the 1x3 binning for a 16:9 aspect ratio when compared to just using the 6Ds max resolution in 16:9 (1824x1026) in 24 fps in 14 bit lossless?

It might be of note to mention that I have the VAF-6D anti-aliasing filter installed on my 6D, so I am not sure if this further diminishes any advantages to using the 1x3 binning?

theBilalFakhouri

@Tyronetheterrible

The first benefit when using 1x3 Binning was to kill aliasing and moire patterns completely, so if you have a VAF filter it can do the job greatly and you don't need this mode.

But if you are using Dual ISO in video even with a VAF filter after processing you will see horrible alisaing and moire and you will lose the half quality of the image, Now with 1x3 Binning and Dual ISO the 2nd benift comes here No alisaing, moire patterns and no loss in the details at all!

Also when using 1x3 Binning it reduces the noise in the video. Read the first post for more informations.

Okay but this mode has limitations you can't use 16:9 aspect ratio in full sensor size, in 6D Max 1824x600 @ 24FPS a wide aspect ratio (maybe we can push it a few pixels, and of course you can drop the resolution in mlv_lite to get 16:9 with cropped FOV area) with write speed of ~80 MB/s in 14-bit lossless and stretched real-time preview.

Otherwise talking about the image details between 3x3 normal mode and 1x3 mode there is no difference only the aliasing and moire has been gone (you can compare it too).

dfort

@theBilalFakhouri -- Do you have your code saved in a Bitbucket repository? I'd like to compare what you're doing with Danne's code.

berechiah


Walter Schulz

Lines(rows) x Columns. An array.
Native Canon full HD (1920x1080) in 5D3 is processed by 3x3 binning. Means: The data contents of 3x3 pixels are processed into 1 pixel output.

1x3 binning is done in most other Canon DSLRs: 3 pixels in a line are binned but lines are treated not this way. Only every 3rd line is processed. 2 out of 3 lines are not processed at all, they are "skipped". Visible aliasing effects often occur. Canon fights this by some data manipulation with disputable results.

With ML RAW/MLV it is possible to use one or the other.
And there is a third option 1:1 (or 1x1) where no binning and skipping takes place. But this requires using a reduced sensor area = Crop mode.