3K/UHD 5D2 Raw development and Other Digic IV Cams

[Dmytro_ua]

I hope you guys enjoy

I see some strong "ghosting/blurring" on moving objects. Why is it so?

[ilia3101]

Awesome work you guys do !

I also get inspired by all the good videos, especially by Ilia Sibiryakov.
So I bought a used 5D and went for holidays to fool around a little bit.
The newest build worked pretty well for me.

I hope you guys enjoy

What a wonderful video. Good colour and composition. And nice lens choice, I once had a sigma 15-30

Also what was the lens? Think you should buy another one if want to shoot in 4k, because in my opinion the lens resolution here is not enough for it.

I thought the Helios 44's softness looked really nice actually, a pleasing glow. The shots at 0:44 1:49 and 3:03 in my opinion are examples of that.

I see some strong "ghosting/blurring" on moving objects. Why is it so?

If MLV App was used, "smooth aliasing" filter was probably enabled on export. I have seen a few videos affected by it before. @masc it should have a warning label so people don't accidentally use it on shots with moving objects. It doesn't even do much for tripod shots anyway.

You need to include the OB range , even thou the final resolution is 3008x1080 there more area to consider here .

Code: [Select]

Default Crop Size               : 3016 1080
Active Area                     : 52 160 1132 3176as you can see the real size is 3016x1080 but because of mod8 rules the mlv_rec only save as 3008 .
Now  in the raw image dump to dng you can see the OB area included now  3176x1132 , the 52 160 is the crop offset
52lines for vertical & 160 lines horizontal = 3016x1080 (mlv_rec cropped 3008x1080) .

So let figure out the math for the over all size with OB to MP/s
3176*1132*23.976 =  86.19 MP/s so there less then 10 MP/s left for total available of 96 MP/s so there
must be a little overhead there in headtimers , so I think that really the limit unless there a way to increase the frequency
from 24MHz to let say 32MHz , that would give us 128MP/s good enough for 3520x1350 @ 23.976(114 MP/s) with OB it would be (3680*1402*23.976=123.7 MP/s)

I see. So OB is just black area? Maybe that could be reduced somehow. Sad to know that maybe it really is reaching the limit now.

[domasa]

"ghosting/blurring" on moving objects

Probably bad project settings and export...

[andy kh]

i think its the shutter speed problem. double of your frame rate is all you need

[shiro_hh]

Probably bad project settings and export...

No its not, i just messed up the shutter speed in most of the shots Cam resets every time to 38 after writing, i dont know why.... And i didnt realize this most of the time in the sunny environment.

[shiro_hh]

i think its the shutter speed problem. double of your frame rate is all you need

thats right i just messed up the shutter speed.

[shiro_hh]

What a wonderful video. Good colour and composition. And nice lens choice, I once had a sigma 15-30

I thought the Helios 44's softness looked really nice actually, a pleasing glow. The shots at 0:44 1:49 and 3:03 in my opinion are examples of that.

If MLV App was used, "smooth aliasing" filter was probably enabled on export. I have seen a few videos affected by it before. @masc it should have a warning label so people don't accidentally use it on shots with moving objects. It doesn't even do much for tripod shots anyway.




I see. So OB is just black area? Maybe that could be reduced somehow. Sad to know that maybe it really is reaching the limit now.

@ Ilia : Thanks mate i appreciate that.

Regarding the Blur... It is messed up shutter speed...  dooh :/

[shiro_hh]

@shiro_hh

Hi, here at 2:34 - this footage with kite in sky also shot in 4k? And what was the FPS and shutter speed did you use? Every moving objects are so blurred. Also what was the lens? Think you should buy another one if want to shoot in 4k, because in my opinion the lens resolution here is not enough for it.

I shot in 2624x1192 and pumped it up to 3840x fps=24 Shutter Speed 38 (messed up most of the time) and yes you right, the lenses arent probably enough (helios 44, sigma 15-30)
But i will be striving for better results next time. It was a first atempt with ml and this setup

[reddeercity]

Thanks guy for the sample of 4k Anamorphic in the real world  looks good , since no one has any big problems
I  updated the first page/post with 4k anamorphic build & setup video for more users to test out ( *note* not for the faint of heart , real bleeding edge stuff)

[reddeercity]

Playing around with the 1:1 3.5k centered crop_rec preset , I can push the vertical to 2784x1160 @ 23.976fps
I have to reduced the vertical to 1160 from 1200 , so you lose 40 lines vertical but gain 192 lines horizontal .
A.R. is 2.40 , so is this something that would be used ? I'll put up a test build later on .
So it seems that 86 MP/s is as far I can go currently , unless I can find where the overhead is limiting the total output of 96 MP/s
So for the one's follow alone , the raw dump image is 2952x1213 with offset crop 52 vertical & 160 horizontal = (2792x1161) mod8 rules =2784x1160
FYI 2.952*1.213*23.976=85.85 MP/s .

[zcream]

sure , I'll let you know when it's ready

I'm going to clean up my 50d tonight ...wowowow.. I'm so excited about this

Sent from my Redmi 4A using Tapatalk

[Igor_Braun]

@Reddeercity, so, maybe you already knew it, but i just noticed that if you select 14 bits and global Draw is "on" with Ml Grayscale preview, then the lifeview become lifeview =) It's around 1 fps, but better then nothing. And it freezes when selecting 12 or 10 bpp. Why is it happening?
I've also tried to connect an external hdmi monitor, but it doesn't work (no signal) if enabling anamorphic 4k preset.

[ilia3101]

Playing around with the 1:1 3.5k centered crop_rec preset , I can push the vertical to 2784x1160 @ 23.976fps
I have to reduced the vertical to 1160 from 1200 , so you lose 40 lines vertical but gain 192 lines horizontal .
A.R. is 2.40 , so is this something that would be used ? I'll put up a test build later on .
So it seems that 86 MP/s is as far I can go currently , unless I can find where the overhead is limiting the total output of 96 MP/s
So for the one's follow alone , the raw dump image is 2952x1213 with offset crop 52 vertical & 160 horizontal = (2792x1161) mod8 rules =2784x1160
FYI 2.952*1.213*23.976=85.85 MP/s .

2792x1161 is a much improved resolution I think, better balance of width and height (to my taste). Definitely worth releasing a build. Not than I can test with my broken 5D

[jpegmasterjesse]

I was able to get continuous 4k with my Lexar 32gb 1066x!

[reddeercity]

@Reddeercity, so, maybe you already knew it, but i just noticed that if you select 14 bits and global Draw is "on" with Ml Grayscale preview, then the lifeview become lifeview =) It's around 1 fps, but better then nothing. And it freezes when selecting 12 or 10 bpp. Why is it happening?

I heard something about it a while ago , yea I kind of figured in 14bit it would (it's the camera's backend bit rate) but never thought to test it , as 14bit is not feasible ,
unless I get lossless working (14bit at about 50-60% compression)  .
10 & 12bit comes from what I understand comes from a different area (A1ex could explain better then me) That's why I tried to get 3.5k centered preset
with at least the same preview as 3x crop_mode .

1x3 4k anamorphic will be better with canon reatime preview with almost correct aspect ratio , that's because 1x3 is in 5x Zoom mode (3xcrop_mode)
https://www.magiclantern.fm/forum/index.php?topic=19336.msg213010#msg213010
https://www.magiclantern.fm/forum/index.php?topic=19336.msg213265#msg213265
1632x1828 @ 23.976 fps (1x3) --> 4896x1828 @ 23.976 fps without any aliasing or moiré pattern

[Igor_Braun]

@reddeercity, thanks for answering.
Ugh.. I've been trying to get into all that sourcecode for learn it (i'm not a programer at all) and maybe help you with some little tweaks (my objective was to center the 4096x590, I actually LOVE this preset, It looks so quality and cinematic). Actually my brain has been exploded I was following your video about compiling ML via Ubuntu in virtual machine and got a bunch of errors in the way to open the croprec code. Was googling how to fix. So, now i'm trying to clone the source code and getting errors about that in the terminal. If I overcome all that shit i'll try to get inside 

[banertop]

Yes, 4096x590 is very cinematic!!!

[reddeercity]

*Note's for me for later investigation*
looking in to (M)JPEG encoder , it seems that there was some development on 5D2
well , really some jpeg code execution on 5D2 , a1ex had some success back 2012 with 5D2
https://www.magiclantern.fm/forum/index.php?topic=2803.msg12793#msg12793

https://www.magiclantern.fm/forum/index.php?topic=2803.msg17885#msg17885

Code: [Select]

On 5D2, the syntax is: call("lv_save_jpeg", 1)

this maybe of interest to 550D user for lossless compression , thou it's was mainly for Jpeg but that where lossless come from , so still hope for you guys yet !
https://www.magiclantern.fm/forum/index.php?topic=2803.msg12793#msg12793

Maybe possible to play with HD buffer too (hopefully to increase for crop_rec res. for hdmi)
https://www.magiclantern.fm/forum/index.php?topic=2803.msg12100#msg12100

Code: [Select]

for 5D2
c0f04008:  4000080 <-- HD buffer

[Galterius]

Awesome work you guys do !

I also get inspired by all the good videos, especially by Ilia Sibiryakov.
So I bought a used 5D and went for holidays to fool around a little bit.
The newest build worked pretty well for me.

I hope you guys enjoy

Wow very nice video !! I also have a 5d2, but I have some issues with the last builds, so I wanted to know if you had a big green tint in your videos when you opened them in mlv app ?
and also which format did you choose to export ? thnaks !

[Galterius]

I don't know where that green tint comes from, but in some shots all shadows are completely green and I see some sort of "green chromatic aberration" on some others...
here are 2 clips, the edge of the flower is weird in one and again heavy green tint on both when I open them in MLV app (v1.7)

https://drive.google.com/file/d/1LW5hHsyuWd_gyprptBxXp75Cx_Z_k-yV/view?usp=sharing
https://drive.google.com/file/d/1ka62BY_UILq3TZy81gav9BXXDI6xE1PX/view?usp=sharing

I used the build from May 24 2019 (2592x1200) and I had the right shutter speed

[reddeercity]

@Galterius , I checked  your files , black level is off by a few numbers (120 & 119) should be 112 your can correct that in MLV App. or MLVProduder by adjusting the raw black level slider.
To know why this happen , I need to know the content of the ml setting folder & the exact build date ( this can seen in the autoexec.bat file with a simple text editor.

Code: [Select]

Magic Lantern crop_rec-4k-5D2-eXperimental.2019May30.5D2212
Camera   : 5D2
Firmware : 212
Changeset: 8bfbb0ca228e+ (crop_rec_4k_5D2) tip
Built on : 2019-05-31 05:50:42 by david@reddeercity

diff -r 8bfbb0ca228e src/raw.c
--- a/src/raw.c Sat Sep 08 11:26:34 2018 +0200
+++ b/src/raw.c Thu May 30 23:50:42 2019 -0600
@@ -32,6 +32,11 @@
  

[Galterius]

Thanks @reddeercity ! I will try to fix the black level
here is the ml settings file :

https://ibb.co/hy3H8pg

[Danne]

Can somenone point me to the exact branch and code used here. I could then take a look at the black level issue and probably fix it. I need crop_rec.c implementation of the preset in question and the contextual raw.c from the actual branch used.

[waza57]

Hello Danne,

Hacking the hack. Let's take one of the builds from first post:

It contains a single file: crop_rec.mo. Put it in your magic-lantern/modules directory and run:

Code: [Select]

./module_hginfo_dump.sh crop_rec.mo

Result:

Code: [Select]

Build date  : 2019-04-05 04:19:36 UTC
Build user  : david@reddeercity

diff -r 8bfbb0ca228e modules/crop_rec/crop_rec.c
...
< what follows is the complete source code of crop_rec, displayed as diff from changeset 8bfbb0ca228e >

Changeset 8bfbb0ca228e is public (exactly where reddeercity indicated). The diff embedded in the binary module (crop_rec.mo in our case) contains all changes to that module, since the reference changeset.

Et voilà, you've got the complete source code.

So , it's seem that  reddeercity worked on a clone of my repository. As apparently we can not speak about this subject with him we must do archaeology of code.
And to avoid triggering his anger, I suggest you do not talk to him about it.

I believe but I am not sure that since then, the only changes it makes is found in the crop_rec module.
This implementation of crop_rec for 5D2 is so the last time we have trace of a complete source code.
I do not have enough time to dig through the whole thread but it would be really nice to have a summary of the registry changes to get the progress that reddeercity  found:

2624x1200 @ 23.976 fps with the full vertical heigh
4096x590 (Anamorphic 4096x1770) @ 23.976 fps
....and other things that don't remember.

These only in these conditions I could easily update the source code.

[Danne]

Hopefully he respects your wishes here Waza57. And welcome back!
I could probably track and put the pieces together here but it's such a waste of time...