Author Topic: 3K/UHD 5D2 Raw development and Other Digic IV Cams  (Read 246682 times)

Igor_Braun

  • Member
  • ***
  • Posts: 118
Re: 3K/UHD 5D2 Raw development and Other Digic IV Cams
« Reply #1150 on: January 07, 2020, 09:07:36 PM »
Hi, @Reddeercity

I did some tests, it's dope...   :)

Centering is perfect, thanks
centering" border="0
https://i.ibb.co/D54QNnz/centering.jpg

Unfortunately, I don't have any cool interiors or good looking landscape and motorized slider as well... so I shoot a 5k panorama with gimbal and downscaled it to 4k because my computer is toooo slow for 5k, or even 2,5k, and my software is unable to render videos that are more than 2880 vertically, so I had to render it with "avi ucompressed" to get 5632 x 3124 it requires a lot of space, so I rendered two videos: 1. only 3 sec of 5k and 2. whole panorama in 4k

4k 5k 3 sec
But there is a problem (for me). Even in 14 bit with global draw allowed in 4k, I got a frozen preview.

Videos from phone:
5k 4k  (frozen preview is here)

Also, got lines in shadows (i think it disappears with time)

SHADOWS" border="0
https://i.ibb.co/sgRVK3R/SHADOWS.jpg

@Reddeercity, what do you think about 4k 16:9 (binned or regular) with small FPS? 

PS:
What do you think about 1dx mark iii. I was shocked by 5.5k 60 fps raw internally but it has only 20,1 mp in 2020 is it ok for photographers? We have 21 in 5d2 :)

Dmytro_ua

  • Member
  • ***
  • Posts: 193
  • Kyiv, Ukraine
Re: 3K/UHD 5D2 Raw development and Other Digic IV Cams
« Reply #1151 on: January 08, 2020, 11:00:05 AM »
it has only 20,1 mp in 2020 is it ok for photographers? We have 21 in 5d2 :)

Yes, it's more than enough for professional use. But it's not enough for cell phone users, that's why very soon we'll see 108-megapixel in Xiaomi  ;)
5d3 1.1.3 exp | Canon 16-35 4.0L | Canon 50 1.4 | Canon 100mm 2.8 macro
Ronin-S

reddeercity

  • Contributor
  • Hero Member
  • *****
  • Posts: 2255
Re: 3K/UHD 5D2 Raw development and Other Digic IV Cams
« Reply #1152 on: January 09, 2020, 07:27:51 AM »
Quote
what do you think about 4k 16:9 (binned or regular) with small FPS? 
New Update: 4K 16x9 , 1:1 pixel  (4096x2160) at 8fps

@Igor_Braun  try this
magiclantern-crop_rec-4k16x9_8fps-5D2-eXperimental.11.01pm-2020Jan08.5D2212.zip

It's 4096x2160 1X1 @ 8fps , I can push it to 9.5fps but it's not a good  rate to made 24fps in hyper-lapse (8fps*3=24fps)
so the frame divide equally for good film motion .
Write speed is around 83MB/s , so limited number of frames , around 350-400 @ 10bit but if you drop the A.R. to 1.85 (4096x2048) this is continuous at 73MB/s or around there .

Igor_Braun

  • Member
  • ***
  • Posts: 118
Re: 3K/UHD 5D2 Raw development and Other Digic IV Cams
« Reply #1153 on: January 09, 2020, 08:00:24 PM »
Hi, Reddeercity, thanks for your amazing work!

My camera is happy every time a new firmware comes out...

It worked for me:

8 fps - it's an ideal decision in my opinion.

Can't wait to test it. Will try to do it tomorrow or the day after, when it's daylight in the same place i shoot 5k panorama  ;)

And i still think it perfect for interior shooting.
Just look at tre first 3 seconds. This is what i'm talking about.
This shot with gimbal, but hope i'll have possibility to shoot a wide-open bright interior with motorized slider and 4k or 5k 16:9 preset

Edit: Did a small 3 sec video in my place instead of going outside  :P:

reddeercity

  • Contributor
  • Hero Member
  • *****
  • Posts: 2255
Re: 3K/UHD 5D2 Raw development and Other Digic IV Cams
« Reply #1154 on: January 11, 2020, 05:57:34 AM »
Here a sample frame of the sunset with 4096x1842 @ 8fps from my back door , dam near froze my finger off -25°C  :(


4096x1842 M09-1723_0-00-00-09.png
4096x1842 M09-1729_000000.dng

Exported , cdng from mlv app , mlvfs quick mount doesn't reconizes the .mlv  say it "can't be mounted" I'll have to look in to mlvfs.dll I guess .
Imported in to After Effect CS6 , the dng I posted is the first frame from the sequence so A.E. applies the camera raw adjustment to it so
it will look like the post png plus it will have the metadata from the ACR embedded , FYI .   
Shot at 24mm with a 1.4 crop from full frame = to 34mm @ F8 + Variable ND at 4stops down , 100 ISO , 1/8th shutter .

Not sure yet but I think I like the 5.6k preset better @ 4fps , need to play around with it more .

Skinny

  • New to the forum
  • *
  • Posts: 37
Re: 3K/UHD 5D2 Raw development and Other Digic IV Cams
« Reply #1155 on: January 11, 2020, 08:01:29 PM »
@reddeercity, would it be possible to make something like 5.6k but write only every second pixel to CF (or read only every second pixel, I don't know) so we would have a full sensor image with a ~2.8k resolution?
I think it would be almost free of aliasing when converted to 1080p in post, very low-noise and cinematic.. and it would save the card space and speed and everything, while still being full-frame..

But I don't know if this is technically possible at all :)

ilia3101

  • Moderators
  • Hero Member
  • *****
  • Posts: 923
Re: 3K/UHD 5D2 Raw development and Other Digic IV Cams
« Reply #1156 on: January 11, 2020, 08:07:30 PM »
Not sure yet but I think I like the 5.6k preset better @ 4fps , need to play around with it more .

Keep both!!!

@reddeercity, would it be possible to make something like 5.6k but write only every second pixel to CF (or read only every second pixel, I don't know) so we would have a full sensor image with a ~2.8k resolution?
I think it would be almost free of aliasing when converted to 1080p in post, very low-noise and cinematic.. and it would save the card space and speed and everything, while still being full-frame..

But I don't know if this is technically possible at all :)

You'd get a black and white image with aliasing, but I'd be interested to see how it really looks.

Skinny

  • New to the forum
  • *
  • Posts: 37
Re: 3K/UHD 5D2 Raw development and Other Digic IV Cams
« Reply #1157 on: January 11, 2020, 08:45:59 PM »
@Ilia3101 :D :D I didn't think about that :) I mean... you know.. skip every 2 and write 2, or what needs to be done, then same with lines..  :D

ilia3101

  • Moderators
  • Hero Member
  • *****
  • Posts: 923
Re: 3K/UHD 5D2 Raw development and Other Digic IV Cams
« Reply #1158 on: January 11, 2020, 08:50:39 PM »
Oh that method. Probably too complicated to make 5d2 do it.

dlprod

  • New to the forum
  • *
  • Posts: 20
Re: 3K/UHD 5D2 Raw development and Other Digic IV Cams
« Reply #1159 on: January 12, 2020, 01:57:38 PM »
Hi Zeek.  Can you please post a link to this build?  Thank you.

@Reddeercity
Hey, I'm using the build for the 5D2:
November 14/2019 3008x1080 @ 23.98 fps Updated Corrected Horizontal Centering.
It's been working really awesome! Thanks! I have just come across two issues:
1.Mlv_Play Module appears as "error" when the module is loaded but works without it.
2. When you format the camera in the camera from Canon Menu, ML is removed completely (Even though it says if I would like to keep ML). Is there a way around this? 
Thanks heaps!

reddeercity

  • Contributor
  • Hero Member
  • *****
  • Posts: 2255
Re: 3K/UHD 5D2 Raw development and Other Digic IV Cams
« Reply #1160 on: January 13, 2020, 05:51:45 AM »
Taken another shot at 1x3 on 5D2 , getting closer I got the adtg hooks working (at least in 3x3 , not sure about 5xzoom yet) plus figure out  how to code it .
Code: [Select]

 /* ADTG12[0x100C] = 0: read every line */
 /* ADTG12[0x1000] = 0: read every column */
 if (is_5D2)
 {
  adtg_new[2] = (struct adtg_new) {2, 0x100C, 0};
  adtg_new[3] = (struct adtg_new) {5, 0x1000, 6};
}
The problem I'm having now is it works in 3x3 but not 5xzoom , for some reason ( it's given me a headache  :( )
So I'm half ways there , adtg hook are working now just need to found out why it's not loading/working in 5xZoom .
Here a sample 1x3 frame from the .mlv , it 1856x1214 (3x3) @ 23.976fps and MLV App automatically detect it was 1x3 and displayed it correctly (5568x1214)
   

1856x1214_3x3_M12-2034_frame_138.png


5568x1214_3x3_M12-2034_frame_139.png

I didn't think this would work in 3x3 , the edges are smooth no nasty steps  :)

ZEEK

  • Senior
  • ****
  • Posts: 278
Re: 3K/UHD 5D2 Raw development and Other Digic IV Cams
« Reply #1161 on: January 13, 2020, 09:33:32 AM »
Hi Zeek.  Can you please post a link to this build?  Thank you.
I can, though isn't it up on Redeercity Build page in the discussion forum? Or has it been updated?
EOS M - EOS M2 - 5D2

Danne

  • Contributor
  • Hero Member
  • *****
  • Posts: 6825
Re: 3K/UHD 5D2 Raw development and Other Digic IV Cams
« Reply #1162 on: January 13, 2020, 09:51:34 AM »
Regarding adtg hooks not working. I can´t check sources but look for this place:
Code: [Select]
    if (!is_supported_mode() || !engio_vidmode_ok)
    {
        /* don't patch other video modes */
        return;
    }

Simply uncomment like this:
Code: [Select]
    if (!is_supported_mode() || !engio_vidmode_ok)
    {
        /* don't patch other video modes */
        //return;
    }

Will allow for adtg hooks to always run.

reddeercity

  • Contributor
  • Hero Member
  • *****
  • Posts: 2255
Re: 3K/UHD 5D2 Raw development and Other Digic IV Cams
« Reply #1163 on: January 14, 2020, 03:15:45 AM »
Thanks , I've seen this before , I'll give that a try .

.....  I can´t check sources .....
Here a link , crop_rec.c
I'm way behind on commits just have the basic stuff , no crop_rec commits yet , I wanted to get 1x3 working before I update the crop_rec to the latest changes for 5D2 that I'm using now .

reddeercity

  • Contributor
  • Hero Member
  • *****
  • Posts: 2255
Re: 3K/UHD 5D2 Raw development and Other Digic IV Cams
« Reply #1164 on: January 18, 2020, 03:27:34 AM »
Regarding adtg hooks not working. ........
Simply uncomment like this:
Code: [Select]
    if (!is_supported_mode() || !engio_vidmode_ok)
    {
        /* don't patch other video modes */
        //return;
    }

Will allow for adtg hooks to always run.
No that didn't help , I moved 1x3 to the 3.5k centered preset (5xzoom) and it loads correctly but locks up with wrong fps .
Keeps it at 30fps in 5xzoom instead of 23.976fps as I coded it , the image looks right (1x3) with correct raw size , so
I think almost confident that the adtg hooks are working in both 3x3 & 5xzoom .

I have a solution , after looking in to the "fps-engio.c" I noted that the fps valves are limited for D4 cams (5D2 , 50D , 500D , 110D)
Code: [Select]
    // restrict max fps to 35 for 1100D, 5D2, 50D, 500D (others?)
    #if !defined(CONFIG_1100D) && !defined(CONFIG_5D2) && !defined(CONFIG_50D) && !defined(CONFIG_500D)
    36000, 37000, 38000, 39000, 40000, 41000, 42000, 43000, 44000, 45000, 46000, 47000, 48000,
    50000, 55000, 59940, 60000, 61000, 62000, 63000, 64000, 65000, 70000
    #endif
};

And the D5 cams have this
Code: [Select]
static int fps_values_x1000[] = {
    150, 200, 250, 333, 400, 500, 750, 1000, 1500, 2000, 2500, 3000, 4000,
    5000, 6000, 7000, 8000, 9000, 10000, 11000, 12000, 12500, 14000, 15000, 16000,
    17000, 18000, 19000, 20000, 21000, 22000, 23000, 23976, 24000, 25000, 26000, 27000,
    28000, 29000, 29970, 30000, 31000, 32000, 33000, 33333, 34000, 35000,

and since timerA is 440 = to 1376+160 (H) is a lot lower then the default @ 1880 (663)

I'll try the expanded valves and see if this stops it from locking up at the frame timers "A&B"

Thou I could almost get it to work if I set "frame override" to 8fps in 3x3 default mode then cycle
to 5xzoom and it enables for a 1-2 seconds then kick back out to 3x3 , seems Liveview fps is to fast
for 1x3 to enable , so still not there yet -- about 98% , 2% to go but that 2% could take some time  ::)
 

reddeercity

  • Contributor
  • Hero Member
  • *****
  • Posts: 2255
Re: 3K/UHD 5D2 Raw development and Other Digic IV Cams
« Reply #1165 on: January 18, 2020, 07:21:55 AM »
.....  when it hits the lower limit for timer A, as declared in fps-engio.c. That is, the value sent to hardware won't be below the declared limit ...
To be able to dial a lower value, edit that limit (FPS_TIMER_A_MIN).
I think I found the answer  :D
I'm hitting a lower limit for timer"A" as define
Code: [Select]
#if defined(CONFIG_5D2)
    #define TG_FREQ_BASE 24000000
    #define FPS_TIMER_A_MIN MIN(fps_timer_a_orig - (ZOOM ? 0 : 20), ZOOM ? 0x262 : 0x228) // trial and error (with digic poke)
0x262 = 610 (crop_mode)
0x228 = 552 (3x3 non crop)
these valves are backup in  "frame override" menu and can not be lowered manually , so I have changed the lower limit
to 0x190 = 400 on both (3x3 & 5xzoom) , this should now let the 1x3 timer"A" load (I hope) as it's valve is 440 will below the min. of 610 in crop_mode .
It's late now so I'll try this tomorrow .
 

domasa

  • Member
  • ***
  • Posts: 106
Re: 3K/UHD 5D2 Raw development and Other Digic IV Cams
« Reply #1166 on: January 18, 2020, 12:04:39 PM »
It means that would be possible use "FPS Override" with more frames per seconds?

Igor_Braun

  • Member
  • ***
  • Posts: 118
Re: 3K/UHD 5D2 Raw development and Other Digic IV Cams
« Reply #1167 on: January 21, 2020, 11:15:13 AM »
Hi, i was doing some things these days and missed a 1x3 preset =) So I think i shouldn't try it now before it becomes part of new build version?

@Reddeercity - what do you think about FHD 48p binned for rich 16x9 aspect ratio? Or just lower the resolution?
For example, now you have 1856 x 774 with 48p working. So 1856x774=1,436,544 (pixels that work stable with 48p, so it's 68,954,112 pixels per second i bet..?)

So there are two options that are close to 1,436,544
1600*900=1,440,000 pixels
1598*898=1,435,004 pixels

16x9 48p I think would be very useful for b-rolls or things like that.

Meanwhile, I did some shot's:

4k 3x1
(aliasing is noticeable)


5k
downgraded to 4k in editing program
(sorry, i forgot to switch off blending when increased video speed, you can notice it on birds, but my PC is too slow to rerender it again)


Reddeercity, understand you about "-25 degrees"  ;D

reddeercity

  • Contributor
  • Hero Member
  • *****
  • Posts: 2255
Re: 3K/UHD 5D2 Raw development and Other Digic IV Cams
« Reply #1168 on: January 23, 2020, 07:46:44 AM »
.... missed a 1x3 preset =)
No , still working on it . Locks up the cam . don't no why yet .
@Reddeercity - what do you think about FHD 48p binned for rich 16x9 aspect ratio?
.......
16x9 48p I think would be very useful for b-rolls or things like that.
Since I have the adtg hooks working in 3x3 I can do 1856x680 48fps at 1.67 pixel stretch = 1856x1133 ,
There's some aliasing to be expected (scene depended)   It is continuous recording .

Sample frame Un-squeezed 

1856x1133_M22-2355_frame_2.png
1856x1134_48fps_M22-2355_frame_1.dng
Short 8 second video 1856x1134_48fps_M22-2355.mp4

1.67pixel Squeeze  , 1856x680 48fps

1856x680_M22-2355_frame_1.png

I may be able to push it to 50fps

Danne

  • Contributor
  • Hero Member
  • *****
  • Posts: 6825
Re: 3K/UHD 5D2 Raw development and Other Digic IV Cams
« Reply #1169 on: January 23, 2020, 08:10:25 AM »
If lock up is because of to fast fps you can try and force timer inside the reg function. For instance, a workaround I use with 5d3 looks like this:
Code: [Select]
    /*  reduce to 30fps temporary to be able to go back from x10 zoom without freezes */
    if (lv_dispsize != 1) *(volatile uint32_t*)0xC0F06014 = 0x613;
You can reduce fps to whatever here, at least on digic v cams. Erase lv_dispsize !=1 if not needed of course.
Since I do not own any digic 4 camera I can´t guarantee anything here.

Igor_Braun

  • Member
  • ***
  • Posts: 118
Re: 3K/UHD 5D2 Raw development and Other Digic IV Cams
« Reply #1170 on: January 24, 2020, 08:47:44 PM »
@Reddeercity, i would like to test 1856x680 48fps  :D
Saw some aliasing, but i also think it depends on scene.

reddeercity

  • Contributor
  • Hero Member
  • *****
  • Posts: 2255
Re: 3K/UHD 5D2 Raw development and Other Digic IV Cams
« Reply #1171 on: February 11, 2020, 05:44:44 AM »
..... i would like to test 1856x680 48fps
Saw some aliasing, but i also think it depends on scene.
Not looking good for this , I have 3 problems
1st , The black level is all over the place (108 - 154) in 10bit thou black level can always be clean up at 78 every time.
2nd there's no lcd liveview (just a black screen) but it dose record correctly but with bad black levels .
and thirdly if you refresh liveveiw , either with the half shutter of the play button the adtg hook stop working
so there's no more 720p mode (1.67pixel) falls back to just vertical line skipping @ 3x3 .

So I'm going to leave this for now ( I'll came back on a later date) and more over to Lossless Compression
It work half ways , as in I can create a lossless fullres image but I can't save it , it just lock's up the camera
I need to debug the D4 lossless code to see where the problem is .

edit: sorry forgot to say also I'll be finishing the 50D port for crop_record .

reddeercity

  • Contributor
  • Hero Member
  • *****
  • Posts: 2255
Re: 3K/UHD 5D2 Raw development and Other Digic IV Cams
« Reply #1172 on: February 11, 2020, 05:57:51 AM »
Shot a test clip of the updated 5D2 1:1 5632x3124 @ 3.8fps , made a hyper lapse at 24fps 6 mins at 3.8fps = 1 min at 24fps . mlv app for cdng's then ae with acr in cs6 uploaded prores 422hq to youtube best to watch at 5k (2880p) mode , I do like 16x9 ratio I think I will keep it  :)


yourboylloyd

  • Senior
  • ****
  • Posts: 288
Re: 3K/UHD 5D2 Raw development and Other Digic IV Cams
« Reply #1173 on: February 11, 2020, 02:11:04 PM »
Shot a test clip of the updated 5D2 1:1 5632x3124 @ 3.8fps , made a hyper lapse at 24fps 6 mins at 3.8fps = 1 min at 24fps . mlv app for cdng's then ae with acr in cs6 uploaded prores 422hq to youtube best to watch at 5k (2880p) mode , I do like 16x9 ratio I think I will keep it  :)

Reddeer you are amazing! I was just thinking of shooting a music video, but shooting it at (0.25x) the speed. This was really cool to see, and for it to be 5K is insane!

I swear if you could zipfile your current CF card on those exact settings then I could sell it online and make a killing XD! (no seriously... ⚆ _ ⚆ )
Join the ML discord! https://discord.gg/H7h6rfq

Igor_Braun

  • Member
  • ***
  • Posts: 118
Re: 3K/UHD 5D2 Raw development and Other Digic IV Cams
« Reply #1174 on: February 18, 2020, 11:20:56 PM »
Reddeercity. Keep it, please. That looks so crisp