3K/UHD 5D2 Raw development and Other Digic IV Cams

Started by reddeercity, April 06, 2017, 12:22:27 AM

Previous topic - Next topic

0 Members and 1 Guest are viewing this topic.

Dmytro_ua

Quote from: Igor_Braun on January 07, 2020, 09:07:36 PMit has only 20,1 mp in 2020 is it ok for photographers? We have 21 in 5d2 :)

Yes, it's more than enough for professional use. But it's not enough for cell phone users, that's why very soon we'll see 108-megapixel in Xiaomi  ;)
5d3 1.2.3 | Canon 16-35 4.0L | Canon 50 1.4 | Canon 100mm 2.8 macro
Ronin-S | Feelworld F6 PLUS

reddeercity

Quotewhat do you think about 4k 16:9 (binned or regular) with small FPS? 
New Update: 4K 16x9 , 1:1 pixel  (4096x2160) at 8fps

@Igor_Braun  try this
magiclantern-crop_rec-4k16x9_8fps-5D2-eXperimental.11.01pm-2020Jan08.5D2212.zip

It's 4096x2160 1X1 @ 8fps , I can push it to 9.5fps but it's not a good  rate to made 24fps in hyper-lapse (8fps*3=24fps)
so the frame divide equally for good film motion .
Write speed is around 83MB/s , so limited number of frames , around 350-400 @ 10bit but if you drop the A.R. to 1.85 (4096x2048) this is continuous at 73MB/s or around there .

Igor_Braun

Hi, Reddeercity, thanks for your amazing work!

My camera is happy every time a new firmware comes out...

It worked for me:

https://youtu.be/B6GvrqcPUAQ
8 fps - it's an ideal decision in my opinion.

Can't wait to test it. Will try to do it tomorrow or the day after, when it's daylight in the same place i shoot 5k panorama  ;)

And i still think it perfect for interior shooting.
Just look at tre first 3 seconds. This is what i'm talking about.
This shot with gimbal, but hope i'll have possibility to shoot a wide-open bright interior with motorized slider and 4k or 5k 16:9 preset
https://vimeo.com/319057484

Edit: Did a small 3 sec video in my place instead of going outside  :P:
https://youtu.be/3d-M7sQ3ALk

reddeercity

Here a sample frame of the sunset with 4096x1842 @ 8fps from my back door , dam near froze my finger off -25°C  :(


4096x1842 M09-1723_0-00-00-09.png
4096x1842 M09-1729_000000.dng

Exported , cdng from mlv app , mlvfs quick mount doesn't reconizes the .mlv  say it "can't be mounted" I'll have to look in to mlvfs.dll I guess .
Imported in to After Effect CS6 , the dng I posted is the first frame from the sequence so A.E. applies the camera raw adjustment to it so
it will look like the post png plus it will have the metadata from the ACR embedded , FYI .   
Shot at 24mm with a 1.4 crop from full frame = to 34mm @ F8 + Variable ND at 4stops down , 100 ISO , 1/8th shutter .

Not sure yet but I think I like the 5.6k preset better @ 4fps , need to play around with it more .

Skinny

@reddeercity, would it be possible to make something like 5.6k but write only every second pixel to CF (or read only every second pixel, I don't know) so we would have a full sensor image with a ~2.8k resolution?
I think it would be almost free of aliasing when converted to 1080p in post, very low-noise and cinematic.. and it would save the card space and speed and everything, while still being full-frame..

But I don't know if this is technically possible at all :)

ilia3101

Quote from: reddeercity on January 11, 2020, 05:57:34 AM
Not sure yet but I think I like the 5.6k preset better @ 4fps , need to play around with it more .

Keep both!!!

Quote from: Skinny on January 11, 2020, 08:01:29 PM
@reddeercity, would it be possible to make something like 5.6k but write only every second pixel to CF (or read only every second pixel, I don't know) so we would have a full sensor image with a ~2.8k resolution?
I think it would be almost free of aliasing when converted to 1080p in post, very low-noise and cinematic.. and it would save the card space and speed and everything, while still being full-frame..

But I don't know if this is technically possible at all :)

You'd get a black and white image with aliasing, but I'd be interested to see how it really looks.

Skinny

@Ilia3101 :D :D I didn't think about that :) I mean... you know.. skip every 2 and write 2, or what needs to be done, then same with lines..  :D

ilia3101

Oh that method. Probably too complicated to make 5d2 do it.

dlprod

Hi Zeek.  Can you please post a link to this build?  Thank you.

Quote from: ZEEK on December 23, 2019, 01:38:33 PM
@Reddeercity
Hey, I'm using the build for the 5D2:
November 14/2019 3008x1080 @ 23.98 fps Updated Corrected Horizontal Centering.
It's been working really awesome! Thanks! I have just come across two issues:
1.Mlv_Play Module appears as "error" when the module is loaded but works without it.
2. When you format the camera in the camera from Canon Menu, ML is removed completely (Even though it says if I would like to keep ML). Is there a way around this? 
Thanks heaps!

reddeercity

Taken another shot at 1x3 on 5D2 , getting closer I got the adtg hooks working (at least in 3x3 , not sure about 5xzoom yet) plus figure out  how to code it .

/* ADTG12[0x100C] = 0: read every line */
/* ADTG12[0x1000] = 0: read every column */
if (is_5D2)
{
  adtg_new[2] = (struct adtg_new) {2, 0x100C, 0};
  adtg_new[3] = (struct adtg_new) {5, 0x1000, 6};
}

The problem I'm having now is it works in 3x3 but not 5xzoom , for some reason ( it's given me a headache  :( )
So I'm half ways there , adtg hook are working now just need to found out why it's not loading/working in 5xZoom .
Here a sample 1x3 frame from the .mlv , it 1856x1214 (3x3) @ 23.976fps and MLV App automatically detect it was 1x3 and displayed it correctly (5568x1214)
   

1856x1214_3x3_M12-2034_frame_138.png


5568x1214_3x3_M12-2034_frame_139.png

I didn't think this would work in 3x3 , the edges are smooth no nasty steps  :)

ZEEK

Quote from: dlprod on January 12, 2020, 01:57:38 PM
Hi Zeek.  Can you please post a link to this build?  Thank you.
I can, though isn't it up on Redeercity Build page in the discussion forum? Or has it been updated?
EOS M

Danne

Regarding adtg hooks not working. I can´t check sources but look for this place:
    if (!is_supported_mode() || !engio_vidmode_ok)
    {
        /* don't patch other video modes */
        return;
    }


Simply uncomment like this:
    if (!is_supported_mode() || !engio_vidmode_ok)
    {
        /* don't patch other video modes */
        //return;
    }


Will allow for adtg hooks to always run.

reddeercity

Thanks , I've seen this before , I'll give that a try .

Quote from: Danne on January 13, 2020, 09:51:34 AM
.....  I can´t check sources .....
Here a link , crop_rec.c
I'm way behind on commits just have the basic stuff , no crop_rec commits yet , I wanted to get 1x3 working before I update the crop_rec to the latest changes for 5D2 that I'm using now .

reddeercity

Quote from: Danne on January 13, 2020, 09:51:34 AM
Regarding adtg hooks not working. ........
Simply uncomment like this:
    if (!is_supported_mode() || !engio_vidmode_ok)
    {
        /* don't patch other video modes */
        //return;
    }


Will allow for adtg hooks to always run.
No that didn't help , I moved 1x3 to the 3.5k centered preset (5xzoom) and it loads correctly but locks up with wrong fps .
Keeps it at 30fps in 5xzoom instead of 23.976fps as I coded it , the image looks right (1x3) with correct raw size , so
I think almost confident that the adtg hooks are working in both 3x3 & 5xzoom .

I have a solution , after looking in to the "fps-engio.c" I noted that the fps valves are limited for D4 cams (5D2 , 50D , 500D , 110D)

    // restrict max fps to 35 for 1100D, 5D2, 50D, 500D (others?)
    #if !defined(CONFIG_1100D) && !defined(CONFIG_5D2) && !defined(CONFIG_50D) && !defined(CONFIG_500D)
    36000, 37000, 38000, 39000, 40000, 41000, 42000, 43000, 44000, 45000, 46000, 47000, 48000,
    50000, 55000, 59940, 60000, 61000, 62000, 63000, 64000, 65000, 70000
    #endif
};


And the D5 cams have this
static int fps_values_x1000[] = {
    150, 200, 250, 333, 400, 500, 750, 1000, 1500, 2000, 2500, 3000, 4000,
    5000, 6000, 7000, 8000, 9000, 10000, 11000, 12000, 12500, 14000, 15000, 16000,
    17000, 18000, 19000, 20000, 21000, 22000, 23000, 23976, 24000, 25000, 26000, 27000,
    28000, 29000, 29970, 30000, 31000, 32000, 33000, 33333, 34000, 35000,


and since timerA is 440 = to 1376+160 (H) is a lot lower then the default @ 1880 (663)

I'll try the expanded valves and see if this stops it from locking up at the frame timers "A&B"

Thou I could almost get it to work if I set "frame override" to 8fps in 3x3 default mode then cycle
to 5xzoom and it enables for a 1-2 seconds then kick back out to 3x3 , seems Liveview fps is to fast
for 1x3 to enable , so still not there yet -- about 98% , 2% to go but that 2% could take some time  ::)

reddeercity

Quote from: a1ex on August 16, 2018, 12:27:31 PM
.....  when it hits the lower limit for timer A, as declared in fps-engio.c. That is, the value sent to hardware won't be below the declared limit ...
To be able to dial a lower value, edit that limit (FPS_TIMER_A_MIN).
I think I found the answer  :D
I'm hitting a lower limit for timer"A" as define
#if defined(CONFIG_5D2)
    #define TG_FREQ_BASE 24000000
    #define FPS_TIMER_A_MIN MIN(fps_timer_a_orig - (ZOOM ? 0 : 20), ZOOM ? 0x262 : 0x228) // trial and error (with digic poke)

0x262 = 610 (crop_mode)
0x228 = 552 (3x3 non crop)
these valves are backup in  "frame override" menu and can not be lowered manually , so I have changed the lower limit
to 0x190 = 400 on both (3x3 & 5xzoom) , this should now let the 1x3 timer"A" load (I hope) as it's valve is 440 will below the min. of 610 in crop_mode .
It's late now so I'll try this tomorrow .

domasa

It means that would be possible use "FPS Override" with more frames per seconds?

Igor_Braun

Hi, i was doing some things these days and missed a 1x3 preset =) So I think i shouldn't try it now before it becomes part of new build version?

@Reddeercity - what do you think about FHD 48p binned for rich 16x9 aspect ratio? Or just lower the resolution?
For example, now you have 1856 x 774 with 48p working. So 1856x774=1,436,544 (pixels that work stable with 48p, so it's 68,954,112 pixels per second i bet..?)

So there are two options that are close to 1,436,544
1600*900=1,440,000 pixels
1598*898=1,435,004 pixels

16x9 48p I think would be very useful for b-rolls or things like that.

Meanwhile, I did some shot's:

4k 3x1
(aliasing is noticeable)
https://youtu.be/Giczkr4_yfg

5k
downgraded to 4k in editing program
(sorry, i forgot to switch off blending when increased video speed, you can notice it on birds, but my PC is too slow to rerender it again)
https://youtu.be/RUUzLdQH-5g

Reddeercity, understand you about "-25 degrees"  ;D

reddeercity

Quote from: Igor_Braun on January 21, 2020, 11:15:13 AM
.... missed a 1x3 preset =)
No , still working on it . Locks up the cam . don't no why yet .
Quote from: Igor_Braun on January 21, 2020, 11:15:13 AM
@Reddeercity - what do you think about FHD 48p binned for rich 16x9 aspect ratio?
.......
16x9 48p I think would be very useful for b-rolls or things like that.
Since I have the adtg hooks working in 3x3 I can do 1856x680 48fps at 1.67 pixel stretch = 1856x1133 ,
There's some aliasing to be expected (scene depended)   It is continuous recording .

Sample frame Un-squeezed 

1856x1133_M22-2355_frame_2.png
1856x1134_48fps_M22-2355_frame_1.dng
Short 8 second video 1856x1134_48fps_M22-2355.mp4

1.67pixel Squeeze  , 1856x680 48fps

1856x680_M22-2355_frame_1.png

I may be able to push it to 50fps

Danne

If lock up is because of to fast fps you can try and force timer inside the reg function. For instance, a workaround I use with 5d3 looks like this:
    /*  reduce to 30fps temporary to be able to go back from x10 zoom without freezes */
    if (lv_dispsize != 1) *(volatile uint32_t*)0xC0F06014 = 0x613;

You can reduce fps to whatever here, at least on digic v cams. Erase lv_dispsize !=1 if not needed of course.
Since I do not own any digic 4 camera I can´t guarantee anything here.

Igor_Braun

@Reddeercity, i would like to test 1856x680 48fps  :D
Saw some aliasing, but i also think it depends on scene.

reddeercity

Quote from: Igor_Braun on January 24, 2020, 08:47:44 PM
..... i would like to test 1856x680 48fps
Saw some aliasing, but i also think it depends on scene.
Not looking good for this , I have 3 problems
1st , The black level is all over the place (108 - 154) in 10bit thou black level can always be clean up at 78 every time.
2nd there's no lcd liveview (just a black screen) but it dose record correctly but with bad black levels .
and thirdly if you refresh liveveiw , either with the half shutter of the play button the adtg hook stop working
so there's no more 720p mode (1.67pixel) falls back to just vertical line skipping @ 3x3 .

So I'm going to leave this for now ( I'll came back on a later date) and more over to Lossless Compression
It work half ways , as in I can create a lossless fullres image but I can't save it , it just lock's up the camera
I need to debug the D4 lossless code to see where the problem is .

edit: sorry forgot to say also I'll be finishing the 50D port for crop_record .

reddeercity

Shot a test clip of the updated 5D2 1:1 5632x3124 @ 3.8fps , made a hyper lapse at 24fps 6 mins at 3.8fps = 1 min at 24fps . mlv app for cdng's then ae with acr in cs6 uploaded prores 422hq to youtube best to watch at 5k (2880p) mode , I do like 16x9 ratio I think I will keep it  :)


yourboylloyd

Quote from: reddeercity on February 11, 2020, 05:57:51 AM
Shot a test clip of the updated 5D2 1:1 5632x3124 @ 3.8fps , made a hyper lapse at 24fps 6 mins at 3.8fps = 1 min at 24fps . mlv app for cdng's then ae with acr in cs6 uploaded prores 422hq to youtube best to watch at 5k (2880p) mode , I do like 16x9 ratio I think I will keep it  :)

Reddeer you are amazing! I was just thinking of shooting a music video, but shooting it at (0.25x) the speed. This was really cool to see, and for it to be 5K is insane!

I swear if you could zipfile your current CF card on those exact settings then I could sell it online and make a killing XD! (no seriously... ⚆ _ ⚆ )
Join the ML discord! https://discord.gg/H7h6rfq

Igor_Braun

Reddeercity. Keep it, please. That looks so crisp

jpegmasterjesse

Had some fun messing around with the 5k build last weekend. I didn't have any motion control system which is to me what really makes a time-lapse more interesting, but I liked the look of things.

One problem I had was pretty serious vertical stripes every time I entered 5x mode. I found that scrolling the shutter-dial - which messes up the frame - repeatedly until the frame returns to normal would sometimes fix this. I also believe that simply recording for 10 seconds or so can also slowly alleviate the problem.

Seems as if Dual-Iso at different bit-depths Just Works.

One thing I'd be very interested in would be even slower frame rates.

Thanks for your hard work RDC, we appreciate it.