3K/UHD 5D2 Raw development and Other Digic IV Cams

Started by reddeercity, April 06, 2017, 12:22:27 AM

Previous topic - Next topic

0 Members and 3 Guests are viewing this topic.

Luther

Quote from: reddeercity on October 27, 2019, 11:14:50 PM
This is my priorities :Get 50D in to the crop_rec code at the same level as the 5D2 (including Anamorphic)
Nice! 50D is a 12 years old camera that still rocks so much. Anamorphic mode will be great. Thanks for all your work on this @reddeercity.

reddeercity

Quote from: Luther on October 28, 2019, 05:01:09 AM
Nice! 50D is a 12 years old camera that still rocks so much. Anamorphic mode will be great. Thanks for all your work on this @reddeercity.

Thanks , here the start of 3x1 anamorphic on 50D in 3x3 Line Skipping.


4096x1968 @ 23.976
50D_3x1_4096x1968_M27-2334_frame_2.png Un-Squeezed Vertically
50D_3x1_4096x656-M27-2334_000002.dng Vertical Squeezed
So the crop factor on this is 1.76 of full frame (@ 4k(4096) there a crop factor of 1.16 of the 50D sensor plus a 1.6 crop factor of full frame if using full frame lens that is)
So just to refresh every one memory , the 50D senor resolution is 4752x3168 .

Luther

Quote from: reddeercity on October 28, 2019, 05:35:30 AM
Thanks , here the start of 3x1 anamorphic on 50D in 3x3 Line Skipping.
4096x1968 @ 23.976
50D_3x1_4096x1968_M27-2334_frame_2.png Un-Squeezed Vertically
50D_3x1_4096x656-M27-2334_000002.dng Vertical Squeezed
So the crop factor on this is 1.76 of full frame (@ 4k(4096) there a crop factor of 1.16 of the 50D sensor plus a 1.6 crop factor of full frame if using full frame lens that is)
So just to refresh every one memory , the 50D senor resolution is 4752x3168 .

This will be very useful for me. I use 50D MLV professionally (marketing videos). It works very well, but the resolution is not ideal. With your last build I was able to record in very high res, but with too much crop factor. This anamorphic mode will enable me to get the best out of 50D, without cropping that much. Amazing.

dariSSight

Can someone explain how to use 48fps firmware, its doesn't have setting like on the video on front page, I will use firmware that correspond with video, maybe that'll work. Thanks again Redeercity, are you done with 5DM2 firmware and are you getting better images with 50D?
Canon 5D Mark II


Igor_Braun

Guys, could you please upload some more 4k anamo videos from your 50d? And is the liveview frozen like on 5d2?

stokis

Quote from: reddeercity on October 27, 2019, 11:14:50 PM
I disagree , 5k Anamorphic in x5 Zoom is the most important thing to me (adtg hook problem), Lossless compression is way down on my priority list .
This is my priorities :Get 50D in to the crop_rec code at the same level as the 5D2 (including Anamorphic)
5D2:  5k Anamorphic in x5 Zoom (works in the adtg_gui module) adtg hook write problem in crop_rec code
CF Card interface bus Overclocking write speed (looking for at least 100MB/s write speed , 30% increase to be useful)
Lossless compression for 5d2 & 50d
And at the bottom ....
7D with limited "rom hack" extended  horizontal  resolutions (maybe 3k)

Edit: FYI 50D maximum resolution @ 24fps ( with a good A.R.)  in crop_mode 3200x1254 @ 24.011 fps = to 100.7 Mpixel/s ( Mega Pixels per second)
Sensor speed on the 50D is 28.8 MPixel/s x 4 channel readout = 115.2MPixel/s
Still have a vertical offset problem , only 1087 vertical pixels are visible out of 1254 (the other 167 lines are black no image data)
may need to do a dm_spy log for cr2/full res liveview height to see what regs are being applied .

Ofcourse, working 5K would be even better than 4K :)

DeafEyeJedi

Quote from: DeafEyeJedi on April 06, 2017, 12:45:30 AM
I'll be standing by you with all of my support for this...

I came across a deal that turned out to be too good to pass on and decided to scoop up on a decent 50D body with only less than 5K shutter counts directly from an original owner on OfferUp.com. It even came w a 4GB CF card. Ha!

I personally felt that @reddeercity has done a tremendous job with an enormous amount of work already put onto this very project for the Digic 4 bodies which literally got me to jump onto this wagon. Rightfully so. Thank you, David!

Never thought I'd ever buy an 11-year old digital camera body but hey never say never, right? ;)

More to come...
5D3.113 | 5D3.123 | EOSM.203 | 7D.203 | 70D.112 | 100D.101 | EOSM2.* | 50D.109

reddeercity

50D Update:
adtg_gui-crop_rec-4k3x1-50D-eXperimental.2019Nov03.50D109.zip
refined 3x1 4k preset experiment in the adtg_gui module -- (4096x720 ->4096x2160 @ 23.976FPS)
Preview is all scrambled at the moment , because I haven't figured out the correct preview reg's yet (keep in mind this is a work in progress)


50D_4096x2160-M04-0119_frame_1.png
50D_4096x720-M04-0119_frame_1.dng
Short 20 second clip with no real setup 50D_4096x2160_23.976fps-M04-0119.mp4

So it just like before , follow the this post for how to install and get running if you're a new user .
A FYI -- @ 4k we have a 1.76 crop factor of full frame which is = to 3.2k on full frame sensor , it work out to be a little under a ASP-C of a little bit bigger then a M4/3ths
full sensor is said to be 35x24 mm e.g. 5D2 or 5d3 , the 50D is said to be a APS-C  22.3x14.9mm with the 4k(4096x720) crop factor  = 19.22x13 mm .
There some aliasing I noticed but I didn't have time to really play around with as I just used mlv.app , if I was going to spend time grading etc. ... I would have
Used Adobe After Effects CS6 with camera raw , as this is the best work flow as it can fix aliasing issue the best . 

nikfreak

Quote from: DeafEyeJedi on October 29, 2019, 09:55:52 PM
....a decent 50D body with only less than 5K shutter counts directly from an original owner...

Wow, Sean, wish 'ya lots of fun with it. Should last forever with that shutter count cause it's also built like a tank.
[size=8pt]70D.112 & 100D.101[/size]

ilia3101

Are the columns of pixels are even in the correct order?


zcream

Hi. Just to confirm 3x3 mode on both cameras is still 14-bit hd right? We are using 10-bit and 12-bit for 3k and above..

Sent from my Redmi 4A using Tapatalk


reddeercity

Quote from: zcream on November 06, 2019, 06:19:26 PM
Hi. Just to confirm 3x3 mode on both cameras is still 14-bit hd right? We are using 10-bit and 12-bit for 3k and above..
All three bit rates (10,12,14) work in all video modes including crop_rec on 5D2 & 50D

reddeercity

Experimenting with 1x3 pixel binding/anamorphic on the 50D (still very early in the development , don't expect too much yet it could all change.)
currently I got 12 fps(for testing) thou I have a black bar in the middle of the image
(cmos5, vertical offset is not set correctly yet, I was more interested in to see if I could get more height then 1200 lines) then I fell in to the 1x3 anamorphic rabbit hole  :D
So I have almost full width (4704) cr2 width is 4752 ,
I should be able to get 1365x2160 @ 23.976fps = 70.76Mpixel/s (Max useable sensor speed is 105 Mpixel/s out of 115 (4 channel readout @ 28.8mhz)
So Un-Squeezed size will be 4096x2160 @ 23.976fps , if I get the vertical offset corrected .

1568x2192_1x3_M05-2326_frame_1.png


4704x2192_1x3_M05-2326_frame_1.png


1568x2192_1x3_M05-2326_frame_56.png


4704x2192_1x3_M05-2326_frame_56.png

Liveview , has correct A/R with the Anamorphic display filter in ML drop down menu .


2 short 20 second video chips , 1st is the squeezed @  1568x2192 mp4 & then the un-squeezed at 4704x2192 mp4


ilia3101

Ok I really want to get the image centered on the mark II in the 3008x1080 mode, how do I get started. Is it a difficult change?

Also... wow! I'm super impressed that you almost have proper anamorphic working on 50D,  exciting.

Edit: it looks like there is still some weird aliasing, could we see MLV  file?

Volumetrik

Quote from: Ilia3101 on November 09, 2019, 12:28:59 PM
Ok I really want to get the image centered on the mark II in the 3008x1080 mode, how do I get started. Is it a difficult change?

Also... wow! I'm super impressed that you almost have proper anamorphic working on 50D,  exciting.

Edit: it looks like there is still some weird aliasing, could we see MLV  file?

I love using the 3.5k crop mode with 2784x1160 resolution! I also agree on the live-view centering. It's the only thing left on my wish-list, everything else works great for my use !

reddeercity

Quote from: Ilia3101 on November 09, 2019, 12:28:59 PM
Ok I really want to get the image centered on the mark II in the 3008x1080 mode, how do I get started.
First , take a cr2 (or silent full res DNG) of a grid pattern (horizontal & vertical)
then with out moving the camera or focus length record a second or 2 in the 3k preset crop_rec , upload a link to the DNG or PNG here .
Quote from: Ilia3101 on November 09, 2019, 12:28:59 PM
Is it a difficult change
yes & no , if the horizontal is out (left or right of center) then in the advance crop_rec menu you can change
cmos[2] , just key in 0x10E etc. ... being 0x10E is the default centering for 3xcrop_mode e.g. 2144x1076
if I remember right I had it set to 0x9E , (there no real fine adjustment on the horizontal)  it's moves at more then 1 columns at a time from my finding
I thing it's like 3-5 columns per valve , so it may never be right on .
If it's a vertical issue then yes it's way more work , vertical centering done by
base vertical offset cmos[1] + cmos[1]Lo & cmos[1]Hi in the code , it called "PACK12" so there's 2 value's in the pack  that need to be adjusted .
/* raw buffer centered in zoom mode */
            case CROP_PRESET_CENTER_Z:
                cmos_new[1] = 0xB0E  /* vertical (first|last) */
                  ? PACK12(12,11)
                  : -1;

this give us a per line/pixel vertical movement up & down to center .
Quote from: Ilia3101 on November 09, 2019, 12:28:59 PM
..... you almost have proper anamorphic working on 50D,
Edit: it looks like there is still some weird aliasing, could we see MLV  file?
I'm not 100% sure it was in 5x Zoom , it may have change to 3x3 , I'll have check again

Google Drive M05-2326.MLV 815MB

ilia3101

Quote from: reddeercity on November 10, 2019, 02:29:54 AM
First , take a cr2 (or silent full res DNG) of a grid pattern (horizontal & vertical)
then with out moving the camera or focus length record a second or 2 in the 3k preset crop_rec , upload a link to the DNG or PNG here .yes & no , if the horizontal is out (left or right of center) then in the advance crop_rec menu you can change
cmos[2] , just key in 0x10E etc. ... being 0x10E is the default centering for 3xcrop_mode e.g. 2144x1076
if I remember right I had it set to 0x9E , (there no real fine adjustment on the horizontal)  it's moves at more then 1 columns at a time from my finding
I thing it's like 3-5 columns per valve , so it may never be right on .
If it's a vertical issue then yes it's way more work , vertical centering done by
base vertical offset cmos[1] + cmos[1]Lo & cmos[1]Hi in the code , it called "PACK12" so there's 2 value's in the pack  that need to be adjusted .
/* raw buffer centered in zoom mode */
            case CROP_PRESET_CENTER_Z:
                cmos_new[1] = 0xB0E  /* vertical (first|last) */
                  ? PACK12(12,11)
                  : -1;

this give us a per line/pixel vertical movement up & down to center .I'm not 100% sure it was in 5x Zoom , it may have change to 3x3 , I'll have check again

Google Drive M05-2326.MLV 815MB

Here I shot some easy to match patterns: https://drive.google.com/open?id=1QdR9tKKupaleX6fjUdRiN06d-07djl0l

Looks like its almost vertically centered (good news):



But quite off horizontally...

I will try what you said in crop rec menu and see if I can center it a bit more.

masc

Quote from: Ilia3101 on November 09, 2019, 12:28:59 PM
Edit: it looks like there is still some weird aliasing, could we see MLV  file?
Hm, when I zoom-in into this file from @reddeercity, I remember a pattern we had half a year ago with the EOS M. I can't proof, but for me it does not look like every 3rd row was recorded. For me it looks like 2 rows were recorded, then 4 rows weren't. When you zoom in, you see that 2 rows look a bit similar, and then the next row looks very different. With EOS M we had that in 1080p mode, but maybe something like that is also possible in 1x3 mode. https://www.magiclantern.fm/forum/index.php?topic=16516.msg212270#msg212270


(Pictures are not 3x stretched vertically.)
5D3.113 | EOSM.202

ilia3101

Ok seems like 0x9e makes the image centered, but I have to wait like 10 seconds for colourful vertical stripes to settle down each time I enter crop.

Could this be at all harmful for the sensor or to dynamic range?

reddeercity

Quote from: Ilia3101 on November 10, 2019, 03:05:15 PM
..... I have to wait like 10 seconds for colourful vertical stripes to settle down each time I enter crop.
Could this be at all harmful for the sensor or to dynamic range?
Short answer , no
but ml dose put extra load & stress on the sensor so maybe at some point it may burn out (or Not) who knows for sure .
The lines you see are related to the power timing reg's , those don't work in the crop_rec because the adtg write hook stop working (there a note about it the adtg c code)
same reason why I can't 1x3 anamorphic working  on the 5D2 adtg write hooks stop working in the crop_rec.

reddeercity

Quote from: Ilia3101 on November 10, 2019, 03:05:15 PM
Ok seems like 0x9e makes the image centered
Well it close , but not really I did some testing with full res cr2 then overlay the 3008x1080 image over it in After Effects .
I found the best fit for horizontal alignment is
0xBE 
cmos[2] 0xBE


The default setting


cmos[2] 0x9E , close but not good enough 


It seems that for each cmos[2] reg unit the image moves about 100 column ,
from default to 0xbE , that's around 6 units = 600 , Look at the white box , Irfan view says that box is 604 pixels wide.


I'll update the code for the 3k preset later on tomorrow , in the mean time go to the advance crop_rec menu
and adjust cmos[2] to 0xBE , that's as close as we will get .   ;D

ilia3101

Looks like 0xBE is much better. But the vertical lines seem even stronger and take a little longer to fade.

@a1ex do you know if these lines be made to not appear when entering centered crop?

1 more question: why does the camera start recording when I press the joystick? I just want to center the window automatically, but this makes it slithgly annoying. I don't think the normal ML builds do this.

2blackbar

Dave theres better method to test this, you can get sensor size chart and then adjust values and pinpoint where center should be , thats what i used with canon m withiut entering photoshop, adjusting on busy background is too confusing, with rectangles/ sensor sizes filling frame its much easier
I made and used this for adjusting cmos 5 and 7 on apsc camera, it needs fullframe rectangle  overlay
http://ipic.su/img/img7/fs/senoc.1573593027.gif
Ill do new version with fullframe later
--
HEre it is, If you display this on your pc monitor and fillm on canon filling frame with it then you can easily pinpoint center with different crop modes and aspect ratios