3K/UHD 5D2 Raw development and Other Digic IV Cams

Started by reddeercity, April 06, 2017, 12:22:27 AM

Previous topic - Next topic

0 Members and 3 Guests are viewing this topic.

reddeercity

Full width 5.6k 16x9 A.R. , 4K Anamorphic 3x1, 1x3,  UHD 3K Plus 10-12bit Full HD ,
this is the latest build as things process I'll keep updating this post

See below short video on how to enable 48fps 3x3 preset

October 03 2020
Experimental build:MLV_Play.Mo and Raw_Twk.Mo Updated for Crop_Rec.Mo 4k3x1-3k1x1-2.8k1x1-48pfhd3x3
5D2_mlv_play+raw_twk_10-3-2020_8.18pm.zip



Fixed problems with raw_twk & mlv_play modules on my D4/5D2 4k Crop_Rec branch .
Tested it in 3x3(1880x1258) , crop_rec 3.5k centered preset(2784x1160) & 3x1 4k anamorphic (4096x590)
there's all view ok in camera , except for 3x1 4k there noise/snow on the bottom half of the screen .
(the anamorphic part of the code is not vertically stretching the image need to look further in the code) but still viewable .
Make sure you load both module's in the zip file , that's it . when you what to view a file just press the > play button 


September 3 2020
Experimental build:50D eXperimental-crop-rec_3.7k_24fps
magiclantern-eXperimental-crop-rec_3.7k-1x1.11.30pm.2020Aug16.50D109.zip
Here is a stable Crop_Rec build for the 50D , so no more adtg_gui crop_rec needed.
There only one preset at the moment , as these's problem with cmos & adtg hooks which i'm working on .
Loads just like the 5D2 crop_rec module , the 50D Crop_Rec resolution is 3760x1080 @ 23.976fps
50D related info for crop_rec https://www.magiclantern.fm/forum/index.php?topic=19336.msg229944#msg229944

July 20 2020
Experimental build:Crop_Rec.Mo Updated for 4k3x1-3k1x1-2.8k1x1-48pfhd3x3
https://bitbucket.org/reddeercity/magic-lantern_10-12bit/downloads/5D2-4k1x3-3k1x1-2.8k1x1-48pfhd3x3_7-10-2020_8.42pm_crop_rec.zip
New Google Drive updated download link
5D2-4k3x1-3k1x1-2.8k1x1-48pfhd3x3_7-10-2020_8.42pm_crop_rec.zip

New Updated Bitbucket Down Load Link(8-27-2020)
5D2-4k1x3-3k1x1-2.8k1x1-48pfhd3x3_7-10-2020_8.42pm_crop_rec.zip

Updated the Crop_Rec Module for multiplies of 3xcrop_mode/5xZoom presets .
Now there is 3k 1:1 (3016x1080 23.98fps) & Centered 3.5k 1:1 (2784x1160 24fps) in the same build plus 4k(3x1) & FHD 3x3 48p (1880x774)
With the new updated mlv_rec. module you get 8 more pixel in 3k & 24 more pixel in 48p 3x3 when use together .
Short Video tutorial on how to enable the new crop_rec presets in the latest update - (shot my 50D in 1x3 (1376x1742 @24fps ->4128x1742 from mlv. app)  ;)



July 5 2020
Experimental build:MLV_Rec.Mo Updated for 1880 (3x3) 2152(5xZoom)
https://bitbucket.org/reddeercity/magic-lantern_10-12bit/downloads/1880_3x3-2152_5xZoom-5d2_7-5-2020-5.59pm-mlv_rec.zip
New Google Drive Download Link
1880_3x3-2152_5xZoom-5d2_7-5-2020-5.59pm-mlv_rec.zip

New Updated Bitbucket Down Load Link(8-27-2020)
1880_3x3-2152_5xZoom-5d2_7-5-2020-5.59pm-mlv_rec.zip

In Canon default  resolution 3x3 you gain 24 more pixels (1856->1880) & in 3xcrop_mode(5xZoom) there a gain of 8 pixels (2144->2152)
Will load on top of the Crop_Rec eXperimental builds , did not test with the nightly builds



Jan 5 2020
Experimental build:5632x3124 @ 3.8fps
https://bitbucket.org/reddeercity/magic-lantern_10-12bit/downloads/crop_rec-5632x3124_3.8fps-5D2-eXperimental.9.42pm.2020Jan05.5D2212.zip
New Google Drive download link
crop_rec-5632x3124_3.8fps-5D2-eXperimental.9.42pm.2020Jan05.5D2212.zip

New Updated Bitbucket Down Load Link(8-27-2020)
crop_rec-5632x3124_3.8fps-5D2-eXperimental.9.42pm.2020Jan05.5D2212.zip

This a 1:1 pixel 5632x3124 @ 3.8fps , Very eXperimental you need at least a 1066x CFcard for this .
Read the discussion in these posts
https://www.magiclantern.fm/forum/index.php?topic=19336.msg223937#msg223937
https://www.magiclantern.fm/forum/index.php?topic=19336.msg224036#msg224036

Update: Feb 10 2020             New video sample of the updated 16x9 1:1 5632x3124 3.8fps centered preset , 6min @ 3.8fps -> 1 min 24fps in a hyper lapse



Here is a sample from the 5.6k preset (5632x2356 4.22fps) **note** this the first draft of this preset , I have updated since.
Shot this Jan-3-2020 , at sunset (4:30pm mst) , use my ef24-70mm 2.8L canon lens @ 24mm
F8 , ISO 100 , 1/5th second and because it was a sunset I had to use a Variable ND filter and stop it down 4 stops
I processed the 10bit cdng's thought Adobe After Effect CS6 with ACR ,I didn't spend much time on grading , just the basic .
I capture 7:00 min's continuously to a 32GB Lexar 1066x CF Card ,
I set the A.E. project to 24fps and that made the time condensed to about 1:15 seconds from 7:00 min's .
Watch it @ 5K (2880p) for the best viewing .
 



Dec 31 2019
Experimental build: 4k(4096) 3x1 Anamorphic ,  2784x1160 1x1 @ 24.00fps & FHD 3x3 (1856x774) @ 48p
https://bitbucket.org/reddeercity/magic-lantern_10-12bit/downloads/crop_rec-4k3x1-2.8k24p_3x3-48p-all-centered_8.18pm-5D2-eXperimental.2019Dec31.5D2212.zip
New Google Drive Download link
crop_rec-4k3x1-2.8k24p_3x3-48p-all-centered_8.18pm-5D2-eXperimental.2019Dec31.5D2212.zip

New Updated Bitbucket Down Load Link(8-27-2020)
crop_rec-4k3x1-2.8k24p_3x3-48p-all-centered_8.18pm-5D2-eXperimental.2019Dec31.5D2212.zip

In proved 4k-3x1 HDMI preview at 480p & changed frame rate to 24.00fps , reconfigured 2784x1160 for true 24.00 fps & realtime preview,
(1856x774  2:40 A.R. @ 48.028fps) write speed is 82MB/s so close to continuous
reduced the rolling shutter in 48p from 29.7ms to 17.8ms  :D 

August 21 2019
Experimental build: Dual ISO Video Module
https://bitbucket.org/reddeercity/magic-lantern_10-12bit/downloads/dual_iso_video-updates_8-21-2019.zip
New Google Download download link
5d2_dual_iso_video_updated_21-8-2020

New Updated Bitbucket Down Load Link(8-27-2020)
5d2_dual_iso_video_updated_21-8-2020.rar

Works with my crop_rec builds (not too sure about the nightly builds didn't test them) at 3x3 FHD(1856x1248) & 5xZoom(2144x1074) (3x crop_mode) @ 10bit raw ,
I didn't check it with the Crop_Rec Preset , so if you do try it with Crop_Rec it may freeze you cam and may need I battery pull .

Oct. 22 2019
Experimental build: 50D ADTG_GUI Module Crop_Rec experiment 3744x1080 @ 23.976 fps
https://bitbucket.org/reddeercity/magic-lantern_10-12bit/downloads/adtg-gui_crop_rec-3.7k-50D-eXperimental.2019Oct01.50D109.zip
New Google Download Link
adtg-gui_crop_rec-3.7k-50D-eXperimental.2019Oct01.50D109.zip

New Updated Bitbucket Down Load Link(8-27-2020)
adtg-gui_crop_rec-3.7k-50D-eXperimental.2019Oct01.50D109.zip

Hey 50D users I've started to port 50D to crop_rec , first step was to code a simple preset in ADTG_GUI.mo where a1ex first tested the 5d3 code.
Reasons why I put the 50D crop_rec in adtg_gui is to make sure it work or course .

How to get started:
Load mlv_rec.mo & adtg_gui.mo
Enable adtg_gui go to the advance menu and enable ENGIO Registers



Press half shutter to exit to liveview then press the play button (make sure to have a cr2 there to view ,this refreshes liveview & enables the other 1500 reg's)
go back to the advance tab in the adtg_gui.mo and now enable the 3k 1:1 50D preset



Press half shutter to exit to liveview , then you may have to cycle thought the 5xzoom button ( but you should only have to press it once)
Make sure you set the shutter to as close to 1/48th of second as you can , I was able to set it to 1/49th and when the preset is enabled it will
go to 1/48th of a second  for 23.9876 fps @ 3744x1080



Don't worry about the line on the right had side , there will not be in the raw image (this is the same thing that happen with the 5D2 , still working on a fix )
To make sure everything gets loaded , you can check the memory patches in the debug menu you should have 7 like this



On a Lexar 1066x 64GB CF card was getting around 10 second in 10bit .

This is very Bleeding Edge Stuff , so expect lockups , cam liveview freezes , etc. .... if it brakes you get to keep both halves  :P



New Update: November 14/2019
3008x1080 @ 23.98 fps Updated Corrected Horizontal Centering
https://bitbucket.org/reddeercity/magic-lantern_10-12bit/downloads/magiclantern-crop_rec-3k_Updated_Center_4.20pm-5D2-eXperimental.2019Nov14.5D2212.zip
New Google Drive Download Link
magiclantern-crop_rec-3k_Updated_Center_4.20pm-5D2-eXperimental.2019Nov14.5D2212.zip

New Updated Bitbucket Down Load Link(8-27-2020)
magiclantern-crop_rec-3k_Updated_Center_4.20pm-5D2-eXperimental.2019Nov14.5D2212.zip

Details lower down on this post

*******************************************************************************************************************

So now you have stable 10-12bit in 1:1 Full HD with 3k crop_rec , more usable now .
To come full hd 48fps or maybe 50 & Full resolution 5.6k @4 fps  to start with.
Enjoy


Short Tutrial for Setting up Crop_Rec Module (3.5k 1:1 Preset) on the 5D Mark ii

For best results start with 30 fps ntsc in the canon Liveview menu


Load crop_rec  & mlv_rec , mlv_snd can be load but reduces the amount of frames recorded .


Next setup Liveview preview , This is the most important part without this set correctly it will not work !

Liveveiw needs to be set to ML Gray Scale
Set bit depth to 10bit & aspect ratio to 1:1

Next go in to the crop_rec menu select 3.5k preset .
Note ! this only work when you enter 5x zoom/3x crop_mode as per the hi-lighted texts says


Once to go to 3x crop_mode you may need to go back to 1:1 then back to crop_mode  to get
2880x1080 sometimes , this is what you should see in the Movie tab once successful

Note the Red hi-light box the Frame Rate now says 23.976
Now you see the "crop_rec" is enabled & the resolution is now 2880x1080

Now go to the Raw Movie Tab you should see the following

You can choice resolutions less then 2880 if you wish , and you need to have ML Grey Scale selected

In Liveview this is what it should look like

Notice the yellow circle "5x zoom"
Green hi-lighted area "Frame Rate" 23.976
The Red Hi-lighted area "crop_rec 1:1 3.5k preset "

For full color High Res preview press the half shutter


Known Limitations
Once recording started you will have a Frozen B/W Liveview .
At this point it's unknown how to fix it yet , but Liveview return after recording stops.
In the current state you should see about 20 to 30 second of 10bit video.


New Update:

July 20 2020
Experimental build:Crop_Rec.Mo Updated for 4k3x1-3k1x1-2.8k1x1-48pfhd3x3
5D2-4k3x1-3k1x1-2.8k1x1-48pfhd3x3_7-10-2020_8.42pm_crop_rec.zip
Updated the Crop_Rec Module for multiplies of 3xcrop_mode/5xZoom presets .
Now there is 3k 1:1 (3016x1080 23.98fps) & Centered 3.5k 1:1 (2784x1160 24fps) in the same build plus 4k(3x1) & FHD 3x3 48p (1880x774)
With the new updated mlv_rec. module you get 8 more pixel in 3k & 24 more pixel in 48p 3x3 when use together .
Short Video tutorial on how to enable the new crop_rec presets in the latest update - (shot my 50D in 1x3 (1376x1742 @24fps ->4128x1742 from mlv. app)  ;)




July 5 2020
Experimental build:MLV_Rec.Mo Updated for 1880 (3x3) 2152(5xZoom)
1880_3x3-2152_5xZoom-5d2_7-5-2020-5.59pm-mlv_rec.zip

In Canon default  resolution 3x3 you gain 24 more pixels (1856->1880) & in 3xcrop_mode(5xZoom) there a gain of 8 pixels (2144->2152)
Will load on top of the Crop_Rec eXperimental builds , did not test with the nightly builds


Jan 5 2020
Experimental build:5632x3124 @ 3.8fps
crop_rec-5632x3124_3.8fps-5D2-eXperimental.9.42pm.2020Jan05.5D2212.zip]
This a 1:1 pixel 5632x3124 @ 3.8fps , Very eXperimental you need at least a 1066x CFcard for this .
Read the discussion in these posts
https://www.magiclantern.fm/forum/index.php?topic=19336.msg223937#msg223937
https://www.magiclantern.fm/forum/index.php?topic=19336.msg224036#msg224036

Dec 31 2019
Experimental build: 4k(4096) 3x1 Anamorphic ,  2784x1160 1x1 @ 24.00fps & FHD 3x3 (1856x774) @ 48p
crop_rec-4k3x1-2.8k24p_3x3-48p-all-centered_8.18pm-5D2-eXperimental.2019Dec31.5D2212.zip
In proved 4k-3x1 HDMI preview at 480p & changed frame rate to 24.00fps , reconfigured 2784x1160 for true 24.00 fps & realtime preview,
(1856x774  2:40 A.R. @ 48.028fps) write speed is 82MB/s so close to continuous
reduced the rolling shutter in 48p from 29.7ms to 17.8ms  :D

                                                                                                                     Short video on how to enable 48fps preset



                                                                                   Short test with 48fps in FHD (1856x688) then slowed down to 23.976fps & 12fps , shot @ 1/91th second , 400ISO lens @ f8


Same as before , it may lockup , freeze , etc. ... you guy know the routine
48p can be hard to enable , what I did was first put the cam in 1:1 (3x crop_mode)
enable 4k Anamorphic for a few second then switch to "FHD 48p" press the play but twice .
It will say in the left corner 1:1 but it's really 3x3 FHD , need to change that to say 3x3 .
FYI about 48p & shutter speed , to get correct shutter speed for 48p you should be double
your frames rate e.g. 24fps = 1/48th , 48fps = 1/96th of second ideally so the best I can get is 1/91th of second
to get that I set shutter speed in 3x3 without crop_rec enabled to 1/41th or 1/40th of a second then enable FHD 48p
should be 1/91th of a second , this give very good motion blur for slow-mo shots down to 12fps

August 21 2019
Experimental build: Dual ISO Video Module
dual_iso_video_5D2.mo
Works with my crop_rec builds (not too sure about the nightly builds didn't test them) at 3x3 FHD(1856x1248) & 5xZoom(2144x1074) (3x crop_mode) @ 10bit raw ,
I didn't check it with the Crop_Rec Preset , so if you do try it with Crop_Rec it may freeze you cam and may need I battery pull .
Best to start out at 100 ISO with the recovery ISO at 800 , so 100/800 ISO , I wouldn't recommend a recovery ISO higher then 1600 ISO (200/1600 ISO Max.)
Anything beyond  that is just noise -- remember 5D2 has only 5 native analog ISO's (100 , 200 , 400 , 800 , 1600) the rest is just digital push or pulled ISO (e.g. 160 ISO = 100 ISO digital pushed)
The Zip file is just the dual_iso.mo (module) not the full build , if you think you need the full build with dual_iso.mo let me know , but it should work on top of
my builds on the first page , in theory it should work with the 5D2 10-12bit  magic lantern experiments


Oct. 22 2019
Experimental build: 50D ADTG_GUI Module Crop_Rec experiment 3744x1080 @ 23.976 fps
adtg-gui_crop_rec-3.7k-50D-eXperimental.2019Oct01.50D109.zip
Hey 50D users I've started to port 50D to crop_rec , first step was to code a simple preset in ADTG_GUI.mo where a1ex first tested the 5d3 code.
Reasons why I put the 50D crop_rec in adtg_gui is to make sure it work or course .

How to get started:
Load mlv_rec.mo & adtg_gui.mo
Enable adtg_gui go to the advance menu and enable ENGIO Registers



Press half shutter to exit to liveview then press the play button (make sure to have a cr2 there to view ,this refreshes liveview & enables the other 1500 reg's)
go back to the advance tab in the adtg_gui.mo and now enable the 3k 1:1 50D preset



Press half shutter to exit to liveview , then you may have to cycle thought the 5xzoom button ( but you should only have to press it once)
Make sure you set the shutter to as close to 1/48th of second as you can , I was able to set it to 1/49th and when the preset is enabled it will
go to 1/48th of a second  for 23.9876 fps @ 3744x1080



Don't worry about the line on the right had side , there will not be in the raw image (this is the same thing that happen with the 5D2 , still working on a fix )
To make sure everything gets loaded , you can check the memory patches in the debug menu you should have 7 like this



On a Lexar 1066x 64GB CF card was getting around 10 second in 10bit .

This is very Bleeding Edge Stuff , so expect lockups , cam liveview freezes , etc. .... if it brakes you get to keep both halves  :P



New Update: November 14/2019
3008x1080 @ 23.98 fps Updated Corrected Horizontal Centering
magiclantern-crop_rec-3k_Updated_Center_4.20pm-5D2-eXperimental.2019Nov14.5D2212.zip
Updated the cmos[2] Horizontal offset to correct centering offset ,  used full res CR2 (5613x3744) for referencing center as this post explained here

****************************************************************************************************************************************************

Ok by now a lot  if not all ml user know about crop_rec on steroids: 3K, 4K, 1080p48, full-resolution LiveView
Yes as it says I'm looking in to 3K/UHD on the 5d2 cam and being that most of the digic iv cam are similar
My hope is it will help on other cams like 7D , 50D , etc.... in reality only cam with CF Card have the potential
of recording 3K/UHD other SD cams maybe in short busts or reduce frame rate but I think the 5d2 and 7D should be capably
of 3K or close to it . That's my target , right now 10bit 2144x1076 @ 23.976p is a reality at about 60-63 MB/s Write speed
with a crop factor of 2.61 . Some may ask if this is possible on cams other then the 5d3 , will the whole discovery came from a
500d experiment from Greg , at least that's my understanding . To my knowledge a1ex reproduce the experiment on 5d3 digic v
which ended up code in the adtg_gui module  from iso_research branch . That's what I'm basing my development on and hints that a1ex gave my here ,
so the first step was to compile a adtg_gui module from the iso_research branch.
Of which I had many problem , thank to dfort for helping me with this issue the thread can read here. Once I load the module I can now get in to the cmos H & V.
I loaded the 5d3 3K registry preset in 3x crop mode and start play round .
I what so far I have discovered with the vertical registry I'm able to move the crop window from the left most leading edge to the right leading edge in 46 increments.
Stating at cmos[2] @ 0x10c <--0x40E
0x1c
0x2c
0x3c
0x4c
0x5c
0x6c
0x7c
0x8c
0x9c
0xac
0xbc
0xcc
0xec
0xfc
0x10c
0x11c
0x12c
0x13c
0x14c
0x15c
0x16c
0x17c
0x18c
0x19c
0x1ac
0x1bc
0x1cc
0x1dc
0x1ec
0x1fc
0x20c
0x21c
0x22c
0x23c
0x24c
0x25c
0x26c
0x27c
0x28c
0x29c
0x2ac
0x2bc
0x2cc
0x2dc
0x2ec


When I have any new developments  or share any info I'll post here and anyone that's wishes to help or build on my work Please join in
looking at you @Ilia3101  ::)   ;D




DeafEyeJedi

I'll be standing by you with all of my support for this. Also own a 7D and a coworker of mine owns a 5D2 whom is more than willingly to loan to me for to test along. Thanks for doing this @reddeercity!
5D3.113 | 5D3.123 | EOSM.203 | 7D.203 | 70D.112 | 100D.101 | EOSM2.* | 50D.109

ilia3101

Juicy!
I will do whatever is useful. If you need me to try hundreds of values on registers I can do that. Will be back in a couple days and ready to do stuff(excited to look at the source code :o and the Gr3g resolution hack)

reddeercity

@ DeafEyeJedi good to hear.

@ Ilia3101 sound good , if you go to my bitbucket_downloads there's a atdg_gui build for 5d2 that I'm using ,
get that and load the adtg_gui , raw_rec & file_manger modules keep it simple . In the submenu of adtg_gui in Advance , toggle on the digic registers
then at the bottom of the menu you will see 1:1 3K crop mode  (5d3) load that preset and go back to the root of adtg_gui and you will see 2 Green icon by cmos[1] Vertical  cmos[2]Horizontal
beware you will get lockups & liveview freeze , just pull the battery and restart etc.... . I use frame over ride @ 23.976p . Start reading the code here for hints & info on the registers plus look at this  post for more help.
From what I understand it's a combination of registers & video timers according to a1ex.

ilia3101

Thank you. I've played around with the atgdgooi branch before, to be honest it scares me a little, as I suspect I've done damage to the sensor (I think it increased the fixed Patten noise) by playing with it. I also discovered 'green_rec' along with 'magenta_rec' and 'vertical_bar_rec'.
Will try out the 3k presets when I get back. The goal is to find the right values of those registers for the other cameras(5D2) to increase resolution in the same way? Or would it be controlled by other registers on other cameras? I guess this what we need to find to get it working. I will be reading the wiki for some homework ;D

reddeercity

Quote from: Ilia3101 on April 06, 2017, 07:02:11 AM
The goal is to find the right values of those registers for the other cameras(5D2) to increase resolution in the same way?
more or less , but first 5d2 then others .

Something interesting
cmos[1]0xaac <--0xeac
cmos[2]0x404 <--0x10E
looks like almost full view compared to the frame on the right which was not modified
the left all squeezed together .  I was using a EF24-70f2.8L at 24mm so in 3x crop mode that's 24mmx2.61=62.64mm
so I would say the left frame is very close to 24mm


full view crop mode
by RedDeerCityTV, on Flickr

Exported Jpeg from MLVProducer , I pushed the exposure to show detail.


M05-2224_00001
by RedDeerCityTV, on Flickr
Non modified registers cmos cdng 2K
https://www.dropbox.com/s/hzds2gbijp4tlzv/M05-2336_00000.dng?dl=0
Modified cmos[1] & cmos[2] cdng
https://www.dropbox.com/s/ng1zbz3xy8auopp/M05-2224_00000.dng?dl=0

It's a start  :)

Deadcode

Cheers! I hope you make it!

Is it possible to implement the lossless compression with older Digic 4 cameras?
With my calculations, the highest continuous resolution in crop mode might be 2736x1164 at 23,976 fps, with 2,1x crop ratio. That requires 128MB/s write speed and with the "usual" 58% compression is just about 74MB/s. That's around the max stable write speed with the 5D2 in crop mode.

ilia3101

@Deadcode The compression is definitely possible in the 5D2 as it also has those features in the firmware that are being utilised on the 5D3 right now, but I think it takes an a1ex level of digic programming skills to do. So possibly may happen... or not. You can never predict.
@reddeercity squished crop mode would be pretty good, looks like there's a big black area on the right of that frame though. I bet getting rid of that pink corruption will be the hardest part.
Great start though!

reddeercity

Yea I think compressed raw will work , I did a test merge of the compressed_raw branch in to unified source code and have a little problem with src/raw.c merge  that I hadn't had time to look in too fully but no crashes on the build .

Quote from: Ilia3101 on April 06, 2017, 08:59:32 AM
I bet getting rid of that pink corruption will be the hardest part.
No , shouldn't be too big of a problem , I can clean up the corruption by changing addresses . Main thing I'm looking for is the full View with the right aspect ratio right now .


a1ex

Some of the values are actually bit fields. My old notes on 5D2 registers:


CMOS[0]: 0x203 at ISO 100
---- ------xx default 11, setting to 00 results in dark image with very low stdev
---- ---xxx-- ISO, values from 000 to 100, ascending (ISO 100-1600)
---- xxx----- second ISO field (as in dual ISO), disabled by default (see next bit)
---x -------- enables second ISO field (default 0)
--x- -------- enables vertical OB clamping maybe (setting it to 0 results in severe horizontal banding that looks like random walk)
-x-- -------- compresses the image horizontally (left side squashed, right side black)

CMOS[4]: 0x242 at iso 100...800 and 0x244 at iso 1600
---x -------- looks like some vertical dual ISO
-x-- -------- seems to cleanup 0.2 or 0.25 stops of shadow noise
No effect observed on the other bits.

dariSSight

@reddeercity Can't wait, but what is the atdg_gui build file for? So far the only way to use 10bit or your possible build is to push the magnify but for 5X to put in crop mode and you have to have a lens like 24-70mm 2.8L lens to view?
Canon 5D Mark II

reddeercity


reddeercity

Quote from: a1ex on April 07, 2017, 08:11:05 AM
Some of the values are actually bit fields. My old notes on 5D2 registers:


CMOS[0]: 0x203 at ISO 100
-x-- -------- compresses the image horizontally (left side squashed, right side black)

Thanks  :) , interesting that's on cmos[2] 0x404 reproduces this .
I found more on Greg's work last night read thought the CMOS/ADTG/Digic register investigation on ISO thread , and it seems
I may have been adjusting the wrong registers (cmos 1&2) it seems he was adjusting cmos 5 &6 for digic iv cams
I'll give that a try .
No ISO related , seems it has more in common to 5D3

reddeercity

Some more update/process , Getting cleaner image now with some surprise's  :D


M07-2145_00001
by RedDeerCityTV, on Flickr   5643x1076



M07-2149_00157
by RedDeerCityTV, on Flickr    5643x1076

Ok I had to do a little post work to get it to the right Aspect Ratio   ::), I still getting the compressed image but it's seem to be all there.
I crop off the black area then just increased the horizontal by 300% and left the vertical unchanged


M07-2145_00001
by RedDeerCityTV, on Flickr


M07-2149_00157
by RedDeerCityTV, on Flickr

Screenshots from crop mode , showing the capture area that's what recorded for reference only


5D2 Liveview
by RedDeerCityTV, on Flickr

I'm having problem with the FPS timer A , it doesn't want to go below 610 , I have no problem with timer B in fact I had it up to 3000 that help clean up the frame
it seems timer A is lock and I think that what stopping me for getting the full width capture not compressed to 2K frame , I had at about 17 fps to get a clean image

Or do I have to play with the Head Timers? I know there's three Can't find any info on them , I believes I need to get timer A to 455 or in that range and timer B about 2200 .

Cheers
Edit: This is frame with FHD 1856x1044 I used on my registers crop full view test , for reference only

M07-2337_00001
by RedDeerCityTV, on Flickr

ilia3101

Good work. Does the black area go away if you move the crop window by the right amount? Yay now we have the 5D3 3x1 binning from crop rec!
Edit: technically the black bar can't go away unless you set the resolution to < 1881. Also that's insane spectrum ratio at 5.25:1
@a1ex genius. Are the registers 12 bit? That's weird ::)

reddeercity

I'm getting more stability now ,
the registers I'm using is:
ADTG1 [105f]N-----0xa41
CMOS[1]------------0x2c7
CMOS[2]------------0x404

Exact FPS
FPS timer A --------610 (can't  lower it for some reason)
FPS timer B -------2000
main clock---------24.00 Mhz
Actual FPS---------19.672

Image is very clean now , no artifacts.
but image is still compressed to the left , I believe that because of FPS timer A is not be able to lowered from 610
I think there's something I'm missing , I feel I'm getting very close now If I can figure out the video timer problem .

Edit:

ADTG1 [105f]N-----0xab56
CMOS[1]------------0x2c7
CMOS[2]------------0x404
CMOS[5]------------0xc05

New setting that open up all registers , before I couldn't figure out way I didn't see the registers at where documented in other posts.
By accident I started to play around with CMOS[5] and BOOM there is all these Registers  :o
there go on forever . Now I access more RAW H&V and video timer stuff.



ilia3101

@reddeercity I've now tried the iso-research branch and setting registers, your settings didn't work too well for me, I managed to get the squish working with cmos[0], but black level kept going up and down causing it to all look ugly, setting cmos[1] and others to values you recommend didn't help much other than locking up the camera. Basically i've not had any success.
But one more thing: when the correct registers/settings to unlock resolution are found, will it automatically be detected in the raw_rec or mlv module so the higher resolution can be set straight away?(I mean: does it auto detect max resolution?)

nikfreak

once the sweet spot(s) for 5D2 are found you could for e.g. adjust/activate your new "crop mode / resolution" via ML menu for the moment. Check a1ex's 2016 implementation
[size=8pt]70D.112 & 100D.101[/size]

reddeercity

@Ilia3101 ,when selecting registers I find it's more temperamental the warmer the sensor gets . There is a certain  order you have to do and of course the video timers have to adjusted or it will not work not matter what you do. 1st set to low light , video timer A ( low as it can go) , video timer B (2000 and up) works in the adtg_gui  advance menu enable digic registers then apply the 1:1 3k preset (which sets cmos[1] & cmos[2] the I adjust cmos[2] first for width then cmos[1] for height next is ADTG1[105f]N (x5 & x10 zoom shutter blanking), move the frame up & down by either by shorting or lengthen shutter duration, to fix pink frame you may have to find a different registers in cmos[1] oh yea also enable cmos[5] helps with pink hi-lights you may also need to play with frame over ride a bit , seems that the frame is clean around 18-20 fps not sure why. Also It looks like I may have got the 1:1 Crop_record working on the 5D2 so you don't have to be in zoom mode for it to work  ;D  As it say 1:1  but at 1856 not 5616 but I can move the capture area cross the sensor just like 3x crop ,  plus in that mode I was able to record a H264 in 1:1when I turn off raw video but the problem I having and you know there's always a problem  ::) I can only record 1856 width(center crop) but full height which is compressed vertically , once I stretch it out it's 1865x3744 .

1:1 Crop_recording with 3K preset , This is Not 3x Crop mode but 1:1 , like I said with compressed vertically . 1856x1044


M10-021100001
by RedDeerCityTV, on Flickr 

After I resized the vertical by about 258% I get 1856x2694 close to full height of the sensor but at 16x9
 

1856x2694-M10-021100057
by RedDeerCityTV, on Flickr

1:1 crop_record H264 from the 5D2 , turn off the raw video and hit record  :) , Maybe Highly Compressed h264 3K or 4K  :P :P
Just click on the image and ficker will link to the file on page. or watch off dropbox see link below


MVI_8653
by RedDeerCityTV, on Flickr

So how do I know if it's truly 1:1 , will I don't really only thing that tells me is the fact there no moiré or aliasing pattern
look at the the fine hole on my MacPro even in h264 I can't tell , thou the lens I use was 24mm so no lens correction
which give the distortion width at the top .

H264 1:1 crop_record MVI_8653.MOV source file link from my dropbox if any one what to download 45Mb


reddeercity

Doing some more quick tests in 1:1 LiveView with the following setting
adtg1[1061] 0x449
cmos[1] 0x3e0
cmos[2] 0x104
cmos[5] 0xc21

23.976 from 24
Video Timer A 584 (FT +12)
Video Timer B 3422 (FT +1672)
Actual frame rate 12.00

crop_record 1:1 (Not 100% sure it working but seems to setup a lot easier and centered
1:1 3K preset that's it .

3000x1250

M10_3000x1250
by RedDeerCityTV, on Flickr


3000x1250

M10_2_3000x1250
by RedDeerCityTV, on Flickr

There's a little trick I did to get this to work , I post tomorrow on what the special thing is  8)
The hint is in the frame size   ;) 

ProRes files of the 3K test  , not big  about 100Mb each
M10_1.mov
M10_2.mov

ilia3101

I see the hint: 1250 ;) Maybe you got something like the vertical compression in the post before but sideways? just a guess...

goldenchild9to5

@reddeercity Great job  :) Now I wanna buy a 5D2 as a back-up to my 5D3. 

Greg

This will not work on old cameras (500D, 5D2 etc) until you find a way to change the EDMAC size.

Old cameras do not support #ifdef CONFIG_EDMAC_RAW_SLURP
https://bitbucket.org/hudson/magic-lantern/src/11f405b62b312294d705e8e7bb8688b820bb9eea/src/raw.c?at=crop_rec_4k&fileviewer=file-view-default#raw.c-429

Maybe patch here :
LiveViewMg:000929e0:00:00: *** ConnectWriteEDmac(0x10, 0x0), from ff1f7134
LiveViewMg:000929e0:00:00: *** SetEDmac(0x10, 0x463390a4, 0xff44e5c8, 0x20000000), from ff1f7164


Or try "#define CONFIG_ALLOCATE_RAW_LV_BUFFER"
https://bitbucket.org/hudson/magic-lantern/src/11f405b62b312294d705e8e7bb8688b820bb9eea/src/raw.c?at=crop_rec_4k&fileviewer=file-view-default#raw.c-126

reddeercity

Thanks for the info Greg I looking for something like this