3K/UHD 5D2 Raw development and Other Digic IV Cams

Started by reddeercity, April 06, 2017, 12:22:27 AM

Previous topic - Next topic

0 Members and 2 Guests are viewing this topic.

mark robinson audio

I am interested in this build   I have 2 anamorphic setups
one is a Kowa B&H with 50mm 1.2 canon lens and the Redstan collar with
the Rapido 16hva front variable diopter the other is a Kowa 16D with the Redstan
connecting collars and a FD 50 1.4 taking lens  ( for lighter weight)(who am I kidding
they both are heavy  and long)
both setups do vignette heavly on the 5dmk2     so I'm looking for a solution
for this critical shooting  problem
Just stumbled onto this site last night   my interest is glued
Mark Robinson

yourboylloyd

Quote from: mark robinson audio on February 19, 2020, 06:03:12 PM
I am interested in this build   I have 2 anamorphic setups
one is a Kowa B&H with 50mm 1.2 canon lens and the Redstan collar with
the Rapido 16hva front variable diopter the other is a Kowa 16D with the Redstan
connecting collars and a FD 50 1.4 taking lens  ( for lighter weight)(who am I kidding
they both are heavy  and long)
both setups do vignette heavly on the 5dmk2     so I'm looking for a solution
for this critical shooting  problem
Just stumbled onto this site last night   my interest is glued
Mark Robinson

Crop mode would probably help you extremely! That as a full frame setup sounds extremely interesting to me though. Anamorphic f/1.2? How much vignetting is there? Do you have any snapshots?

Join the ML discord! https://discord.gg/H7h6rfq

reddeercity

Almost got 50D to compile the crop_rec module , but getting a error
"Will not load on: 50D (fps_override_shutter_blanking) not checked"
?
Of course this stop the crop_rec module from compiling.
I know it has something to do with the video & or shutter hack on 50D as it doesn't have native video support .

Here the added support for 50D , it uses the same values as 5D2 (0x105f & 0x1061) , in fact everything is almost identical to the 5d2  :D
    const int blanking_reg_zoom   = (is_50D) ? 0x105F : 0x805F ;     // waza57 for test
    const int blanking_reg_nozoom = (is_50D) ? 0x1061 : 0x8061 ;           // :
    const int blanking_reg = (lv_dispsize == 1) ? blanking_reg_nozoom : blanking_reg_zoom;


shutter_hack movtweaks.c#lines-307
#ifdef CONFIG_MOVIE_RECORDING_50D_SHUTTER_HACK

CONFIG_INT("shutter.btn.rec", shutter_btn_rec, 1);

void shutter_btn_rec_do(int rec)
{
    if (shutter_btn_rec == 1)
    {
        if (rec) gui_uilock(UILOCK_SHUTTER);
        else gui_uilock(UILOCK_NONE);
etc. ....

50d video_hack movtweaks.c#lines-466
#ifdef FEATURE_MOVIE_RECORDING_50D

static MENU_UPDATE_FUNC(lv_movie_print)
{
    MENU_SET_VALUE(
        lv_movie_select != 2 ? "Disabled" :
        video_mode_resolution == 0 ? "1920x1080, 30fps" :
        video_mode_resolution == 2 ? "640x480, 30fps" : "Invalid"
    );
etc. ....


Is there anyone on the forum left that knows more able this ?
5D2 doesn't have any problem with this so I'm a little lost on how solve this .

Edit: found something that I think could be the issue
50D/EOSM: disabled FRAME_SHUTTER_BLANKING_WRITE  commit f68f196 this different then the 5D2 which has this enabled 
**50D.109/consts.h**
-#define FRAME_SHUTTER_BLANKING_WRITE  (lv_dispsize > 1 ? &FRAME_SHUTTER_BLANKING_ZOOM : &FRAME_SHUTTER_BLANKING_NOZOOM)
+//~ #define FRAME_SHUTTER_BLANKING_WRITE  (lv_dispsize > 1 ? &FRAME_SHUTTER_BLANKING_ZOOM : &FRAME_SHUTTER_BLANKING_NOZOOM)


5D2.212/consts.h
#define FRAME_SHUTTER_BLANKING_WRITE  (lv_dispsize > 1 ? &FRAME_SHUTTER_BLANKING_ZOOM : &FRAME_SHUTTER_BLANKING_NOZOOM)


I see the EOSM has this also disabled , what would be the reason for 50D to have this disabled ?

Edit:#2
committed 6192a0d
Looks like a1ex disabled this from TL ,
/** We can also override shutter on a per-frame basis */
-#define CONFIG_FRAME_SHUTTER_OVERRIDE
+/* really? no other old camera can do this */
+//~ #define CONFIG_FRAME_SHUTTER_OVERRIDE

Not sure if this related but looking like it .
5D2 does not have this , so this seems it could be re-enabled , from what I understand it was disabled because it was a bleeding edge stuff
as no other camera has this & can do this .

Would be nice to find some history notes for this .

Igor_Braun


reddeercity

Fixed crop_rec module compiling problem on the 50d
in "platform/50D.109/consts.h" In this line

+//~ #define FRAME_SHUTTER_BLANKING_WRITE  (lv_dispsize > 1 ? &FRAME_SHUTTER_BLANKING_ZOOM : &FRAME_SHUTTER_BLANKING_NOZOOM)


I changed in to this

#define FRAME_SHUTTER_BLANKING_WRITE  (lv_dispsize > 1 ? &FRAME_SHUTTER_BLANKING_ZOOM : &FRAME_SHUTTER_BLANKING_NOZOOM)

Now it compiles but the module error out (module will not initiate startup) after loading .
So something is not letting the crop_rec startup , I guess I have to go over the code again and see what I missed .
I am closer now , just a matter of chasing down the bugs .

Igor_Braun

@Reddeercity, look, i was playing with 48 fps today trying make some b roll transitions and noticed some strobing or flickering (i don't know how to say it correctly) effect when i was in the room with fluorescent lamps. So it because 1/125 shutter speed. Is there any way to change it in 48 fps mode?
Another question. How do you think, is it real to push fps even more just cutting edges from the right and the left side? It could become 1376x774 (from 1856x774) but with higher fps.

reddeercity

Change your shutter speed to 1/90th - 1/100th of second for 48fps ,
just adjust the shutter speed before you enter into 48p you may have to lower it to 1/40th or lower in 3x3 (FHD) then when you which to crop_rec
it should be right.

I have no plans to increase the fps of reducing frame size for 48fps at this time on the 5D2 .
FYI is close to the edge for 5d2 in 3x3 Hi speed , the 50D will have more frame rate capability ( faster sensor) I can see at least 60 if not 70fps in 3x3
Unless there a problem with 5D2 builds , My time is dedicated now to 50D Crop_Rec & Lossless Compression on 50D & 5D2 .

tankmanbrad

Quote from: reddeercity on April 06, 2017, 12:22:27 AM
Full width 5.6k 16x9 A.R. , 4K Anamorphic 3x1, 1x3,  UHD 3K Plus 10-12bit Full HD ,
this is the latest build as things process I'll keep updating this post

See below short video on how to enable 48fps 3x3 preset

Jan 5 2020
Experimental build:5632x3124 @ 3.8fps
crop_rec-5k-4fps-5D2-eXperimental.9.08pm.2020Jan01.5D2212.zip
This a 1:1 pixel 5632x3124 @ 3.8fps , Very eXperimental you need at least a 1066x CFcard for this .
Read the discussion in these posts
https://www.magiclantern.fm/forum/index.php?topic=19336.msg223937#msg223937
https://www.magiclantern.fm/forum/index.php?topic=19336.msg224036#msg224036


Shoot, tried to download this version...
I get this: "That link has no power here" and the link data in the browser tab says 404....

Am I being blocked from load or has it been pulled?
I blame wuhan virus! ;)

Igor_Braun

Understood you, Reddeercity. Wish I could help you, but i'm too old to get into all this... oly can help with testing, checking, filming somthing etc..
Hope you take 50d to a new level :), and even 7D afterwards.

dariSSight

@reddeercity I Know your busy and you do not like redundancy, but this will be last time I'll ask question:
1. Which is your most stable build in FHD, 48fps, 5K, 4K time-lapse and 5x Crop?
2. For Best Image results is it best to use 14bit and 12bit or is 10bit Raw good enough?
3 Lastly, What is the best workflow that you use.
Thanks for your answers, I wanted to have your best recommendation as I test out builds in this time of population Quarantine.
Canon 5D Mark II

Bender@arsch

The "crop_rec-5632x3124_3.8fps-5D2-eXperimental.9.42pm.2020Jan05.5D2212.zip" build is missed in the first Page and the link of the old one "crop_rec-5k-4fps-5D2-eXperimental.9.08pm.2020Jan01.5D2212.zip" is corrupt (51kb file).

I like the new 5.6K build. Works really good;)
Is it possible to implement the new 5.6K crop in the main Build?

Sidequest: what is the biggest CF Card for the 5D Mark II, can the 5D Mark II handle a 256GB CF Card?

Any new news about lossless compression?

tankmanbrad

I pointed out the first page flaw as well, over ten days ago...
Seems the moderator doest like me enough to post my question "where did the file go?" as I kept getting a 404 error when I tried using the link.

I confirm a 128Gig 1066x Lexar card works on my 5DmkII, use it a lot for these huge mlv files,  if you get a 256G wouldn't mind knowing if it works or not.

yourboylloyd

Quote from: Bender@arsch on March 29, 2020, 02:48:30 PM
what is the biggest CF Card for the 5D Mark II, can the 5D Mark II handle a 256GB CF Card?


Just don't do it. I use the 5D2 as my main camera and CF cards just aren't reliable consistently. I've had a couple die on me over the years. Get two 128GB's 1066x instead. 128GB is the sweet spot for me.
Join the ML discord! https://discord.gg/H7h6rfq

reddeercity

Quote from: Bender@arsch on March 29, 2020, 02:48:30 PM
The "crop_rec-5632x3124_3.8fps-5D2-eXperimental.9.42pm.2020Jan05.5D2212.zip" build is missed in the first Page and the link of the old one "crop_rec-5k-4fps-5D2-eXperimental.9.08pm.2020Jan01.5D2212.zip" is corrupt (51kb file).
Thanks for the heads up , I fixed the link , should be able to download now
I was cleaning up the 1st page post of downloads links to streamline things.

Quote from: Bender@arsch on March 29, 2020, 02:48:30 PM
I like the new 5.6K build. Works really good;)
Is it possible to implement the new 5.6K crop in the main Build?
This is a problem with all 5x crop presets on 5d2 , as the code is written now I can only have 1 5xcrop preset
on the module loaded , more then 1 e.g. 3.5k centered  & 5.6k FFV (Full Frame View) one of them will fallback to 3x3 mode
usually the second one in the crop_mode check in crop_rec.c , read the link , it explains more , if you can solve this I can add all the 5x crop preset in 1 build
https://www.magiclantern.fm/forum/index.php?topic=19336.msg220869#msg220869

Quote from: Bender@arsch on March 29, 2020, 02:48:30 PM
Sidequest: what is the biggest CF Card for the 5D Mark II, can the 5D Mark II handle a 256GB CF Card?
technically it dose since firmware 1.09v. but. .......... , so yea keep with 128GB , I just use 64GB cards , it safer I think .
If a 64GB card dies you may only loose 8-10min of footage , that bad enough but if a 128GB card dies will that would hurt bad :'(
Not to say it will , but you have to be prepared for the worst , as there say "plan for the worst - hope the best" words to live by  :D
https://www.magiclantern.fm/forum/index.php?topic=16045.0

Quote from: Bender@arsch on March 29, 2020, 02:48:30 PM
Any new news about lossless compression?
No , not yet I'm focused on getting the 50D crop_rec working without any workarounds right now ,
will look in to it later on ,
FYI , Lossless on the 5D2 is a lot closer then I'm letting on too
Why ?
Because having crop_rec working is more important , there's only one or 2 line of code that really my attention in lossless .
It's just a working philosophy I have , figure the hard stuff first & the easy stuff will fall in place , or so I hope  ;D

JMS

I have been following and playing with ML for a number of years and reddeercity your work has been inspiring.
When you have the 50D crop ready I will gladly run any and all tests.
Thanks to all and Best wishes to everyone during these trying times.

d!g!c

Something weird happend to my 50D. No, it did not break but when I tried the November experimental build for 3.5k crop, my vertical resolution is limited to 720p. So it's like 3.5k pixels across then 720 pixels down. I'm sure I followed all the steps correctly. The first experimental build for the 50D worked fine on my unit.

I'm more than willing to contribute to this effort however my sole CF card just died and I can't get a new one until the end of our community quarantine.

reddeercity

Quote from: d!g!c on April 04, 2020, 11:21:28 PM
Something weird happend to my 50D. No, it did not break but when I tried the November experimental build for 3.5k crop, my vertical resolution is limited to 720p. So it's like 3.5k pixels across then 720 pixels down. I'm sure I followed all the steps correctly. The first experimental build for the 50D worked fine on my unit.

I'm more than willing to contribute to this effort however my sole CF card just died and I can't get a new one until the end of our community quarantine.
There's no November build posted on the 1st page/post download links just this one
''adtg-gui_crop_rec-3.7k-50D-eXperimental.2019Oct01.50D109.zip''
post a frame (dng) from that .

Igor_Braun

4k picture is insane.
There is definitely something special in the 592-1776 stretching. I don't know how it works but it adds a certain kind of look to the picture:
https://youtu.be/aRxTGMj9Cxo
Processed with MLVP (BDM film profile, ''Lift'' green channels reconstruction mode, MLVPDM debayering method, some basic cc)
Very sharp (keep in mind that it's f/1.7)
And it feels sharper if compare it with 3k:
https://youtu.be/1-ykYj1ukBo
(1856 mode also feels sharper, but 3k is megacool zoom mode, and it contains a lot of information)

And this is color graded (in Vegas pro) 2:1 version of that 4k anamorphic image:
https://youtu.be/WoXb0fUDM1I

My dream is unsqueezed preview in 4k mode :)

RH42

Which build did you use? - that 4k looks great!


reddeercity

Quick update , working on the 50D crop_rec module -- complied ok now but will not load on the camera just says error
stops at the module_init
MODULE_INFO_START()
    MODULE_INIT(crop_rec_init)
    MODULE_DEINIT(crop_rec_deinit)
MODULE_INFO_END()

So it won't start up  :(
So I need to trace it or log the startup to see where it fails , not sure if qemu can run Crop_Rec module on D4/50D
not even sure if 50D runs in qemu at all .

On a side note , I figured out 4k 3x1 4096x720 ->4096x2160 @23.976fps 
on 50D with continuous recording on Lexar 1066x


a short mp4 10 second test here ->50D_4096x2160_24fps_3x1-M30-0002.mp4
it's a little shaky  :D
used a full frame 50mm prime , the crop factor is 1.76 (1.6 for APS-C + .16 crop of the 50D full senor)(4096 from 4755)
50mm x 1.76 = 88mm

Head hurts now , I'll come back to this in a few days .

5D2: working on getting multiply 5xzoom crop_rec preset into one build with help from another forum member (You know who you are) :D
e.g. 3k (3008x1080) , 5.6k (5632x3124) & 2.8k (2784x1160) plus more in time .
still a work in process , chasing bugs  :(

Edit: here a ADTG_module build with 4k 3x1 if any one what to test it out
adtg_gui-crop_rec-4k3x1-50D-eXperimental.2019Nov03.50D109.zip
Just load it like the 3.7k build but in 3x3(FHD)(full width mode)
If you do get it in to 5xZoom mode , it will only be at 4096x720 without vertical line skipping.
So make sure you are in 3x3 mode to set the 3x1 pixel mode.
Have fun

JMS

I will load this up and give it a run. Thank you (and everyone else) for sharing your hard work.

Wlad81

Quote from: reddeercity on May 02, 2020, 03:11:46 AM
On a side note , I figured out 4k 3x1 4096x720 ->4096x2160 @23.976fps 
on 50D with continuous recording on Lexar 1066x
Could you, please, be so kind to upload the original MLV file?

Am I to understand that by now 50D is better choice than 100D for real work?
Canon EOS 5D Mk III + Canon 24-105 F/4 L IS USM + SanDisk Exreme Pro 64 GB (SD, ML Nightly.2021Feb07.5D3113) + SanDisk Extreme Pro 128 GB (CF).

reddeercity

Quote from: Wlad81 on May 02, 2020, 11:33:13 PM
Could you, please, be so kind to upload the original MLV file?
I don't have that one any more ,  I did fine another one but with 1x3 pixel instead of 3x1 pixel


50D_1x3_4128x1776_M04-2317_frame_4.png

525MB file 50D_1x3_1376x1776-M04-2317.MLV

quick grade in mlv app. then exported to mp4
50D_1x3_4128x1776_M04-2317.mp4

what the differences you may ask  ?
1x3 is in 5xZoom so no chance of aliasing & it's a horizontal stretch (1376x1776 = 4128x1776) which is a better mode
3x1 is 3x3 (FHD - Full HD) so vertical line skipping 4096x720 = 4096x2160) , not as good as 1x3 but still useable .

Quote from: Wlad81 on May 02, 2020, 11:33:13 PM
Am I to understand that by now 50D is better choice than 100D for real work?
Will , the 100d has more advance features e.g. 10,12,14bit lossless compression
A working crop_rec module , it d5 camera the d4 camera's (50D & 5D2) are behind in development .

The 50D has faster storage (CF Card 80MB/s+) can record 10,12bit uncompressed raw video along with 14bit .
So it really depends on your needs for your projects , as I don't have a 100D I can't really give the best advice on this
do a forum search for 100D are see what others are saying about it .
Though if the 50D is cheap enough buy both , and use as a"B"Cam.

My main cam is 5D2 & the 50D is "B"Cam/backup , FYI.

Wlad81

reddeercity
Thank you so much! Got the file and graded it. Exporting to ProRes4444 1920x826 takes 2.5 minutes on my 2008 8-core Mac Pro using MLVApp.

Are there any other non-anamorphic hi-res modes on 50D currently?

I can get 50D body almost as cheap as used CF 1066x 64GB flash for it. The seller says it's shutter counter is almost 350000, is this a big value for 50D?
Canon EOS 5D Mk III + Canon 24-105 F/4 L IS USM + SanDisk Exreme Pro 64 GB (SD, ML Nightly.2021Feb07.5D3113) + SanDisk Extreme Pro 128 GB (CF).