LiveView Investigation

Started by theBilalFakhouri, August 27, 2020, 12:04:37 PM

Previous topic - Next topic

0 Members and 1 Guest are viewing this topic.

Danne

Quote from: theBilalFakhouri on February 04, 2023, 02:00:17 PM
Processing 1736x2214 @ 23.976 FPS in LiveView works
yeah yeah ez ez
Crazy. It's almost like you are recording outside liveview area  :o.

iaburn

Incredible... I got on board in Magic Lantern just recently after hearing about it for sooooo many years and I find amazing that you and other clever people are still passionate about this and bringing features that seemed impossible, thank you!!
Clean image (no artifacts) and real time preview are the 2 main factors for me to choose a recording preset. With the latest Framing preview improvements it got much better, 2.8K is awesome now, but live preview on 1x3 using the full 1736 pixels will be my go-to mode <3

vastunghia

Quote from: theBilalFakhouri on February 04, 2023, 02:00:17 PM
Processing 1736x2214 @ 23.976 FPS in LiveView works
yeah yeah ez ez

5D3 user on ML forum like:

(Apparently ani gif not supported by forum, here it is)
5D3 for video
70D for photo

theBilalFakhouri

Quote from: vastunghia on February 04, 2023, 11:04:18 PM
5D3 user on ML forum like:

[gifv]https://i.imgur.com/AsfK0rd.mp4[/gifv]


I will feel the same if I had a 5D3 . .  ah I already have a 5D3 😅, yes sorry . . as I said eariler, this year I will focus only on Preview . .

I started on 700D because I worked on it before, I wanted to continue the investigation there until I understand every single piece of preview (understand it enough) and finish the unfinished work
--> 5D3 have some similarities, this may help when I start looking into 5D3 again. Well, same thing has happened to 5D3 regarding SD stuff last year, it started on 100D, then all DIGIC 5 models were benefited, including 5D3 :)

I really hope I can get something on 5D3 regarding preview this year . .



In the meantime:

Proof of Concept: 1736x868 @ 50 FPS WORKS with correct preview :D (high FPS modes can work with real-time correct preview)
I figured out why it wasn't working before (it was choppy and casues corrupted frames), a coder error :P

theBilalFakhouri

-Current step: figuring out how to increase width preview (we are currently limited to ~2000 pixels), going over that produce black bar in x5 mode. I didn't try yet increasing width in 1080p mode.

ML700D

Quote from: theBilalFakhouri on February 05, 2023, 12:24:14 AM

In the meantime:

Proof of Concept: 1736x868 @ 50 FPS WORKS with correct preview :D (high FPS modes can work with real-time correct preview)
I figured out why it wasn't working before (it was choppy and casues corrupted frames), a coder error :P

wow.. nice! can I test it?
EOS 700D

theBilalFakhouri

Quote from: ML700D on February 05, 2023, 03:09:13 AM
wow.. nice! can I test it?

Thanks!

Things are still being work in progress, not fully finished yet. The fourth month isn't far from now too :P
More likely these new achievements won't be for free, e.g. I spent ~4 hours a day last month working on preview.

Grognard

Quote from: theBilalFakhouri

I really hope I can get something on 5D3 regarding preview this year . .


Thank you for your amazing work!
I have both EOS M and 5D3, improvement for 700d /Eos M is a good news but improvement for 5d3 will be a little revolution because 5D3 is far better in terme of quality. It will not only be a cheap camera to achieve raw footages but a real cinematique camera for professionnal work.


gabriielangel

Quote from: theBilalFakhouri on February 04, 2023, 02:50:52 PM
Yes, that's exactly what does that mean :)

EOS M/EOS M2/700D/650D/100D are benafited from this research and achievements, because their internals are very similar, almost identical.
Previous LiveView work (current 1x3 presets with real-time, a.k.a frtp presets on EOSM) was started on 700D then ported and fine-tuned by Danne to EOS M (it's almost copy-paste stuff here).

This is some serious advancement @theBilalFakhouri, the extra amount of details gained in the  1736x2180 mode on the eos m is quite significant.

vastunghia

Quote from: Grognard on February 06, 2023, 09:18:33 AM
improvement for 5d3 will be a little revolution because 5D3 is far better in terme of quality. It will not only be a cheap camera to achieve raw footages but a real cinematique camera for professionnal work.

+1 and I also think that preview improvements over HDMI, in particular, will be crucial.
5D3 for video
70D for photo

northbk

Yes! I'd pay for some improvements to my 5D III ...I know here in NYC many working professionals keep 5D Mark 3's around as backups for photos. I think like me, they would put them in service in video production as a B or C cam or backup if they were a bit more usable in terms of monitoring. The CDNG to color space transform in Resolve makes it easy to match 5D III as a B cam.

I personally feel like EOS M is a bit of a toy, hobbyist thing, no offense.

theBilalFakhouri

Thank you all guys!
It seems that we all love shooting RAW video :), that's why working on increasing write speed (LiveView hacks, SD Overclocking) and preview are ones of my goals and they excite me too.

Okay, let's recap current state regarding Preview:

700D and similar models:

-Centering Preview on screen (LCD/HDMI)                    is now possible
-Clearing Preview artifacts using Canon configuration     is now possible
-Exceeding Preview height limit                                  is now possible (we can upgrade current 1x3 modes to higher resolutions, 1736x2214 *already works)
-Getting Preview working in High FPS modes                 is now possible (we can reduce RAW resolution to increase FPS, 1736x868 @ 50 FPS *already works)

*I didn't check yet if there would be new or further limits, e.g. processing 1736x2928 might not be possible (didn't check yet), also didn't check if we can get 1736x738 @ 60 FPS with correct Preview
  (without corrupted frames) or even higher FPS than 60 FPS at lower resolutions with working preview.

-Last thing that I need to figure out here regarding Preview is how to increase width preview for 1:1 resolutions, such as 3K/2.8K/2.5K/1440p without black bar.
I didn't make experiments yet, currently going above ~2000 pixels width will result in black area.


5D3:

-Registers which control how much height and width we want to process in LiveView seems similar to 700D, which are in C0F3 range (can be showed using adtg_gui)
-Patching 1080p mode into 720p mode works, gives valid RAW data but Preview is *stretched
-Patching 720p mode into 1080p mode works, gives valid RAW data but Preview is *squeezed

-* That's because YUV configuration is being set somewhere where I don't know yet outside adtg_gui, in 700D it's being set using some C0F1 and C0F0 registers (can be shown in adtg_gui).
    And that's might be the only difference compared to 700D. I just need to find where it's being set to be able to start experiments on 5D3.

   YUV configuration contains scaling and stretching routines for Preview streams (LV/HD YUV paths). on 700D I use them to show the new processed data in LiveView, also correct
   apsect ratio in LiveView.

-How to find it?
More likely by comparing video modes configurations, e.g. 1080p vs 720p and x5 vs x10. Find which function set YUV configuration, and where does it store it in memory?

-For me, I just started yesterday comparing 1080p vs 480p configurations, why?

Because 480p mode have same as 1080p RAW configuration, both have 1920x1290 RAW resolution, beside no registers are being shown in adtg_gui by compring 480p vs 1080p which what I want.
The only difference here is YUV configuration and Canon overlay configuration, I already found out where Canon overlay configuration is being set so I can skip it, because it's not important for us.

Now I am looking for YUV configuration (where it's being set), thing that will help of course is:

1080p has 1904x1274 YUV HD resolution while 480p has 1280x852, which mean scaling and stretching routines are used here . . I just need to find where they are being set now.
Also there are three EDMAC channels seem related to YUV HD path which are channels #10, #21 and #28. Searching around them may lead us to something.

Might spend this month working on 5D3 . .

iaburn

Truly awesome news! Full 5K real time is already huge. If it's finally possible to overcome this 2000 pixels limit for crop modes, that would take it to another level  :o

Danne

Quote from: theBilalFakhouri on February 08, 2023, 12:34:57 PM
-Exceeding Preview height limit                                  is now possible (we can upgrade current 1x3 modes to higher resolutions, 1736x2214 *already works)
You have this working with real time liveview?

vastunghia

5D3 for video
70D for photo

andy kh

good work bilal. keep it up👍
5D Mark III - 70D

theBilalFakhouri

Quote from: iaburn on February 08, 2023, 01:53:02 PM
Truly awesome news! Full 5K real time is already huge. If it's finally possible to overcome this 2000 pixels limit for crop modes, that would take it to another level  :o

Thanks!
Will try doing my best for getting more 2000 width pixels :)


Quote from: Danne on February 08, 2023, 03:05:24 PM
You have this working with real time liveview?

Yes! already mentinoed that few days ago in this reply. Anyway here is a un-edited quick showcase:

https://www.youtube.com/watch?v=51TFnTAPbHI

What you can see in this video:
-1736x2214 1x3 @ 23.976 FPS with real-time responsive preview
-real-time preview compared to Framing preview
-The real-time preview is centered on LCD screen
-No artifacts in both top and bottom parts of the LiveView,
I pressed Info button to switch to Canon overlay, there are no artifacts there too
-It just look like a native Canon video mode 8)  Perfecto! :P




Thanks guys @vastunghia @andy kh!

Quote from: vastunghia on February 08, 2023, 03:18:28 PM
Am I dreaming? :P

I don't want to be negative, but it would be always there no guarantees of success . . Will try my best though :)



To anyone who is interested: just please don't hold your breath. Don't blame me if I failed :P

Danne

Wtf. 5.2k camera with real time preview from digic V sensor. Absolutely crazy.

Bruno Italiano

Wow, would that work on the 5D3?

iaburn

Crazy, crazy... The only failure is not trying!! The goal is just a bonus  ;D

vastunghia

Quote from: iaburn on February 08, 2023, 07:51:43 PM
Crazy, crazy... The only failure is not trying!! The goal is just a bonus  ;D

Sometimes I miss the "like" button on this beautiful Web 1.0 forum ;)
5D3 for video
70D for photo

ShittyWebsite


amitkattal

Bilal,
You are doing God's work now

theBilalFakhouri

Thanks @everyone!




Quote from: Danne on February 08, 2023, 05:33:32 PM
Wtf. 5.2k camera with real time preview from digic V sensor. Absolutely crazy.

Exactly, mind blowing! (recording RAW video + doing lossless compression + processing RAW data in LiveView .. at the same time!) that's why I said earlier:

Quote from: theBilalFakhouri on February 04, 2023, 02:02:36 PM
It seems the hardware is powerful enough, thanks Canon!





Quote from: Bruno Italiano on February 08, 2023, 07:19:17 PM
Wow, would that work on the 5D3?

It seems the hardware is powerful enough. 5D3 should be even more powerful than 700D (5D3 has faster CPU, RAM.. better hardware in general).
Current state for 5D3 was explained in this reply , currently I am looking for the missing pieces on 5D3 . . then I can start doing some real experiments.

dpjpandone

Quote from: theBilalFakhouri on February 08, 2023, 12:34:57 PM


-How to find it?
More likely by comparing video modes configurations, e.g. 1080p vs 720p and x5 vs x10. Find which function set YUV configuration, and where does it store it in memory?



are you doing this in QEMU? or in camera? Maybe if you make a video showing how you're comparing configurATIONS i COULD HELP YOU