Author Topic: Canon 5D Mark II / 5D2  (Read 546915 times)

tajino

  • New to the forum
  • *
  • Posts: 27
Re: Canon 5D Mark II / 5D2
« Reply #675 on: April 22, 2018, 12:15:23 AM »
I've noticed that when using mlv_lite.mo (Raw video v1.1 (MLV Lite)) with FPS override FastTV mode, when recording RAW in 1x crop mode on 5D mark II, it will contain intermittent backward frames.

Watch this https://youtu.be/m1_FBnhzXCs
There are 2 backward frames in this sample sequence, they are marked and should be easy to notice.

Here is the source MLV : https://goo.gl/txLJoN

Magic Lantern version : Nightly.2017Sep15.5D2212
mlv_lite.mo (Raw video v1.1 (MLV Lite))
FPS override 15fps (FastTV mode)
1x crop mode @ 1856x1044
ISO100
aperture : f/8
shutter speed : 1/60s (16ms)
bit depth : 14bit Raw

The sequence will contain more backward frames with slower shutter speed, for example FPS override of 15fps and shutter speed of 1/17s will produce about 20+ backward frames scattered randomly in a 2000 frames sequence.

However, the same settings works correctly with mlv_rec.mo (Raw video v2.0(MLV)) Nightly.2017Sep15.5D2212

This issue doesn't occur in 3x crop mode with the same fps override setting.

Hopefully it could be fixed. Thanks!

reddeercity

  • Hero Member
  • *****
  • Posts: 1641
Re: Canon 5D Mark II / 5D2
« Reply #676 on: April 22, 2018, 05:28:43 AM »
Ok thanks , I'll see if I can reproduce the issue with that build date on my 5d2

reddeercity

  • Hero Member
  • *****
  • Posts: 1641
Re: Canon 5D Mark II / 5D2
« Reply #677 on: April 22, 2018, 05:37:32 AM »
I guess there a few people who are having some troubles installing ml , so I made a updated (with the new ml setup firmware file)
install tutorial for 5d2 but it applies to all ml enabled camera -- I do a step by step (slowly) hopefully not to slow  :D .


reddeercity

  • Hero Member
  • *****
  • Posts: 1641
Re: Canon 5D Mark II / 5D2
« Reply #678 on: April 23, 2018, 06:44:31 AM »
I've noticed that when using mlv_lite.mo (Raw video v1.1 (MLV Lite)) with FPS override FastTV mode, when recording RAW in 1x crop mode on 5D mark II, it will contain intermittent backward frames.
Code: [Select]
Magic Lantern version : Nightly.2017Sep15.5D2212
mlv_lite.mo (Raw video v1.1 (MLV Lite))
FPS override 15fps (FastTV mode)
1x crop mode @ 1856x1044
ISO100
aperture : f/8
shutter speed : 1/60s (16ms)
bit depth : 14bit Raw

Ok had a look into this , I guess I should be testing these build as I'm finding problems .
First loaded the Sept/15/2017 nightly build
Code: [Select]
# Magic Lantern Nightly.2017Sep15.5D2212 (80501e7a8ada (unified) tip)
# Built on 2017-09-14 22:09:23 UTC by [email protected]
# Configuration saved on 2018/04/22 21:26:30
beta.warn = 22
tried to reproduce @tajino setting and I had no problems with mlv_lite or mlv_rec or at least what was describe as the problem
I can't download the file that was posted (problem with link) to check the file .
So I did a few test's with mlv_lite & mlv_rec + audio -- tested with HDMI connected to Zacuto EVF & without
Without Evf(HDMI) all raw video looks normal in mlv_lite & mlv_rec+audio ,
Not so with Evf (HDMI) connected both mlv_lite & mlv_rec+audio has numerous corrupted frames , mlv_lite had very bad corruption compared to mlv_rec
 had 36 bad frames out of 700 here a couple of examples of mlv_lite


 




mlv_rec just has torn frames just like I post here -- some examples
Frames from 00053-00059



So not a bad as mlv_lite , I don't know how far back this goes I notice it on the latest build "Feb/02/2017" and this is Sept.15/2017 build . I don't have the problems with any of the experimental builds (10-12bit) must be a different branch I think this is unified I'm testing right now .
@tajino by chance did you have a HDMI connected when you had this problem ?
Can I get some feedback from other 5D2 users that use HDMI , does problem came up ?
What build did everyone notice it first happen ? Also any other Digic 4 cam users -- have anyone notice problems with HDMI mlv_lite or mlv_rec ?

In the mean time I'll go back about a year and test some builds , to see if the problem can be tracked down to a merge or update .
Until this issue can resolved if you use a HDMI try and find a older build that works , the last two nightly builds are effected . 

reddeercity

  • Hero Member
  • *****
  • Posts: 1641
Re: Canon 5D Mark II / 5D2
« Reply #679 on: April 23, 2018, 08:30:46 AM »
When back a few years in builds and this problem has been there for a long time I never really notice before .
I had to go back to the old core
Code: [Select]
# Magic Lantern v2.3.NEXT.2014Feb15.5D2212 (54a967d0c228 (unified) tip)
# Built on 2014-02-15 19:27:16 UTC by [email protected]
# Configuration saved on 2018/04/23 00:16:20
beta.warn = 23
Code: [Select]
# Config file for module mlv_rec (MLV_REC.MO)
mlv.video.enabled = 1
mlv.res.x = 15
mlv.write.speed = 7023
mlv.preview = 3
mlv.video.display_rec_info = 2
mlv.video.buffer_fill_method = 0
All frames are good with HDMI connected with mlv_rec+audio even has a higher write speed "70MB/s" compared to the new builds write speed of 68MB/s .
The one I test before that was
Code: [Select]
Magic Lantern Nightly.2017Jan13.5D2212
Camera   : 5D2
Firmware : 212
Changeset: 6ebf4242f4d9 (unified) tip
Built on : 2017-01-12 23:09:33 by [email protected]
and it has the problem with HDMI , it seem when where thing was changed to the "New Core" that when it broke from what I can tell , Why ? I have no idea
some one smarter then me would have look in to it . 
What has changed in Liveview from old to new core ? or is this another one of those thing that been sacrificed for the Digic 5 camera ?

I guess that's why I been using the "Old Core" for production work , got to have HDMI .




tajino

  • New to the forum
  • *
  • Posts: 27
Re: Canon 5D Mark II / 5D2
« Reply #680 on: April 23, 2018, 02:45:32 PM »
@reddeercity, I don't have HDMI connected, just standalone 5D2.

Your frame tearing and corruption issues looks more severe, what I got from MLV_lite was duplicated backwards frames in the sequence.
The frame sequence it will go like this 0,1,2,3,2,5,6,7,8,7,10,11,12, instead of writing frame 4, it is writing frame 3 at frame 4 location omitting frame 4 completely.

I had to fix a few shots with these backward and missing frames with Twixtor pro, luckily there were only subtle movements in the shot which could be saved with generated motion vector interpolates.

Here is the new link to the source MLV in Dropbox this time : https://www.dropbox.com/s/nokr8gttksfgfne/M18-1427_mlv-lite_1x_15fps_bkf.zip?dl=0

Strange that you couldn't access the previous link https://goo.gl/txLJoN, it was a directly link to my webhost.

There is no mlv_lite.mo in the old core right (Magic Lantern v2.3.NEXT.2014Feb15.5D2212 (54a967d0c228 (unified) tip))?

reddeercity

  • Hero Member
  • *****
  • Posts: 1641
Re: Canon 5D Mark II / 5D2
« Reply #681 on: April 24, 2018, 06:15:37 AM »
Ok thanks ,
There is no mlv_lite.mo in the old core right (Magic Lantern v2.3.NEXT.2014Feb15.5D2212 (54a967d0c228 (unified) tip))?
Yes ,  but raw_rec.mo (.raw) it the exact same as mlv_lite.mo (.mlv) -- in fact there just took .raw and gave it a .mlv extension and added some camera metadata that full mlv+audio has .
You should also see a increase in write speed + higher resolution ,  Instead of the limited 1856 (1:1) you can go to 1872 . (I would get short burst of about 120 seconds (2min) @ 1872x1054 24p)
Question , why are you using  "FastTV mode" ? you get better results with "exact" frame rate .
One last thing , is your cam set to "PAL" or "NTSC" ? I never tested if this issue is related to that -- I'm in NTSC land .

If you are recording1856x1044 @15fps why do you need to use mlv_lite ? There no advantage to use mlv_lite unless you are recording @ 23.976P for extended record time
(1856x928 23.976p is continuous) and if the reason is to have overlays/GD in full mlv (mlv_rec.mo) all you need to do is enable "Allow Global Draw" when recording mlv .

reddeercity

  • Hero Member
  • *****
  • Posts: 1641
Re: Canon 5D Mark II / 5D2
« Reply #682 on: April 24, 2018, 08:14:23 AM »
Checking the Experimental 10-12bit broken_3xcrop_mode build with raw_slurp 0x02 write channel
Code: [Select]
# Magic Lantern Nightly.2017Dec10.5D2212 (ee95e8825183+ (raw_video_10bit_12bit_LVState-wip) tip)
# Built on 2017-12-10 03:33:12 UTC by [email protected]
# Configuration saved on 2018/04/23 23:49:34
beta.warn = 23
for HDMI corruption and good news , I had the first frame (that's always was there without HDMI) and one frame in the middle that had a mix up image
like Reply #677 (mlv_lite) but not nearly as bad and only one to two bad frames that's it . Same with full mlv(mlv_rec) first frame but only had 3-4 bad frame with auto preview (15second clips)
with Hacked preview (mlv_rec) & frozen/framing preview (mlv_lite) there was non or less then 2 bad frames .
But there was no torn frame like the nightly builds in mlv_rec 14bit so it seems (LVState-wip) is the most stable liveview for Digic4 with HDMI , not perfect but 99% !
So maybe I'll start working in this branch , I think I'll give up on the unified because of the HDMI problem.

tajino

  • New to the forum
  • *
  • Posts: 27
Re: Canon 5D Mark II / 5D2
« Reply #683 on: April 26, 2018, 06:47:34 PM »
@reddeercity, my camera is set to NTSC.

Does the Canon menu 'Movie rec. size' 24p or 30p setting makes any difference to MLV_full or MLV_lite? I've tried both, they seems to exhibit the same back-frames/skipped-frames/dupe-frames issues in either mode.

Upon further investigation on fps override in 1x crop mode, I've found that if you set the fps override to 1fps (exact or lowlight doesn't matter), with :
MLV_Full(mlv_rec) : only odd frames are recorded, even frames are the duplicate of the odd frames. Liveview shows every frame correctly while recording.
Check this MLV_Full(mlv_rec) 1x crop 1fps (exact) sample : https://www.dropbox.com/s/kpqaflhi0ra464x/M26-2351_mlvfull_exactfps.zip?dl=0

MLV_Lite(mlv_lite) : recorded frames is a mess, besides skipping even frames, there is also intermittent duplicated previous frames in the sequence.
Check this MLV_Lite(mlv_lite) 1x crop 1fps (exact) sample : https://www.dropbox.com/s/yh8hyj38u8wml0w/M27-0006_mlvlite_exactfps.zip?dl=0

- the end of the headlight trails should be the start of the trail in the subsequent frame, but you can clearly see that the frame sequencing is a total mess, try following a trail, you can't.

- you can quickly scrub through the sample MLV frame by frame in MLVProducer https://sourceforge.net/projects/mlvproducer/ without dumping it to dng

- I suspect this doesn't only apply to 1fps override, any other low fps override would also exhibit this issue in 1x crop mode. I'll do more tests and report back here when time permits.

Magic Lantern version : Nightly.2017Sep15.5D2212
FPS override 1fps (Exact mode)
1x crop mode @ 1856x1044
shutter speed : 1s
bit depth : 14bit Raw


In 3x crop mode though, both MLV_Full and MLV_Lite seems to be recording correctly with frame override set to 1fps, or any other fps in any fps mode (exact, lowlight, fasttv, lowjello).

@reddeercity, would you be able to test this 1x crop 1fps override issue in both MLV_full and MLV_lite, to confirm my findings. Thanks!


tajino

  • New to the forum
  • *
  • Posts: 27
Re: Canon 5D Mark II / 5D2
« Reply #684 on: April 26, 2018, 07:43:26 PM »
Question , why are you using  "FastTV mode" ? you get better results with "exact" frame rate .

I need the shutter speed to be faster than the overridden fps, for bright scenes without ND filters, and to reduce motion blur for specific purposes.


One last thing , is your cam set to "PAL" or "NTSC" ? I never tested if this issue is related to that -- I'm in NTSC land .

Mine is set to NTSC, does that affect MLV frame timing or just capping the max at 25fps in PAL mode?


If you are recording1856x1044 @15fps why do you need to use mlv_lite ? There no advantage to use mlv_lite unless you are recording @ 23.976P for extended record time
(1856x928 23.976p is continuous) and if the reason is to have overlays/GD in full mlv (mlv_rec.mo) all you need to do is enable "Allow Global Draw" when recording mlv .

mlv_lite allows aperture/shutterspeed changes during recording, useful for pseudo timelapse of sunrise/sunset where you need to manually ramp the aperture and shutter speed to compensate with the extreme dynamic range. I do exposure changes in tethered Canon EOS utility while recording without touching the camera.

mlv_full ignores aperture/shutterspeed changes while recording.

tajino

  • New to the forum
  • *
  • Posts: 27
Re: Canon 5D Mark II / 5D2
« Reply #685 on: April 26, 2018, 11:54:51 PM »
I've tried rolling back to the previous nightly and it seems that this has been broken all the way back to Nightly.2015Mar29.5D2212

When recording to MP4 with the same fps override, all frames were written correctly, no duplicates, jumbled or backward frames.

I can be pretty sure that the fault is in mlv_rec and mlv_lite, and not the fps override.

Can anyone test this to confirm? Please refer to these posts for details :

https://www.magiclantern.fm/forum/index.php?topic=11205.msg200609#msg200609
https://www.magiclantern.fm/forum/index.php?topic=11205.msg200425#msg200425
https://www.magiclantern.fm/forum/index.php?topic=11205.msg200371#msg200371

Hope a1ex or g3gg0 can take a look at this issue.

Thanks!

Update : I've also tested the older build magiclantern-v2.3.NEXT.2014Feb16.5D2212, it is also exhibiting the same issues with 1fps frame override in 1x crop mode.

reddeercity

  • Hero Member
  • *****
  • Posts: 1641
Re: Canon 5D Mark II / 5D2
« Reply #686 on: April 27, 2018, 07:48:52 AM »
Have tested with raw_rec.mo on the magiclantern-v2.3.NEXT.2014Feb16.5D2212 or just mlv_rec ?
did you try the latest nightly build , I think it's Feb/2018 ?
If you feel like living on the bleeding edge , maybe try this on the Highly Experimental  raw_video_10bit_12bit_LVState-wip ? see Reply #681
caveat : only works in pure ISO's (100,200,400,800,1600,3200) All digital ISO (160,300,320,500, etc. ...) cause a Lockup/cam freeze , need's a battery pull to unlock.

If truly the frames are out of order at 1 fps then a1ex or g3gg0 are the ones that need to look at this , it's way above my pay grade  ;)
There a few different development ml builds I made for research  in my bitbucket downloads you could try magiclantern-10bit_12bit_raw_twk_crop_rec.2016Dec01.5D2212 ,
magiclantern-Nightly.Compressed.Raw.Bit.Reduction.2017.May11.5D2212 or magiclantern-adtg_gui.2017Apr04.5D2212
there all work but have special tools to help in reverse engineering .

Edit: A light bulb just came on , does still happen if you don't ramp ISO or change it ? while filming -- I seem to remember something about back in 2013 on the old 5d2 thread.
Edit 2: RAW+FPS override=error every second frame reported in September 21, 2013

tajino

  • New to the forum
  • *
  • Posts: 27
Re: Canon 5D Mark II / 5D2
« Reply #687 on: April 27, 2018, 05:27:00 PM »
Have tested with raw_rec.mo on the magiclantern-v2.3.NEXT.2014Feb16.5D2212 or just mlv_rec ?

Yes, tested both, same results.

did you try the latest nightly build , I think it's Feb/2018 ?

Yes, tested that too. same issue.

If you feel like living on the bleeding edge , maybe try this on the Highly Experimental  raw_video_10bit_12bit_LVState-wip ? see Reply #681
caveat : only works in pure ISO's (100,200,400,800,1600,3200) All digital ISO (160,300,320,500, etc. ...) cause a Lockup/cam freeze , need's a battery pull to unlock.

Will check it out.

If truly the frames are out of order at 1 fps then a1ex or g3gg0 are the ones that need to look at this , it's way above my pay grade  ;)

Any idea how to get a1ex or g3gg0 informed about this fps override and mlv_rec/mlv_lite issue?

There a few different development ml builds I made for research  in my bitbucket downloads you could try magiclantern-10bit_12bit_raw_twk_crop_rec.2016Dec01.5D2212 ,
magiclantern-Nightly.Compressed.Raw.Bit.Reduction.2017.May11.5D2212 or magiclantern-adtg_gui.2017Apr04.5D2212
there all work but have special tools to help in reverse engineering .

Will definitely check that one out.

Edit: A light bulb just came on , does still happen if you don't ramp ISO or change it ? while filming -- I seem to remember something about back in 2013 on the old 5d2 thread.

The issue with fps override and frame duplication/jumbled happens with just raw recording, without any shutter speed/aperture/ISO change while recording.

Edit 2: RAW+FPS override=error every second frame reported in September 21, 2013

Looks like this issue is known long ago, either that it is not fixable or just not yet being looked into.

@reddeercity Can you test the 1fps override on your 5D2 just to confirm that it is indeed a problem with mlv_rec/mlv_lite and not my settings. Thanks!

1. Find somewhere with constant traffic flow, expose so that it is good enough to see the headlight trails
2. fps override = 1fps (mode : exact, lowlight doesn't really matter)
3. make sure LV is at 1x crop mode.
4. enable mlv_rec.mo and record for 30 seconds (you should get 30 unique frames)
5. check the recorded MLV, step through each frame, you'll see that only odd frames are recorded, even frames are the duplicate of the odd frames.
6. repeat the test with mlv_lite.mo, you'll get jumbled and repeated frames all over the sequence.

Looking forward to your results.



reddeercity

  • Hero Member
  • *****
  • Posts: 1641
Re: Canon 5D Mark II / 5D2
« Reply #688 on: July 11, 2018, 07:24:42 AM »
I just finish uploading to Youtube 12bit raw video interview (book author's signing) with the bleeding edge highly experimental 10-12 bit FHD (Full Frame) @ 1856x1044 23.976fps+audio .
It's just a one take shot interview for about 10min. First time I tried it at 800 ISO , there was a little noise in the shadow used Neat Video to clean it up .
Graded in FCPX with Film Convert Pro used the "RedMX" for camera source & Polaroid 600 for film emulation film stock . Uploaded file is Apple ProRes 422HQ (15GB)
all detail about workflow are on my YouTube post.

IDA_ML

  • Senior
  • ****
  • Posts: 417
Re: Canon 5D Mark II / 5D2
« Reply #689 on: July 11, 2018, 11:01:04 AM »
Excellent work, Reddeercity, you made it with the 5D2!  Congratulations!

So, there is hope for Digic IV cameras, isn't it?  Keep up the good work!