Canon 5D Mark II / 5D2

[reddeercity]

Ok thanks , I'll see if I can reproduce the issue with that build date on my 5d2

[reddeercity]

I guess there a few people who are having some troubles installing ml , so I made a updated (with the new ml setup firmware file)
install tutorial for 5d2 but it applies to all ml enabled camera -- I do a step by step (slowly) hopefully not to slow  .

[reddeercity]

I've noticed that when using mlv_lite.mo (Raw video v1.1 (MLV Lite)) with FPS override FastTV mode, when recording RAW in 1x crop mode on 5D mark II, it will contain intermittent backward frames.

Code: [Select]

Magic Lantern version : Nightly.2017Sep15.5D2212
mlv_lite.mo (Raw video v1.1 (MLV Lite))
FPS override 15fps (FastTV mode)
1x crop mode @ 1856x1044
ISO100
aperture : f/8
shutter speed : 1/60s (16ms)
bit depth : 14bit Raw

Ok had a look into this , I guess I should be testing these build as I'm finding problems .
First loaded the Sept/15/2017 nightly build

Code: [Select]

# Magic Lantern Nightly.2017Sep15.5D2212 (80501e7a8ada (unified) tip)
# Built on 2017-09-14 22:09:23 UTC by jenkins@nightly
# Configuration saved on 2018/04/22 21:26:30
beta.warn = 22 tried to reproduce @tajino setting and I had no problems with mlv_lite or mlv_rec or at least what was describe as the problem
I can't download the file that was posted (problem with link) to check the file .
So I did a few test's with mlv_lite & mlv_rec + audio -- tested with HDMI connected to Zacuto EVF & without
Without Evf(HDMI) all raw video looks normal in mlv_lite & mlv_rec+audio ,
Not so with Evf (HDMI) connected both mlv_lite & mlv_rec+audio has numerous corrupted frames , mlv_lite had very bad corruption compared to mlv_rec
 had 36 bad frames out of 700 here a couple of examples of mlv_lite


 




mlv_rec just has torn frames just like I post here -- some examples
Frames from 00053-00059



So not a bad as mlv_lite , I don't know how far back this goes I notice it on the latest build "Feb/02/2017" and this is Sept.15/2017 build . I don't have the problems with any of the experimental builds (10-12bit) must be a different branch I think this is unified I'm testing right now .
@tajino by chance did you have a HDMI connected when you had this problem ?
Can I get some feedback from other 5D2 users that use HDMI , does problem came up ?
What build did everyone notice it first happen ? Also any other Digic 4 cam users -- have anyone notice problems with HDMI mlv_lite or mlv_rec ?

In the mean time I'll go back about a year and test some builds , to see if the problem can be tracked down to a merge or update .
Until this issue can resolved if you use a HDMI try and find a older build that works , the last two nightly builds are effected . 

[reddeercity]

When back a few years in builds and this problem has been there for a long time I never really notice before .
I had to go back to the old core

Code: [Select]

# Magic Lantern v2.3.NEXT.2014Feb15.5D2212 (54a967d0c228 (unified) tip)
# Built on 2014-02-15 19:27:16 UTC by jenkins@magiclantern.fm
# Configuration saved on 2018/04/23 00:16:20
beta.warn = 23

Code: [Select]

# Config file for module mlv_rec (MLV_REC.MO)
mlv.video.enabled = 1
mlv.res.x = 15
mlv.write.speed = 7023
mlv.preview = 3
mlv.video.display_rec_info = 2
mlv.video.buffer_fill_method = 0
All frames are good with HDMI connected with mlv_rec+audio even has a higher write speed "70MB/s" compared to the new builds write speed of 68MB/s .
The one I test before that was

Code: [Select]

Magic Lantern Nightly.2017Jan13.5D2212
Camera   : 5D2
Firmware : 212
Changeset: 6ebf4242f4d9 (unified) tip
Built on : 2017-01-12 23:09:33 by jenkins@nightlyand it has the problem with HDMI , it seem when where thing was changed to the "New Core" that when it broke from what I can tell , Why ? I have no idea
some one smarter then me would have look in to it . 
What has changed in Liveview from old to new core ? or is this another one of those thing that been sacrificed for the Digic 5 camera ?

I guess that's why I been using the "Old Core" for production work , got to have HDMI .

[tajino]

@reddeercity, I don't have HDMI connected, just standalone 5D2.

Your frame tearing and corruption issues looks more severe, what I got from MLV_lite was duplicated backwards frames in the sequence.
The frame sequence it will go like this 0,1,2,3,2,5,6,7,8,7,10,11,12, instead of writing frame 4, it is writing frame 3 at frame 4 location omitting frame 4 completely.

I had to fix a few shots with these backward and missing frames with Twixtor pro, luckily there were only subtle movements in the shot which could be saved with generated motion vector interpolates.

Here is the new link to the source MLV in Dropbox this time : https://www.dropbox.com/s/nokr8gttksfgfne/M18-1427_mlv-lite_1x_15fps_bkf.zip?dl=0

Strange that you couldn't access the previous link https://goo.gl/txLJoN, it was a directly link to my webhost.

There is no mlv_lite.mo in the old core right (Magic Lantern v2.3.NEXT.2014Feb15.5D2212 (54a967d0c228 (unified) tip))?

[reddeercity]

Ok thanks ,

There is no mlv_lite.mo in the old core right (Magic Lantern v2.3.NEXT.2014Feb15.5D2212 (54a967d0c228 (unified) tip))?

Yes ,  but raw_rec.mo (.raw) it the exact same as mlv_lite.mo (.mlv) -- in fact there just took .raw and gave it a .mlv extension and added some camera metadata that full mlv+audio has .
You should also see a increase in write speed + higher resolution ,  Instead of the limited 1856 (1:1) you can go to 1872 . (I would get short burst of about 120 seconds (2min) @ 1872x1054 24p)
Question , why are you using  "FastTV mode" ? you get better results with "exact" frame rate .
One last thing , is your cam set to "PAL" or "NTSC" ? I never tested if this issue is related to that -- I'm in NTSC land .

If you are recording1856x1044 @15fps why do you need to use mlv_lite ? There no advantage to use mlv_lite unless you are recording @ 23.976P for extended record time
(1856x928 23.976p is continuous) and if the reason is to have overlays/GD in full mlv (mlv_rec.mo) all you need to do is enable "Allow Global Draw" when recording mlv .

[reddeercity]

Checking the Experimental 10-12bit broken_3xcrop_mode build with raw_slurp 0x02 write channel

Code: [Select]

# Magic Lantern Nightly.2017Dec10.5D2212 (ee95e8825183+ (raw_video_10bit_12bit_LVState-wip) tip)
# Built on 2017-12-10 03:33:12 UTC by ml@ml-pc
# Configuration saved on 2018/04/23 23:49:34
beta.warn = 23for HDMI corruption and good news , I had the first frame (that's always was there without HDMI) and one frame in the middle that had a mix up image
like Reply #677 (mlv_lite) but not nearly as bad and only one to two bad frames that's it . Same with full mlv(mlv_rec) first frame but only had 3-4 bad frame with auto preview (15second clips)
with Hacked preview (mlv_rec) & frozen/framing preview (mlv_lite) there was non or less then 2 bad frames .
But there was no torn frame like the nightly builds in mlv_rec 14bit so it seems (LVState-wip) is the most stable liveview for Digic4 with HDMI , not perfect but 99% !
So maybe I'll start working in this branch , I think I'll give up on the unified because of the HDMI problem.

[tajino]

@reddeercity, my camera is set to NTSC.

Does the Canon menu 'Movie rec. size' 24p or 30p setting makes any difference to MLV_full or MLV_lite? I've tried both, they seems to exhibit the same back-frames/skipped-frames/dupe-frames issues in either mode.

Upon further investigation on fps override in 1x crop mode, I've found that if you set the fps override to 1fps (exact or lowlight doesn't matter), with :
MLV_Full(mlv_rec) : only odd frames are recorded, even frames are the duplicate of the odd frames. Liveview shows every frame correctly while recording.
Check this MLV_Full(mlv_rec) 1x crop 1fps (exact) sample : https://www.dropbox.com/s/kpqaflhi0ra464x/M26-2351_mlvfull_exactfps.zip?dl=0

MLV_Lite(mlv_lite) : recorded frames is a mess, besides skipping even frames, there is also intermittent duplicated previous frames in the sequence.
Check this MLV_Lite(mlv_lite) 1x crop 1fps (exact) sample : https://www.dropbox.com/s/yh8hyj38u8wml0w/M27-0006_mlvlite_exactfps.zip?dl=0

- the end of the headlight trails should be the start of the trail in the subsequent frame, but you can clearly see that the frame sequencing is a total mess, try following a trail, you can't.

- you can quickly scrub through the sample MLV frame by frame in MLVProducer https://sourceforge.net/projects/mlvproducer/ without dumping it to dng

- I suspect this doesn't only apply to 1fps override, any other low fps override would also exhibit this issue in 1x crop mode. I'll do more tests and report back here when time permits.

Magic Lantern version : Nightly.2017Sep15.5D2212
FPS override 1fps (Exact mode)
1x crop mode @ 1856x1044
shutter speed : 1s
bit depth : 14bit Raw


In 3x crop mode though, both MLV_Full and MLV_Lite seems to be recording correctly with frame override set to 1fps, or any other fps in any fps mode (exact, lowlight, fasttv, lowjello).

@reddeercity, would you be able to test this 1x crop 1fps override issue in both MLV_full and MLV_lite, to confirm my findings. Thanks!

[tajino]

Question , why are you using  "FastTV mode" ? you get better results with "exact" frame rate .

I need the shutter speed to be faster than the overridden fps, for bright scenes without ND filters, and to reduce motion blur for specific purposes.

One last thing , is your cam set to "PAL" or "NTSC" ? I never tested if this issue is related to that -- I'm in NTSC land .

Mine is set to NTSC, does that affect MLV frame timing or just capping the max at 25fps in PAL mode?

If you are recording1856x1044 @15fps why do you need to use mlv_lite ? There no advantage to use mlv_lite unless you are recording @ 23.976P for extended record time
(1856x928 23.976p is continuous) and if the reason is to have overlays/GD in full mlv (mlv_rec.mo) all you need to do is enable "Allow Global Draw" when recording mlv .

mlv_lite allows aperture/shutterspeed changes during recording, useful for pseudo timelapse of sunrise/sunset where you need to manually ramp the aperture and shutter speed to compensate with the extreme dynamic range. I do exposure changes in tethered Canon EOS utility while recording without touching the camera.

mlv_full ignores aperture/shutterspeed changes while recording.

[tajino]

I've tried rolling back to the previous nightly and it seems that this has been broken all the way back to Nightly.2015Mar29.5D2212

When recording to MP4 with the same fps override, all frames were written correctly, no duplicates, jumbled or backward frames.

I can be pretty sure that the fault is in mlv_rec and mlv_lite, and not the fps override.

Can anyone test this to confirm? Please refer to these posts for details :

https://www.magiclantern.fm/forum/index.php?topic=11205.msg200609#msg200609
https://www.magiclantern.fm/forum/index.php?topic=11205.msg200425#msg200425
https://www.magiclantern.fm/forum/index.php?topic=11205.msg200371#msg200371

Hope a1ex or g3gg0 can take a look at this issue.

Thanks!

Update : I've also tested the older build magiclantern-v2.3.NEXT.2014Feb16.5D2212, it is also exhibiting the same issues with 1fps frame override in 1x crop mode.

[reddeercity]

Have tested with raw_rec.mo on the magiclantern-v2.3.NEXT.2014Feb16.5D2212 or just mlv_rec ?
did you try the latest nightly build , I think it's Feb/2018 ?
If you feel like living on the bleeding edge , maybe try this on the Highly Experimental  raw_video_10bit_12bit_LVState-wip ? see Reply #681
caveat : only works in pure ISO's (100,200,400,800,1600,3200) All digital ISO (160,300,320,500, etc. ...) cause a Lockup/cam freeze , need's a battery pull to unlock.

If truly the frames are out of order at 1 fps then a1ex or g3gg0 are the ones that need to look at this , it's way above my pay grade 
There a few different development ml builds I made for research  in my bitbucket downloads you could try magiclantern-10bit_12bit_raw_twk_crop_rec.2016Dec01.5D2212 ,
magiclantern-Nightly.Compressed.Raw.Bit.Reduction.2017.May11.5D2212 or magiclantern-adtg_gui.2017Apr04.5D2212
there all work but have special tools to help in reverse engineering .

Edit: A light bulb just came on , does still happen if you don't ramp ISO or change it ? while filming -- I seem to remember something about back in 2013 on the old 5d2 thread.
Edit 2: RAW+FPS override=error every second frame reported in September 21, 2013

[tajino]

Have tested with raw_rec.mo on the magiclantern-v2.3.NEXT.2014Feb16.5D2212 or just mlv_rec ?

Yes, tested both, same results.

did you try the latest nightly build , I think it's Feb/2018 ?

Yes, tested that too. same issue.

If you feel like living on the bleeding edge , maybe try this on the Highly Experimental  raw_video_10bit_12bit_LVState-wip ? see Reply #681
caveat : only works in pure ISO's (100,200,400,800,1600,3200) All digital ISO (160,300,320,500, etc. ...) cause a Lockup/cam freeze , need's a battery pull to unlock.

Will check it out.

If truly the frames are out of order at 1 fps then a1ex or g3gg0 are the ones that need to look at this , it's way above my pay grade 

Any idea how to get a1ex or g3gg0 informed about this fps override and mlv_rec/mlv_lite issue?

There a few different development ml builds I made for research  in my bitbucket downloads you could try magiclantern-10bit_12bit_raw_twk_crop_rec.2016Dec01.5D2212 ,
magiclantern-Nightly.Compressed.Raw.Bit.Reduction.2017.May11.5D2212 or magiclantern-adtg_gui.2017Apr04.5D2212
there all work but have special tools to help in reverse engineering .

Will definitely check that one out.

Edit: A light bulb just came on , does still happen if you don't ramp ISO or change it ? while filming -- I seem to remember something about back in 2013 on the old 5d2 thread.

The issue with fps override and frame duplication/jumbled happens with just raw recording, without any shutter speed/aperture/ISO change while recording.

Edit 2: RAW+FPS override=error every second frame reported in September 21, 2013

Looks like this issue is known long ago, either that it is not fixable or just not yet being looked into.

@reddeercity Can you test the 1fps override on your 5D2 just to confirm that it is indeed a problem with mlv_rec/mlv_lite and not my settings. Thanks!

1. Find somewhere with constant traffic flow, expose so that it is good enough to see the headlight trails
2. fps override = 1fps (mode : exact, lowlight doesn't really matter)
3. make sure LV is at 1x crop mode.
4. enable mlv_rec.mo and record for 30 seconds (you should get 30 unique frames)
5. check the recorded MLV, step through each frame, you'll see that only odd frames are recorded, even frames are the duplicate of the odd frames.
6. repeat the test with mlv_lite.mo, you'll get jumbled and repeated frames all over the sequence.

Looking forward to your results.

[reddeercity]

I just finish uploading to Youtube 12bit raw video interview (book author's signing) with the bleeding edge highly experimental 10-12 bit FHD (Full Frame) @ 1856x1044 23.976fps+audio .
It's just a one take shot interview for about 10min. First time I tried it at 800 ISO , there was a little noise in the shadow used Neat Video to clean it up .
Graded in FCPX with Film Convert Pro used the "RedMX" for camera source & Polaroid 600 for film emulation film stock . Uploaded file is Apple ProRes 422HQ (15GB)
all detail about workflow are on my YouTube post.

[IDA_ML]

Excellent work, Reddeercity, you made it with the 5D2!  Congratulations!

So, there is hope for Digic IV cameras, isn't it?  Keep up the good work!

[dariSSight]

Thanks for the improvements Reddeercity, I’ve found sometime to test your bleeding edge 12bit and it’s awesome. I did notice the first frame of the clips has some image defects (

), but 99% of what is recorded is 12bit RAW, I will also test out the 10bit 1856x1254 because I’m looking forward to doing something with the full sensor image. By the way, Objectively Magic Lantern is Industry ready for Filmmakers and Professional, I spend my time on movie set using Blackmagic Mini Pro to RED to Canon. The only thing that will stop Magic Lanter from making a Feature film is lack of effort, don’t forget House MD season 6 Episode 22 the season finale “Help Me”, was shot entirely with the Canon 5D Mark II with maybe Cinestyle Log native CF Card H.264, also Act of Valor film and many more. If you have a good DIT system on your set and patience for securing Take, anything is possible.

[HJL]

Hello!
Sorry for my English
Please tell me how to enable
servo autofocus
in video mode
5DM2 camera

[Audionut]

Please tell me how

Chapter 4 of the camera manual.

[reddeercity]

Another Pipe Dream comes true      3K raw video 
for those who don't know what I'm talken about  start reading  here
We reach the first milestone in UHD on the 5d2 , 3k 10bit raw video in crop_mode
Thanks to a1ex & waza57 for the finial push across the finish line !
Shot some test last night at home , here a frame , I didn't spend much time grading , just the basic stuff in MLVProducer .
**Note** the prores files I uploaded to my google drive play's them at 1080p so not full rez , you'll need to download to see the full 2880x1080
Used my Canon EF 24-70mm f2.8L  , I either use 24mm or 70mm --- at this rez there's a crop factor of 1.95
100 ISO , F16 and one shot at f9.1 on a Lexar 64GB 1066x

2880x1080 @ 23.976 10bit


Link to the above Full size -M02-1800.png  
Link to the ProRes 4444 file M02-1800.mov it about 1GB

Some other frames from my test , even was able to record 1:40 min 8GB+ file with frame skipping enabled , and from my setting in ML
there was only 1 frame dropped . More testing needed , next to test with Audio enabled and see how long I can record .

2880x1080 @ 23.976 10bit


Link to the above Full size - M02-1802.png
Link to the ProRes 4444 file M02-1802.mov it about 2GB

2880x1080 @ 23.976 10bit


Link to the Full size - M02-1810.png
Link to the ProRes 4444 file M02-1810.mov it about 560 MB

2880x1080 @ 23.976 10bit


Link to the Full size - M02-1817.png
Link to the ProRes 4444 file M02-1817.mov 5GB
This is the file I enabled frame skipping , where there's only 1 frame drop in 8GB , plus I wanted to see if there any aliasing & moiré patterns
from the spider web (fine lines or patterns)

[jpegmasterjesse]

All these days lurking have finally paid off! Thanks for your hard work keeping the dream alive reddeercity, waza, a1ex, and greg!

For those of you who are a little worried the workflow is beyond your depth, it's not hard at all.
Here's what I did:

A: Downloaded magiclantern-Nightly.2018Sep02.5D2212.zip from waza: https://bitbucket.org/waza57/magic-lantern/downloads/

B: Deleted the files on my card, copied the build files over, and went through the installation process.

C: Loaded the modules adtg_gui / crop_rec / mlv_rec & rebooted.

D: Enabled Crop mode in the Movie menu, and selected 3.5k 1:1 centered x5.

E: Enabled Raw video (MLV), went to liveview, and pressed the zoom button once to enter 5x mode.

F: Entered settings on the Raw video module and scaled my resolution up to 2880 x 1080.

G: Set my bit depth to 10bit and pressed record!

[reddeercity]

You need

Code: [Select]

crop_rec.mo
mlv_rec.mo
mlv_snd.moSound works also but can take up a little resources which can reduce the almost of frames.
set it to low bit rate 44.1 or 22 etc. ..

[Danne]

What source is used for compiling/getting 2880×1080p? What might work for lossless is to turn down the analog gain registers. Works for 2520×1320 on eos 100D reducing 14bitlossless into 10bit.(kudos Levas, bilal)

[reddeercity]

What source is used for compiling/getting 2880×1080p?

3K/UHD 5D2 Raw development and Other Digic IV Cams

What might work for lossless is to turn down the analog gain registers. Works for 2520×1320 on eos 100D reducing 14bitlossless into 10bit.(kudos Levas, bilal)

we don't have 14bit lossless working yet .

[IDA_ML]

You finally made it Reddeercity!  Congratulations to you and all the other developers that helped!  I guess, this is a very important step forward for all Digic 4 cameras, not just the 5D2.  I am waiting with great excitement for a working build for the EOS 7D.203.  With its fast CF-card interface and especially its unique filmic look, the 7D has the potential to become the next 4K-crop RAW video monster!

[flofifull]

I am waiting with great excitement for a working build for the EOS 7D.203.  With its fast CF-card interface and especially its unique filmic look, the 7D has the potential to become the next 4K-crop RAW video monster!

+1
7D needs '4K-crop RAW' !

[Audionut]

Nice work people.  Good to see all of your development effort paying dividends reddeercity.

A: Downloaded magiclantern-Nightly.2018Sep02.5D2212.zip from waza: https://bitbucket.org/waza57/magic-lantern/downloads/

I've removed the direct link from your post.  There were some issues in the past where people make bug reports about user builds that are months (years) old, regarding issues that have long been resolved, causing wasted time for all parties involved.

Most of the time, this was as a result of random builds being posted all throughout the forum.  By linking to the repository instead, helps to ensure that only the latest builds are available.

Regards,
Audionut.