Magic Lantern Forum

Experimental builds (WIP) => crop_rec and derived builds => Topic started by: Danne on November 09, 2018, 05:11:37 PM

Title: Danne's crop_rec_4k, 5DIII
Post by: Danne on November 09, 2018, 05:11:37 PM
Moved builds and to first post instead from today 20210127:

Latest:
https://bitbucket.org/Dannephoto/magic-lantern_dannephoto_git/downloads/

Source atm before leaving bitbucket:
https://bitbucket.org/Dannephoto/magic-lantern_dannephoto_git/src/master/


Worked on my 5D3 crop_rec.c code in this branch:
https://bitbucket.org/Dannephoto/magic-lantern_dannephoto_git/src/master/


- Refined anamorphic presets so it now gives continuous:
1808x2300(2:35.1) = 5425 x 2300
1360x2300(16:9)    = 4080 x 2300

- Also adressed the battery pull issue happening when in 48fps or mv720p 3x3 mode. Workaround allows for looping through x5,x10 and back into x1 mode.

- cine.lua included
- set_25fps in crop mode sub menu working with anamorphic mode
- bitdepth modes in crop mode sub menu working for all presets
- not included sd_uhs(don´t see why sd patching would be needed with mlv_lite anyway)

In terms of image quality and performance the anamorphic mode on this camera outruns anything coming from eosm, 100d etc...

EDIT:
sd_uhs module:
Included as a module. Enable it in Modules tab. Beware that this module is extremely experimental. Use at own risk.





























Below info saved for future/historical reference
Due to misassumptions let us move on!
https://www.magiclantern.fm/forum/index.php?topic=23041.msg208432#msg208432

From crop_rec thread:
https://www.magiclantern.fm/forum/index.php?topic=19300.msg208429#msg208429



In case anyone missed this:
https://www.magiclantern.fm/forum/index.php?topic=10111.msg208136#msg208136

A special ML build here for 5D3113:
https://bitbucket.org/Dannephoto/magic-lantern/downloads/crop_rec_4k_mlv_snd_isogain_1x3_5D3113_presets.zip

build for 5D3123(Not tested! bleeding edge, be careful)
https://bitbucket.org/Dannephoto/magic-lantern/downloads/crop_rec_4k_mlv_snd_isogain_1x3_5D3123_presets.zip

commit:
https://bitbucket.org/Dannephoto/magic-lantern/commits/75b6e5aedbbb23c22b5055ddea6712f662681955

I added a few items to the crop_rec menu and also rearranged a few things which makes it possible to get cleaner output. Thanks to a1ex crop_rec.c code it´s possible for a player like myself to get some decent workflow out of this.

How does it work?
Pretty straight forward. If you want to shoot regular 14bit or use the regular 12/10 bit menu in RAW video you can use Crop mode menu as before. However, if you want to get cleaner iso and lowering analog gain to get 12/10bit output a different way do following:

1 - Enable crop rec and select any setting in Crop mode menu. Be sure to start off in 14bit-lossless

(https://i.postimg.cc/JhkZ9m0H/VRAM0-PPM-500px.png)

2 - Press q on Crop mode menu and select any iso in there. This will result in a 13bit iso which will get you cleaner files than the regular iso. You won´t see the change by eye in liveview but comparing files recorded you´ll see the difference in shadows. By enabling iso in this submenu you will override any analog iso already set before. Set chosen iso to off if you want to get back to old iso settings

(https://i.postimg.cc/FsLcBN6t/VRAM2-PPM-500px.png)

3 - You can now choose to add 12bit or 10bit on top of your chosen iso to further lower analog gain registers

(https://i.postimg.cc/XJ1FTJ3W/VRAM1-PPM-500px.png)

Original iso 100
(https://i.postimg.cc/R09ctyGk/iso100-png-800px.png)

10bit iso 100 More or less same as iso 1600. Let´s work the other bits if you not after lowering bitrate.
(https://i.postimg.cc/50yQqVzR/iso100-10bit-png-800px.png)

12bit iso 100
(https://i.postimg.cc/tgXxJP4y/iso100-12bit-png-800px.png)

13bit iso 100
(https://i.postimg.cc/0Q4MVBd2/iso100-13bit-png-800px.png)

Have fun! And be careful. It´s bleeding edge...


Noticed two bugs on the way when testing:
1 - When 1080p45/1080p48 3x3 is set you will get stuck in 10x zoom mode if you go there.
2 - adtg_gui.mo will interfere with slowish "framing" previewing. You need to disable adtg_gui.mo altogether to have framing mode working again.

Thanks A1ex, Levas, bilal, 70MM13 and others for contributions.


Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: jimiz on November 09, 2018, 05:29:33 PM
for 5D3123 , nothing ?  :-\
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: a1ex on November 09, 2018, 05:33:45 PM
Quote from: Danne on November 09, 2018, 05:11:37 PM
10bit iso 100

This is actually about ISO 1500. Try comparing it with Canon's ISO 1600, in both highlights and shadows.

Yes, it's slightly better than Canon's 1600, but labeling it as ISO 100 is plain misleading, sorry to say that.





Edit: further test reveals the actual ISO is actually *above* 1600. Test files (white level tweaked manually, right before the last histogram peak):
iso1600.DNG (https://a1ex.magiclantern.fm/bleeding-edge/iso50/danne/iso1600.DNG) (unmodified Canon ISO, assumed exact)
iso100-cmos0-443.DNG (https://a1ex.magiclantern.fm/bleeding-edge/iso50/danne/iso100-cmos0-443.DNG) (estimated ISO 1527)
iso100-cmos0-443-adtg-888x-low.DNG (https://a1ex.magiclantern.fm/bleeding-edge/iso50/danne/iso100-cmos0-443-adtg-888x-low.DNG) (estimated ISO 1491)
danne-iso100-10bit.DNG (https://a1ex.magiclantern.fm/bleeding-edge/iso50/danne/danne-iso100-10bit.DNG) (estimated ISO 2043)

ISO estimation method in octave, from median value in the raw file, normalized with black and white levels (not 100% right; estimation should be done from clipping point):

[a,ea] = read_raw('iso1600.DNG'); a = a - ea.black_level; a = a / (ea.white_level - ea.black_level); median(a(:))
ans =  0.33647

[a,ea] = read_raw('iso100-cmos0-443.DNG'); a = a - ea.black_level; a = a / (ea.white_level - ea.black_level); median(a(:))
ans =  0.32112
# 1600 * 0.32112 / 0.33647 = 1527

[a,ea] = read_raw('iso100-cmos0-443-adtg-888x-low.DNG'); a = a - ea.black_level; a = a / (ea.white_level - ea.black_level); median(a(:))
ans =  0.31355
# 1600 * 0.31355 / 0.33647 = 1491

[a,ea] = read_raw('danne-iso100-10bit.DNG'); a = a - ea.black_level; a = a / (ea.white_level - ea.black_level); median(a(:))
ans =  0.42959
# 1600 * 0.42959 / 0.33647 = 2043





Edit2: further testing to figure out why Danne's picture is brighter reveals a different shutter speed when crop_rec with the "iso 100 10-bit" preset active: rather than 1/100 as dialed in Canon menu, after enabling crop_rec, shutter speed becomes 1/73.31 (as read from the Expo menu or from the DNG metadata). This gives a resulting ISO of 2043 * 73.31 / 100 = 1498, i.e. as expected.

QED, initial hypothesis confirmed.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on November 09, 2018, 05:41:39 PM
Oh, quite so. Same quality more or less. Tested. 10bit a no go. Thanks for pointing out. 10bit could still be useful for lower bitrates with modes not working with anything else than 14bit lossless.

@jimiz
Updated build for 5D3123 in my above post. Not tested so please report how it works.


EDIT:
QuoteEdit: further test reveals the actual ISO is actually *above* 1600. Test files (white level tweaked manually, right before the last histogram peak):
iso1600.DNG
iso100-cmos0-443.DNG
iso100-cmos0-443-adtg-888x-low-iso1500.DNG
danne-iso100-10bit.DNG
Confirmed, slightly above 1600iso comparing your files.
That octave image analysing is really something else.

EDIT 2:
So conclusion is I have been simply rearranging the signal pushing down for instance iso 400 to iso 100(12bit setting)
200 to 100(13bit). Fools gold  8).
Well, now I pragmatically now what´s going on and had a good c code practice...
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: 70MM13 on November 10, 2018, 11:09:20 AM
Ok guys, here's the proof everyone needs...

I used a manual aperture lens and made absolutely sure that both exposures are identical.  This is a serious stress test.

See for yourself.

There's a bit of loss of highlights, but for practical purposes it is negligible.

I've been doing this by hand for all of my videos for the last year, and I am overjoyed to be able to do it so easily now.

Overwhelming thanks to Danne!

And of course to the wizard a1ex!
(https://thumb.ibb.co/gj4bQA/100-gain-dropped.jpg) (https://ibb.co/gj4bQA)

(https://thumb.ibb.co/ii8aJV/100-stock-iso.jpg) (https://ibb.co/ii8aJV)
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on November 10, 2018, 11:24:03 AM
Thanks for sharing. Well, it goes like this. If you shoot at iso 100 then set it to iso 100 with gain drop you could actually then switch again to regular canon iso 200 and it should give you the same result as the one with the gain drop. Just keep the same settings, aperture, shutter(iso 200 will become brighter and classic ettr will take place). So what´s really happening here is that I have set iso hundred but in reality we are shooting iso 200. Conclusion. Fools gold  8).

One sidequestion. I know the question was asked that dual iso could be disabled for previewing purposes when entering 10xzoom mode. How would it work if dualiso previewing could act like HDR showing alternating iso image on display, high low with intervals? When hitting record dualiso should be enabled like before so it would only be a previewing feature. Even showing only base iso could be really useful, maybe even better than alternating isos.
Now that 1x3 recording is possible it´s even more useful with dualiso but previewing is a bit problematic.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: 70MM13 on November 10, 2018, 11:59:49 AM
200 stock ISO, same exposure...

The proof is in practice.
(https://thumb.ibb.co/mawCyV/200-stock-iso.jpg) (https://ibb.co/mawCyV)
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: a1ex on November 10, 2018, 12:03:30 PM
DNG, please.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: 70MM13 on November 10, 2018, 12:31:54 PM
All three tests, zipped DNG.

https://drive.google.com/file/d/17hlqCmZtawshYnzvHpaMCi2zvuDxc6w_/view?usp=drivesdk
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: jimiz on November 10, 2018, 12:37:11 PM
Quote from: Danne on November 09, 2018, 05:41:39 PM

@jimiz
Updated build for 5D3123 in my above post. Not tested so please report how it works.





THANKS I will try!!!  ;)
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: a1ex on November 10, 2018, 01:09:03 PM
Quote from: 70MM13 on November 10, 2018, 12:31:54 PM
All three tests, zipped DNG.

Clip areas:
- 0446: 0.0863% (WL=16381)
- 0447: 0.1373% (WL=9138)
- 0618: 0.1101% (WL=16381)

Pretty sure 0447 was based on ISO 400 or greater, possibly 1600; please compare with these.

Additionally, your clipped area is extremely small. If you use a higher stock ISO, the highlight difference in the final output will be negligible. Please try.

Please consider using a lamp shining into some large flat area (such as a white wall); look at my test scene a few posts above. There, even a tiny change in ISO (e.g. from 1600 to 1500) is noticeable in clip areas, which are pretty large, btw:

iso1600.DNG: 15.34% (WL=16381)
iso100-cmos0-443.DNG: 13.98% (WL=16381)
iso100-cmos0-443-adtg-888x-low.DNG: 13.53% (WL=6040)
danne-iso100-10bit.DNG: 23.39% (WL=2885) [note: different exposure time on this one]

TLDR: please compare with stock ISO 400 and 1600.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: 70MM13 on November 10, 2018, 01:40:24 PM
At these exposures, stock 400 and especially 1600 are just a pile of noise when the shadows are lifted to my liking.

Maybe this isn't for everyone, but it sure works for me!

I'm a happy camper getting excellent results, and the last time I checked, that's what really matters...
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: a1ex on November 10, 2018, 01:45:03 PM
Please post the DNGs.

At these exposures, stock 400 and especially 1600 have much cleaner shadows than stock 100 or 200. Please try them.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: 70MM13 on November 10, 2018, 02:13:28 PM
Stock 400 did surprisingly well, but not as good as Danne 100.

Stock 1600 was unusable when pushed.  Not worth the data...

For me, 100 with clean shadows is heaven :)

Here's the DNG:

https://drive.google.com/file/d/1htZlLLEZTsXqRujzj7SV90sP1GcxzrxC/view?usp=drivesdk
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: a1ex on November 10, 2018, 02:58:37 PM
Please make sure you use the same shutter speed, aperture, scene light and so on. Otherwise, the test is not relevant.

This last file shows 1/1000 exposure time; previous ones were at 1/62.5.

If scene light is no longer the same as in the original test, please capture the entire sequence again, at stock ISO 100, 200, 400, 800 and 1600, and at whatever settings you have used for Danne's ISO 100 (not known to me at the time of writing). Also, please minimize the camera movement (not with subpixel accuracy, but the test images should have the same framing).

Anyway, crop area in the last file is 0.1349%; not sure whether to consider it or not, given the different exposure time.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: 70MM13 on November 10, 2018, 03:21:01 PM
I did a bunch of tests and found that the benefits are primarily for 100, falling off to equal by 400.

I was exposing to the right in the tests, using the bulb as the reference point by eye at 10X zoom, adjusting first by increasing the f stop and then by shutter speed when I hit the aperture limit.

I also don't know what Danne has done "under the hood", and so it may be that the test is invalid for actual ISO comparison.

Until today, I've been doing this by hand with the iso registers using your modules, knowing for example that I'm dropping 200 to 109, my most common setting.

I know exactly how well that works for me in extremely challenging circumstances, and I know that the iso 109 I am using really acts like 109 but with cleaner shadows.

I have to get back to the editor.  Hopefully something good will come from this, I know that I will be using it!
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on November 10, 2018, 03:47:13 PM
Not by my computer atm. If running yesterday build I think stock iso 400 equals to setting iso to 100 in submenu. Leave out 12/10 bit.
If running todays build I am now focusing on getting continuous shooting rather than trying move isos around.
A1ex is right. Lowering analog gains compensating with pushing higher isos will only move base iso etc to another place. Getting cleaner files will need tweaking of other registers. The analog gains however is still a major player when getting continuous to 1x3 modes and modes that doesn't work with regular 10-14bits workflows.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: a1ex on November 10, 2018, 03:48:34 PM
Quote from: 70MM13 on November 10, 2018, 03:21:01 PM
I also don't know what Danne has done "under the hood", and so it may be that the test is invalid for actual ISO comparison.

Analog gain lowered and CMOS[0] overridden for higher ISOs; see his commit.

For example, ISO 100 presets are:
- with his "iso100" option enabled: CMOS[0] as for ISO 200, analog gain 512
- with "iso100" + "12-bit": CMOS[0] as for ISO 400, analog gain 250
- with "iso100" + "10-bit": CMOS[0] as for ISO 1600, analog gain 60

I believe you have use one of the last two presets, just not sure which one.

In my tests, reducing analog gain only improves things by about 0.1 EV.

In other words, I'm pretty sure the results you were getting were 0.1 EV actual improvements, and 1.5 ... 3 stops were misunderstandings (possibly coming from the mislabeled ISO values in crop_rec menu). I wanted to prove it on your own images, but that requires identical test conditions for each setting (which you did not provide).

You made a very strong statement:

Quote from: 70MM13 on November 10, 2018, 11:09:20 AM
Ok guys, here's the proof everyone needs...

yet, you did not provide a valid proof.

Quote from: 70MM13 on November 10, 2018, 01:40:24 PM
I'm a happy camper getting excellent results, and the last time I checked, that's what really matters...

Yet, this particular topic (ISO tweaks) was about getting results *better* than with stock Canon ISOs.

My argument is that, in Danne's build, the improvement is about 0.1 EV over stock Canon ISOs (according to my measurements). In your example, the shadow difference is much stronger than that, but I'm pretty sure that difference is *not* an improvement over stock Canon ISOs (except for that 0.1 EV, which is not going to be noticeable without careful examination).

Quote from: 70MM13 on November 10, 2018, 11:09:20 AM
There's a bit of loss of highlights, but for practical purposes it is negligible.

Pretty sure the loss is about 1.9 EV if you have used the 12-bit "iso100", or 3.9 EV if you have used 10-bit "iso100". Clearly negligible ;)
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: 70MM13 on November 11, 2018, 01:30:53 PM
My statements were not in the right context.  My fault.

I was referring to my experiences with reduced gain by hand, not with Danne's experiment.  I have only used it to take those test shots.  It seemed like it was behaving the same way, which it may indeed, but I was going by my impression of how it behaves the same way under the familiar test conditions.

It may be that on a statistical level, the reduced gain is only marginally better, but in practice, I find it vastly superior.  There's still noise in the shadows, but it's more like film grain, and it is usable when pushed hard.  I can't do the same with stock ISO.

It works for me.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: a1ex on November 11, 2018, 02:01:07 PM
Quote from: 70MM13 on November 11, 2018, 01:30:53 PM
I was referring to my experiences with reduced gain by hand, not with Danne's experiment.  I have only used it to take those test shots.  It seemed like it was behaving the same way [...]

No, it does not.

Besides, your test scene is not ideal for comparing different ISOs, simply because the clipped area is extremely small. On your test image, whether you use ISO 100 or 400, it doesn't make a big difference in highlights (the clipped area was close to 0.1% in both cases). This is exactly why you said:
Quote
There's a bit of loss of highlights, but for practical purposes it is negligible.

Yet, the difference in highlights between these two ISOs is 2 full stops. In your test scene, these two stops are on the tiny light bulb; that's why you found the highlight difference to be negligible. In other scenes, the last 2 stops may cover a very large area of the image.

I'm still asking you to capture a full set of DNG images, with the same exposure time, on your test scene, at the following settings:
- stock ISO 100
- stock ISO 200
- stock ISO 400
- stock ISO 1600
- Danne's ISO 100 (all 3 flavors)
- the preset you use with manual tweaking from iso_regs

I bet you'll have a little surprise at ISO 1600. You'll be tempted to try 3200 and 6400. Not joking.

Caveats:
- enabling both crop_rec and iso_regs at the same time does not work; if you enable both and then disable one of them, it won't work either.
- enabling Danne's crop_rec will alter the shutter speed; to cross-check with iso_regs you may have to use the shutter fine-tuning feature.
  Just make sure shutter speed is set to Original (not Full Range) in crop_rec menu.


Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Levas on November 11, 2018, 02:44:25 PM
Quote from: a1ex on November 11, 2018, 02:01:07 PM
- enabling Danne's crop_rec will alter the shutter speed; to cross-check with iso_regs you may have to use the shutter fine-tuning feature.

I wonder why it messes with the shutter speed and was wondering if it could be the case that if 'full range' option is selected in crop_rec, it messes with shutter time. And could it be that if this option is set to 'original' it won't mess with shutter speed ?

Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on November 11, 2018, 02:56:12 PM
Since there is still some interest in doing tests around my lowering gain builds I reupload them as they were published a few posts back:
https://bitbucket.org/Dannephoto/magic-lantern/downloads/crop_rec_4k_mlv_snd_isogain_1x3_5D3113_presets.zip
https://bitbucket.org/Dannephoto/magic-lantern/downloads/crop_rec_4k_mlv_snd_isogain_1x3_5D3123_presets.zip

Feel free to do the tests suggested by a1ex two posts above but be sure to use the builds above. No time personally atm for testing.

I also uploaded two other versions which works pretty similar but with a few personal rearrangements which are to be considered a work in progress:
https://bitbucket.org/Dannephoto/magic-lantern/downloads/crop_rec_4k_mlv_snd_isogain_1x3_5D3113_presets-ver2.zip
https://bitbucket.org/Dannephoto/magic-lantern/downloads/crop_rec_4k_mlv_snd_isogain_1x3_5D3123_presets-ver2.zip

On a sidenote it would be cool if we now could continue testing pregain etc and see if we could get it rightly done. I have to little experience in this field but got a few hints and pointers here:
https://www.magiclantern.fm/forum/index.php?topic=10111.msg208037#msg208037
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: a1ex on November 11, 2018, 03:17:05 PM
Quote from: Levas on November 11, 2018, 02:44:25 PM
I wonder why it messes with the shutter speed and was wondering if it could be the case that if 'full range' option is selected in crop_rec, it messes with shutter time. And could it be that if this option is set to 'original' it won't mess with shutter speed ?

That's correct. My bad, forgot this setting enabled.

Quote from: Danne on November 11, 2018, 02:56:12 PM
On a sidenote it would be cool if we now could continue testing pregain etc and see if we could get it rightly done.

Keep an eye on the iso-research (https://bitbucket.org/hudson/magic-lantern/commits/branch/iso-research) branch.

My experimental modules (https://builds.magiclantern.fm/modules.html#iso-research) (iso_regs, raw_diag and adtg_gui) are compatible with crop_rec_4k and derived builds (including Danne's build), btw.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on November 14, 2018, 04:26:10 PM
Have been trying to get 1x3 binning mode to work with increased height on the 100D the but have been running out of ideas. No matter how I tweak registers I cannot move above 1736x1188 before I get either corrupted recordings, every other white, the next contains image content or if going higher I get completely white live view image.

Commit here:
https://bitbucket.org/Dannephoto/magic-lantern/commits/a6170f148121d281b9b17a807f264f7afce038d3?at=crop_rec_4k_mlv_snd_isogain_1x3_presets

Now I tried changing around a lot in raw.c. Testing excluding height-- among other stuff but this don´t seem to help.

Is there anything in the timing registers that could be tweaked or did I hit roof at height 1188?
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: nikfreak on November 14, 2018, 04:45:22 PM
Unsure if it could help but you might try to define  timer A+B (https://bitbucket.org/Dannephoto/magic-lantern/src/a6170f148121d281b9b17a807f264f7afce038d3/src/fps-engio.c?at=crop_rec_4k_mlv_snd_isogain_1x3_presets&fileviewer=file-view-default#fps-engio.c-253) to it's orig value. Maybe my customisations interfere somehow.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on November 14, 2018, 05:05:17 PM
Might very well be. SOrry but what are the timer A+B original values?

Tried this but not really helping:
#elif defined(CONFIG_100D)
    #define TG_FREQ_BASE 32000000
    #define FPS_TIMER_A_MIN (fps_timer_a_orig)
    #undef FPS_TIMER_B_MIN
    // no need to cause confusions as recording speed cannot handle such high fps in crop mode
    // (ZOOM || MV1080CROP ? 1288 : 1970)) <-- these are ok while not recording.
    // Hybrid CMOS AF II uses 60fps by default in LV/MV for the camera display
    // to achieve a "snappy" autofocus by doubling the fps
    // MV720 is not LV so we need to extend the definition for the LCD.
    #define FPS_TIMER_B_MIN (fps_timer_b_orig)
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: nikfreak on November 14, 2018, 05:14:08 PM
fps_timer_a_orig
fps_timer_b_orig
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: IDA_ML on November 14, 2018, 05:28:48 PM
Hello all,

I was finally able to borrow a 5D3 for testing the latest very exciting 1x3 recording developments but only for a very short time - I have to return it tomorrow. Nonetheless, I thought, it might help if I provide some feedback on what I was able to test in that short time.

I tested briefly the two 17fps options in Danne's build:

https://bitbucket.org/Dannephoto/magic-lantern/downloads/crop_rec_4k_mlv_snd_isogain_1x3_5D3113_presets-ver2.zip

and all I can say is that this is another break through for Magic Lantern.  I would have never dreamed of shooting at 400/3200 Dual ISO at 1,0 crop factor and get usable results.  Not only are they usable and quite clean, but  also look very natural compared to previous techniques for improving dynamic range which in most cases provided very HDR-ish looking images.  In my opinion, this 1x3 technique, in combination with Dual ISO, provides a radical solution to low-light shooting high-quality FHD video in RAW without or with very little noise in the shadows.  I don't think, too many of the professional cinema cameras can do that.  Congratulations to all of you making this possible!

Also, I greatly appreciate Danne's efforts to provide continuous recording options, even at the expense of reduced frame rate.  There is nothing more annoying than early camera stops in the middle of a shooting.  And I don't think that 17 fps is that much of a problem.  Human eye accepts everything above 12 fps as motion and earlier silent movies were shot at 16 fps.  I shot a wedding film recently that I  filmed at 18 fps and nobody noticed that.  Nowadays we also have quite good optical flow techniques.  Of course, if you do a lot of camera motion, (slider, gimbal, flycam work, etc., requiring fast camera motion) you may end up with some choppy results but there is a solution to that too.  Motion should be slower for 17 fps, compared to 24 fps, and as smooth as possible, so training is required.  If you shoot from a tripod, monopod or even handheld and do not shake the camera too much, results are indistinguishable from 24 fps and the motion blur of moving objects in the scene really looks nice.  So, 17 fps is not necessarily a bad thing!

I didn't have time to test all the options, especially the 10/12-bit ones at different ISOs in the crop menu - this requires a lot of time and very systematic efforts to pixel peep all combinations and select the ones that provide the cleanest results with the highest dynamic range.  I hope that other 5D3 owners will jump in with more test results very soon which will be of great help to the developers.  However, I did test some of the high-resolution crop modes (I use them all the time, especially with the 100D) and am sorry to say that they are all broken in the above build.  The 3k crop mode that I have been successfully using to film the wedding at 3072x1728 resolution and 18 fps does not seem to be working at all.  It does not allow me to set any resolution but stays all the time at 0x0.  The 4k and Full-resolution Live View modes seem to be kind of working but the results are horrible - a lot of aliasing along horizontal and vertical edges, noise and loss of resolution - both, in the normal and Dual ISO modes.  Camera operation in those modes is very unstable either - lots of camera freezes requiring battery pulls. These high-res crop modes used to work very well even in the very early builds from April 2017. 

At this time I would make the following suggestion to A1ex and the other developers:  Please try to implement working 17 fps presets from Danne's build above into one of the experimental 5D3 builds.  Please use the July 4-th build #78 that you can find here:

https://builds.magiclantern.fm/jenkins/view/Experiments/job/crop_rec_4k/

The later ones, including the July 22-nd build, do not seem to be working properly - lots of instabilities.  Once such an experimental build works properly and is stable enough, I am sure many professional 5D3 video shooters will start working with it and will greatly appreciate it.  This is because they will have a very powerful tool in their hands that they will use for a long time in their work.  This is the dream of every video shooter, including me.  I would like to see a build that can provide the following modes:

1) Normal 1,0 crop factor FHD (1920x1080) RAW video with maximum quality and minimum noise that can be used in low-light conditions with Dual ISO.  The 17 fps presets already do that;

2) 3x-crop FHD (1920x1080) RAW video (1:1 mode) that will allow me to quickly change the focal length of my lens from 1 to 3x on a push of a button without changing lenses or using heavy zooms.  A 35/F2 IS lens is perfect for that and I use it all the time switching from 35 to 105mm focal length.

3) A 3k mode that I can use at 3072x1728 resolution and 18 fps for continuous recording (also with Dual ISO).  This one is perfect for capturing scenes with a lot of fine detail (group shots with 50 or more people on them, landscape videography, etc.).  Here is a film of the ancient city of Plovdiv that I made recently and that was filmed in that mode with the #78 build:

https://cloud.mail.ru/public/Grpx/iLK4KHaKi

(To watch it in the highest quality, please download it with the "Скачать" button from the top left of the above link).

4) A Full-resolution Live View mode with up to 5 fps continuous recording for smooth timelapses.

5) The usual 50/60 fps modes

For the beginning, 14-bit lossless compression would be perfect but wherever 13, 12 or 10 bit lossless could be implemented, would be very welcome to reduce file size.

And one final thought. Now that we have all the above functions more or less working and ready to use and we are close to the ultimate quality ML RAW video, in my opinion, future research should be directed towards increasing the interface bandwidth for higher frame rates and/or higher continuous recording resolutions.  This can be done in two ways:

A. Reimplementing card spanning on the 5D3.  I don't know why this extremely useful function was removed;

B. CF-card overclocking in a way similar to SD-card overclocking on the 100D - a God sent function.

It also would be very useful to create similar builds for other camera models such as the 100D, 7D, 650D and others.  The 5D3 is still quite expensive and the majority of ML users, including me, use the other camera models.  We all would love to see a long time awaited update to our cameras too in a way similar to what Bilal did with the 700D already. 

Please let me know what you think about my suggestions.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on November 15, 2018, 03:14:31 PM
Thanks for feedback IDA_ML. I checked and surely a lot of presets were broken. I readded all my presets to the crop_rec.c from crop_rec_4k branch and added it to my branch instead. Seems to work better:
https://bitbucket.org/Dannephoto/magic-lantern/commits/8846065dfd242f82de3942cc3295f5f33225f7e4

Downloads:
https://bitbucket.org/Dannephoto/magic-lantern/downloads/crop_rec_4k_mlv_snd_isogain_1x3_5D3113_presets.zip
https://bitbucket.org/Dannephoto/magic-lantern/downloads/crop_rec_4k_mlv_snd_isogain_1x3_5D3123_presets.zip

In addition to 1x3 presets and isostuff in the submenu following is added:
- Added changes for 1920x1080 48 fps
- Changed following registers:
adtg_new[8]  = (struct adtg_new) {6, 0x8179, nrzi_encode(fps_timer_b - 5) }; /* PowerSaveTiming OFF (5D3/6D/700D) adtg_new[9]  = (struct adtg_new) {6, 0x8197, nrzi_encode(fps_timer_b - 5) }; /* PowerSaveTiming OFF (5D3) */


One very annoying bug is when camera mode is set to mv720p. Zooming will require battery bull when trying to get out of x10 zoom mode after previewing. No idea why it gets stuck. Happens with crop_rec presets.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on November 16, 2018, 01:52:38 PM
In addition to the previous bug I also noticed that "framing" preview isn't working when hdr is set. Anybody can confirm? Known issue a1ex? Really useful working when using 1920x1080p 48fps.
Also uploaded builds which should be more stable shooting with above mentioned setting.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: IDA_ML on November 16, 2018, 04:19:21 PM
Danne,

I now remember one more bug that I noticed when I had the 5D3 in my hands but just forgot to report it in my post #1954 above.  It concerns "Full-resolution LiveView: 5796x3870 at 7.4 fps" which is very useful for shooting  smooth timelapse sequences at low frame rates using the full sensor resolution.  When activated, this mode records just one single frame and then camera stops.   This behavior is observed at any resolution set.  In older builds (those from April, 2017) this Full-resolution LiveView mode was working just fine, providing continuous recording at 5 fps as also stated on the Experimental page.  A fix should be greatly appreciated.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Levas on November 16, 2018, 06:03:58 PM
Now you mention it, I've made a full resolution live view crop preset for 6d.
And it behaves the same as the 5d3, only one frame is recorded.
The 6d has about 250Mb of free buffer, so you would at least expect to fit about 7 uncompressed frames in that buffer ??? (Not sure when lossless kicks in, is that before or after the buffer ?)

Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: norek on November 16, 2018, 08:26:24 PM
Hi Danne,

Can I use, your latest crop_rec.c to eos m if I build your "crop_rec_4k_mlv_snd_isogain_1x3_presets" branch build to eos m?

thank you for Your hard work! :)
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on November 16, 2018, 09:02:05 PM
For eosm it's the same presets as with crop_rec_4k.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: IDA_ML on November 17, 2018, 02:52:41 PM
Danne,

I have been inspecting the files that I shot on the 5D3 with the latest 1x3 crop modes recently and found that now the 5D3 is one BIG step closer to perfection.  The Crop ISO (CISO) settings work so well in providing clean shadows that the results are really amazing.  Here are a few more minor issues that need to be fixed to get the dream 5D3 video shooting build:

1) The 6400 CISO setting still has vertical stripes in the shadows.  If these could be fixed and just the noise is left, this high CISO setting may be a life savior in some really dark situations, especially keeping in mind that Resolve does a pretty good job with noise cleaning.  Please note that the CISOs 3200 and lower settings are perfect already - no vertical stripes at all.

2)  MLVApp does not recognize and report the correct CISO at which the clip was shot.  It reports Dual ISO 100/800 all the tme, regardless of what CISO was used.

I also have a few questions:

I.  We now have the possibility to use the normal FHD MLV RAW video mode with Canon's ISOs and the mv1080p_ mv720p mode with CISO and Canon's ISOs.  What exactly is the difference between these two modes and does one of them provide advantages vs. the other in terms of video quality (fine detail, dynamic range, etc.)?

II.  Do the CISO settings apply to all crop modes in the Crop menu?  Will they clean the Shadows of the high-resolution modes in the same way and strength as they do with the mv1080p_ mv720p mode?

III.  I have noticed that it is possible to activate several CISO settings at the same time - e.g. the 200 and the 1600 setting.  Which one will be applied in this case?  Could these clean CISOs be used to also make Dual ISO with two CISO settings simultaneously active?

IV.  This question is for A1ex and is actually a tool request.  Would it be possible to add an indicator showing how much space is left on the CF card while recording?  In the 1x3 crop modes the 5D3 eats card space for breakfast and you never know when you will run out of card space.

V.  I understand that there are problems with overclocking the CF-card interface.  Would it be possible to overclock the SD-card interface instead?  If it could be overclocked to say 30 MB/s and card spanning could be applied, then the 5D3 would write at a speed of about 150 MB/s and this would significantly increase continuous recording times at the high-resolutions and continuous recording at 24 fps at the 1920x3240 1x3 mode would be possible.

VI.  Danne, could you please provide some more information on how to use the "Shutter range" and the "Advanced options" in the Crop menu?  In what situations should those be used?

Thanks.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on November 17, 2018, 05:42:07 PM
Since my iso experiments was built on faulty assumptions about how analog gain registers and analog iso registers were related I decided to simply erase those code parts in following builds:
https://bitbucket.org/Dannephoto/magic-lantern/downloads/crop_rec_4k_mlv_snd_isogain_1x3_5D3113_presets.zip
https://bitbucket.org/Dannephoto/magic-lantern/downloads/crop_rec_4k_mlv_snd_isogain_1x3_5D3123_presets.zip

What still is valid testing and developing is 1x3 presets together with playing around with analog gain registers creating 10/12 bit. Those two settings can still be found in the sub menu of crop mode.
In a longer perspective iso tweaking is still valid and could be developed further I´m sure. I might dig into this and revive some code parts in crop_rec later on but without mislabeling menu items.

Commit:
https://bitbucket.org/Dannephoto/magic-lantern/commits/4e18649356067e49e15134e432025acdb2b6f0a7
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: jimiz on February 15, 2019, 03:01:55 PM
Quote from: Danne on November 17, 2018, 05:42:07 PM
Since my iso experiments was built on faulty assumptions about how analog gain registers and analog iso registers were related I decided to simply erase those code parts in following builds:
https://bitbucket.org/Dannephoto/magic-lantern/downloads/crop_rec_4k_mlv_snd_isogain_1x3_5D3113_presets.zip
https://bitbucket.org/Dannephoto/magic-lantern/downloads/crop_rec_4k_mlv_snd_isogain_1x3_5D3123_presets.zip

What still is valid testing and developing is 1x3 presets together with playing around with analog gain registers creating 10/12 bit. Those two settings can still be found in the sub menu of crop mode.
In a longer perspective iso tweaking is still valid and could be developed further I´m sure. I might dig into this and revive some code parts in crop_rec later on but without mislabeling menu items.

Commit:
https://bitbucket.org/Dannephoto/magic-lantern/commits/4e18649356067e49e15134e432025acdb2b6f0a7


@Danne

Can you compile crop_rec_4k_mlv_snd_isogain_1x3_presets_2019Feb14  also for 5d3 123 ?

thanks lot !!!
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: jimiz on February 15, 2019, 05:02:54 PM
THANKS!!!   :)
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on May 23, 2019, 03:09:47 PM
Builds and sources now moved to first post:
https://www.magiclantern.fm/forum/index.php?topic=23041.msg208185#msg208185
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on May 23, 2019, 03:23:09 PM
Quote from: timbytheriver on May 23, 2019, 03:01:56 PM
@Danne
modules loaded: crop_rec, mlv_snd, mlv_lite, mlv_play
res: 1920x1080p /14bit lossless (not crop mode)
CF (KB1066x) card seems to be working/saving fine when I revert to a previous 4K_crop-rec Danne build 2/4/19 :)

Still odd...
Try fomatting card in camera (non exfat) reinstall clean build.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on May 23, 2019, 03:24:37 PM
Quote from: andy kh on May 23, 2019, 03:20:07 PM
now it works im not sure what i had done in my first test. now i just clean install and turn on the anarmophic preset in crop rec and no more greenish black preview. i have a very slow 4gb cf card atm. wil test more as soon a i recieved another card
Yes, bleeding edge stuff. Faster card will probably help. I set regs all over the place. A safety press on menu button and thrashcan once in a while to settle all regs won´t hurt too.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: timbytheriver on May 23, 2019, 03:40:39 PM
Quote from: Danne on May 23, 2019, 03:23:09 PM
Try fomatting card in camera (non exfat) reinstall clean build.

Tried this. Get a Canon menu error:

Cannot format
Change card1

Yes, am saving to the CF card (1)

Still getting CARD FULL in top left of ML menu when I press record in any res. My CF card has been faultless til today.

Files into MLV App produce error: 'File header is missing: invalid MLV" or "file length too short Invalid MLV'

Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on May 23, 2019, 03:43:32 PM
Sorry to hear but I suspect this is the reason but I can´t say for sure why it would break your card:
https://www.magiclantern.fm/forum/index.php?topic=19300.msg216884#msg216884

Tried formatting your card to fat32 on computer and then format in camera?
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: timbytheriver on May 23, 2019, 03:44:48 PM
That I copied only the crop_rec.mo file?

I've done that before without issue...

Have I tanked something?
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on May 23, 2019, 03:45:29 PM
Tried formatting your card to fat32 (or fat, can´t remember exactly what it´s called) on computer and then format in camera?
Well, I can´t say what would work or not here. It´s all guesswork atm.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: timbytheriver on May 23, 2019, 03:47:00 PM
Quote from: Danne on May 23, 2019, 03:45:29 PM
Tried formatting your card to fat32 on computer and then format in camera?
Well, I can´t say what would work or not here. It´s all guesswork atm.

Yes! See four posts above. :)
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on May 23, 2019, 03:48:18 PM
Your answer indicates formatiing in camera but not on computer to fat. Do you have another card you can test my build on? If that´s working clearly your card is having an issue.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: timbytheriver on May 23, 2019, 03:49:50 PM
Oh right, sorry. Did you mean FAT32 instead of exFAT? Thought it needed to be exFAT?
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on May 23, 2019, 03:52:20 PM
Oh man, we need @Water Schultz on this one. Find one of his rescue procedures and see if that will work.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: timbytheriver on May 23, 2019, 04:11:30 PM
I'm going to revert to previous build and see if I can get back the status-quo!
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: timbytheriver on May 23, 2019, 04:37:07 PM
Clean format of KB1066x CF card in mac to exFAT
Clean re-install of previous 4K_crop-rec Danne build 2/4/19 on SD card

All seems restored and working – except for one shot which didn't respond to stop button. Restarted camera, shot a few more tests at various res. All import working into MLVApp.

Tried a different Sandisk Extreme CF card with current state – all is well.

Totally weird!  :o But very happy my camera is still alive! :)
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on May 23, 2019, 04:59:37 PM
Quote from: timbytheriver on May 23, 2019, 04:37:07 PM
Clean format of KB1066x CF card in mac to exFAT
Clean re-install of previous 4K_crop-rec Danne build 2/4/19 on SD card

All seems restored and working – except for one shot which didn't respond to stop button. Restarted camera, shot a few more tests at various res. All import working into MLVApp.

Tried a different Sandisk Extreme CF card with current state – all is well.

Totally weird!  :o But very happy my camera is still alive! :)
Still very unclear but I would say nothing is wrong with the ml builds. One thing is for sure. I would never trust that KB card.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: timbytheriver on May 23, 2019, 05:02:53 PM
Quote from: Danne on May 23, 2019, 04:59:37 PM
I would never trust that KB card.

It's been rock solid til now – but today I'm starting to wonder...  :(  I had a Lexar before that which was a pile of poop!
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on May 23, 2019, 05:09:59 PM
Try a windows formatting:
https://www.magiclantern.fm/forum/index.php?topic=5473.msg171046#msg171046
Seems different card readers can affect too. Doesn´t really matter that it worked perfect until today. Suddenly issues starts to happen.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: timbytheriver on May 23, 2019, 05:13:41 PM
Quote from: Danne on May 23, 2019, 05:09:59 PM
Try a windows formatting:

Didn't know that – interesting! Will look into it, but I need a PC!

Does anyone know when formatting on mac whether the eXFAT scheme is crucial? (e.g. GUID, Master Boot Record, APM)
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Walter Schulz on May 24, 2019, 01:10:26 PM
Sorry, haven't much time (and it doesn't look like I can help).
Formatting with ExFAT will enable Exfat on low capacity cards where Canon's firmware denies to apply Exfat within its own format routine. A1ex has a patch for it.
But I'm afraid it will not rectify the situation with given card. I had CFs going south without rhyme or reason. No expertise in flash CPR, sorry.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: andy kh on May 24, 2019, 03:33:10 PM
i can increase fps override til 39fps in full HD without any corrupt/pink frames
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on May 24, 2019, 03:59:19 PM
Hey @andy kh with below mode you can do 45 or 48 fps mv1080p depending on if in 50fps(pal) or 60fps(ntsc) mode.
1080p45/1080p48 3x3

Worked before with 48fps 1920x1080 but reverted back to 1920x1040 because om pink frames.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on May 24, 2019, 06:17:54 PM
Posted two new builds:
https://www.magiclantern.fm/forum/index.php?topic=23041.msg216899#msg216899

Mainly I separated 45/48fps modes into two and they run in either 50 or 60p mode. Upscaled 48fps to 1060p:
(https://i.postimg.cc/zB9rF1w7/VRAM0-PPM-scaled.png)
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: andy kh on May 24, 2019, 07:01:47 PM
@danne  problem wit 45/48fps is the live view. If i set to real time framing is not correct and if i set to framing live view is not in real time so very difficult to shoot a moving object in practical.
If i increase the fps in 1080p mode i get real time preview wit correct framing. There may be a way to increase the fps beyond 40
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: andy kh on May 24, 2019, 07:08:47 PM
Wil try your new builds tomorrow as im away from home atm
And today i get greenish black live view while recording wit your yesterday's build. I was shooting 3.5k.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on May 24, 2019, 08:42:05 PM
@andy kh
Thanks for report. Found the issue and now fixed. New builds posted just now:
https://www.magiclantern.fm/forum/index.php?topic=23041.msg216899#msg216899

Commit:
https://bitbucket.org/Dannephoto/magic-lantern/commits/178845d7d86e8b078a0d1345e05f4e35ee209fb2

Do note that preview will look a bit greenish because of the workaround to get bitdepth reduced with analog gain regs. Shouldn´t be almost black anymore though and image files will look good.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: andy kh on May 25, 2019, 05:28:54 AM
Quote from: Danne on May 24, 2019, 08:42:05 PM
Do note that preview will look a bit greenish because of the workaround to get bitdepth reduced with analog gain regs. Shouldn´t be almost black anymore though and image files will look good.

the live view gets much darker as soon as i hit  the record button making me difficult to shoot outdoor but not completely black anymore
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on May 25, 2019, 06:36:59 AM
Well from now on I expect some deeper feedback and testing. I will check into it myself som more though. I do see some extra greenish stuff happening. WIll look.
MAny of the presets can be run with the ordinary implementation of bitdepth changes so if that´s the case it will solve workaround issues.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: andy kh on May 25, 2019, 06:39:47 AM
Quote from: andy kh on May 24, 2019, 07:01:47 PM
@danne  problem wit 45/48fps is the live view. If i set to real time framing is not correct and if i set to framing live view is not in real time so very difficult to shoot a moving object in practical.

very strange as framing in real time works only in ntsc . i have been testing in pal. today i tried both and found that framing in real timein pal is not correct
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on May 25, 2019, 06:48:45 AM
Are you referring to 45/48 fps presets? They are not gonna show the correct full mv1080p real time live view. They will behave the same both in pal and ntsc so don´t know what you are getting. Please film your screen or do more tests and explain further in detail.
Real time limitations known already since building the preset being in mv720p mode will yield faster fps.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: andy kh on May 25, 2019, 07:00:38 AM
now i understand
i tried in 60p and i get 1920 by 800 whereass in pal i get 1920 by 818 so in 60p the bottom is crop by 18
and its very near to what i see in real time
now i can get exact framing in any mode by goin to reg_skip_botton and increase the number by 350
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on May 25, 2019, 08:32:39 AM
Well increasing reg_skip_bottom also removes resolution.

Uploaded two new builds. Fixed some testing stuff I forgot to erase which affected mv720p modes.
Trying to fight the greenish tint but the regs I use for this on eosm and 100D is not very effective on 5D3. Will take a deeper look into this when I can.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on June 16, 2019, 04:41:40 PM
New uploads for the 5DIII:
https://www.magiclantern.fm/forum/index.php?topic=23041.msg216899#msg216899

- Fixed a bug when recording 50/60fps
- Better handling mv720p mode 45/48 fps when going in and out of x10 zom mode
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: jimiz on June 16, 2019, 10:12:52 PM
Quote from: Danne on June 16, 2019, 04:41:40 PM
New uploads for the 5DIII:
https://www.magiclantern.fm/forum/index.php?topic=23041.msg216899#msg216899

- Fixed a bug when recording 50/60fps
- Better handling mv720p mode 45/48 fps when going in and out of x10 zom mode


simply THANKS Danne!!!   ;)
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on June 16, 2019, 11:36:34 PM
You´re welcome.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: domasa on June 17, 2019, 10:44:45 AM
Is it already possible to use magic zoom in full screen mode on 5D2 ?
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on June 17, 2019, 12:13:46 PM
Ask in a thread specific to 5D2.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: andy kh on June 20, 2019, 08:08:34 AM
just install this new build and tried shooting some slomo video. working fantastic so far.
thank q so much for this new build danne
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on June 20, 2019, 08:19:11 AM
Hey man. Thanks for reporting bugs and such.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: andy kh on June 20, 2019, 06:50:42 PM
i stil cant shoot in 50fps with your latest build. 60fps is fine. i have been shooting 60fps for the last couple of hours without issue. just tried 50fps this evening and i get some error which is very strange. if i restart the camera canon setting jumps to ntsc from pal. i tried setting to pal again and shoot at 50fps and whenever i get this error i try restarting and jumps to ntsc

http://ibb.co/ygDJBJt
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on June 20, 2019, 07:34:08 PM
New uploads for the 5DIII:
https://www.magiclantern.fm/forum/index.php?topic=23041.msg216899#msg216899

- Minor change. Maybe it affects 50fps mode positively. Can´t test, no cam here.

Changing between PAL and NTSC is like you describe sometimes not really changing and goes back on restart. Because of this I want to separate 45/48, 50/60 fps to independent presets. This means they can be run in either ntsc or pal as long as camera is set to mv720p. 45/48 is already like this but havn´t had the time for the other two.

Anyway. When I tested myself before it seemed to work. Are you using 5D3.1.1.3? Maybe reinstall?

If people are testing please take alook at 50/60 fps mode and report back if working or not.

About your screenshot it´s related to compression handling in mlv_lite.c. Something is affecting it so it correctly reports files are getting corruption issues.

And as always. Changing presets also likes pushing canon menu button to settle regs...
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: andy kh on June 20, 2019, 08:53:12 PM
Quote from: Danne on June 20, 2019, 07:34:08 PM
New uploads for the 5DIII:
https://www.magiclantern.fm/forum/index.php?topic=23041.msg216899#msg216899
stil the same problem. sometimes it works fine. the problems occurs after recording 3/4 times

Quote from: Danne on June 20, 2019, 07:34:08 PM
About your screenshot it´s related to compression handling in mlv_lite.c. Something is affecting it so it correctly reports files are getting corruption issues.
i get som corrupted pink frames

i dont understand why there is no such problem with your 2nd Apr build!!i have been using it for so many days and i havnt found any problem so far
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on June 20, 2019, 08:55:39 PM
2nd april from my branch/builds?
What firmware used 1.1.3 or 1.2.3?
Could you share exact settings?
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: andy kh on June 20, 2019, 09:02:56 PM
yeah 2nd Apr if i remember from your branch/build. it works perfect
im on 1.1.3
my settings are
pal in canon menu
720p@50fps
activate crop mode 1920 50/60 3X3
edit : i set to 1920X818 spect ratio 2.35:1
14bit lossless
real time
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on June 20, 2019, 09:24:51 PM
Could you test this version of mlv_lite together with the latest build?
https://bitbucket.org/Dannephoto/magic-lantern/downloads/mlv_lite.mo

mlv_lite from 2nd april. Want to know if it´s related to something in there or in crop_rec.c.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: andy kh on June 20, 2019, 09:41:02 PM
no it doesnt work
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on June 20, 2019, 09:56:36 PM
Doesn´t work at all or work and gives compression errors? I need my camera I believe...
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: andy kh on June 21, 2019, 09:42:55 AM
Quote from: Danne on June 20, 2019, 09:56:36 PM
Doesn´t work at all or work and gives compression errors? I need my camera I believe...
gives compression errors.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: muanthang on June 22, 2019, 12:12:00 PM
Quote from: Danne on May 24, 2019, 06:17:54 PM
Posted two new builds:
https://www.magiclantern.fm/forum/index.php?topic=23041.msg216899#msg216899

Mainly I separated 45/48fps modes into two and they run in either 50 or 60p mode. Upscaled 48fps to 1060p:
(https://i.postimg.cc/zB9rF1w7/VRAM0-PPM-scaled.png)
New build anamorphic  test in5Diii 123. Thank you
https://youtu.be/7GMRgAuH5uQ
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on June 27, 2019, 10:14:59 PM
New uploads for the 5DIII:
https://www.magiclantern.fm/forum/index.php?topic=23041.msg216899#msg216899

- Separated 50p and 60p into two separate presets same as 45p and 48p. Means they will work both in PAL or NTSC mv720p. Also modified numbers some. Seems more resistent from compression errors in 50p mode now

Commit:
https://bitbucket.org/Dannephoto/magic-lantern/commits/e6f87460df08f511b2f3790bdaa49a62d8f2623e

Thanks to andy kh for reports.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Quentin on June 29, 2019, 11:07:39 AM
Awesome!

Is it possible to have these presets (45/48/50/60 FPS) in 1920 1:1 ?
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on June 29, 2019, 11:31:54 AM
Might be. I could have a look in implementing the x3crop in Crop mode sub menu similar to how it's done for eosm.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on June 29, 2019, 04:33:17 PM
Quote from: Quentin on June 29, 2019, 11:07:39 AM
Awesome!

Is it possible to have these presets (45/48/50/60 FPS) in 1920 1:1 ?
mv720p mode and x3zoom seems restricted to reduced height like what you get when in mentioned 1920 1:1 mode. I have a hard time figuring out a1ex pack modes on cmos regs but maybe once those numbers are "decrypted" we can revert to some more obvious numbers and start constructing more freely.

EDIT: Nudged cmos1 and some other regs and seems I´m on to something. Stay tuned. I post when I gt something working.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on June 29, 2019, 06:55:48 PM
New uploads for the 5DIII:
https://www.magiclantern.fm/forum/index.php?topic=23041.msg216899#msg216899

Commit:
https://bitbucket.org/Dannephoto/magic-lantern/commits/ddd1c56678d2601be04091bb6fe8b08a63dfb838

Key are these two regs combined or resolution looks like sheit:
                adtg_new[3] = (struct adtg_new) {6, 0x8000, 5 + reg_8000};
                adtg_new[17] = (struct adtg_new) {2, 0x8806, 0x6088};
   

- x3crop now works with higher frame rates 45/48/50/60 fps. Simply be in one of the mentioned presets in mv720p and then select x3crop from within Crop mode sub menu:

(https://i.postimg.cc/TwR53Yq8/VRAM0-PPM-500px.png)
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Quentin on June 29, 2019, 07:00:31 PM
 :P
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: andy kh on June 30, 2019, 09:12:48 PM
done a quick test so far so good
great job danne
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on July 01, 2019, 10:24:52 PM
New uploads for the 5DIII:
https://www.magiclantern.fm/forum/index.php?topic=23041.msg216899#msg216899

- x3crop toggle working for 45/48/50/60 fps modes. Function same as for eosm here:
https://www.magiclantern.fm/forum/index.php?topic=9741.msg218141#msg218141
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: fresco on July 03, 2019, 06:51:39 PM
Hi Danne, just to say thank you for the work you do (and all FM devs of course), I've got a 5dmkIII and last week I needed 720p footage at 48FPS, so I've just overwritten my previous ML 113(experimental, the 4K raw video recording 22-7-18) and the 2 hours shooting (not continuous) went all great!!
I'm going to update in the next days as long as you go on coding...
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Dmytro_ua on July 07, 2019, 12:49:35 PM
Quote from: Danne on May 23, 2019, 03:09:47 PM

- Refined anamorphic presets so it now gives continuous:
1808x2300(2:35.1) = 5425 x 2300

https://bitbucket.org/Dannephoto/magic-lantern/downloads/crop_rec_4k_mlv_snd_isogain_1x3_presets_2019Jul02.5D3113.zip

Wow, this one is awesome! Works without problems.

Hope, sometimes we'll have a realtime liveview to have a possibility to shoot moving objects, not only static frames from tripod.

Thanks for your job!!
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on July 07, 2019, 02:29:16 PM
Yes, 5D3 can produce some heavy resolutions.
There's real time preview by the way. If in framing mode press halfshutter for cropped real time preview.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Dmytro_ua on July 07, 2019, 02:51:36 PM
Quote from: Danne on July 07, 2019, 02:29:16 PM
There's real time preview by the way. If in framing mode press halfshutter for cropped real time preview.

Yes, I understand what you mean, but what is a real purpose for such a preview? The proportions aren't correct, we can only see a massively stretched top part of an image.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on July 07, 2019, 02:55:59 PM
Part of the workaround technique. Framing is done from real buffer very slow and focusing can be done while holding halfshutter while recording. Then back into framing again. In and out. I can work with that and capture pretty much anything I want.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: muanthang on July 07, 2019, 06:06:31 PM
Quote from: Dmytro_ua on July 07, 2019, 02:51:36 PM
Yes, I understand what you mean, but what is a real purpose for such a preview? The proportions aren't correct, we can only see a massively stretched top part of an image.
Danne, for me  continuous recording  in  anamorphic 1600X2332< 16:9! :) :) :)  another way round to  preview  framing before recording  is   press hold the AF Lock button (the  lens  should  be  in AF  Mode)Cheers...
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on July 07, 2019, 06:08:25 PM
Yes. That should work just fine but not really 16:9 when upsampled in post :).
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Quentin on July 08, 2019, 04:31:40 AM
I am not certain if it is possible, to drop resolution for a higher FPS.
For instance 1280x720 @ 96FPS
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Dmytro_ua on July 16, 2019, 03:37:57 PM
Is it possible to enable proxy recording from 1920 3x3 preset?
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on July 16, 2019, 04:26:49 PM
What exact preset are you referring to?
When using proxy recording function also make sure you are selecting 2nd card(SD) in canon menu. This way proxy goes to sd and raw to CF.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Dmytro_ua on July 16, 2019, 07:37:00 PM
I've tried your latest build with 2:35.1 10bit lossless 25fps (i've got 1720x2200 px).
When I enable proxy - it's stretched and cropped. I understand, that it's somehow made from 1x3 proportions, that's why it's not usable. So, I assume, aren't these two processes independent (MLV and proxy)? Can't we somehow use nice proxies from Alex's build 1920 (3x3) with your 1x3 raw 1720x2200 px?
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on July 16, 2019, 07:40:16 PM
Na, that would mean a corrected liveview output parallell to shooting raw. The holy graal if you so like ;)
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Dmytro_ua on July 26, 2019, 11:36:01 AM
Hi, Danne!

I'm sorry, maybe it was mentioned before, but I cannot find an information about what your lua script exactly do? I mean step-by-step
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on July 26, 2019, 11:44:57 AM
Why not test it? It sets optimised settings for anamorpic 2.39:1 recordings.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Dmytro_ua on July 26, 2019, 12:39:12 PM
Quote from: Danne on July 26, 2019, 11:44:57 AM
Why not test it? It sets optimised settings for anamorpic 2.39:1 recordings.

I did try. But I shoot mostly with 2.35:1, so I want to be sure, if I change 2.39 to 2.35, I won't mess anything else.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on July 26, 2019, 12:54:24 PM
No. That's fine. Once you run the script you are free to change anything after.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Dmytro_ua on July 26, 2019, 06:28:48 PM
Quote from: Danne on July 26, 2019, 12:54:24 PM
Once you run the script you are free to change anything after.

So, what the script is actually doing? Can I do the same manually from ML menu?
I'm just curious, it would be nice to read some description of it. But if you're busy, don't bother ;)
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on July 26, 2019, 06:34:49 PM
Yes, manually. It's only a helper script to get going. Originally created eosm on mind.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: ibrahim on August 07, 2019, 10:03:18 AM
Anyone knows how to record continuous at 14-bit lossless at 1440p 24fps? I get pinky/black preview on my LCD screen.

These are my selected settings:
Global draw: liveview
fps override: 24 fps
crop mode: 4K 1:1 and x3crop set

RAW video:
2656x1494
16:9
14-bit lossless
preview: realtime
croprec preview: auto mode
kill global draw on
sound on at 48khz

Any tips on what I am doing wrong?
Using build 2019-07-20 on 5d mark III firm.123
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: ibrahim on August 07, 2019, 10:27:03 AM
Quote from: ibrahim on August 07, 2019, 10:03:18 AM
Anyone knows how to record continuous at 14-bit lossless at 1440p 24fps? I get pinky/black preview on my LCD screen.

These are my selected settings:
Global draw: liveview
fps override set at 24 fps
crop mode: 4K 1:1 and x3crop set

RAW video:
2656x1494
16:9
14-bit lossless
preview: realtime
croprec preview: auto mode
kill global draw on
sound on at 48khz

Any tips on what I am doing wrong?
Using build 2019-07-20 on 5d mark III firm.123
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: ibrahim on August 09, 2019, 04:07:03 PM
With a slight modification of the aspect ratio (1:2 in raw menu and 2.35 in crop rec menu) and resolution to 1808x2300 in 14-bit lossless of the cinema lua script I managed to get automatically the following in MLVapp:

5424x2300

Just to make sure I have understood this script correctly. Does this signify that the streching by 3-fold 1808x2300 to 5424x2300 does not result in any loss of pixels? Meaning that pixels had been squeezed and then streched back making this true genuine 4k footage?
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: ibrahim on September 26, 2019, 12:31:03 PM
I've used the cinema lua script using an external monitor. The issue I am having is to see the lower end of my footage. I know that there is a stretching going on vertically, which is why I cannot see the lower end of the filmed footage. Is there a way to say shrink the entire frame so that the lower end can be seen? Any other solution?
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Dmytro_ua on October 15, 2019, 06:26:03 PM
1. iso climb: in menu it is mentioned INFO(5D3), but it does nothing
2. x3crop toggle (halfshutter press (5d3)) in Press down or Set mode:   x10crop not compatible with x3toggle    - but i'm not in x10crop
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: DeafEyeJedi on October 15, 2019, 06:34:17 PM
Quote from: Dmytro_ua on October 15, 2019, 06:26:03 PM
There is a misprint for iso climb: in menu it is mentioned INFO(5D3), but it does nothing

Is this related to the 2019July20 or 2019Oct13 build from @Danne's bitbucket download page?
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Dmytro_ua on October 15, 2019, 06:55:03 PM
2019Oct13.5D3113.zip
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on October 15, 2019, 07:13:55 PM
New builds 5D3:
https://www.magiclantern.fm/forum/index.php?topic=23041.msg216899#msg216899

- Removed a few features due to lack of time bughunting
Removed: x3 crop toggle, iso climb.
All good stuff still in there so shouldn´t make any difference.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: GullRaDriel on October 16, 2019, 09:54:28 AM
Thanks a lot for all the good job you're doing.

I'm testing a lot of your builds, and this one will be tested tonight. I'll be putting a review.

Danne, if you need me to test something special feel free to ask. As I'm a developer too I'll try to clone and build your version myself.

Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on October 16, 2019, 10:14:45 AM
Ok, sounds good. General tests of the presets please go ahead. Not all sub menu items will work here and I am not up to date with this branch atm since I put all focus lately into the eos m. If you and others can find bugs and start working on fixes just go ahead. I will help out with pointers etc.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: GullRaDriel on October 17, 2019, 04:13:44 PM
I've just tried to compile on debian testing, the classic unified branch for 5DM123.

I had to comment out the include module_strings, because the file is not present and it gives a compilation error.

Make zip made me a zip, I do not yet have a working qemu to test it, it'll come soon !
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: GullRaDriel on October 18, 2019, 02:56:26 PM
Edit:
Everything is working so far, with your branch build on my debian.

I don't get how I can correctly fork your branch and see it on bitbucket. We'll see what to do on that.
Title: Danne's crop_rec_4k & ISO experiments
Post by: ozcancelik on October 19, 2019, 12:52:36 AM
Quote from: Danne on July 07, 2019, 02:55:59 PM
Part of the workaround technique. Framing is done from real buffer very slow and focusing can be done while holding halfshutter while recording. Then back into framing again. In and out. I can work with that and capture pretty much anything I want.

I tried  2019Oct15.5D3113 and 2019Oct15.5D3113. This feature is very very useful but sometimes(mostly) does not work for me. When it works and after pressing half shutter, it backs streched view again.

When I run your Lua script, everythings are fine and recording is ok. Low fps and laggy preview but at least not streched, framing is good. (I can get 5424x2270 24fps 10bit/12bit continuous)

(https://i.ibb.co/Y8bpTcH/cropped.png)


When pressing half shutter for focusing:

(https://i.ibb.co/vHmvBLT/streched.png)

And it stucks there. I can't see correct framed version again. Sometimes works 1-2 times, then streched view again. Also freezing camera when change aspect ratio on crop_rec menu.

Am I doing something wrong?
Thanks.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: ozcancelik on October 19, 2019, 12:56:19 AM
.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on October 19, 2019, 01:31:52 AM
I don´t know if you have x10 focus aid enabled. Try disabling that if it´s the case.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: ozcancelik on October 19, 2019, 09:32:25 AM
Quote from: Danne on October 19, 2019, 01:31:52 AM
I don´t know if you have x10 focus aid enabled. Try disabling that if it´s the case.
Tried both on and off. Nothing changed. But for now i use zoom button 2 times then focusing. Not best solution and very slow, but works.[emoji3]

May I ask, do you use 123 or 113?
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on October 19, 2019, 10:23:29 AM
Screen recordings preferred that shows your issues. Too much guesswork.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: ozcancelik on October 19, 2019, 06:08:27 PM
Quote from: Danne on October 19, 2019, 10:23:29 AM
Screen recordings preferred that shows your issues. Too much guesswork.
There is a video that i record. I hope it helps.
https://drive.google.com/open?id=1t4SrL51Cvcn_pFS0AusOpHd_CL3QuE15

Also my settings:
(https://i.ibb.co/XtzkcJh/danne-crop-rec-settings.jpg)

I guess I'm missing something to do. :)
Thank you very much for your interest.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on October 19, 2019, 07:42:44 PM
All is working over here. Just tested. Did you set Preview to framing? You find this under RAW video menu settings.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: ozcancelik on October 19, 2019, 08:59:59 PM
Quote from: Danne on October 19, 2019, 07:42:44 PM
All is working over here. Just tested. Did you set Preview to framing? You find this under RAW video menu settings.

Yes its Framing.

(https://i.ibb.co/RDqbHM3/DF514-BF2-ED51-4-DE0-99-CC-0173-F6-BB26-A8.jpg)
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on October 19, 2019, 09:08:52 PM
Hard to say what is going on but keep testing different settings. Maybe you find the answer eventually. I'm on 1.1.3 by the way.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: ozcancelik on October 20, 2019, 02:39:59 PM
Quote from: Danne on October 19, 2019, 09:08:52 PM
Hard to say what is going on but keep testing different settings. Maybe you find the answer eventually. I'm on 1.1.3 by the way.

I guess i found the problem. It's about adtg_ui module. I disabled the module and everything works expected.

Does this module use any code with your crop_rec? I tested and looks fine. Just want to know.

Thanks again Danne!
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on October 20, 2019, 05:32:57 PM
Ah, yes. It will interfere with framing. Good catch. I should remove this module as it´s only needed for when looking for registry nad development.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: DeafEyeJedi on October 20, 2019, 06:01:00 PM
Quote from: Danne on October 20, 2019, 05:32:57 PM
Ah, yes. It will interfere with framing. Good catch. I should remove this module as it´s only needed for when looking for registry nad development.
Or just leave it disable when installing. Enable when needed for troubleshoot and tests.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: gravitatemediagroup on October 26, 2019, 04:46:47 AM
nothing warms my heart more than seeing progression here
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: timbytheriver on October 26, 2019, 06:28:25 PM
@Danne

Thanks for new build 'crop_rec_4k_mlv_snd_isogain_1x3_presets_2019Oct15.5D3113.zip'

If I use with iso_regs.mo ON I get strange behaviour of liveview: e.g. in Anamorphic 1360x2300, the liveview image changes its centre point and becomes squished up. Turning iso_regs OFF and restart resets the liveview to normal behaviour.

Is iso_regs not designed to work with crop_rec.mo now?

Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on October 26, 2019, 06:33:40 PM
Both adtg_gui and, also seemingly, iso_reg module, will affect outcome in some way. Have no idea why so feel free to take a look if you have the time.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: timbytheriver on October 26, 2019, 06:46:22 PM
@Danne Righto. Thanks. Maybe something's changed, as previous versions seemed to play nicely with iso_regs.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on October 26, 2019, 07:29:09 PM
If so, try to narrow down the build where it starts to break.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: timbytheriver on October 27, 2019, 01:30:04 PM
@Danne

Reverted to an older build to try and trace errors with iso_regs. Have only got a backup of crop_rec_4k_mlv_snd_isogain_1x3_presets_2019Apr02.5D3113.zip which on my camera is buggy with compression errors. Errors go when I update to most recent – but then whenever iso_regs is enabled the crop_rec previews are all messed up.

Trying to find more recent builds from July19 (which were working well on my camera) on your downloads but can't find them. Have you taken them down? 

Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on October 27, 2019, 02:13:24 PM
I can't keep every build. I'd prefer users to take time to compile on their own so I guess if this issue is important enough to fix you simply learn to compile. No priority over here. Need to focus on other things. Good luck.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: timbytheriver on October 27, 2019, 02:23:29 PM
Ok. I hear you. Thanks!
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: timbytheriver on October 28, 2019, 11:50:07 AM
@Danne I'm going to try to have a go and jump into ML dev.  :o I've installed via your compiler.app as per here https://www.magiclantern.fm/forum/index.php?topic=21882.0

The example given at 7) is for 17 EOSM.202

Could you give me some pointers how I'd change this to recompile your earlier Jul22 4K_crop_rec build for 5D3113 ?

Thanks!

PS I have managed to compile today's build, but am stuck on how to find an earlier build!
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on October 28, 2019, 12:50:53 PM
Good. I didn't include jumping around in source tree in any easy way with compiler.app so it needs to be done in terminal. You can also work from atlassian source tree gui. In there you can see commits and doubleclick back in time.
Sorry, not a lot of time lately...
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: timbytheriver on October 28, 2019, 01:02:49 PM
Quote from: Danne on October 28, 2019, 12:50:53 PM
You can also work from atlassian source tree gui. In there you can see commits and doubleclick back in time...
Thanks!

Lots of stuff I don't understand there! I know you're time-poor at moment so could anyone else point out how I work in the source tree gui to compile a specific build?

Thanks

***UPDATE***
I've searched back to find the commit for Jul22 and have managed to download a zip of this by doing https://bitbucket.org/Dannephoto/magic-lantern/get/f0e391b.zip

Now I have this folder, I need to compile it into the final zip... How do I do this?
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Dmytro_ua on October 28, 2019, 02:15:02 PM
I've got Danne's  "crop_rec_4k_mlv_snd_isogain_1x3_presets_2019Jul20.5D3113" build. If you need it I can upload it somewhere.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: timbytheriver on October 28, 2019, 03:04:53 PM
Quote from: DeafEyeJedi on February 26, 2019, 07:56:53 AM



@DeadEyeJedi I have got my install working to the same level as seen in this video now. What I'd like to know is how to compile a build from an earlier commit date in Danne's repo. Do you or anyone else know how?  :o

Cheers all!
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on October 28, 2019, 06:09:03 PM
If you downloaded and got into the correct branch you can still compile from compiler.app after you select a new historical commit. I advice to use Source tree:
(https://i.postimg.cc/TPgQQ0hY/Screenshot-2019-10-28-at-18-05-11-png-scaled.png)
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: timbytheriver on October 28, 2019, 07:16:38 PM
@Danne

Thanks. I have sourcetree installed now.

I'm doing: Open > Remote > Clone a repository > https://bitbucket.org/Dannephoto/magic-lantern > Destination: /Users/me/magic-lantern

From here I don't know how to select the historical commit or compile. Any pointers?

Thanks.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: GullRaDriel on October 28, 2019, 10:39:20 PM
hg update [name of the branch you want to switch on, without the braces]

make clean

make zip

It can complain about module_strings.h missing. On debian testing as I don't know very much yet about it, I commented the include and got it to compile.

I take pointers if any.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: timbytheriver on October 29, 2019, 09:51:55 AM
Hmm. Thanks, but that just gets me the current files.

In sourcetree:

1) I have cloned the branch to my local repo
2) Found the commit point (rev 19200) from which I want to compile
3) Image shows my options:

https://drive.google.com/file/d/1vLiEctKach9jIPcELzfzMGcjtdMwTJtx/view?usp=sharing

I think what I want is 'checkout' but I don't see that option – and I don't want to break the internet by pressing the wrong button!  :o

I'm also not sure when I switch from Sourcetree app to Danne's Compiler.app to do the compiling.

Any help gladly received. Thanks.

Tim
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on October 29, 2019, 09:57:24 AM
1 - In compiler.app source tree needs to be here:
crop_rec_4k_mlv_snd_isogain_1x3_presets

2 - On top of Source tree gui in your picture where it says "All branches" also select crop_rec_4k_mlv_snd_isogain_1x3_presets

3 - Double click backwards on any commit back in time and source will get updated into the past revisions

4 - Go back into compiler.app and compile
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: timbytheriver on October 29, 2019, 10:16:30 AM
Thanks @Danne  :)

When I double clicked on the commit point the message said: 'Switching working copy' (Hope this is correct)

Then I compiled with compiler.app

The resultant compiled zip is labelled with today's date rather than the date of the commit. e.g. crop_rec_4k_mlv_snd_isogain_1x3_presets_2019Oct29.5D3113.zip

Is this correct?

Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Quentin on October 29, 2019, 12:58:20 PM
Quote from: Danne on June 16, 2019, 04:41:40 PM
New uploads for the 5DIII:
https://www.magiclantern.fm/forum/index.php?topic=23041.msg216899#msg216899

- Fixed a bug when recording 50/60fps
- Better handling mv720p mode 45/48 fps when going in and out of x10 zom mode

Is X3 back, compatible with 50/60 ?
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on October 29, 2019, 01:42:37 PM
Yes, I included x3zoom for these modes. Don´t remember how to reach them. Look in the Crop rec submenu if not present as a static preset menu item.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Stousen on November 30, 2019, 11:32:23 AM
Hi Danne and everyone involved, been following a lot of your work , especially with the eos M. And i thank you all so much for it. Workinh wonders.
I just bought myself a used mark iii. And tried the anamorphic mode, its awesome and the noise is so much cleaner in low light. And image quality superb. Love it. So happy, thanks guys.

I have one question about the anamorphic build, using the latest, on a 1.2.3 firmware.
I tried to understand the problem by reading this thread all over twice but i might not fully understand. When i use the anamorphic mode , the liveview halfshutter x10 works great, and zooms into the center of the image. But the ordinary liveview is focused on a different area, the upper part of the frame, so i cant really know exactly where the middle point of my shot is. Is this a thing that can be changed or is it "common" knowledge to use the method of combininh halfshutter back and forth to know where center point rly is?

Hope it makes sense

Kind regards
S
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on November 30, 2019, 07:41:15 PM
There's certainly room for improvements. Check out 2blackbar managing to find center spot for anamorphic mode on the eosm. Same should be doable for the 5diii.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on December 07, 2019, 10:38:21 PM
New builds:
https://www.magiclantern.fm/forum/index.php?topic=23041.msg216899#msg216899

Added my tlapse scripts originally built for the eosm here:
https://www.magiclantern.fm/forum/index.php?topic=9741.msg223238;topicseen#msg223238
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: DeafEyeJedi on December 08, 2019, 08:01:42 PM
Who needs Christmas or Santa when we all have @Danne's never-ending magic compiling upon on us every now and then.

Let's all make it snow for once and y'all get your hands dirty on these tests builds and please do report your findings.

Including myself. Especially on the 100D since this so-called DSLR definitely needs some love again. EOSM is just scary good!

Thank YOU for annihilating Santa as always w your charming talents annually, @Danne!  :)
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on December 11, 2019, 10:47:40 AM
New builds:
https://www.magiclantern.fm/forum/index.php?topic=23041.msg216899#msg216899

- Added centered regs for UHD 1:1 preset(Thanks to Ilia3101 who tweaked these)
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Dmytro_ua on December 11, 2019, 10:52:53 AM
Wow! Is there a chance your anamorphic to be centered or it has nothing common with this?

(https://bitbucket.org/Dmytro_Kn/ml/downloads/cine.jpg)
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on December 11, 2019, 11:15:50 AM
Yes, it should be fixed too. No time atm, maybe Ilia3101 could jump in here  :P
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on December 11, 2019, 04:05:27 PM
Quote from: Dmytro_ua on December 11, 2019, 10:52:53 AM
Wow! Is there a chance your anamorphic to be centered or it has nothing common with this?

(https://bitbucket.org/Dmytro_Kn/ml/downloads/cine.jpg)

New version:
https://www.magiclantern.fm/forum/index.php?topic=23041.msg216899#msg216899

- Rearranged cmos1 and seems more centered now for anamorphic modes. Needs testing.

Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: timbytheriver on December 11, 2019, 05:22:31 PM
Testing:

Anamorphic mode has a single horiz 1px(?) white line at base.
If you come out of crop mode, LiveView shows only half the screen.

Or it could just be me...  ???
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on December 11, 2019, 08:05:13 PM
Thanks for testing. I uploaded two new builds. Hopefully fixed now. Please test anamorphic again.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Dmytro_ua on December 11, 2019, 09:36:05 PM
Quote from: Danne on December 11, 2019, 08:05:13 PM
Hopefully fixed now. Please test anamorphic again.

I have a green picture and a wrong information on top.

Here is a regular picture:
(https://bitbucket.org/Dmytro_Kn/ml/downloads/IMG_6330.jpg)

Here is a 1920 preset:
(https://bitbucket.org/Dmytro_Kn/ml/downloads/IMG_6330-1920.jpg)

Here is anamorphic preset:
(https://bitbucket.org/Dmytro_Kn/ml/downloads/IMG_6330-anam.jpg)

(https://bitbucket.org/Dmytro_Kn/ml/downloads/IMG_6330off.jpg)
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on December 11, 2019, 09:40:15 PM
1920 preset? I only changed for anamorphic mode. Did you push menu button and back? Fps set to 24 in canon menu?
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Dmytro_ua on December 11, 2019, 09:44:08 PM
Quote from: Danne on December 11, 2019, 09:40:15 PM
1920 preset? I only changed for anamorphic mode. Did you push menu button and back? Fps set to 24 in canon menu?

1920 preset - is just for comparison.
I've just found - green picture in anamorphic with problem on top appears when Set 25 fps is ON.
It's ok when Set 25 fps is OFF
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on December 11, 2019, 10:18:23 PM
Ok, I'll take a look tomorrow.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Stousen on December 11, 2019, 10:38:48 PM
Wow! It got fixed by Danne :-* I shall try it out tomorrow aswell! Superb work man..

Cheers
Chris
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on December 12, 2019, 08:40:54 AM
New version:
https://www.magiclantern.fm/forum/index.php?topic=23041.msg216899#msg216899

- Slightly different centering for set_25fps but at least it works now. (Anamorphic mode)
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: timbytheriver on December 12, 2019, 11:28:50 AM
@Danne Both UHD and Anam are now good here! Preview fixed. :) Thanks plenty!
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on December 12, 2019, 04:30:47 PM
Ported iso average,frame burst and frame stop functions to 5D3. New uploads, usual place.
On eosm iso average goes like this:
https://www.magiclantern.fm/forum/index.php?topic=9741.msg222737#msg222737

Uploads:
https://www.magiclantern.fm/forum/index.php?topic=23041.msg216899#msg216899
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Stousen on December 12, 2019, 08:52:10 PM
Hey Danne Great work, Cheers, I should try the iso average etc asap. :)
About the centered liveview, It doesn't seem to be centered to me yet. (I don't think my account has the permission to upload images so I can't really show you.)
But to explain in words - When I zoom in 10x to center, it shows another center then what is showing in Live View. The center is further up than the actual center.
Have anyone else got other results?

//Chris
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on December 12, 2019, 09:03:10 PM
Centre while recording better. Also if holding down halfshutter. X10 zoom follows its own protocol.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on December 20, 2019, 12:24:52 AM
New version:
https://www.magiclantern.fm/forum/index.php?topic=23041.msg216899#msg216899

- Ported frame burst refinements same as on eosm here:
https://www.magiclantern.fm/forum/index.php?topic=9741.msg223648#msg223648




Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: garry23 on December 21, 2019, 09:59:06 PM
@Danne

Started playing around with your latest 5D3 build, with the frame stop feature, but this build is clearly different to the experimental download version that runs.

First, my script doesn't run, but that is not the issue.

I set an exposure of 0.8s.

I have expo sim and override on.

I switch on crop FLV.

I switch on RAW video.

I switch FPS on and to 1 fps.

But, unlike with the experimental build, I don't get a LV image and more critically the shutter switches to 1/33.

Not looking for help/answer, just giving update at the moment.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on December 21, 2019, 11:48:34 PM
I get full range shutter when set so cannot reproduce what you are doing.
Anyway. Would help if you narrow down what works first then focus the bad new at the bottom of the list. Meaning. Is frame burst acting like it should when not moving fps override and such? Then give specifics of what happens when fps override is on. Do you turn off audio by the way? FLV do not like audio on etc.

Are we testing frame burst?:
https://www.magiclantern.fm/forum/index.php?topic=9741.msg223648#msg223648

Also check here:
https://www.magiclantern.fm/forum/index.php?topic=9741.msg223238#msg223238

Also, if you are not getting a liveview image I doubt you are in framing mode. So I would say there´s a lot more to exercise around movie modes here.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: garry23 on December 22, 2019, 09:22:45 AM
@Danne

It's a mystery  ;)

I've switched back and forth between the Experimental build and your frame burst one.

The experimental one works as expected, ie when I switch from LV to Movie mode the shutter stays at the correct shutter, eg 0.8s if I'm using a 1 FPS.

When I load yours it switches the shutter to 1/33 when I switch from LV to Movie mode.

As I say, I use the same settings for each build.

As I say, a mystery: but I'll keep playing around.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on December 22, 2019, 09:36:11 AM
Hm, I'l have a look later today. I might have messed some with a1ex fps values in crop_rec at some point. Didn't work this branch for a while.
Can you give feedback on the frame burst function itself. Tlapse script as well?
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: garry23 on December 22, 2019, 10:12:15 AM
Frame stopping working great: looking forward to trying that in my script, once I get the shutter fixed.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on December 22, 2019, 10:28:15 AM
I try it here and all works. I need to push canon menu buttons once in a a while and at one time I restarted camera since framing wasn't working but it works. I choose Full-res LiveView then Shutter range to Full range,  FPS override set to Desired fps 1. Then I push canon menu twice and when coming back shutter is fullres 0.8. Disable sound and start recording. Works perfectly...
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: garry23 on December 22, 2019, 10:43:50 AM
BTW where do you disable sound?
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: garry23 on December 22, 2019, 10:54:18 AM
Got it!!!!!!!!!  :)

Quotethen Shutter range to Full range
This was the problem!

Shutter OK, but still can't see mage in LV, even after Menu pushes, ie black/purple diagonal lines fill the image.

I'll carry on playing around.

Thanks for your support.

BTW rather strangely the File Manager viewing of MLVs doesn't seem to work with your build, I get an "Allocation Failed" message. Not a priority for me.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on December 22, 2019, 11:05:22 AM
Did you select framing under RAW video? If still not working simply restart.
What's working or not can't be determined by one preset selected tests. Please try other presets with file manager as well. Still trouble? Maybe you were lucky on the other build?
Edit: also note that adtg_gui should never be enabled if not in use. It kills framing for instance.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: garry23 on December 22, 2019, 10:31:51 PM
UPDATE 29-Dec-2019

See https://www.magiclantern.fm/forum/index.php?topic=24663.msg223841#msg223841

@Danne

Have spent most of the day switching between your build and the experimental page version.

I have assured myself that the settings are the same each time, eg shutter at 0.8s and an FPS of 1.

With the experimental build I can always see a stable LV image in movie mode.

In your version I mostly see a solid black & purple image. No amount of switching the menu on and off fixes this. Occasionally the image from the non Movie LV mode transfers to move mode, but freezes.

The perfect world for me would be the experimental build with your framing feature   ;)

But then again, we don't live in a perfect world  :)
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on December 22, 2019, 10:44:07 PM
I see. I would need your SETTINGS folder or a printscreen showing your settings in RAW video menu and in Movie tab to be able to see what's going on. Too many variables will go wrong otherwise. It works here, what can I say.
Edit: also what modules do you have enabled?
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: GullRaDriel on December 29, 2019, 07:04:48 PM
Thanks Danne for the hard work.

I updated my repos and it just built fine.

More testings tomorrow, have good end of year :-)
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on December 29, 2019, 07:13:20 PM
Yes. Lots of changes. Rearranged menus and modules enabled from start and a few other things...
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: koopg on December 30, 2019, 09:51:05 PM
just download an tested crop_rec_4k_mlv_snd_isogain_1x3_presets_2019Dec30.5D3123.zip
5d mark 3
version 1.2.3

I am really impressed.

my 'C' days are over long ago, (I do python as a qa automation developer)
I never was a videographer, only stills.
my English should get better
and when reading here I can understand one every two sentences
so please forgive me in advanced

the only issue
experimentals and your build from April (I belive) as well gave me an option to set live view and when pressing '*' I could frame my shot
it worked on all profiles. however on this build when pressed I get a x10 zoom which will not go away after release, and if I pressed many times on '*'
and the 'zoom' button It went away but image is broken, ML menue will not open an nothing else is working until restart

thank you so much for this it's all really  amazing that I don't really care if this would be fixed
5k raw video from 5d3, and continueas, and live view ! what else it would shoot rockets to space :)


amazing! !!!!!!!

few questions. . .

what is 'crop rec preview'  should it be on?
why in video menu it say '12 bit' and raw video menue say '14 bit'?
what is 'shutter range' I never sew this. logic tells me variable fps but didn't we had this all ready  ?
what iso is optimal?

and last I do not own anamorphic lenses, I shot my doter using the anamorphic 5k and let mlvapp do its own streaching magic
I don't see distortion and the frames look AMAZING, do I need an eye doctor ?
is it disorted in a way I don't see it ?
what am I missing ? 



Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on December 30, 2019, 10:29:39 PM
- Set focus aid to OFF for * button and halfshutter working normal way

- Keep 14bit lossless in RAW vide menu. As a workaround you can add 10 or 12 bit in the Movie tab menu for longer recording times. It actually lower analog gain acting 10 or 12bit

- Crop rec preview set to auto mode will select either framing or real time preview but automated depending on what preset chosen. Turn it off if you wish to work manually between presets.

- Yes, anamorphic is a pixelated stretch(I call it anamorphic) but without the need for any anamorphic lenses. You already noticed that Mlv App fixes the upscaling in post just fine. And yes, it´s good.

- Iso climb. Enable i and move joystick up or down for iso control, even while filming

- Shutter range. As it says ORIGINAL will set canon shutter. Full range will allow for much lower shutter speeds. Works with FPS override down to around 0.5s shutter
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: garry23 on December 30, 2019, 11:45:01 PM
@Danne

Quote- Set focus aid to OFF for * button and halfshutter working normal way

When I try this on the 5D3, the halfshutter works normally, but * does nothing, ie no zoom.

Is it me...again ::)
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on December 30, 2019, 11:55:15 PM
zoom? You mean focus? Check your manual. Think it should look like this(except the pinks  :P:
(https://i.postimg.cc/x8V4PpBF/VRAM0-PPM-300px.png)
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: garry23 on December 31, 2019, 12:13:21 AM
No I meant zoom.

With that feature enabled the image zoom in to x10, I guess, when I do a half shutter press. If I disable that feature, the half shutter returns to normal, but the * doesn't 'zoom in', like the half shutter did. 

Are you saying it shouldn't zoom in, just do an AF?
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on December 31, 2019, 12:20:03 AM
Either x10 zoom enabled or the rewired button disabled and then it´s back to canon settings for both halfshutter and ae button.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: koopg on December 31, 2019, 10:06:29 PM
I meant something else. not focus and not zoom.
in the experimental buildm my preview was realtime and when press+Hold '*' I get framing preview .
the change you suggested does help with the x10 but not bringing back old method. maybe it was a settings I did some how and don't remember how.
but I can totally live without it.

I made a few more test, and everything work like charm.

this build is the best new year  gift :)
Happy new year

Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on December 31, 2019, 11:04:37 PM
It should enter framing when pushing halfshutter and set to real time. Will take a look tomorrow. What preset are you using by the way?
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: GullRaDriel on January 01, 2020, 02:40:05 PM
Everything is working fine so far here.

The crop rec integration is more intuitive this way.

There are a few modes that says preview broken, is it fixable ? What's the cause of it ?

Happy new year BTW
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: garry23 on January 01, 2020, 03:55:35 PM
@Danne

At the risk of annoying you, a quick thought on the focus aid.

Currently, when on pressing * will do a x10 zoom, which stays on until you do a half shutter press.

Doing a half shutter press brings up the x10 zoom, while the half shutter is pressed.

The 'problem' with this approach is that, if one uses the half shutter in a script, as I do, you can't also use the focus aid.

One way round this is if your focus aid only used the * button and that it also toggled the x10 on and off. Thus freeing up the half shutter.

Just a thought and Happy New Year to you.

Cheers

Garry
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on January 01, 2020, 04:00:53 PM
* button comes with haflshutter button for good or worse. The other way around is tricky. I assume yoù know a way to assign the ae(*) button cause I don't.
Cheers
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: garry23 on January 01, 2020, 04:34:42 PM
 Ok
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: timbytheriver on January 02, 2020, 12:10:49 PM
Hi!

Just cloned your crop_rec_4k_mlv_snd_isogain_1x3_presets_2020Jan01 repo and tried to add my iso-regs code into it.

Think maybe I've done something wrong as the new 'Presets' tab is there – but when I try and select it, it doesn't activate. :(

Can you see something I've done wrong? Maybe I need to add things in different places now...  :o


Ignore pls!

For some reason my crop_rec.mo wasn't compiling at all... Compiled separately and it works now.  Sorry...  :-[

Cheers!
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: timbytheriver on January 02, 2020, 02:07:12 PM
Cool menu edit + new toys... Thanks! :)

Notice that with Sound recording = ON, the camera start/stop beeps don't sound. Turning Sound recording = OFF brings them back. Is this expected behaviour?


Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on January 02, 2020, 02:16:39 PM
There's a reason for most things in here ;).
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: timbytheriver on January 09, 2020, 04:41:35 PM
Got these errors every other couple of shots today with latest build:

Live display; text in red:

'fatal no buffers'

then a few seconds later

'audio failed to stop. read state 3'

only a 3kb file is saved with no content.

Pressing menu then allows a proper recording, but the whole cycle repeats again.

I was recording in 3K as usual, with NO audio, so that's odd!

Anyone replicate this error?

Thanks.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on January 09, 2020, 04:55:43 PM
Tell me exact settings, preset, etc. Preferrably do screenshots or a screenrecording to be sure not to miss anything.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: timbytheriver on January 09, 2020, 05:08:57 PM
(https://i.ibb.co/nP8VwwJ/IMG-3322.png) (https://ibb.co/MB5jgg0)
(https://i.ibb.co/m8b8cwC/IMG-3323.png) (https://ibb.co/DpzpRyD)

These are the error screens, but I noticed that Sound recording was enabled – my bad. However, I was running raw_diag.mo. I disabled that module and it seems to be ok again. Never seen that error before!  :o Good to know!

Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on January 09, 2020, 05:34:35 PM
How are you running raw_diag module?
Next time reporting issues tell build, set up, enabled modules etc. Tiring with most, not all, 'test reports'  just thrown out there without even basic info.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: timbytheriver on January 09, 2020, 06:08:11 PM
QuoteHow are you running raw_diag module?

Just by loading and enabling the module. I only really use it for the raw info readout window.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on January 09, 2020, 06:13:33 PM
Yes, but that indicates you are running older builds. In later build you would see that enabling modules is not there. So, build info is vital.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: timbytheriver on January 09, 2020, 08:55:05 PM
I cloned your repo at commit #5a6f55b 2019‑12‑31 and compiled locally.

I can see that you have now enabled modules by default and that the modules tab doesn't display. But if you add other 'extra' modules in – as I did with a1ex's raw_diag.mo – the module tab then appears and can be accessed to enable these extra modules – but the rest of the modules still remain 'invisible'.

So I don't think it is an 'older build'. ?
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on January 09, 2020, 09:18:05 PM
Oh, that´s nice. Didn´t know it worked. Jip-Hop worked out the module automation routines. Nice find.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on January 10, 2020, 11:00:00 AM
Added mlv capabilities as for eosm here:
https://www.magiclantern.fm/forum/index.php?topic=9741.msg224216#msg224216

EDIT: Buggy. Took out the mlv_play fix for now. Needs more testing...

EDIT: Reuploaded. Hopefully bug fixed. Needs testing
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Stousen on January 12, 2020, 06:24:38 PM
The anamorphic mode is superb, so much less noise in low light situations.

Right bow i have the slow framing preview and a live preview on atomos shinobi working.
Tho the framing is correct on the canon camera its a bit off on the external monitor. I wonder if its possible to arrange it so that i can get the center position on my external monitor aswell?

//Chris
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: ilia3101 on January 15, 2020, 04:00:02 PM
@Danne do you know why the 5D3 can only record 14 bit with compression in UHD preset?

Could 12/10 bit be added? Or is this something not easy? (I can go in to the code again if needed)
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on January 15, 2020, 04:18:17 PM
It could probably be added but I don't know how to do it the "right" way. There are comments about reducing bits in mlv_lite.c.

But, meanwhile it should work with my bitdepth workaround by keeping 14bit lossless in RAW video menu and selecting 10 or 12 bit from Movie tab menu. Should do more or less the same.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: ilia3101 on January 15, 2020, 04:33:47 PM
Ah ok, this is available with the new "eos m" layout? I will try it out.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on January 15, 2020, 04:59:38 PM
Yes, works, just tested.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: ilia3101 on January 15, 2020, 09:24:36 PM
Nice! I will try it very soon. (once I empty my card)

Is this only possible with the recent layout update?
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on January 15, 2020, 09:29:15 PM
Can´t remember. I know I added my bitdepth workaround not so long ago to the uhd so that might very well be true. But it´s better to use the latest as I did a lot of cleanup as well so nu reason to stay on the older version.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: ilia3101 on January 15, 2020, 09:35:30 PM
I think it's true then, I remember I just couldn't find any way to change bitdepth in the previous build.

I will use the latest of course, I have always done so with magic lantern :)
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on January 15, 2020, 09:46:34 PM
Quote from: Ilia3101 on January 15, 2020, 09:35:30 PM
I think it's true then, I remember I just couldn't find any way to change bitdepth in the previous build.

I will use the latest of course, I have always done so with magic lantern :)
Strange. Should have been in the sub menu. Anyway. It´s in Movie tab menu now so can´t be missed in the latest version. Just make sure that it´s set to 14bitlossless in RAW video menu:
https://www.magiclantern.fm/forum/index.php?topic=23041.msg216899#msg216899
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: ilia3101 on January 16, 2020, 01:27:23 AM
Ah I didn't even think it could have been in crop_rec! Spent an entire holiday choosing between 4 second recording times and 20fps :D

Also why are the modules gone in the new build? How does it all work? How do you load a module? Do you think this is the future of magic lantern layout? It feels a whole lot less modular to me :(
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on January 16, 2020, 06:55:31 AM
Future, modular? I rearranged and modified to be able to just start the camera and get on using it. It's just another open source project.
Code is there so you can build your own tweaks if there's something you're missing but since you didn't even find the crop mode sub menu in the last build at least enjoy the oppurtunity to lower the bitdepths again ;).
It's not like the modules are gone. They are simply autoenabled. Is there a module you're missing?
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: ilia3101 on January 16, 2020, 06:43:02 PM
Quote from: Danne on January 16, 2020, 06:55:31 AM
Future, modular? I rearranged and modified to be able to just start the camera and get on using it. It's just another open source project.

Well your branch is clearly the most advanced and bug free right now, so it is the future. When referring to 'future' I meant: would a1ex want to merge all of these changes back in to the main source tree? I imagine the user interface changes (module aspect) are a bit too drastic (for exmaple some users don't want any video features), but the internal code changes are of course great.

Quote from: Danne on January 16, 2020, 06:55:31 AM
I rearranged and modified to be able to just start the camera and get on using it. It's just another open source project.

It is great and very usable, I really like the new video tab. I just want to know which modules are enabvled by default now... (and to get module screen back if I can change your mind ;))

I remember on my 5D2, loading the smallest amount of modules would increase recording times. I just think it's best to let users disable whatever modules they want, but I am not against having some modules load by default like you have done.

Quote from: Danne on January 16, 2020, 06:55:31 AM
Code is there so you can build your own tweaks if there's something you're missing but since you didn't even find the crop mode sub menu in the last build at least enjoy the oppurtunity to lower the bitdepths again ;).

Yes thanks :D

Quote from: Danne on January 16, 2020, 06:55:31 AM
It's not like the modules are gone. They are simply autoenabled. Is there a module you're missing?

Nothing I'm missing, but I want to see what's enabled and disable what I don't need. I just think it's better for module screen to stay, what if someone wants to write a new module, it's useful for them to toggle it on and off easily.

I only want to suggest improvements, sorry if anything I say sounded rude.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on January 16, 2020, 08:07:25 PM
Nothing rude at all. I just answered :). I welcome feedback.

These modules are default:
mlv_lite \
mlv_play \
mlv_snd \
dual_iso \
silent \
lua \
crop_rec \
file_man \
ettr \

You can add any additional module by simply putting it in the module folder on your card and it should appear the normal way.
You can also look for this line in module.c in src folder:
char *core_modules[] = {"mlv_lite", "crop_rec", "mlv_play", "mlv_snd", "sd_uhs", "lua", "file_man", "dual_iso", "silent"};
And erase:
char *core_modules[] = {};
Or erase all code related to core_modules and it should be back to normal. Didn´t dig in to hard on this. It´s mostly Jip-Hops code parts in this case and works really well.

About bugs I created a couple of pull requests. All the rest is small quirk fixes here and there, nothing big really. A1ex also developed a refined crop_rec code for the 700D which might be the new standard in the future. Who can tell really?
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: ilia3101 on January 17, 2020, 11:22:31 AM
Ah good to know where that array is.

Also do you knokw why mlv_rec.mo stops working with crop rec enabled? I would be interested in trying to fix that (unless it's a really huge task), as I want to try card spanning.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on January 17, 2020, 11:33:49 AM
No idea really.
By the way. You should port card spanning to mlv_lite ;)
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: timbytheriver on January 17, 2020, 12:26:18 PM
Quote from: Danne on January 17, 2020, 11:33:49 AM
By the way. You should port card spanning to mlv_lite ;)
+1 :)

I'm looking into this as well! I see the code in sd_uhs.c for enabling it in 5D3 (untested), but I assume additional code has to be ported into mlv_lite.

In which module does the code that needs to be ported live now?

Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: ilia3101 on January 17, 2020, 12:58:35 PM
Quote from: Danne on January 17, 2020, 11:33:49 AM
No idea really.

😢

Quote from: Danne on January 17, 2020, 11:33:49 AM
By the way. You should port card spanning to mlv_lite ;)

I like the sound of this too. I just looked at mlv_rec.c, and it seems not too complicated (an extra thread and loads of if statements).

But I need to gain some understanding of magic lantern code first. It's not as simple as c library and pthreads :'(

What branch would be the best starting point for this modification? Unified, crop_rec_4k or something else?
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on January 17, 2020, 01:07:42 PM
I would work in this branch directly. I see no reason no too. I ported global draw off a while ago. Not as hard as card spanning though but as you say. Not impossible to understand but It's a bit over my head.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: ilia3101 on January 17, 2020, 09:45:48 PM
Quote from: Danne on January 17, 2020, 01:07:42 PM
I would work in this branch directly. I see no reason no too.
Yeah ok. I cloned crop_rec_4k_mlv_snd_isogain_1x3_presets, this is the main one right now?

Quote from: Danne on January 17, 2020, 01:07:42 PM
I ported global draw off a while ago. Not as hard as card spanning though but as you say. Not impossible to understand but It's a bit over my head.
I am not sure where to start really. I see in mlv_lite theres loads of "NO_THREAD_SAFETY_ANALYSIS" which is a tiny bit concerning. Currently trying to compare how both modules do writing, it seems to be making a little bit of sense, but there's no clear comments like "this line writes the frame", so it's a bit difficult.

Are the FIO_* functions used for writing actual big frame data? Or are they just for headers? I can't tell what they are doing... just 'jobs' according to variable names.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: gravitatemediagroup on January 18, 2020, 03:14:00 AM
has anyone else experienced blacked out playback as if something went wrong with recording, but when loaded into MLVApp the image is there?  I've been noticing this the past few builds, I've tested and changed various settings/resolutions to see if I had accidently turned something off, but every shot comes back blank.  The liveview before shooting is there, just no playback.

sorry if this has been discussed already, i'm short on time so I just jumped to the end of the thread to ask. :) 
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on January 18, 2020, 05:04:21 AM
More information needed.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: ilia3101 on January 18, 2020, 01:24:31 PM
@Danne how often do you update mlv_lite.c? I hope we do not make changes at the same time that will be difficult to merge.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on January 18, 2020, 01:45:52 PM
I only do minor changes. Did a small change today. Just keep on with your stuff. WHen ready I can merge it into mine branch.
By the way, where´s the branch you are working on?
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: ilia3101 on January 18, 2020, 02:37:05 PM
I hg cloned crop_rec_4k_mlv_snd_isogain_1x3_presets yesterday - and am editing mlv_lite.c in there. Same branch as you?
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on January 18, 2020, 03:05:59 PM
Yes, same. Could you link your repo so I can follow?
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: ilia3101 on January 18, 2020, 03:17:48 PM
Hmm I don't have it on bitbucket, I just typed "hg clone https://bitbucket.org/Dannephoto/magic-lantern -b crop_rec_4k_mlv_snd_isogain_1x3_presets" and started making changes. Should I make a branch of my own to my bitbucket account? How do I do that?

So far, I have been saving versions by copying the file, not through commits because I don't know how to use mercurial, however I can put those versions in to commits once I get the mercurial stuff set up properly.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: ilia3101 on January 18, 2020, 04:08:58 PM
I'm guessing maximum number of chunks of an MLV is 101? as you can have only one .MLV, and 100x of .M00-.M99
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: ilia3101 on January 18, 2020, 07:06:40 PM
It's actually really difficult to adapt mlv_lite for spanning. I will try again with a different approach, it's a bit of a mess this first attempt, I just tried to copy most of the way mlv_rec does it.

In mlv_rec writing loop is so much simpler, here it is tangled in to everything, so it's difficult to have two running at the same time. I wish we could have mlv_rec working with crop_rec.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on January 18, 2020, 07:16:02 PM
Hm, keeping mlv rec is hard to justify. No lossless recording if I recall correctly? Only reason to hold on to it would be if both lossless and card spanning were working but ultimately if you manage to get it working on mlv_lite personally I would think it's the better way.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: ilia3101 on January 18, 2020, 07:22:13 PM
Quote from: Danne on January 18, 2020, 07:16:02 PM
Hm, keeping mlv rec is hard to justify. No lossless recording if I recall correctly? Only reason to hold on to it would be if both lossless and card spanning were working but ultimately if you manage to get it working on mlv_lite personally I would think it's the better way.

I am trying again on mlv_lite, this time without copying how mlv_rec does it, as it's just too different.

Also I didn't realise mlv_rec didn't have compression, I always thought it was the more "advanced one" :D That's what I felt from using the 5D2 anyway :D But I guess I was wrong :-\

I think one advantage to mlv_rec is that it writes EXPO blocks for each exposure adjustment during recording, while mlv_lite does not, is that correct? Or is this also outdated information?
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on January 18, 2020, 07:44:24 PM
Yeah, mlv_lite is stripped for maximizing speed. Originally dmilligan started out building this module.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Stousen on January 18, 2020, 09:47:31 PM
Hi, I love the anamorphic mode, and i do not mind that it is squeezed in live view, and its perfect to be able to frame The desqueezed view before recording.
But i have one question that i rly havent found clearity to yet.
Even tho the live view is squeezed, is it possible to move the center position so that it matches the center better?

I made a video including external monitor to show what i mean.
It would be very very useful, (atleast for me;) ) if it was possible to match the squeezed views center point to the live view center point. In laymen terms, move the image up;)

https://vimeo.com/385713397/4aed6ecab1

Is this complicated / goes much deeper than what I may think?

Thanks!

Kind regards
//Chris
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: ilia3101 on January 18, 2020, 10:23:22 PM
I am almost done with card spanning, I have a very simple solution. just need to sort out one final thing: sharing the "slots" thing between two threads. Need to figure out what it is (I think it's a queue) and how it works, then how to share it. Going to leave this for tommorow.

Quote from: Danne on January 18, 2020, 07:44:24 PM
Yeah, mlv_lite is stripped for maximizing speed. Originally dmilligan started out building this module.

So it would be nice to get mlv_rec working again and add compression support ;)
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on January 18, 2020, 10:29:01 PM
Hehe, well. Who knows what tomorrow brings. Nice to hear about your progress on card spanning!
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: garry23 on January 19, 2020, 07:03:12 AM
I thought some of you videographers :) ;) may be interested to know that this 4mm fisheye lens us now available in an m mount, and it's cheap as chips.

https://www.venuslens.net/product/laowa-4mm-f-2-8-mft/
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: ilia3101 on January 19, 2020, 11:00:19 PM
Should I add another struct semaphore * for protecting the slots array / writing queue when accessing it from two threads? Or should I extend the use of settings_sem to protect that?

BTW I am not adding any of this "guarded by" stuff to anything I add, as I don't know how to use it correctly. But as I understand that only affects static analysis, not running the code.

Also why does the code sometimes use '0' instead of NULL for pointers?
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: ilia3101 on January 20, 2020, 12:00:53 AM
Ok nevermind about all that for now. First I need to understand how write_frames works...

Could anyone who knows explain: why it is only called once for multiple slots? it only gets the pointer from the first slot as the ptr argument, yet somehow writes all of the slots to the card?

And as far as I can tell a "slot" is an MLV block waiting to be written, which can be a frame or any other type - correct?
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: names_are_hard on January 20, 2020, 04:02:11 AM
Quote from: ilia3101 on January 19, 2020, 11:00:19 PM
Also why does the code sometimes use '0' instead of NULL for pointers?

NULL and 0 have the same value.  But, NULL implies pointer.  So many people think you should use NULL if it's a pointer, because it lets other people know they're dealing with a pointer.  I agree with this but it's basically a style choice.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: ilia3101 on January 20, 2020, 01:36:25 PM
Quote from: ilia3101 on January 20, 2020, 12:00:53 AM
Could anyone who knows explain: why it is only called once for multiple slots? it only gets the pointer from the first slot as the ptr argument, yet somehow writes all of the slots to the card?

Ok firgured this one out, all the blocks are actually in a single continuous block of memory behind the scenes, somehow. Therefore the pointer to the first block is actually a pointer to all the blocks needing to be written.

I guess this must roll over back to the beginning of the buffer when it reaches the end, but where is the code for detecting the roll over?

I think can make spanning work now I kinda understand what's going on.

These are just notes for myself, but I'm writing here so anyone who knows better can correct me.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: a1ex on January 20, 2020, 04:48:54 PM
Indeed, your understanding is correct, so far. Most of these things are not related to Danne's changes; mlv_lite has the same quirks in the main repository (so, the discussion here is probably off-topic).

Anyway - mlv_lite is pretty much the codebase from the original raw_rec (i.e. most of that is my code, updated by dmilligan to support the MLV format at the same recording speeds as the original raw_rec implementation, if not a bit faster (https://www.magiclantern.fm/forum/index.php?topic=17091.0)). Long before that, mlv_rec was written by g3gg0 in an attempt to completely replace raw_rec; unfortunately, it was a little slower, and its menus and internals were a bit too complex for my taste, so... we ended up maintaining both. Not ideal, I know. It would make sense to merge both modules somehow, keeping both the raw recording speed and the features, if possible.

Regarding 'loads of "NO_THREAD_SAFETY_ANALYSIS"' - there are only two, that I could find, and that's because the static analysis (https://www.magiclantern.fm/forum/index.php?topic=18907) does not handle cli/sei correctly. I don't see this as a reason to be concerned - on the contrary. But I cannot guarantee 100% correctness either - maybe rewriting some parts of ML in Rust could help with that. No, I don't know Rust, besides trying to run Hello World some years ago, but it seems to be something worth learning.

About what things are executing - there are our own DryOS tasks, more or less straighforward to understand, and there are hooks placed at various locations in Canon firmware (usually in their DryOS tasks). The most interesting one here is the VSYNC hook, aka "EvfReadOutDone" on recent models (i.e. triggered once after capturing every single LiveView frame, in Canon's Evf/LiveView task, which runs with very high priority). That's where each frame is processed, and the next slot is chosen (ideally continuing the previous memory chunk, as it's a lot faster to write several megabytes at once).

However, what exactly happens within each LiveView frame was only recently understood (https://www.magiclantern.fm/forum/index.php?topic=19300.msg207723#msg207723), and only to a very limited extent.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: ilia3101 on January 21, 2020, 02:45:13 PM
Thanks for the response a1ex

True it is a bit off topic, but the goal is adding card spanning which is on topic I think.

Is the reason for mlv_rec being slower that it writes one frame at a time? It would be nice to merge them. Would unified be the best starting point for this kind of change? Also about mlv_rec not loading in crop_rec_4k, is that a difficult fix?

Quote from: a1ex on January 20, 2020, 04:48:54 PM
Regarding 'loads of "NO_THREAD_SAFETY_ANALYSIS"' - there are only two, that I could find, and that's because the static analysis (https://www.magiclantern.fm/forum/index.php?topic=18907) does not handle cli/sei correctly. I don't see this as a reason to be concerned - on the contrary. But I cannot guarantee 100% correctness either - maybe rewriting some parts of ML in Rust could help with that. No, I don't know Rust, besides trying to run Hello World some years ago, but it seems to be something worth learning.

Hm rust, can it even be compiled to run on these cameras? Might it use any dynamic memory allocation behind the scenes?

Quote from: a1ex on February 05, 2017, 02:12:43 AM
Therefore, if a function is called from more than one task, it must be thread-safe.

This is a good way to think about it, will keep in mind.

Quote from: a1ex on January 20, 2020, 04:48:54 PM
About what things are executing - there are our own DryOS tasks, more or less straighforward to understand, and there are hooks placed at various locations in Canon firmware (usually in their DryOS tasks). The most interesting one here is the VSYNC hook, aka "EvfReadOutDone" on recent models (i.e. triggered once after capturing every single LiveView frame, in Canon's Evf/LiveView task, which runs with very high priority). That's where each frame is processed, and the next slot is chosen (ideally continuing the previous memory chunk, as it's a lot faster to write several megabytes at once).

However, what exactly happens within each LiveView frame was only recently understood (https://www.magiclantern.fm/forum/index.php?topic=19300.msg207723#msg207723), and only to a very limited extent.

Interesting to know. So the VSYNC hook is how ML redirects the image data to it's own memory?

And back to implementing spanning in mlv_lite:

My simplest (most threadsafe) idea was: the main thread will split each write in to an SD and a CF card part, then tell the SD card thread what to write (memory pointer and number of bytes). The splitting should be a 1:5 ratio, or learnt as the recording goes on. But this is not very good as it will make smaller chunks be written each time, and if the SD card has a hiccup, the main thread will be waiting for it to finish, and the other way round, the SD card would not be fully utilised. And if there is not enough frames in the queue, it can't be split very well.

I want to figure out a better way to share the queue between two threads. Do you think that is possible?

Haven't really made sense of the whole writing loop yet, so I can't tell.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on January 21, 2020, 03:17:05 PM
Mlv_rec works here. Only tested with eosm and with that particular branch. I thnk mlv_rec works with 5d3 too. At least with a1ex crop_rec_4k branch.
With that said only thing personally missed in mlv_lite is card spanning :)
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: ilia3101 on January 21, 2020, 03:23:30 PM
oh it does? not with crop_rec.mo enabled though?
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on January 21, 2020, 03:34:18 PM
Crop_rec works with eosm.
A bit off topic but it needs certain other modules enabled to work I guess. I'm sure it can be solved with a little trial and error. But let's fix card spanning on mlv_lite first ;)
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: ilia3101 on January 21, 2020, 04:01:15 PM
Quote from: Danne on January 21, 2020, 03:34:18 PM
But let's fix card spanning on mlv_lite first ;)

Sure :)
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: ilia3101 on January 22, 2020, 04:08:38 PM
I think this line:

        writing_queue_head = after_last_grouped;


should be moved to before the frame(s) start being written, so that when the other thread starts looking for frames, it will get unwritten ones.

Or will moving this line affect whatever process is actually putting the frames in to the buffer? In that case, I can add an extra version of this variable for the write threads, updated at the start, and leave the original one for the process actually inserting frames, updated at the end as before (will need some care when both threads are updating it)

I also think the SD card thread should only write one frame at a time, otherwise it will be wasting time and memory, especially when the buffer starts getting full.

This is my current best idea for spanning.


@Danne Do you know how much extra write speed mlv_rec spanning adds? Does it perfectly sum CF and SD speed or is there overhead?
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on January 22, 2020, 05:08:53 PM
I used it briefly when it was implemented. Wild guess it gives around 20mb extra. But. 5d3 can do sd_uhs hack so we might get like maybe 40mb extra rough estimation?
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: ilia3101 on January 22, 2020, 05:13:07 PM
Woahh! Didn't know sd_uhs worked on 5D3 as well. So we may get 140MB/s which could give continuous UHD 😱
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on January 22, 2020, 05:17:58 PM
Well, a1ex would know this for sure but 125-130 might be more realistic maybe.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Quentin on January 22, 2020, 05:56:57 PM
Wrong thread, sorry
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: ilia3101 on January 22, 2020, 08:14:45 PM
I HAVE MADE WORKING SPANNING!!!!!! This is what the commit looks like: https://github.com/ilia3101/mlv_lite_spanning/commit/0684bab9e5937a563af8409f5c226af73b8e7c74

I have used github as I don't understand how to use bitbucket or mercurial. On that github repo you can see the before and after.

unfortunately: there is one case where the threads collide and recording stops with "Slot check error" - it happens rarely, and I know exactly why, I just haven't found a way to do mutual exclusion yet.

I am pretty sure the semaphore is what I should use as a "mutex", but I could not get it to work, could you help me a little bit please @a1ex? I just want to know how to use the semaphore for mutex purposes.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: ilia3101 on January 22, 2020, 08:20:11 PM
https://www.youtube.com/watch?v=5vqMAmgdkts
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on January 22, 2020, 08:21:15 PM
Wow. Impressive. No cam today but will test soon! Hope a1ex can take a look.
Bravo Ilia3101!!
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: ilia3101 on January 22, 2020, 08:26:23 PM
I will upload test builds, I just don't recommend it for anything other than testing!

Recording WILL STOP due to an error sometimes!

Edit: I won't upload builds actually, until I have got it in to a more usable state. Testing right now won't mean anything.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: ilia3101 on January 22, 2020, 09:07:07 PM
When I add a semaphore eveything just freezes forever, and says something like "25 frames" or "31 frames" until I turn the whole camera off.

All I did was add a pair of take_semaphore and give_semaphore, timeout 0 which I guess means no timeout. I might just try something dumb like a spinlock.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: a1ex on January 22, 2020, 10:16:46 PM
Nice progress!

To debug these semaphores, you may use the wrappers at the beginning of menu.c. These will tell you who acquired the semaphore (what line of code), and you can also add the task name (get_current_task_name). What you print on the display, should stay there even if the camera locks up.

However, a hard lock up (when everything stops responding) generally means some kind of invalid hardware (MMIO) access, or DryOS memory overwritten, i.e. messed up badly enough that vanilla firmware can no longer continue. If some task ends up "simply" waiting at semaphore, that shouldn't bring down the entire machine.

For 32-bit integer assignments, on a single-core ARM CPU, semaphores should not be needed - afaik, this operation is atomic. That's probably not true on multi-core systems.

For very short critical sections, you may use cli/sei, but no other tasks will be able to run between those two. You should not call any DryOS API either (such as msleep), as these might enable the interrupts on their own.

Also take a look at the selftest module - that also serves as "documentation" of expected behavior and return value of various DryOS functions. The VxWorks documentation should be helpful, too, as the high-level behavior is pretty much identical (but the internals are not).
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: ilia3101 on January 22, 2020, 10:30:14 PM
Quote from: a1ex on January 22, 2020, 10:16:46 PM
However, a hard lock up (when everything stops responding) generally means some kind of invalid hardware (MMIO) access, or DryOS memory overwritten, i.e. messed up badly enough that vanilla firmware can no longer continue. If some task ends up "simply" waiting at semaphore, that shouldn't bring down the entire machine.

None of my lockups were hard, just raw recording thread(s) locking up - I could still enter ML menu and it would just say "stopping"

Quote from: a1ex on January 22, 2020, 10:16:46 PM
For 32-bit integer assignments, on a single-core ARM CPU, semaphores should not be needed - afaik, this operation is atomic. That's probably not true on multi-core systems.

Doesn't apply to the current situation (I think), but good to know.

Quote from: a1ex on January 22, 2020, 10:16:46 PM
For very short critical sections, you may use cli/sei, but no other tasks will be able to run between those two. You should not call any DryOS API either (such as msleep), as these might enable the interrupts on their own.

This may be the perfect solution! I will try it out. Didn't realise what cli/sei were until I just googled it. Wow!

Is "ASSERT" and beep/bmp_printf allowed between cli/sei?


Will have a look at menu.c and selftest module as well.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: ilia3101 on January 22, 2020, 11:07:04 PM
I added sei/cli and it seems to fix the problem, but I think the code runs between them for too long, so I will still try and sort out the mutex.

Just one last question for today: There is loads of "Frame order error" messages at the end of recording - it only seems to happen when the video's bitrate exceeds or almost exceeds total write speed. Is this a major issue?

With UHD total write speed tops out around 111MB/s right now, not as amazing as I expected. However I haven't tried sd_uhs yet. Update: I compiled sd_uhs in your branch @Danne and it says not supported on the 5D3 - where do I get the latest sd_uhs?
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on January 23, 2020, 07:07:05 AM
Check the code in sd_uhs.c(my branch):
/* Below cams not tested/supported atm. Try it by enabling sd_overclock_task(); */
    if (is_camera("5D3", "1.1.3"))
    {
        /* sd_setup_mode:
         * sdSendCommand: CMD%d  Retry=... ->
         * sd_configure_device(1) (called after a function without args) ->
         * sd_setup_mode(dev) if dev is 1 or 2 ->
         * logging hook is placed in the middle of sd_setup_mode_in (not at start)
         */
        sd_setup_mode       = 0xFF47B4C0;   /* start of the function; not strictly needed on 5D3 */
        sd_setup_mode_in    = 0xFF47B4EC;   /* after loading sd_mode in R0, before the switch */
        sd_setup_mode_reg   = 0;            /* switch variable is in R0 */
        sd_set_function     = 0xFF6ADE34;   /* sdSetFunction */
        sd_enable_18V       = 0xFF47B4B8;   /* 5D3 only (Set 1.8V Signaling) */
        SD_ReConfiguration  = (void *) 0xFF6AFF1C;
     /* sd_overclock_task(); */    }

    if (is_camera("5D3", "1.2.3"))
    {
        sd_setup_mode       = 0xFF484474;
        sd_setup_mode_in    = 0xFF4844A0;
        sd_setup_mode_reg   = 0;
        sd_set_function     = 0xFF6B8FD0;
        sd_enable_18V       = 0xFF48446C;   /* 5D3 only (Set 1.8V Signaling) */
        SD_ReConfiguration  = (void *) 0xFF6BB0B8;
     /* sd_overclock_task(); */    }

return 0;
}

Enable the function with this:
/* sd_overclock_task(); */
to this:
sd_overclock_task();

Don´t forget, the module will autoenable when starting camera.
in modules.c
char *core_modules[] = {"mlv_lite", "crop_rec", "mlv_play", "mlv_snd", "lua", "file_man", "dual_iso", "silent", "ettr"};

Just tested over here and seems to work but havn´t checked agains any benchmark tests.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: ilia3101 on January 23, 2020, 02:27:19 PM
Didn't work, SD card just benchmarks at 0.0MB/s and there is some error when raw recording. (I'm firmware 1.1.3)
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on January 23, 2020, 02:41:23 PM
Well, I can´t really help you on that as I have no issues here.
You could test sd_uhs.mo from the sd_uhs branch. Here is a compiled version:
https://bitbucket.org/Dannephoto/magic-lantern/downloads/sd_uhs.mo

Try and replace it with what´s in your modules folder now. This version needs to be enabled from with debug tab. Not as convenient but check if it works better.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: ilia3101 on January 23, 2020, 02:47:37 PM
Thanks! I will try that version.

Also this card might be wacky, it's an 600x pink transcend. I'll try a different card later.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on January 23, 2020, 02:58:04 PM
Yes, could be it. My version don´t really like cheap cards  :P.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: ilia3101 on January 23, 2020, 09:32:36 PM
Anyone have any idea what this error could be about:

(https://i.postimg.cc/5tc3X3bF/IMG-20200123-202510.jpg)

It only happens rarely, but does happen.

Since that error happened, the camera has been recording for 10 more minutes without any more errors.

I think spanning is getting close to usable now!
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on January 23, 2020, 09:37:19 PM
Wonderful Ilia3101!
Compression error. Usually includes corrupt frame/frames. I had them when recording was disturbed of sone engdrvout routine changing regs in crop rec. But root could as well be overhead or recording edge of speed I think.
Sd_uhs working?
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: ilia3101 on January 23, 2020, 09:48:36 PM
About to try sd_uhs with a proper card!

Edit: the sd_uhs didn't work with any of my two cards I have tried. I will try with some other cards once they are free.

I have uploaded some testing builds with spanning:
https://github.com/ilia3101/mlv_lite_spanning/releases/download/test-builds/magiclantern-Nightly.2020Jan23.5D3113.zip
https://github.com/ilia3101/mlv_lite_spanning/releases/download/test-builds/magiclantern-Nightly.2020Jan23.5D3123.zip

I decided to post them as it does not seem to be causing any dangerous crashes or lockups. I have only tested 5D3.113, don't know if it will be different for 123. Curious to see people's results.

My modified mlv_lite.c and mlv_lite.h code can be seen here: https://github.com/ilia3101/mlv_lite_spanning

I did have issues at one moment, but it was just a faulty lens adapter chip messing with the camera. Not from my spanning code. Pretty certain it's safe.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on January 23, 2020, 11:26:36 PM
Gave it a go with version 1.1.3 and could get continuous 24fps 10bit with full expansion of UHD 1:1(3840x1536). I needed sd_uhs enabled but had to get the old routine patching with the very long wait from sd_uhs branch. With my sd_uhs version it would create some File create error and then stop recording. I guess this module needs some testing to get automation working. On a side note I wish for continuation of the sd_uhs patching module. I never really liked the way I stripped and got it working reliably mostly for the eosm but not with other cams.

Compression errors were present when trying out higher frame rates like 48/50/60 fps modes. I guess these modes are too much for the sd card to handle.
Crop marks dir is missing and i also couldn´t get the mlv_lite.c and mlv_lite.h to work with my ongoing branch but I guess it could be done later on.

Great work Ilia3101.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: ilia3101 on January 23, 2020, 11:37:42 PM
Glad to see you testing it out :)

I just sorted out the semaphores (https://github.com/ilia3101/mlv_lite_spanning/commit/3f110176b170949d2668217a0e0e236664a07d4d), and it has added megabytes of performance, at least with the weird transcend card. Before I was using cli/sei which would block the processor for too long and cause the compression errors (I think).

I am recording a long test clip right now to see if any errors come up.


When do you think we can start figuring out how to put it back in to your bitbucket branch? How many changes have you made to mlv_lite since?
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on January 23, 2020, 11:44:56 PM
Only one slight change jan 18th:
     raw_set_preview_rect(skip_x, skip_y, res_x, res_y, 1);
     raw_force_aspect_ratio(0, 0); */

-    if (!get_halfshutter_pressed())
+    if (!get_halfshutter_pressed() || rec_trigger == 3)
     {
         autofocusing = 0;
         long_halfshutter_press = 0;


So it won´t be an issue. You could test compiling and working right into my latest branch. I won´t be messing with it for a while anyway ;).

You changed mlv_lite.c and mlv_lite.h but no other places? Modules needs to be turned on I see at least but I also had some warning about dryos. Didn´t have time to check it too hard.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: ilia3101 on January 23, 2020, 11:48:19 PM
Nice. Just added that change to my mlv_lite.c, now it can easily be put back in to your branch whenever it is time.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on January 23, 2020, 11:51:10 PM
Great. I´ll check. I think I was in the eosm branch before so My last message was testing the wrong branch  :P
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: ilia3101 on January 24, 2020, 12:01:21 AM
Ah ok. Undid the change for now.

Also updated the builds.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on January 24, 2020, 12:10:01 AM
ah, no, the change is ok, I meant another error so you can add it back.
Tested again and skipped messing with the sd_uhs module. 48/50/60fps working just fine and what was nice there were no compression errors at all. Could very well be related to sd_uhs.
Nice part with this is that practically all presets can be run in 14bit. Only missing the sd_uhs module for the UHD 1:1 before patching I think sd card will run around 20mb and after patching at least double so getting some usable sd_uhs patch working is something to look into.
Let´s keep your testing branch open for a while and keep on testing from it and when ready I can put it into my own branch.

Remember folks. BLEEDING EDGE! Be brave, and maybe rich too ;)

EDIT: Will test full 48fps 1920x1080p and see if spanning stuff makes this work...
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: ilia3101 on January 24, 2020, 12:18:37 AM
Redid the change :D

Yeah, let's leave testing open for a little while. @everyone please test SD/CF spanning! Download in this post (https://www.magiclantern.fm/forum/index.php?topic=23041.msg224571#msg224571)
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Stousen on January 24, 2020, 02:34:48 PM
This is super exciting, i have some good cards that will try it out on this weekend.
UHD in 14bit 24fps with liveview working?? Sounds to good to be true ???
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: ilia3101 on January 24, 2020, 05:34:14 PM
The only thing that has changed is write speed (if you enable card spanning), now instead of 100 it's more like 112 for me (I really want to hear other people's results, I feel like it should be 120). With sd_uhs we might even get a lot more ;)

Note: just remembered: in my build I removed core module auto loading array, so you'll have to load them yourself sorry :) @Danne feel free to make a slightly more official build, the mlv_lite.c/h on my github is the latest
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on January 24, 2020, 05:53:16 PM
I took your changes and also added sd_uhs patching into 5D3 into this branch:
https://bitbucket.org/Dannephoto/magic-lantern/branch/crop_rec_4k_mlv_snd_isogain_1x3_presets_card_spanning

In time I´ll merge changes into the regular branch again. Feel free to grab code changes and compile/test new builds. Note that sd card I test with are sandisk extreme pro 95 or 170mb/s. Slower cards might behave fishy when patched.

When patched the first time it takes a few seconds for the changes to show. Once OFF turns to ON it´s patched.

Patch function enabled from with in Movie tab menu:
(https://i.postimg.cc/V6tg3Jbs/VRAM0-PPM-scaled.png)

Do remember:
BLEEDING EDGE! Briefly tested. I did not test to patch while only using CF-card so don´t know how it will behave if no sd-card is in the memory card slot...
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: ilia3101 on January 24, 2020, 09:45:07 PM
Holy fuck. My sandisk 45MB/s card just wrote at 48MB/s!

However the CF did slow down to ~75MB/s... whyy!!!! Is the camera's ram becoming a bottleneck?

(https://i.postimg.cc/441qtb8F/UHD.jpg)

^ That is UHD in 12 bit

Edit: yep, getting data corruption, need a really good card for this to work. At least 60MB/s
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: MAG on January 25, 2020, 01:32:47 PM
Would love to try this build to help the community !

I have 5DM3 with:
SDHS I Sandisk 95 MB/s
CF lexar 160 MB/s 1066x

But which build to use ?
And what is the settings to try ?
(I have read last 5 pages but I'm not enought in it to fully understand...)
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: timbytheriver on January 25, 2020, 01:55:42 PM
@ilia3101 Thank you for your hard work bringing this to 5D3! :)

I have tested both a build compiled from Danne's branch :
https://bitbucket.org/Dannephoto/magic-lantern/branch/crop_rec_4k_mlv_snd_isogain_1x3_presets_card_spanning

and yours:
https://github.com/ilia3101/mlv_lite_spanning/releases/download/test-builds/magiclantern-Nightly.2020Jan23.5D3113.zip

Fastest card I have is Sandisk Extreme 90Mb/s U3.

On Danne's branch: I get almost instant stops in UHD 3850px with message: "Frame order error...Slot 10(?)...e13...expecting 19..." The message disappears very quickly so I can't read it all! A file has been saved to SD I notice: M25-1206.M00 – file is 50mbs but I can't open it in MLVApp.

**EDIT** I have just tried turning Spanning = On, but Overclocking = Off. It now records one file to CF and one to the SD, both with same timestamp but the SD one with the .00 suffix. Can't open .00 file in MLVApp or MLVFS.

On ilia's I get an error printed about: Missing crop-marks and also sd_uhs will not run on this camera. (I'm on 5D3 1.1.3)
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on January 25, 2020, 02:23:46 PM
Quote from: MAG on January 25, 2020, 01:32:47 PM
Would love to try this build to help the community !

I have 5DM3 with:
SDHS I Sandisk 95 MB/s
CF lexar 160 MB/s 1066x

But which build to use ?
And what is the settings to try ?
(I have read last 5 pages but I'm not enought in it to fully understand...)
Wait for Ilia3101 to compile and share or learn how to compile. Seems you have the right card to use so should be ok.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: ilia3101 on January 25, 2020, 02:47:19 PM
Updated:
https://github.com/ilia3101/mlv_lite_spanning/releases/download/test-builds/magiclantern-Nightly.2020Jan25.5D3113.zip
https://github.com/ilia3101/mlv_lite_spanning/releases/download/test-builds/magiclantern-Nightly.2020Jan25.5D3123.zip

@timbytheriver What should happen is that the main file (.MLV) will be recorded on the CF card, and .M00 will be on the SD, just move both of them to the same folder/card, then you will be able to open it with MLV App.

And there may also be .M01 .M02 etc from 4GB splitting.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: timbytheriver on January 25, 2020, 02:56:56 PM
@ilia3101 Aha! Thank you.

Quotejust move both of them to the same folder/card, then you will be able to open it with MLV App.

I see this to be true now. :)

I will try your updated builds and report back.

Thanks!
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on January 25, 2020, 03:13:44 PM
@ilia3101
Works good over here. Is frame order "issue" due to spanning just recording frames differently? Seems indexing fine though so maybe we should exclude the check when spanning is on?
Next I want to increase anamorphic resolutions when spanning is enabled vs defaults now without spanning on.

Also noticed a previewing issue when recorded longer takes, 3 or more mlv chunks. Will print exct message when back home.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: ilia3101 on January 25, 2020, 03:27:14 PM
I am almost certain the frame order issue is just due to the nature of spanning. Makes each file look like it has loads of skipped frames.

So yeah I think we should disable this check when spanning is used.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on January 25, 2020, 03:31:25 PM
Quote from: ilia3101 on January 25, 2020, 03:27:14 PM
Makes each file look like it has loads of skipped frames.
Ah, makes sense.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: timbytheriver on January 25, 2020, 03:33:01 PM
@ilia3101 With your newly posted build I get:

Card spanning + SD overclocking = on, I get msg: File Create Error. Stops recording immediately.

SD overclocking = off, Card spanning = on, I get Frame order... issue (Think you have discussed this?) and stops after 8 secs or so.

Upon restart had msg twice: Camera not shutdown properly. Skipping module loading.

Cards: CF Sandisk Extreme Ultra Pro 160mb/s (Been using for 3K fine for a year) + SD Sandisk Extreme 90mb/s. (Also been fine for ML core files).

Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: 70MM13 on January 25, 2020, 03:46:58 PM
speaking of cards, i want to join in the party but i don't have any decent sd cards.  the local retailer here only has this in stock:

SanDisk 64G Extreme SDXC UHS-1 Memory Card - 150MB/s, C10, U3, V30, 4K UHD, SD Card - SDSDXV6-064G-CWCIN

opinions?  will it overclock?

my other option is amazon, but then the wait for shipping begins ;)
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on January 25, 2020, 03:51:29 PM
Only tested realible sd_uhs patching with sandisk extreme pro 95mb and 170mb card. Most other cards either failed or even slowed down speed performance.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: 70MM13 on January 25, 2020, 03:55:41 PM
adding the "pro" to my stock availability search drops the results to zero :(
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: ilia3101 on January 25, 2020, 04:02:42 PM
@timbytheriver

Hmm, strange. I didn't get to try out sd_uhs with a proper card so I can't tell what's going on. I will upload a build where the sd_uhs module does not auto load, maybe that will improve things for you.

And those "Camera not shutdown properly" happened only with sd_uhs for me.

However I did get much improved record times even without sd_uhs.

@70MM13 still valuable if you try it out without sd overclocking.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: 70MM13 on January 25, 2020, 04:13:41 PM
i'll try it with my ancient sandisk 30mb/s card while i wait for amazon shipping :)

any improvement is a good thing, right? :)
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on January 25, 2020, 04:30:53 PM
Quote from: ilia3101 on January 25, 2020, 04:02:42 PM
I will upload a build where the sd_uhs module does not auto load, maybe"

However I did get much improved record times even without sd_uhs.
Patch itself is not autoenabled. Problem is due to card itself. Don't patch and problem goes away. Reluctant to answer some users who neglect to share info in other posts but I don't want Ilia3101 to waste his time.
I get increased recording times when patching. I'd say around 125mb/s.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: ilia3101 on January 25, 2020, 04:41:29 PM
Oh yeah it doesn't automatically do the patch. And I forgot to post the build, not home now sorry. If you still want to try disabling sd_uhs tim you can just remove it from the card, though it shouldn't be the source of the problem.

Also if you get file creation error it could be because the card was inserted badly (I had that once), but I can't help any further with sd_uhs for now.

@Danne I also hit 124MB/s with sd_uhs and a 45MB card, still need to check if the file can be read, the camera couldn't play it (it was a 3 minute UHD)
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on January 25, 2020, 04:46:37 PM
Yeah, good for you the patch works on a 45mb card. I don't think you can reach higher speed with a faster card.
I also had preview issues but file itself works in mlv app.
The file creation error is explained in mlv_lite code. I can recreate it with older sd_uhs patch code. The issue isn't triggered with latest build.
@70mm13
Try patch on your 30mb card. Maybe it works.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: 70MM13 on January 25, 2020, 05:40:26 PM
i'm trying it on a few sd cards i have here, (all slow but a couple are brand new) and no matter what i do i don't get any files to show up on the sd card.  i tried toggling through all of the canon menu card recording options, but it makes no difference.  any suggestions?  obviously i must be missing some crucial and obvious (but not to me) step!

while i await any suggestions i will try another test without a CF card, especially just to try the patching!
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on January 25, 2020, 05:51:00 PM
Don´t know what builds you are testing but you need to enable card spanning in RAW video menu.
Patching will only work with my latest code.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: 70MM13 on January 25, 2020, 06:04:14 PM
i'm using the latest one ilia posted, and yes, i did miss the obvious "card spanning" in the raw video menu!  :P

meanwhile here's my sd-only overclock test results:

both new kingston cards (crappy cheap cards only intended to load ML and capture stills) said "card full" even though they were empty, and my ancient sandisk "ultra" 30mb/s worked, although i didn't see any real improvement, only a few extra frames recorded but that's within margin of error...

EDIT: PS: what formatting block size settings are you guys using on the sd cards?
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on January 25, 2020, 06:06:07 PM
Yeah, sd_uhs will not work with those builds. Have to wait for new uploads.

Preview issue comes from mlv_play. Could reproduce with longer takes, three chunks:
From mlv_play.c
                    /* no, its another chunk */
                    if(main_header.fileGuid != file_hdr.fileGuid)
                    {
                        bmp_printf(FONT_MED, 30, 190, "Error: GUID within the file chunks mismatch!");
                        beep();
                        msleep(2000);
                        return;
                    }
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: 70MM13 on January 25, 2020, 06:10:42 PM
no worries, i'll wait patiently :)

any suggestions for optimal sd card format block size?
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: ilia3101 on January 25, 2020, 07:34:05 PM
Ah I figured out why the fileguid is different, I will fix it this evening.

Update: fixed (https://github.com/ilia3101/mlv_lite_spanning/commit/3c88cb06c238c2f129a4d700705bbdac2e5aaf3b)
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on January 26, 2020, 08:01:19 AM
Cool. Works nicely with mlv_play and previewing longer takes is not longer an issue. I included the fix and also excluded frame order text when card spanning is set to on also in this branch:
https://bitbucket.org/Dannephoto/magic-lantern/branch/crop_rec_4k_mlv_snd_isogain_1x3_presets_card_spanning
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on January 26, 2020, 08:53:05 AM
Getting some errors around mlv_play. Locks camera:
[104]compress_task: stack overflow: free=0 used=4096

I record 14bit lossless anamorphic mode. Deleting and then previewing the next file got me the above text. card_spanning on but sd overclock is set to OFF.
Seems also happening with 10bit selected. Maybe my sd card is corrupted.

Formatted sd card in camera and all seems working again. I guess sd_uhs related. Hard to say. My sd card have been doing all kinds of tests lately  :P
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: ilia3101 on January 26, 2020, 10:42:00 AM
compress_task does not touch mlv play, it is only for compressing frames while recording. No idea why it would have a problem, I did not touch it's code or do anything that should affect it.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on January 26, 2020, 11:57:28 AM
Probably sd_uhs patch related. Card chokes causing issues. After formatting all works again.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: timbytheriver on January 26, 2020, 02:25:35 PM
Have new card now: Sandisk Extreme Pro SDXC UHS-I 64gb (170MB/s read, 90MB/s write)

Compiled latest updates. Card-spanning and SD overclocking working well now:

I can get 1min+ 3600 x 1532 / 24fps / 2.35:1, continuous at 3072p. 1080p 14bit on SD card alone – continuous! :)

Many thanks @ilia3101, @Danne.


Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Stousen on January 26, 2020, 02:31:20 PM
Quote from: timbytheriver on January 26, 2020, 02:25:35 PM
Have new card now: Sandisk Extreme Pro SDXC UHS-I 64gb (170MB/s read, 90MB/s write)

Compiled latest updates. Card-spanning and SD overclocking working well now:

I can get 1min+ 3600 x 1532 / 24fps / 2.35:1, continuous at 3072p. 1080p 14bit on SD card alone – continuous! :)

Many thanks @ilia3101, @Danne.

Wow, great work, need to try this when i get back home. Is the liveview working as normal in this cases?? :o
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: timbytheriver on January 26, 2020, 03:16:19 PM
@Stousen Yes!

In 1080p = Real Time.
In Crop modes = Framing.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: 70MM13 on January 30, 2020, 01:46:46 PM
my new sandisk extreme pro 170 card arrived the other day, and i have put it through its paces...

formatted with 4mb blocks for my first test.

like tim, the sd card alone does 1920x818 continuous!
3072x1308 also continuous!
3620<> x1536 5 minutes (x resolution at maximum for true 2.35:1 - is there a way to push y above 1536?)

all 14 bits lossless, with lots of brightness and motion.

i've been putting off my next music video until i could shoot 3k+ continuous (it's a performance) and now i can do it!  thanks!
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: timbytheriver on January 30, 2020, 02:51:13 PM
A postscript to @70MM13's post: For Mac users!!

I tried to format a custom 4Mb block size in exFAT using the terminal like this:

sudo newfs_exfat -b 4194304 -v NameThePartition /dev/disk3s3

It appeared to have done so, but I couldn't get it to mount under any circumstances. The card will work in the camera – but you will be unable to mount it to retrieve your files.

The closest I could get to a larger custom block size was 1Mb (1048576) (These numbers have to be powers of 2 apparently.) This will mount, but it caused problems in the camera and I started to get only about 15sec @ 3072p with or without card spanning/sd overclock on or off.

Not sure if it was related but I then kept getting card errors: 'Card1 cannot be accessed' after formatting custom block sizes from the Terminal. Reflashed the Firmware, finally erased formatted to exFAT from disk utility with the default [tiny] block size of 32768 (0.03Mb).

All appears to be ok again now. But bottom line may be that Mac really doesn't play well with exFAT/exFAT custom block sizes. I wish I'd left well alone!  :(

PS If you format the cards in-camera I noticed (both my SD and CF cards being 64Gb) that the SD card gets exFAT, while the CF gets FAT32. Just noting...
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Stousen on January 30, 2020, 07:06:36 PM
Quote from: timbytheriver on January 26, 2020, 03:16:19 PM
@Stousen Yes!

In 1080p = Real Time.
In Crop modes = Framing.

I managed to get it to work, i get avout 110-115 in w/speed!
Tho my live view doesnt work while recording in crop 3k? :(
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on January 30, 2020, 08:29:26 PM
Quote from: Stousen on January 30, 2020, 07:06:36 PM
I managed to get it to work, i get avout 110-115 in w/speed!
Tho my live view doesnt work while recording in crop 3k? :(
It's hard to see what you expect or even if there is a problem involved. To minimize communication mishaps you need to be specific with settings used, preferrably with screenshots or a screenrecording. Use contextual terminology instead of making up new words etc.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Stousen on January 30, 2020, 09:16:40 PM
Quote from: Danne on January 30, 2020, 08:29:26 PM
It's hard to see what you expect or even if there is a problem involved. To minimize communication mishaps you need to be specific with settings used, preferrably with screenshots or a screenrecording. Use contextual terminology instead of making up new words etc.

LoL, i hear ya. Will try not to do a Hegel and be swift but clear.  :-*

Card spanning: on
1/1 3k crop
14 bit lossless
2.35:1
Required 110 write speed

Live view: framing
Kill global draw: no, also tried yes
Sd uhs hack : on


Live view before recording: framing
Live view after pushing rec: framing
Live view some seconds after pushing rec: pink screen but still recording

70 ish write speed CF - 40-50 ish write speed on SD.
Tho thought the liveview would function better if the cardspanning actually increased the bandwith? Or am i out biking on a road with no light?

Cheers
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on January 30, 2020, 09:41:10 PM
You need a better bike  8)
Previewing capabilities will not change with different cards. Framing...
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Stousen on January 30, 2020, 09:46:20 PM
Quote from: Danne on January 30, 2020, 09:41:10 PM
You need a better bike  8)
Previewing capabilities will not change with different cards. Framing...

Aye, thanks for the enlightenment :D :D ;)
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: vstrglv on January 31, 2020, 09:24:03 PM
Fantastic build crop_rec_4k_mlv_snd_isogain_1x3_presets_card_spanning_2020Jan25.5D3113!!! I've got (1920X3)X2332- 2.39:1 continuous 24fps, 14bit lossless, Dual ISO at anamorphic Presets. Is it possible to add settings for 1920 -2,35:1?
I've tried Dmytro_ua's Fast video presets, updated for Danne's build 16th of Jan -  https://drive.google.com/open?id=18-Wo0yNVBCVwfjyTlB7O7UK5bMPUtsCd, but there is no this lua in Scripts menu. ?
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Dmytro_ua on January 31, 2020, 10:06:03 PM
Quote from: vstrglv on January 31, 2020, 09:24:03 PM
I've tried Dmytro_ua's Fast video presets, updated for Danne's build 16th of Jan -  https://drive.google.com/open?id=18-Wo0yNVBCVwfjyTlB7O7UK5bMPUtsCd, but there is no this lua in Scripts menu. ?

Those presets are actually easy to update to your needs with a simple text editor on your computer. I've shared them like an example to everyone who needs smth special for themselves. I'm sure there is no universal set of presets suited for everyone. So you can edit any of them to your needs. And delete others which you don't need. Actually it's not hard at all.

Sorry, didn't understand at first what you are asking for. As I mentioned before, I'll try to update them as soon as I have time to test everything in a proper way.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: vstrglv on February 01, 2020, 09:16:20 AM
It seems to me that menus structures in builds of 16th Jan and 25th Jan are the same. My lua script works fine in 16th Jan build, but there is no this lua in Scripts menu in 25th Jan build. All builds are Danne's build.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on February 01, 2020, 09:37:25 AM
Quote from: vstrglv on February 01, 2020, 09:16:20 AM
It seems to me that menus structures in builds of 16th Jan and 25th Jan are the same. My lua script works fine in 16th Jan build, but there is no this lua in Scripts menu in 25th Jan build. All builds are Danne's build.
Post screenshots or try describe more in detail what you arw missing. I use lua all the time and it´s still included as a module but who knows what you´re asking here. Maybe try and do a screenrecording?
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on February 01, 2020, 10:56:52 AM
New versions:
https://www.magiclantern.fm/forum/index.php?topic=23041.msg216899#msg216899

- Added card spanning implemented by ilia3101 and also sd_uhs overclocking

Faster sd card(sandisk seems to work better overclocking). Patch only works on sd card.

Only briefly tested so tests and reports are welcome especially now at early stages. Bleeding edge folks. I trust card spanning more than I trust the sd_uhs hack. When patching works it works really well, but otherwise it could give give surprises like corrupted files, no header etc, or maybe even affect the sd card permanently. Well, other than that. Happy testing :)

And thanks ilia3101 and a1ex for the card spanning feature(formerly implemented in mlv_rec by g3gg0).
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: vstrglv on February 01, 2020, 11:32:12 AM
Quote from: Danne on February 01, 2020, 09:37:25 AM
Post screenshots or try describe more in detail what you arw missing.
When I open "Scripts" menu in ML build 16 Jan I see my lua and can run it. But when I open "Scripts" menu in ML build 25 Jan, I can not see the same lua in menu.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on February 01, 2020, 12:26:27 PM
Post the scripts. More info needed if you compare. Try shorten the name of the script that is showing in menu.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: GullRaDriel on February 01, 2020, 01:04:27 PM
Wonderfull work Danne & ilia3101 and a1ex !

I'll try it asap !
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: vstrglv on February 01, 2020, 03:17:54 PM
Quote from: Danne on February 01, 2020, 12:26:27 PM
Try shorten the name of the script that is showing in menu.
Yes! Thank you. If SD card FAT32 formated - no problem with long file name. If exFAT only 8 length works.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: GullRaDriel on February 04, 2020, 12:29:32 PM
No Problem with shooting so far. I'll try recording this evening.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: vstrglv on February 10, 2020, 08:36:10 PM
I can't make screenshot on build crop_rec_4k_mlv_snd_isogain_1x3_presets_2020Feb01.5D3113. Debug\Screenshot-10s, SET, Shutter butt. - half-press. There is a display with ML top and bottom bars. Global Draw - LiveView. There is no new VRAMx.PPM file. Is it OK?
By the way in crop mode there is no "Focus distance info" in low bar, because there is no room for it. How to reduce crop made info in low bar or even delete it? Also WB info is useless for me.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on February 10, 2020, 10:47:01 PM
Worked last time I tried. Could someone else test the screenshot function?
Code is out there. If you want to modify screen text you can check in lens.c for instance.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: vstrglv on February 11, 2020, 06:42:04 AM
Quote from: Danne on February 10, 2020, 10:47:01 PM
Worked last time I tried.
It works for me only for ML menu.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on February 11, 2020, 07:20:51 AM
Turn off RAW video while doing screenshots. I did some automation to temporarily disable RAW video when using screenshot function but maybe it fails under certain conditions. If you could present clear cases reproducing the issue I could take a look. Screenrecording would do.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: vstrglv on February 11, 2020, 07:55:19 AM
Thank you. Will try this evening.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: vstrglv on February 11, 2020, 02:20:28 PM
I am trying pull request your branch with command :hg clone https://bitbucket.org/hudson/magic-lantern && cd magic-lantern && hg update crop_rec_4k_mlv_snd_isogain_1x3_presets && cd , but got an error:"abort: unknown revision 'crop_rec_4k_mlv_snd_isogain_1x3_presets'" I am on cygwin (Win10) What is the problem?
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on February 11, 2020, 04:57:51 PM
Ask google.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: vstrglv on February 11, 2020, 05:55:33 PM
Quote from: Danne on February 11, 2020, 07:20:51 AM
Turn off RAW video while doing screenshots. I did some automation to temporarily disable RAW video when using screenshot function but maybe it fails under certain conditions.
Yes, it works. Thank you.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: ilia3101 on February 12, 2020, 02:36:28 PM
How does the bit depth option work in crop_rec? I am really concerned about the black level staying the same as it is at 14 bit. I switch to 12 bit, black level is still at 2047. Is it just cutting the top 3/4 of values off?
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on February 12, 2020, 05:56:03 PM
Quote from: ilia3101 on February 12, 2020, 02:36:28 PM
Is it just cutting the top 3/4 of values off?
Values of what?
The workaround is very simple. There are analog gain registry that when lowered gives reduced bitdepth. Only white level needs adjusting. Maybe a bad thing but it works so I just kept working with that.
You could test and compare 12bit in crop rec vs raw video.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: ilia3101 on February 12, 2020, 06:56:35 PM
Ah I see, so it is gain. You are putting a 12 bit range in a 14 bit container (still getting more efficient compession). Not cutting anything off then (GOOD!).

Analog - this explains why black level stays the same. I wonder what the effects on noise are, I seem to get stronger than usual stripes in the shadows, that don't go away with stripe fix.

ProTip: You could do this gain by only 0.1 stops and call it increased dynamic range ;) ;) ;)
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: ilia3101 on February 12, 2020, 07:00:12 PM
I really want to add real 12 bit to the UHD preset.

Wish I knew how😭 @Danne didn't you mention there's comments somewhere about reducing bitdepth??
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on February 12, 2020, 07:24:04 PM
I don't think it's less real. Quality wise probably the same. What's your issue by the way?
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: ilia3101 on February 12, 2020, 07:31:12 PM
I have no issue, but:

The black-white range with your gain adjusted 12 bit seems to be approximately 2047-5600 (max 16383)

With real 12 bit it will probably be 512-3800 (max 4095)

So it is effectively 12 bit.

But I suspect the compression algorithm can be slightly more efficient in true 12 bit mode.

I just got an excessive amount of stripes recently shooting in crop_rec 12 bit, which got me wondering about this.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on February 12, 2020, 07:45:29 PM
A1ex explained from time to time about bitdepth routines. I can't find the posts right now. I don't think those stripes are related to bitdepth in crop rec but who knows.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: ilia3101 on February 12, 2020, 07:55:36 PM
Ok thank you. I wasn't saying I was certain that the stripes are caused by it. Probably not. The 5D3 is really quite stripy.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: koopg on February 16, 2020, 02:59:34 PM
Can i go a bit off topic here ?
I hvae bought a KB 128Gb from amazon
I have used it twice and yesterday its simply died.
I want to buy a new card, but KB feesls like out of the question with this type of quilty.
So, is there anything else to use on a 5d3 with more or less the same speeds but more reliability ?
Used cases are danna builds 3.5k raw o  a 5d3

Thanks

Sent from my SM-N975F using Tapatalk

Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on February 16, 2020, 04:10:09 PM
How did it die?
I use transcend. Never failed.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Dmytro_ua on February 16, 2020, 09:21:23 PM
I use Lexar. Maybe it's not a top speed but a solid proof for many years
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: koopg on February 18, 2020, 12:33:27 PM
Thanks

Quote from: Danne on February 16, 2020, 04:10:09 PM
How did it die?
I use transcend. Never failed.

Pressing record and its gone, will not recognize by any system

Can you tell me which type and does it do 3.5k with danne build ?

Quote from: Dmytro_ua on February 16, 2020, 09:21:23 PM
I use Lexar. Maybe it's not a top speed but a solid proof for many years

Same .. you are saying that its not top speed, but does it work with danne build 3.5k raw on 5d3 ?

Sent from my SM-N975F using Tapatalk
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Walter Schulz on February 18, 2020, 01:16:21 PM
If going Lexar 1066x: Take care, there are 2 versions: https://www.magiclantern.fm/forum/index.php?topic=24461.msg220607#msg220607

My KB card went dead some years ago and got replaced. No problems since. Same with my 2 Transcends.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Boobie on February 19, 2020, 10:05:13 AM
Dear Danne,

Is it possible to record 12/14 bit 2656x1484 (16/9)?
Or is 1308 height a hardware limitation for continuous recording 12/14 bit?

The 3072x1308 (2.35:1) mode is not useful to me as I rarely use 2.35:1 and make 99% of stuff in 16/9, so I will have to crop 3072 down to 2326 and lose 33% of the recorded pixels.

I don't have a 5D3, but I might buy one if 16/9 is working with >=4 megapixels Raw.

3072*1308=4,018,176
2688*1512=4,064,256
2656*1484=3,941,504 so it maybe possible

What is the highest resolution that 16/9 can be recorded continuously for 12/14 bit?
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: IDA_ML on February 19, 2020, 10:19:43 AM
Impatient to try this vey exciting card spanning feature, I borrowed the 5D3 and tested the latest February 01. build using the following two cards:

1) Transcend SDHC 32 GB 300x, (write speed: 40 MB/s, USB 3.0 card reader test)
2) Sandisk Extreme Pro 64 GB 160 MB/s, (write speed: 114 MB/s, USB 3.0 card reader test)

I.  With Card spanning ON, SD overclock OFF spanning works fine, in-camera preview too.  The 00-files get nicely recorded on the SD card and merging with the main files on the CF card goes flawlessly.  Just dump the contents of both cards in one directory and you are ready to go.  MLVApp processing works fine too.   I get continuous recording at 3072x1728 10-bit lossless resolution and 24 fps with about 1,5 stops underexposure at these settings.  With the same settings but without spanning, I get continuous recording only at 17 fps.  So, card spanning makes perfect sense and is extremely useful.

Important:
=======

To get maximum recording times, warming up cards is necessary.  With the above settings and both cards cold, I get a maximum of 200 frames recorded.  Immediately after that, I get 1000-2300 and even more frames recorded.  I guess, it's the SD card that needs warming up because, without spanning, CF card warming is not necessary.

II. With Card spanning ON and SD overclock ON, recording does not work.  Upon pressing the record button, I get three beeps along with the message "Recording stopped automatically", then recording stops and nothing gets recorded. 

------------------------------------------

Unfortunately, I had to pay a price for my impatience.  My beloved SD card died in these experiments.  Here is how this happened:

III.  I decided to check the SD-overclocking feature alone.  I removed the CF card and left only the SD card with ML on it in the camera. Then I activated SD-overclocking, waited until it is patched, (status ON) and pushed recording.  Recording did not work, I got the error message.  Then I decided to format the SD card in the camera without turning SD-overclocking off.  Formatting failed and I was prompted to replace the card.  That was it.  All further attempts to fix the card through formatting in the camera and PC via card reader failed.  The card is dead.  Not a big loss but still ...  After that, I did not try other SD cards.

----------------------------------

Excellent work Ilia3103, Danne and everyone else involved.  12-bit UHD RAW-video recording at 24 fps is a real break through for the good old 5D3 !
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: ilia3101 on February 19, 2020, 10:44:28 AM
Quote from: Boobie on February 19, 2020, 10:05:13 AM
What is the highest resolution that 16/9 can be recorded continuously for 12/14 bit?

There is a 3K preset that does 3072x1920, so you can record 16:9 in 3072x1728 (it's continuous I think)

@IDA_ML thanks for the great confirmation that it's working! Getting quite certain it's reliable now.

Quote from: IDA_ML on February 19, 2020, 10:19:43 AM
Unfortunately, I had to pay a price for my impatience.  My beloved SD card died in these experiments.  Here is how this happened:

III.  I decided to check the SD-overclocking feature alone.  I removed the CF card and left only the SD card with ML on it in the camera. Then I activated SD-overclocking, waited until it is patched, (status ON) and pushed recording.  Recording did not work, I got the error message.  Then I decided to format the SD card in the camera without turning SD-overclocking off.  Formatting failed and I was prompted to replace the card.  That was it.  All further attempts to fix the card through formatting in the camera and PC via card reader failed.  The card is dead.  Not a big loss but still ...  After that, I did not try other SD cards.

Sad about your card. Sometimes it's hard to tell if a card is dead or the file system is really messed up. Sometimes mkfs.vfat can fix things like that.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on February 19, 2020, 11:21:03 AM
New builds
Usual links

- Removed sd_uhs module. Too fishy. Not worth it. If anyone wants to test it check commit to compile it again:
https://bitbucket.org/Dannephoto/magic-lantern/commits/a61ec50df0059d3ecd7e2356d4e0b8ad9157d37d

Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Boobie on February 19, 2020, 11:57:12 AM
Quote from: ilia3101 on February 19, 2020, 10:44:28 AM
There is a 3K preset that does 3072x1920, so you can record 16:9 in 3072x1728 (it's continuous I think)

Can anyone please test this and confirm that it works continuously with 12/14 bit?

3072*1920 is considerably higher resolution at 5.9 megapixels, I'm surprised to hear the camera can support it with Raw.

If 3072x1920 is truly possible for 12/14 bit with 5.9 MP -- could 3264x1836 be supported?
That would be even better, pushing the max for 16/9.

3072*1920=5,898,240
3264*1836=5,992,704
3232*1818=5,875,776
3200*1800=5,760,000

Could it be possible to add 3264x1836 or 3232x1818 and/or 3200x1800 modes?
If 5.9 megapixels is the true limit, 3.2K would be the best possible 16/9 Raw output for this camera.
3200x1800 also has a nice upscale ratio as it's a perfect 6/5ths upscale to 4K.

I think it's important to add a preset supporting the maximum stable 16/9 resolution for Raw, as that's one of the most basic functionalities to get right before other unique aspect ratios.
A 3.2K 16/9 preset supporting 12/14 bit would be fabulous.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: ilia3101 on February 19, 2020, 12:23:31 PM
@Boobie Just tested 12 bit 3072x1728 - it's continuous with card spanning, but just on the edge. If your shot suddenly becomes overexposed, recording indicator goes orange and it will be at risk of stopping.

Quote
If 3072x1920 is truly possible for 12/14 bit with 5.9 MP -- could 3264x1836 be supported?
That would be even better, pushing the max for 16/9.

3072*1920=5,898,240
3264*1836=5,992,704
3232*1818=5,875,776
3200*1800=5,760,000

I've thought about that before, but have no idea how to implement it. It may be possible, but it's just as likely not - control of the sensor isn't very exact and there's always unpredicatble black areas coming out, they may be bigger or smaller depending on how it's configured. (at least from what I've heard from reddeercity with the 5D2, maybe its not like this on the 5D3)
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Boobie on February 19, 2020, 12:52:37 PM
Quote from: ilia3101 on February 19, 2020, 12:23:31 PM
@Boobie Just tested 12 bit 3072x1728 - it's continuous with card spanning, but just on the edge. If your shot suddenly becomes overexposed, recording indicator goes orange and it will be at risk of stopping.

Thank you very much for testing. Did you record at 24p or 30p?

I'm uncertain if MLRAW is RGB 36 bits or RGGB 48 bits pre-compression, would love to learn more.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: masc on February 19, 2020, 12:58:45 PM
Quote from: Boobie on February 19, 2020, 12:52:37 PM
I'm uncertain if MLRAW is RGB 36 bits or RGGB 48 bits pre-compression, would love to learn more.
MLRAW is 10/12/14 bit. RAW is B/W (one channel). Color comes with debayering.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Boobie on February 19, 2020, 01:00:24 PM
Quote from: masc on February 19, 2020, 12:58:45 PM
MLRAW is 10/12/14 bit. RAW is B/W (one channel). Color comes with debayering.

I understand, I'm saying 12+12+12 versus 12+12+12+12.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: ilia3101 on February 19, 2020, 01:05:16 PM
I shot 24p (23.976fps)

The raw without being compressed is not RGB, it's black and white (Bayer pattern), each pixel has only one channel, red/green/blue (nothing bad all raw cams are like that)

And it's tightly packed 12/14/10 bit, no 16 bits anywhere. Uncompressed bitrate in MB/s is (width*height*bitdepth*fps)/(8*1024*1024)

For example (3200*1736*12bit*23.976fps)/(8*1024*1024) = 190.5 MB/s

+ compression makes that smaller by ~40%
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: 70MM13 on February 19, 2020, 03:09:41 PM
hey everyone,
i'm a fan of the sd overclock!  don't drop it, it's worth keeping!  i used it to shoot my new candlelight music video continuously at 3072*1308 (4 minutes continuous!) i've also used it on the sd card alone for 1920 continuous with no cf card in the camera - all 14 bit :)

here's a few observations from my experiences with it...

it only works for me on the new sandisk extreme pro card i purchased for using it.  none of my other cards work with it.

it only works reliably for me if the camera is started with overclock DISABLED.  enable it after startup, and then use it.  disable it again before shutdown.

i suggest for the time being to make it disabled at startup by default.  the loss of a few seconds to enable it is far better than potentially unreliable operation...

it's a real drag that formatting the card with it enabled could fry the card.  that's valuable information!

one other thing to mention:  the camera definitely heats up when pushing it this hard.  we should really be paying close attention to this.  i shut down and let it cool down after a few takes when the temperature gets scary!  these temps could have consequences, so everyone should be aware and careful!

thanks for the great work, everyone!

check out my candlelight video to see it in action :)  i'll eventually post a 4k version when av1 finally gets adopted.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on February 19, 2020, 03:34:24 PM
Sorry. It´s disabled. As mentioned. Follow my commit to compile the module locally. Might look into fixing it in the future.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: IDA_ML on February 19, 2020, 04:04:46 PM
Quote from: Danne on February 19, 2020, 11:21:03 AM
Removed sd_uhs module. Too fishy. Not worth it.

Not only is it worth it!  SD-overclocking is the key to the success of this entire card spanning project!  The enormous extended functionality of the EOS-M and the 100D would have been impossible without SD-overclocking.  These 10-13 MB/s on top of the 40 MB/s factory write speed were the key to the success of these two cameras.  Same for the 5D3 too.  Very little more write speed is needed to achieve continuous recording at key modes such as the anamorphic 3840x2160/12bit lossless/24 fps or the 3072x1728/12bit lossless/24 fps or 1920x1080/48 fps without the need to reduce frame rate or lower exposure.  I wish, I hadn't mentioned my damaged SD card at all. I just wanted to warn people not to repeat my mistake.  A damaged card should not be a reason to stop the development on this issue of crucial importance!
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: ilia3101 on February 19, 2020, 04:45:45 PM
So... good opportunity to bring back the module screen 😉
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on February 19, 2020, 04:48:49 PM
Opportunity for others to get to learn code/compiling basics...
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: koopg on February 19, 2020, 05:30:55 PM
I woukd like to add
If you remember in the begging of the week
I told you my card die
It was a cf card
And after  a few tests o wanted to format the card to record my actuall takes
So i format it and %×@@#@ a big explotion happend
No just kidding, no explotion just a died card

Could it be a good tip to not format the card?

Sent from my SM-N975F using Tapatalk

Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: IDA_ML on February 19, 2020, 06:26:32 PM
Quote from: ilia3101 on February 19, 2020, 10:44:28 AM
Getting quite certain it's reliable now.

Ilia3101,

Indeed it is very reliable.  I shot tons of footage with card spanning ON, (SD-overclocking OFF), over the weekend and never had a glitch.  Moreover, it is very user friendly too.  You activate card spanning just once and forget about it.  In the end of the shooting day, you just dump the content of both cards in the same directory and forget about merging too.  MLVApp just does the rest and never complains.  Safe and reliable SD-card overclocking, as in the 100D and EOS-M, is the only thing needed to make card spanning perfect.  If that is not worth it, I don't know what is.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: koopg on February 19, 2020, 08:41:14 PM
I would like to try and correct my bad english.

I lost (died) a card (CF KB128GB) this weekend due to a format (usnig canon manu)  when the card was full.
After format the card it became un accessable from any system.

Was testing a scene, recorded few sampales
And for unknown resone I got a massage saying card full
I didnt gave it much thinking and went strait to format it from canon manu.

Maybe formating the card right after recording is a bad move ?
And a shutting off the camer and let is rest before  would lead diffrent results

Sent from my SM-N975F using Tapatalk
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: ilia3101 on February 20, 2020, 06:18:48 PM
Bug report: when recording uncompressed 12/10 bit, the white level metadata is always set to 16200 (that value is only suitable for 14 bit)
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: IDA_ML on February 20, 2020, 07:19:15 PM
Good news guys!  This morning I decided to test some spanned card footage with MLVFS to use it with DaVinci Resolve directly.  And it works absolutely fine.  I tested anamorphic 1920x2332 and 3k 1:1 3072x1728 at 24 fps and 10, 12 and 14 bits lossless and Resolve crunches it like cereal for breakfast.  Average export times of the processed video on an i7 laptop with a 4 GB of RAM GPU are 7,5 to 9 fps with Davinci Resolve Lite 16 using the MPEG4 export format at the original resolution.  This card spanning functionality is a real break through for the 5D3!    Thanks so much, everyone involved!
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on February 20, 2020, 07:57:21 PM
Quote from: ilia3101 on February 20, 2020, 06:18:48 PM
Bug report: when recording uncompressed 12/10 bit, the white level metadata is always set to 16200 (that value is only suitable for 14 bit)
That is a problem also with official experimental builds?
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: ilia3101 on February 20, 2020, 08:35:42 PM
I don't know. But it's caused by line 3081 in mlv_lite.c - just comment it out and everything is fixed - it makes the wrong assumption that if crop_rec bitdepth is not set, that the image must be 14 bit:

    if (!bitdepth) raw_hdr.raw_info.white_level = 16200

https://github.com/ilia3101/mlv_lite_spanning/commit/033c0d4801043b0d2e31ae101854fabbd40616f9


@IDA_ML Great!
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on February 20, 2020, 08:46:12 PM
So you record uncompressed 12 or 10 bit plus adding reduced bitdepth in crop rec?
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: ilia3101 on February 20, 2020, 09:03:46 PM
No, just uncompressed 12/10 bit set from mlv_lite.c - without setting bitdepth in crop_rec (set to OFF).
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on February 20, 2020, 09:22:35 PM
I see. Will check it. Never used uncompressed since lossless came into the picture.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: ilia3101 on February 20, 2020, 09:33:34 PM
I never use it either. I was just generating some files to test LibMLV.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Dmytro_ua on February 21, 2020, 11:04:35 AM
Is there any SD vs CF size proportion recommended? For example, if I have 128Gb Lexar CF what size SD card should I buy? I assume there is no any reason to buy 128 SD card?
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: 70MM13 on February 21, 2020, 02:06:13 PM
you should be fine with a 64gb sd card, but there's nothing wrong with having extra capacity!

the 170mb/s sandisk extreme pro is almost cheap on amazon...  it works beautifully for me!
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: MAG on February 27, 2020, 06:32:33 PM
I have tried this version : crop_rec_4k_mlv_snd_isogain_1x3_presets_2020Feb01.5D3113

The mlv files can't be open in any software (Photoshop, Ae, MLVFS, MLV to CDNG on the fly). Only MLVproducer were able to do but it gave me a glitch pink image almost like snow black and white tv...

To record I have tried almost every option in the presets...

Do somebody know this problem ? Do I do something wrong ?

Thanks (:
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: IDA_ML on February 27, 2020, 06:42:25 PM
Quote from: MAG on February 27, 2020, 06:32:33 PM
Do somebody know this problem ? Do I do something wrong ?

No problem at all!  Just try MLVApp.  It opens MLV files from your camera directly. 
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Dmytro_ua on February 27, 2020, 06:42:32 PM
Quote from: MAG on February 27, 2020, 06:32:33 PM
I have tried this version : crop_rec_4k_mlv_snd_isogain_1x3_presets_2020Feb01.5D3113

The mlv files can't be open in any software (Photoshop, Ae, MLVFS, MLV to CDNG on the fly). Only MLVproducer

Did you try MLVApp?
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: MAG on February 28, 2020, 09:55:14 AM
Wonderful Thanks a lot MLVapp work so well !
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: ilia3101 on March 05, 2020, 09:51:12 PM
Seems that there is no true 12/10 bit compressed recording? It's all gain based?

I recorded in "12 bit lossless" data format, and white level was at 6000 or something. Not below 4096 like I expected. And black was 2047 just like 14 bit (would be 512 in true 12 bit)

So there is no difference between using crop_rec bitdepth and mlv_lite data fromat lossless options?
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on March 05, 2020, 09:59:29 PM
Quote from: ilia3101 on March 05, 2020, 09:51:12 PM
Seems that there is no true 12/10 bit compressed recording? It's all gain based?

I recorded in "12 bit lossless" data format, and white level was at 6000 or something. Not below 4096 like I expected. And black was 2047 just like 14 bit (would be 512 in true 12 bit)

So there is no difference between using crop_rec bitdepth and mlv_lite data fromat lossless options?
Told you already ;)
But what is true 10/12-bit according to you?
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Larouso on April 10, 2020, 07:17:35 PM
came over from the EOS M and Dannes builds... love those - but now completely blown away by what the 5D3 is capable with this build! Just awesome.

One thing that I stumbled over today was the following behavior: when switching on the camera or going from still mode in movie mode, while having one of the presets "1920 1:1" or "mv1080p_mv720p" active then at first i just get a black screen. If i half push the shutter button to go in zoom mode, liveview appears and stays... behavior is from then on perfectly normal. Same if hit menu button (ore.g.  also trash button) and come back. It`s not happening if the cam goes in standby, and mirror flips back when waking it up again. I can`t remember having this behavior the days before... Is this a known thing?  Only difference I can think of, of doing today is changing frame-rates in canon menu for 60 fps recording. But of course I went back afterwards to 1920/25/All-I.

Already set back everything and did a completely new installation of ML. I am using "crop_rec_4k_mlv_snd_isogain_1x3_presets_2020Feb19.5D3113"
Thanks for any reply if the fault is on my side - if not, maybe a hint for an open ML issue.

Best, Larouso
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on April 11, 2020, 11:28:32 AM
I didn't have time to look into quirks too much changing from movie to photo mode.
As you say. 60 fps could cause some issues as well as waking cam from sleep mode. Hopefully it will be useful with some workaround as I pretty much have no time to dig into the code atm.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: ilia3101 on April 11, 2020, 01:16:00 PM
Quote from: Danne on March 05, 2020, 09:59:29 PM
Told you already ;)
But what is true 10/12-bit according to you?

Sorry, was going to answer but forgot.

I meant "true 10/12 bit" as in: read from sensor the same way as usual (14 bit), but converted down to 12/10 bit in digital space (bits cut off)

Also "true" 12/10 bit would be within 0-4095 or 0-1023, currently it's 2048-~6000 for 12 bit ;)

It works fine though, compression is improved.

Only problem is how the MLV App stripe algorithm sees it as 14 bit, so it can't find any "highlights" to measure stripes.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Larouso on April 11, 2020, 08:22:54 PM
Quote from: Danne on April 11, 2020, 11:28:32 AM
Hopefully it will be useful with some workaround as I pretty much have no time to dig into the code atm.

yes of course - like mentioned, the workaround is easy and fast - just wanted to mention it... since the build looks besides that pretty damn perfect :)
Happy easter days for all of you!
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: rinski on April 14, 2020, 10:11:16 AM
Hello, I would like to know if you have to install the ML firmware on the 2 sd and cf cards at the same time, to record with both simultaneously, how the expansion sd works and what limitations this type of recording has on 5d3 in short.
Thank you very much.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: ilia3101 on April 14, 2020, 06:16:30 PM
Quote from: rinski on April 14, 2020, 10:11:16 AM
Hello, I would like to know if you have to install the ML firmware on the 2 sd and cf cards at the same time, to record with both simultaneously

No, you only need to install it on one of the cards.

Quote from: rinski on April 14, 2020, 10:11:16 AM
how the expansion sd works and what limitations this type of recording has on 5d3 in short.

It works by writing files to both cards at the same time (.MLV on CF card, .M00 on SD card), you must put files from both cards in the same folder before you can process them as videos. No limitations anywhere, only increased speed.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Dmitriy84759 on April 27, 2020, 08:06:17 PM
Sorry guys! I'v just read whole "crop_rec on steroids" topic from first message to last and now see that there is another topic about same theme. My mind already blowing so please could you tell me in short what advantages in this another crop module (with compare of last experimental one from july 22) at this moment? I use 5dm3 1.2.3
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: jzzzyang on April 28, 2020, 01:47:34 PM
Great work,Danne!
Solved so many problems!
Keep going!
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: rinski on May 02, 2020, 11:08:24 AM
Hello, thanks for the answer the other day but I can't find the menu to record the 1920 x 2332 anamorphic adding the two sd + cf cards and at the moment I can only get to 1808, how and where are the settings in the magic latern menu Simultaneous recording and sd speed unlocking.
Thanks again.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: IBIRRU on May 02, 2020, 07:09:49 PM
I kindly ask if is possible to have an updated (last) zipped compiled file to load into 700D 1.1.5

Now I have  crop_rec_4k_mlv_snd_isogain_1x3_presets_2019Apr02.700D115 from Danne repository

I'm able to compile from the unified main branch but I'm not able (I'm sorry) to compile from this branch  :'(

Thanks for your patience  :)

Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on May 02, 2020, 07:41:26 PM
Nothing new for the 700D so no need for updating.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: IBIRRU on May 02, 2020, 08:21:03 PM
Quote from: Danne on May 02, 2020, 07:41:26 PM
Nothing new for the 700D so no need for updating.

Thanks a lot @Danne
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: rinski on May 03, 2020, 10:20:36 PM
Hello, please I can't find in the last update for 5d3 firmware 123 from February 19th where is the module sd_uhs card spanning nor the overclocking and the menu to record sd+ cf, someone can guide me.
Thank you.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on May 04, 2020, 03:57:38 AM
Read answer #363.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: jzzzyang on May 10, 2020, 03:06:04 PM
How to turn off 1.67 stretch in the raw video mode?
Is there a option? Or How to have the option?
Thanks a lot.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on May 17, 2020, 12:53:34 AM
New version:
https://www.magiclantern.fm/forum/index.php?topic=23041.msg216899#msg216899

- Added Custom modes same as for eosm here:
https://www.magiclantern.fm/forum/index.php?topic=24993.msg226973#msg226973
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: rinski on May 19, 2020, 06:25:18 PM
Hello, I would like to see how the m00 files are reproduced and edited in the mlv app, the time recorded on the sd card with the spanning function is lost when trying to import the mlv file from the cf card, there is some operation to be done with the m00 file to be recognized by the mlv app ?, I have not found a solution for the 5d3 with the experimental version May 17.
Thank you.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: ilia3101 on May 19, 2020, 09:07:00 PM
Just make sure the .M00 files are in the same folder as the .MLV files. Then just open the MLV file and MLV App will use the .M00 as needed.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: motionSOUL on May 28, 2020, 07:01:49 PM
Hello all, is it possible to get more than 5 Custom modes (CM1 to CM5)?
I think I have red somewhere we could create our own folder, but when I do that, CM6 for example, the new folder is replacing CM5.
It still appears in Prefs/Config options though but there some folders appear twice.

5DMKIII - 1.1.3 - crop_rec_4k_mlv_snd_isogain_1x3_presets_2020May17.5D3113

Thanks,

S/.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on May 28, 2020, 07:07:20 PM
Yes, up to 13 custom modes is possible.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: motionSOUL on May 28, 2020, 09:21:54 PM
Thanks. I have tried to create 13 folders CM01->CM13 (and deleted all others), but ML doesn't seem to like it. Crash log at the beginning.
Plus in the Movie/Custom Presets menu, only 6 choices appears: OFF - StartupKeys - CM01->CM05, others folders don't show and you can't make them to appear by using the wheel like in the Prefs one. Can we really change the folder names?

Second question, some people seem to get 1920x1080 48fps, but the max. here is 1920x1050 48fps, do I miss something?

By the way, the anamorphic preset is really cool, thanks a lot.

S/.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on May 28, 2020, 09:35:46 PM
Renaming works fine:
(https://i.postimg.cc/FsdCmK3N/VRAM0-PPM-500px.png)

Maybe you´re not following the max eight character rule but who knows. Not enough information provided.(sorry, you said CM01->CM13, no idea why it should cause a crash though)
If you want to expand your custom mode list from Movie tab you need go into source code config.c and find this place:
static struct menu_entry cfg_menusmovie[] =
{
    {
        .name = "Custom modes",
        .priv = &config_new_preset_index,
        .min = 0,
        .max = 6,
        .choices = (const char **) config_preset_choices,
        .select = config_preset_toggle,
        .update = config_preset_update,
        .help = "Choose a configuration preset and start customize(restart needed)."
    },
};


Change it to:
static struct menu_entry cfg_menusmovie[] =
{
    {
        .name = "Custom modes",
        .priv = &config_new_preset_index,
        .min = 0,
        .max = 14,
        .choices = (const char **) config_preset_choices,
        .select = config_preset_toggle,
        .update = config_preset_update,
        .help = "Choose a configuration preset and start customize(restart needed)."
    },
};

I think you get the picture.

Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on May 28, 2020, 11:34:06 PM
New version:
https://www.magiclantern.fm/forum/index.php?topic=23041.msg216899#msg216899

- Removed Custom modes, not working as expected like on eosm. Crashes reproduced as described by @motionSOUL
I advice to download this new build and not use the Custom mode setting implemented before.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: motionSOUL on May 29, 2020, 11:39:25 AM
Too pity to get the Custom modes out. It was such a time saver.
Is the problem coming from your crop-rec version and the fact that you have modified it for the EOS-M or the trouble is coming from a1ex Custom modes development?
I ask because I don't know if I have to report to him on his forum side.

Thanks,

S/.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on May 29, 2020, 12:29:07 PM
If you could test one of the experimental builds by simply adding a few folders and use them from the config section and see what happens that would be nice. Grab a build from the crop_rec_4k branch. Check the downloads section.
Is it crashing every time in my build or after renaming?
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: motionSOUL on May 29, 2020, 02:32:32 PM
Not sure what you asked for, but here are some tests hope it will help. Tell me.
First of all if I stay with CM1 to CM5 folders all is working properly smoothly. Not a single problem when switching from any Custom modes.

5DMKIII - 1.1.3 - crop_rec_4k_mlv_snd_isogain_1x3_presets_2020May17.5D3113 (fresh install).

5DMKIII on.
Prefs / Config preset / OFF - Startup key - CM1 - CM2 - CM3 - CM4 - CM5
CM1 chosen.
5DMKIII off.
5DMKIII on.
Prefs / Config preset / OFF - Startup key - CM1 - CM2 - CM3 - CM4 - CM5 - CM1 - CM2 - CM3 - CM4 - CM5 (now the CM1 to CM5 access are doubled in the list).

Changed a folder name from my Mac: CM2 -> BANANA.
All is OK. Move from CM1 to BANANA and reverse also (from 5DMKIII). All is good.

Card on computer. The BANANA folder is still there, but ML has recreated the CM2 folder.
Changed all the folder names (from CM2 to CM5 because CM1 is used in CURRENT.SET).

5DMKIII on.
Crash detected error message.
Card on computer. All the folders are here, but ML recreated the CM1 to CM5 folders also.

Restart from a fresh copy of the crop_rec.
Make more tests.

My conclusion: The crash seems to occure when there are more than 5 folders in the SETTINGS.
As soon as I start the 5DMKIII, as the crop_rec recreate the missing CM1 to CM5 folders, there are more than 5 folders then, so at the next reboot a crash occures.
Not sure of the 5 folders limit, but it crash when ML recreate other folders.

Thanks,

S/.



Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Walter Schulz on May 29, 2020, 03:10:32 PM
Just guessing: Maybe an issue with "_MACOSX" folders (aka: Resource forks)?
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on May 29, 2020, 03:22:47 PM
Actually. a1ex mentioned the recreation issue before. I thought my lockfile would be detected but seems when changing config directory it searches for the lock file in that very folder. Mistake on my part. I do not know enough "c". Anyway, changing:
            char config_file[0x80];
            snprintf(config_file, sizeof(config_file), "%sfirst", get_config_dir());
            int first_run = config_flag_file_setting_load(config_file);

to this in module.c, seems to fix it:
            char config_file[0x80];
            snprintf(config_file, sizeof(config_file), "ML/SETTINGS/FIRST", get_config_dir());
            int first_run = config_flag_file_setting_load(config_file);

Need to test it some more.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on May 29, 2020, 03:41:54 PM
New version:
https://www.magiclantern.fm/forum/index.php?topic=23041.msg216899#msg216899

- Custom folders are back(added CM1 to CM8. Crash issues should be fixed. Please test @motionSOUL and report back. Also added the fix to eosm and uploaded a new build there as well.

Bleeding edge folks! Always risks included.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: motionSOUL on May 29, 2020, 06:22:49 PM
So far so good. I have changed the folder names without problem (respecting 8 characters).
The file names aren't doubled anymore and all seems OK for the moment. I will keep you inform if I find other things. Thank you so much for your work!

S/.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Walter Schulz on May 29, 2020, 06:39:29 PM
Up to 12 characters is fine. Canon's folder handling looks like 8-Dot-3 naming convention but "dot" can be replaced by other supported characters.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: motionSOUL on May 29, 2020, 06:50:31 PM
Strange, I have tried to name one for example "1_1080_24fps" and it appears "1_1080~" in ML menus...

S/.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on May 29, 2020, 07:09:54 PM
8 characters.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Walter Schulz on May 29, 2020, 07:30:16 PM
Seems to depend on cam or build.

Just tested with different builds on 7D and now I have to do more testing to write another bug report. Looks like lua_fix build has problems. EDIT: False, for whatever reason I had an outdated version installed ...

But 650D seems to work fine with 12 characters.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: names_are_hard on May 29, 2020, 08:28:43 PM
FAT vs ExFAT on the card?  The 8.3 limit is specific to FAT, though I don't know how ExFAT naming limits interact with Canon FW.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on May 29, 2020, 08:48:44 PM
Yes, exactly @names_are_hard.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Walter Schulz on May 29, 2020, 08:54:19 PM
I cannot test exfat with 7D because not supported there: Digic 4. Only ML enabled D5 cams with CF slot are 6D and 5D3.
On 650D it depends on file system as you supposed: ExFAT works with 12 characters but FAT32 only supports 8.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: motionSOUL on May 29, 2020, 11:32:04 PM
I have reformated my SD card in ExFAT and now I have access to 11 characters in the Custom modes and Prefs / Config preset.  :)
Not sure why not 12, but only 11 of my 12 characters names are showing.

S/.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: motionSOUL on May 30, 2020, 09:42:40 AM
Totally off-topic sorry, don't know where to post:
What "battery.drain.rate.rev" is use for ?
It gives me different numbers with the same battery on different Custom modes.

Thanks,

S/.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Walter Schulz on May 30, 2020, 10:11:39 AM
Quote from: motionSOUL on May 29, 2020, 11:32:04 PM
Not sure why not 12, but only 11 of my 12 characters names are showing.

Sorry for messing up!
Actually only 11 characters are supported. If you create a folder with 12 or more you will only see first 11 in cam. And as soon as you select such a folder and use it as preset cam will create another folder. Using first 11 characters. Afterwards you will see 2 folders displayed with identical names.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: motionSOUL on May 30, 2020, 07:15:01 PM
Hello, I encountered another trouble with the crop. Everytime I press the shutter halfway, the 10x zoom is activated.
On other ML versions, the preview kept the same, just the overlays went OFF.

My settings:
Display / Clear overlays: HalfShutter.
Prefs / LiveView zoom tweaks: Zoom on HalfShutter: OFF
Prefs / LiveView zoom tweaks: Zoom with Focus Ring: OFF
Prefs / LiveView zoom tweaks: Zoom with old button: OFF

Any idea? Thanks a lot.

S/.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on May 30, 2020, 07:18:30 PM
Turn it off under the crop mode sub menu.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: motionSOUL on May 30, 2020, 08:45:13 PM
Totally forgot that, thank you Danne!

S/.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: motionSOUL on June 01, 2020, 01:04:21 PM
Hello, I've noticed in all crop rec modes (1050p 48fps / 1920p 50fps / 1920p 60fps), the RAW Video / Preview / Framing is OK but all the Realtime ones aren't centered properly.
The framing is off towards up of the frame. Question: is it possible to correct this by a way or another to be able to aim when shooting or not?

Thanks,

S/.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on June 01, 2020, 03:57:49 PM
I think it's time for you to fire up adtg_gui, read a couple of related posts, and get your hands dirty looking for deeper knowledge.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: motionSOUL on June 01, 2020, 09:28:57 PM
Just a note to confirm that you really have to only use 8 characters in the name of your Custom modes if you want all to work as expected.
If you use more it seems to work properly at first but in fact it shuts down the Custom modes (set automatically to OFF) and mess with the Config presets too.
If you change the Config and restart, the state isn't saved as expected.

@Danne do you know what order is used to list the Custom modes?

Thanks,

S/.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on June 01, 2020, 09:34:32 PM
I think your answer will be found in this thread:
https://www.magiclantern.fm/forum/index.php?topic=8499

About order:
https://www.magiclantern.fm/forum/index.php?topic=8499
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: iaval on June 03, 2020, 08:33:07 AM
Hi Danne,
I'm using your crop_rec_4k_mlv_snd_isogain_1x3_presets_2019Apr02.700D115 build on my 700d, it works fine, but I get ISOless PH err(15) every time I want to use dualISO. Any idea how to fix that one?
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Walter Schulz on June 03, 2020, 04:38:41 PM
It is solvable but it requires some work.

https://www.magiclantern.fm/forum/index.php?topic=7139.msg197146#msg197146
Follow one of the tutorials "Compiling Magic Lantern ..." https://www.magiclantern.fm/forum/index.php?board=25.0 to build your own development environment (quite easy, mostly pre-scripted). Then edit and compile your build using the values found by following first link.

And do it now. This repository will get erased quite soon and there will - most likely - no easy way to get it done after deletion!
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: rinski on June 03, 2020, 07:21:37 PM
Hello, would there be any possibility of full anamorphic 6k with 23,903 even if it was 12 or 10 bits in 5d3 ?.
Thank you.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: iaval on June 03, 2020, 10:00:35 PM
Which repo will be deleted?
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: vstrglv on June 04, 2020, 11:33:59 AM
Thank you Danne for your hard work and wonderful versions of ML. I have some Q:
1. There is an issue:
I use mode "Movie", "Presets", "3K 1:1", the resolution is 2880x1620. If x5 and x10 are enabled in Canon menu and I press zoom button, the resolution is changed to 2880x1320. If only x5 is enabled there is no this issue. I am on Danne's "crop_rec_4k_mlv_snd_isogain_1x3_presets_2020May29.5D3113" 
2. About custom modes. I do not understand how to use "Startup key". I do not see the menu to choose CM.
3. What is an advantage of this CM compare to 
Fast video presets for 5dIII (based on Danne's cine.lua)
https://www.magiclantern.fm/forum/index.php?topic=24679.0
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on June 04, 2020, 01:40:09 PM
3K 1:1 is supposed to be used in x1 mode, not x5. Use the other presets for that.
Custom modes has been discussed recently. Check those threads to get a picture of best usage.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: vstrglv on June 04, 2020, 02:17:37 PM
Of course not x5. I use zoom button only for focusing.
I can not find info about Startup key.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on June 04, 2020, 04:42:39 PM
Yes in x5 mode resolution changes cause you are now in x5 crop mode. But when back in 3k 1:1 all is as expected again.

Select start up mode. Restart camera and hold a start up button i.e SET. You are now in SET "folder". Do your configurations and next time you start hold SET again. All changes will be stored. Skipping SET will start cam normally.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: vstrglv on June 04, 2020, 07:24:19 PM
Thank you for explanation about Startup key. I believed that it can be used for choosing Custom Mods at startup.
About x5:
Cam is in mode 3K 1:1 2880x1620. I press zoom button for better focusing. If x5 is enable in Prefs\LiveView zoom tweaks\Zoom x5 ON (my mistake about Canon menu in previous post), after I press zoom button, the resolution reduced to 2880x1320, but cam is still in 3K 1:1. If only x10 is enable in Prefs\LiveView zoom tweaks\Zoom x10 ON, there is no the resolution reducing.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on June 04, 2020, 08:06:17 PM
Well, 3k 1:1 and x5 zoom is pretty much the same. Only x10 will help for focusing in this case. Just use halfshutter zoomaid(x10) zoom and releasing back to normal.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: 70MM13 on June 06, 2020, 07:49:56 PM
here's a message to let everyone know that sd overclocking is still alive and well for the 5d3!
i just filmed a new zen episode at 3.5k under extremely challenging outdoor full sun and windy conditions with no stops for over 15 minutes thanks to the new overclocking module that ilia and danne have continued quietly working on... and it works like a champ on my sandisk extreme pro 170 card!

anyone else brave enough to play with it should do so!  it's in danne's file repository...

keep up the great work, guys!

overclocking and card spanning have revitalised my workflow and my former 3*3 binning 1920 filming is now always 3.5k continuous!

the 5d3 still has a lot of life as a very serious filmmaking tool...

peace to everyone.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: ilia3101 on June 06, 2020, 08:39:11 PM
It's all Danne ;) (and a1ex originally)
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: 70MM13 on June 06, 2020, 09:00:46 PM
oh my!

i can't believe a1ex has fallen off of my radar.  of course, all thanks go to him first!!!

i miss the days when a1ex was right at the front of everything.  we were so spoiled!

thank you a1ex!!!
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: DeafEyeJedi on June 07, 2020, 12:19:51 AM
Nice. Looking forward to your Zen work @ 3.5K w no stops @70MM13!
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: 70MM13 on June 07, 2020, 11:07:31 AM
thanks!  unfortunately i am still stuck with cellphone internet here making it impractical to upload 4k, so the episodes are downsampled to 1080, but the extra detail and lack of aliasing is very apparent!

i'm working on a new industrial music video and it will be uploaded at 4k :)
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: vstrglv on June 15, 2020, 04:47:16 PM
Quote from: 70MM13 on June 06, 2020, 07:49:56 PM
here's a message to let everyone know that sd overclocking is still alive and well for the 5d3!
i just filmed a new zen episode at 3.5k under extremely challenging outdoor full sun and windy conditions with no stops for over 15 minutes

Good news! What resolution and fps at 3.5k do you use for continued recording?
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: 70MM13 on June 15, 2020, 06:51:12 PM
anywhere in the low 3000's on the x axis at 2.35:1, varying by the framing of the shot i am after/glass being used...
23.976 always for me!

also 14 bit lossless.  no luck at reduced bit depths for me.  never looks right...  it would be nice to see development of bit reduction within the mlv_lite crop_rec module (brain fart!).  i think it would look better :)

if we had true 10 bit data, with bit reduction occuring immediately after image acquisition i think 3840 true continuous recording would be attainable, but i know nothing...  just a hopeful guess!

but... 14 bits is very nice and i am very, very happy!  just need dual card support in mlvapp!!
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: vstrglv on June 16, 2020, 08:51:12 AM
Thank you! Would you please upload 14bit and 12,10 bit  lossless frames?
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on June 16, 2020, 09:56:44 AM
Quote from: 70MM13 on June 15, 2020, 06:51:12 PM
also 14 bit lossless.  no luck at reduced bit depths for me.  never looks right...  it would be nice to see development of bit reduction within the mlv_lite crop_rec module (brain fart!).  i think it would look better :)
It will never look 14bit, that´s for sure. please upload comparison examples and explain why what you see is not true reduced bitdepths.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: ilia3101 on June 16, 2020, 06:46:11 PM
I think "true" reduced bitdepths would mean digitally reduced from 14 bit sensor output, and not done through analogue gain. I guess "true" is not the best word.

In UHD 1:1, 12 bit introduces unusual vertical stripes that don't go away: https://drive.google.com/file/d/1MwIFbHDki9Cmc6sv25xabeCZIaEEXC8g/view?usp=sharing

(that doesn't happen in 3K preset)
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on June 16, 2020, 07:10:21 PM
Interesting. That might be fixable. I use some generic way to reduce bitdepth but it could be tweaked if not your sensor is having this problem. When I have some time over I´ll test to reproduce the issue.
The result is the same I think reducing analog gain vs digitally reduced or whatever we choose to call it. At least I´d like to see proof there´s any difference. So far I haven´t heard of anyone understanding fully how it´s done, except for a1ex of course.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: ilia3101 on June 16, 2020, 07:21:26 PM
Quote from: Danne on June 16, 2020, 07:10:21 PM
Interesting. That might be fixable.
Just realised I should try a dark frame. But I'm not too hopeful, doesn't really look like FPN (no purple/green tinting).

Quote from: Danne on June 16, 2020, 07:10:21 PM
I use some generic way to reduce bitdepth but it could be tweaked if not your sensor is having this problem. When I have some time over I´ll test to reproduce the issue.
Would be very interesting to see if other cameras have this issue.

Quote from: Danne on June 16, 2020, 07:10:21 PM
The result is the same I think reducing analog gain vs digitally reduced or whatever we choose to call it. At least I´d like to see proof there´s any difference.

Maybe there's not as much of difference as I thought. Yesterday was the first time I realised those stripes only appear in UHD mode.

Shouldn't be too hard to do a comparison. MLV App can export to 12 bit from 14 bit I assume.

Quote from: Danne on June 16, 2020, 07:10:21 PM
So far I haven´t heard of anyone understanding fully how it´s done, except for a1ex of course.
Would love to know more :)
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Hydrazine on June 24, 2020, 04:03:52 PM
Hi all,

I'm trying to get my head around the builds with card spanning (was this removed along with sd_uhs?). There seems to be a branch before Danne removed sh_uhs (as per post #363) named crop_rec_4k_mlv_snd_isogain_1x3_presets_card_spanning, last updated Jan 26 2020. Is this the one I should be attempting to compile if I want card spanning and not necessarily SD overclocking? Do I lose the more recent changes and updates of the main crop_rec_4k_mlv_snd_isogain_1x3_presets branch? How do I actually compile this after using Mercurial to clone?
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on June 24, 2020, 04:21:16 PM
I updated my download post added the sd_uhs module. Check bottom. Place it in modules folder and restart camera. Enable it from Movie tab and wait:
https://www.magiclantern.fm/forum/index.php?topic=23041.msg216899#msg216899

If test please report if working or not. I leave absolutely now guarantees. If card gets corrupted or worse you´ve been warned.
With that said it works for me and for @70MM13 but who knows what random users comes up with here.
Good luck.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: 70MM13 on June 24, 2020, 06:45:39 PM
overclocking is working perfectly here.  on a recent episode i was recording at 3072*1308 14 bit lossless continuously for 30 minutes!

the only caveat for me remains: i have to disable overclocking at startup.  if it remains enabled from the last power cycle, recording fails immediately.  it's just a matter of turning it off in the recording menu at shutdown, *not* disabling the module.

i've occasionally forgotten to turn it off before shutting down, and i got around it by starting up in photo mode, turning off card overclock, and then switching to video mode.  worked fine.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on June 24, 2020, 09:34:06 PM
That should not happen with latest version. Did you test latest? Please upload a screen recording as it will reveal any issues.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: 70MM13 on June 24, 2020, 10:13:22 PM
afaik it's the latest... it's the one you uploaded on the day we discussed this a few weeks ago...
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on June 24, 2020, 11:31:49 PM
I need screen recordings. If using a fast card it should be working. It's easy to see if patch is working or not when checking a screen recording. Impossible otherwise.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: 743v04 on June 25, 2020, 12:16:58 AM
I have been using this build with sd_uhs and card spanning running without any issues for a few weeks also. None of this patching issue, works for me with custom presets too. It has been really solid so far but if that changes I will report back. Thanks a ton Danne  :D
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: 70MM13 on June 25, 2020, 03:39:51 AM
here's a vid of what happens here:

https://youtu.be/smiZurp1UhE

there's a bit of a mess on the camera display when i do the first reboot with overclocking already on: two messages are displayed simultaneously, one being about patching success, and the other being failure to load some kind of cropmarks.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on June 25, 2020, 08:07:21 AM
What card are you using? Are you using the very latest build as well? Both ml version and sd_uhs version?
File creation error can be related to card spanning feature.
Test also with an auto focus lens. Also test a crop rec preset, not passthrough. Maybe also turning crop rec off. I really need some narrowing down on this.
Also try and wait for patches to be done before pushing other buttons etc.
Before trying suggestions redownload all from the download post and do a clean reinstall.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Bender@arsch on June 25, 2020, 11:29:13 AM
QuoteIf test please report if working or not. I leave absolutely now guarantees. If card gets corrupted or worse you´ve been warned.
With that said it works for me and for @70MM13 but who knows what random users comes up with here.
Good luck.

It works for me too and very well, but with some small issues.
3.5K works continuous at 12bit

I can rec. in UHD 1:1 continuous at 3840 x 1440 (AR 1,67:1) with live view while recording and 3840 x 1536 without live view while recording, all in 10bit. writespeed ~125MB/s.
I tested on different conditions:
In 34 shots i have 3 bugs: 2 clips have no Audio and 1 is totally broken -> MLV App crashes when opened, export with MLVFS give me some crazy colored stars on white background.
I'm not sure, but i think this happens if i shut down the camera to fast after recording.

In 3K 1:1 i have more trouble. After 30sec record time (AR 16:9) comes an error message.
Crashfile:
QuoteML ASSERT:
0
at mlv_lite.c:2724 (compress_task), task compress_task
lv:1 mode:3

compress_task stack: 1ae938 [1ae9c8-1ad9c8]
0x0006A01C @ b8303c:1ae968
0x00069878 @ 6a084:1ae938

Magic Lantern version : Nightly.2020May29.5D3113
Mercurial changeset   : 6b5fa5a301dd (crop_rec_4k_mlv_snd_isogain_1x3_presets) tip
Built on 2020-05-29 13:38:20 UTC by danne@danands-MBP.
Free Memory  : 210K + 2384K

I don't have the issue from 70MM13.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: 70MM13 on June 25, 2020, 11:42:04 AM
i used all the latest versions, and i had no CF card inserted for the test.  sandisk extreme pro 170. the card was freshly formatted and the camera was reset.  the only thing i did was switch to 1920 for a nicer looking preview ;)

i was impatient during the demo just to show the issue.  it happens the same if waiting before recording.

i will try the various conditions suggested...
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: masc on June 25, 2020, 11:46:10 AM
Quote from: Bender@arsch on June 25, 2020, 11:29:13 AM
... and 1 is totally broken -> MLV App crashes when opened, export with MLVFS give me some crazy colored stars on white background.
is that clip large? Any possibility to upload it for analysis?
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Bender@arsch on June 25, 2020, 12:08:04 PM
https://drive.google.com/drive/folders/1HGOqDNpQvqxeLzXa0f5Zbfzh8bbzl-GH?usp=sharing

wait 10min for uploading.

I think the Problem is, there is no .M00 file. only a MRX file.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: 70MM13 on June 25, 2020, 12:12:51 PM
danne, you were right about the autofocus lens!

problem disappeared immediately.

put cine lens back on... problem is back.

if there's no other solution, can you add the option to have overclock setting off by default for manual focus lenses?
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on June 25, 2020, 02:30:41 PM
Ok, I see what I can do about the issue. Will test when I have my hands on my 5d3 again. Thanks.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: 70MM13 on June 25, 2020, 02:39:10 PM
fingers crossed!  :)
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: masc on June 25, 2020, 10:56:34 PM
Quote from: Bender@arsch on June 25, 2020, 12:08:04 PM
https://drive.google.com/drive/folders/1HGOqDNpQvqxeLzXa0f5Zbfzh8bbzl-GH?usp=sharing

wait 10min for uploading.

I think the Problem is, there is no .M00 file. only a MRX file.
Wait... you recorded with card spanning and got no .M00? That should mean some data is missing. Your file's metadata tells about existing audio channels but no audio data is existing. This was why MLVApp chrashes. I implemented another check which doesn't just trust the metadata... :D If you are able to compile, you can try the fix.
Grüße nach Dresden!
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Grognard on June 26, 2020, 11:58:26 AM
Hi. I'm a long time user but it's my first post here.

I've tried Danne's last build with sd_uhs module and works perfectly on my lexar 256go  633x. A relatively cheap card.
I can reach more than 40 MBs write speed (with peaks at 50mbs).

With card spanning on, in UHD mode, write speed is around 120mbs (80 mbs CF +40 mbs SD)

I'm also able to record continue 1920x804 14bits lossless on Sd card only.

I also tried 5k anamorphic and it works perfectly. No crop factor (!) almost realtime liveview and very good quality. sd_uhs is not necessary but could be usefull on very contrasted scene.
I made a short video with this mode.

https://youtu.be/lCzWh8fe_qU


I will made a more complexe short film with this mode soon.


Thank You Danne (and others A1ex, Lila.. ) for your work.

Max
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on June 26, 2020, 02:13:33 PM
Nice footage. 5k anamorphic is undisputable the most efficient preset of them all if filming 24 or 25fps. What lens was used?
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on June 26, 2020, 03:15:14 PM
New sd_uhs.mo version uploaded tested working with manual lenses in an automated way:
https://www.magiclantern.fm/forum/index.php?topic=23041.msg216899#msg216899
Bottom of the post. Reports if working or not welcome. @70MM13 please test with your lens giving you the error before.

EDIT: Also posted new ml builds adressing yet again custom folder function. I advice to reinstall both ml build and sd_uhs module from this post:
https://www.magiclantern.fm/forum/index.php?topic=23041.msg216899#msg216899
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Grognard on June 26, 2020, 04:44:42 PM
Quote from: Danne on June 26, 2020, 02:13:33 PM
Nice footage. 5k anamorphic is undisputable the most efficient preset of them all if filming 24 or 25fps. What lens was used?

Thanks. I used Canon EF 24-105 L.
Around F.16 a little too closed at my taste.
I had forgotten my neutral filter but the clouds saved me.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Grognard on June 26, 2020, 05:01:53 PM
Danne. Is it possible to make Fps overdrive usable in 5k anamorphic mode juste like the EOS M does?
Thank You.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on June 26, 2020, 05:35:04 PM
Which is how exactly?
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: 70MM13 on June 27, 2020, 03:10:02 AM
the new build plus the new overclock module works perfectly now with manual focus lenses!

thanks!
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: rinski on June 28, 2020, 11:05:06 AM

428/5000
Hello, the sd_uhs module works perfectly with my manual samyang xp 50mm 1.2 lens and with the professional lexar cf 1066x 160 MB / s and sdxc sandisk extreme pro 170 MB / s cards I can record in full anamorphic 6k 1.1 1920 x 3760 in 14 bits with 15.003 fps, indoors and outdoors, maybe 5 more minutes, and I'm wondering if it would be possible to enable 23,976 fps in 12 or 10 bits in this format for smooth movement.
Thank you.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on June 28, 2020, 01:03:48 PM
Not possible with that high resolution.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on July 04, 2020, 08:05:30 AM
New builds:
https://www.magiclantern.fm/forum/index.php?topic=23041.msg216899#msg216899

- sd_uhs speed increase https://www.magiclantern.fm/forum/index.php?topic=12862.msg228659#msg228659
- sd_uhs.mo added as a module to Modules tab
- bench.mo added to Modules tab

Works pretty much the same as for eosm here. But works with 240Mhz(tested on 170Mb/s card)

EDIT: Think I fixed the File create error completely that came with manual lenses sometimes conflicting with patching.

Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Larouso on July 05, 2020, 10:14:49 PM
Quote from: Grognard on June 26, 2020, 11:58:26 AM

With card spanning on, in UHD mode, write speed is around 120mbs (80 mbs CF +40 mbs SD)


Hopefully not a very dump question - but how did you get the write values per card?
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Walter Schulz on July 05, 2020, 10:22:59 PM
File size / recording duration?
As in "MByte/s"...
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Larouso on July 05, 2020, 10:34:42 PM
Quote from: Walter Schulz on July 05, 2020, 10:22:59 PM
File size / recording duration?
As in "MByte/s"...

Sure, thought there is maybe an option to show it live per card, like the mb/s stats that you get if you kill global draw... Thanks anyway for the hint.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: domasa on July 12, 2020, 07:29:58 PM
Quote from: a1ex on November 17, 2018, 04:24:34 PM
As long as these builds contain mislabeled ISO settings, I am not going to support them, sorry.
Is it planned to return this build back to Experiments (https://builds.magiclantern.fm/experiments.html) page?
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on July 12, 2020, 08:22:43 PM
Not as is and probably not a priority from a1ex atm.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Hynek_Tuleja on July 18, 2020, 03:46:14 PM
Hi, I have just tested Danne's build and it's incredible.

I would like to ask, if it would be possible to shot in 60fps in higher resolution (in anamorphic preset for example)?

I use the Canon HD format to shot in 60fps (1920x628 resolution) and then I scale the video to Full HD in MLVApp for slow motion. So is there a way to shot slow motion in higher resolution then Full HD with this build?
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: ewinemiller on July 18, 2020, 06:22:24 PM
Hi all,

If anyone is interested I put together some intermediate presets for 2.20:1, 2:1, and 1.85.1. I was looking for something a little in the middle of the 16:9's crop and the 2.35 aspect ratio. All are continuous on a 1000x KombuterBay without spanning or anything.

I will try to put it up on bitbucket, but have to get my head back around that process again. I don't use it enough to be comfortable or even remember the basics, and might not have time to work through it this weekend.

All changes in crop_rec.c from Danne's crop_rec_4k_mlv_snd_isogain_1x3_presets branch. Thank's Danne for your work. It was super easy to build on.

Regards,
Eric

menu definition

    static struct menu_entry ratios_menu[] =
    {
        {
        .name   = "Ratio",
        .priv   = &ratios,
        .max    = 6,
        .choices = CHOICES("OFF", "2.39:1", "2.35:1", "2.2:1", "2:1","1.85:1","16:9"),
        .help       = "Access six global ratios",
        .help2   = "only anamorphic preset\n"
        },
    };


in crop_rec_needs_lv_refresh

    if (ratios == 1) menu_set_str_value_from_script("RAW video", "Aspect ratio", "2.39:1", 5);
    if (ratios == 2) menu_set_str_value_from_script("RAW video", "Aspect ratio", "2.35:1", 6);
    if (ratios == 3) menu_set_str_value_from_script("RAW video", "Aspect ratio", "2.2:1", 7);
    if (ratios == 4) menu_set_str_value_from_script("RAW video", "Aspect ratio", "2:1", 8);
    if (ratios == 5) menu_set_str_value_from_script("RAW video", "Aspect ratio", "1.85:1", 9);
    if (ratios == 6) menu_set_str_value_from_script("RAW video", "Aspect ratio", "16:9", 10);


In LVINFO_UPDATE_FUNC

    if (CROP_PRESET_MENU == CROP_PRESET_1x3)
    {
        if (ratios == 0x1)
        {
            snprintf(buffer, sizeof(buffer), "anamorph 2.39:1");
        }
        if (ratios == 0x2)
        {
            snprintf(buffer, sizeof(buffer), "anamorph 2.35:1");
        }
        if (ratios == 0x3)
        {
            snprintf(buffer, sizeof(buffer), "anamorph 2.2:1");
        }
        if (ratios == 0x4)
        {
            snprintf(buffer, sizeof(buffer), "anamorph 2:1");
        }
        if (ratios == 0x5)
        {
            snprintf(buffer, sizeof(buffer), "anamorph 1.85:1");
        }
        if (ratios == 0x6)
        {
            snprintf(buffer, sizeof(buffer), "anamorph 16:9");
        }
        if (ratios == 0x0)
        {
            snprintf(buffer, sizeof(buffer), "anamorphic");
        }
    }


in calc_skip_offsets

        case CROP_PRESET_1x3:
            if (ratios == 0x1)
            {
                skip_left       = 206;
                skip_right      = 62;
                skip_top        = 60;
                skip_bottom     = 30;
            }
            if (ratios == 0x1 && set_25fps == 0x1)
            {
                skip_left       = 248;
                skip_right      = 110;
                skip_top        = 60;
                skip_bottom     = 42;
            }
            if (ratios == 0x2)
            {
                skip_left       = 206;
                skip_right      = 62;
                skip_top        = 60;
            }
            if (ratios == 0x2 && set_25fps == 0x1)
            {
                skip_left       = 248;
                skip_right      = 110;
                skip_top        = 60;
            }
            if (ratios == 0x3)
            {
                skip_left       = 268;
                skip_right      = 124;
                skip_top        = 60;
            }
            if (ratios == 0x3 && set_25fps == 0x1)
            {
                skip_left       = 360;
                skip_right      = 118;
                skip_top        = 60;
            }
            if (ratios == 0x4) 
            {
                skip_left       = 340;
                skip_right      = 196;
                skip_top        = 60;
            }
            if (ratios == 0x4 && set_25fps == 0x1)
            {
                skip_left       = 432;
                skip_right      = 190;
                skip_top        = 60;
            }
            if (ratios == 0x5)
            {
                skip_left       = 402;
                skip_right      = 258;
                skip_top        = 60;
            }
            if (ratios == 0x5 && set_25fps == 0x1)
            {
                skip_left       = 488;
                skip_right      = 246;
                skip_top        = 60;
            }
            if (ratios == 0x6)
            {
                skip_left       = 426;
                skip_right      = 282;
                skip_top        = 60;
            }
            if (ratios == 0x6 && set_25fps == 0x1)
            {
                skip_left       = 512;
                skip_right      = 270;
                skip_top        = 60;
            }
            break;

           
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on July 18, 2020, 07:09:09 PM
Nice. Will check it out when I have the chance.
Ongoing code atm:
https://bitbucket.org/Dannephoto/magic-lantern_dannephoto_git/src/master/

I piggy back on a git account but still include hg commits working with my compiler tool:
https://bitbucket.org/Dannephoto/ml_compiler-git/src/master/
After commits I push all hg and code changes to the git account. It's all temporary. Bitbucket are deleting all mercurial sources. Bad move on their part.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: ewinemiller on July 19, 2020, 01:11:45 PM
Since the "where we're landing" question doesn't seem to be answered yet (or at least I couldn't pick it out of the end mercurial thread), I just forked your git and stuffed the changes here https://bitbucket.org/ewinemiller/magic-lantern_dannephoto_git/src/newpresets/.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: GullRaDriel on July 20, 2020, 08:46:05 AM
I got some problems while trying to make a raw video 3k + fps override @2.5:
ML ASSERT:
RAW_IS_IDLE
at mlv_lite.c:969 (measure_compression_ratio), task shoot_task
lv:1 mode:3

shoot_task stack: 1c2498 [1c2600-1c0600]
0x000B6A18 @ 956f0:1c2590
0xUNKNOWN  @ b6a6c:1c2578
0x00B3B854 @ b3d710:1c24d8
0x0006A01C @ b3b91c:1c24c8
0x00069878 @ 6a084:1c2498

Magic Lantern version : Nightly.2020Jul15.5D3113
Mercurial changeset   : 8f38ee536de0+ (crop_rec_4k_mlv_snd_isogain_1x3_presets) tip
Built on 2020-07-15 19:47:31 UTC by danne@danands-MBP.
Free Memory  : 213K + 2445K

Did not stumbled upon this before, so I don't know if it's related to your build only or not.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on July 20, 2020, 08:58:58 AM
Test another build and compare.
If you want more help more info will be needed.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: wib on July 20, 2020, 10:57:49 AM
Quote from: ewinemiller on July 18, 2020, 06:22:24 PM
Hi all,

If anyone is interested I put together some intermediate presets for 2.20:1, 2:1, and 1.85.1. I was looking for something a little in the middle of the 16:9's crop and the 2.35 aspect ratio. All are continuous on a 1000x KombuterBay without spanning or anything.

I will try to put it up on bitbucket, but have to get my head back around that process again. I don't use it enough to be comfortable or even remember the basics, and might not have time to work through it this weekend.

All changes in crop_rec.c from Danne's crop_rec_4k_mlv_snd_isogain_1x3_presets branch. Thank's Danne for your work. It was super easy to build on.

Regards,
Eric

Amazing ! how can we download it as a autoexec "classic ML file" ? (I know nothing about coding, I'm more into video..)
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on July 20, 2020, 11:24:41 AM
Ask ewinemiller for a build. My laptop decided to die today so taking a real break here.
Looks like he uses ratios directly from RAW video section so meanwhile you should be able to change from there directly as well.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: ewinemiller on July 20, 2020, 11:27:33 AM
Quote from: wib on July 20, 2020, 10:57:49 AM
Amazing ! how can we download it as a autoexec "classic ML file" ? (I know nothing about coding, I'm more into video..)

Only been tested lightly with 1.23. It's just the croprec module. Drop it into the ML\modules folder of your card. It should play nicely with the rest of Danne's latest build.

https://www.dropbox.com/s/sqj6ija5ttf2svc/crop_rec.mo?dl=0

Edit: Just saw Danne's post and I'll try to update this later today with full builds.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on July 20, 2020, 11:54:11 AM
Should be fine with a single crop_rec.mo too if you use the updated code.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: wib on July 20, 2020, 11:55:45 AM
along with the 15 july version of yours ?
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on July 20, 2020, 12:40:06 PM
My latest builds.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: wib on July 20, 2020, 12:41:48 PM
Thank you ! 👍🏻
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: wib on July 21, 2020, 01:48:45 PM
(sorry, can an admin delete this post ?)
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Bender@arsch on July 22, 2020, 01:19:52 AM
@Danne
Is it possible to make a 2x2 Preset like 2880x1620 (16:9) or better a 1x2 Preset like 2880x1920 (2.5:1) = 5760x1920, or is this still impossible?
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: masc on July 22, 2020, 11:53:50 AM
Quote from: Bender@arsch on July 22, 2020, 01:19:52 AM
Is it possible to make a 2x2 Preset like 2880x1620 (16:9) or better a 1x2 Preset like 2880x1920 (2.5:1) = 5760x1920, or is this still impossible?
Have a look on the bayer matrix. 2x2 is only possible theoretically for b/w, because you loose the color information.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Bender@arsch on July 22, 2020, 12:24:21 PM
I am not a programmer and unfortunately I already thought that it would not work...
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: masc on July 22, 2020, 01:17:41 PM
Quote from: Bender@arsch on July 22, 2020, 12:24:21 PM
I am not a programmer and unfortunately I already thought that it would not work...
This has nothing to do with programming, but with how a sensor is build. You have a RGGB layout on it. And if you just read 2x2 and start at R, you get only R pixels.
(https://www.researchgate.net/profile/Emanuel_Marom/publication/45709080/figure/fig1/AS:307400574816256@1450301416028/Typical-Bayer-Matrix-with-3-main-colors-in-the-RGGB-configuration-In-this-paper-each_Q320.jpg)
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Volumetrik on July 28, 2020, 10:25:50 PM
Not sure if this has been addressed before, but the only module I see when I install the Jul15 build is the Bench.mo module.

I am using the 113 version and I re-installed ML, formated, low level, tried an other card, reset to ML defaults, even created the SETTINGS folder and made a SD_UHS.EN file. I can see and load all the modules with the nightly exp 2018Jul22 build, but for some reason, this build I can't load or see any other module than bench.mo.

A lens is installed, only the SD card is in and the camera is in movie mode.

(https://i.ibb.co/JcJs7NT/VRAM0.png)
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on July 28, 2020, 10:48:00 PM
All modules are autoloaded except for bench.mo. I also plan on adding adtg_gui.mo as an optional module.
Do note that my builds comes from a fork from another experimental build. This is actually experimental on top of another experimental build.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Volumetrik on July 29, 2020, 12:08:35 AM
Quote from: Danne on July 28, 2020, 10:48:00 PM
All modules are autoloaded except for bench.mo. I also plan on adding adtg_gui.mo as an optional module.
Do note that my builds comes from a fork from another experimental build. This is actually experimental on top of another experimental build.


That explains it ! Thanks, I do feel dumb now. From my understanding of the replies on this thread, the card spanning module is in the raw video section ? I cannot find it, even in the advanced menu. Could only find one post mentioning that it was in the Raw video tab, but I don't see it there.

EDIT : Found it. You need the CF card in as well for it to appear. Sorry for bothering.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on July 29, 2020, 12:15:19 AM
You need both SD and CF card inserted for it to show up. For the very same reason you won´t see the SD overclock option if not a sd card is inserted.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Grognard on July 30, 2020, 12:15:34 PM
Hi all,


l did a little comparative test of the sharpness between the 3k, 3.5k UHD, 4K 12.5FPs, 5.7k 7fps, 5k anamorphic, fullhd, fullhd h264 modes. I shot with an EF L 24-105 canon Lens at F.14 compensating the cropfactor. All were upscalled or downscalled in 4k (true 4096) which I take as a reference resolution. We can see that the sharpness is better in 1: 1 mode than in anamorphic mode, but the difference is minimal. The difference between UHD and 3.5k is not really obvious. The FullHD is very mushy and the h264 ... let's not even talk about it;) In conclusion, the most interesting modes are
- the anamorphic mode because there is no crop and a real-time feedback, the loss of sharpness compared to 3.5k is not so bad. it looks very well in 4k.
- 3.5k mode, the crop factor is only 1.6 and there is still usable feedback (zoom x5). But the ratio is wider than the 2.39. If you want more vertical resolution you have to go to 3k.

- full HD, it's ugly but it works so well!

Thank you Danne for your  incredible  build!

https://youtu.be/LmB3cLTk8hQ
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: dtr on July 31, 2020, 06:45:21 PM
Just to be on the safe side what is the max safe temperature for 5D3 please? I had over 47C today in just a couple min so want to play it safe.

I'm just trying to figure out a reasonable higher res workflow. Full HD from nightly works fine and is a big improvement over H264, and in my case keeping 16mm as close to 16mm is very important. I know the answer is R5 but hopefully this will still keep on developing.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on July 31, 2020, 10:14:13 PM
Thanks for the test!
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: DeafEyeJedi on August 02, 2020, 10:27:29 AM
Quote from: Danne on July 18, 2020, 07:09:09 PM
Nice. Will check it out when I have the chance.
Ongoing code atm:
https://bitbucket.org/Dannephoto/magic-lantern_dannephoto_git/src/master/

I piggy back on a git account but still include hg commits working with my compiler tool:
https://bitbucket.org/Dannephoto/ml_compiler-git/src/master/
After commits I push all hg and code changes to the git account. It's all temporary. Bitbucket are deleting all mercurial sources. Bad move on their part.

Thanks for the heads up, @Danne! I've went ahead and ran the latest Compiler on this Hackintosh running 10.15.5 and all seems well. I will try to spit out a build as soon as I can.

Actually could I get a reminder on which branch is the one that is usually found on the beloved bitbucket download page (Option 1 or 5 from the branch option menu)?

Appreciate the recent quick fix for Catalina's environmental friendly when it comes to compiling the latest. Always carrying the EOSM w me everywhere I go. Such a gem!
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on August 02, 2020, 11:40:16 AM
Here´s recent magic lantern compiler:
https://bitbucket.org/Dannephoto/ml_compiler-git/downloads/

Mlv App compiler:
https://bitbucket.org/Dannephoto/mlv_app_compiler-git/downloads/

eosm branch:
https://bitbucket.org/Dannephoto/magic-lantern_jip_hop_git/src/master/

5d3 branch:
https://bitbucket.org/Dannephoto/magic-lantern_dannephoto_git/src/master/
Title: Cannot format SD and keep ML on it
Post by: GullRaDriel on August 04, 2020, 09:37:02 PM
Hello.
Since the last update with sd overclock module I can't seem to be able to format sd card AND keep ML on it. It's formatting everything. The usual menu and copy log before formatting is gone.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on August 04, 2020, 09:47:23 PM
Yes, it's intentional. Formatting camera with sd uhs enabled will potentially destroy your sd card. Havn't found a way to disable patching yet so for now I disabled the keep ml after format function.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: sm105 on August 05, 2020, 08:42:34 PM
Can rack focus be used with raw video? I can set the endpoints and preview the focus change in liveview, but I'm not sure how to activate it after starting to record.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: GullRaDriel on August 05, 2020, 09:43:36 PM
Well, ok.
And when you say "Havn't found a way to disable patching yet" does it means that even with the moduel disabled the patching is still here ?
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on August 05, 2020, 09:54:02 PM
No, it´s only patching when enabled in the menu. The solution could be to disable the sd_uhs menu when performing the reformat thingy(if sd patch is on) and probably not so hard to do but I havn´t been able to yet. Need more time.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: has_abandonment_issu on August 07, 2020, 10:58:13 PM
Hi there! I wanted to say thank you for all the work on this build. It's been such a huge upgrade.

I found a weird quirk using the card spanning module. I'm using the July 15 3113 build. Not using sd overclocking as it's not working for me.

The 5x crop preset has an extra 5mbps without global draw using card spanning vs UHD or anamorphic. In those modes it tops out at 111mbps (91 cf - 20 sd) but in 5x 3.5k, the CF card climbs to 94-95, for a total of 115mbps! I think that mode is using fewer hardware resources or something and that translates into more recording bandwidth. I don't know if the way these modes behave is already well known, but it seemed worth mentioning. I am noticing differing (but consistent) speeds using different presets, with or without global draw.

I'm using a Pixelflash 1107x 64gb card and a Sandisk Extreme Pro 95mbps 32gb.

Kill Global Draw set to ON.

Edit: also it looks to me like the recording rate estimation is using 14bit raw recording in it's calculation, even though the files are in 12bit, giving a larger estimate than actual. Is this true? It seems like my recording times reflect what I would expect to get with 12bit.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Bender@arsch on August 08, 2020, 08:28:07 AM
QuoteI am noticing differing (but consistent) speeds using different presets...
https://www.magiclantern.fm/forum/index.php?topic=12862.msg228848#msg228848

Global draw needs extra resources, so it slow down the maximum writespeed.
maximum speed with Cardspanning and overclocking for now is BTW. 131MB/s (Nobody knows why). - > without global draw

Quote
Edit: also it looks to me like the recording rate estimation is using 14bit raw recording in it's calculation, even though the files are in 12bit, giving a larger estimate than actual. Is this true?
Yes, it shows 14bit lossless - > set in drop down menu. This is because the settings for 12,10bit... Is just a tweaking from 14bit lossless. You can check the white and blacklevel in MLVapp.

What happens if you using SD overclocking?
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Volumetrik on August 08, 2020, 03:07:01 PM
When I use Global draw & RAW Zebras in combination with card spanning + SD overclocking, I get around 112-115 MB/s while recording.

I set my resolution to get me 110 MB/s and I'm usually covered for continuous recording in pretty much all scenarios.

Extreme Pro 64gb 170MB/s + Lexar 128gb 1066X CF card.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Grognard on August 08, 2020, 03:36:32 PM
Quote from: Bender@arsch on August 08, 2020, 08:28:07 AM

Global draw needs extra resources, so it slow down the maximum writespeed.
maximum speed with Cardspanning and overclocking for now is BTW. 131MB/s (Nobody knows why).

True for UHD mode but you can reach higher writespeed in 4K half FPS or 5'7k full liveview (170 MB/S -100 CF +70 SD).
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Bender@arsch on August 08, 2020, 05:42:36 PM
@Grognard

Not really , the showing writespeed is incorrect in other modes. See this test:

https://www.magiclantern.fm/forum/index.php?topic=12862.msg228848#msg228848
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: has_abandonment_issu on August 08, 2020, 06:23:15 PM
Quote from: Bender@arsch on August 08, 2020, 05:42:36 PM
@Grognard

Not really , the showing writespeed is incorrect in other modes. See this test:

https://www.magiclantern.fm/forum/index.php?topic=12862.msg228848#msg228848

I see that there's a lot going on here with the writespeed calculations.

You also asked what happens when I try to use SD overclocking. I am using a 95mbps Sandisk Extreme Pro 32gb SDHC card. I have a 128gb 170 coming in the mail on Monday.

When I use the overclocking, I turn it on in the settings, turn off the camera, turn back on, wait for the prompt to say it's been patched. Then when I try to record, I have gotten both "card full," and "recorded has stopped" errors. No frames recorded. I have tested it spanned with my CF card (pixelflash 1107x 64gb) and on it's own. No luck. I have also tried both 3123 and 3113 builds to see if that made a difference. Nothing. I also tried formatting multiple different ways (exfat, fat32), but I don't actually know anything about formatting cards so that was just at random and it didn't do anything.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on August 08, 2020, 06:40:36 PM
I was expecting the card 95mbps Sandisk Extreme Pro 32gb to work with latest sd uhs patch.
Could you tell me what ml version you are using? Full name or link to exact build?
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Bender@arsch on August 08, 2020, 06:43:12 PM
@has_abandonment_issu

This is a knowing issue. Try low level format in Camera (SD card) and have fun ;)
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: has_abandonment_issu on August 08, 2020, 06:57:57 PM
Quote from: Danne on August 08, 2020, 06:40:36 PM
I was expecting the card 95mbps Sandisk Extreme Pro 32gb to work with latest sd uhs patch.
Could you tell me what ml version you are using? Full name or link to exact build?

Hi Danne! I have been having so much fun testing this build and exploring the new creative options. You and everyone should be really proud of how much you've put into it.

I have tested these two builds:

crop_rec_4k_mlv_snd_isogain_1x3_presets_2020Jul15.5D3113
crop_rec_4k_mlv_snd_isogain_1x3_presets_2020Jul15.5D3123

I did most of my testing on 3113, before briefly changing to 3123 and getting the same error. It looks to me like I'm having a similar issue as IDA_ML.

I just did it again to see exactly what was happening. Here's how it goes, I apologize if this is an annoying amount of detail, but I know you guys are troubleshooting so I'll try to describe everything:

- turn on camera, wait for it to load.
-turn on overclock module
-turn off camera
-receive patching notification
-patching done!
-go to live view, press record
-"recording has stopped automagically" "flushing buffers" "nothing recorded to card"
-turn off camera
-light stays on significantly longer than usual, about 6 seconds
-turn camera on
-"magic lantern was not shut off cleanly, skipping module loading"
-turn camera off
-light normal
-turn camera on
-receive patching notification
-patching done!
-go to ml menu and turn off patching
-turn off camera
-notification light stays on too long again
-turn on camera
-"magic lantern was not shut off cleanly"

and at that point I'm stuck in a loop and have to format the card.

This error has been consistent.

Edit:
Quote from: Bender@arsch on August 08, 2020, 06:43:12 PM
@has_abandonment_issu

This is a knowing issue. Try low level format in Camera (SD card) and have fun ;)

I will try this right now.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: has_abandonment_issu on August 08, 2020, 07:20:10 PM
Same error after low level format. First I tried formatting the card with magic lantern still installed. Then reinstalled magic lantern and tested it. Same error. Then I formatted the card on the computer, then low level formatted it again in the camera. Same error.

This time I tried again but without the CF card.

The error read "card full," followed by "audio failed to stop recording: state 3"  or something like that. So I disabled sound recording. Returned "card full," with no other error.

Then I went into the magic lantern menu and navigated through the various tabs to see if Magic Lantern can show what it thinks the available memory on the card is, and while simply scrolling (no change to any settings) I got an error that said "please send coredump.dat to the devs" or something along those lines.

Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on August 08, 2020, 07:41:41 PM
I am not sure what is going on here and don't have my camera here but if it's not working giving card full etc it's better to stay off the patch on this particular card. I expect this patch to either work fully or not at all, no in betweena.
Not sure what coredump is caused for in this case but just stay off patch on that card.
Please remember. It is bleeding edge. I tried to prevent serious errors but nothing is finished.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: has_abandonment_issu on August 08, 2020, 07:44:09 PM
This seems like it could be relevant.

https://i.imgur.com/nS2MvTZ.jpg

I can link pictures of the rest of the red ones if this is anything.

Quote from: Danne on August 08, 2020, 07:41:41 PM
I am not sure what is going on here and don't have my camera here but if it's not working giving card full etc it's better to stay off the patch on this particular card. I expect this patch to either work fully or not at all, no in betweena.
Not sure what coredump is caused for in this case but just stay off patch on that card.
Please remember. It is bleeding edge. I tried to prevent serious errors but nothing is finished.

I purchased this card with free amazon 1-day shipping to keep me busy until my 128 170mbps sandisk arrives Monday. It was $13. So I don't mind destroying the card if it helps debugging. So long as there's no risk to the camera itself.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Bender@arsch on August 08, 2020, 07:55:09 PM
@has_abandonment_issu

Which Mode do you use, resolution, bit...

because I have some trouble with 3K mode:
Interestingly I found out, that this mode + Cardspanning + overclocking only works with 14bit lossless continuously. If I set the same settings (AR 16:9, 2848x1602 at 14bit lossless works continously on all condition, without global draw) and change it to 10 or 12 bit - > compression error bla bla bla, everytime.

@Danne
Any Idea?
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on August 08, 2020, 07:59:48 PM
10 or 12bit from what menu? Under raw video menu not recommended.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Bender@arsch on August 08, 2020, 08:08:10 PM
Not in dropbdown menu. I mean the 10  or 12bit lossless (14bit lossless tweaking). Do you need a small video with this error?
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: 70MM13 on August 08, 2020, 08:09:57 PM
hi everyone,
i'm having a lot of fun with the 5.7k mode, in fact i love it!
i'm wondering if there's a way to increase the vertical resolution to capture 2.35:1 without reducing the horizontal resolution?
with spanning and overclock there is plenty of headroom but i just can't find a way to get that little bit more vertical capture...
thanks!
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on August 08, 2020, 08:16:53 PM
Quote from: Bender@arsch on August 08, 2020, 08:08:10 PM
Not in dropbdown menu. I mean the 10  or 12bit lossless (14bit lossless tweaking). Do you need a small video with this error?
Not sure where you select from. The bitdepth options from Crop mode sub menu should work.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Bender@arsch on August 08, 2020, 08:23:55 PM
Movie, bitdepth, 8bit, 9bit, 10bit, 12bit- > only with 3K mode I have the errors.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on August 08, 2020, 08:29:28 PM
Ah, yes, Movie tab. Tell me exact name of presets giving errors and I'll try to reproduce later.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Bender@arsch on August 08, 2020, 09:18:32 PM
Here is a short video and the error file from the 3K mode test:

https://drive.google.com/drive/folders/1ABS7sbXXXDIjMHNzeFNeAr9lBh2Lj_3z?usp=sharing

I get this error only if i use 10 or 12 bit lossless, not with 14bit lossless. The resolution is not important, i use this resolution for 14bit lossless (filezise analyse says 125 up to 130MB/s -> correct writespeed). So this is the limit for continuosly record at 14bit lossless and AR 16:9.

The error comes sometimes immediately and sometimes after 30sec.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on August 08, 2020, 09:37:44 PM
I know about this error. It´s always triggered from the same place in mlv_lite.
Usually I don´t add any extras to global draw but stick to minimun per installation. I also don´t change ratios from under RAW video menu but stick to Movie tab ratios but that´s maybe the case already. Lastly I didn´t test 16:9 extensively. Is it working better with 2.39:1? Is it working without sd patch added? Without using shutter fine tuning?
Thanks for the vid.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Bender@arsch on August 08, 2020, 10:01:54 PM
I set kill global draw and I tested as well with standard settings. I change ratio because of the error, so no difference. I tested 2.39:1 at 10bit - at the last resolution (2848) it works, but with 3072 not. The same without SD overclocking and the same without audio and the same without fine tuning. This all is only happens in 3K mode with Cardspanning.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on August 08, 2020, 10:15:23 PM
Ok, cool. I'll have a look. Maybe tomorrow.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Volumetrik on August 08, 2020, 11:42:15 PM
Quote from: has_abandonment_issu on August 08, 2020, 06:23:15 PM
I see that there's a lot going on here with the writespeed calculations.

You also asked what happens when I try to use SD overclocking. I am using a 95mbps Sandisk Extreme Pro 32gb SDHC card. I have a 128gb 170 coming in the mail on Monday.


I have that same card (32Gb SDHC 95MB/s). It's around 6 years old and I have the same issue. My 64Gb SDXC 170MB/s gives me no problems.

So it would seem that the SanDisk Extreme Pro SDXC 170MB/s cards work great with the SD_UHS patch, but not the SDHC (32gb or less) counterparts.

I just came back from shootings some clips and I was using 3520x1320 14-Bit lossless and 1920x2340 (5.7k) 14-Bit lossless all continuous with green seconds counter. The preview was going from black & white to color depending on the complexity of the scene. I was using ETTR methods where when I saw raw (green) zebras, I backed out 1/3 of a stop and then recorded.

I'm on the Jul15 firmware 1.1.3.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on August 09, 2020, 12:14:10 AM
Seems like the 170Mb/s cards above 32gb are holding up best so far. If anyone is willing to test with a sandisk 300Mb/s card please let me know. I want to do a short test with 240Mhz setting enabled. All tests with 170Mb/s cards are indicating "almost' working but always fails after talking a photo or enabling raw video modes. Maybe the 300Mb/s card is what will work.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: has_abandonment_issu on August 09, 2020, 12:19:44 AM
Thanks Volumetrik I am pretty excited to get a 128gb and test it out. I'll update when it arrives.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: 70MM13 on August 09, 2020, 01:41:40 PM
does anyone have any experience with the sony "tough" cards?

check out the specs and price on this one:

https://www.amazon.ca/Sony-Tough-M-UHS-II-SF-M64T-T1/dp/B07YNVHBRB/ref=pd_vtp_147_5/137-0597058-5496919?_encoding=UTF8&pd_rd_i=B07YNVHBRB&pd_rd_r=ad1e4f25-8b40-444f-b8cd-bfa782b38ec4&pd_rd_w=JOLuj&pd_rd_wg=efYlY&pf_rd_p=75befe49-ac36-4a58-aab5-12fc18b6d465&pf_rd_r=3FVGYCBKGFCQ401TNFQ6&psc=1&refRID=3FVGYCBKGFCQ401TNFQ6

Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on August 09, 2020, 02:14:01 PM
Here is a version with all three registers included, 160/192/240 Mhz:
https://bitbucket.org/Dannephoto/magic-lantern_dannephoto_git/downloads/sd_uhs.mo

Above version will work with my latest builds from july 15th.

No reason to use this module more than for brief testing. With brief tests I mean enable bench.mo and run the 1 minute benchmark test. Test scenario.

With only the SD card in the camera. No CF card inserted in camera that is! Do following:

1 - Select for instance sd overclock 240Mhz, restart camera in photo mode.
2 - Run benchmark test and check the numbers. If working the first time numbers should be around 105Mb/s read speed and I think around 90 write speed.
3 - After running benchmark test take a photo then run the benchmark tests again. Usually write speed works like before but read speed will take off to around 5000Mb/s. Once that happens you might as well turn off the camera and consider the 240Mb/s patch not working.

If you for some reason don´t want to run benchmark routines above, a simple useful test would be to simply apply the patch, then enable a movie preset and start recording. Do multiple recordings to see If it works without early stops.

Do not format card in camera with sd patch applied. If formatting see to it that sd uhs patch is set to OFF.

What cards havn´t been tested? Well. 32gb sandisk 95mb/s seems not to work with 160Mhz. Will it work with 240Mhz?
We still havn´t tested the 300mb/s sandisk cards either 32gb or above. Mainly tests should be if you have any of these cards.
Don´t hesitate to ask questions and be careful. There are risks:
https://www.magiclantern.fm/forum/index.php?topic=25210.msg229534#msg229534
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Walter Schulz on August 09, 2020, 02:17:32 PM
Would be a first here: UHS-II card in overclocked UHS-I compatibility mode.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on August 09, 2020, 02:21:18 PM
Quote from: Walter Schulz on August 09, 2020, 02:17:32 PM
Would be a first here: UHS-II card in overclocked UHS-I compatibility mode.
You´,ve been successful? But not on a 5DIII right? What card exactly?
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Walter Schulz on August 09, 2020, 02:32:43 PM
No, just wanted to express it would be a first here = ML community. Don't know if SD overclocking with UHS-II in UHS-I mode was ever tested somewhere else.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on August 09, 2020, 02:42:36 PM
Yes, aware of this. Probably not gonna work but might be a slight possibility.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on August 09, 2020, 08:06:05 PM
Quote from: Bender@arsch on August 08, 2020, 10:01:54 PM
I set kill global draw and I tested as well with standard settings. I change ratio because of the error, so no difference. I tested 2.39:1 at 10bit - at the last resolution (2848) it works, but with 3072 not. The same without SD overclocking and the same without audio and the same without fine tuning. This all is only happens in 3K mode with Cardspanning.
I can´t reproduce this issue. Recorded longer taes with sd overclock on 24 fps 3072 resolution 10bit. Works ok here.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Bender@arsch on August 09, 2020, 09:23:44 PM
Interestingly.
How long you have recorded? Mostly it happenes in the first 45sec. Sometimes it is depending on what you film (how fast it happens).

I used a SanDisk Extreme Pro 170MB/s 128GB and a Komputerbay Prof. 128GB 1066x.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: GullRaDriel on August 09, 2020, 11:19:19 PM
I'm currently testing with a Lexar Professional SD3XCII 10 128GB x1000 with a theoric write speed of 150MB/s . When I'll test I'll also do it with the CF, it will be a Lexar Pro UDMA7 1066x with a theoric write speed of 160MB/s.

Wait and see.

Edited: fixed wrong assumption
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Walter Schulz on August 09, 2020, 11:32:57 PM
Not sure which card you are using. Lexar lists a "Lexar Professional 1000x SDHC/SDCX UHS-II" card with 150 MByte/s labeled but for read speed only. Cameramemoryspeed tested the 128 GB variety and it had a maximum speed (without overclocking) below 96 MByte/s.
There are at least two varieties of Lexar 1066x. One with premium write speeds (quite close to theoretical write performance) and another one not that fast.
I strongly recommend testing them with a decent cardreader.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: GullRaDriel on August 09, 2020, 11:53:41 PM
Well. The numbers seem to give you a point: reading speed is increasing way more than writing.

Here are the results, as following: mode,1st Write/1st Read/2ndWrite/2ndSpeed

sd module off: 20.5 / 21.8   / 18.8 / 21.8
160 MHz:        50.3 / 70.1   / 65.6 / 70.1    ===> if only WRITE speed is what counts, that mode is the best as it's overcranked to the minimum and it gives the same average write speed results
192 MHz:        64.4 / 83.0   / 49.8 / 83.1
244 MHz:        63.5 / 101.7 / 50.7 / 101.8   ===> Best READ mode

CF+SD Write: SD / CF => total
OFF       : 14.7 / 113.5 => 128.2
160 MHz: 43.9 / 93.1   => 137
192 MHz: 42.3 / 94.3   => 136.6
240 MHz: 54.7 / 89.5   => 144.2



I'll try to make some shot / raw videos in different mode tomorrow. It's anyway a BIG difference of minimum x2 in terms of write speed, just using the 160MHz.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Walter Schulz on August 09, 2020, 11:55:39 PM
Please run benchmarks with cardreader connected to your computer first. Both cards.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: GullRaDriel on August 10, 2020, 12:05:01 AM
I don't think I have a decent card reader, as I can record quicker than reading / writing the CF on the computer. It may not be bad (the adapter) with the SDHC, will try tomorow.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Volumetrik on August 10, 2020, 03:48:09 AM
Quote from: GullRaDriel on August 09, 2020, 11:19:19 PM
I'm currently testing with a Lexar Professional SD3XCII 10 128GB x1000 with a theoric write speed of 150MB/s . When I'll test I'll also do it with the CF, it will be a Lexar Pro UDMA7 1066x with a theoric write speed of 160MB/s.

Wait and see.

I think you may be referring to a discontinued model of that card. It just so happens that I have a 64GB version of said card.

Can you confirm that you're talking about this one ?
(https://i.ibb.co/zfmqffK/IMG-5957.jpg)

If so, I have tested it multiple times with card reader benchmarks and in camera with & without SD_UHS. My conclusion was that I found it very unstable performance wise. Sometimes I could get 118MB/s (SD_UHS 160Mhz + Spanning) writing for minutes at a time on the 5D3, other times my SD UHS-II card reader benchmarks were sub-standard, like 40MB/s and dropping.

Bad performance, to the point where I was seriously doubting the card's legitimacy. I bought it second hand with the 128GB 1066x 170MB/s Lexar card which runs flawlessly, so can't be sure.

For the reasons stated above, I don't use that card and I don't recommended for our use case.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: GullRaDriel on August 10, 2020, 11:23:26 AM
My cards:

(https://i.ibb.co/z8KC7JW/dav.jpg)
Obviously I was tired last evening, but at least I did some benchmarks on the mkIII ^^

What can I use to benchmark the cards on a computer ? Tested them with SpeedOut :

The SD is reporting an average of 87 MB Read / 77 MB Write
The CF is reporting an average of 133 MB Read / 130 MB Write
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: GullRaDriel on August 10, 2020, 01:06:35 PM
Okay, I did some test with the 166MHz Mode.

It's recording continuous 3072x1320,12-bits lossless (preview is cropped, but with framing it's usable to aim/focalise). I've ran a 1 minute long recording, kept green all the time. BTW I'm also recording sounds. I moved the camera a lot to make some sudden image change (and thus trigger some more activities), changed exposition during recording. Additional settings: card spanning on, preferred card CF, global draw off when recording. If it's counting, all my cards are formatted to exFat with default settings (did not played with cluster size).

ALL WORKED LIKE A CHARM. It was not the case before. It was working, but only for a couple dozen of seconds and with yellow indicators at best. What I can say is that the 166 MHz mode made my cards usable for raw recording.
I'm pretty aware that these are not the best fit cards for ML& MKIII, but the last versions of Danne's ML and modules made them pretty usable for the cases I'm aiming.

No problems while shooting. I'm going to play a bit with the patch on @ 166 and I'll try with the others after.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on August 10, 2020, 01:19:55 PM
160Mhz is the only patch working solid so far with at least 170mb/s and probably 64gb 95mb/s cards. Mostly heard about sandisk cards but your lexar card works too?

If testing other patches easiest to test with only sd in the slot.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: GullRaDriel on August 10, 2020, 01:33:36 PM
I can confirm that the 166 MHz patch is working with my Lexar card. It's at least doubling the default speed. Tested continuous 3K rec one more time and it's working for more than a minute without a glitch. It's staying green except each couple of 15 secs, where it's flashing to orange for a second before coming back to green (maybe a buffer/cache issue, it's not affecting my record)

@Danne a few post ago I posted my values, tested with only SD in:
OFF        :        20.5 / 21.8  / 18.8 / 21.8
160 MHz:        50.3 / 70.1   / 65.6 / 70.1    ===> if only WRITE speed is what counts, that mode is the best as it's overclocked to the minimum and it gives the same average write speed results
192 MHz:        64.4 / 83.0   / 49.8 / 83.1
244 MHz:        63.5 / 101.7 / 50.7 / 101.8   ===> Best READ mode

With my cards I was not that far from the wanted bandwidth for continuous 3K. Doubling the SD write speed did it.

Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on August 10, 2020, 01:41:31 PM
Ok, could you test 240Mhz in photo mode. Run benchmark test, then take a photo, then run benchmark test once again. What readings are you getting from the second test? I want to know if your card will give consistent results or somehow breaks or not.
What´s your max write speed for your card? Seems around 70mb/s?
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: GullRaDriel on August 10, 2020, 02:01:34 PM
71.5 / 101.9 / 64.5/ 101.0  (no picture in background, card was cleaned)
Took 3 shots, RAW, and then ran again:
54.5 / 101.9 / 65.5 / 101.8 (one of the pictures I shot was in the background)

Edit: @240 MHz

Edit2: Ran a couple other shots, and a video, and one more benchmark (did not restart the camera since first test)  65.4 / 101.8 / 66.7 / 101.0

Edit3: the average write speed during the tests was 64.6

Edit4: The 240 MHz option seems to work on my setup.I'll try to stay on that mode for a while and report. ==> RAW recording not working in that mode for longer than a few seconds, (first try was just a start stop video) got raw error and camera in state where I need to pull of the battery.

Edit5: Going back to 160 Mhz immediately makes everything working back.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on August 10, 2020, 02:19:40 PM
Are you running the tests in photo mode? Yeah, this means your card is probably working stable only in 160mb/s mode.
Just for the fun of it. Here´s a patch which works faster but not stable on my card. Maybe you are luckier:
https://bitbucket.org/Dannephoto/magic-lantern_jip_hop_git/downloads/sd_uhs.mo
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: GullRaDriel on August 10, 2020, 02:49:18 PM
Yes, photo mode.
Trying your module now.
Edit: reverted to previous. This one is unstable, gives me err02 and full card errors
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: has_abandonment_issu on August 10, 2020, 08:37:32 PM
Hi again everyone I just wanted to update that I did receive a Sandisk 128gb Extreme Pro 170mbps card, and the patch is working correctly and I can record at 125mbps without global draw or 115 with.

This is further confirmation that the 128gb cards seem to work consistently.

It's awesome! Thank you guys again it's like I have a brand new camera.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: has_abandonment_issu on August 11, 2020, 01:49:35 AM
I'm getting a lot of "file create error"s when using the sd overclocking, mostly in UHD mode. It seems to happen if I enable anything in global draw. It will also happen randomly, but it happens consistently if I enable something in global draw, then restart.

Edit: I purchased my card off of ebay, and while it benchmarks correctly and does function with ML, I have reasons to be suspicious that it's not authentic so I ordered another one from B&H and will update if this error persists with that card.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Hisplan247 on August 11, 2020, 07:33:31 PM
What are your exact settings for the 5d Mark iii? I have the 128gb A2 v30 170
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: has_abandonment_issu on August 12, 2020, 01:07:12 AM
Quote from: Hisplan247 on August 11, 2020, 07:33:31 PM
What are your exact settings for the 5d Mark iii? I have the 128gb A2 v30 170

That model is a micro sd with adapter right? I'm using a SanDisk 128GB Extreme PRO UHS-I SDXC (but it might be a knock off). Firmware 3113. All global draw overlays set off, but global draw on. UHD mode with 12 bit set to on in the external menu. Card spanning on. SD overclock on. If I turn on any cropmarks or histogram or anything else in global draw it will return a "failure to create file" error when I try to shoot, and it will continue to shoot just using the cf card.

Sometimes it works, but if I turn the camera off and on it will usually return an error on the second start up.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: toto2012 on August 12, 2020, 01:29:23 AM
Hi Danne, thank very much for your build. It's amazing !
Today I installed your latest from today I guess. I have the 5D3 with 1.2.3.
I work with the 5.7K Anamorphic but I have some issues with the global draw I think. When I record with the global draw my "speed record" is always in the orange and after 30-40seconds the record stop automatically. If I disable the global draw everything works and my speed record is green and around 90Mb/s, and I can record without limits.
I record only on my CF Card Sandisk Extreme Pro 160Mb/s. Do you have an idea if it's possible to fix this ?

Thank you
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: has_abandonment_issu on August 12, 2020, 02:20:34 AM
Quote from: toto2012 on August 12, 2020, 01:29:23 AM
Hi Danne, thank very much for your build. It's amazing !
Today I installed your latest from today I guess. I have the 5D3 with 1.2.3.
I work with the 5.7K Anamorphic but I have some issues with the global draw I think. When I record with the global draw my "speed record" is always in the orange and after 30-40seconds the record stop automatically. If I disable the global draw everything works and my speed record is green and around 90Mb/s, and I can record without limits.
I record only on my CF Card Sandisk Extreme Pro 160Mb/s. Do you have an idea if it's possible to fix this ?

Thank you

It sounds like you're describing normal operation. Global draw will reduce recording speed, I believe because it uses up system resources. Also recording in higher frame rates reduces speed, as well as the firmware build you're using. 3123 is slower than 3113 in my testing and seemingly in general.

Is it just that speed is reduced when using global draw? The speed reduction should be around 10%.

The great thing about dannes build is that you can turn on card spanning, which will let you record to both SD and CF cards. That should get you back to normal speeds, or even faster with global draw off.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Bender@arsch on August 13, 2020, 08:42:10 PM
I have an update from my 3K mode trouble:
- Problem: Can't record 3K mode with cardspanning (+overclocking) + 10 or 12bit, only 14bit lossless.
- Here is what happens: https://drive.google.com/drive/folders/1ABS7sbXXXDIjMHNzeFNeAr9lBh2Lj_3z?usp=sharing

I tested so many tests the last days. many combination of settings and installation (only CF, only SD and both).
And now i found a way, that it's works:

Quotedefault settings (fresh install, or fresh ML files/ without config) + cardspanning + without SD overclocking + 10/12 bit.
-> working and with 10bit continuous with live view or 12 bit without.

Trouble:
- if i set SD overclocking (160mhz) ->failed
- if i set in Overlay: Histogram, Waveform and Zebras (raw), with or without kill global draw ->failed
- but, if i set in Overlay: Histogram and Waveform (without zebras) and kill global draw -> working

in summary: -> only working without SD overclocking!
- If i want liveview i need to disable Zebras, Histogram and Waveform manually (not possible to simply disable global draw)
- If i want without liveview i need to disable Zebras manually (not possible to simply disable global draw or kill global draw)

-> The frustrating things is: this is only happens in 3K mode. In all other modes, i can use SD overclocking and Overlays.

------------------------------
I also tested Benchmark with your SD overclocking module:

i tested step by step from your discription! (only SD, photo mod, benchmark -> picture -> 2. benchmark)
I used a SanDisk Extreme Pro 170MB/s 128GB

without overclocking -> working (logical)

160mhz -> working (logical)

192mhz -> write ~80, read ~87 (both tests works surprisingly)
->
240mhz -> failed (5000mb...) at 1. and 2. test

so, back to 192mhz ->failed, and everytime...


The test is probably not that reliable...

@Danne
Maybe this helps a little bit
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on August 13, 2020, 09:08:11 PM
Thanks for the screen recording.
Tip. Only way for me to check for errors is to know if we can have a reliable reproducable issue. If anyone present an error one should always also go back to main intent when I buillt my presets. And that is very easy. After install select your preset and set to desired bitdepth. Then start to record. If this i working ok we at least know what works.
Next, if adding functions after this you need to find what function is causing the issue.
In general. If disabling zebras or histogram and such will make it work this is to me acceptable. I personally choose reliabilty recording over histogram and zebras. But that´s me.

So, what is actually working for you when having sd overclock enabled? Is there such a thing?
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Bender@arsch on August 13, 2020, 09:31:08 PM
Quote-> The frustrating things is: this is only happens in 3K mode. In all other modes, i can use SD overclocking and Overlays.

But in 3K mode:
If overclocking enabled, I can record CF only, sd only (10/12/14bit - > less resolution, because of writespeed) and 14it with cardspanning (continuous at 2848, AR 16:9). But not 10/12 bit with Cardspanning.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on August 13, 2020, 09:34:34 PM
I am sorry. Not clear to me. You install my build, enable sd overclock and start to record? Nothing extra enabled, zebras, histogram etc?  Could be your cf card if so. I use a transcend cf card and from my tests I couldn´t get your issue.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Volumetrik on August 13, 2020, 09:53:17 PM
Not to spam your thread @Danne, but I could not reproduce the problems you're having Bender.

3K 1:1 Preset with 2:1 aspect ratio. 160Mhz SD_UHS + Card spanning + Raw Zebras + Digic Peaking

SanDisk Extreme Pro 64Gb 170Mb/s + 1066X Lexar 128Gb CF

(https://i.ibb.co/1vVDxnL/Screen-Shot-2020-08-13-at-3-45-51-PM.png)(https://i.ibb.co/wJSjxbw/Screen-Shot-2020-08-13-at-3-46-01-PM.png)(https://i.ibb.co/9grKZDD/Screen-Shot-2020-08-13-at-3-46-11-PM.png)

I am actually having close no no issues. Thanks so much Danne, with the SD overclocking I can afford to have everything with 14-Bit lossless !
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on August 13, 2020, 10:07:57 PM
Thanks for reports. The more the better to nail down potential issues. Also what is actually working is important news.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Bender@arsch on August 13, 2020, 10:08:47 PM
QuoteI am sorry. Not clear to me. You install my build, enable sd overclock and start to record? Nothing extra enabled, zebras, histogram etc?  Could be your cf card if so. I use a transcend cf card and from my tests I couldn´t get your issue.

I'm not sure what you mean. If I install, than enable overclocking and record in 3k mode - >SD card only (without CF card inside) or CF only (Cardspanning disabled) - > working in all bitdepth.
Default setting is 12bit and 2.35:1. If I enable Cardspanning - >failure
also with AR 16:9 and/ or 10bit.

Without extra settings.

I use a Komputerbay professional 128gb 1066x.

@Volumetrik
Sometimes it takes up to over 1min, especially with less resolution (2.35:1).
and most tests I set AR 16:9 (max. Resolution in this mode)
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on August 13, 2020, 10:27:16 PM
We need more testers but seemingly it works ok for others. Do try another cf card. Komputerbay cards are known for inconsistency.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Bender@arsch on August 13, 2020, 11:15:10 PM
@Danne
Yes we need more testers.

I tested other CF Cards:

- a old SanDisk Extreme 120MB/s 16GB CF card

- SanDisk Extreme Pro 160MB/s 64GB  CF card

Both fresh install/ default settings.

Settings changed:
Preset: 3K 1:1, overclocking enabled, AR 16:9, 10bit, cardspanning enabled ->restard -> waite for overclocking and nothing more.
-> record with 3072x1728 at 10bit lossless

-> failure takes up to 30sec. on both cards.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Volumetrik on August 14, 2020, 12:19:47 AM
First test using your settings did a minute with no corruption issues. Had one frame (206) that had a compression error. Frame demonstrated in the screenshot below. Write speed was at only 89.35 MB/s.

(https://i.ibb.co/k8xXYwB/Screen-Shot-2020-08-13-at-6-02-49-PM.png)

Second test with 16:9 10-bit stopped at 12 seconds because it was writing at 120.14 MB/s. I think this one also has one compression error, however I can't recall the frame and I can't see it by playing through the footage.

(https://i.ibb.co/TwdB1vK/Screen-Shot-2020-08-13-at-6-07-59-PM.png)

You can see the file sizes for the second test highlighted. You can also see the sizes for the 1 minute test at 2.35 AR just above.

From my hardware, camera and settings, I have to stay around the 110MB/s to get full continuous footage. That figure might be different for others reading this.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Bender@arsch on August 14, 2020, 12:47:49 AM
@Volunters
Interestingly, there is no pop out console while recording?
which firmware do you use?
I use 113 and can rec. up to 125mb/s with liveview and 131mb/s without (UHD mode).

In my case it never stops recording, but I see multiple compression error on frame *

Easily you can close your lens cap for less writespeed, but if you don't see the console message it will not really work.
but maybe you can enable console in ML menu under scripts.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: has_abandonment_issu on August 14, 2020, 01:08:23 AM
Bender@arsch I get a similar error when recording higher framerates (either 1920 @ 60fps or 1050 @ 48fps) while using card spanning. I am currently using a 95mbp/s sandisk 32gb card. I haven't tested the error aggressively so I'm not sure if it conflicts with other settings.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Volumetrik on August 14, 2020, 02:29:09 AM
Quote from: Bender@arsch on August 14, 2020, 12:47:49 AM
@Volunters
Interestingly, there is no pop out console while recording?
which firmware do you use?
I use 113 and can rec. up to 125mb/s with liveview and 131mb/s without (UHD mode).

In my case it never stops recording, but I see multiple compression error on frame *

Easily you can close your lens cap for less writespeed, but if you don't see the console message it will not really work.
but maybe you can enable console in ML menu under scripts.

1.1.3 Latest Danne build Jul15 with stock SD_UHS @160Mhz + Spanning +Raw Zebras + Global draw + Digic peaking

I did get the console message, but it kept on recording. (forgot to mention sorry) The compression error message was only for the frame 206 which was blank as shown. I agree that this is not ideal and it partially obscures the liveview, but the recording was okay and was fully available to view in MLVApp afterwards.

So in a sense, I did (kinda) reproduce your error for the compression, but I could not replicate the ''failed'' portion of it. The recording works, albeit for that singular blank frame.

Also, to think of it, I did a day-long shoot with the 5DIII in June and I did get that error (frame compression + console appearing on liveview, but still recording) recording 3K 1:1 present in 2:1 aspect ratio at 10-bit non spanning only on CF recording.

Quote from: has_abandonment_issu on August 14, 2020, 01:08:23 AM
Bender@arsch I get a similar error when recording higher framerates (either 1920 @ 60fps or 1050 @ 48fps) while using card spanning. I am currently using a 95mbp/s sandisk 32gb card. I haven't tested the error aggressively so I'm not sure if it conflicts with other settings.

I also got errors using my 32GB SDHC 95MB/s SanDisk. I think the newer SDXC 170MB/s cards work better in our use-case.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on August 14, 2020, 05:18:26 AM
Ok, so getting compression errors will need some tinkering. There should be none. I will take a look and see if I can tweak some.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on August 14, 2020, 06:44:23 AM
@Bender@arsch, @Volumetrik. Could you test this version in 3k modes. I changed reg 713c and 7150 when in 24fps. So this test differs only when camera is set to 24fps and in the 3K 1:1 preset.
https://bitbucket.org/Dannephoto/magic-lantern_dannephoto_git/downloads/crop_rec_4k_mlv_snd_isogain_1x3_presets_2020Aug14.5D3113.zip

https://bitbucket.org/Dannephoto/magic-lantern_dannephoto_git/downloads/crop_rec_4k_mlv_snd_isogain_1x3_presets_2020Aug14.5D3123.zip
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Bender@arsch on August 14, 2020, 09:21:06 AM
@Danne
Thanks for your hard work!

I tested it out,... And it works lovely!

Same Settings:
fresh install/ default settings.

Settings changed:
Preset: 3K 1:1, overclocking enabled, AR 16:9, 10bit, cardspanning enabled ->restard -> waite for overclocking and nothing more.
-> record with 3072x1728 at 10bit lossless

Recording over 90sec without failures!

I also tested 12 bit and kill global draw - > working

And again, but this time with Overlays (Histogram, waveform and zebras (raw, hide while rec.))
-> and it's working

Danne, you rocked it!
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on August 14, 2020, 11:02:08 AM
Very nice :).
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Volumetrik on August 14, 2020, 05:00:59 PM
@Danne @Bender@arsh

Confirmed on my end ! Everything is working well, no compression errors on 10-Bit or 12-Bit.

Over 5 minutes for both bit-depth !! Danne you're the man !
(https://i.ibb.co/7NGcLx4/Screen-Shot-2020-08-14-at-10-58-08-AM.png)(https://i.ibb.co/T1dSFM4/Screen-Shot-2020-08-14-at-10-58-14-AM.png)
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: has_abandonment_issu on August 15, 2020, 08:04:53 AM
@Danne

I was so excited about the amazing anamorphic mode and card spanning, I forgot to mention something I noticed a while ago.

In regular raw recording without using any crop modes, I get different exposures while using the same exposure settings if I change bit depth.

Switching between 14 bit lossless in mlvlite, 12 bit lossless, or 14 bit lossless in mlvlite with 12 bit in the bit depth menu all return different exposures. I haven't tested any other combinations.

You can't see it in liveview, but when you play back with mlvplay in camera or bring the files onto a computer, the differences are obvious.

I remember this build originally started with you editing the ISO settings, maybe something left over? Or maybe it's a feature not a bug!
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on August 15, 2020, 09:15:09 AM
If you turn off lff crop rec you can turn off bitdepth options too. Instead use bitdepth handling in RAW video menu.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: has_abandonment_issu on August 15, 2020, 04:30:21 PM
Thank you Danne.

For everyone's reference I found that:

14 bit lossless with the bit depth menu off,

or 12 bit lossless from the raw video menu with 12 bit selected via the bit depth menu,

Both appeared to have the correct gain, so I would try those settings first if you're trying to record without the crop modes.

12 bit lossless via the raw menu (nothing bit depth menu) appears to be underexposed, and 14 bit with 12 bit from the bit depth menu appears overexposed.

Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: 70MM13 on August 20, 2020, 01:44:40 AM
with the beautiful anamorphic mode giving such great results, i'm curious...

would it be possible to do it vertically also?  can it be just as "aliasing-free" vertically as it is horizontally?

the reason i'm asking is because i would love to be able to do some slow-motion with this quality.

i think everyone would benefit from this if it is achievable...

thanks!
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: wib on August 21, 2020, 11:50:04 AM
I have to report that sometimes the liveview is stuck in x10 zoom (this seems to happen when I go in ML menu with the trash button) and I have to click on menu button 3-4 times to reset it and ML will load again the "normal" liveview.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: rinski on August 22, 2020, 10:27:49 AM
Hello, version 5d3 works very well for me, July 4 1.2.3, 88MB / s cf Lexar 128gb 1066x + 78 MB / s, extreme pro sandisk 170MB / s, 240 patching, more than 6 minutes voluntarily interrupted with parameters 1/166 iso 200 av 9.9, on the outside with the full anamorphic resolution 1.1, 1920x3760, the two cards in fat32 without restart problems when turning off and on and more or less maintained the speed, the 3x3 Binning pixels would be wonderful to obtain more than 15,003 fps no aliasing / moire.
Thank you.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: GullRaDriel on August 24, 2020, 09:34:49 PM
Are you using Sticky DOF and 10x crop aid maybe ?
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: GullRaDriel on August 24, 2020, 09:36:13 PM
I'm on the August 15 built from Danne's repo (see the commits for the little changes between 14 and15 build)
Never experienced such a thing as a sticky x10.
Crop rec can force it to x5.
What settings were you using ?
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Calussien on August 25, 2020, 03:34:32 PM
Hi 5d3 users. I just got a 5D3 AND usable cards for ML : SD Sandisk 128GB 170MB/s and CF Lexar Pro 128GB 160MB/s
I am discovering ML features one by one, doing many tests to understand the tools I could use in photo and video.

I have come with an issue using Danne's build. I can't record 12 bits lossless or 8-11 lossless in any crop preset.

Here are my settings for a UHD preset.

Build : Nightly.2020Aug14.5D3113

Presets : UHD 1:1

Raw video : On, 3664x1536, AR 16:9, Data format : 14-bit lossless (written in grey, can't change it in other lossless bit depths...), Preview : Framing, Crop   rec preview : auto mode, card spanning : on, kill GD : off

Bitdepth : 12

Ratio : off

FPS Override : off

SD overclock : on, 160MHz


Maybe there is something I am doing wrong. I saw older posts and some guys were using 3k preset in 12 bit lossless.

Many thanks for helping me :)
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: ABBATT on August 25, 2020, 08:13:52 PM
Just try to use
MicroSDXC PRO+ Memory Card w/ Adapter 128GB
https://www.samsung.com/us/computing/memory-storage/memory-cards/micro-sd-pro-128gb-memory-card-w-adapter-mb-md128da-am/ (https://www.samsung.com/us/computing/memory-storage/memory-cards/micro-sd-pro-128gb-memory-card-w-adapter-mb-md128da-am/)

Benchmark result
(https://i.imgur.com/Zm3URxo.jpg)
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: ihaveacamera on August 27, 2020, 03:03:38 AM
Okay, perhaps I'm doing something wrong but I'm having an issue with getting video that isn't choppy. I'm basically using the default setting for the anamorphic preset except for the resolution being set to 1600 and I have global draw off. I'm should mention I'm using a Lexar Pro 1066x. I've tried playing around with a few other settings but I haven't had much luck and just end up crashing.

Anyone mind pointing me in the right direction? Thank you!
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: sm105 on September 02, 2020, 01:01:28 AM
I've been successfully using Danne's builds since earlier this summer (awesome work!), and I just started testing out dual iso raw video. I feel like I'm doing something wrong because I'm getting weird colors, lines, and regions of cyan. For the frame below, I used the 3K preset with the following settings:

Aug. 14 build (1.2.3)
2560x1440
16x9 AR
10-bit
Histogram and zebras enabled
Dual-iso enabled at 100/800
Slightly underexposed from ETTR
Dual-iso ON in MLV App

I also tried an earlier build and had the same issue. Any idea what I'm missing?

(https://i.ibb.co/FgW6YKD/screenshot.jpg)
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on September 02, 2020, 04:29:00 PM
You can try "Switch". Uses a1ex updated cr2hdr code.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: sm105 on September 03, 2020, 12:50:37 AM
Quote from: Danne on September 02, 2020, 04:29:00 PM
You can try "Switch". Uses a1ex updated cr2hdr code.

Thanks Danne! Switch worked. I was able to salvage some good shots that I otherwise would have deleted.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: GullRaDriel on September 06, 2020, 03:54:21 PM
Everything is working so far for me.
I'm currently trying a timelapse with fps override @2.5 and raw 12bits video.
I've attached a photo for the stats, continuous.
And for the video itself, it is still recording atm.
(https://www.nilorea.net/wp-content/uploads/2020/09/IMG_20200906_154506-1024x576.jpg)
Speed is a total of 179 MB/s
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on September 06, 2020, 03:58:02 PM
That is brutal  8).
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Bender@arsch on September 06, 2020, 04:10:51 PM
@GullRaDriel

I think this is not the correct writespeed, see my test with different modes:

https://www.magiclantern.fm/forum/index.php?topic=12862.msg228848#msg228848

You can also test it at the same way.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: GullRaDriel on September 06, 2020, 04:47:31 PM
Yeah, I agree that fps overriding is somewhat helping, not doing that much encoding.

First I used MLVapp and 60fps setting and generated a 32GB avi.

Then I used Handbrake and vimeo/youtube 4k setting and got a 171 MB video X-D

Anyway, the video itself (please note that ATM youtube is still processing the highres version):

Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: GullRaDriel on September 06, 2020, 05:10:08 PM
I'll also try a normal and long record with audio, at the highest possible continuous setting for my set up.
Pretty sure that if the processors are busy doing audio and video encoding the write speed will lessen. That, and or the various bus's that can be more used and thus limiting bandwidth somewhere.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: stef7 on September 12, 2020, 05:33:39 PM
Question about anamorphic fullres mode:
Currently it is fixed to 15fps.  Is is possible to increase frame rate ? Tried to use FPS override but camera locks and freezes. Have to pull the battery out in order to make it operational again.

With SD card overclock + card spanning in theory can get 1800 x 2700 12 bit or even 1920 x 2880 10 bit running at 24fps for at least 10-15 sec, which is enough for me. 2:1 is my favorite aspect ratio. :)
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on September 13, 2020, 12:16:20 AM
New builds:
https://www.magiclantern.fm/forum/index.php?topic=23041.msg216899#msg216899

- Expanded 3.5K 1:1 centered x5 preset height to 3584x1730(24fps)
Why this. Now we get cropped real time preview and framing instead of only framing preview when using 3K 1:1 preset for instance.
For 24fps you can use full 3584x1730 but for 25fps I had to reduce height to 3584x1660.
Needs some testing. Now we can get 16:9 3152x1730 with cropped realtime preview. Nice.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: has_abandonment_issu on September 13, 2020, 01:05:41 AM
Quote from: Danne on September 13, 2020, 12:16:20 AM
New builds:
https://www.magiclantern.fm/forum/index.php?topic=23041.msg216899#msg216899

- Expanded 3.5K 1:1 centered x5 preset height to 3584x1730
Why this. Now we get cropped real time preview and framing instead of only framing preview when using 3K 1:1 preset for instance.
For 24fps you can use full 3584x1730 but for 25fps I had to reduce height to 3584x1660.
Needs some testing. Now we can get 16:9 3152x1730 with cropped realtime preview. Nice.

I am already finding the ability to see real time focus (albeit cropped) extremely useful, and I have also found the 3.5k x5 preset to be the most stable whenever I've tested anything before (even with a knock off SD card) in general. Very excited.

I just tested it using a variety of settings on 3.113 (card spanning on, off, overclocking on, etc). I have yet to run into any issues. Seems very stable.

The inclusion of a "preferred card" toggle in the raw video menu was a nice touch. I tried just SD card using that setting in 14 bit 1080 and it also worked well with no issues.

The new 2.07 - 1 max aspect ratio in 3.5k is really nice. I may start shooting this aspect ratio a lot. Gives me a clear foreground, middle ground, and background without the feeling of too much vertical space. Anything between 1.77 - 1 to 2.4 - 1 is really up to taste, but this feels like just right to me. I can't wait to start designing some shots and feeling it out more.

Also at 3584 x 1730 we are getting a whopping 6.2 megapixels, which is even higher than UHD 3840x1536 at 5.9 megapixels. And with the ability to see focus with global draw off I can actually shoot that resolution continuously in a lot of lighting conditions!

This is a very big update. Ability to check focus in real time with global draw off means I can shoot at high resolutions and still take full advantage of the overclocked write speeds without being totally blind. Awesome.

Thanks Danne. I'm going to be playing with this new build all week.

Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on September 13, 2020, 01:29:55 AM
Thanks for your testing and feedback. Appreciated.
I guess one could rework all the presets while in x5 zoom and it would be possible to find real time cropped preview for all presets like on eosm. Will take too long so this will be nice to have.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: 70MM13 on September 13, 2020, 03:34:19 AM
this is truly excellent!

there seems to be something indeed about the 3.5k mode that is extra stable.  i was recording at full 14 bits with a green indicator when exposed with very little clipping, and it stayed in the orange for a good 30 seconds before finally quitting when it was severely overexposed!

with overclocking and spanning of course :)

this feels like a new camera.  spectacular!  i really could have used this realtime preview during shooting earlier today!

i agree the extra vertical height is perfect.  sometimes 2.35:1 was just too short.  this is great!

hats off to you and bilal
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on September 13, 2020, 04:12:10 AM
Great to hear it's working!
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: GullRaDriel on September 13, 2020, 08:58:41 AM
Hello Danne.

Thanks for the build. I'm on firmware 1.13 and with your latest build I have a flashing liveview, alternating from parts of what is in sight with strange colors to full colored pixel view (like a TV without a channel).

Whatever the mode set it's not working and generating corrupted messages and asserts logs if I try to record.

I've tried numerous settings (spanning on/off, various résolutions/bitdepth), no one working.

@70mm what firm are you using ? 1.13 ? Have you wiped the SD before putting the new build ?
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: has_abandonment_issu on September 13, 2020, 09:14:23 AM
Quote from: GullRaDriel on September 13, 2020, 08:58:41 AM
Hello Danne.

Thanks for the build. I'm on firmware 1.13 and with your latest build I have a flashing liveview, alternating from parts of what is in sight with strange colors to full colored pixel view (like a TV without a channel).

Whatever the mode set it's not working and generating corrupted messages and asserts logs if I try to record.

I've tried numerous settings (spanning on/off, various résolutions/bitdepth), no one working.

@70mm what firm are you using ? 1.13 ? Have you wiped the SD before putting the new build ?

Weird, I ran it on 3.113 and didn't run into any issues, are you seeing this in all presets, and not just the 3.5k 5x? I formatted my sd card in camera before installation.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: 70MM13 on September 13, 2020, 11:33:14 AM
i'm also running 1.1.3 and i did wipe the sd card before installing.

maybe you could try downloading again.  could it be a file error that wasn't caught?  all it takes is 1 bit...

i don't have any other suggestions so my fingers are crossed for you!
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on September 13, 2020, 12:53:42 PM
New builds:
https://www.magiclantern.fm/forum/index.php?topic=23041.msg216899#msg216899

- Added a preset which handles up to 3296x1854(16:9) 24fps and with realtime cropped preview.
Reduced width keeping real time preview according to older findings from theBilalFakhouri.
Enjoy!

(https://i.postimg.cc/GhYq0zXG/VRAM4-PPM-500px.png)
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Grognard on September 13, 2020, 02:24:50 PM
Thank you Danne! I look forward to test the new build.
With next uncropped realtime preview this old camera will become a brand new 4k camera! ;)
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on September 13, 2020, 02:46:55 PM
More like a 3.3k cam but I get you ;).

Uploaded new builds. Reduced height and width slightly to the 3.3k preset due to reports of compression error.

Usual place:
https://www.magiclantern.fm/forum/index.php?topic=23041.msg216899#msg216899
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: andy kh on September 13, 2020, 02:47:55 PM
Eager to test but im away from my camera atm. Fantastic job btw👍👍
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on September 13, 2020, 02:49:48 PM
Thanks. Put up some feedback after testing. Good and bad.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: stef7 on September 13, 2020, 03:11:45 PM
Thanks a lot for the latest build, Danne. It's oustanding ! 3.5K 2:1 aspect ratio at 24fps 1.6 crop. It's basicaly 4K Super35 (APS-C) format. Just perfect for me !
Don't need anamorphic modes anymore.  :)

Not sure if this is a problem or not but modules don't show on the menu.
See only two of them atg_gui and bench. But can see them in the respective folder.
Is this a bug or by design ?

When bench marking a SD card instead for some values for read performance get this message:

          malloc error buffer: 16777216

Two difference Sandisk Pro 128G cards, same message.

But the work and report write speeds of 50mb/s
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on September 13, 2020, 03:21:22 PM
Nice.
Keep an eye on your recordings around malloc errors. Are they sandisk pro extreme cards? Otherwise might be tricky using sd_uhs module.
Modules are autoloaded in this build. Bench and adtg_gui additional only. Shouldn´t be enabled if not used. Especially adtg_gui will be tricky conflicting with crop rec.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: GullRaDriel on September 13, 2020, 03:39:39 PM
Latest tests on latest build:

I got some strange crashes when I tried to record without having x5 on (using 3k 1/1)

But on the other tests with presets 3K x5, it was working and I had a working colored x5 preview while recording.

Very good effort !

I may do some more tests with whatever you come with, but not until friday (busy IRL).

Good job and thanks for the time you're giving us.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on September 13, 2020, 03:53:09 PM
Quote from: GullRaDriel on September 13, 2020, 03:39:39 PM
I got some strange crashes when I tried to record without having x5 on (using 3k 1/1)
Please make a screen recording if you can´t nail down the issue or reproduce it exactly.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: has_abandonment_issu on September 13, 2020, 07:01:27 PM
@danne just tried the new build and in the 3.3k preset I got compression errors at roughly 1.5 minutes of recording a few times, but I can't seem to reliably reproduce the error.

I tried going down settings in order:

- card spanning on, nothing else
- bit depth on, nothing else
- overclock and card spanning, nothing else etc.

I had an error with card spanning, overclocking, and bit depth and global draw on, as well as global draw off. It's possible it returns errors with other settings. I tested roughly a minute and a half for each trial.

Unfortunately, when I found an error, restarting and trying again with the same settings did not reliably reproduce the error. I will try more later my camera is currently cooling off.

I will also test the 3.5k preset more vigorously, since I'm eager to use it for product demonstrations for work, so it will get a lot of testing over the next few days.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: ozcancelik on September 13, 2020, 07:18:07 PM
Hi Danne,

Just tried 1.13 build for 3.3K realtime preview test. It works just like before for me. Laggy preview. Am I missing something?

Screen record :
https://drive.google.com/file/d/1B_ScednT0ms1jKB_DBjILxOEhfwAnyTG/view?usp=sharing
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: ozcancelik on September 13, 2020, 07:20:11 PM
Quote from: ozcancelik on September 13, 2020, 07:18:07 PM
Hi Danne,

Just tried 1.13 build for 3.3K realtime preview test. It works just like before for me. Laggy preview. Am I missing something?

Screen record :
https://drive.google.com/file/d/1B_ScednT0ms1jKB_DBjILxOEhfwAnyTG/view?usp=sharing

Edit: also tried canon menu button magic, nothing changed.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Bender@arsch on September 13, 2020, 07:23:14 PM
Quote from: ozcancelik on September 13, 2020, 07:20:11 PM
Just tried 1.13 build for 3.3K realtime preview test. It works just like before for me. Laggy preview. Am I missing something?

Have you tried global draw off?

@Danne
I have the same problem as has_abandonment_issu in 3.3K.

But 3.5 works very well.
nice work!
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on September 13, 2020, 07:26:19 PM
I see. I think I need to shave down a few more pixels then. Let me test some.
EDIT. What resolution are you using?
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: has_abandonment_issu on September 13, 2020, 07:39:28 PM
Quote from: Danne on September 13, 2020, 07:26:19 PM
I see. I think I need to shave down a few more pixels then. Let me test some.
EDIT. What resolution are you using?

I was reducing resolution to allow for continuous recording in each case. From 2.8k to max. I got one error at a lower resolution with global draw on, and also at max resolution with all settings checked and global draw off.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on September 13, 2020, 07:52:17 PM
Ok, I shaved some height and width. Maybe it´ll fix it. If not I have to check timers. Later on that is. Downloads at usual location.

I also got my not yet released application "Switch mini" working with spanned files. Simply drag both cards at once onto Switch mini, then select (CS) setting and follow the instructions.

https://bitbucket.org/Dannephoto/switch_mini-git/src/master/
Download:
https://bitbucket.org/Dannephoto/switch_mini-git/get/db5140d40a12.zip

Thanks for feedback.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: ozcancelik on September 13, 2020, 08:01:27 PM
Thanks. It worked. 5x-3.3K preset continuous recording ~2.8K with global draw off.  When recording, preview is realtime but broken colors. Also when change fps, camera freezes. When change global draw, camera freezes. Not much can be done due to the camera freezing.

Quote from: Bender@arsch on September 13, 2020, 07:23:14 PM
Have you tried global draw off?

@Danne
I have the same problem as has_abandonment_issu in 3.3K.

But 3.5 works very well.
nice work!
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on September 13, 2020, 08:06:12 PM
Whatever makes the camera freeze. Don't do it.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: has_abandonment_issu on September 13, 2020, 09:13:08 PM
Quote from: Danne on September 13, 2020, 08:06:12 PM
Whatever makes the camera freeze. Don't do it.

Hahhahahahha. Good advice,

We are currently at a rough limit of 6 megapixels at 24fps or 144 megapixels per second.

I'm not sure if it's possible to squeeze any more out of the 5d mkiii, but for reference we are just 10% away (3840x1920) from this camera being viable for producing Netflix content! Well like 15% away if you count total resolution area but it's amazing how much you guys have managed to push this camera
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: ZEEK on September 14, 2020, 01:48:30 AM
Quote from: Danne on September 13, 2020, 07:52:17 PM
I also got my not yet released application "Switch mini" working with spanned files.
Sounds like a really cool transcoding app, well done! Ive been busy recently, but with free time now I'll test out the new M Build out, see how it goes. I know it's a work in progress, but honestly, it's a miracle where the camera is right now. Cheers for all the work! 🔥🎥👍
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on September 14, 2020, 02:28:06 PM
Please feel free to test. Hadn´t had time to publish anything yet.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on September 14, 2020, 04:55:53 PM
Got word from has_abandonment_issues about 3.3k preset working with this version. Missed uploading yesterday:
New builds:
https://www.magiclantern.fm/forum/index.php?topic=23041.msg216899#msg216899
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: ozcancelik on September 14, 2020, 11:12:55 PM
Crash has become much less. Doesn't crashed when changing global draw. It "sometimes" crash when changing FPS. I was able to record 24 frames 3264x1366 continuously. (8 minutes). There is overlay pattern (https://ibb.co/FYw4JVH) when recording but it does not prevent shooting. Also image becomes greenish.

Also it would be nice if the size that is seen on the screen and the size taken is the same.

Quote from: Danne on September 14, 2020, 04:55:53 PM
Got word from has_abandonment_issues about 3.3k preset working with this version. Missed uploading yesterday:
New builds:
https://www.magiclantern.fm/forum/index.php?topic=23041.msg216899#msg216899

Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on September 14, 2020, 11:39:06 PM
Try and find the answers to why fps makes your camera crash, also why changing global draw is affecting your recordings etc. With time and testing you´ll find your answers.

In general. All you are describing is already obvious to most users. If it was possible to change it it would have been changed already.

For real time preview check out theBilalFakhouri work.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Bender@arsch on September 15, 2020, 12:16:45 PM
Quote from: Danne on September 14, 2020, 04:55:53 PM
Got word from has_abandonment_issues about 3.3k preset working with this version. Missed uploading yesterday:
New builds:
https://www.magiclantern.fm/forum/index.php?topic=23041.msg216899#msg216899

Realy nice! All works!
I can continuous shoot at 3.3K (16:9) in 12bit and 3.5K (2.07:1) in 10bit
- >real world test

Interestingly the writespeed indicator is up to 137,5 mb/s, but I don't double check it on my computer.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Dmytro_ua on September 15, 2020, 12:37:15 PM
What about noise amount? I've just made a few quick shots comparing to anamorphic mode and the noise in shadows looks more noticeable than in anamorphic. Though didn't have enough time to check it properly yet..
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Bender@arsch on September 15, 2020, 12:40:23 PM
Ok, i double check it:

I search a good spot (bright and flat spot, without dark areas) and show in ML Menu under Raw -> 14Bit writespeed preview say 208,5mb/s or so

Here the Result:
3.5K 3584x1730 23,976fps 10bit
CF: 81,9
SD: 55,6
=137,5MB/s
-> 8424 (cf 5029, sd 3394), 1469 frames =~61sec
8424/61 =138mb/s !!!

This is a new record!!!

p.s. the indicator was orange and i stoped manuel;)
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Grognard on September 15, 2020, 01:37:12 PM
UHD 2.39 is "only" 6.170 880 pixels (3840x1607) less than in this case : 6.200 320 pixels (3584x1730)
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Bender@arsch on September 15, 2020, 01:47:34 PM
Quote from: Grognard on September 15, 2020, 01:37:12 PM
UHD 2.39 is "only" 6.170 880 pixels (3840x1607) less than in this case : 6.200 320 pixels (3584x1730)

I don't know what you're trying to say, but the important thing is the increased writespeed. And the latest build can only 3840x1536 (continuous recording too).

-> we got never more than 131mb/s
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: has_abandonment_issu on September 15, 2020, 02:01:01 PM
Quote from: Bender@arsch on September 15, 2020, 01:47:34 PM
I don't know what you're trying to say, but the important thing is the increased writespeed. And the latest build can only 3840x1536 (continuous recording too).

-> we got never more than 131mb/s

I didn't want to overstate anything but it seemed to me also that the write speeds were faster than I expected them to be in 3.5k. Thanks for actually checking!

I think there is something about the 3.5k preset that the 5d just handles extremely well. Less system load or something.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on September 15, 2020, 02:52:34 PM
Quote from: Bender@arsch on September 15, 2020, 12:40:23 PM
Ok, i double check it:

I search a good spot (bright and flat spot, without dark areas) and show in ML Menu under Raw -> 14Bit writespeed preview say 208,5mb/s or so

Here the Result:
3.5K 3584x1730 23,976fps 10bit
CF: 81,9
SD: 55,6
=137,5MB/s
-> 8424 (cf 5029, sd 3394), 1469 frames =~61sec
8424/61 =138mb/s !!!

This is a new record!!!

p.s. the indicator was orange and i stoped manuel;)
Those are nice numbers. I am pretty sure it´s because of being in x5 zoom.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: IDA_ML on September 15, 2020, 06:42:10 PM
I can also confirm that the 3,5k and 3,3k modes work really well on the 5D3.  I get similar results as Bender@arsch, just 2-3 MB/s less since I only have the old 95 MB/s SD-card.  And I did not have to overclock it. I also get continuous recording at 3200x1800/10bitLL/24fps (16:9) and more than 400 frames recorded at 12bitLL and 0.0 exposure without a single corrupt frame.  Thank you so much, Bilal and Danne for this amazing work and for bringing the 5D3 that far.  I still cannot believe that the 5D3 can do this.

The only thing that I am missing in this latest build is the slow choppy preview of the flv anamophic mode which is a full-sensor readout mode.  I use it a lot at 15 fps and it really works very well for wide angle landscape videography since it allows slow camera panning and provides very smooth results at 1/30-th of a sec. shutter speed.  Unfortunately, flv preview becomes skewed when recording is started and I don't how to fix it.   So, I was wondering if the marvelous 5x real time preview could be combined with the slow flv preview during recording so that both could be toggled with the INFO button.  Also, I was wondering if the frame rate could be raised by another 2-3 fps in that flv anamorphic mode.  Right now, write speed is about 75 MB/s (green indicator) at 15 fps, so there seems to be a lot of overhead for higher fps available.  The EOS-M does conveniently 16.688 fps in its flv anamorphic mode and is very stable at that frame rate, no corrupt frames either.  In my experience, 17-18 fps frame rate seems to be a sweet spot for optical flow interpolation to 24 fps in Resolve.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: 70MM13 on September 15, 2020, 07:05:27 PM
resolve does 18fps timelines so that would be a great choice!  i use it sometimes instead of 23.976 and it is really nice.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: has_abandonment_issu on September 15, 2020, 09:11:52 PM
When recording you can press the magic lantern menu button (trashcan) and see a current recording speed as well as a max recording speed. How accurate is that using the 3.5k preset?

Edit: Tested it myself, what I'm talking about is if you move your selector over the RAW module, and then exit the ML menu and start recording, you can press the ML button during recording, and it overlays the ML menu, with the selector still over the raw module, showing the current record speed. It doesn't seem to be as accurate as the recording indicator that pops up when recording though.

For reference with an estimate of around 163mbps from the ML menu, I can record continuously at 12bit. In case anyone else records 12 bit regularly. Actual speed is around 135mbps. I haven't experimented with the quality 10bit produces, but I am going to test that next since 10bit seems to be continuous in almost all exposure scenarios.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: garypayton on September 16, 2020, 02:37:10 AM
Maybe this is the silliest question here, but when i try to install this build it tells me that i cannot install it because my firmware is not 1.2.3 ... I thought the right version of the firmware was the 1.1.3 (the one i have installed)...

What's wrong?
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: IDA_ML on September 16, 2020, 06:16:12 AM
Quote from: has_abandonment_issu on September 15, 2020, 09:11:52 PM
I haven't experimented with the quality 10bit produces, but I am going to test that next since 10bit seems to be continuous in almost all exposure scenarios.

In my experience, the only downside of 10 bits becomes obvious when you try to push severely underexposed shadows.  This results in ugly red-brownish noise in those areas, more obvious in the EOS-M.  Exposing to the right greatly reduces this phenomenon which is less pronounced at 12 bits.  Other than that, with normally lit scenes, 10 bits provide great results.

But please test yourself and share your findings here.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: IDA_ML on September 16, 2020, 06:19:47 AM
Quote from: 70MM13 on September 15, 2020, 07:05:27 PM
resolve does 18fps timelines so that would be a great choice!  i use it sometimes instead of 23.976 and it is really nice.

Glad to hear you like 18 fps too.  I love the smooth motion blur it provides.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: IDA_ML on September 16, 2020, 12:17:36 PM
I think, I have another good news:  The September 14-th build works quite nicely with cheap slow SD-cards without overclocking but with Card spanning active.  I tested with a 32 GB no name card that provides 39 MB/s write speed, tested with a card reader.  And I found that the 5D3 works with that card just as well as with the 95 MB/s Sandisk Extreme Pro.  I am getting:

1) 3264x1824/10bitLL/24fps, 0.0 exposure - continuous (orange indicator)

2) 3264x1824/12bitLL/24fps - about 10 sec. recording

3) 1920x3240/12bitLL/15fps/full res. anamorphic - continuous (green indicator)

Since the write speed on the SD-card indicator was well below 39 MB/s with both cards in the above modes, I think, we could safely use cheap slow cards with no or negligible write speed reduction.  In addition, we have another bonus - 10 to 20% more recording due to the spanned writing on both cards.  Not bad at all!
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Quentin on September 23, 2020, 05:21:16 PM
I use 5d mk3 1.1.3.
I installed the last build 14 Sept 2020.

Somehow I get overexposed yellowish recordings.
I use MLVApp to develop the MLVs.
I drop the Gamma to 2 and select the best profile that satisfies me.
Before that build, I never had such distorted recordings.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on September 23, 2020, 05:30:51 PM
How do you think we could help you out? Impossible mission. At least throw in a sample mlv.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Quentin on September 23, 2020, 05:41:16 PM
Quote from: Danne on September 23, 2020, 05:30:51 PM
How do you think we could help you out? Impossible mission. At least throw in a sample mlv.

Οκ, I will
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Quentin on September 24, 2020, 06:00:21 AM
Quote from: Danne on September 23, 2020, 05:30:51 PM
How do you think we could help you out? Impossible mission. At least throw in a sample mlv.

https://drive.google.com/file/d/1Z2hTLI5ETIbpyMDaOL3iWy8F9Eeeph9_/view?usp=sharing
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: sm105 on September 24, 2020, 07:26:05 AM
Quote from: Quentin on September 24, 2020, 06:00:21 AM
https://drive.google.com/file/d/1Z2hTLI5ETIbpyMDaOL3iWy8F9Eeeph9_/view?usp=sharing

Seems like an issue on your end. It looks pretty good to me. The fluorescent lights are clipped, but everything else looks great. If it's yellow, maybe you have Night Shift on your display? ;)

MLV App:
Exposure -1.5
Temp/Tint 3740/41 (selected white area of wall that wasn't blown out)

(https://i.ibb.co/zVBFpfJ/M23-1636-frame-1.jpg) (https://ibb.co/qYcCK15)
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on September 24, 2020, 07:44:49 AM
Looks perfectly fine to me.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Quentin on September 24, 2020, 07:50:43 AM
Quote from: sm105 on September 24, 2020, 07:26:05 AM
Seems like an issue on your end. It looks pretty good to me. The fluorescent lights are clipped, but everything else looks great. If it's yellow, maybe you have Night Shift on your display? ;)

MLV App:
Exposure -1.5
Temp/Tint 3740/41 (selected white area of wall that wasn't blown out)

(https://i.ibb.co/zVBFpfJ/M23-1636-frame-1.jpg) (https://ibb.co/qYcCK15)

What I was seeing on the monitor was normal, otherwise I wouldnt record it.
What was recorded was far away.
Sorry, but I will return to a previous build to prevent any risks.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on September 24, 2020, 08:03:07 AM
If there's nothing wrong it's always better to use the latest build. Usually bugs and other refinements have been worked on but do as you want.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: wib on September 24, 2020, 10:40:46 AM
exported as DNG from MLV app without any settings, and In Davinci a lut is applied and of course in the raw setting you can minimize the highlights and then you're done. the shot is perfect.



Here are the settings I modified in davinci.

project setting / camera raw tab :
raw profile cinema DNG
decode using project
color space blackmagic design
gamma blackmagicdesign
highlights recovery checked

I applied a lut. I used one that I created but you can use EOSHD LUT 5D3 RAW

in the color tab, in the camera raw menu :
color temp 3740
expo -1,5
sharpness 0
highlights -100
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: GullRaDriel on September 24, 2020, 11:47:13 AM
Looks good to me. @Quentin I think it's more a question of settings and shooting conditions than Danne's ML version.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Quentin on September 24, 2020, 08:14:22 PM
Thanks all for your time.
When seeing something that is "suspicious", my intention is to mention it cause I like the tools I use.
I will do some dummy tests to conclude.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: SAMK on September 26, 2020, 07:39:33 AM
Hi Guys
idont know if im at the right place to talk about that but i saw your record using danne build and i have a question
i use Magic lantern since many years and wanted to share some test i did few days ago with my 5D3 before i sent it for maintenance using danne build with overclok SD
i did make some test and this what i got i did filming at 3K1 using spanning card 14 bit and it was recording continu at 24 FPS i did use MLV APP for convert to DNG and got file that is 7 Mo
i did calculation im not sure itswork like that but thus what i got
so 24 FPS X 7 Mo = 168 Mo/S is it possible and can we do this kind of calculation ?
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: masc on September 26, 2020, 10:18:07 AM
What is the goal of your calculation?
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: koopg on September 26, 2020, 02:27:53 PM

Update: I found most of my issues.

1.  I see you guys talking about 3k 1:1 (NO x5) - When i do that i have a pink screen and now record, only when X5 i can shoot 3K1:1, is this normal ?
2.  I remember danne earlier builds of which I could lower 3.5k bit rate to 12 losless, but now ML menu claim it shouldn't be done on large pixel ?

1.1.3
5d3
2020Sep14

I am getting great results from what does work using card spanning is wonderful
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: SAMK on September 26, 2020, 04:20:17 PM
i read many people said 5DM3 can not record more than 135 Mo continu at 10 bit about something like that
my calculation i got 168 Mo continu at 14 bit
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: masc on September 26, 2020, 06:42:54 PM
The bit depth does not change the overall limit. Check your MLV size, and check its length in seconds and calculate with that. Converted data is different and not what the camera recorded.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: SAMK on September 26, 2020, 06:59:51 PM
Ok I see I will do it in this way
Thank you for your help
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: koopg on September 27, 2020, 10:10:30 AM
sd CARD will not go over 20M/s
Just bought a new one
none of them will go over 20mb/s

how do you guys do that ?

pepole talking about 60MB/s and saying bad one would reach 35mb
but I have 7 san disk ranging from 95/mg to 170/m
some from amazon
and a brand new one from 10 min ago from local store
20MB/s

please some one tell me what is wrong
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Bender@arsch on September 27, 2020, 10:34:55 AM
Quote from: koopg on September 27, 2020, 10:10:30 AM
sd CARD will not go over 20M/s
Just bought a new one
none of them will go over 20mb/s

how do you guys do that ?

pepole talking about 60MB/s and saying bad one would reach 35mb
but I have 7 san disk ranging from 95/mg to 170/m
some from amazon
and a brand new one from 10 min ago from local store
20MB/s

please some one tell me what is wrong

How do you test it? And have you try SD overclocking on - > restart - > wait until patching overclocking completed and tested again?
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: koopg on September 27, 2020, 11:12:31 AM
benchmark frim ML menu (1min)
results for any of my 10 cards will not go over 20.8MB/s

I did try oc
BUT NOT REBOOT  :o

trying again...

but still did I understand wrong ? are guys working with your SD at rates higher then 20 ?
my SD does write 80 MG on my pc, I know its not 1 to 1 thing, but I see couple of posts up
claims for cheap SD to do 35Mb
and before a guy saying 55MB

so I need to know if I need to buy 50 more cards to maybe get fast one


Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on September 27, 2020, 11:16:45 AM
Sd patch needs to be enabled. Unclear if so. I suggest a screen recording to exclude more quesswork.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: koopg on September 27, 2020, 11:39:17 AM
I will be happy to share my screen capture,
but where is the sd patch thing ? are referring to SD OC option it self ?

when ever I enable OC the camera will not take 1 frame.
I press rec and its sat automatic  stop

steps:
1.  shot a video on 3.3k 16:9 I can do it for few sec - 7-10
2.  goto menu, enable SD OC
3. reboot camera
4. wait for patch done msg
5. hit rec
6. no frame is taking


then I need to reinstall ML because it would keep tell me that camera did not shut down properly
even if I disable SD OC

ok making a video to show you

Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: koopg on September 27, 2020, 12:12:42 PM
https://youtu.be/_faN5NAlzHU
Please note the first rec was stopped by me, my fingers is out of frame.

But this is whats happening when i enable sd oc

The last sd card i bought  from this morrning(https://uploads.tapatalk-cdn.com/20200927/b42564f801632e9bd9f2a031797b5e54.jpg)

Sent from my SM-N975F using Tapatalk

Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: ewinemiller on September 27, 2020, 12:47:39 PM
I had zero luck from a couple of the 95mb/s cards that I had laying around. It wouldn't write anything if OC was set.

A new SanDisk Extreme Pro 170mb/s worked fine.

https://photos.app.goo.gl/8bdwe99AwLLNW6vV6

Left good, right bad.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on September 27, 2020, 12:52:46 PM
Yes, unfortunately the 170Mb/s card seems the only stable one for these regs.
I am sorry I don't have more time to spend here. Maybe there could be another patch working better here, probably is, but I am not the one that could help here atm.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: koopg on September 27, 2020, 01:11:34 PM
170 card working !!!!!!!!!!!!!!!!!!! wow

cooooooooool
QuoteYes, unfortunately the 170Mb/s card seems the only stable one for these regs.
I am sorry I don't have more time to spend here. Maybe there could be another patch working better here, probably is, but I am not the one that could help here atm.

dont you ever be sorry to any one here !!!! you are the king

I was running this morning to get a true sdxc type 1 - the 95mb/s one
I thought this would be the key lol.

so I still didn't get answer for to the none OverClock method

should I expect more then 20mb/s ? - Is this really a set of faulty cards that I have ?
* again on pc it has 80+ mb/s
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on September 27, 2020, 01:54:07 PM
Yes. Around that unclocked. Not sure exactly.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: koopg on September 28, 2020, 12:35:02 PM
I will just place that here :)(https://uploads.tapatalk-cdn.com/20200928/b25372abff312342a31df487c7d5a436.jpg)

Sent from my SM-N975F using Tapatalk

Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: AlexTran on September 29, 2020, 09:13:13 PM
Hey Danne!

I'm a big fan of your work and currently using your latest build.

I don't have a mac so I couldn't use your "switch mini" app to stich my spanned file.

Could you please make a window version so all of us window user can also try out this feature?

Thank you so much!
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: koopg on October 01, 2020, 12:56:32 AM
Quote from: AlexTran on September 29, 2020, 09:13:13 PM
Hey Danne!

I'm a big fan of your work and currently using your latest build.

I don't have a mac so I couldn't use your "switch mini" app to stich my spanned file.

Could you please make a window version so all of us window user can also try out this feature?

Thank you so much!
Download mlvapp for windows
Just import the files and extract

Sent from my SM-N975F using Tapatalk

Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: AlexTran on October 01, 2020, 10:13:35 PM
Hey Koopg!

Thank you for your input but I tried it and it doesn't really work for spanned files.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Abaco on October 02, 2020, 12:50:48 PM
Hello all, I am interested in this build primarily for the real time live view, but upon installing it I am still getting the choppy low res view even when using the 3.3k 5x preset. I saw on the thread about maybe disabling global draw and that hasnt made a difference. If anyone can help me get that working I would appreciate it
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on October 02, 2020, 01:27:48 PM
What's not working? Where did you get info about real time preview?
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Abaco on October 02, 2020, 01:56:59 PM
Maybe Im not understanding what is being described, for 1x 1080p recording the live view runs full resolution and real time/smooth, on other builds ive primarily recorded 2880x1440 in 5x mode but the live view for that is low resolution and slow/choppy. I took this as making the 5x liveview for higher resolutions run real time and show framing
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: koopg on October 03, 2020, 03:12:27 PM
 :D

https://www.youtube.com/watch?v=V5xNj1DW9W0&feature=youtu.be

:D

5d3 1.1.3 magic lantern
Helius 44-2 F2 1/48
Build: Denna's crop_rec_4k_mlv_snd_isogain_1x3_presets_2020Sep14.5D3113
3520X1730 16:9
14bit lossless
:D Dual ISO
card spanning on
SD card overclock 166hz
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: mkayhko on October 03, 2020, 06:48:55 PM
Can it ever be possible get accurate framing preview of anamorphic or crop modes when using an external monitor?
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Walter Schulz on October 03, 2020, 06:54:34 PM
Danne, is it to much asked to redo first post according to other threads? I find it convenient to have a first post  frequently updated with progress, caveats, recent build info, management abstract, etc.
Just asking ...
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: SAMK on October 03, 2020, 06:55:40 PM
hello guys im using danne build september with firmware 123 on 5D3 and my setting is 3K 1:1 12 Bit  24FPS 
i can not get real time clean screen on my camera
this my all setting and what i get on my camera screen and same on external monitor HDMI connected

https://ibb.co/NNbZJ3b
https://ibb.co/8skHZXG
https://ibb.co/ZSbyYwL
https://ibb.co/tB8v45K
https://ibb.co/gDnQkhH
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: sm105 on October 03, 2020, 09:01:46 PM
Have you tried pressing the Menu button to cycle into and out of the Menu? It can sometimes refresh things to get the preview to work.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on October 03, 2020, 10:10:48 PM
Quote from: SAMK on October 03, 2020, 06:55:40 PM
hello guys im using danne build september with firmware 123 on 5D3 and my setting is 3K 1:1 12 Bit  24FPS 
i can not get real time clean screen on my camera
this my all setting and what i get on my camera screen and same on external monitor HDMI connected

https://ibb.co/NNbZJ3b
https://ibb.co/8skHZXG
https://ibb.co/ZSbyYwL
https://ibb.co/tB8v45K
https://ibb.co/gDnQkhH

If you stand on the preset you want to use it will present info on what preview mode that works with selected preset. Please read carefully and try hard to work with and not against the limitations of each preset.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: beba on October 05, 2020, 06:20:00 PM
Who knows how to remove these lines? (https://i.ibb.co/VBY6bQB/image.jpg)

Resolved
(https://i.postimg.cc/XvMMXLGz/5-A732-E9-A-96-F7-4-B18-B0-DD-F63-E15418098.jpg)
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Dmytro_ua on October 05, 2020, 08:27:03 PM
There are no such lines in a regular Danne's build.
If you really need help, provide more information + source file
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: masc on October 05, 2020, 08:47:23 PM
Upload the clip as short MLV file, and try to tell something about your settings. Maybe it is DualIso, no idea without information. Nobody knows what you did.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: koopg on October 06, 2020, 10:51:31 PM
I have managed to get this with danne. under exposed
Low light above 400iso
Its getting worse every iso bump
On iso800 looks like in the pic
At 1600 ita all lines
3.5k 16:9 and 2:20
In all bitdepth

Its also happening if you dual iso and not on 16:9


So i am gessing  iso issue
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on October 06, 2020, 10:54:36 PM
Upload a sample mlv file. I have no issues.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: koopg on October 09, 2020, 04:18:07 PM
I will later on this weekend.
Say, I can't remember user name but i was reading the liview refactoring project thread
And gave a try yesterday to enable UHD 1:1 liveview
Was playing with regs and could see things changing, for instance i have started seeing thing but lost it.
Then something happened and I had to power cycle the cam.
When it came back i could not remember which one was it, spend 3 hours trying with no luck.

Couldn't understand the routine logic behind when to tweak what.
Do you have any clue which regs could be the needed regs to make this happen.

I don't mind to invest time in it, just need a lead.

Sent from my SM-N975F using Tapatalk

Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on October 09, 2020, 04:57:53 PM
Sorry, can´t understand what you are trying to say. Maybe someone else.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: beba on October 12, 2020, 08:22:15 PM


Shooting at 3.5 K , waves waves
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Dmytro_ua on October 12, 2020, 09:08:27 PM
Do you mean rolling shutter?
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: GullRaDriel on October 12, 2020, 09:28:20 PM
I think he is talking about the vertical black stripes
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Dmytro_ua on October 12, 2020, 09:41:14 PM
Quote from: GullRaDriel on October 12, 2020, 09:28:20 PM
I think he is talking about the vertical black stripes

It looks more like monitor's pixels on this video. But who knows..
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: beba on October 13, 2020, 08:50:02 PM


floating image on 3.5k
Do I need to experiment with the settings?
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: sm105 on October 13, 2020, 09:56:14 PM
beba, this looks like rolling shutter. Try using (1) a tripod, (2) a wider lens, or (3) a gimbal. You will have a hard time getting stable footage when shooting handheld while walking.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: wib on October 13, 2020, 09:58:05 PM
wider lens and ninja steps will help  8)
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Abaco on October 15, 2020, 12:29:45 AM
I never got an answer to my question on the real time preview for this build, so i took a quick video to make sure what im talking about is clear, for the 1080p raw that is what i would call real time, its full color and full speed, when switching into the 3.3k preset the preview is desaturated and extremely choppy. It sounded like people had the 3.3k preset running like the 1080p preview with proper framing, am I missing something or is this how its supposed to look?

https://youtu.be/Np9c276-ICU
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: ewinemiller on October 15, 2020, 12:55:23 AM
I don't think anything outside of the 1080p stuff is expected to give a real time view.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Bender@arsch on October 15, 2020, 02:17:13 AM
Quote from: Abaco on October 15, 2020, 12:29:45 AM
I never got an answer to my question on the real time preview for this build, so i took a quick video to make sure what im talking about is clear, for the 1080p raw that is what i would call real time, its full color and full speed, when switching into the 3.3k preset the preview is desaturated and extremely choppy. It sounded like people had the 3.3k preset running like the 1080p preview with proper framing, am I missing something or is this how its supposed to look?

https://youtu.be/Np9c276-ICU

There is a new 5x preview mode for the 3.3K and 3.5K presets. But this is currently a 5x zoom preview (only a small area). How to use:
- for 5x preview while recording + before = set global draw to off
- for 5x preview only while recording = set "kill global draw"

Benefit is: faster writespeed.

BTW. If you want to use this Preset you need cardspanning, sd overclocking and maybe less bitdepth (depending on scene) .
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on October 15, 2020, 07:32:58 AM
Pay attention to description at the bottom while selecting a preset. When it says cropped realtime preview it actually means "cropped" realtime preview.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: kaco on October 17, 2020, 06:00:22 PM
@Danne: what is the current best mode available to shoot in 1080p with 5Dm3? Does the unsqueezed 48p with compression still have a gray or choppy preview? Thank you
PS: I no longer have 5D to test myself, but working 1080p more than 37fps mode with working preview would be awesome enough to buy one again.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on October 17, 2020, 07:15:53 PM
Sorry, someone else could answer. I rarely touch my 5d3 nowadays.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: andy kh on October 17, 2020, 08:32:29 PM
Quote from: kaco on October 17, 2020, 06:00:22 PM
working 1080p more than 37fps mode with working preview would be awesome enough to buy one again.

Any ML build wil do your job. Set to 1080p mode n increase the fps overide. I think it can go upto atleast 40fps
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on October 17, 2020, 08:53:54 PM
Actually, tested fps override and above 36fps seems to cause corruption. Therefore I added a 38fps preset just now. Think a1ex had around 40fps working at some point or close to it.

BUilds here:
https://www.magiclantern.fm/forum/index.php?topic=23041.msg216899#msg216899
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Bender@arsch on October 17, 2020, 09:20:55 PM
Quote from: kaco on October 17, 2020, 06:00:22 PM
@Danne: what is the current best mode available to shoot in 1080p with 5Dm3? Does the unsqueezed 48p with compression still have a gray or choppy preview? Thank you
PS: I no longer have 5D to test myself, but working 1080p more than 37fps mode with working preview would be awesome enough to buy one again.

5D III currently by Danne's Build:

1920x1080 45fps
1920x1050 48fps
1920x960 50fps
1920x804 60fps

Full working preview ;)

Edit: all is 3x3 binning and it's streched.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: kaco on October 17, 2020, 09:30:12 PM
Quote from: Bender@arsch on October 17, 2020, 09:20:55 PM
1050p 48fps
Full working preview ;)

Wow, this sounds amazing and should be given more attention. The last time I was shooting with 5D, there's been only build by a1ex with 48p (3x3 binning), but the preview was gray/choppy or squeezed/incorrect framing. Any leads on how to get this mode working? Last time I checked, I couldn't get anything with full-sensor working from these experiments, so I thought Danny's work is related to crop modes.
Thank you,
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on October 17, 2020, 09:38:09 PM
Nothing changed. It´s still stretched preview. We need to be realistic here. It still works very well and is totally usable for me and most users. If you can´t work with the shortcomings please do not rebuy the 5D3.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: kaco on October 17, 2020, 10:19:13 PM
Quote from: Danne on October 17, 2020, 09:38:09 PM
Nothing changed. It´s still stretched preview. We need to be realistic here. It still works very well and is totally usable for me and most users. If you can´t work with the shortcomings please do not rebuy the 5D3.

Thank you. I've never said I want to rebuy, just asked what the updates are, as it is not that easy to keep up with the forum.
The stretched preview wouldn't be that big of an issue, but the framing is not accurate for 16:9 as far as I remember. So not that easy to use in the real world.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: koopg on October 17, 2020, 11:49:45 PM
Is there anything new besides 38fps preset that you need us to test over yesterday build ?

Changelog?

Sent from my SM-N975F using Tapatalk

Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on October 18, 2020, 07:10:08 AM
You can follow all changes in code and commits.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: rinski on October 21, 2020, 08:25:01 PM
Hello I wanted to comment that with the 5d3 1.2.3 full anamorphic 3240x1920 av11, iso100, 1/64 in sunny shots, with both cards sandisk extreme pro 128 gb 95mbs + lexar professional 128 gb 1066x 166mhz, 14bits 6 minutes 100+ 70 mbs 15,003 fps , on your latest compilation, could it be possible to zoom to 16 or 17 fps like the eos m for better optical flow?
Thank you.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: rinski on November 03, 2020, 05:54:49 PM
Hello, with the same previous parameters and with the 240mhz patch I tested the sdxc sandisk extreme pro 170 MB / s 512 gb v30 u3 with speeds cf 103 MB / s and this sd 78 MB / s 14 bits for more than 7 minutes without stopping, stopping what I, also with the latest version 5d3 123 without jams and with correct reconstruction in mlv app.
In November 2018 there was an option of 1920x3240 10 and 12 bits with 110 MB / s (90 + 20) between the CF + SD, which would be good with the new speeds, thanks.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: jzzzyang on November 04, 2020, 03:02:43 PM
Could it be possible to use the 5d3
M-Fn button for false color quick switch? It could be very useful. Thanks a lot!
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: motionSOUL on November 04, 2020, 03:15:34 PM
You can do this by simply use two LiveViews, the first one set as you like and the second one with the False Color activated.
Then use the Info button to switch between the Normal LiveView and the False Color LiveView.
I'm not in front of my 5D but there is an option to activate more than one LiveView (2,3,4) and you can set each as you want.

S/.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Walter Schulz on November 04, 2020, 03:39:54 PM
See https://wiki.magiclantern.fm/camera_help#lv_display_presets
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: jzzzyang on November 05, 2020, 03:58:53 PM
I get it!  :D Thanks.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: motionSOUL on November 09, 2020, 02:39:06 PM
Hello, I am testing real anamorphic filming with a 5DMKIII and an Isco Ultra Star x2.
For the moment, I am filming in 1600x1290 - 23.976fps with no crop to get 3200x1290.
Is there a way to keep the same 2.48 ratio and to raise the vertical resolution by using crop modes or not ?

Thanks,

S/.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on November 09, 2020, 03:41:12 PM
Crop modes can go full sensor 1x1 resolution if that's what you're asking.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: motionSOUL on November 09, 2020, 03:53:37 PM
Is 1290 the max vertical resolution without using crop mode?
And what is the maximum vertical resolution in crop mode if you want to keep 23.976fps?

Thanks,

S/.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on November 09, 2020, 03:58:12 PM
1290 max.
Around 3.5k 24 fps.
Instead work the anamorphic presets. You'll get 6k 24fps without any need to use any extra glass.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: wib on November 09, 2020, 05:09:18 PM
@Danne quick question while you are here :)

I know there is 1080 24fps 1x1 preset, which is great, but can you confirm one thing : in slowmo presets (48fps, 50fps, 60fps) with crop checked in Q menu of the preset, it is also 1x1 ?
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on November 09, 2020, 06:04:34 PM
Yes. 1x1.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: wib on November 09, 2020, 07:16:02 PM
Thank you !

(https://64.media.tumblr.com/f38d4d6aa6ab4830181cc1ae49fe80bb/tumblr_ndjsmqxH1z1qhub34o1_500.gif)
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: motionSOUL on November 11, 2020, 05:37:29 PM
Sorry for this question Danne but I'm a bit lost in all the presets modes.
If I would like to shoot in 1920x2160 / 24p without using your anamorphic modes (which are really really great by the way) but just normal shooting with a strange ratio, is it possible with your build? Because, when I raise the resolution (to get more vertical one), it is written in the presets 15p or 7.5p...

Thanks for any help on this...

S/.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on November 11, 2020, 05:48:38 PM
Presets are mostly optimized already. If those aren't enough you probably need a better camera. But not knowing exactly what you want I'll leave your questions for others to answer. No time atm.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: wib on November 11, 2020, 08:12:23 PM
Quote from: motionSOUL on November 11, 2020, 05:37:29 PM
1920x2160

as if you plane to shoot like, square ? 0.88 ratio ?
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: motionSOUL on November 11, 2020, 08:38:46 PM
No, not really. It is because I have bought an ISCO Ultra Star x2 Anamorphic lens and would like to be able to shoot 1920x2160 to get 3840x2160 24p, for the moment I only manage to get 3200x1290 unsqueezed.

S/.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on November 11, 2020, 09:00:14 PM
Already anwered. 1290 is max resolution if not accepting cropped recording. Sell your lens and use anamorphic preset instead imo.
And, recommended to test out those presets and really learn them one by one since it will eventually help you realize what works and not atm.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: motionSOUL on November 12, 2020, 06:49:49 PM
I have well understood what you've said, what I don't know is how to access more vertical resolution in crop mode without using an anamorphic preset.
I can shoot 1920x2332 24p in anamorphic, but I would like to shoot this resolution with 24p but without the deformation. Is it possible? What preset do I need to use?

Thanks,

S/.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on November 12, 2020, 08:00:13 PM
None of them will actually. Only anamorphic will work with standard frame rates.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: 2blackbar on November 13, 2020, 04:38:50 PM
Anamorphic mode is not for anamorphic lenses.
What could help is crop mode, if there would be decent 4:3 preset then you could iuse some 2/3'' sensor lenses with your anamorphic lens x2 to get similar FOV to what you have now and maximum resolution .
crop modes are optimized for 16:9 and cinemascope ratios, You can trim sides from 16:9 but its not real maximum 4:3, its just not many people need it
In theory 2200x1790 could be possible if you would take sides from 2.8k and applty them to top and bottom resolution while reducting left and right, Not sure if that would help but it might be the highest 4:3 resolution this camera could handle at the moment and this also could help us get nice 16mm film emulation preset in 4:3.
--
Ah You have 5D3... i thought it was M.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: wib on November 13, 2020, 07:24:33 PM
I think that's a very good answer to help him.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: gravitatemediagroup on November 15, 2020, 12:04:46 AM
anybody have a copy of the build from BEFORE Oct. 17th?
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: wib on November 15, 2020, 09:41:34 PM
15 august and 13 sept. both for 1.1.3

https://we.tl/t-Mc6onjR8Zu

but the recent one is more stable you know, less bugs.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: gravitatemediagroup on November 16, 2020, 03:33:48 AM
Quote from: wib on November 15, 2020, 09:41:34 PM
15 august and 13 sept. both for 1.1.3

https://we.tl/t-Mc6onjR8Zu

but the recent one is more stable you know, less bugs.

I agree, I just wanted to test out a few things, the latest build has gave me some weird issues that's I've never encountered before, lot of battery pulls, but I'm not sure if it's the build, something in the settings being off, or the camera dying on me lol

thank you for the links :)
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on November 16, 2020, 05:14:19 AM
You could also desctibe your issues here. What preset used causing those issues and even upload your SETTINGS folder for us to reproduce.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: gravitatemediagroup on November 16, 2020, 08:46:05 PM
Quote from: Danne on November 16, 2020, 05:14:19 AM
You could also desctibe your issues here. What preset used causing those issues and even upload your SETTINGS folder for us to reproduce.

I didn't want to bother you because I know you're a busy guy and I thought you was taking a break from the 5d3 stuff.  If I can recreate it I will try to take a picture of it.  It's been a few different things all in the newer 5k anamorphic mode, like full on pink distorted frozen screen, another issue a error pops up on the screen that looks more like from the canon side of things, and other occasions of a hard freeze within a few frames. fps override is off on all issues, but I will try to recreate them, I was just worried that the canon error may have been super bad. lol
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Bender@arsch on November 24, 2020, 10:54:56 AM
@Danne

Can you Re-center again in the new 3.5K 5x zoom crop Preset? It's a little bit to bottom mid.

Thx
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on November 24, 2020, 12:15:16 PM
Been a while. Maybe could take tonight.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: wib on November 24, 2020, 01:02:42 PM
and if you could add 8K RAW + 5G WIRELESS  would be great thank youuuuuuuuuuuuuu

(just kidding  ;D !)
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: omihovilic on November 24, 2020, 05:18:16 PM
Hi guys,

thank you for your amazing work trough all these years.

I'm using latest Danne's crop_rec_4k & ISO experiments with 5D mark iii.

With 3.5K 1:1 centered x5 preset I get constant "compression error -3" and "stdev too large" errors after about half a minute of shooting resulting in corrupt frames in MLV app. But the recording continues with green status. I'm using SANDISK Extreme Pro CF and SD cards with overclocking. It happens with any of the possible resolutions.

Preset 3.3K works fine but I can't get it to record 25FPS. If I try FPS overide to 25FPS camera crashes.

Any clues for me?

Thank you!


I tried 1.1.3 and 1.2.3 firmwares.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on November 24, 2020, 07:26:45 PM
New builds:
https://www.magiclantern.fm/forum/index.php?topic=23041.msg216899#msg216899

- Centered 3.5k preset.
Needs some testing...
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Bender@arsch on November 24, 2020, 08:13:10 PM
Quote from: Danne on November 24, 2020, 07:26:45 PM
New builds:
https://www.magiclantern.fm/forum/index.php?topic=23041.msg216899#msg216899

- Centered 3.5k preset.
Needs some testing...

OK, 3.5K is now a little little bit too top mid and 3.3K the same, but bottom.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on November 24, 2020, 08:52:45 PM
Well, better at least. Don´t think I can get it closer to center.
Who said anything about 3.3k?
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Bender@arsch on November 24, 2020, 09:03:38 PM
Quote from: Danne on November 24, 2020, 08:52:45 PM
Well, better at least. Don´t think I can get it closer to center.
Who said anything about 3.3k?
Only I, just for testing and comparing. And yes, it's much better at least.
Thx.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on November 24, 2020, 09:21:47 PM
Thanks for testing.

New builds again:
https://www.magiclantern.fm/forum/index.php?topic=23041.msg216899#msg216899

Centered both 3.5k and 3.3k a little better I think. Please test.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Bender@arsch on November 24, 2020, 10:16:48 PM
Quote from: Danne on November 24, 2020, 09:21:47 PM
Thanks for testing.

New builds again:
https://www.magiclantern.fm/forum/index.php?topic=23041.msg216899#msg216899

Centered both 3.5k and 3.3k a little better I think. Please test.

I'm not sure, but I see no difference in 3.5K. 3.3K is nearly perfect, but I get some crazy vertical lines/ stripes in all previews.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on November 24, 2020, 11:04:23 PM
Hm, I´ll have a look. Does it affect recorded file too?
EDIT:I don´t think what you are referring too regarding stripes is related to recent changes. This has been there for long. As long as recordings are fine all is working as before and expected.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Bender@arsch on November 24, 2020, 11:09:21 PM
Yes. But this issue is only in 3.3K.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on November 24, 2020, 11:11:33 PM
Yes, it´s because of modifying width to be able and preview cropped and in realtime. Still good.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: omihovilic on November 25, 2020, 11:49:39 AM
After a week of searching the forum a can't find an answer, so I hope somebody helps me out with advice.

Using 3.3K preset (fresh install, all default settings) works great in 23.980 FPS but when I try FPS override to 25 FPS camera freezes. Battery pull required.

Any ideas? Thanks
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: viotech on December 06, 2020, 12:22:22 AM
Hello,

I'm having an issue with the HDMI monitor connection with the latest build Nov 26, 2020. Using a DJI Ronin RS2 Pro gimbal with camera control cable and Raveneye for wireless HDMI monitor.

1. If I just connect camera control cable ML will freeze when pressing record button on gimbal. But, if I use the start/stop button on the camera it records fine and can use anamorphic modes without issue.
2. If I add HDMI cable for external monitor (Raveneye with RS2 Pro), I can monitor the output from the camera live!
3. (This is the main issue) If I add HDMI cable for external monitor in #2 and press the start/stop to begin recording the camera freezes and needs a battery drop.

Attempting with:
1. Anamorphic
2. 16:9
3. 12 or 14 Bit
4. card spanning: on (256GB Extreme Pro CF and SD cards), ML on CF.

Is there a certain settings combo to get HDMI to work with anamorphic modes? The issue appears to be with ML and not the RS2 as the feed works fine while not recording and when recording begins the 5DMIII chokes.

Much Appreciated!
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: wib on December 07, 2020, 12:52:09 AM
I think you should not use FPS override. if you want 25 fps then switch to PAL and select 1080 ALL-i @ 25 fps in the canon video compression options.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on December 07, 2020, 05:57:51 AM
24 fps is maximum for 3.3k preset. It´s also informed when standing at the preset.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: ChristianEOS on December 07, 2020, 07:32:17 AM
Also 5.7k (anamorphic) is the max. 24fps.
But I thought with write speed approx 95mbs somehow maybe 25 f. p.s. would be still possible?
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on December 07, 2020, 08:39:28 AM
Not the issue. Maximizing height affects timer registry. Reducing height will allow for higher fps. Just choose another preset instead.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: MotherSoraka on December 07, 2020, 07:43:51 PM
Hi Danne and thank you for everything you've done for this community.

Is it possible to set/lock the HDR live-view preview only on 1 ISO?
in other words, can we stop the constant Flashing/Switching between the 2 ISOs in HDR mode while recording?
Becsaue it makes it almost unusable and impossible to see what youre shooting every other 5 seconds.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: GullRaDriel on December 07, 2020, 10:56:45 PM
Long time without posting.
Thanks for the work @Danne, I'm going to test your latest build tomorrow :-)
You're awesome. Thanks for your contributions !
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: viotech on December 10, 2020, 08:12:11 AM
Quote from: viotech on December 06, 2020, 12:22:22 AM
Hello,

I'm having an issue with the HDMI monitor connection with the latest build Nov 26, 2020. Using a DJI Ronin RS2 Pro gimbal with camera control cable and Raveneye for wireless HDMI monitor.

1. If I just connect camera control cable ML will freeze when pressing record button on gimbal. But, if I use the start/stop button on the camera it records fine and can use anamorphic modes without issue.
2. If I add HDMI cable for external monitor (Raveneye with RS2 Pro), I can monitor the output from the camera live!
3. (This is the main issue) If I add HDMI cable for external monitor in #2 and press the start/stop to begin recording the camera freezes and needs a battery drop.

Attempting with:
1. Anamorphic
2. 16:9
3. 12 or 14 Bit
4. card spanning: on (256GB Extreme Pro CF and SD cards), ML on CF.

Is there a certain settings combo to get HDMI to work with anamorphic modes? The issue appears to be with ML and not the RS2 as the feed works fine while not recording and when recording begins the 5DMIII chokes.

Much Appreciated!

Can ignore this. Experimenting more the HDMI feed works perfect, the issue appears to be with the control cable. Camera crashes requiring a battery pull if using miniUSB to macbook with canon eos utility 3 app to control iso/record/aperture or using the ronin rs2 button controls that work fine with 1.2.3 firmware and not ML. This issue probably not related to your build
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on December 10, 2020, 10:31:11 AM
Ok, that´s good. I really never use hdmi and external screens so can´t say anything here.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Bender@arsch on December 10, 2020, 02:50:28 PM
@Danne
Some good news about the 5x 3.3K vertical stripes issue?
I tested your currently newest update and it's still not gone. You can see it especially in dark area, mostly greenish.

Thx
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on December 10, 2020, 03:31:10 PM
Sorry, no idea what you are talking about. Need MLV test files or clear, visual examples including all your settings applied.
Please read up on how to effectively report bugs. Thanks.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Bender@arsch on December 10, 2020, 11:25:48 PM
I mean this:

Quote from: Bender@arsch on November 24, 2020, 10:16:48 PM
I'm not sure, but I see no difference in 3.5K. 3.3K is nearly perfect, but I get some crazy vertical lines/ stripes in all previews.

Quote from: Danne on November 24, 2020, 11:04:23 PM
Hm, I´ll have a look. Does it affect recorded file too?
EDIT:I don´t think what you are referring too regarding stripes is related to recent changes. This has been there for long. As long as recordings are fine all is working as before and expected.

Quote from: Bender@arsch on November 24, 2020, 11:09:21 PM
Yes. But this issue is only in 3.3K.

Quote from: Danne on November 24, 2020, 11:11:33 PM
Yes, it´s because of modifying width to be able and preview cropped and in realtime. Still good.

If you need a shortend MLV, I can upload tomorrow.
There is no specific settings. It's only in 3.3K mode in all preview modes (with or without global draw) and in MLV, since you try to centered again the last time.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on December 10, 2020, 11:53:51 PM
Yes, mlv. Recordings are ok over here so your settings or anything else you are doing will be important to understand if you want to solve your issue. Please read up on how to report bugs effectively.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Bender@arsch on December 11, 2020, 01:57:09 PM
@Danne
Here is a bad 4K smartphone video from this issue. I started with default settings with your last update. And a short MLV File in 10bit:

https://drive.google.com/drive/folders/1N7CcGelofLKkKTc-9i_em933d1gRswAp?usp=sharing

I use this specific spot, because this issue is better to see on contrasty and dark area.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on December 11, 2020, 03:36:06 PM
New builds:
https://www.magiclantern.fm/forum/index.php?topic=23041.msg216899#msg216899


- Fixing timers causing "hot" recordings in 3.3k mode

Please test.

Finally I got the information needed to tackle the issue. Thanks for that. Next time, do start with providing a sample mlv. In this case I would have fixed it in ten minutes like right now. Well, better late then never right.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Bender@arsch on December 11, 2020, 03:57:37 PM
It's gone, thx;)
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: motionSOUL on December 13, 2020, 12:53:11 PM
Hello Danne, a question for you: would it be possible, technically speaking, to add a preset which could record at, for example, 2808x2340, in 24p (not in an anamorphic mode)?
What could be the greatest vertical and horizontal resolutions in 24p (no anamorphic)?

Thanks,

S/.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on December 13, 2020, 03:04:58 PM
The limitations are all presented through each and every preset. If full resolution would work with 24fps it would already be there. It's not like we're holding back.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: motionSOUL on December 13, 2020, 03:40:04 PM
Thanks for the answer, I try to understand:
In 3K 1:1 mode, I can record 1920 vertical resolution (24p).
In Anamorphic mode, I can record 2340 vertical resolution (24p).
What, could be the maximum horizontal resolution of a 2340 vertical file if I wasn't in an anamorphic mode and I would still want 24p?

Not sure if it is clear?

Thanks,

S/.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on December 13, 2020, 04:17:42 PM
Not really. If you push resolution and ratio to max then you are using highest thinkable reolution with 24fps. A simple test going through each preset will give you your answer.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: motionSOUL on December 13, 2020, 05:10:30 PM
I know, I have already done that, I have tested every presets since two days.
The problem is if I want 24p, the max vertical resolution now is 1920 pixels with the 3.1K 1:1 (without using anamorphic).
But, some presets offer more vertical resolution, like 2340, in anamorphic.
My question was just if it is possible to get 24p, 2340 vertical resolution, even if I loose some horizontal one and if I loose one what could be the horizontal resolution?

I don't get why it is possible to record 2340 pixels vertically in anamorphic but not in an unsqueezed preset.

S/.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: wib on December 16, 2020, 08:55:05 PM
Hello Danne, I have two questions, how does one manage to create its own presets (or the list is full) ? And does the function of restoring ML when formatting not compatible with your version ?
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on December 16, 2020, 09:04:41 PM
Not full.
Not secure using sd_uhs module and then format while enabled. Disabled formatting from ml. Might removing sd_uhs in the future. Not sure how useful it really is.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: rinski on December 17, 2020, 05:13:35 PM
Hello, I would like to comment that the sd_uhs module works well in 160 mhz and only with 240 mhz it has problems of sound loss after 3 minutes with 20, with sandisk extreme pro 170 MB / s 128 GB card, formatting the sd card or deleting the files on the computer has no danger, and the increase in speed recording with both cards at the same time is appreciated when recording with looser parameters and much longer.
Thank you very much Danne and company for your meritorious work.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: vstrglv on December 21, 2020, 10:54:00 AM
Quote from: rinski on December 17, 2020, 05:13:35 PM
Hello, I would like to comment that the sd_uhs module works well in 160 mhz and only with 240 mhz it has problems of sound loss after 3 minutes with 20, with sandisk extreme pro 170 MB / s 128 GB card, formatting the sd card or deleting the files on the computer has no danger, and the increase in speed recording with both cards at the same time is appreciated when recording with looser parameters and much longer.
Thank you very much Danne and company for your meritorious work.
Hello, what Canon`s model are you talking about? There is no possibility  to set 240 mhz for 5D3.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Walter Schulz on December 21, 2020, 11:25:01 AM
Quote from: vstrglv on December 21, 2020, 10:54:00 AM
There is no possibility  to set 240 mhz for 5D3.

https://www.magiclantern.fm/forum/index.php?topic=23041.msg229639#msg229639
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on December 21, 2020, 11:41:43 AM
I gave up on 240Mhz setting. I recommend any old builds with this patch still there not to use it. Too many issues.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: vstrglv on December 21, 2020, 12:10:17 PM
Quote from: Walter Schulz on December 21, 2020, 11:25:01 AM
https://www.magiclantern.fm/forum/index.php?topic=23041.msg229639#msg229639
I mean last Danne`s 17Dec2020 build.
Quote from: Danne on December 21, 2020, 11:41:43 AM
I gave up on 240Mhz setting. I recommend any old builds with this patch still there not to use it. Too many issues.
What about 192mhz оn 5D3?
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on December 21, 2020, 12:16:50 PM
Gave up that one too. Never stable or not working at all.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: GullRaDriel on December 21, 2020, 04:36:08 PM
160 MHz is the only one that's working nearly flawlessly on 5D3.

For last version: I tried a few presets and the feeling is good ! I'll try to save a bit of christmas on video. That's a first for me :-)
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Wlad81 on January 02, 2021, 09:54:25 PM
Using Dec 11 2020 mod. Cannot run Full-res LiveView mode. Card Spanning is on, preferred card is CF. Using best recommended cards. What am I to do?

Otherwise, great mode.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Bender@arsch on January 02, 2021, 10:59:56 PM
Card Spanning and preferred card to CF together is not possible.
But for solving your problem, you need to disable global draw (or kill global draw) and disable audio;)
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Wlad81 on January 02, 2021, 11:04:49 PM
Thank you so much, never knew of that.

UPD: the Full-res LiveView mode finally works. But the workflow on my 2008 Mac Pro is a piece of... something.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: motionSOUL on January 05, 2021, 03:39:35 PM
Have someone had some issues with 1920 60fps?
All other presets are working fine, but with this preset (+ NTSC / 720p / 60 Canon Menu), I can record, transcode the MLV to .dng and preview the .dng on my Mac (1920x804), but the files created are impossible to import in After Effects or Photoshop. They give me Photoshop (-30504) Error message.
And sometimes the recording is stopping due to datas errors, filling my 5DMKIII with numbers, but even if the record is good with any errors, I can't load the files then.

Any idea ?

Thanks,

S/.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Dmytro_ua on January 05, 2021, 03:51:46 PM
This mode is very demanding to your CF card recording speed. If your card is good, try to disable all unnecessary modules and onscreen data (like zebra, RGB parade and others)
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: motionSOUL on January 05, 2021, 03:58:25 PM
The problem is I get all the images and they are good in Preview mode from the Mac, but something is preventing themselves to be understood by CameraRAW after been transcoded.
The mlv file is opening fine in MLV App, but as soon as I transcode in .dng, the files become unreadable.

S/.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Dmytro_ua on January 05, 2021, 04:23:08 PM
Quote from: motionSOUL on January 05, 2021, 03:58:25 PM
The mlv file is opening fine in MLV App, but as soon as I transcode in .dng, the files become unreadable.

I think it's better to upload small MLV file and ask in MLV App thread for a help with transcoding. You won't get any help without a corrupted file uploaded.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: nomadfilm on January 11, 2021, 01:59:25 AM
Hi All,

I apologize in advance for the beginner question but I want to confirm the process of upgrading to this build.  Do I simply copy and replace the ML folder and autoexec.bin currently on my SD card with the ones provided in this build?  Just want to make sure before I take the leap.  Thanks in advance for your patience as I continue to learn and explore.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on January 11, 2021, 07:55:47 PM
I recommend you uninstall any older builds to start clean. Then install next build fresh.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: wib on January 12, 2021, 12:48:49 PM
Quote from: nomadfilm on January 11, 2021, 01:59:25 AM
Do I simply copy and replace the ML folder and autoexec.bin currently on my SD card with the ones provided in this build?

Yes.

(already answered here https://www.magiclantern.fm/forum/index.php?topic=19300.msg233582;topicseen#msg233582 (https://www.magiclantern.fm/forum/index.php?topic=19300.msg233582;topicseen#msg233582))
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: nomadfilm on January 13, 2021, 09:22:47 PM
Quote from: Danne on January 11, 2021, 07:55:47 PM
I recommend you uninstall any older builds to start clean. Then install next build fresh.

Thanks @Danne for answering such a basic question.  Does a complete reinstall mean formatting the SD card in camera and then moving the ML files for the new build onto the card?  Does there need to be a copy of the firmware on the Sd card for ML to operate it or is this not necessary?  Thanks again for helping us newbies.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on January 13, 2021, 09:37:28 PM
After uninstall your card is just like any other card without magic lantern.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Larouso on January 22, 2021, 05:41:10 PM
Hopefully someone has an answer for this : Is anyone of you using Danne's build here with an external monitor and is able to get the framing preview over hdmi on to the external monitor? If yes, which one?
Or is it maybe just not possible?

Thanks for A hint in the right direction.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: wib on January 22, 2021, 05:45:59 PM
I do, and I use a Freewell monitor, everything above 1080p will give you a real time cropped x5 preview, 5K will appear flattened.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Larouso on January 22, 2021, 06:01:10 PM
Quote from: wib on January 22, 2021, 05:45:59 PM
I do, and I use a Freewell monitor, everything above 1080p will give you a real time cropped x5 preview, 5K will appear flattened.

Thanks for the super fast reply.
X5 crop rt preview is exactly what I also get for example in 3,5k mode. But to be honest it's giving me a hard time to guess how the frame looks then finally. So I usually stay with the cameras built in monitor...
I was still hoping that I am just missing a config that would give just a clone of what is shown on built in monitor.


Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: nomadfilm on January 23, 2021, 06:27:54 PM
Hi everyone,

I've been playing around with this build and I've run into a problem.  I was recording using various settings and on a previous start-up, script came up on the screen that scrolled too fast for me to read but included the phrase "Fix me."   Now, there is a red dot beside my Memory patches setting (EA39374) and speed tests show that my write speed has decreased to about 9 mb/s on my SD card.  When I turn on SD overclock, all Memory patch dots go red.  Is this normal/expected or has something gone wrong?  Obviously, I don't understand the Memory patch setting.  I've purchased a new SD card and tried a speed test on it and I get similar results.  I've also done a full re-install and that doesn't seem to fix the situation. I backed up my files and can provide info if needed.  Any help would be greatly appreciated. 

As a followup, has anyone been using card spanning in combination with sd overclock?  Are there any limitations in this setting?

Thanks
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on January 23, 2021, 06:55:57 PM
If sd patch is troubling please don't use it. It's rather unstable and should be used very carefully. The only card I possibly would trust is the sandisk extreme pro 170mb/s.
If you're card is slow please turn off sd uhs and restart camera to get it back to normal. If that isn't working you probably need to format and reinstall.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: nomadfilm on January 23, 2021, 07:31:18 PM
Hi Danne,

Thanks for the advice.  With the SD patch off, should I be experiencing a red dot beside one of the memory patch settings (EA39374)?
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on January 23, 2021, 07:45:52 PM
No camera here. You need to post screenshots and share info on sd card brand and preset used and so on. Generally speaking. If you are able to record with your card with patch off it´s probably all good.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: michaelfilm on January 25, 2021, 10:23:31 AM
Hi everyone,
I have been filming with 5dmk3 / 1.1.3 / crop rec 4k build 2018-07-22 13:09 until today.
In response to a problem-question in the forum
https://www.magiclantern.fm/forum/index.php?topic=19300.msg233752#msg233752
- Bender@arsch kindly recommended me to try out Dannes builds.
Since my english is very poor (deepL) , I find it difficult to find out which last build runs well...
I would be very happy about any help!:)
(I can well imagine that sometimes the nerves are on edge when such fun-loving newcomers like me
come for the for the xth time with similar questions).
Sorry for that!:) & thanks for all!

Translated with www.DeepL.com/Translator (free version)
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: michaelfilm on January 25, 2021, 10:58:39 AM
aah, now I understand the principle that in the old post 23may2019 the builds are refreshed
:)
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on January 25, 2021, 11:26:04 AM
Quote from: michaelfilm on January 25, 2021, 10:58:39 AM
aah, now I understand the principle that in the old post 23may2019 the builds are refreshed
:)
Yup, correct.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: michaelfilm on January 25, 2021, 01:41:17 PM
Thanks Danne!
To understand the new menu structure, I suppose I'll read from the old post and as far as it's possible for my layman understanding;
- try it out myself.
At the moment I can't even manage a continious rec. with higher resolution... :)
I can't put 12 bit losless on, etc.
But I will try that now...
I want to switch quite simply from FF-HD-25p in best possible quality -
to a higher resolution (with the lowest possible crop factor (around 1.80 or lower) and continuous recording.
Until now:
5dmk3
1.1.3
fast KomputerBay 64GB CF (no SD)
crop rec 4k Build 2018-07-22 13:09
mostly 3072x1320 1.81 crop (5x) or FF-HD
12Bit losless

With the problem in FF-HD:
In 12Bit losless it comes to "vagabond" pixel errors at edgy spots that look like digital fireflies:)
If I take 14 Bit or 14Bit Losless: ColorScience tilts from ISO 800 clearly into the reddish...

I'll stop right here in the forum with my inflationary lush text:)
I don't hope that someone will explain everything to me...:)

----The only question I have is whether I can find solutions to the problems I outlined above here in your build.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on January 25, 2021, 01:47:09 PM
Instead of using bitdepth options in raw video menu keep that set to 14bit lossless. Then select Bitdepth from Movie tab menu instead. It´s a workaround. Image will appear greenish when in 10bit but recorded file will look right.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: winmediacenter on January 29, 2021, 10:09:22 AM
Hello everybody.

I just downloaded Danne's newest build (2020Dec11) and made some tests. My cards : Lexar Professional CF 64GB 1066x and SANDISK Extreme Pro 128GB 170/90.

With Card spanning on and SD Overclock mode i was able to record most of the modes continously. But that's not the case.
I started to make some speed tests with different modes and this is a conclusion:

In my opinion 3.5K x5 centered is the best mode for highest possible resolution with reasonable previev (Kill global draw - on).
3584x1500 (1.60x) in 10bit continous  satisfies me the most, but... few days ago i was still using cropp_rec_4k.2018Jul22.5D3123.zip and noticed interesting thing.  I always recorded 3,5k x5 centered with lower resolution because of lack of overclock option.
After update to your version i noticed that the image is not centered as it was before. It's because of increasing the maximum resolution in this mode? Now i can record more Mpix but its more misaligned than before. :(

I think this is still best mode to use when we consider speed/quality/ability to focus when recording. The recording speeds are also very promising. Maybe we should focus on that mode more than before?

Btw. awesome job Danne i'm grateful for your job. Thanks to your work guys i can enjoy my 5D much more. :):)
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on January 29, 2021, 11:55:36 AM
Thanks for feedback. I did some centering changes, that is correct. Let me know your exact resolution you are using and I will take a look later.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on January 29, 2021, 04:13:24 PM
I tested the 3.5k and the way I use it it´s centered. That is I only use it with ratio options 2.39:1, 2.35:1 and 16:9 from ratio menu under Movie tab menu not changing resolution.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: winmediacenter on January 29, 2021, 08:32:00 PM
I,ve checked one more time to make sure. In previously used build (magiclantern-crop_rec_4k.2018Jul22.5D3123.zip) the picture is perfectly aligned to the center but resolution is limited to 3584x1320 (maybe that's the catch). I'm not able to achieve higher horizontal resolution than 1320.

In your build i'm using 3584x1500 (maximum possible) and image is definitely shifted down. Even when i choose one of the ratios (eg. 2,39:1) from Movie tab it still far from perfect. I've tried different ratios with same results.

I also tried to set the same resolution i used before - same result.

Is it possible to shift the "picture" slightly to the top? Tomorrow i'll try to add some overlayed frames from both of the builds to show you the difference.

3,5K centered x5 is the most misaligned mode by now. In previous build it was UHD. It was significantly shifted down but in your build its nearly perfect.

Thanks :)
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on January 29, 2021, 08:48:01 PM
Push the joystick button to centre rectangle. If you want to see rectangle Go to Display tab and turn off Kill Canon Gui.
Report back if this works for you.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: winmediacenter on January 29, 2021, 09:06:25 PM
I've tried it many times. I'm always trying to set the rectangle to the center. I also tried to move the rectangle to the top to move entire image and it triggers camera freeze and need to pull the battery out.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on January 29, 2021, 09:08:03 PM
I think I need to see a screen recording from install and forward to see what´s going on. It works here and it´s centred so not sure what to do.

EDIT: Wait, Ill check once more, downloading the dec 11th build now.

Tested, works like intended. Please provide a screen movie recording to help further.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: winmediacenter on January 30, 2021, 04:49:10 PM
Uninstalled ML and performed clean install. I didn't change the resolution only set aspect ratio to off (with 2,39:1 in nothing changed at all - the same framing)


this is a comparison of different modes.  Lens - Samyang 8mm


(https://i.ibb.co/3z1jqsM/comparison-00000.jpg) (https://ibb.co/zJsBY57)

As you can see 3,5K x5 centered is too much to the bottom of the frame. I also noticed some exposure change in 3.3K mode. You can see it on a short video i added.

Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on January 30, 2021, 05:32:04 PM
In the preset sub menu try and alter CMOS[1] lo or CMOS[1] hi and see if you can fine tune vertical positioning. Share yor findngs here.
Horisontal offset should be "CMOS[2]".
Exposure change? Maybe only preview when 12bit kicks in? Shouldn´t affect recorded image. Try 14bit.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: winmediacenter on January 30, 2021, 06:31:20 PM
I think it did the job. I found that CMOS[1] lo - 9 and CMOS[1]hi - 12 works best for me.. but how can i save those?
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on January 30, 2021, 06:46:09 PM
Is that setting valid for 3584x1730 or is that for lowered resolution? What about the original cmos 1 when in 3584x1730?

You can change this in crop_rec.c:
                /* raw buffer centered in zoom mode */
            case CROP_PRESET_CENTER_Z:
                cmos_new[1] = PACK12(11,61); /* vertical (first|last) */
                cmos_new[2] = 0x09E;            /* horizontal offset (mask 0xFF0) */
                break;

This:
                cmos_new[1] = PACK12(11,61); /* vertical (first|last) */
into:
                cmos_new[1] = PACK12(9,12); /* vertical (first|last) */

Of course, if it´s valid for all ratios I will put it into my builds.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: winmediacenter on January 30, 2021, 06:53:57 PM
Quote from: Danne on January 30, 2021, 06:46:09 PM
Is that setting valid for 3584x1730 or is that for lowered resolution? What about the original cmos 1 when in 3584x1730?

I tested it for 3584x1500 (2,39:1) and also for maximum 3584x1730. Works just fine for those two.

Am i need to recompile the code with special software? (sorry for questions but i'm not a programmer). I can try this with all three ratios under Movie tab if you need it.

Edit:

checked for all three ratios - no issues.

With the original CMOS1 (3584x1730) still to much to the bottom.
9 , 60 seem to work fine as well
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on January 30, 2021, 07:03:53 PM
I added the code in these builds. Could you test for your cam?
https://bitbucket.org/Dannephoto/magic-lantern_dannephoto_git/downloads/crop_rec_4k_mlv_snd_isogain_1x3_presets_2021Jan30.5D3113.zip
or:
https://bitbucket.org/Dannephoto/magic-lantern_dannephoto_git/downloads/crop_rec_4k_mlv_snd_isogain_1x3_presets_2021Jan30.5D3123.zip

If working I replace older builds in first post.


For compiling I use this tool for mac:
https://www.magiclantern.fm/forum/index.php?topic=21882.msg199370#msg199370

You seem to be able and get around code so I would recommend you set up a compiling environment for experimenting and developing in the future.
https://www.magiclantern.fm/forum/index.php?topic=16012.0
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: winmediacenter on January 30, 2021, 07:09:30 PM
Everything works just fine with all three ratios. Also recorded some footage and postprocess it to make sure. I will test it further. Thanks for quick response. :)
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on January 30, 2021, 07:12:14 PM
Updated first post  8).
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: ChristianEOS on January 30, 2021, 07:53:26 PM
I will test the built has anything changed with the "anamorphic advanced" Presets?
So that 25p in 5.7 still works. Similar than second and first version of 5.7 k?
Does the One screen "display Menü" work with only clicking menu?
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on January 30, 2021, 08:09:12 PM
Only 3.5k preset cmos 1 changed. No need to download for what you are seeking.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: rinski on February 01, 2021, 05:08:33 PM
Hello, I wanted to inform that with the version 01-30-21 for 5d3 in full anamorphic it generates a multitude of corrupt black squares.
Thank you.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on February 01, 2021, 05:40:11 PM
Quote from: rinski on February 01, 2021, 05:08:33 PM
Hello, I wanted to inform that with the version 01-30-21 for 5d3 in full anamorphic it generates a multitude of corrupt black squares.
Thank you.
Yes, you can keep them all for free.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: ChristianEOS on February 01, 2021, 07:48:13 PM
Danne very funny ;) grey pictures also are for free:)
It is actually a stable version I think that somehow also with versions before I change sd160. When I start the camera new the whole magical Lantern reset it. That only happens with sd160 sometimes I write mlv files from CF to SD that works a little more stable without the sd160 if you know what I mean?
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on February 01, 2021, 08:36:20 PM
Yes. Sd_uhd itself can cause instabilities. It's questionable if it should be used or not but some cases showed to work. As long as you know this it can stay included in the build.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: ChristianEOS on February 03, 2021, 01:32:28 PM
Thinking about how a public/ stable version might look like? I think the 5. 7 k is a cinematic difference. Since Zeek makes quiet an often seen impression of SD uhs 160 that would be also available?
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on February 03, 2021, 01:46:16 PM
Not sure if I follow you entirely here. Owning both an eos m and a 5DIII I don´t see much need of use of patching or even recording onto a sd card on the 5DIII. If you want more stable recording don´t enable sd uhs at all. On the eos m on the other hand, patching is needed imo.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: ewinemiller on February 04, 2021, 04:06:07 PM
Lately I've been shooting in the 3.5k 1:1 centered x5 mode at 3456x1728 10bit. It's continuous with card spanning and SD overclock, but only a few seconds without either. There are certainly plenty of good modes without spanning or overclock, but it does open more options.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on February 04, 2021, 04:17:42 PM
Good to know. Thanks for feedback.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: rinski on February 04, 2021, 07:58:35 PM
Hello, could you explain what the parameters are, for the x5 mode centered 1: 1 from 3.5k to 3456x1728 10bit, I can't use it. Thank you.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: ChristianEOS on February 04, 2021, 08:06:04 PM
"Not sure if I follow you entirely here. Owning both an eos m and a 5DIII I don´t see much need of use..." (me also)
Of course it isn't necessary. Recording in 60p you still can push it more to the limits. I will do as you wrote. I didn't want to disturb.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: wib on February 05, 2021, 12:45:02 PM
 I would like to add to this that sometimes there are mlv recorded in 3.5 with card spanning that end up without audio track. I don't know if it's related to card spanning or to sd_uhs with card spanning...
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on February 05, 2021, 01:29:51 PM
Could you upload one recording with missing audio? There are more than one way to develop footage that could solve this. Most likely audio is still there.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: ewinemiller on February 05, 2021, 02:06:57 PM
Quote from: rinski on February 04, 2021, 07:58:35 PM
Hello, could you explain what the parameters are, for the x5 mode centered 1: 1 from 3.5k to 3456x1728 10bit, I can't use it. Thank you.

I'm using a slightly tweaked build of Danne's work with just a few extra Ratio presets in the Movie menu, but the settings below should get you there with his build.

Presets  3.5k  1:1 centered x5
RAW Video
     Resolution  3456x1728
     Aspect ratio 2:1
     Data format 14-bit lossless
     Preview Framing
     Crop rec preview auto mode
     Card spanning on
Bit Depth 10 bit
Ratio Off
SD overclock 160mhz

and most importantly, you have to have the right SD card. After seeing success with other folks I got one of these and no problems. It's got to be the 170mb/s. I have one of the 95mb/s ones and no luck with it. Haven't seen the lost sound issue.

https://smile.amazon.com/gp/product/B07H9VX76D/ref=ppx_yo_dt_b_search_asin_title?ie=UTF8&psc=1

Any fast writing compact flash seems fine. I use a variety of Komputer Bay 1000x or better cards.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Bender@arsch on February 05, 2021, 03:01:44 PM
Quote from: Danne on February 05, 2021, 01:29:51 PM
Could you upload one recording with missing audio? There are more than one way to develop footage that could solve this. Most likely audio is still there.

I have this problem sometimes too, here is an shortend example:

https://drive.google.com/folderview?id=1pLemHSb2UynLEkaIJuNA7eIHmKYzDrDJ
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on February 05, 2021, 03:54:37 PM
No shortened file please. Obviously would affect audio length if shortened. This check needs complete files.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Bender@arsch on February 05, 2021, 04:06:08 PM
OK, in 8min there is a 600mb clip online. Same Link
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on February 05, 2021, 05:01:06 PM
Checking metadata:
File Header (MLVI)
    Size        : 0x00000034
    Ver         : v2.0
    GUID        : 17047428700475394385
    FPS         : 23.976000
    File        : 0 / 0
    Frames Video: 132
    Frames Audio: 0
    Class Video : 0x00000021
    Class Audio : 0x00000001


Frames Audio: 0 so I guess something would not allow wav file to be recorded. Is this reproducable? Only happening in 3.5k mode?
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: rinski on February 05, 2021, 05:49:44 PM
Algo 5k anamorphic eos m 7 minutes, Full anamorphic 5d3 19 minutes. Thanks you
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: wib on February 05, 2021, 06:49:22 PM
reproductible yes.

here is 3 records attempt (the link is 2Go; is it ok for your connection ?) https://we.tl/t-Cogz5FvXHN



The settings :

Presets  3.5k  1:1 centered x5
RAW Video
     Resolution  3584x1630
     Aspect ratio 2:20
     Data format 14-bit lossless
     Preview Framing
     Crop rec preview auto mode
     Kill Global Draw ON
     Card spanning on
Bit Depth 10 bit
Ratio Off
SD overclock 160mhz
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on February 05, 2021, 07:17:15 PM
Thanks. And what about when disabling card spanning? Try to find a way that is working maybe? Or do you know that it is card spanning?
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Bender@arsch on February 06, 2021, 12:39:57 PM
Quote from: Danne on February 05, 2021, 05:01:06 PM
Checking metadata:
File Header (MLVI)
    Size        : 0x00000034
    Ver         : v2.0
    GUID        : 17047428700475394385
    FPS         : 23.976000
    File        : 0 / 0
    Frames Video: 132
    Frames Audio: 0
    Class Video : 0x00000021
    Class Audio : 0x00000001


Frames Audio: 0 so I guess something would not allow wav file to be recorded. Is this reproducable? Only happening in 3.5k mode?

Not really. In my Files i have no audio in 0% up to 33% of shoot sessions. And this is not only in 3.5K, in UHD 1x1 and 3.3K (16:9) is the same problem, but not so often i think. I delet some older clips, so i can't see older tests with Anamorphic. But in all records i use cardspanning + sd overclocking.
I think i need some systematic tests (camera on, record and stop, changing bitdepth, record and stop, changing bitdepth, refresh liveview, record and stop, focusing, record and stop, 10x zoom, record and stop and so...)
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on February 06, 2021, 01:21:17 PM
Oki. From what you describe it seems related to card spanning. If possible do more tests without card spanning.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: IDA_ML on February 06, 2021, 05:23:43 PM
I would like to report a very strange behavior of the 5D3 with the latest Jan. 30-th 2021 build.  When I turn all presets off to default to the normal 1920x1080/24 fps mode, when I change the bit depth from 14 (off) to 12, 10, 9 and 8, the preview looks perfectly equal at all bit depths but with every bit depth reduction by one step in the above sequence, the recorded footage gets overexposed by one stop compared to the previous one.  I noticed that after filming at 12 bit and then decided to go down to 10 bit.  The 10-bit footage was overexposed by one stop compared to the 12 bit one, with all other settings unchanged.  This also happens with the anamorphic modes.

I have shot a bit depth sequence that illustrates this.  Here are single MLV frames from each clip:

https://we.tl/t-MfE2qkSiAQ

Is this normal?
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on February 06, 2021, 05:38:39 PM
Use the bitdepth menu from raw video if you turn off crop rec. Set it to OFF in Movie tab.

Edit: You can also correct those files with white level slider in Mlv App.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: IDA_ML on February 06, 2021, 09:13:13 PM
Yes, correcting the white level of these strange (overexposed) looking files works quite well in MLVApp but this requires manual adjustment of every clip separately.  Moreover, if you try to do that in Resolve with MLVFS, fixing white level is almost impossible.  Why can't the correct white level at each bit depth be hard coded in the camera as this used to be in older builds?
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on February 06, 2021, 09:53:28 PM
What build exactly?
Learning compiling and essential code will answer most questions and help me and others from drowning in repeatable questions.
I have very little time to refine stuff. Help needed.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: IDA_ML on February 06, 2021, 10:53:08 PM
Sorry for asking.  Thanks.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on February 07, 2021, 09:08:10 AM
I will see if I can add some disabling of bitdepths when crop rec i set to off.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on February 07, 2021, 09:53:27 AM
New builds in first post.

Movie tab bitdepth routines will be turned off when crop rec is turned to OFF. Use bitdepth routines from raw video menu instead if needed in this case.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Bender@arsch on February 07, 2021, 03:10:21 PM
Quote from: Danne on February 06, 2021, 01:21:17 PM
Oki. From what you describe it seems related to card spanning. If possible do more tests without card spanning.

I tested some multiple recording delay tests with cardspanning and without (2sec. clips) and the result is: No failure in wihout cardspanning, but i found another interesting thing.
In the cardspanning tests: After a clip without audio, the next clip was only recordet on CF card and this clip is about 900mb bigger  (~300mb vs 1250mb). But the clip before has the same filesize (~150mb)

here 3 files example:
1. with audio, 2. wihout audio 3. bigger size and with audio

https://drive.google.com/folderview?id=1pLemHSb2UynLEkaIJuNA7eIHmKYzDrDJ


I also tested without SD overclocking -> same result. There are also 3 times without audio behind each other -> all 3 clips after the first clip without audio are much bigger and the first 2 without audio, but this time there is a 1kb file on the SD Card (from the 2 bigger files without audio).

I hope this will help.

-------------------
Edit: files are bigger because more frames...

Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on February 07, 2021, 03:54:09 PM
I had a look around yesterday in mlv_lite.c but it's not obvious what to look for when it comes to audio. There are some notes how audio starts. Since it seems related to card spanning I guess something will go wrong after a few takes sometimes so I would start by testing stuff in mlv_lite.c. Feel free todo so. Also ask Ilia3101 since he ported card spanning. He might have a clue.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: AlanSmithee on February 10, 2021, 01:54:36 PM
Hi there,

(there's a slight chance that I am asking something that has been answered before, but sometimes I gets confusing when reading though years of conversation on the forum, and then to work out what has been updated and what hasn't. my apologies in advance)

Here's what I want to do:

1. shoot RAW video, with reliable and stable (enough) settings (therefore HD for me)
2. use LiveView for focusing (and check composition etc)
3. check the video after recording to see if the footage is useable

I am using ML version "crop_rec_4k_mlv_snd_isogain_1x3_presets_2021Feb07.5D3123" - 5d mk iii (installed on CF card atm, since i thought i would use the SD card for recording mainly)
I have a highspeed SanDisk Extreme Pro 256gb 170mb/s, and a SanDisk Extreme 60Mb/s CF card (several sizes)
I use the SD overclocking module

To keep the video recording stable and reliable, I am sticking to HD (FF or 1:1). To check the video after shooting, I would like to use the proxy h.264 video, instead of the slow MLV player.

And here's where I am having problems:

- As soon as I add the proxy h.264 setting, the videos (both, the proxy and the MLV) are largely overexposed. (jumping to 12800 or 6400 ISO, for whatever reason)
Exposure is fine, as soon as I switch off the proxy again.
this happens in all modes other than manual mode (AV,TV), no matter whether sound on or off, or 14bit or 12bit uncompressed

Does Proxy only work reliably in Manual mode?

- As soon as i add the proxy h.264 option, the MLV file will be recorded onto the CF card, despite the SD card being my preferred card selection. is there any way I could do this the other way round? MLV to SD card, .mov file to CF card? (main reason for this is I have more space and the faster card in SD). However, I might be mistaken about the write speed of my CF cards. maybe 60mb/s is perfectly fine?

Also, my battery seems to be drained relatively fast (from 100% to 90% in around 5-10 minutes). Is that related to ML?

thanks, ;-)
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on February 11, 2021, 03:58:03 AM
Raw video is working in manual mode so I guess both mov and mlv will get affected as described if using auto modes. I didn't test this very much.

Recording hd on sd card maybe will work with sd overclock enabled but cf will probably be more reliable. Speed on sd will probably not be faster than around 55mb/s write speed. SD overclocking is highly experimental and not very reliable. i wouldn't build my card set up around sd cards if I wanted reliability.

Recording proxy on cf card is probably possible by rewriting code routines in mlv_lite.c so you can take a look in there if important.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: AlanSmithee on February 11, 2021, 10:08:23 AM
Perfect, thanks for the clarification.
Using manual mode should be perfectly fine.

Good to know about the SD card, I will switch back to CF for main recording. (So far, in my little amount of testing, I have had very stable results with SD overclock, but after hours of filming it might be a different story ;-) )

Oh, there's one other thing that sometimes gets mentioned on the forum, but doesn't have very up-to-date information:
the use of an external camera monitor with ML.

I will buy myself external monitor (HDMI), but I have no knowledge about where the feed for the monitor comes from.
Will it cause additional 'workload' on the camera and have a negative impact on the raw recording? (Once I have the monitor, I will share my experiences, obviously)


[edit: I used a monitor and it works fine. no crazy latency nor unstable video recording]
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: civica on February 12, 2021, 12:20:48 AM
Hi!
I'm very new to this forum. I tried searching around but I didn't understand all of it.

I want to record 1080p 25fps without using also the sd card. What's the best stable preset to do it? Is it with Dual ISO?

Thanks a lot for the work Danne
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: saf34 on February 17, 2021, 11:11:45 PM
Hi guys, just been reading through this topic for the first time after a long time on the stable branch.  Just a quick sanity-check for me I wanted to throw in re. monitoring (pprompted by @AlanSmithee's comment above).

In anamorphic mode, my HMDI out (on 1.2.3) is giving the unsqueezed live feed.  So this means with an external monitor with anamorphic desqueeze we can film RAW *and* monitor with a fully functional preview (i.e. not the black and white one shown on liveview)? 
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: wib on February 18, 2021, 12:54:36 AM
yeah but the hdmi is heavily cropped in 5k mod so you're end up with a very narrow and horizontal field of view.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: saf34 on February 18, 2021, 01:07:00 AM
Agh, yup, was too easy to be true... thanks.   Just thinking out loud: it's kind of useful as a 'magic focus'... almost... as it's not centered.  I'm not there yet with how the code works: is this the nature of the stream or could I tweak something to center it?
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: AllWashedOut on March 02, 2021, 07:56:21 PM
My experience with SD overclocking below. I am using a Sandisk Extreme 128gb Micro SD (XC I, V30, U3, A2) in an SD adapter sleeve and measured using the benchmark module in 1gb mode.

Original write speed: 21mbps
Original read speed: 21mbps

Overlocked write speed: 66mbps
Overclocked read speed: 72mbps

So the speed increase is very significant.

Unfortunately, it's not stable enough. When taking raw photos, I get an error beep maybe 1 out of 20 shots and have to toggle the power switch. That photo comes out corrupted, usually with half the image missing.

I notice that 160mhz is the only overlock option. Any possibility of lower options or is that a hardware impossibility?
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on March 02, 2021, 10:50:10 PM
There are preferred cards proven more stable than others.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: wib on March 03, 2021, 01:31:16 AM
not the best. better to stick to cf or a good sd, but not a micro sd in a sd adaptator
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: evgennish on March 03, 2021, 04:35:42 AM
Hello!
Thank you Danne and all team who are still work with this build! Its something amazing!

My camera Canon 5d mark 3 and Canon 24-70 2.8 II, firmware 1.2.3, crop_rec_4k_mlv_snd_isogain_1x3_presets_2021Feb07.5D3123
I watch this topic a lot of time, can tell something and want to ask few questions

first, ability to connect with gimbals:
Ronin S
- Works well, start/stop rec gimbal button, focus and etc. in anamorphic 14bit lossless continuous

connection with gimbal MCC-microUSB(+adapter microUSB(female)-MiniUSB(male))

Way to connect:
1. Turn off camera
2. Connect camera and gimbal
3. Switch Camera to Photo Mode (the most important thing)
4. Turn on Gimbal
5. Turn on camera
6. Wait for SD patching (if you use this patch)
7. Switch to video
8. Continuous recording

Ronin SC2 or RSC2 or RSC 2
Connection is different and works not so good, connection with gimbal usbC-miniUSB
in anamorphic 14bit lossless, focus work, camera won't recording video, and go in error, needs restart (log on a screen)
in anamorphic 10bit uncompressed camera start/stop rec with gimbal button, focus work well, record 15-30 second and stop (this is the one way i found it work for the short takes)

Settings
- Preset anamorphic - 2.35:1 - 1808x2300px
- Movie tab bitdepth - OFF
- Raw video - Data Format - 10-bit
- Raw video - Kill grobal Draw - ON
- Raw video - Card Spinning - ON
It is doesn't matter how to turn on or turn off camera and in which mode(photo/video)

Maybe someone know how to start recording with RS2 or RSC2 continuous?
in 14bit lossless and connected to gimbal it has error using on camera rec button or gimbal rec

And one more question to Danne, Is it technically possible to simulate frame in LiveView not stretched? i try different settings it ML menu Display tab - Anamorphic, but it is not so good and not usable

Anyway thank you for the best life for this camera!
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: ChristianEOS on March 03, 2021, 03:42:42 PM
On Sunday I'm filming a music video. I hope I'm hitting the topic correct. Does anybody advice SD card spanning. I've got the best CF cards SanDisk Pro but sadly only 64GB so maybe I thought I would save changing the CF card All the time?
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on March 03, 2021, 03:53:40 PM
If not using sd uhs patching even very slow cards will do.
Card spanning not working with higher frame rate presets.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: ChristianEOS on March 03, 2021, 07:09:09 PM
https://youtu.be/Mx7OnFnj6AM

I prepared with turning off magic lantern overlays. I basically press the info button once and record in 5.7 k 24fps so you would see anamorphic distortion therefore if somebody else has the camera. Because I've got two 5d3s. So they can approximately see what is Sharp (with slightly sharper). I have got a good CF card and the SD ScanDisk extreme pro 95mbs and 170mb s. Would that work with card spanning wouldn't even use faster U HS. Just that I don't have to change the CF card the whole time?
I don't get paid for this but the last video was seen by over 30000 people. I tried to upload exactly the biggest file to YouTube but in with 5.7 k I only got 2k on YouTube. Then I tried with full resolution in 16 by 9 worked 4k. Would it be possible somehow upscaling it to 8k on YouTube? I remember when I had my first DV camcorder it made a difference if I uploaded in 720p there was a difference to 480p even though it was the same camera. Thx
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on March 03, 2021, 07:21:53 PM
Better if you test thoroughly on your own if you are testing bleeding edge features such as sd uhs, card spanning. If going for safety exclude card spanning or at least the sd uhs patch.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: ChristianEOS on March 03, 2021, 07:44:06 PM
I tested 5.7k with card spanning. Global draw off. 14bit lossless.
That worked.

Just the view with any magic lantern (global draw) doesn't work. After 2 minutes stopped. Without it worked until 64gb full.
My only question is does it work more stable without card spanning? I thought there is only a difference with sd uhs 160 modul on. It worked otherwise flawlessly. What about the 8k on YouTube? For the fast editing I use Sony Vegas 17 and that has no rendering option in 8k. My colour correction with Adobe After Effects and exported in *. mov 422 in exactly the same resolution as I recorded it with magic lantern (5.7k). :) looks expensive/sharp.

Am I am doing anything stupidly wrong?
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on March 04, 2021, 08:26:15 AM
A lot of set ups lacks data. Different presets might work better than others. If you do a 5.7k film shoot with card spanning enabled and it's stable it's good info to have.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: ChristianEOS on March 04, 2021, 03:31:33 PM
Sry, Danne I also lack sometimes on my concentration ;) the imagine in 5.7k is  incredible full of detail. You must know how the sensor renders a frame. Even if you then on YouTube watch it in full HD. A complete new impression of the picture. But I guess teenagers want to film also in slow motion. So I will have to choose the 60 FPS. I hope nobody will notice?
Maybe the most people have no 5K Monitor.
I also tested 38 FPS with Sharpness 1. 60fps sharpness 0. Surprisingly with other magic lantern builds. I had to put the sharpness completely down and it looked much more unsharp. Anamorphic 2:39:1 FPS 60 looks quite similar to a normal sharpness without aliasing and miore. I think no magic lantern build works better. You should get something that :) thx 1000x
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Bender@arsch on March 04, 2021, 04:53:23 PM
QuoteWhat about the 8k on YouTube?
Why you want upscale this? In my tests I upload a 5.7K video and I can set to 5K in the web browser and if I click right click on statistics, you can read this is 5.7K ;)
In my opinion there is no reason for upscale a 5.7K Anamorphic image.

The only reason is with footage less than 4K, but not for quality of the footage, just only for Youtube - > YouTube HD quality is really bad.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: wib on March 05, 2021, 05:03:33 PM
Quote from: Bender@arsch on March 04, 2021, 04:53:23 PM
The only reason is with footage less than 4K, but not for quality of the footage, just only for Youtube - > YouTube HD quality is really bad.

Agreed !
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: ChristianEOS on March 05, 2021, 11:32:04 PM
What about you watch videos on YouTube in 4K would you see the difference with magic lantern 5.7 k and 60 FPS 1080? I'm sure you wouldn't be able to see miore or aliasing.

https://youtu.be/CFhkdFaRkCk

I filmed this with the 5D 2 and 30 FPS used twixtor. I just wonder filming  in 5.7k would it be worth the less FPS? The only deficit with the 5D III is no slow emotion. I bought a DOF adaptor for the Samsung Galaxy S10 that even records with 240fps. Mathieu Stern said, it wouldn't be good result for vintage lenses. What would be the cheapest slow emotion ?
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: caylemweeks on March 10, 2021, 12:32:36 PM
Hey guys,

Just installed this build to my Canon 5D Mk 3 and it's working pretty well. I'm using the dual shooting mode with my SD and CF card and can do continuous 3.3K RAW in 10 bit, which is awesome.
HOWEVER.
In every single one of my clips, there is this weird pink aliasing (for want of a better word) on the highlights. Literally every single clip I record that is the slightest overexposed, the pink lines appears.
Even on text on a screen, it appears.
I've trolled through the forums and looked at countless posts, but to no avail. I'm using the latest 2021 Feb build, so I'm not out of date. I've got Global Draw turned off as well.
I haven't enabled any dual iso stuff, or anything to do with any custom overlays.
Help me Obi-Wan MagicLanternForums-obi, you're my only hope!

EDIT:
I've been using the EV function and have been exposing by about +1 EV to get proper exposure in the RAW files. Pink areas everywhere.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: jzzzyang on March 13, 2021, 04:29:02 AM
Hi,caylemweeks
MLVApp-profiles-cyan highlight fix
Try this option.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: masc on March 13, 2021, 10:04:28 AM
@caylemweeks: sounds like you clipped the green channels. Try highlight reconstruction in parallel to RAW white level adjustments in MLVApp. In Resolve there is also a highlight reconstruction feature.
And for the future: use zebras and ETTR in camera and try to not overexpose!
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: kidfob on March 13, 2021, 05:45:57 PM
Hello all. I just made the large jump from a ML build from 2016 to the most recent one crop_rec_4k_mlv_snd_isogain_1x3_presets_2021Feb28.5D3123

Looks like things have changed quite a bit.

On the 2016 build, I would use Dual ISO in addition to crop mode for a resolution of 2560 x 1090
I had card spanning and was able to shoot continuously.
Monitoring was a challenge since Live View was gray, low quality, and not real time

Will the latest build help me solve some of these challenges?
Can I shoot Dual ISO, 4k continuous? Is card spanning deprecated and no longer available now? How do I get continuous shooting? (overclock module hasn't seemed to help. Maybe I'm doing something wrong)
Can I get a good monitoring situation? Live view and perfect framing of scene being shot?
How high up can I go in resolution these days and still use Dual ISO, without any bottlenecking of the camera or cards?

Thanks much all
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: ChristianEOS on March 13, 2021, 11:33:54 PM
First of all this magic lantern build has no crop anymore. With anamorphic on you do still get the view in black and white and no real time. But if you would change to the normal Canon view. You get a view croped and squeeze. There for it is in real time and sharp. With 14 bit lossless you don't have to use card spanning anymore. It works stable will my camera setup. Although I don't use duel iso since I noticed that it is a little less sharp.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: kidfob on March 15, 2021, 12:47:38 AM
Thanks. Attached are screenshots of my settings. Any recommendations?

https://i.imgur.com/Dy9Bn27.jpg
https://i.imgur.com/7Gmzd05.jpg
https://i.imgur.com/vHeMcMb.jpg

Also, looks like the liveview is 5x and doesnt let me frame correctly however. Anyway to get a more accurate live view?

Thanks again
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on March 15, 2021, 06:20:22 AM
Nothing changed with preview capabilities. If not real time uncropped use framing for correct preview.
A few refined presets added like the anamorphic modes(Also called 1x3 binning).
Card spanning works. Sd uhs patching not very reliable. If using that see to it to test out a valid, good working card. Info on this can be found in varous posts and threads.
Other than that, a lot of tweaks and a few bug fixes.

I recommend you go through this thread as it progressively shows what´s been added into this build. Most questions have been answered if not all.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: kidfob on March 15, 2021, 06:47:03 AM
Thanks Danne. I think I have things working well now. I'm actually able to keep Global Draw On for all modes in addition to Zebras, Focus Peak, Cropmarks, Histogram, and Waveform.
Preset is 3.3k 1:1 x5
12 bit
2.39:1

SD not overclocked
No card spanning
14-bit lossless
Preview - Framing
Crop Rec Preview auto mode (what does this do? lol)

I'm pretty happy with how things are working now and have done 30 second tests without any issues. Any recommended optimizations to make things even better? I like this!

Any tips for shooting slow motion? I've never accomplished that w ML before. What are some best practices?

Thanks much all!
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on March 15, 2021, 07:16:53 AM
Find your own ways. Seems you're perfectly capable of doing that and if you find something extraordinary post your findings.
What's not working with higher fps? You share no info of what you are trying to achieve.

Best practices. Turn off all extras. Add them back one by one until it breaks recordings.
Apply bitdpeth reduction to 10bit. Increase if possible.
If 10bit not enough. Record 2.39:1 or reduce ratio even further.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: kidfob on March 15, 2021, 07:35:05 AM
Appreciate it. I'll keep experimenting.

Slow motion is achieved by using FPS override correct? Will I need to choose a proper resolution for 60fps instead of sticking with 3.3k?

Thanks again
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on March 15, 2021, 09:43:37 AM
I never use fps override. I only work with presets from crop rec if not using regular hd 1080p, then I turn crop rec to off.
What you ask for is easy to test. My suggestion would be that you take a week and try and learn each and every preset, their quirks and possibilities. Pay attention to help texts. Some modes require cam to be set to 50 or 60fps in canon menu. A few presets needs to stay in x1 and a few needs to be started in x5 crop.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: far.in.out on March 22, 2021, 12:34:27 PM
Hey guys. Do you think it's a good idea to start a topic comparing ALL the ML video recording options (RAW, MP4, HDMI capture, USB, ...) with most notable advantages/limitations of each option and keep it up to date with the most recent developments and statuses for each option? I mean, not for any particular camera but the overall state of video recording feature set of ML, so to speak. I've been out of the loop for several years and some recent developments just blow my mind away. I've bought and sold several cameras during this period of time. If I were aware of those features I would've made different choices. I just feel like it would be useful to many to have such a high level overview of what is possible. Then one could dive deeper into specific camera's possibilities and options.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Walter Schulz on March 22, 2021, 01:15:10 PM
About to edit a wiki about streaming/recording abilities with Canon EOS cameras covering HDMI, USB via EOS Utility/EOS Webcam Utility.

Collecting USB related stuff should be easy. Most are just doing 576p. Exception (so far): EOS M will not work at all. Need input about "sheep in wolf clothes" EOS M3, M5, M6, M10, M100 running PowerShot codebase.

Tricky part is HDMI. There is no easy way to tell actual HDMI resolutions in all modes without proper hardware. Cheap Full-HD USB converters (those in the 20 and lower buck/euro range) will not reveal anything about input resolution. Some TVs/Monitors will link to any input source and tell you it's 1080p.
Tried https://webcamtests.com/ but no avail. (Found the site via this link (https://phototacopodcast.com/can-canon-eos-webcam-utility-beta-do-1080p) ).

Further findings: The only cam in ML project scope able to do DCI 4k (4096 pixel horizontal) is EOS R5. All other labeled as 4k-HDMI are doing UHD (3840 horizontal aka 2160p).

I just started with an uncomplete table https://wiki.magiclantern.fm/streaming:hdmi_rfc

And covering all raw recording modes ... good luck! I think it can be done if supported by devs making those custom builds.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: far.in.out on March 22, 2021, 02:27:06 PM
I was thinking about something like this:
(https://i.imgur.com/4BJXwg2.png)
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Walter Schulz on March 22, 2021, 02:43:27 PM
Quick sidenotes: Cropped raw/MP4/HDMI is not free of aliasing and moire. Amount should be the lowest, of course. And high bandwidth applies to RAW, too.
You should also mention anamorphic mode.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: far.in.out on March 22, 2021, 04:05:45 PM
That was just to illustrate my point. I'm nowhere near enough informed to do this on my own. I think this deserves a separate sticky thread that would be updated by people who are in the loop and would structure and update the info to reflect the current state of things. I don't want to continue off-topic here but I'm not sure about where is the right place for such a thread.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Walter Schulz on March 22, 2021, 04:17:31 PM
On the long run sticky threads with content to maintain are prone to become unmaintained, outdated and adding to user confusion.. "Staff" discussed this some time ago and opted for wiki instead. Wiki doesn't guarantee to go smoothly and had to be maintained, too. But looking backwards on some history we are better with wiki than without.
Lookup Camera Help (http://wiki.magiclantern.fm/camera_help). Initiator put in some serious work and dropped out without being heard from him since and way before completion.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: far.in.out on March 22, 2021, 04:28:41 PM
Makes sense. OK, I'll try it.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Panz on March 29, 2021, 08:30:53 AM
With February builds, shutter speed doesn't affect exposure when in video mode 3.5k or 3.3k. The numbers do change but there is no effect on the image or histogram. All other modes work as they should. When i switch to photo the exposure is correct. I tried changing shutter range, shutter lock(changing shutter from ml only), ettr, expo override but none seems to be able to change the actual shutter speed. The number changes, the exposure doesn't. I am on 5D 1.2.3

Is that a bug or is there any other option i am missing?
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on March 29, 2021, 10:29:27 AM
Don´t have my camera atm but I can take a look this week.
Meanwhile. Could another user verify this behaviour?
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Kharak on March 29, 2021, 11:46:50 AM
Reset ML settings.

I recall once having a similar issue with "vanilla" 3.5k crop. Don't know what it was, but resetting to ML default fixed it

Also check your Dial, is it by chance on (A+) or any of the others?
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Panz on March 29, 2021, 03:48:01 PM
I tried resetting both canon and ml settings. Formatted both cf and sd and installed vanilla 28feb build but still the same issue. It's on M mode. It's not readjusting iso or aperture. Shutter number changes as it should. There is no difference though. Happened both on manual and electronic lenses. Other than that i cannot think of anything else to try.
Tried to change shutter in shutter priority mode. As shutter speed decreased 1/4000, iso maxed and the image got brighter.

Last think left to check is 1.1.3 version, although i prefer 1.2.3 for hdmi monitoring.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on March 29, 2021, 08:11:43 PM
I can verify that shutter is not changeable in 3.3k preset. Tried to see what´s going on but couldn´t find the issue yet. When I build the preset I tried following the CROP_PRESET_CENTER_Z routine and probably some safe guard stopping shutter from being modified. I sees if I can find time and fix it.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on March 29, 2021, 09:06:13 PM
I think the shutter issue with 3.3k preset is fixed:
https://bitbucket.org/Dannephoto/magic-lantern_dannephoto_git/downloads/

Some issue with cmos 2. Thanks for reporting.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Panz on March 29, 2021, 09:44:28 PM
Thanks for the really quick fix!
Happy to help with the bug hunt. Least i can do for now.

I tried working with 3.5k x5 centered but it's not as robust as 3.3k. I always get compression error around 1 minute mark no matter what resolution i use. Console comes up and i have a few logs. The cam keeps recording but i think a few frames are gone. Is this a known issue, performance related? I can look into in a bit more if you want(upload logs, clip)
I guess one more frame per second is really heavy on card speed compared to 3.3K.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on March 29, 2021, 10:23:47 PM
You can see if compression issues disappears by reducing height. In the Presets sub menu(push Q button) and reduce reg_6804_height by let´s say -10. Now also reduce reg_713c with the same number -10.

Overhead errors can also be caused if you have too much going on like histogram, magic zoom and such. What ratio are you using by the way? Only use the ratios provided in Movie tab menu (Ratio). Are you using 25 fps? Bitdepth? You leave out a lot of information. Exterrnal monitors will probably affect most of all so if using that expect issues.

Lastly. Downgrading to 1.1.3 will probably help here too.

Please report back if you are getting better results.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Panz on March 30, 2021, 04:05:59 PM
I use 2 display presets. I keep one clean and the second one is where i have histogram, waveform and level indicator. When i record i use the empty one. I use digic peaking, should i turn it off?
I was under the impression that 3.5K is 25fps and 3.3K is 24fps. So i use 25fps in the 3.5k preset. I shoot at 12bit and 16:9 ratio set in the movie tab menu.
My cards are 32gb lexar x1000 and sandisk extreme pro 64gb. No external monitor atm. To achieve continuous recording i lower resolution in the raw recording menu to 2880.
Changing the registers by -10 seems to fix the problem(recording at 2880X1620). Need to test more to be certain.
I even shot a dual iso clip at 1620, no issues.

Can the change in the register be saved in the manual config? eg. CM3 set to 3.5k with register's change?
Another issue that sometimes happen is that the screen gets stuck in real-time focus mode(in 3.5K mode). I cannot change back to framing from ml menu or by going to canon menu and back again. Need to either restart or switch to review and back. I haven't found the steps to reproduce being stuck in real-time yet. Will look more into it.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on March 30, 2021, 05:18:43 PM
24 fps probably works without reducing height.

Easiest test is to just enable the 3.5k preset after a vanilla installation. Don't enable any other settings. If this works you can test enabling other settings until it breaks.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on April 01, 2021, 10:22:14 AM
New builds uploaded thanks to @Panz test reports. Reduced 3.5k preset height by -10 to reduce corrupted frames when recording in 25fps.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: motionSOUL on April 27, 2021, 03:29:01 PM
Hello Danne, totally fool question here:
Would it be possible to have a plain, all sensor, preview when idle and when recording despite the chosen crop mode?
And to prepare and use crop mark images to get the correct framing?

Thanks,

S/.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on April 27, 2021, 03:40:53 PM
Grab the code and start experimenting. I have no idea what you are talking about.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: motionSOUL on April 27, 2021, 04:24:20 PM
Yes I know. To explain the question:
When the camera is framing but not recording, the framing preview is always good even if not realtime and is the same as the image recorded.
But when the camera is recording the preview, when working, doesn't help to frame anything because the back image on the camera doesn't correspond to the image recorded at all.
My question was: would it be possible to put on the camera screen a realtime preview or readout of all the sensor when waiting or when recording even if we have chosen a particular crop mode?

Don't know if I am clearer.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on April 27, 2021, 04:48:45 PM
I don't get what you are after but maybe someone else understand.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: theBilalFakhouri on April 27, 2021, 07:51:40 PM
@motionSOUL

Currently there is no real-time with correct-framing preview when using "Crop mode" on 5D3, you are referring to "Framing" preview which is choppy but has correct framing, if you want to use it all time (in Both Idle and when recording) do the followings:

Highlight "RAW video" (make sure mlv_lite is enabled) --> Press Q button --> Preview --> Change it to "Framing"

You also press Half-Shutter when recording to toggle between "Framing" and "real-time" preview.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: motionSOUL on April 27, 2021, 08:39:56 PM
Thanks for the info, but what I really would like to know is: Would it be possible technically to implement an option to get a full live view full sensor realtime preview while recording a crop mode?
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: names_are_hard on April 28, 2021, 12:20:54 AM
That is not known with certainty, and I feel the answer of "maybe" is unsatisfying.  But that is the answer.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: alcet on April 30, 2021, 09:50:26 PM
I can't download  Danne's crop_rec_4k & ISO experiments for Canon 5d markIII
I am using this downloding link  https://bitbucket.org/Dannephoto/magic-lantern_dannephoto_git/downloads/
Error message is ERR_SSL_PROTOCOL_ERROR
bbuseruploads.s3.amazonaws.com  sent an invalid response.

How can I download or where can I download it?
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Heatshiver on May 03, 2021, 12:36:52 PM
I may be missing something in settings and just trying to figure what I could change:

In 1080P I get a wider FOV than I do when I am using a preset like UHD or 3.5K. What can I do to correct this?
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Walter Schulz on May 07, 2021, 06:38:37 AM
https://wiki.magiclantern.fm/glossary#crop_rec
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: wib on May 07, 2021, 07:40:34 PM
get a wider lens :)
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Boygetslost on May 23, 2021, 04:04:23 PM
Hey everyone,

I was using the April 21 update with the 5d 1.1.3. Nothing fancy, just using the 1080, normal 14 bit, no crop. Very little lockups or issues.

I then tried the April 21 update with the 5d3 1.2.3 firmware and I seem to be have more lockups and recordings stopping (not all the time but less stable then with the older firmware).

Is that normal? is the 1.2.3 firmware less stable. Or is it something I am doing?

Does anyone else have any ideas or experience?


Cheers
Chris
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Danne on May 23, 2021, 06:15:53 PM
Overhead issues?
But really you need to be more specific about settings used and so on.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: vastunghia on May 27, 2021, 05:24:23 PM
[Original post: 27may21. 28may21 edits highlighted in blue]

Ciao,

last week I grabbed a 5D3 (so now flanking my old 70D) from eBay and started playing with Danne's beautiful presets (using 1apr21 build).

I'm reporting my findings and understandings in the table below, and I would be glad to know if there is something wrong / misreported or if someone is having a different experience.

Please note that
So here we go:











IDDescriptionHorizontal resolution*H/V ratioBinningFOV@16mmFOV@35mmAPS-C safe**Frame rateData rateCont.Rec.PreviewOther notes
3X1920 1:1
1.9K (HD)
2.39
1x1
41°
19°
Yes
25
48 MB/s
Yescolors, slightly low h/v ratio?, hi fpsPerfectly centered?
anamorph_ fullresanamorphic fullres
1.9K stretched to 5.6K
2.39
1x3
97°
54°
No
15
69 MB/s
Yescolors, correct framing, low fpsCovers 100% of sensor width. Centering not investigated.
4K_HFPS4K 1:1 half-fps
4K
2.39
1x1
77°
40°
Almost
12.5
72 MB/s
Yescolors, correct framing, low fpsA bit below center. Unusable: produces pink / magenta / corrupted frames.
1x3anamorphic
1.8K stretched to 5.3K
2.39
1x3
93°
52°
No
24/1.001
120 MB/s
Yesgrey scale, correct framing, low fpsCovers 94% of sensor width. Just slightly below center?
3K3K 1:1
3K
2.39
1x1
62°
31°
Yes
25
125 MB/s
Yescolors, correct framing, low fps.A bit above center and slightly on the left?
33K3.3K 1:1 x5
3.2K
2.39
1x1
65°
33°
Yes
24/1.001
129 MB/s
Yescolors, correct framing, low fpsA bit below center and slightly on the right?
CENTER_Z3.5K 1:1 centered x5
3.5K
2.39
1x1
70°
35°
Yes
25
179 MB/s
Nocolors, correct framing, low fpsSlightly above center? Continuous recording @10 bit (in some circumstances even 12) or disabling Global Draw + 12 bit (in this case preview will be standard x5, so cropped).
UHDUHD 1:1
3.8K
2.61
1x1
74°
38°
Almost
25
183 MB/s
Nocolors, correct framing, low fpsPerfectly centered? Continuous recording @10 bit (apart from extreme circumstances maybe?), or in some circumstances 12 bit but disabling Global Draw (no preview at all!)
* 1K = 1.024 px
** meaning that you can shoot with an APS-C lens without suffering vignetting

For my tests I have been using
with both SD overclock (@160 MHz) and card spanning enabled.

Card benchmarks (in video mode) give me
but while the former test is in line with what I obtain on my 70D with 160 MHz overclock, I think that the latter is not reliable as it would not explain how ever I was able to shoot continuously in 3K mode at 129 MB/s (measured ex post) [Bender@arsch confirms that the latter is not reliable].

Final remark: on my 70D, thanks to the work of ArcziPL (and others), and using his 1mar21 build, I am able to push SD overclock also to 192 and 240 MHz. With 240 MHz, benchmarks display an improvement from 57 to 76 MB/s for SD write speed. Not that much, but I'm wondering if that could help in achieving continuous shooting with CENTER_Z or UHD.

Oh, and why 4K_HFPS mode seems to require only 72 MB/s @12.5 fps? If I double that, I get only 144 MB/s, which is way lower than what I measure (179 MB/s) with an even lower resolution (3.5K with CENTER_Z) @25 fps... mmh.

Thank you!

Sergio
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: Bender@arsch on May 27, 2021, 06:28:32 PM
Hi, some short answers :

- full resolution LV is only possible with audio off and global draw off or kill global draw
- Aspect Ratio: you can change it and get in Anamorphic mode (set to off) full 1920 streched to 5.7K and for example 3.3K, 16:9 and 3.5K nearly 2:1
- continously recording: for better Result you can decrease bitdepth. Default is off - > meaning 14bit lossless, try 12 or 10 bit (all lossless), And if you set global draw off increase writespeed, but preview is only available in 3.3K and 3.5K mode - >5x zoomed crop live preview.
- SD overclocking works only with SD Card
- With Cardspaning: I did a lot of tests and the showing Writespeed is not correct
You Can reed here : https://www.magiclantern.fm/forum/index.php?topic=12862.msg228848#msg228848
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: vastunghia on May 27, 2021, 06:46:53 PM
Thanks a lot! Further remarks below.

Quote from: Bender@arsch on May 27, 2021, 06:28:32 PM
- Aspect Ratio [...]
- continously recording: for better Result you can decrease bitdepth [...]

Yup, thanks a lot, forgot to mention that I just wanted to test presets 'out of the box'. But you are right, it would be nice to add a column reporting the max bit depth allowing continuous recording (if any).

Quote from: Bender@arsch on May 27, 2021, 06:28:32 PM
- SD overclocking works only with SD Card

Sure, no doubt. I was just wondering if it is possible to port to 5D3 higher SD overclock freqs (192 MHz and 240 MHz). This would help.

Also, is there any way to benchmark the CF card alone?

Thank you!

Sergio
Title: Re: Danne's crop_rec_4k, 5DIII
Post by: Peperoros on June 28, 2021, 09:26:24 PM
When recording, in anamorphic(1x3), are you meant to only see the upper half of the cropped image?

I have Global Draw on in Liveview only, so hitting the halfshutter for preview also shows the upper half of the cropped image.
I believe that with one of the crop modes I was able to move the focus rectangle down so when I was preview/recording the image lined up to the actual footage.

If this isn't meant to be, I can provide material to show what I mean and troubleshoot.

Other than that, I've had no issues with this build. Incredibly impressed!
Title: Re: Danne's crop_rec_4k, 5DIII
Post by: stef7 on July 08, 2021, 08:17:42 PM
Problem with crop modes and card spanning:

5D Mark III in 3.5K crop mode. It worked OK for several days. But opened footage from last day and it's all garbage.
Tried different cards, result is always the same. As far as card spanning is ON and crop mode is 3K or 3.5K it's all garbage.
When shooting nothing suggested that there is a problem. Most of the time indicator is green which is kind of surprising. In 3.5K it is yellow most of the time or red with limited filming time.
Maybe messed up with a setting ? Green indicator is kind of hint in this direction.
ML version is the last one from Danne (April 2021)

Check the frames bellow. Any ideas why ?

https://ibb.co/R3Lzx1f (https://ibb.co/R3Lzx1f)
https://ibb.co/MNJHZJ6 (https://ibb.co/MNJHZJ6)
Title: Re: Danne's crop_rec_4k, 5DIII
Post by: Danne on July 08, 2021, 10:02:39 PM
A lot more info should be provided and more tests. Tried reinstalling? What's your exact settings? What fps was used?
Title: Re: Danne's crop_rec_4k, 5DIII
Post by: stef7 on July 09, 2021, 06:18:26 AM
Here are my settings:

https://ibb.co/Y0XRdDc (https://ibb.co/Y0XRdDc)
https://ibb.co/zSTnBb8 (https://ibb.co/zSTnBb8)
https://ibb.co/TwpfRhH (https://ibb.co/TwpfRhH)
https://ibb.co/xXSr6jp (https://ibb.co/xXSr6jp)

24fps in camera and same in MLV when open the files.
Also 3K is the same. As far as card spanning is enabled all crop modes are affected
Tried : Kill global draw - on and off, no effect.

Firmware version 1.2.3, latest from you at 1st of April 2021. Unfortunately didn't kept previous versions to test
Previous day formatted a second SD card, copied the firmware and discovered that had to do the installation on that card too.
Otherwise ML won't load from the card. Apparently it has to set the some flag on the card not just in camera ?
Wanted to have a second set of cards (SD+CF) as one was not enough to go trough the day and shooting
And it worked OK for a day. Then it went totally crazy. It seems this second installation somehow messed things up

Followed your advice: Uninstalled ML, format both SD and CF cards in camera. Reinstalled ML on SD card.
Same (bad) result when trying to write on both cards at 3.5K crop.

https://ibb.co/chKbzm2 (https://ibb.co/chKbzm2)
https://ibb.co/Fnmg2Gh (https://ibb.co/Fnmg2Gh)
Title: Re: Danne's crop_rec_4k, 5DIII
Post by: stef7 on July 09, 2021, 06:32:53 AM
Tried on the second set of SD + CF cards - same (bad) result.
Writing speeds are good. But green indicator on 3.5K, 2:1 ratio, 10 bit at 3584x1730 resolution ?
Hmm this is kind of fishy. Never had this before.

https://ibb.co/61GJrK7 (https://ibb.co/61GJrK7)

Before writing speed indicator was yellow at best and red most of the time. Which is expected in such a high resolutions
But for relatively short clips it worked well and without major problem.
Title: Re: Danne's crop_rec_4k, 5DIII
Post by: Danne on July 09, 2021, 06:40:47 AM
Why 2:1 ratio? Don't touch the ratios from raw video menu. Instead use the presets from crop rec sub menu. Under raw menu out ratios to max if set to off in crop rec menu.

Please test to see if other ratios works for instance 2:39.1 etc.
Always seek what's working and then try to find a breaking point from there.
Title: Re: Danne's crop_rec_4k, 5DIII
Post by: stef7 on July 09, 2021, 07:57:06 AM
Always used 2:1 ratio. And until recently it worked without any problem
Here is a test with 2.35:1 ratio set in presets:

https://ibb.co/SB4jt9B
https://ibb.co/XzWNQDc

Still bad. Thought that breaking point is card spanning. But it's not.  Tested 3K crop, anamorphic 2.35:1 ratios.  All bad even when using only the CF card
Only 1080p normal mode works OK.
It's really strange. Will try to reset everything later and start again from scratch. 

P.S. Will wait some time to clear my head, then reset everything and start from scratch.
Title: Re: Danne's crop_rec_4k, 5DIII
Post by: Danne on July 09, 2021, 02:40:59 PM
Might be your card reader. Transferring issues.
Title: Re: Danne's crop_rec_4k, 5DIII
Post by: wib on July 09, 2021, 03:06:27 PM
Be sure to use a fast reader, at least USB 3.0 and "UDMA7 cards" compatible.
Title: Re: Danne's crop_rec_4k, 5DIII
Post by: stef7 on July 09, 2021, 04:10:24 PM
You are absolutely right ! Nothing wrong with recording. It played OK in camera, no damaged frames. Card reader is OK actually, when plugged to a fast USB 3.0 port it works OK
Problem was when card reader was on a slow USB2 port. Never had a problem with this USB 2 port. It was slow but worked.

Anyway, thanks for the help and apologies for bugging you with something that is way off ML
But sometimes it's just a bad day and my brain doesn't work as it should :)

By the way with kill global draw 3584x1730 (2:1 my favorite ratio) at 10 bit recording times are excellent. Way more that expected !
Again thanks a lot for your work and help.

Title: Re: Danne's crop_rec_4k, 5DIII
Post by: wib on July 09, 2021, 04:43:23 PM
I do the same, 2:20 ratio, 14bits lossless in raw menu and 10 bits in movie menu (I guess it override ?) 3.5K in 3584x1630 with kill global draw option, card spanning and sd overclocked, it's marvelous.
Title: Re: Danne's crop_rec_4k, 5DIII
Post by: kpn on July 18, 2021, 02:13:31 PM
Amazing work Danne, the anamorphic 5.5k preset is great!
Just a one small request, is it possible to format the card yet keep the Magic Lantern as in the nightly builds?
Title: Re: Danne's crop_rec_4k, 5DIII
Post by: wib on July 18, 2021, 03:55:38 PM
that would help also the bug on mac catalina with the folder's « bit »
Title: Re: Danne's crop_rec_4k, 5DIII
Post by: Danne on July 18, 2021, 04:21:35 PM
Conflict when sd_uhs patch is used when formatting. Sorry, won't change back.
If someone adds a safeguard turning off sd_uhs patch selecting format it could be an option added.
Title: Re: Danne's crop_rec_4k, 5DIII
Post by: Peperoros on July 19, 2021, 04:20:00 PM
I ran into the problem with flickering when using this build, anamorphic 1:3 binning, 14bit, dual iso, v1.2.3. If I have understood this correctly, it's the dual iso that's the culprit.
ONLY happened when I recorded clouds. Several recordings between are all normal.

https://streamable.com/8vp8z4

I'm unsure if this is the correct thread to report this. Saw that there was flickering reported for the eos-m version of this build, so I'm hoping I'm not mistaken.
Title: Re: Danne's crop_rec_4k, 5DIII
Post by: Digidagi on September 09, 2021, 01:06:54 PM
Hey everyone,
I've been following and experimenting with magic lantern for a while. Gotta say it's amazing and thank you for the hard work.

I'm on build crop_rec_4k_mlv_snd_isogain_1x3_presets_2021Apr01.5D3113
As of today which crop modes support real-time correct framing? So far I could make 1920 1:1 work. Any chance for any of the ones with raised resolution?

Thank you for your answers.
Title: Re: Danne's crop_rec_4k, 5DIII
Post by: GullRaDriel on September 09, 2021, 09:36:08 PM
Hi Danne,
I'm willing to contribute but I'm unable to make a build from source.
Can you give me some pointers on how to build https://bitbucket.org/Dannephoto/magic-lantern_dannephoto_git/src on Linux Debian or Windows 10 (msys2 or cygwin) ?
Or do you have a pinned forum post explaining exactly this ?
Title: Re: Danne's crop_rec_4k, 5DIII
Post by: Danne on September 09, 2021, 10:32:48 PM
What changes did you add?
Sorry, but unable to help but there are several guides on this forum about compiling.
Title: Re: Danne's crop_rec_4k, 5DIII
Post by: names_are_hard on September 10, 2021, 12:13:14 AM
GullRaDriel - walking you through building a repo is probably better suited for Discord.  You're likely to have a few problems along the way and it's slow fixing them one at a time on a forum.  I can walk you through build problems.  I don't know if cygwin works.  Debian definitely does, I use that.  Pretty sure WSL is known to work also.
Title: Re: Danne's crop_rec_4k, 5DIII
Post by: trapshitkalci on September 13, 2021, 04:28:28 PM
Having problem with the display preview in anamorphic mode. Latest built : 2021 Apr. 1 ,  LCD display preciew. Stays distorted whatever I try. I am on firmware 1.2.3. Can that be the problem ?  Was anamorphic mode tested on 1.2.3 ?
In RAW video submodule  Preview is set to Framing but the green icon in front is simply faded. Is that a bug in 1.2.3 which doesn't appears on 1.1.3 ?

Nnow tried it with firmware 1.1.3 and problem is solved ! I didnt pressed the INFO button enough times for getting the Magic Lantern view on my LCD display. To find this out it really needed e the 1.1.3. version cause the info bar on the bottom of the Framing Preview didnt said it  with the 1.2.3 It said couldn't able framing preview due to GlobalDraw.
Title: Re: Danne's crop_rec_4k, 5DIII
Post by: GullRaDriel on September 15, 2021, 10:59:45 PM
Danne: I did not make any change but following the guides led me to some errors. May be my fault/ bad arm version / etc

Okay, as stated I'm going to seek help on discord. See you in a few days !
Title: Re: Danne's crop_rec_4k, 5DIII
Post by: ShittyWebsite on November 05, 2021, 07:34:14 PM
Does silent pics works? i've tryied full res lv but it says it needs crop rec to be loaded (it dosent show any modules)

Maybe i did something wrong? (1.1.3)
Title: Re: Danne's crop_rec_4k, 5DIII
Post by: Walter Schulz on November 05, 2021, 07:36:34 PM
Which file option is selected? DNG or MLV?
Title: Re: Danne's crop_rec_4k, 5DIII
Post by: Danne on November 05, 2021, 07:51:13 PM
Quote from: ShittyWebsite on November 05, 2021, 07:34:14 PM
Does silent pics works? i've tryied full res lv but it says it needs crop rec to be loaded (it dosent show any modules)

Maybe i did something wrong? (1.1.3)
Crop rec is on always. I enabled most modules default and not as an option to the user to turn on or off in this build.
Title: Re: Danne's crop_rec_4k, 5DIII
Post by: ShittyWebsite on November 05, 2021, 08:56:37 PM
I'm using full-res LV, MLV

It says:

Full-res LV requires the crop_rec module loaded

Title: Re: Danne's crop_rec_4k, 5DIII
Post by: Danne on November 05, 2021, 09:43:36 PM
Did you try it to see if it works?
Title: Re: Danne's crop_rec_4k, 5DIII
Post by: ShittyWebsite on November 05, 2021, 09:46:39 PM
I also tryied using the experimental build

No files on the folder  :-[

Maybe a problem with the camera settings?
Title: Re: Danne's crop_rec_4k, 5DIII
Post by: ShittyWebsite on November 05, 2021, 09:52:18 PM
Quote from: ShittyWebsite on November 05, 2021, 09:46:39 PM
I also tryied using the experimental build

No files on the folder  :-[

Maybe a problem with the camera settings?

I just fully reset the camera and now everything works


Dammmn I'm stupid
Title: Re: Danne's crop_rec_4k, 5DIII
Post by: ShittyWebsite on November 05, 2021, 10:33:07 PM
ok.. the experimental build works for full res lv


danne's build works, but not full res (2080x1318)

https://imgur.com/a/HfFSA0G


edit:
maybe i should try to update to 1.2.3?



Title: Re: Danne's crop_rec_4k, 5DIII
Post by: Thoracius on November 06, 2021, 12:19:31 AM
I'm curious.. is 3x3 binning of the whole sensor possible (e.g. 1920x1280) or would that be too heavy to achieve reasonable frame rates?

Title: Re: Danne's crop_rec_4k, 5DIII
Post by: allemyr on November 10, 2021, 11:37:47 AM
Hi!

I'am using 2020May29.5D3123 crop rec 4k mlv snd isogain build, I'am trying out shooting in 3840x1440px and would like to turn on SD overclock, is that possible with this build and where can I please find it? I have card spanning on and get pretty decent record times right now in 3840x1440px at 14-bit lossless but SD overclock could be sweet.

Thx in advance!

/ Karl
Title: Re: Danne's crop_rec_4k, 5DIII
Post by: theBilalFakhouri on November 10, 2021, 11:49:43 AM
Latest Danne build (https://bitbucket.org/Dannephoto/magic-lantern_dannephoto_git/downloads/) from the first post have what you need, why not to use it?

Not sure if 2020May29.5D3123 build has SD overclocking module.
Title: Re: Danne's crop_rec_4k, 5DIII
Post by: ShittyWebsite on November 23, 2021, 02:47:09 PM
Hello, great build, quite solid

Just a small question, i'm using:
Preset:
Full-res live view

RAW video
Preview Framing
Rec Trigger: Half-Shutter: pre only

When i start recording, press the half shutter, it captures everything fine, when i stop recording i get stuck on busy (so i can't change shutter speed, going out of livewview and back works)

SRM memory On/off didnt not help, neither Small Hacks



Also, it crashs when using rec trigger as half-shutter: hold (i'm guessing its my slow card)
Title: Re: Danne's crop_rec_4k, 5DIII
Post by: ShittyWebsite on January 03, 2022, 03:54:03 AM
Just wondering, would be possible record 5760 x 1080 then stretching vertical to 3240 ?
Same as 1920x2300 but the other way around

I don't know the right name, 1x3 or 3x1
Thanks
Title: Re: Danne's crop_rec_4k, 5DIII
Post by: bouncyball on January 03, 2022, 09:47:15 AM
Quality wise vertical resolution is more important than horizontal. So I think this makes no sense.
Title: Re: Danne's crop_rec_4k, 5DIII
Post by: Danne on January 03, 2022, 02:58:37 PM
Turn the cam 90°  8)
Title: Re: Danne's crop_rec_4k, 5DIII
Post by: motionSOUL on January 23, 2022, 10:04:51 AM
Question : would it be possible to have an anamorphic mode in x2 to add to the x3 arsenal, with less vertical resolution to keep a realistic recording rate ?
x3 is a bit extreme when filming portrait for example with all the hairs aliasing.
Or it is a totally dumb question, which can be.

Thanks,

S/.
Title: Re: Danne's crop_rec_4k, 5DIII
Post by: masc on January 23, 2022, 10:32:37 AM
Quote from: motionSOUL on January 23, 2022, 10:04:51 AM
Question : would it be possible to have an anamorphic mode in x2 to add to the x3 arsenal, with less vertical resolution to keep a realistic recording rate ?
Read about 1x3 recording mode and you should find your answer: https://wiki.magiclantern.fm/glossary#anamorphic https://wiki.magiclantern.fm/pixel_binning
Title: Re: Danne's crop_rec_4k, 5DIII
Post by: motionSOUL on January 23, 2022, 12:19:05 PM
Ah yes, so dumb question. I didn't thought about the RGB sensor readout.
Title: Re: Danne's crop_rec_4k, 5DIII
Post by: motionSOUL on January 24, 2022, 10:42:04 AM
I try to record 1920x1050 48fps, which keep giving me errors when recording on CF cards. So I've tried to record it directly on SD card.
I've tested SD patch with my SanDisk Extreme PRO 95 MB/s with no result as ML always says my Card is Full, but it isn't.
So I've tested to record without the patch and only succeeded for 70 frames each time.
Is it possible to record longer takes ?
If I buy a 170 MB/s will I have more chances ?
And does a Lexar HC II 300 MB/s makes a difference ?

Thanks for the help...

S/.
Title: Re: Danne's crop_rec_4k, 5DIII
Post by: masc on January 24, 2022, 11:02:02 AM
Try 2 cards in parallel, SD+CF using card spanning. One single card will be too slow.
Title: Re: Danne's crop_rec_4k, 5DIII
Post by: Danne on January 24, 2022, 11:06:21 AM
Card spanning not recommended with higher frame rates on 5DIII. Not working well unfortunately.
Title: Re: Danne's crop_rec_4k, 5DIII
Post by: Bruno Italiano on January 24, 2022, 12:31:41 PM
SanDisk Extreme PRO 95 MB/s is one of the fastest SD cards. I would record in high frame rates with a very fast CF card only.
Title: Re: Danne's crop_rec_4k, 5DIII
Post by: Kharak on January 25, 2022, 05:59:19 PM
Quote from: motionSOUL on January 24, 2022, 10:42:04 AM
I try to record 1920x1050 48fps, which keep giving me errors when recording on CF cards. So I've tried to record it directly on SD card.
I've tested SD patch with my SanDisk Extreme PRO 95 MB/s with no result as ML always says my Card is Full, but it isn't.
So I've tested to record without the patch and only succeeded for 70 frames each time.
Is it possible to record longer takes ?
If I buy a 170 MB/s will I have more chances ?
And does a Lexar HC II 300 MB/s makes a difference ?

Thanks for the help...

S/.

No, a higher speed SD card will not help because the SD interface is limited to about 20 MB/s. You getting 70 frames is your buffer filling up and then writing those 70 frames to your sd card, because the sd card has no chance to keep up. If you shoot 24 fps fullHD, you'd typically get around 124-140 frames before recording stops.

Try reducing the resolution slightly.

And only record to CF card.

You should get almost continues, depending on luminance and detail in the scene, mind you the lossless compression will compress less in complex scenes e.g. wide shots with hyperfocal focus and vice versa a 85 mm with only a face in focus and the rest a blur.

Happy shooting!
Title: Re: Danne's crop_rec_4k, 5DIII
Post by: motionSOUL on January 26, 2022, 08:33:37 AM
Thanks for the answers...
Title: Re: Danne's crop_rec_4k, 5DIII
Post by: motionSOUL on January 27, 2022, 03:11:01 PM
5DMKIII, 1.1.3, last ML build, CF+SD write benchmark (1 min) :

SD: 19.1 MB/s - CF: 85.5 MB/s
SD 160MHz overclock: 49.8 MB/s - CF: 60.1 MB/s

Does it make any sense? The overclock mode on SD card slow down the CF writing speed here... Anyone else?

S/.
Title: Re: Danne's crop_rec_4k, 5DIII
Post by: happyta5 on February 01, 2022, 04:24:33 PM
I'm shooting at 5.7K 16:9 and like to have a external monitor. Anyone has experience on it? Just don't want to buy a field monitor(7"} that does not work. Any suggestion is welcome!

Title: Re: Danne's crop_rec_4k, 5DIII
Post by: ShittyWebsite on February 01, 2022, 11:49:02 PM
5DMKIII CF+SD benchmark (1 min):

SD 160mhz overclock:
SD: 65.7mb/s
CF: 72.8mb/s

No overlock:
SD: 21.8mb/s
CF: 80.7mb/s



My only problem is:
When i'm shooting "full-res liveview" with rec trigger Half-shutter: hold
The camera freezes, only removing the battery works
Title: Re: Danne's crop_rec_4k, 5DIII
Post by: kidfob on February 16, 2022, 05:58:43 PM
Hello all. Thanks for all your help and support regarding Magic Lantern. I would like to start using 5.7k Anamorphic on professional shoots (short films). The difficulty is that unlike a traditional video camera, our ability to monitor the scene we're shooting is difficult. This makes framing difficult and racking focus as the subject approaches the camera or moves away from the camera.

Any workarounds for this?
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: dream951 on February 16, 2022, 09:56:35 PM
Quote from: Danne on September 02, 2020, 04:29:00 PM
You can try "Switch". Uses a1ex updated cr2hdr code.
Hey Danne. Where I can get a1ex updated cr2hdr code?
I don't quite understand where to look for this, sorry if this is a stupid question ::)
Title: Re: Danne's crop_rec_4k, 5DIII
Post by: Danne on February 16, 2022, 10:17:05 PM
What are you using it for? Mac or windows? These days code is not that easy to find sonce mercurial was buried.

I added two new 5d3 builds. Increased 1080p 38 fps to 40 fps. Seems stable enough.
Title: Re: Danne's crop_rec_4k & ISO experiments
Post by: dream951 on February 16, 2022, 10:35:47 PM
Quote from: sm105 on September 02, 2020, 01:01:28 AM
I've been successfully using Danne's builds since earlier this summer (awesome work!), and I just started testing out dual iso raw video. I feel like I'm doing something wrong because I'm getting weird colors, lines, and regions of cyan. For the frame below, I used the 3K preset with the following settings:

Aug. 14 build (1.2.3)
2560x1440
16x9 AR
10-bit
Histogram and zebras enabled
Dual-iso enabled at 100/800
Slightly underexposed from ETTR
Dual-iso ON in MLV App

I also tried an earlier build and had the same issue. Any idea what I'm missing?

(https://i.ibb.co/FgW6YKD/screenshot.jpg)

Just set Vertical stripes in mlvapp to off. It works for me
Title: Re: Danne's crop_rec_4k, 5DIII
Post by: ShittyWebsite on March 12, 2022, 10:42:46 PM
Is it possible to playback full res photo?
i'm getting "allocation failed" weirdly (when shooting full res at 16:9 it worked and 2 days ago it does not work anymore)
Maybe i messed up something?

My settings:

Preset:
Full-res LiveView with focus aid

RAW video:
Resolution: 5784x3254
Aspect: 16:9
Data: 14bit lossless
Preview: Framing
Crop rec preview: off
Card spanning: Off
Preferred card: CF
Kill global draw: off
Pre record: 1 Frame
Rec trigger: Half-shutter: pre only
SRM: on
Small hacks: off
Title: Re: Danne's crop_rec_4k, 5DIII
Post by: 70MM13 on March 13, 2022, 12:57:21 PM
Try booting with no unnecessary modules loaded/enabled...
Title: Re: Danne's crop_rec_4k, 5DIII
Post by: ShittyWebsite on March 13, 2022, 07:45:43 PM
I found a fix:

The camera shooting mode must be at:
Raw only (either jpg or raw+jpg did not work, allocation error when pressing play while in liveview)

2:
The aspect ratio has to be at 16:9 or lower (5:3 will cause allocation error and freeze the liveview)


Playback works perfectly

Title: Re: Danne's crop_rec_4k, 5DIII
Post by: IDA_ML on March 15, 2022, 04:59:34 PM
Here is an interesting post:

https://www.magiclantern.fm/forum/index.php?topic=26414.msg238174#msg238174

Has anyone compiled this for the 5D3?
Title: Re: Danne's crop_rec_4k, 5DIII
Post by: vastunghia on March 18, 2022, 10:22:37 AM
All,

a question regarding SD overclock.

With Danne's fantastic build I am able to shoot continuously in 3.3K 1:1 x5 mode (currently my favorite): I obtain 110 MB/s on average, with
When I step up at 3.5K 1:1 centered x5 mode, however, the only way to obtain continuous shooting (apart from lowering bit depth, which is not an option imo) is to disable Global Draw - which is a pain in the neck of course, as framing preview is completely lost. However, done that, I do obtain continuous recording and of course higher write speeds than with 3.3K 1:1 x5.

So 1st question is: am I correct in deducing that higher overclock rates (say 192 or 240 MHz, as available on 70D for instance), if implemented, would be of no help in obtaining continuous rec. in 3.5K 1:1 centered x5 mode with Global Draw enabled? I.e. there must be another bottleneck somewhere preventing this, regardless of max write speed achievable by SD card?

2nd question: what is preventing from implementing higher overclock rates in the 5DM3?

Thanks a lot

Sergio
Title: Re: Danne's crop_rec_4k, 5DIII
Post by: wib on March 18, 2022, 11:57:27 AM
From my experience, it's easy to get continuous recording.

card spanning, 14 bit lossless selected and also 10 bits enabled on top, in 3.5K 1:1 at the maximum resolution (for me 2:20 ratio and 3584x1630)

I set up 2 display mode : one with no global drawing, and with the push of a button, one with normal framing, the record never stops, only the status dot changes from green to orange doing so, but you have to go back to no global drawing.
Title: Re: Danne's crop_rec_4k, 5DIII
Post by: vastunghia on March 18, 2022, 01:03:46 PM
Thank you wib,

I would prefer to stick to full 14-bit depth, but I'm curious to hear from your experience: do you find that 10 bits are enough even for complex scenes with a heavily stretched dynamic range?

Anyway, I'm very interested in the possibility of temporarily switching Global Draw on during recording. I did't think this was possible. Could you please explain exactly how to configure this? EDIT: I guess it was the old INFO button. Got it now ;)

Thanks a lot

Sergio
Title: Re: Danne's crop_rec_4k, 5DIII
Post by: MCChristor on March 24, 2022, 04:09:01 AM
@Danne

Possible to get 12bit 4096x1440 25FPS working? When activating 12bit it does crash with some errors and works normal with 14bit (but stops after few seconds). Should be almost continuous with 12bit.
Title: Re: Danne's crop_rec_4k, 5DIII
Post by: JayJayProductions on April 12, 2022, 02:40:22 AM
How can I install the module to my 1.2.3 nightly build on my 5d mark III? sorry for the noob question
Title: Re: Danne's crop_rec_4k, 5DIII
Post by: Walter Schulz on April 12, 2022, 07:26:58 AM
Quote from: JayJayProductions on April 12, 2022, 02:40:22 AM
How can I install the module to my 1.2.3 nightly build on my 5d mark III? sorry for the noob question

You will most likely fail to install/use a single module from a custom build if you are running nightly. You should install the build completely. See https://wiki.magiclantern.fm/faq -> Installation
Title: Re: Danne's crop_rec_4k, 5DIII
Post by: anto on April 19, 2022, 12:20:22 PM
Hi guys. What is the max res that gives real-time preview on the MKIII?
Title: Re: Danne's crop_rec_4k, 5DIII
Post by: Bruno Italiano on April 19, 2022, 01:10:53 PM
I can see more information in the colour.
× Bitdepth OFF
× ratio OFF
×14bit lossless
×No sound
×Frozen LV
×kill canon GUI
×don't kill global draw
×Card Spanning
×One more hack
×Ivface +aewb
With these settings even Magic Zoom works and Follow Focus Arrows with the autofocus of the lens.
Title: Re: Danne's crop_rec_4k, 5DIII
Post by: wib on April 19, 2022, 03:04:57 PM
Quote from: anto on April 19, 2022, 12:20:22 PM
Hi guys. What is the max res that gives real-time preview on the MKIII?

all is real time.

1080P with correct framing and 2K, 4K, 5K.. are also real time but with cropped framing.
Title: Re: Danne's crop_rec_4k, 5DIII
Post by: koopg on April 22, 2022, 11:01:07 PM
Quote from: Bruno Italiano on April 19, 2022, 01:10:53 PM
I can see more information in the colour.
× Bitdepth OFF
× ratio OFF
×14bit lossless
×No sound
×Frozen LV
×kill canon GUI
×don't kill global draw
×Card Spanning
×One more hack
×Ivface +aewb
With these settings even Magic Zoom works and Follow Focus Arrows with the autofocus of the lens.
Please can you explain what is
Magic zoom
And what is do. You mean autofocus ? Can you autofocus with 5d3 during video rec?


Sent from my SM-P905 using Tapatalk

Title: Re: Danne's crop_rec_4k, 5DIII
Post by: Walter Schulz on April 22, 2022, 11:43:41 PM
Quote from: koopg on April 22, 2022, 11:01:07 PM
Please can you explain what is
Magic zoom
https://wiki.magiclantern.fm/camera_help#magic_zoom
Title: Re: Danne's crop_rec_4k, 5DIII
Post by: anto on April 23, 2022, 12:20:50 PM
Quote from: wib on April 19, 2022, 03:04:57 PM
all is real time.

1080P with correct framing and 2K, 4K, 5K.. are also real time but with cropped framing.
yeh, I mean real time correct framing.
how much cropped others?

same way via hdmi?
Title: Re: Danne's crop_rec_4k, 5DIII
Post by: koopg on April 23, 2022, 08:54:26 PM
Quote from: Walter Schulz on April 22, 2022, 11:43:41 PM
https://wiki.magiclantern.fm/camera_help#magic_zoom
thank you.

Sent from my SM-N975F using Tapatalk

Title: Re: Danne's crop_rec_4k, 5DIII
Post by: Wushuliu on April 24, 2022, 10:26:57 PM
Quote from: anto on April 23, 2022, 12:20:50 PM
yeh, I mean real time correct framing.
how much cropped others?

same way via hdmi?

I would like to know the preview framing/crop specifics as well. Contemplating getting a 5D3...
Title: Re: Danne's crop_rec_4k, 5DIII
Post by: gravitatemediagroup on April 26, 2022, 03:17:23 PM
the newer 113 build under construction or has the DL location changed? Sorry if I missed any news/info regarding this
Title: Re: Danne's crop_rec_4k, 5DIII
Post by: theBilalFakhouri on April 26, 2022, 03:22:51 PM
The ones with the new LiveView hacks?

Here you go:

Quote from: theBilalFakhouri on April 07, 2022, 06:20:22 AM
-5D3.113
crop_rec_4k_mlv_snd_isogain_1x3_presets_2022Apr07.5D3113.zip (https://bitbucket.org/bilal_fakhouri/magic-lantern/downloads/crop_rec_4k_mlv_snd_isogain_1x3_presets_2022Apr07.5D3113.zip)

-5D3.123
crop_rec_4k_mlv_snd_isogain_1x3_presets_2022Apr07.5D3123.zip (https://bitbucket.org/bilal_fakhouri/magic-lantern/downloads/crop_rec_4k_mlv_snd_isogain_1x3_presets_2022Apr07.5D3123.zip)

More info about them:
LiveView hacks (write speed improvement) (https://www.magiclantern.fm/forum/index.php?topic=26443.msg238349#msg238349)
Title: Re: Danne's crop_rec_4k, 5DIII
Post by: winmediacenter on May 11, 2022, 06:35:35 PM
Great job works like a charm

Continous UHD 3840x1536 12bit by holding from time to time halfshutter with clear overlays option enabled
Title: Timelapse custom framerates?
Post by: data1706 on May 30, 2022, 10:39:23 AM
Hello,
i'm using Danne's build to capture timelapses and it works very well. Often i'm using the preset "Full-res Live View" which works with 7,4 fps. For many timelapses this framerate is to fast and i need maybe 1-3 fps. Unfortunately the fps override function isn't working. Is it possible to create custom profiles with custom framerates?

thanks
data1706
Title: Re: Danne's crop_rec_4k, 5DIII
Post by: mkh50 on June 25, 2022, 11:54:05 AM
Hi!
I'm a documentary filmmaker and I'm curious is it possible to shoot continuous scenes with latest builds with a resolution near 4K and near 16:9 ratio. 
I would need to be able to shoot as long as 1 hour continuous, and it doesn't matter if it is saved in raw or some other format.
I still don't own 5DIII so I can't test it, that's why I'm asking for help here :)
I do own 6D, but as I figured out 5DIII is much better option.
So if somebody can tell, is this possible and if yes, what resolution is possible to get in what bit depth and in what format?

P.S. two details, I do need live view on camera as I do not use external monitor, and I do need ML peaking.

Thanks!  ;D
Title: Re: Danne's crop_rec_4k, 5DIII
Post by: ShittyWebsite on July 02, 2022, 07:02:46 PM
You can use Fps Override with the low light setting (rather than high fps)
I can get continuous at 5fps and card spanning

I also made a lua script with some settings that i mostly use (1080p, full-res with half shutter, 3.5k, and  burst 5fps by holding half shutter)
I can share that script if you want to
Title: Re: Danne's crop_rec_4k, 5DIII
Post by: Danne on July 02, 2022, 07:13:22 PM
Pretty sure I include lua timelapse scripts in the bottom of the Movie menu section.
Title: Re: Danne's crop_rec_4k, 5DIII
Post by: Bender@arsch on July 12, 2022, 06:33:07 AM
Is there a way to turn off bitdepth reset while camera starting?
I personally use crop rec only, but if I start the Camera in Photo mode, the bitdepth setting will reset almost every time, while sd overclocking process. I know you have Implemented this for 3x3.
Title: Re: Danne's crop_rec_4k, 5DIII
Post by: Sagedavid on July 20, 2022, 01:27:30 PM
Hello,
I'm a true beginner, just an amateur photographer wanting to go in video, not too bad in lighting management, but really not good at computers...


Does anybody can post me a link to get a "smooth and high resolution video setting"?
When I'm starting with default presets (not RAW format), everything is ok. As soon as I'm activating "RAW video (MLV) ; 1920x818 ; aspect ration 2.35:1", all I get is a jerky video (on MLV Player on my computer)...
NB : I'm recording at 88MB/s on a lexar professional 1000x 32 GB CF UDMA7

Regards 
Title: Re: Danne's crop_rec_4k, 5DIII
Post by: Lackus on July 28, 2022, 09:54:57 AM
Hello everyone!

I am new to the forum, so first just wanted to thank everyone who is still involved into the development of this awesome project. :)

My question mainly concerncs the live preview stuff. I have found a few discussions which are dated like 1-2 years old (probably outdated) and there is not too much visual demonstration which could show how it works.

So basically, at which presets can 5dmk3 have correct framing in live preview without black&white and skipped frames without the ~13 MB/s boost hacks applied, which presets, on the other hand, can give normal live preview with these hacks enabled? Furthermore, which of the presets also work flawlessly with an external monitor and which do not?
I have seen some great demonstrations with 650d/700d build, but couldn't really find anything on 5dmk3, sorry if it was already discussed recently! :(

Thank you very much.
Title: Re: Danne's crop_rec_4k, 5DIII
Post by: vastunghia on July 31, 2022, 10:58:55 PM
Lackus,

start from here:

https://www.magiclantern.fm/forum/index.php?topic=14652.msg211800#msg211800

Sergio
Title: Re: Danne's crop_rec_4k, 5DIII
Post by: Dmytro_ua on August 05, 2022, 04:13:46 PM
Hi
Does Proxy work with any of the RAW presets? Even with a regular 1920p RAW it only records 5-8 seconds and then an Emergency stop appears.
SD card is selected as a preferred card. RAW goes strait to CF. The sound in RAW is corrupted when proxy is enabled.

I'm using Sandisk Ultra Micro SD HC I with an adaptor. Maybe this is a reason?
The latest build 2022May15.5D3113.zip
Title: Re: Danne's crop_rec_4k, 5DIII
Post by: Walter Schulz on August 05, 2022, 04:17:02 PM
Do card + adapter work with full speed using a cardreader? Yes -> No, no reason.
Some Ultra cards have a very low write speed. Around 20 MByte/s. Standard H.264 recording requires around 5.5 MByte/s.
Title: Re: Danne's crop_rec_4k, 5DIII
Post by: Dmytro_ua on August 05, 2022, 04:33:30 PM
Writing Speed test on a computer shows around 10 MB/s.
My main concern is about Proxy module. Does it work or nobody is using it?
Title: Re: Danne's crop_rec_4k, 5DIII
Post by: Walter Schulz on August 05, 2022, 04:37:19 PM
Get a faster card.
Title: Re: Danne's crop_rec_4k, 5DIII
Post by: Dmytro_ua on August 05, 2022, 04:44:17 PM
Thanks for an advice!
Although a regular Canon's video without RAW enabled, records continuously on this card.
Title: Re: Danne's crop_rec_4k, 5DIII
Post by: theBilalFakhouri on August 05, 2022, 04:48:17 PM
Quote from: Dmytro_ua on August 05, 2022, 04:13:46 PM
Hi
Does Proxy work with any of the RAW presets? Even with a regular 1920p RAW it only records 5-8 seconds and then an Emergency stop appears.
SD card is selected as a preferred card. RAW goes strait to CF. The sound in RAW is corrupted when proxy is enabled.

Disable sound recording from RAW video submenu, it seems to cause problems with H.264 proxy.
I can record here 1920x1080 @ 30 FPS 14-bit lossless + H.264 proxy, recorded over 3 minutes then stopped manually.

I am using 1.2.3 firmware version, official crop_rec_4k build, SD card set to Standard card from Canon settings, RAW data goes to CF.

Note: 1.1.3 version probably has issue related to default LV RAW buffer, which might being used for both RAW data stream and H.264 video which causes early stop after few seconds.
In 1.2.3 version, a different RAW buffer is being used for RAW stream.

-Tests you can perform:
1- Make sure your SD card can record continuous H.264 video (without ML), if yes --> continue
2- Disable sound recording from RAW video submenu, record RAW video with H.264 proxy, use 1920x1080 @ 23.976 FPS at 14-bit lossless for RAW video, does it still stop early? If yes --> continue
3- Upgrade 5D3 firmware to 1.2.3, redo step 2, then feedback.
Title: Re: Danne's crop_rec_4k, 5DIII
Post by: Dmytro_ua on August 05, 2022, 05:00:36 PM
theBilalFakhouri, thanks for the hint!!

Yes, it works without RAW sound.

Glad no need to buy another card  ;)
Title: Re: Danne's crop_rec_4k, 5DIII
Post by: Leszek Wysocki on September 06, 2022, 08:17:04 PM
For some reason the audio doesn't record at all or only part of the clip. Does anyone know what the problem may be?

Przykład na YT https://www.youtube.com/watch?v=2xPOvC67lPc
Title: Re: Danne's crop_rec_4k, 5DIII
Post by: GullRaDriel on September 11, 2022, 09:01:09 AM
Never had that problem before.
You may try to lower the video settings and or the audio output quality, try, and if it does not work use the way described by theBilalFakhouri a few posts ago
Title: Re: Danne's crop_rec_4k, 5DIII
Post by: 12georgiadis on October 01, 2022, 08:18:38 PM
Hi !
I checked all the hot topics and updates and the progress on ML is crazy !
One info was missing or not clear :
Can we get real time live view during raw rec in 1x3 5.7k anamorphic 1.78 AR and using 160mhz SD card overclock ? Or we really need 240mhz for that ? Does someone already made a test ? Can we imagine real-time also for 3.5k mode ?
Thanks
Title: Re: Danne's crop_rec_4k, 5DIII
Post by: Grognard on October 01, 2022, 08:43:07 PM
5d mark iii:  No realtime preview exept with fullhd.
No link between Sd hack (160 mHz or 240 mhz)

Maybe, do you mean continuous recording ? It's continuous without sd hack for 5.7k anamorphic.  And it's continuous in 3.5k with 160Mhz hack (don't need 240MHz).
Title: Re: Danne's crop_rec_4k, 5DIII
Post by: 12georgiadis on October 01, 2022, 08:52:29 PM
Quote from: Grognard on October 01, 2022, 08:43:07 PM
5d mark iii:  No realtime preview exept with fullhd.
No link between Sd hack (160 mHz or 240 mhz)

Maybe, do you mean continuous recording ? It's continuous without sd hack for 5.7k anamorphic.  And it's continuous in 3.5k with 160Mhz hack (don't need 240MHz).
Thank you for the infos ! So we won't get real time preview in the near future for 5dmkiii ? Or it is possible with external monitor or hdmi viewfinder ?
But we have real time preview with eosm and 70D while recording 1x3 anamorphic ? right ?
Title: Re: Danne's crop_rec_4k, 5DIII
Post by: Grognard on October 02, 2022, 11:50:29 AM
Quote from: 12georgiadis on October 01, 2022, 08:52:29 PM
Thank you for the infos ! So we won't get real time preview in the near future for 5dmkiii ? Or it is possible with external monitor or hdmi viewfinder ?

No realtime preview with hdmi device.
Maybe We will get real time preview in the futur but nobody working on it.
Try this tip : put a Phone with a director's viewfinder application beside your camera to achieve an almost perfect realtime preview of what you record ;) better than nothing...

Quote from: 12georgiadis on October 01, 2022, 08:52:29 PM
But we have real time preview with eosm and 70D while recording 1x3 anamorphic ? right ?

Right on the Eos M and 700D (not 70d sorry) But only in 1440x1806 not with the new full anamorphic resolution (1736x 2178).
Title: Re: Danne's crop_rec_4k, 5DIII
Post by: 12georgiadis on October 02, 2022, 07:34:51 PM
Quote from: Grognard on October 02, 2022, 11:50:29 AM
No realtime preview with hdmi device.
Maybe We will get real time preview in the futur but nobody working on it.
Try this tip : put a Phone with a director's viewfinder application beside your camera to achieve an almost perfect realtime preview of what you record ;) better than nothing...

Right on the Eos M and 700D (not 70d sorry) But only in 1440x1806 not with the new full anamorphic resolution (1736x 2178).

Thank you for the tips ! Will try smartphone viewfinder !
Title: Re: Danne's crop_rec_4k, 5DIII
Post by: GullRaDriel on October 03, 2022, 11:30:23 AM
5DIII: To be precise there are some mode with realtime preview. Most anamorphic modes are giving a real time preview, even if distorted.
Title: Re: Danne's crop_rec_4k, 5DIII
Post by: Grognard on October 03, 2022, 05:36:00 PM
Quote from: GullRaDriel on October 03, 2022, 11:30:23 AM
5DIII: To be precise there are some mode with realtime preview. Most anamorphic modes are giving a real time preview, even if distorted.

Yes. Realtime previews.... but distorted (anamorphic) or cropped (3k, 3,5k).
Title: Re: Danne's crop_rec_4k, 5DIII
Post by: Wlad81 on October 05, 2022, 12:06:23 AM
Quote from: wib on March 18, 2022, 11:57:27 AM
From my experience, it's easy to get continuous recording.

card spanning, 14 bit lossless selected and also 10 bits enabled on top, in 3.5K 1:1 at the maximum resolution (for me 2:20 ratio and 3584x1630)
It works.
Title: Re: Danne's crop_rec_4k, 5DIII
Post by: has_abandonment_issu on October 07, 2022, 04:19:12 AM
I don't know if this has already been reported, but I'm getting a massive difference in write speed on the april 07 3.123 build that bilal linked vs the may 15 3.123 build.

This is present in the 1080p 60fps preset. Clean install on both. Global draw off, card spanning off, small hacks and aewb+lvface on both builds.

I get around 60mbs without any hacks on for both builds, but 88mbs on the april build with hacks on and only 66mbs with the may build. Is the write speed indicator reading correctly? I haven't tested aggressively, but I've shot the same scene with both and there is a clear difference in write speed, even if maybe the indicator isn't accurate.

Is this happening for anyone else?

Title: Re: Danne's crop_rec_4k, 5DIII
Post by: rinski on October 08, 2022, 10:47:54 AM
Full anamorphic 18 fps 240 MHz? 5d3
Title: Re: Danne's crop_rec_4k, 5DIII
Post by: dpjpandone on November 19, 2022, 12:16:47 AM
Wrong thread, please delete

Title: Re: Danne's crop_rec_4k, 5DIII
Post by: names_are_hard on November 19, 2022, 02:01:06 AM
I think if you do this that it won't work on older cams:


case 2:
            W = 640;


Very old cams I think don't have that high a resolution, 320x240 maybe?
Title: Re: Danne's crop_rec_4k, 5DIII
Post by: dpjpandone on November 20, 2022, 03:18:37 AM
I just realized i posted this in the 5D3 thread,, I'm sorry guys this build is for eosm, please disregard
Title: Re: Danne's crop_rec_4k, 5DIII
Post by: vastunghia on December 01, 2022, 07:06:04 PM
Quote from: has_abandonment_issu on October 07, 2022, 04:19:12 AM
I don't know if this has already been reported, but I'm getting a massive difference in write speed on the april 07 3.123 build that bilal linked vs the may 15 3.123 build.

I think this is an important point that should deserve some attention. I myself have been reporting huge speeds with the 2022Apr07 build from Bilal (see here (https://www.magiclantern.fm/forum/index.php?topic=26641.msg240190#msg240190)), which seemed to be unexpected.

I've always been on 2022Apr07 1.1.3 and I hoped I could find the time to test the 2022May15 1.1.3 build, but that didn't happen :-[

Now I would like to switch to 1.2.3 for testing of an external HDMI monitor, so I decided that I should give it a try to both 2022May15 and 2022Apr07 builds for 1.2.3.

Unfortunately, it seems that Bilal has pulled his 2022Apr07 build from here (https://www.magiclantern.fm/forum/index.php?topic=26443.0). Anyone knows where I can find it, or is kind enough to send it to me?

And: should the difference in write speed be confirmed by more users, would it be possible to single out the differences between these two builds? A kind request for Danne / Bilal of course  ;)

Thank you

Sergio
Title: Re: Danne's crop_rec_4k, 5DIII
Post by: theBilalFakhouri on December 01, 2022, 08:53:41 PM
Quote from: vastunghia on December 01, 2022, 07:06:04 PM
Unfortunately, it seems that Bilal has pulled his 2022Apr07 build from here (https://www.magiclantern.fm/forum/index.php?topic=26443.0). Anyone knows where I can find it, or is kind enough to send it to me?

The 2022Apr07 builds are still in my Bitbucket download (https://bitbucket.org/bilal_fakhouri/magic-lantern/downloads/) page, look for:

crop_rec_4k_mlv_snd_isogain_1x3_presets_2022Apr07.5D3113.zip
crop_rec_4k_mlv_snd_isogain_1x3_presets_2022Apr07.5D3123.zip


These builds are based on Danne's 5D3 source code (https://bitbucket.org/Dannephoto/magic-lantern_dannephoto_git/src/master/), iirc last commit from Danne was db5dc42 when I created the builds, I have only implemented the new hacks in mlv_lite.c, I didn't change anything else.

More likely Danne implementation for new hacks has small bug which make them don't work in all presets, iirc I made some tests and it was from this line of code:
if (more_hacks && shamem_read(0xc0f383d4) != 0x4f0010) /* excludes mcm mode on eosm */

Removing: && shamem_read(0xc0f383d4) != 0x4f0010 might solve the problem.




Edit before posting the reply:

Ahhh, wait, there is a bug, in this commit (https://bitbucket.org/Dannephoto/magic-lantern_dannephoto_git/commits/61c2a5a38fedc273156882850ebe5ce302cc858b), the function hack_liveview_more() is never being called, which make the new hacks don't work at all in 15 may build.

hack_liveview_more(); should be added in RAW recording initialization code, e.g. after these lines:

        hack_liveview(0);
        liveview_hacked = 1;
Title: Re: Danne's crop_rec_4k, 5DIII
Post by: vastunghia on December 01, 2022, 09:51:10 PM
Thanks Bilal, I knew I could count on you! ;)

No testing required then, a lot of time saved, thanks a lot.

Will stick to the 2022Apr07 build until bug is fixed in Danne's one.

S
Title: Re: Danne's crop_rec_4k, 5DIII
Post by: Danne on December 02, 2022, 06:37:36 AM
You mean adding:
        hack_liveview(0);
        liveview_hacked = 1;
        hack_liveview_more();


Did it now and uploaded new builds. Please test and report if fixing any errors.
Title: Re: Danne's crop_rec_4k, 5DIII
Post by: vastunghia on December 03, 2022, 03:53:46 PM
Thanks Danne,

tested build Dec02 for 1.2.3, seems ok but I could achieve continuous rec. @max 133 MB/s (binary prefixes).

With Apr07 build for 1.1.3 I could reach 147 MB/s (see here (https://www.magiclantern.fm/forum/index.php?topic=26641.msg240190#msg240190)).

I guess I should be testing also Dec02 build for 1.1.3? Just to rule out some weird 1.1.3 vs 1.2.3 difference. Let's see if I find the time...

Sergio
Title: Re: Danne's crop_rec_4k, 5DIII
Post by: Danne on December 03, 2022, 04:23:29 PM
From reply 1040 he is testing 1080p 60 fps against an older build. I think a simple CF-card test would do with and without more hacks on.
Title: Re: Danne's crop_rec_4k, 5DIII
Post by: vastunghia on December 03, 2022, 05:23:13 PM
As requested:
RESULTS: 1st run @90.2 MB/s, 2nd run @91.9 MB/s
RESULTS: 1st run @89.1 MB/s, 2nd run @89.4 MB/s

Not sure if difference is significant ??? What is your verdict?
Title: Re: Danne's crop_rec_4k, 5DIII
Post by: Danne on December 03, 2022, 06:25:09 PM
I guess the original poster about the issue should test since he knows exactly what he did to obtain differences :).
Title: Re: Danne's crop_rec_4k, 5DIII
Post by: vastunghia on December 03, 2022, 08:16:12 PM
Not sure what exactly we are trying to understand here then.

My point remains the following: With Apr07 1.1.3 I was getting 150 MB/s, now with Dec02 1.2.3 I'm getting 130. I hope I will find the time tomorrow to test Dec02 1.1.3. Should I still get 130, I would conclude that the Dec02 build (as well as the May15, I presume) has something wrong different from the Apr07 build, that makes it definitely less attractive.

Will keep you posted.
Title: Re: Danne's crop_rec_4k, 5DIII
Post by: Danne on December 03, 2022, 09:46:35 PM
I don't think 150Mb/s is possible to achieve? I thought bottleneck is around 130Mb/s. Would be a happy surprise if I was wrong.
However. Testing if the hacks are working or not is something else. One way to test is to select a preset that usually works for a few seconds or more then stops. Applying the hacks should get you longer recording times, maybe continuous in those tests.

My best guess now is that this build works as good as any older build and better.
Title: Re: Danne's crop_rec_4k, 5DIII
Post by: ShittyWebsite on December 03, 2022, 11:32:58 PM
So.. aparently Full Res silent pic don't work (the long exposure one)

If high iso and slow shutter speed: "Raw error"
Can someone confirm this?
Title: Re: Danne's crop_rec_4k, 5DIII
Post by: Walter Schulz on December 04, 2022, 12:47:35 AM
Quote from: Danne on December 03, 2022, 09:46:35 PM
I don't think 150Mb/s is possible to achieve? I thought bottleneck is around 130Mb/s

Bilal and I had doubts, too. You missed some discussion: https://www.magiclantern.fm/forum/index.php?topic=26641.msg240245#msg240245
We are at 145 MByte/s now. Not benchmarks but real recording numbers.
Title: Re: Danne's crop_rec_4k, 5DIII
Post by: Danne on December 04, 2022, 08:21:36 AM
Not bad  8)
Title: Re: Danne's crop_rec_4k, 5DIII
Post by: vastunghia on December 04, 2022, 08:42:00 AM
Quote from: Walter Schulz on December 04, 2022, 12:47:35 AM
Bilal and I had doubts, too. You missed some discussion. We are at 145 MByte/s now. Not benchmarks but real recording numbers.

Thank you Walter, I was afraid I had to start all over again to convince another ML giant that 130 is not a bottleneck for 5D3 :D

Did some more detailed testing with Dec02 1.2.3 and I could achieve higher write speeds than yesterday. In one case I obtained 143.8 MB/s, but the on-screen indicator remained orange all the time and actually recording stopped automagically at 3' 28" (5224 frames). Would not consider this a successful continuous recording write speed, but it sets the upper bound.

So yes, Dec02 1.2.3 is a few MB/s behind Apr07 1.1.3 (my personal record: 147.3 MB/s for 6' continuous rec), but not that much.

One question to developers: how confident are we at this point that Apr07 and Dec02 now are really the same thing (apart from details that should not affect write performance)? 100%, 99% or less?

In case confidence level >= 99%, next I will test Dec02 1.1.3 to determine if 1.2.3 vs 1.1.3 is the culprit here. Otherwise I will go for Apr07 1.2.3.
Thank you

Sergio
Title: Re: Danne's crop_rec_4k, 5DIII
Post by: Danne on December 04, 2022, 04:36:24 PM
If verifying more hacks are working and all is considered good in my book. Still havn't seen a solid check on this. Might look into it myself during christmas.
Title: Re: Danne's crop_rec_4k, 5DIII
Post by: gabriielangel on December 04, 2022, 09:23:28 PM
Hello, I have read that it is possible to get continuous 12bit @3.5k Crop with 5DIII. With the latest build, Is it possible to use Auto Focus or Touch focus while recording? Can we see the full capture frame?(Even if it looks low fps like the 2.5k on eos m)
Title: Re: Danne's crop_rec_4k, 5DIII
Post by: vastunghia on December 04, 2022, 09:41:08 PM
Quote from: gabriielangel on December 04, 2022, 09:23:28 PM
Hello, I have read that it is possible to get continuous 12bit @3.5k Crop with 5DIII.

Actually I've been shooting my whole Summer holidays 14bit @3.5k (which is 3.7k actually in UHD standards, i.e. assuming 4k = 3840 ;))

Not sure what you mean by Touch focus (LCD on 5D3 is not touch-enabled) and as far as Auto Focus is concerned, my understanding is that yes you can use it but aperture will be maxed out during AF, so your footage will appear brighter while it is seeking focus. Completely useless. Furthermore, there is no DPAF on the 5D3 so AF is a pain in the neck anyway. Go manual.

With 3.5k framing is ok if you don't need top-notch write speeds (i.e. very bright and complex scenes) @14bit: in that case you will have to turn Global Draw off (i.e. lose correct framing and see only a central crop). Most likely that won't happen if you stick to 12bit.

HTH

Sergio
Title: Re: Danne's crop_rec_4k, 5DIII
Post by: vastunghia on December 04, 2022, 09:54:14 PM
Quote from: Danne on December 04, 2022, 04:36:24 PM
If verifying more hacks are working and all is considered good in my book. Still havn't seen a solid check on this. Might look into it myself during christmas.

Yes. I understand your perspective which is the developer's one: like, "I want to make sure that my implementation of more hacks is correct".

My perspective is that of a user instead, so it is more like "I wish I could understand why have I lost 5% or more of my max write speed passing from one build to another".

But difficult questions require complex tests, and complex tests require simply too much time for me now. Maybe I will find it during Xmas holidays too.

Thanks for all the support

Sergio
Title: Re: Danne's crop_rec_4k, 5DIII
Post by: Danne on December 04, 2022, 10:54:37 PM
No problem. It's not trivial to test as we have all kind of possibilities with settings and different behaviour depending on preset used, lossless, spanned option etc. My plan is to add the latest sd_uhs code from bilal soon and also add back format option.
Title: Re: Danne's crop_rec_4k, 5DIII
Post by: has_abandonment_issu on December 05, 2022, 01:53:16 AM
For two months this thread was completely dead and now in three days I'm already way behind.

Update danne on the issue I mentioned.

For recap. I was on May 2022 3123

Fresh install. 60fps preset. Global draw off. Small hacks on, af off, lvface +aewb

Getting only 60-65mbps on a 0.0 exposed scene.

After seeing your update I decided to test all three builds, April, May, and now December under the exact same settings on the same scene.

April was ~85mbps
May was still ~65mbps
December was ~85mbps

Whatever you changed clearly made a difference. If there is anything specific you'd like me to test let me know. I am going to probably be going through a lot of the settings exhaustively over the next month since I recently got some new lenses and a tripod anyway. I'll update if I find anything.
Title: Re: Danne's crop_rec_4k, 5DIII
Post by: Danne on December 05, 2022, 05:46:44 AM
Great! Thanks for testing.
Title: Re: Danne's crop_rec_4k, 5DIII
Post by: vastunghia on December 05, 2022, 07:18:44 PM
So today I started playing with my new external monitor (actually a DJI Raveneye attached to RSC 2 transmitting to smartphone).

I wanted to test the possibility to use
with Preview = Framing, Global Draw = LiveView, 3.5k preset.

However I quickly realized that, with Global Draw = LiveView, there are at least two major issues:
So I found that a compromise could be to have GD off most of the time (that is, when I don't need to worry about framing and need to focus only on focusing -- pun not intended) and switch GD on only for a few secs when I need to check framing.

This is already feasible actually, as long as I keep the REC button on gimbal half-pressed all the time (5D3 interprets this as half-pressed shutter button, so this way Global Draw is switched off on cam) and release it only when I want to check framing (so GD with Framing is kicked back in). But of course this is very very uncomfortable.

So the question -- finally -- is: Would it be possible to reverse this behavior? So have a new option in ML making it possible to have

Would be so sweet if it turned out to be a simple mod in the code...

Thanks a lot

Sergio
Title: Re: Danne's crop_rec_4k, 5DIII
Post by: ShittyWebsite on December 05, 2022, 10:22:52 PM
Quote from: vastunghia on December 05, 2022, 07:18:44 PM

So the question -- finally -- is: Would it be possible to reverse this behavior? So have a new option in ML making it possible to have

  • Global Draw = off (or maybe even better, no preview at all on cam, as I will be looking at the external HDMI image) all the time,
  • Global Draw = on (correct preview) only when you half-press shutter?

Would be so sweet if it turned out to be a simple mod in the code...

I guess it's possible with lua script, i have set the Q button, while in LiveView to switch between Framing and Real-Time
That's actually a good idea and i might try change a little bit my script:


console.hide()
mod_button_1 = KEY.Q -- Switch Preview

function test41(key)
if key == mod_button_1 and lv.enabled  == true and menu.visible == false then
elseif menu.get("RAW video", "Preview", "") ~= "Framing" then
menu.set("RAW video", "Crop rec preview", "OFF")
menu.set("RAW video", "Preview", "Framing")
return false
elseif menu.get("RAW video", "Preview", "") == "Framing" then
menu.set("RAW video", "Crop rec preview", "OFF")
menu.set("RAW video", "Preview", "Real-time")
return false
end

event.keypress = test41


I'll do some tests later
Title: Re: Danne's crop_rec_4k, 5DIII
Post by: vastunghia on December 05, 2022, 11:29:50 PM
Quote from: ShittyWebsite on December 05, 2022, 10:22:52 PM
I guess it's possible with lua script

Ahhh Lua, I've never used that but I should have thought about it. Thank you, very useful.

Would be super if the trick could be working with half press of shutter instead of Q button. Q button cannot be triggered by commands on gimbal.
Title: Re: Danne's crop_rec_4k, 5DIII
Post by: Danne on December 05, 2022, 11:47:22 PM
Hm, I never use hdmi out but is it not already working? If preset is set to Realtime you'll have cropped realtime preview but holding halfshutter gives you framing until releasing halfshutter?
Title: Re: Danne's crop_rec_4k, 5DIII
Post by: vastunghia on December 06, 2022, 07:52:52 AM
Quote from: Danne on December 05, 2022, 11:47:22 PM
Hm, I never use hdmi out but is it not already working? If preset is set to Realtime you'll have cropped realtime preview but holding halfshutter gives you framing until releasing halfshutter?

Holy cow you are correct of course, apparently I have been having Crop rec preview = "auto mode" all the time, so I could not manually select Preview = "Real-time". I always thought it was some limit of this build and the only way to get real time preview was to turn GD off... how dumb of me :-[

Cool, I disabled auto preview mode and now everything seems fine. Will test more but I think this is it.

Thank you!

S

Ps: holy grail for me would be to have dark LCD screen when no button pushed and framing preview when half shutter pressed. But I guess this is more complicated. Or could this be achieved with Lua?
Title: Re: Danne's crop_rec_4k, 5DIII
Post by: ShittyWebsite on December 06, 2022, 11:38:46 AM
Quote from: vastunghia on December 06, 2022, 07:52:52 AM
Ps: holy grail for me would be to have dark LCD screen when no button pushed and framing preview when half shutter pressed. But I guess this is more complicated. Or could this be achieved with Lua?
The settings preview > frozen LV only works before recording, so it's not possible to disable while recording but:

Prefs > Powersave in LiveView > "Enable while recording" and "Use shortcut key" should work

In lua is possible to:

menu.set("Overlay", "Global Draw", "OFF")
menu.set("Overlay", "Global Draw", "ON, all modes")


That code as half-shutter key, I had some freezes, most likely due to my lack of knowledge in scripting
Title: Re: Danne's crop_rec_4k, 5DIII
Post by: Danne on December 06, 2022, 12:38:42 PM
On eosm I freeze real time preview while using framing by modifying two regs like this:
/* Will maybe reduce corruption of frames by freezing liveview while in framing mode. To be tested */
/* reg for eosm,650d,700d,100d */
if (RAW_IS_RECORDING && (shamem_read(0xc0f383d4) == 0x4f0010)) // x3 digital zoom
{
      EngDrvOutLV(0xc0f383d4, 0x4efffc);
      EngDrvOutLV(0xc0f383dc, 0x42401b2);
        }

Numbers seems not important but it reduced or even eliminated corrupted frames in anamorphic modes on eosm so I guess it works a little like LV frozen on and off while recording.
5DIII doesn´t seem to behave like the eos m and might not benefit with this hack.
Title: Re: Danne's crop_rec_4k, 5DIII
Post by: vastunghia on December 06, 2022, 10:46:03 PM
Thanks a lot for the support, not sure I caught all details but I will look into it as soon as I have some time.

In the meanwhile I found out a setting that I never saw before -- 'Sticky HalfShutter' in the Misc key settings. Could be useful for switching between Real-time and Framing preview without having to hold (half-pressed) down the shutter button on the gimbal. Nice, ML has always some surprise hidden somewhere. Wish I had been a user since early 2010's, I would have seen these features come alive one by one.

Ciao

Sergio
Title: Re: Danne's crop_rec_4k, 5DIII
Post by: Gnarleyeh on December 14, 2022, 02:54:26 PM
Quote from: vastunghia on December 06, 2022, 10:46:03 PM
Thanks a lot for the support, not sure I caught all details but I will look into it as soon as I have some time.

New poster here. Have been using ML for 5 years on a 5D MkIII, with no issues, mostly for augmenting still capabilities, generously produced from the many builds. In the last 2 months I have explored the exciting world of filming RAW. Downloading Danne's Build, I have been experimenting in the early stages of use. My initial attempts met with success after consulting with online documentation of several YouTube videos, and the proper setup with respect to Danne's build. My issue has arisen I believe, because I was exchanging SD cards with the base 1.13 version and the Danne Build. I was hoping to use the overlays specifically to use the Waveform tool for estimating my exposure level, and then replacing the base SD card with the Danne build on a second SD card. I am now unable to write to my CF card, and in spite of reformatting in camera and overwriting to the latest dec build on my SD card. Upon activating recording, I receive the message, Movie Recording stopped automagically  Slot 3:frame 0 not saved. Also, after a reboot and turning movie mode on, and entering ML menu, I receive the message Load Error 0:ML/cropmks/CineSco2.bmp. Kill Global Draw is at OFF, and in the Layout menu, Global draw is at Liveview. The M00 files are being written to the SD card however. Presets -anamorphic, RAW video On, 1920 x 2340, aspect ratio 16:9, data format 14 bit lossless, crop rec preview auto mode, card spanning ON, kill global draw, all overlays OFF, SD Overclock 160 MHz

Thanks,

ML
Title: Re: Danne's crop_rec_4k, 5DIII
Post by: dpjpandone on December 28, 2022, 04:07:24 AM
you might want to check the option in the ml menu under card settings and make sure that the preferred card is set to CF, also check the option in canon menu and set rec/play to CF
Title: Re: Danne's crop_rec_4k, 5DIII
Post by: MCChristor on December 29, 2022, 02:49:30 PM
@Danne Possible to get Adtg GUI / Iso Regs working with crop_rec or put some specific adtg registers in the crop_rec. Is CMOS(4) the same CMOS as the CMOS(4) in the adtg gui? Idk why but I cannot compile crop_rec.c
Title: Re: Danne's crop_rec_4k, 5DIII
Post by: Danne on December 29, 2022, 07:18:15 PM
You can modify cmos4 directly in the build yes.
Title: Re: Danne's crop_rec_4k, 5DIII
Post by: dpjpandone on December 29, 2022, 10:43:49 PM
Hey Danne,
can you clarify something for me? In the "data format" submenu help text, are the recommended iso settings to aid with a more efficient compression rate? Or is there a quality improvement to be had by following the suggested iso ranges? Obviously a lower iso results in a cleaner image, no question about that but where it says "14-bit recommended iso less than 100" or "12-bit lossless recommended iso 100-1600" are there any side effects other than an increased bitrate and noise when shooting high iso?
Title: Re: Danne's crop_rec_4k, 5DIII
Post by: pepper_chip on December 30, 2022, 11:23:44 AM
Quote from: dpjpandone on December 29, 2022, 10:43:49 PM
Hey Danne,
can you clarify something for me? In the "data format" submenu help text, are the recommended iso settings to aid with a more efficient compression rate? Or is there a quality improvement to be had by following the suggested iso ranges? Obviously a lower iso results in a cleaner image, no question about that but where it says "14-bit recommended iso less than 100" or "12-bit lossless recommended iso 100-1600" are there any side effects other than an increased bitrate and noise when shooting high iso?

Hi, in my practice 14 bit uncompressed cleaner at all iso's in the shadows than 10/12 bits
Title: Re: Danne's crop_rec_4k, 5DIII
Post by: Danne on December 30, 2022, 01:45:45 PM
Quote from: dpjpandone on December 29, 2022, 10:43:49 PM
Hey Danne,
can you clarify something for me? In the "data format" submenu help text, are the recommended iso settings to aid with a more efficient compression rate? Or is there a quality improvement to be had by following the suggested iso ranges? Obviously a lower iso results in a cleaner image, no question about that but where it says "14-bit recommended iso less than 100" or "12-bit lossless recommended iso 100-1600" are there any side effects other than an increased bitrate and noise when shooting high iso?

Iso ranges and canon digic V sensors are worth a few hours digging. On a sidenote my eos R6 is a complete redesign in sensor output. Instead of pulling back highlights I can expose for highlight and then pull back my shadows and to a very rough extreme. Still clean image.
So iso 100 on 5diii and without exposing to the right the shadows will crack sooner than iso 800.
Title: Re: Danne's crop_rec_4k, 5DIII
Post by: dpjpandone on December 31, 2022, 05:22:05 AM
Quote from: Danne on December 30, 2022, 01:45:45 PM
So iso 100 on 5diii and without exposing to the right the shadows will crack sooner than iso 800.

you can't just drop a bomb like that and walk off-stage.

Come again?

are you comparing traditionally proper exposure at iso 100 to an ETTR at 800? or are we talking apples to apples?
Title: Re: Danne's crop_rec_4k, 5DIII
Post by: Danne on December 31, 2022, 10:18:27 AM
This is common knowledge around here. You can do a simple test by shooting two matched files with iso 100 and 800. Just change shutter speed to match exposure. Then lift shadows in post. Iso 100 works best when minimum shadowlifting is needed. Then you get noiseless iso 100. Otherwise iso 400 and higher will reduce shadow issues.
Title: Re: Danne's crop_rec_4k, 5DIII
Post by: rinski on December 31, 2022, 12:57:05 PM
Hello, I wanted to report that the December 2nd version makes many errors such as corrupt frames and high instability in full anamorphic.
Thank you.
Title: Re: Danne's crop_rec_4k, 5DIII
Post by: Bruno Italiano on December 31, 2022, 03:25:05 PM
Brilliant anything else?  :-X  :)
Title: Re: Danne's crop_rec_4k, 5DIII
Post by: Ben_R on January 01, 2023, 04:34:42 PM
Hi Danne!
I also have a question around your MLV version. I use it with an anamorphic lense on a 35mm objective, so the 3,3 and 3,5k 5x centered modes are pretty usefull for me.
How does it come that the 3,3k preset offeres a higher vertical resolution? Are there any differences in quality between those two presets?
Also: when i chose 14-bit lossless in the RAW Video tab and then alter the Bitdepth tab in the Movie tab, does that affect the footage in any way?


Thanks for your work!

Best
Ben
Title: Re: Danne's crop_rec_4k, 5DIII
Post by: Danne on January 03, 2023, 05:36:14 PM
Added new versions in first post:

- sd_uhs from theBilalFakhouri(192/240Mhz high speed patches)
- Putting back CONFIG_RESTORE_AFTER_FORMAT(formatting and keeping ML on card after restore)
Title: Re: Danne's crop_rec_4k, 5DIII
Post by: dpjpandone on January 08, 2023, 02:14:12 AM
Quote from: Danne on December 30, 2022, 01:45:45 PM
Iso ranges and canon digic V sensors are worth a few hours digging.

Hey Danne, I noticed something quirky I thought you might have some insight:

Let me preface this by saying I understand that ML digital iso has no effect on raw video (although it is a nice feature for .h264)

When shooting raw, if the bit depth is set to 12bit, digital iso DOES affect preview on the LCD as well as an external monitor. I have tested to confirm this is only affecting the preview and not the recorded file. My question is does this happen for a reason? Is it a feature, a bug, or a side effect? I am currently using this as a feature because my (evolving) method for cleaner shadows is to overexpose by one stop in camera then pull down in post (similar to push/pull processing with film) setting the ML digital ISO to a negative value allows me to preview the shot as it would appear after a post-processing pull. I wonder if there is a way to duplicate this behavior for other bitdepths?
Title: Re: Danne's crop_rec_4k, 5DIII
Post by: Danne on January 08, 2023, 05:29:08 AM
Preview output is matched to meet the brightness when selecting 12bit and 10bit. Not perfect when using those bitdepth overrides in Movie tab but usable at least.
Title: Re: Danne's crop_rec_4k, 5DIII
Post by: dpjpandone on January 08, 2023, 06:16:58 AM
Quote from: Danne on January 08, 2023, 05:29:08 AM
Preview output is matched to meet the brightness when selecting 12bit and 10bit.

Where is this happening? mlv_lite? do you know the approximate line number or a keyword I can search?  My goal is to make 14bit preview behave the same way

setup_bit_depth_digital_gain ?
Title: Re: Danne's crop_rec_4k, 5DIII
Post by: Danne on January 08, 2023, 08:38:01 AM
14bit? How do you mean?
I change brightness in crop_rec.c. Below example is for the eos M:
         if (OUTPUT_10BIT)
         {
             EngDrvOutLV(0xC0F42744, 0x4040404);
         }

         if (OUTPUT_12BIT)
         {
             EngDrvOutLV(0xC0F42744, 0x2020202);
         }

How it works otherwise I have no idea.
Title: Re: Danne's crop_rec_4k, 5DIII
Post by: dpjpandone on January 09, 2023, 12:59:39 AM
Quote from: Danne on January 08, 2023, 08:38:01 AM
14bit? How do you mean?

digital gain (ML options- image fine tuning) only affects preview in 10 or 12 bit. In 14-bit it has no effect
Title: Re: Danne's crop_rec_4k, 5DIII
Post by: ShittyWebsite on January 09, 2023, 12:15:45 PM
Hi Danne, is it possible to add
RAW_PREVIEW_GRAY_ULTRA_FAST
to the 1:1 crop modes? the BW preview in anamorphic modes is almost real-time

perhaps as a option on/off?

Thank you
Title: Re: Danne's crop_rec_4k, 5DIII
Post by: Danne on January 09, 2023, 01:02:22 PM
Yes possible. Maybe makes more sense to always use RAW_PREVIEW_GRAY_ULTRA_FAST while we are recording? Or maybe an option as you say. I´ll see what I can do :).
Title: Re: Danne's crop_rec_4k, 5DIII
Post by: Danne on January 09, 2023, 08:46:39 PM
New builds:

GRAY_ULTRA_FAST is enabled for all presets when in menu Crop rec preview is set to Auto mode. Turn to OFF and framing works the old way alternating between color and b&w preview. GRAY_ULTRA_FAST is fast though, more useful.
Title: Re: Danne's crop_rec_4k, 5DIII
Post by: kpn on January 17, 2023, 12:33:39 PM
Seems to be working great so far, haven't experienced any bugs yet, appreciate your work Danne!
Title: Re: Danne's crop_rec_4k, 5DIII
Post by: Grognard on January 18, 2023, 09:28:39 PM
Quote from: Danne on January 09, 2023, 08:46:39 PM
New builds:

GRAY_ULTRA_FAST is enabled for all presets when in menu Crop rec preview is set to Auto mode. Turn to OFF and framing works the old way alternating between color and b&w preview. GRAY_ULTRA_FAST is fast though, more useful.

One of the best Updates. Thank you Danne!
We have our (almost) realtime preview ;-)

Of course it's b&w and low resolution but it's really better than half frame colour/ half frame b&w and very very low.

Title: Re: Danne's crop_rec_4k, 5DIII
Post by: Danne on January 18, 2023, 09:56:25 PM
True. Good tip from ShittyWebsite.
Title: Re: Danne's crop_rec_4k, 5DIII
Post by: vastunghia on January 20, 2023, 09:01:44 AM
Tested 2023Jan09 1.2.3, works like a charm -- thank you Danne!

Sergio
Title: Re: Danne's crop_rec_4k, 5DIII
Post by: Danne on January 20, 2023, 08:08:07 PM
You are welcome. Latest changes were picked from theBilalFakhouri.
Title: Re: Danne's crop_rec_4k, 5DIII
Post by: winmediacenter on January 25, 2023, 10:45:39 AM
I've just tested new build with 3,5K centered mode and noticed something weird. I tried to set shutter to 1/50 to avoid flickering and the only method to achieve perfect shutter is to use shutter fine tuning. Everything working great unless i tried to record some footage. The shutter crank up automatically second by second after pressing record button and ruined the shot. Everytime i use shutter fine tuning this happens. I also noticed another thing when i set shutter without fine tuning (it's approx 1/50 but not ideal) and press shutter halfway to set my focus the shutter automatically sets to 1/48 and everytime i need to readjust to 1/50 by entering ML Menu (doesn't change by turning upper wheel)
Title: Re: Danne's crop_rec_4k, 5DIII
Post by: Danne on January 25, 2023, 10:51:50 AM
Turn off more hacks. Probably the issue.
Title: Re: Danne's crop_rec_4k, 5DIII
Post by: winmediacenter on January 25, 2023, 10:59:01 AM
I will try but...few MB/s less to write. I dont know how im gonna live with that  :'(
Title: Re: Danne's crop_rec_4k, 5DIII
Post by: Grognard on January 25, 2023, 11:21:26 AM
Quote from: winmediacenter on January 25, 2023, 10:59:01 AM
I will try but...few MB/s less to write. I dont know how im gonna live with that  :'(

Shutter issues are related to lface + aewb hack. You should only use lface hack and one more hack.
No need more with 3.5k mode. Is continuous with 12 bits, SD 160MHZ and card spanning enable using crop realtime previous or even most of time  with the new grey super fast preview
Title: Re: Danne's crop_rec_4k, 5DIII
Post by: winmediacenter on January 25, 2023, 11:30:46 AM
Thanks for quick reply. I will give it a try  :)
Title: Re: Danne's crop_rec_4k, 5DIII
Post by: vastunghia on January 25, 2023, 12:54:40 PM
Quote from: Grognard on January 25, 2023, 11:21:26 AM
No need more with 3.5k mode. Is continuous with 12 bits, SD 160MHZ and card spanning enable

Continuous also @14bit for me -- at least in most occasions, or possibly slightly lowering exposure (precise ETTR could be hard to reach).
Title: Re: Danne's crop_rec_4k, 5DIII
Post by: dpjpandone on January 28, 2023, 06:27:21 AM
Why do you have 12-bit lossless disabled in 3.5k mode?
Title: Re: Danne's crop_rec_4k, 5DIII
Post by: vastunghia on January 28, 2023, 08:14:17 AM
Quote from: dpjpandone on January 28, 2023, 06:27:21 AM
Why do you have 12-bit lossless disabled in 3.5k mode?

Sorry, not sure I understand your question :-\
Title: Re: Danne's crop_rec_4k, 5DIII
Post by: dpjpandone on January 29, 2023, 04:21:51 AM
This question is for Danne. all of the bit depths and compression schemes should work with 3.5K
Title: Re: Danne's crop_rec_4k, 5DIII
Post by: Danne on January 29, 2023, 06:21:20 AM
All bitdepths work when selected from Movie tab. If not, provide some screenshots of what you are doing to miss it.
Title: Re: Danne's crop_rec_4k, 5DIII
Post by: rinski on January 29, 2023, 11:01:43 AM
Hello, I wanted to mention the useful view of the 5D3 view on the 5D3, adding the 10x zoom (it helps a lot in the manual approach) and the 18 fps in the full anamorphic as in the eos m.
Thanks.
Title: Re: Danne's crop_rec_4k, 5DIII
Post by: dpjpandone on January 30, 2023, 03:48:05 AM
Quote from: Danne on January 29, 2023, 06:21:20 AM
All bitdepths work when selected from Movie tab. If not, provide some screenshots of what you are doing to miss it.

help reports:
"compression does not work with higher resolutions" in 3.5k mode
Title: Re: Danne's crop_rec_4k, 5DIII
Post by: Danne on January 30, 2023, 05:13:06 AM
But does it work?
Title: Re: Danne's crop_rec_4k, 5DIII
Post by: dpjpandone on January 30, 2023, 11:41:03 PM
Quote from: Danne on January 30, 2023, 05:13:06 AM
But does it work?

Does not allow the user to select 12bit lossless in 3.5k mode. It automatically reverts to 14bit lossless. I think you reused the portion of the code that blocks lossless 12-8bit in HIGHER resolutions (4k...etc.) but 3.5k was always working from the inception of crop-rec on steroids
Title: Re: Danne's crop_rec_4k, 5DIII
Post by: Danne on January 30, 2023, 11:55:30 PM
Hm, works here. Could you do some screenshots or a screen recording?
Title: Re: Danne's crop_rec_4k, 5DIII
Post by: dpjpandone on January 31, 2023, 01:17:19 AM
(http://hipsterhack.com/wp-content/uploads/2023/01/20230130_173600-1-scaled.jpg)
Title: Re: Danne's crop_rec_4k, 5DIII
Post by: Danne on January 31, 2023, 01:28:02 AM
What build are you on? Always leave it at 14bit lossless. Then reduce bitdepth from Movie tab.
Title: Re: Danne's crop_rec_4k, 5DIII
Post by: dpjpandone on January 31, 2023, 02:17:08 AM
Quote from: Danne on January 31, 2023, 01:28:02 AM
What build are you on? Always leave it at 14bit lossless. Then reduce bitdepth from Movie tab.

This is your Jan 9th build. perhaps you should change help to:

"reduce bitdepth from Movie tab" ??

and clarify that this is or is not compressed?

hey btw, is there any possible side effects for defining CONFIG_KILL_FLICKER on 5d3? It looks like this was an easy way to add Kill canon Gui, but could this possibly slow down other stuff that we dont wish to interfere with?
Title: Re: Danne's crop_rec_4k, 5DIII
Post by: Danne on January 31, 2023, 04:48:51 AM
Read the thread. Somewhere you'll get your answers.
Flicker stuff. No idea.
Title: Re: Danne's crop_rec_4k, 5DIII
Post by: dpjpandone on January 31, 2023, 03:22:41 PM
Quote from: Danne on January 31, 2023, 04:48:51 AM
Flicker stuff. No idea.

I did a search for CONGIF_KILL_FLICKER in all files
  C:\ML4K\src\debug.c (1 hit)
Line  783: #ifdef CONFIG_KILL_FLICKER
  C:\ML4K\src\powersave.c (4 hits)
Line 150: #ifdef CONFIG_KILL_FLICKER
Line 243: #ifdef CONFIG_KILL_FLICKER
Line 383: #ifdef CONFIG_KILL_FLICKER
Line 469:     #ifdef CONFIG_KILL_FLICKER
  C:\ML4K\src\tweaks.c (3 hits)
Line 3421: #ifdef CONFIG_KILL_FLICKER
Line 3599:     #if defined(CONFIG_KILL_FLICKER) || defined(FEATURE_SCREEN_LAYOUT) || defined(FEATURE_IMAGE_POSITION) || defined(FEATURE_UPSIDE_DOWN) || defined(FEATURE_IMAGE_ORIENTATION) || defined(FEATURE_AUTO_MIRRORING_HACK) || defined(FEATURE_FORCE_HDMI_VGA)
Line 3606:             #ifdef CONFIG_KILL_FLICKER
  C:\ML4K\src\zebra.c (3 hits)
Line   71: #ifdef CONFIG_KILL_FLICKER // this will block all Canon drawing routines when the camera is idle
Line  433:             #ifdef CONFIG_KILL_FLICKER
Line 3893:                 #ifdef CONFIG_KILL_FLICKER

and I did not find anything that would have adverse effects on performance, It seems to just call CLRSCREEN in certain instances as a fix for 50D in powersave modes. your idea to use it to remove canon 5x  overlay was brilliant!
Title: Re: Danne's crop_rec_4k, 5DIII
Post by: Danne on January 31, 2023, 05:05:49 PM
I thought I used some setting n ml menu which removes overlay  8).
When it comes to help texts etc I chose to keep things on the 5d3. My main work was around eos m, 5d3 more like a bonus cam.
Title: Re: Danne's crop_rec_4k, 5DIII
Post by: ShittyWebsite on February 01, 2023, 01:40:45 AM
You are doing great with the 5D3, everyday feels better and better, been testing with my phone as a second monitor, 5D3 monitor as framing and phone as real-time (anamorphic stretched)
Title: Re: Danne's crop_rec_4k, 5DIII
Post by: vastunghia on February 01, 2023, 07:06:52 AM
Quote from: Danne on January 31, 2023, 05:05:49 PM
My main work was around eos m, 5d3 more like a bonus cam.

You are breaking my heart here ;D

Why is everybody so in love with the M? A 2nd hand 5D3 is not as cheap as an M, but it is very close and so cheap in absolute terms anyway. And is by far superior, technically speaking (starting from e write speed capability of course).

So really, a genuine question, can somebody explain to me why M is so popular?
Title: Re: Danne's crop_rec_4k, 5DIII
Post by: ShittyWebsite on February 01, 2023, 12:53:28 PM
Quote from: vastunghia on February 01, 2023, 07:06:52 AM
You are breaking my heart here ;D

Why is everybody so in love with the M? A 2nd hand 5D3 is not as cheap as an M, but it is very close and so cheap in absolute terms anyway. And is by far superior, technically speaking (starting from e write speed capability of course).

So really, a genuine question, can somebody explain to me why M is so popular?

Exactly, where i live theres not a single EOS M for sale, seriously, i was trying to find one
Title: Re: Danne's crop_rec_4k, 5DIII
Post by: Danne on February 01, 2023, 02:10:11 PM
Eos m will become the legend ;).
Agree though on 5diii being the superior cam imagewise and more stable.
Title: Re: Danne's crop_rec_4k, 5DIII
Post by: parallel visuals on February 01, 2023, 05:33:17 PM
As an owner of both the M and the 5D3, I share my thoughts:

I would guess that huge increase of the popularity of the M is mostly because of much more youtube videos about that: actually I have also found ML because an EOS M video just has popped up one year ago. And I have learnt only later that you can do similar things with other Canon cameras.

Price: as far as I understand, when all the ML development had started, the price difference between the M and the 5D3 was much higher, but now with the popularity of the M (and the drop of the 5D3 prices due to the advent of the R series), it is not that much of a difference any more, I agree. But it is still cheaper, so if someone starts to do videography, might feel safer to start with a more budget-friendly option.

Main advantages of the 5D3: to me it is a huge improvement over the M that it has a native 1920x1080 resolution with native 3x3 binning: the image is gorgeous even in the plain 1080p mode, and can be used up to 60 fps. (I personally don't really use other modes on the 5D3, 1080p is sharp enough to me on any monitor in a normal viewing distance. I really enjoy the manageable file sizes and quick editing.) Moreover, it is one of the best stills camera on the market: reliable autofocus and very good pictures straight out of the camera even in low light. For professional video and photo work I would definitely grab this one.

Main advantages of the EOS M: the best thing about it its small size and weight, with the 15-45mm kit lens I can literally fit into the pocket of my jacket, so I take this one if I go for a small excursion or meet friends. And even on a festival I can work quite unnoticed with the M. Another plus is the adaptability of the M mount, I sometimes use it with smaller EF-M lenses, or with EF lenses with the Viltrox speedbooster. The only downside for me is the line skipping in the 1080p mode, but the artefacts can be avoided using a shallow depth of field and/or soft lenses. For very detailed scenes using the anamorphic and the high resolution modes are the way to go, at the price of higher file sizes. And who knows, at some point we might get digital 3x3 binning, where the three lines are added before being written out to the card, to make a super1080p mode. After all, so many developments have happened that noone thought possible before!

So both have their place in my workflow and it is great that Danne is developing for both so I can use ML builds that have pretty similar functionality.
Title: Re: Danne's crop_rec_4k, 5DIII
Post by: vastunghia on February 01, 2023, 07:37:40 PM
Quote from: parallel visuals on February 01, 2023, 05:33:17 PM
As an owner of both the M and the 5D3, I share my thoughts

Thanks for this.

Yes, I think mostly it is Zeek's fault ;D if M is shadowing the 5D3.

I agree that resolution is overvalued most of the times — particularly if the final goal is to share your videos on YT, as they will be watched by users in some small floating window on their smartphone screen at some low resolution / high compression.

I guess that the intended use case should always be the main driver in choosing your cam. For instance, I'm shooting video mainly to conserve memory of relevant family moments, to be watched on a (not huge, but still much bigger than a smartphone) 4K UHD HDR TV screen. And 14-bit 1x1 3.5K (which should be called 3.7K according to UHD standard btw) encoded into HEVC Main10 profile shines like a jewel on it (if only I were good at grading, that is :-[ but I'm learning). I can definitely tell the difference with 1080, especially if it is 3x3 (I have a 70D too, and btw heaven knows how much I miss DPAF on 5D3). So yeah, in my case choice of 5D3 is no brainer... I got one used for 300 bucks some time ago and that is the deal I'm most satisfied of. Ever.

S

Title: Re: Danne's crop_rec_4k, 5DIII
Post by: Danne on February 01, 2023, 11:22:49 PM
New builds:

Testing if grayscale framing preview could get even faster
Title: Re: Danne's crop_rec_4k, 5DIII
Post by: vastunghia on February 01, 2023, 11:29:57 PM
<3
Title: Re: Danne's crop_rec_4k, 5DIII
Post by: dpjpandone on February 02, 2023, 12:21:20 AM
Danne:

while (((white-black) >> div) >= 700)

good idea!

playing with it now, (btw I asked you about frozen vs/ gray ultra fast I have figured out that frozen call's ultrafast when need for speed kicks in)

why this:

if (get_ms_clock() - last_hs_unpress > 300) ?


Title: Re: Danne's crop_rec_4k, 5DIII
Post by: dpjpandone on February 02, 2023, 01:26:39 AM
OK, I did not add this (because I don't understand it)

if (get_ms_clock() - last_hs_unpress > 300)

but I found that the other changes certainly speed up the refresh rate of gray ultrafast, however I saw a consistent 1-2 MB/s drop (From 91.2MB/s to 88.3MB/s) in SD card write speed. I went back and forth testing before and after the changes to confirm. I guess this is the meaning of "Be Gentle, save for recording"


Got consistent "Frame order error Slot" when buffer filled up
Title: Re: Danne's crop_rec_4k, 5DIII
Post by: ShittyWebsite on February 02, 2023, 11:28:02 AM
Quote from: Danne on February 01, 2023, 11:22:49 PM
New builds:

Testing if grayscale framing preview could get even faster


Very good update
Title: Re: Danne's crop_rec_4k, 5DIII
Post by: Danne on February 02, 2023, 11:21:36 PM
New builds:

Testing this suggestion:
https://www.magiclantern.fm/forum/index.php?topic=25287.msg241992#msg241992
Title: Re: Danne's crop_rec_4k, 5DIII
Post by: dpjpandone on February 03, 2023, 04:14:18 AM
Quote from: Danne on February 02, 2023, 11:21:36 PM
New builds:

Testing this suggestion:
https://www.magiclantern.fm/forum/index.php?topic=25287.msg241992#msg241992

I'm pretty happy with the balance between speed and stability with those values.

I now understand that:if (get_ms_clock() - last_hs_unpress > 300) is to make switching back and forth faster. This is good. personally 200ms is perfect for me

When you have a moment could you please explain lowering the gamma and white levels to <700 ? in raw.c:
while (((white-black) >> div) >= 700)

I can't figure out what (or why) this does?



Title: Re: Danne's crop_rec_4k, 5DIII
Post by: Danne on February 03, 2023, 06:50:44 AM
Gamma lowers gamma. It should help with speed. Feel free to test by returning the values to 1024 and see if you notice and difference in speed.
Title: Re: Danne's crop_rec_4k, 5DIII
Post by: dpjpandone on February 03, 2023, 05:09:21 PM
Refresh speed? CPU overhead? Write speed? Which speed?
Title: Re: Danne's crop_rec_4k, 5DIII
Post by: Danne on February 03, 2023, 10:39:07 PM
Maybe no gain at all. I am testing by trial and error. Input back full 1024 in later builds. Maybe works equally good.
Title: Re: Danne's crop_rec_4k, 5DIII
Post by: dpjpandone on February 05, 2023, 02:24:13 AM
I went all the way down to 256 and did not notice an improvement
Title: Re: Danne's crop_rec_4k, 5DIII
Post by: Danne on February 05, 2023, 02:39:14 AM
Great 👍
Title: Re: Danne's crop_rec_4k, 5DIII
Post by: Saint on February 07, 2023, 04:23:40 PM
Quote from: vastunghia on February 01, 2023, 07:37:40 PM
Thanks for this.

Yes, I think mostly it is Zeek's fault ;D if M is shadowing the 5D3.

I agree that resolution is overvalued most of the times — particularly if the final goal is to share your videos on YT, as they will be watched by users in some small floating window on their smartphone screen at some low resolution / high compression.

I guess that the intended use case should always be the main driver in choosing your cam. For instance, I'm shooting video mainly to conserve memory of relevant family moments, to be watched on a (not huge, but still much bigger than a smartphone) 4K UHD HDR TV screen. And 14-bit 1x1 3.5K (which should be called 3.7K according to UHD standard btw) encoded into HEVC Main10 profile shines like a jewel on it (if only I were good at grading, that is :-[ but I'm learning). I can definitely tell the difference with 1080, especially if it is 3x3 (I have a 70D too, and btw heaven knows how much I miss DPAF on 5D3). So yeah, in my case choice of 5D3 is no brainer... I got one used for 300 bucks some time ago and that is the deal I'm most satisfied of. Ever.

S
Good afternoon! Where did you buy one and in what condition? Good buy, we can't find it for that kind of money.
Title: Re: Danne's crop_rec_4k, 5DIII
Post by: rinski on February 08, 2023, 07:37:05 PM
Hello, I wanted to report that the iso is locked in auto and the shutter is disabled in the latest version 5d3 123, everything else is great, the preview especially.
Thank you.
Title: Re: Danne's crop_rec_4k, 5DIII
Post by: dpjpandone on February 10, 2023, 07:01:46 PM
yeah thats what happend when you enable "more hacks"
Title: Re: Danne's crop_rec_4k, 5DIII
Post by: vastunghia on February 11, 2023, 11:55:37 AM
Quote from: Saint on February 07, 2023, 04:23:40 PM
Good afternoon! Where did you buy one and in what condition? Good buy, we can't find it for that kind of money.

Maybe I was lucky. Who knows. I spotted the 5D3 on eBay. I used Auction Sniper to secure it for € 302. That was June 21. It belonged to a professional photographer who was dropping it before shutter breakdown I guess. It had some 400k shutter actuations :o but for the use I make of it (few stills, some video), it is perfect.

Then of course you need to add the cost for a fast CF card...

S
Title: Re: Danne's crop_rec_4k, 5DIII
Post by: Mattia on February 14, 2023, 01:18:10 PM
Hi! I'm thinking about buying a 5d3 to use it with Magic Lantern but before doing it, there are few things I need to evaluate:

Do the 3.3k, 3.5k and UHD 1:1 modes offer continuous shooting?

What's the crop factor of the 3.3k, 3.5k and UHD modes?

Does the 5.7k mode offers continuous shooting?

What's the liveview status of the 1:1 and the 5.7k modes? Is it frtp? Is it cropped? How fast is it?

Thanks!
Title: Re: Danne's crop_rec_4k, 5DIII
Post by: HoDzA.X on February 14, 2023, 03:30:36 PM
hey, I have the 5D3 ML
{Do the 3.3k, 3.5k and UHD 1:1 modes offer continuous shooting?}
the modes like 3.5k is in 1.86:1 Aspect ratio I think, max in 16;9 is 2880x1600 about, cant remember exact pixels. and you can continuously shoot if you have fast cards, I have the gold san disk extreme CF, not the pro. and 128 gb extreme pro sd card. when you enable card spaning I have 2.8k at 16:9 continuous. the crop is 1.5x in 3.5k full, and 2.25x in 2.8k. al the modes have a black-and-white live view but it's fast.
BTW if you select 10-bit or 12-bit you can have continuous.


{Does the 5.7k mode offers continuous shooting?}
it's like 7.5 fps and I don't use it. but it is beautiful.

ps:
you can do 45-48fps in 1080p but it's buggy. in my exp
standard 1080p has a full-time live view. it's very lovely!
Title: Re: Danne's crop_rec_4k, 5DIII
Post by: vastunghia on February 14, 2023, 07:34:05 PM
Quote from: Mattia on February 14, 2023, 01:18:10 PM
Do the 3.3k, 3.5k and UHD 1:1 modes offer continuous shooting?

I use 14-bit 3.5K 2.39:1 all the time and the only problem I face is that I cannot always accurately ETTR (sometimes I have to stop down 1/3 to max 1 EV in order to get continuous rec). This is also an advantage though, as I'm pretty confident that rec. will stop if I inadvertently were clipping highlights ;)

3.3K is continuous in all situations for me.

For UHD (which natively is 2.61:1 btw) I think you will have to switch to 12 bit, however I didn't test it much, preview is completely broken at this time.

Quote from: Mattia on February 14, 2023, 01:18:10 PM
What's the crop factor of the 3.3k, 3.5k and UHD modes?

They are 1x1 crop modes, so the math is pretty simple here. Just divide full sensor pixel width count by rec. resolution. I recall that 3.5K is perfectly 1.6x — which makes this mode fine even with APS-C lenses 8)

Quote from: Mattia on February 14, 2023, 01:18:10 PM
Does the 5.7k mode offers continuous shooting?

Absolutely.

Quote from: Mattia on February 14, 2023, 01:18:10 PM
What's the liveview status of the 1:1 and the 5.7k modes? Is it frtp? Is it cropped? How fast is it?

LV is not exciting, but Bilal is working on it! So fingers crossed ;) Currently I use fast grey preview on LCD just to have an idea of framing and an external HDMI monitor for focusing. Unfortunately HDMI out is equivalent to the x5 cropped zoom area, so it is impossible to focus subjects on the right or the left of the frame.

My cards:

SD: SanDisk 128 GB Extreme PRO 95 MB/s, Class 10, U3, V30
CF: Lexar 256GB 1066x 160 MB/s UDMA 7 VPG-65

HTH
Title: Re: Danne's crop_rec_4k, 5DIII
Post by: koopg on February 15, 2023, 09:46:34 AM
Quote from: vastunghia on February 14, 2023, 07:34:05 PM
I use 14-bit 3.5K 2.39:1 all the time and the only problem I face is that I cannot always accurately ETTR (sometimes I have to stop down 1/3 to max 1 EV in order to get continuous rec). This is also an advantage though, as I'm pretty confident that rec. will stop if I inadvertently were clipping highlights ;)

3.3K is continuous in all situations for me.

For UHD (which natively is 2.61:1 btw) I think you will have to switch to 12 bit, however I didn't test it much, preview is completely broken at this time.

They are 1x1 crop modes, so the math is pretty simple here. Just divide full sensor pixel width count by rec. resolution. I recall that 3.5K is perfectly 1.6x — which makes this mode fine even with APS-C lenses 8)

Absolutely.

LV is not exciting, but Bilal is working on it! So fingers crossed ;) Currently I use fast grey preview on LCD just to have an idea of framing and an external HDMI monitor for focusing. Unfortunately HDMI out is equivalent to the x5 cropped zoom area, so it is impossible to focus subjects on the right or the left of the frame.

My cards:

SD: SanDisk 128 GB Extreme PRO 95 MB/s, Class 10, U3, V30
CF: Lexar 256GB 1066x 160 MB/s UDMA 7 VPG-65

HTH
how do you get framing on lcd and realtime on monitor?

Sent from my SM-N975F using Tapatalk

Title: Re: Danne's crop_rec_4k, 5DIII
Post by: koopg on February 15, 2023, 10:03:03 AM
Danne,
I am using your awsome builds from when you started to release them,
thank you for that.

I allwayse had my "AUTOMATIC" settings for ML
3.5k
Allwayse turning off bit depth from movie tab
and aspact ratio as well.
and tought that, one should handle all of these settings from with in raw tab.
14bit loss less was my goto.

the output was amazing and i was happy with it.
card spanning and sd OC
along with all the hacks
helped to get near continuse shooting,
but I always had random crashs and alwayse crash when some pixeles are over exposed

in one of your latests post here, you have mantioned  running 12bit on movie tab.
so when installing your latest update, I left the bit depth checkbox on 12bit.
Then I was shooting over exposed and didnt not crash and everything feels much more stable.

can you please explain what is the bit depth checkbox different from both tabs ?

thanks

Sent from my SM-N975F using Tapatalk
Title: Re: Danne's crop_rec_4k, 5DIII
Post by: Mattia on February 15, 2023, 10:41:59 AM
Quote from: vastunghia on February 14, 2023, 07:34:05 PM
I use 14-bit 3.5K 2.39:1 all the time and the only problem I face is that I cannot always accurately ETTR (sometimes I have to stop down 1/3 to max 1 EV in order to get continuous rec). This is also an advantage though, as I'm pretty confident that rec. will stop if I inadvertently were clipping highlights ;)

3.3K is continuous in all situations for me.

For UHD (which natively is 2.61:1 btw) I think you will have to switch to 12 bit, however I didn't test it much, preview is completely broken at this time.

They are 1x1 crop modes, so the math is pretty simple here. Just divide full sensor pixel width count by rec. resolution. I recall that 3.5K is perfectly 1.6x — which makes this mode fine even with APS-C lenses 8)

Absolutely.

LV is not exciting, but Bilal is working on it! So fingers crossed ;) Currently I use fast grey preview on LCD just to have an idea of framing and an external HDMI monitor for focusing. Unfortunately HDMI out is equivalent to the x5 cropped zoom area, so it is impossible to focus subjects on the right or the left of the frame.

My cards:

SD: SanDisk 128 GB Extreme PRO 95 MB/s, Class 10, U3, V30
CF: Lexar 256GB 1066x 160 MB/s UDMA 7 VPG-65

HTH

Thanks for all your precious info! You've been really kind to clarify all that! I would only like to understand a little more about the liveview. Does it offer correct framing, even if slow? And.. How much slow is it? Could I follow some actor walking in a room, for example?

Sorry to bother you, I just want to be sure before purchasing it! I'm also thinking, as an alternative solution, to use the viewfinder when shooting. Does it work while recording?
Title: Re: Danne's crop_rec_4k, 5DIII
Post by: Walter Schulz on February 15, 2023, 10:46:02 AM
Quote from: Mattia on February 15, 2023, 10:41:59 AM
Sorry to bother you, I just want to be sure before purchasing it! I'm also thinking, as an alternative solution, to use the viewfinder when shooting. Does it work while recording?

In any SLR (Single Lens Reflex) camera mirror is in "up" position during recording. Thus all light goes to sensor. Vievfinder is completely blocked from incoming light from lens.
https://www.mediacollege.com/photography/camera/slr/
(Secondary mirror not shown in linked description).
Title: Re: Danne's crop_rec_4k, 5DIII
Post by: vastunghia on February 15, 2023, 07:18:57 PM
Quote from: koopg on February 15, 2023, 09:46:34 AM
how do you get framing on lcd and realtime on monitor?

Realtime on monitor is heavily cropped with 1x1 5x modes, as I said. And with anamorphic 1x3 modes it is also stretched (or squeezed? Can't remember) horizontally so it is almost unusable.

That said, there is nothing special you have to do to obtain it — HDMI out is always realtime (on 5D3 1.2.3 it is also clean). Just get an HDMI cable and connect your cam to your pc monitor to test.
Title: Re: Danne's crop_rec_4k, 5DIII
Post by: vastunghia on February 15, 2023, 07:26:21 PM
Quote from: Mattia on February 15, 2023, 10:41:59 AM
I would only like to understand a little more about the liveview. Does it offer correct framing, even if slow? And.. How much slow is it? Could I follow some actor walking in a room, for example?

Yes it is correct. And yes you can follow action. Only thing you cannot do is adjust focus. For that you will need an external monitor IMO.

I would be happy to make a video for you showing you how LV works, but unfortunately I don't think I will have the time — at least before the week-end. You may find something on this forum or over YT however.
Title: Re: Danne's crop_rec_4k, 5DIII
Post by: Mattia on February 15, 2023, 08:58:53 PM
Quote from: vastunghia on February 15, 2023, 07:26:21 PM
Yes it is correct. And yes you can follow action. Only thing you cannot do is adjust focus. For that you will need an external monitor IMO.

I would be happy to make a video for you showing you how LV works, but unfortunately I don't think I will have the time — at least before the week-end. You may find something on this forum or over YT however.

Thanks again for your answer! Anyway I bought a 5d Mark III today, I've found quite an occasion! Around 10k shutter actuations, not even a small scratch, for 550€! Not bad at all! I'll receive it next tuesday and I can't wait to try it!

By the way this camera has a firmware version 1.2.1, should I upgrade it to some particular version before installing Magic Lantern? And why on Danne's repository there are two distinct builds?
Title: Re: Danne's crop_rec_4k, 5DIII
Post by: Danne on February 15, 2023, 09:47:35 PM
Firmware 1.1.3 is better regarding raw. More overhead.
Title: Re: Danne's crop_rec_4k, 5DIII
Post by: vastunghia on February 15, 2023, 09:54:41 PM
Welcome to the 5D3 club! 8)

You'll want to upgrade to 1.2.3. Or, you may downgrade to 1.1.3. In a nutshell, 1.1.3 has (a very few) more ML features enabled than 1.2.3; but 1.2.3 has clean (i.e. no overlays) HDMI out.

This is all well documented in the ML wiki. Pretty sure Walter will step in anytime soon rebuking you for not having a look before posting :P
Title: Re: Danne's crop_rec_4k, 5DIII
Post by: vastunghia on February 15, 2023, 09:56:30 PM
Quote from: Danne on February 15, 2023, 09:47:35 PM
Firmware 1.1.3 is better regarding raw. More overhead.

That was my expectation when I had to switch permanently to 1.2.3 for clean HDMI. However, in my tests I lost maybe 1% of write speed, not much more. Not sure my test were 100% accurate of course.

Would you be expecting a higher difference? Or did you test it thoroughly?
Title: Re: Danne's crop_rec_4k, 5DIII
Post by: Danne on February 15, 2023, 10:54:35 PM
Not really tested personaly and maybe as you say not that big difference nowadays.
Title: Re: Danne's crop_rec_4k, 5DIII
Post by: vastunghia on February 15, 2023, 11:02:03 PM
Yeah, anyway @Mattia, the rule is: if you don't need HDMI, go for 1.1.3. Look for downgrade instructions.
Title: Re: Danne's crop_rec_4k, 5DIII
Post by: Mattia on February 15, 2023, 11:28:27 PM
Quote from: vastunghia on February 15, 2023, 11:02:03 PM
Yeah, anyway @Mattia, the rule is: if you don't need HDMI, go for 1.1.3. Look for downgrade instructions.

Yes, 1.1.3 version is the best option for now since I don't have an external monitor. I've already downloaded the Canon firmware and watched a video about downgrade, it's pretty simple.
Grazie ancora! ;)
Title: Re: Danne's crop_rec_4k, 5DIII
Post by: walter_F on February 15, 2023, 11:57:00 PM
hello everyone, like mattia i bought a 5d mark iii, actually i got it today and i have already tried danne's release with anamorphic at 5.7k. I use a 64gb cf komputer bay 1066x and a 128gb lexar 1667x sd. the quality of the files is exceptional... i wanted to thank danne and everyone for the valuable advice i found on the forum. given my inexperience in video with ml, until now I had only used it for photography with a 6D, I didn't know if there were any differences in writing speed by installing the release in the cf compared to the sd. where did you install it? in any case I did some tests and I got more or less the same speeds for a total of 153mbps with memory overclock at 240hz regardless of whether ml was on cf or sd. In ogni caso, ciao Mattia! Fa piacere ritrovare qualche italiano anche qui!
Title: Re: Danne's crop_rec_4k, 5DIII
Post by: Mattia on February 16, 2023, 10:13:06 AM
Quote from: walter_F on February 15, 2023, 11:57:00 PM
hello everyone, like mattia i bought a 5d mark iii, actually i got it today and i have already tried danne's release with anamorphic at 5.7k. I use a 64gb cf komputer bay 1066x and a 128gb lexar 1667x sd. the quality of the files is exceptional... i wanted to thank danne and everyone for the valuable advice i found on the forum. given my inexperience in video with ml, until now I had only used it for photography with a 6D, I didn't know if there were any differences in writing speed by installing the release in the cf compared to the sd. where did you install it? in any case I did some tests and I got more or less the same speeds for a total of 153mbps with memory overclock at 240hz regardless of whether ml was on cf or sd. In ogni caso, ciao Mattia! Fa piacere ritrovare qualche italiano anche qui!

È sempre bello! Dovremmo fare un thread tipo "Magic Lantern Italy"! Hahahah

Anyway.. I was just asking myself which are the best (and the fastest) sd and cf models for the 5d mark III.. Are there some "official" Magic Lantern suggested models?
Title: Re: Danne's crop_rec_4k, 5DIII
Post by: Danne on February 16, 2023, 10:44:46 AM
My build runs bilals sd_uhs code. 240Mhz. Don't get any faster than that.
Title: Re: Danne's crop_rec_4k, 5DIII
Post by: walter_F on February 16, 2023, 11:09:50 AM
Yes of course I'll keep it on these frequencies, also because for now I haven't had any problems with the few tests I've done. I have a question for you Danne. I bought the 5dmkiii both to shoot from the ground, but I would like to test it on a fpv cinelifter. It is somehow possible
extract gyroscope data for a stabilization of the footage in post?
Title: Re: Danne's crop_rec_4k, 5DIII
Post by: Walter Schulz on February 16, 2023, 11:57:46 AM
Stabilization in post -> reducing resolution.
If it is high frequency shake/vibration you may end with unusable footage. I have some unrecoverable footage from some GoPro mounted to a motorcycle and in the wrong place.
Best add stabilization to gear and as little as possible (or none at all) in post.
Title: Re: Danne's crop_rec_4k, 5DIII
Post by: walter_F on February 16, 2023, 12:31:23 PM
yes surely there is a minimum of degradation, you always have to find the right compromise, in the air every gram you save means flying more time and with greater safety, surely the best solution would be an rs3 or something like that. I have been stabilizing gopro footage for years and now we have achieved excellent results with gyroflow, as well as with cameras such as blackmagic or red
Title: Re: Danne's crop_rec_4k, 5DIII
Post by: Walter Schulz on February 16, 2023, 12:42:12 PM
Old discussions: https://www.magiclantern.fm/forum/index.php?topic=18473.0
Title: Re: Danne's crop_rec_4k, 5DIII
Post by: Mattia on February 17, 2023, 09:59:07 AM
Any advice for the SD and CF cards to use with the 5d Mark III? Which model is better to work with Magic Lantern?
Title: Re: Danne's crop_rec_4k, 5DIII
Post by: vastunghia on February 17, 2023, 10:13:31 AM
Quote from: Mattia on February 17, 2023, 09:59:07 AM
Any advice for the SD and CF cards to use with the 5d Mark III? Which model is better to work with Magic Lantern?

I have these...

Quote from: vastunghia on February 14, 2023, 07:34:05 PM
SD: SanDisk 128 GB Extreme PRO 95 MB/s, Class 10, U3, V30
CF: Lexar 256GB 1066x 160 MB/s UDMA 7 VPG-65

With these, I get almost 150 MB/s...

Quote from: vastunghia on September 09, 2022, 04:37:30 PM

  • 153.8 MB/s (with unitary prefixes, i.e. 1000 Bytes per kB etc)
  • 146.7 MB/s (with binary prefixes, i.e. 1024 convention)

Beat that 8)
Title: Re: Danne's crop_rec_4k, 5DIII
Post by: Walter Schulz on February 17, 2023, 10:26:43 AM
For SD: Any UHS-I labeled W90 or higher. Exception: Kingston Canvas.
CF: Looks like a very fast card draws a higher load thus reducing combined storage. The jury is still out about this. We need more real life data.
See https://www.magiclantern.fm/forum/index.php?topic=26641.msg240244#msg240244
If your takes are shorter than 20 minutes I would not care about this and go for a Komputerbay 1066x 128 GB.
Title: Re: Danne's crop_rec_4k, 5DIII
Post by: Mattia on February 21, 2023, 03:46:26 PM
I have a 256gb Samsung Pro Plus (160mbps in writing) SD card which I was using on my previous system, a Canon Eos M, and which now I intend to use on my 5d3. Which CF card do you suggest to use with this specific SD?
Title: Re: Danne's crop_rec_4k, 5DIII
Post by: Walter Schulz on February 21, 2023, 03:54:16 PM
Answered. And your Samsung is labeled R160/W130, not W160.
Title: Re: Danne's crop_rec_4k, 5DIII
Post by: Mattia on February 21, 2023, 04:42:52 PM
Quote from: Walter Schulz on February 21, 2023, 03:54:16 PM
Answered. And your Samsung is labeled R160/W130, not W160.

Yes, I confused read and write speeds, sorry..

I have a problem with a bad pixel. It gets eliminated with "auto" bad pixels fix but are there some bad pixels maps for the 5d3? Or how can I create one?
Title: Re: Danne's crop_rec_4k, 5DIII
Post by: Mattia on February 21, 2023, 05:25:04 PM
Quote from: Mattia on February 21, 2023, 04:42:52 PM
Yes, I confused read and write speeds, sorry..

I have a problem with a bad pixel. It gets eliminated with "auto" bad pixels fix but are there some bad pixels maps for the 5d3? Or how can I create one?

Nevermind, I've found out how to do it
Title: Re: Danne's crop_rec_4k, 5DIII
Post by: Mattia on February 21, 2023, 05:53:06 PM
Maybe a silly question: why I do not have the "Card Spanning" option? Is it because I don't have a CF card or the latest Danne build is just like that?
Title: Re: Danne's crop_rec_4k, 5DIII
Post by: dpjpandone on February 21, 2023, 07:02:56 PM
If you don't have two cards in the camera there can be no spanning
Title: Re: Danne's crop_rec_4k, 5DIII
Post by: Mattia on February 21, 2023, 07:40:47 PM
Quote from: dpjpandone on February 21, 2023, 07:02:56 PM
If you don't have two cards in the camera there can be no spanning

Sure but I was expecting a greyed out "spanning" option but there isn't in the menu
Title: Re: Danne's crop_rec_4k, 5DIII
Post by: Mattia on February 22, 2023, 08:33:42 PM
So, today I had some time to test my "new" 5d3, let's start saying that I'm very much pleased with the quality and the responsiveness of the camera. I only have one question. Everytime I selected any one of the non compressed bit depths in the raw sub menu the liveview froze and I could record only 1 or 2 seconds before the camera stopped. This behaviour happened even with sound recording turned off and every hack and sd overclock turned on, and it was the same with 10, 12 or 14 bit. The "lossless" bith depths, instead, they worked flawlessly and the liveview is very fast even at 3.5k. So, my question is: are my cards too slow for the non compressed bit depths or is it just like that at this development stage?

My cards:
SD: Samsung Pro Plus 256Gb
https://www.amazon.it/Samsung-PRO-Plus-memoria-MB-SD64K/dp/B09D3NFL5X/ref=mp_s_a_1_4?crid=2O3OA0IVD6FBJ&keywords=samsung%2Bpro%2Bplus&qid=1677094276&sprefix=Samsung%2Bpro%2B%2Caps%2C203&sr=8-4&th=1&psc=1
CF: Lexar Professional 1066x 64Gb
https://www.amazon.it/Lexar-Professional-Scheda-Compact-Velocit%C3%A0/dp/B00ICD3WNY/ref=mp_s_a_1_3?crid=PXM1UWDMOWO&keywords=compact+flash+lexar+professional&qid=1677094367&sprefix=lexar+professional+compact%2Caps%2C190&sr=8-3

Yes, "Card Spanning" was always on in every test.


Title: Re: Danne's crop_rec_4k, 5DIII
Post by: Walter Schulz on February 22, 2023, 08:36:17 PM
Bottom lines of movie screen should tell you required bandwidth.
Title: Re: Danne's crop_rec_4k, 5DIII
Post by: Mattia on February 22, 2023, 09:07:15 PM
 :-[
Quote from: Walter Schulz on February 22, 2023, 08:36:17 PM
Bottom lines of movie screen should tell you required bandwidth.

Of course they do, I just wanted to know what's the experience of someone with cards faster than mine, if he/she can record with uncompressed bit depths and if his/her liveview works.
Title: Re: Danne's crop_rec_4k, 5DIII
Post by: Mattia on February 23, 2023, 01:36:28 AM
Question for Vastunghia: are the 3.5k liveview and the external monitor image the same or the monitor is even more cropped? What monitor are you using?
Title: Re: Danne's crop_rec_4k, 5DIII
Post by: vastunghia on February 23, 2023, 02:02:49 PM
Quote from: Mattia on February 23, 2023, 01:36:28 AM
Question for Vastunghia: are the 3.5k liveview and the external monitor image the same or the monitor is even more cropped? What monitor are you using?

Monitor view @3.5k = Real Time LV on LCD screen (which is heavily cropped). DJI RavenEye (with DJI RSC 2).

Ciao
Title: Re: Danne's crop_rec_4k, 5DIII
Post by: motionSOUL on April 07, 2023, 06:56:28 PM
Just to be sure, there is no way to get a frame preview on an external monitor in crop mode, right?
Thanks,

S/.
Title: Re: Danne's crop_rec_4k, 5DIII
Post by: vastunghia on April 07, 2023, 11:27:57 PM
Right.
Title: Re: Danne's crop_rec_4k, 5DIII
Post by: togg on April 30, 2023, 07:29:39 AM
I wanted to ask, is this version more stable than the last 2018Jul22 croprec build? Particularly regarding bad frames and such.
Title: Re: Danne's crop_rec_4k, 5DIII
Post by: dtr on June 04, 2023, 03:33:04 AM
I am sure i have missed something obvious but how do you get rid of that annoying crop mode x10 halfshutter "aid" from getting in the way whenever I am about to take an image?
Title: Re: Danne's crop_rec_4k, 5DIII
Post by: Danne on June 04, 2023, 11:57:05 AM
Enter the crop rec sub menu. Pr the menu at the top, can't remember exactly atm.
Title: Re: Danne's crop_rec_4k, 5DIII
Post by: Ben_R on June 24, 2023, 11:01:33 PM
Hi Danne and guys!
Some questions about the build:
Im filming with a (real) anamorphic 2x lense, so i got some "strange" requirements:
Centered crop mode is most important to me, since i get vignetting. Is the 3,3k 1:1 x5 centered? the 3,5k preset got "centered" in the name, but i dont really like it since it gives me a way lower vertical resolution.
Also the 3k 1:1 mode gives me the highest vertical resolution (1920 instead of 1836) but square pixel preview is broken, so i cant use the 5x or 10x zoom while filming as a "realtime" focus hack..
any ideas which pre set / maybe even different build would give me the best of all those requirements?
(looking for the highest vertical resolution in a centered crop with the option to use the 5x or 10x zoom while filming)
also i got a question about the 14 bit lossless format: since it says iso <100 recommended: how do i need to understand that? whats the matter with isos over 100?
how does it compare to the 12bit uncompressed?

Thanks for your help!
Best
Ben
Title: Re: Danne's crop_rec_4k, 5DIII
Post by: HugoMouteira on August 26, 2023, 01:16:20 PM
Question: And sorry if it was already answered. Is sandisk extreme pro 170MB/S and Komputerbay 1055x mandatory for the most effective card spanning i.e. for 5.7k? Because there's a sandisk extreme pro 200MB/S and I cant find any komputerbay 1055x online.

Best regards my dear friends!
Title: Re: Danne's crop_rec_4k, 5DIII
Post by: Walter Schulz on August 26, 2023, 01:21:48 PM
Not mandatory at all.
And I think you refer to 1066x. There are no 1055x cards.
I think Sandisk Extreme Pro are overpriced. I prefer Samsung EVO Plus 256 GB.

There is a hint slightly slower CF cards result in more balanced write distribution. Not enough data for final word.
https://www.magiclantern.fm/forum/index.php?topic=26641.msg240244#msg240244
Title: Re: Danne's crop_rec_4k, 5DIII
Post by: Danne on August 26, 2023, 02:55:53 PM
That could be true. Means a more basic CF and SD card combo might do better or as good as more expensive cards.
At least a sufficient with cheaper sd card if used with a fast cf card.
Title: Re: Danne's crop_rec_4k, 5DIII
Post by: HugoMouteira on August 26, 2023, 03:27:46 PM
Quote from: Danne on August 26, 2023, 02:55:53 PM
That could be true. Means a more basic CF and SD card combo might do better or as good as more expensive cards.
At least a sufficient with cheaper sd card if used with a fast cf card.

Thats sad. Sandisk extreme pro sd 200MB/S are cheaper than the 170MB/S on amazon theses days  :(
Title: Re: Danne's crop_rec_4k, 5DIII
Post by: HugoMouteira on August 26, 2023, 03:32:09 PM
Quote from: Walter Schulz on August 26, 2023, 01:21:48 PM
Not mandatory at all.
And I think you refer to 1066x. There are no 1055x cards.
I think Sandisk Extreme Pro are overpriced. I prefer Samsung EVO Plus 256 GB.

There is a hint slightly slower CF cards result in more balanced write distribution. Not enough data for final word.
https://www.magiclantern.fm/forum/index.php?topic=26641.msg240244#msg240244

So you adapt your samsung evoplus microsd qith the adapter. May I ask what is your CF card? And do you reach good writing speed?
Title: Re: Danne's crop_rec_4k, 5DIII
Post by: dxotic on September 20, 2023, 09:16:15 AM
Hi good people,

I have been a long time user of Magic Lantern, but haven't used it for awhile and downloaded crop_rec_4k_mlv_snd_isogain_1x3_presets_2023Feb03.5D3113.zip for my 5D3 and then upgraded my 1.1.3 and noticed that my modules isn't loading,  I do see that the modules loaded :
adtg_gui.mo
bench.mo

but none of the others have loaded. Any clues what could be wrong? I have low level formatted the Sandisk Extreme Pro 32G SD card and cleared all camera settings but as of yet am not able to get it going...

I have used the latest stable version but nothing newer than that.

I had a look at the issues and there was nothing about the modules not loading  i could find. TIA
Title: Re: Danne's crop_rec_4k, 5DIII
Post by: Walter Schulz on September 20, 2023, 10:45:50 AM
Delete autoexec.bin, ML folder.
Copy extracted build content to card.

Retry.
Title: Re: Danne's crop_rec_4k, 5DIII
Post by: dxotic on September 21, 2023, 08:44:57 AM
Hi,
Just an update:
I tried copying it again that didn't work, but what actually helped was reformatting slow on the PC then putting the files back on it and then it would work.
I noticed when i did format the card in the camera I was still left with the ML/SETTINGS/MAGIC.CFG file which wasnt erased so I thought i do a low level format on the PC.

So for card spanning , it's best to format it as an EXFAT for both the cards right? Apologies if this has been answered somewhere else as I havent been keeping up and want to try the anamorphic with the lenses I have and Danne's Build TIA
Title: Re: Danne's crop_rec_4k, 5DIII
Post by: a.sintes on September 21, 2023, 10:09:23 AM
yep, exFAT for both cards.

Note also you may want to download the recently updated Danne's 5D3 packages (https://bitbucket.org/silentbreed/magic-lantern_asintes_git/downloads/), including an ultrafast framed preview (https://www.magiclantern.fm/forum/index.php?topic=26998.msg244918#msg244918) mode.
Title: Re: Danne's crop_rec_4k, 5DIII
Post by: vastunghia on September 21, 2023, 12:22:26 PM
Quote from: dxotic on September 21, 2023, 08:44:57 AM
I noticed when i did format the card in the camera I was still left with the ML/SETTINGS/MAGIC.CFG file which wasnt erased

How come? Always formatted in cam and never happened anything like this to me.

I actually thought that it was better to format in cam than on pc.

Any universally agreed guideline on this?
Title: Re: Danne's crop_rec_4k, 5DIII
Post by: Walter Schulz on September 21, 2023, 01:08:17 PM
1) ML active, using default format option = keep ML
- ML will copy autoexec.bin, ML-SETUP.FIR and ML dir (with all content, including ROM dump) into memory. Additionally files needed for Toshiba Flashair firmware are stored, too.
Cam will format card, applying file system, create DCIM and MISC. ML will re-enable boot option flags for card and copy all content back to card.

2) ML active, having Q pressed in format menu = delete ML
- Cam will format card, removing card's boot option settings. Cam will create DCIM and MISC after creating file system.
For some reasons unknown to me ML/SETTINGS will be preserved.
Title: Re: Danne's crop_rec_4k, 5DIII
Post by: dxotic on September 25, 2023, 02:58:41 PM
I have tried with two Sandisk Extreme Pro 32Gb and 64Gb  SD cards and for the life of me can't see the other modules than the  adtg_gui.mo , bench.mo , cinemato.mo  on the back of the camera. Ive loaded up the latest Danne crop rec 4k build as well as a.sintes ultrafast preview build.
having said that even though I cant see the other modules I have successfully shot RAW at 1880x 2268
As Ive only come back to Magic lantern after a few years I have no idea what other procedures I am missing. I check my cards write and read speeds with Blackmagic Raw Speed test and consistently getting 80mb Write and 85mb Reads

Could someone kindly point out what I can do to make this work better or should I try and older build. Looking forward to learning more
Title: Re: Danne's crop_rec_4k, 5DIII
Post by: andy kh on September 25, 2023, 04:51:24 PM
Quote from: dxotic on September 25, 2023, 02:58:41 PM
I have tried with two Sandisk Extreme Pro 32Gb and 64Gb  SD cards and for the life of me can't see the other modules than the  adtg_gui.mo , bench.mo , cinemato.mo  on the back of the camera. Ive loaded up the latest Danne crop rec 4k build as well as a.sintes ultrafast preview build.
having said that even though I cant see the other modules I have successfully shot RAW at 1880x 2268
As Ive only come back to Magic lantern after a few years I have no idea what other procedures I am missing. I check my cards write and read speeds with Blackmagic Raw Speed test and consistently getting 80mb Write and 85mb Reads

Could someone kindly point out what I can do to make this work better or should I try and older build. Looking forward to learning more

make a video and share
Title: Re: Danne's crop_rec_4k, 5DIII
Post by: a.sintes on September 25, 2023, 05:47:52 PM
@dxotic: just checked and I've got the same result with only two visible modules (adtg_gui & bench, three with cinemato), anyway notes the "content" of other modules (ettr, lua...) are already embedded in regular Danne's build ML menus (e.g.: you have a dedicated "script" tab for LUA, ettr is in the Video menu etc.).
Title: Re: Danne's crop_rec_4k, 5DIII
Post by: dxotic on September 25, 2023, 06:53:52 PM
@a.sintes Good to know I'm not the only one, I can't tell whether it has been loaded or not or are they all loaded? I mean I can record and play but  also noticed that my camera shuts down after a while is there a setting that i need to turn off or is there something wrong and then it says that the cam shut down improperly and it hasn't loaded the modules, so I have to shut it down and restart it for it to work plus with your build i get an occasional error with the crop marks not loading.

@ Kh I will embed a video tomorrow showing it. It's midnight here right now
Title: Re: Danne's crop_rec_4k, 5DIII
Post by: kizza1234 on October 04, 2023, 02:14:37 PM
Hi guys, avid user of Magic lantern, and recently got some EF anamorphic lenses.
Anybody know if its possible to get a 6:5, 3:2 or 4:3 image with the 3x3 sampling method?

After some extensive tests using this build, I am finding using this 3x3 sampling method combined with Dual ISO removes most if not all visable aliasing.
Because of this, Im keen to see if the method could be used to create a 6:5, 3:2 or 4:3 output instead of the current 16:9, 2.35:1 and 2.39:1 options.


Any thoughts, would be very much appreciated!
Title: Re: Danne's crop_rec_4k, 5DIII
Post by: tweak on December 03, 2023, 02:41:12 PM
Quote from: kizza1234 on October 04, 2023, 02:14:37 PM
Hi guys, avid user of Magic lantern, and recently got some EF anamorphic lenses.
Anybody know if its possible to get a 6:5, 3:2 or 4:3 image with the 3x3 sampling method?

After some extensive tests using this build, I am finding using this 3x3 sampling method combined with Dual ISO removes most if not all visable aliasing.
Because of this, Im keen to see if the method could be used to create a 6:5, 3:2 or 4:3 output instead of the current 16:9, 2.35:1 and 2.39:1 options.


Any thoughts, would be very much appreciated!

It's pretty simple to get other ratios. Make sure you turn the ratio off in the main menu, then go into the raw menu and select the ratio you want, afterwards scroll through the numbers with the jog wheel until you get to the actual numbers you want.
Title: Re: Danne's crop_rec_4k, 5DIII
Post by: Skinny on December 04, 2023, 03:45:27 PM
I can't say for 5D3 but I have used anamorphic lenses with 5D2 in 3x3 mode. And in any builds that I have tried you can select whatever you want, full sensor area (2:3), 3:4 or anything else. So at least in standard builds I think it should be possible for 5D3. 3x3 requires less speed so you don't really need to overclock or do anything specific.
And I also found that with 2x anamorphic lenses you get a lot less aliasing, it works almost like an anti-aliasing filter. So 3x3 mode is perfectly useable.
Title: Re: Danne's crop_rec_4k, 5DIII
Post by: ThePotatoParadox on December 15, 2023, 07:55:22 PM
About to buy a SanDisk Extreme Pro 160 MB/s VPG-65 UDMA 7 CF card because it's very cheap second hand. Will this work for 5.7K continuous? I have the appropriate SD card for card spanning.

Sorry if this has been asked before.
Title: Re: Danne's crop_rec_4k, 5DIII
Post by: Danne on December 16, 2023, 09:44:35 AM
If the card can do write speeds around 120Mb/sit should be working.
Been a while since I ran 5.7k but my presets were made to run continuous at 24/25 fps.
Title: Re: Danne's crop_rec_4k, 5DIII
Post by: ThePotatoParadox on December 16, 2023, 10:50:30 AM
Quote from: Danne on December 16, 2023, 09:44:35 AM
If the card can do write speeds around 120Mb/sit should be working.
Been a while since I ran 5.7k but my presets were made to run continuous at 24/25 fps.

Thank you, Danne.
Title: Re: Danne's crop_rec_4k, 5DIII
Post by: adamszulc on February 18, 2024, 04:24:50 PM
Hi, I bought 5Dmk3 for RAW video.

I have problem.

I installed ML and it works fine, but in canon format menu I dont have option for KEEP ML. What am I doing wrong?

Could you help?
Title: Re: Danne's crop_rec_4k, 5DIII
Post by: fanfzero on February 21, 2024, 09:05:55 PM
Some tests I did, both are a mix of shots in 5,7 anamorphic and 3k, those were the first 2 times I used my new 5d MKiii (I had experience with Magic Lantern with an EOS M)

This is the extremely low light test (Iso 6400), unfortunatelly I wanted to have it ready as soon as posible, so I think I could have done a better job on Davinci, it was denoised and stabilized afterwards in Topaz video ai


And this is a test with good light (around iso 200), I really like the result on this one, no Topaz video AI on this one


Now I guess I'll have to practice manual focus for moving shots, if this camera had continuous autofocus and in body stabilization like my Panasonic Lumix G80 it would be the perfect camera, still I think it has better image quality than the Lumix

Btw, is there any way that autofocus doesn't increase exposure when focusing?

Title: Re: Danne's crop_rec_4k, 5DIII
Post by: PaulHarwood856 on February 22, 2024, 04:18:10 AM
Hey fanfzero,

   I can't view the videos you have in your post...

- Paul
Title: Re: Danne's crop_rec_4k, 5DIII
Post by: whitelight on February 23, 2024, 12:47:04 AM
Quote from: PaulHarwood856 on February 22, 2024, 04:18:10 AMHey fanfzero,

  I can't view the videos you have in your post...

- Paul

Same
Title: Re: Danne's crop_rec_4k, 5DIII
Post by: Promet73 on February 26, 2024, 04:13:57 PM
Hi all, I've been using ML on EOS M for about a year with great joy and results, so I have recently purchased a top mint 5D III for using it with ML. 
I have installed the latest Danne's build but I can't get any LV at all, either black screen or random patches of pixels. What am I doing wrong?

Title: Re: Danne's crop_rec_4k, 5DIII
Post by: Walter Schulz on February 26, 2024, 04:24:12 PM
Please specify. Garbled LV during recording or in idle, too?

See first post of this thread for basic build infos and restrictions applying.
Title: Re: Danne's crop_rec_4k, 5DIII
Post by: fanfzero on March 14, 2024, 06:52:55 AM
Quote from: PaulHarwood856 on February 22, 2024, 04:18:10 AMHey fanfzero,

   I can't view the videos you have in your post...

- Paul

Quote from: whitelight on February 23, 2024, 12:47:04 AMSame

Strange, will try again without embedding

Video 1
https://youtu.be/vUt4NBPzruM?feature=shared

Video 2
https://youtu.be/UyjhyJ8UIe0?feature=shared
Title: Re: Danne's crop_rec_4k, 5DIII
Post by: Walter Schulz on March 14, 2024, 07:37:38 AM
use

[youtube]https://youtu.be/vUt4NBPzruM[/youtube]
not
[youtube]https://youtu.be/vUt4NBPzruM?feature=shared[/youtube]