Magic Lantern Forum

Experimental builds (WIP) => crop_rec and derived builds => Topic started by: Danne on December 03, 2018, 06:10:17 PM

Title: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on December 03, 2018, 06:10:17 PM
Latest:
https://bitbucket.org/Dannephoto/magic-lantern_jip_hop_git/downloads/

Source code here atm(temp git solution):
https://bitbucket.org/Dannephoto/magic-lantern_jip_hop_git/src/master/

Todo:
https://www.magiclantern.fm/forum/index.php?topic=9741.msg229863#msg229863


branch:
https://bitbucket.org/Dannephoto/magic-lantern_jip-hop/branch/crop_rec_4k_mlv_snd_raw_only

Been working hard with Jip-Hop to refine presets and all around movie handling approaching the eosm more like a movie cam. Some of the things done recently:

- reworked Movie tab menu(Jip-Hop)
- fast preset access by simply tapping display
- corruption free 4k anamorphic modes(slightly reduced height in raw.c)
- shutter coherency. Same shutter across all presets(fixed a bug introduced by myself)
- Movie Restart for raw recordings(Jip-Hop)
- autoenabling modules(refined by Jip-Hop)
- gain buttons up for higher iso. push down for lower iso, also working while recording
- aperture + ISO(up/down buttons will open or close aperture when max/min iso is reached)(Jip-Hop)
- h264 mov preset, working with x3 digital gain(SET button) and gain buttons(up/down)
- toggling between photo and movie mode working better

Upon install buttons will be reassigned as follows:
SET x3 crop and back to x1.6 mode
Up/Down gain increasing/decreasing(iso)
Tap display startoff preset list
Halfshutter press x10 zoom aid(release for normal view)

For newcomers and for people who just wants to get down to recording do following:
1 - Install above build onto your eosm and start film. Camera will be set to mv1080p 2.39:1 24 fps
Or...
2 - Set your camera into manual focus mode and tap your display to get into the fast access preset list:

Select a preset after tapping your display. Done!:
(https://www.magiclantern.fm/forum/proxy.php?request=https%3A%2F%2Fi.postimg.cc%2FL5FQVqF8%2FVRAM0-PPM-500px.png&hash=0de1c2f6a5e9aa0d3cdf7f42d16941d4)

Reworked Movie tab menu(thanks Jip-Hop):
(https://www.magiclantern.fm/forum/proxy.php?request=https%3A%2F%2Fi.postimg.cc%2FX7CYSJHj%2FVRAM0-PPM-scaled.png&hash=82fa339ac00713318222c74f3be5b611)

Movie Restart feature(thanks Jip-Hop)
(https://www.magiclantern.fm/forum/proxy.php?request=https%3A%2F%2Fi.postimg.cc%2FkgNMGHPL%2FVRAM2-PPM-scaled.png&hash=06d5f8854de927ed284ac23371c3d315)

customize buttons:
(https://www.magiclantern.fm/forum/proxy.php?request=https%3A%2F%2Fi.postimg.cc%2FcJXsM8Hm%2FVRAM7-PPM-scaled.png&hash=414429e104eac0bc091d865ca4cce127)

h264 mov. Select it from tap display options:
(https://www.magiclantern.fm/forum/proxy.php?request=https%3A%2F%2Fi.postimg.cc%2FYjKkq6np%2FVRAM6-PPM-scaled.png&hash=83731acc3d7f78ab3822094732bfad10)

Missing 3K, 4K? Still there. Reach them by tapping "presets" from Movie tab section:
(https://www.magiclantern.fm/forum/proxy.php?request=https%3A%2F%2Fi.postimg.cc%2FFK9rLx9z%2FVRAM4-PPM-scaled.png&hash=f40a0373032a2a06d477bc86e7718ca5)

cine 2.39:1 script still there(refined by Jip-Hop)
(https://www.magiclantern.fm/forum/proxy.php?request=https%3A%2F%2Fi.postimg.cc%2F4yhsgL1L%2FVRAM9-PPM-scaled.png&hash=83af6ab60b8abf28b11c4749e0891551)















OLDER STUFF BELOW. NOT SUPPORTED ANY LONGER


branch:
https://bitbucket.org/Dannephoto/magic-lantern/branch/crop_rec_4k_mlv_snd_isogain_1x3_presets

I focused on getting rid of corrupted images in 5K anamorphic mode. And also to complete a set up that will record all the presets continuously when a certain set up is performed. To enable continuous recordings do following:
sd_uhs hack on
bitrate to 10bit
ratios set to 2.35:1
(will scale down or reduce bitrate depending on preset chosen)

For instance. 5K anamorphic 1736x2150 will be set to 1504x1920 when ratios 2.35:1 is set. Still a stellar file since upsampled in Mlv App you will export a file that´s 4512x1920 in size.
3k will run with reduced fps and so will 5k setting. Most other presets will still keep original frame rate. All presets will record with 2.35:1.
If you want full manual control just skip the 2.35:1 ratios setting and do whatever tweaks in other menus instead.

Enjoy and don´t forget to post what´s working or not…

(https://www.magiclantern.fm/forum/proxy.php?request=https%3A%2F%2Fi.postimg.cc%2F5NhvwVGV%2FVRAM0-PPM-scaled.png&hash=b4ace966cdfc9bac92ac6de93529cd5b)

(https://www.magiclantern.fm/forum/proxy.php?request=https%3A%2F%2Fi.postimg.cc%2FHs1Jnxbb%2FVRAM1-PPM-scaled.png&hash=1ed76374fc8c14c58db5e7260b9cf193)

(https://www.magiclantern.fm/forum/proxy.php?request=https%3A%2F%2Fi.postimg.cc%2FT2DLTm5R%2FVRAM2-PPM-scaled.png&hash=69736f2112223e1b8f311b245c487d07)




From here:
https://www.magiclantern.fm/forum/index.php?topic=9741.msg211572#msg211572

- Cleaned out scripts, kept two. One is new. "eosm cinema 2:35.1". The script will through lua add all necessary parameters to get into anamorphic 4.5K preset. Once the script has finished you can use any of the crop rec presets and they will all run in 2:35.1 and continuous. A fast sd card will be needed. The script also enables the sd_uhs script "sd overclock engine" and sets it to auto. The script is good as starting point instead of fiddling around for 10 minutes before getting into filming.
Why 2:35.1? Easy. Eosm has it´s limitations and restriction and this ratio seems like sweet spot for most presets on this cam.

(https://www.magiclantern.fm/forum/proxy.php?request=https%3A%2F%2Fi.postimg.cc%2FcChG6s3Y%2FVRAM0-PPM-scaled.png&hash=a6dad97b582d2b9231cfc4c7fc596ee4)

- The other feature(also added though "eosm cinema 2:35.1" script) is "Crop rec preview" in mlv_lite menu. Once this is set to auto mode The crop rec presets will work either with framing or real time preview depending on what works better. Reason for this is that it takes a little too long to switch both preset and preview mode for every preset changed. Watch out. This auto mode setting overrides any Preview mode setting aready set from before. Disable auto mode when not in use.
All modes and settings can of course be set manually without the scripts.

(https://www.magiclantern.fm/forum/proxy.php?request=https%3A%2F%2Fi.postimg.cc%2FwMgd6t1g%2FVRAM1-PPM-scaled.png&hash=b48fc51689d345583a81f6162e994458)

Additional stuff:
3xcrop toggle
(https://www.magiclantern.fm/forum/proxy.php?request=https%3A%2F%2Fi.postimg.cc%2FtRh0Z3mw%2FVRAM1-PPM-scaled.png&hash=30dcbbb01395339f893161b1a5d51bfa)


All of this is of course experimental, bleeding edge and out here for tests and feedback. As always thanks to a1ex, g3gg0, dmilligan for code and lua api.

A lot of tutorials from this guy and eos m enthusiast:
https://www.youtube.com/channel/UCCn0RQHYheA41EudwmLnYKA

Also check this thread:
https://www.eoshd.com/comments/topic/28526-5k-raw-24p-video-for-150-magic-lantern-making-great-strides-on-canon-eos-m/#comments


Also check in my work on the 5DIII here:
https://www.magiclantern.fm/forum/index.php?topic=23041.msg216899#msg216899
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: alpicat on December 06, 2018, 03:20:53 AM
@Danne, this build works nicely shooting 2520x1308 in 9 or 10 bit lossless. I can't seem to get rid of the focus pixels using mlvapp, but other than that the image quality is perfect. Liveview looks a bit funny colourwise but it's not particularly distracting and still very usable.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on December 06, 2018, 07:48:59 AM
That is dfort area. Could you share a file in the focus pixel thread or in Mlv app thread so it could be fixed?
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: ctfire on December 06, 2018, 12:08:05 PM
Hey , is there any working ML for eos m with correct mv1080 without crop ?
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on December 06, 2018, 12:35:26 PM
There's no crop with the mv1080p preset.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: ctfire on December 06, 2018, 04:10:19 PM
There's no crop with the mv1080p preset.

And what about live view when recording in this mode?
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on December 06, 2018, 04:29:57 PM
It is what it is. THanks to A1ex we at least have full preview but a bit slow...
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Teamsleepkid on December 07, 2018, 02:42:12 AM
alex is the coolest
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: alpicat on December 08, 2018, 01:13:44 AM
That is dfort area. Could you share a file in the focus pixel thread or in Mlv app thread so it could be fixed?

Will do, I've been trying to get a screengrab that shows all the focus pixels clearly but no success so far, hard to tell the focus pixels apart from the background. I guess if I shoot against a clear sky that might work best.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: dfort on December 08, 2018, 04:57:37 PM
Try shooting simple silent stills with the movie settings at the resolution you want to test. This will save a DNG of the full raw buffer. Shoot light subjects, dark subjects, flat walls, scenes with lots of contrasty details--sometimes focus pixels pop right out and other times they are hard to find. Then again if you can't find them that's the best news of all!
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: bergamote on December 09, 2018, 04:42:02 PM
Just popping by to say Thanks!
I'd tested raw on the eos m ages ago and at first got crazy excited by the image quality. But I ended up sticking to h.264 for filming because of the very limiting crop factor, the headache of setting everything right in ML and I wasn't getting very good results in low lights. All that, added to the extra workflow in post, didn't make it seem worth the effort.
Now, trying out Danne's latest build, I'm crazy excited again! Once I'd cleared my saved ML settings it worked perfectly, just switch on, run sd hack and apply a 2.5k preset and it's all good to go! 2.5k is a lot more workable than 1.4k and with the 800iso preset low light shots aren't as noisy as what I was getting before.

So thanks a million to everybody working on this!

I haven't read all 71 pages of this thread, so the following bug probably isn't specific to this build, but just in case:
After going through the steps I described, filming a shot in raw then reviewing it in-camera, when I switch the camera off it gets stuck at the sensor cleaning stage and never switches off. Pressing any button brings the liveview back but taking the battery out is only way to switch off.

Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on December 09, 2018, 05:22:23 PM
I get the same issue from time to time but hard to reproduce. If you can narrow down the exact steps to reproduce the issue I will try and see wht´s going on.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Tullen on December 09, 2018, 05:42:09 PM
I just got the same results when starting the camera and shutting it down before 2.5k script had finished running. Camera stuck at sensor cleaning, and had to pull battery. But cant reproduce it.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on December 09, 2018, 05:55:04 PM
Ok, so maybe lua script could be related. Let's keep an eye for more occasions.
Also welcome with examples of what's working and what's useful and such.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: alpicat on December 09, 2018, 07:34:53 PM
Try shooting simple silent stills with the movie settings at the resolution you want to test. This will save a DNG of the full raw buffer. Shoot light subjects, dark subjects, flat walls, scenes with lots of contrasty details--sometimes focus pixels pop right out and other times they are hard to find. Then again if you can't find them that's the best news of all!

Thanks - finally got round to doing this and posted the focus pixel photos in the "Dealing with Focus Pixels in raw video" thread. Silent stills mode didn't work in 2.5k crop mode unfortunately - liveview goes black for a while, and all I get is a blank jpg. I just shot some short MLV clips and then extracted PNG files from them in MLVapp, enhanced in post so you can see all the focus pixels.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: bergamote on December 10, 2018, 11:24:33 AM
I've been trying to reproduce the cleaning sensor bug but it's pretty random. Here the few variations i came across:
- with only mlv_lite and mlv_play loaded, switch on and press play to start watching the last raw video then switch off whilst the file is playing. Every time it stays stuck to Cleaning sensor. Pressing the power button brings the camera back on and pressing it again switches it off immediatelly, skipping the cleaning sensor part.
- with snd,  crop_rec and lua also loaded, switch on, run the 2.5k 100iso script, shoot for 3 seconds then after waiting a bit, press the play button. If a bug shows up it can go two ways:
  1) you get a black screen. The orange led blinks as if mlvplay was playing the shot but the screen stays black. Pressing half shutter brings back shooting mode. Pressing play again plays the video without problem and it will not get stuck during Cleaning sensor even if switching off during playback
  2) the raw clip plays fine but when switching off whilst playing it gets stuck. The power button switches between shooting mode and cleaning, but the battery has to be removed.

I managed to get the last type 4 times in a row but then it didn't do it the fifth time. It looked like it happpened more often with the 2.5k100 than the 800 one but that might have been by chance. Also it did happen whilst mlvplay was stopped, and once whilst i was in a ML menu.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on December 10, 2018, 01:13:20 PM
Ok, thanks. I gather one has to go easy on this little cam and wait for processes to finish.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Tullen on December 11, 2018, 12:32:54 AM
@Danne

When using your crop_rec_4k_mlv_snd_isogain_1x3_presets_2018Dec08.EOSM202.zip, the recording sometimes shuts down due to to slow memory write speed. I'm using a Sandisk Extreme Pro 128GB.

- Installed and played around a bit with Magic Lantern.
- Set canon camera to manual film mode. Set the camera to 1080p 24 fps and Pal in canon menu.
- Did a low level format of the memory card in camera.
- Removed the old ML folder from the memory card and extracted the ML folder and the .DS Store, autoexec.bin and ML-SETUP.FIR to the root of the memory card from the crop_rec_4k_mlv_snd_isogain_1x3_presets_2018Dec08.EOSM202.zip (ignoring the MACOSX folder). Safe eject card from memory reader.
- Went into manual fotomode and updated the firmware. When prompted restarted the camera. Set the camera to film mode (manual).
- Opened magic lantern and loaded the crop_rec, lua, mlv_lite, mlv_snd and sd_uhs modules. Restart.
- Set  sd_uhs to autorun. Restart
- Go to movie tab and enable Crop Mode 2.5k 2520x1304 and set to 12 bit in Crop Mode submenu. Set FPS override to 23.976 and optimized for exact fps. Restart
- Go to movie tab and enable RAW, set bit depth to 12 and resolution to 2560 (which sets it to 2520x1308).

If I then try to record, the recording shuts down immediately.

If I put the RAW to 12 bit lossless it can record to up to a minute before stopping. Also, if I set it to 12 bit lossless the display becomes much darker. Gets brighter when I half-press shutter button.

So maybe the sd_uhs is not enough to record in 12 bit or 12 bit lossless at this resolution? If I set the Crop Mode to 10 bit and RAW to 10 bit it also shuts down after a few frames.
Setting the Crop Mode to 10 bit and the RAW to 11...8 bit lossless it seems to record continuously, but then the image is scrambled and of course  I'm still stuck with the dark display.

I'm sure I am doing something wrong, or maybe the dark display thing is a know issue, but I did not find anything when searching this tread so maybe you or others have some tips?

Cheers and thanks for all the amazing work.

EDIT: Seems none of the clips I took work when checking in mlvapp :(. So Im probably in much more trouble than I thought about just the dark image and 10 bit. How did you go about it alpicat?
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on December 11, 2018, 06:08:44 AM
In RAW video keep it on 14bit lossless if you work with crop_rec  module and its settings enabled. You set bitrate from another submenu by tapping the screen while on Crop mode menu(seems that is what you already do):
https://www.magiclantern.fm/forum/index.php?topic=9741.msg208959#msg208959

Also leave fps override alone when using the crop rec presets. might be issues otherwise. Maybe it works with fps override when recording with mv1080p mode set in crop_rec. I will have to check.

EDIT:
Updated a few things and uploaded a new version in this post:
https://www.magiclantern.fm/forum/index.php?topic=9741.msg208959#msg208959
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: loknar on December 11, 2018, 10:44:15 AM
Thanks Danne for the builds. I tried the one from December the 8th and 1x3 preset works very well (even with changed bit rate, 8 bit have shifted white/black level, but others work out of the box), preview is stretched(not a big deal) but is very fluent and also i'm able to shoot very quickly.
Also this is first build with which i successfuly recorded 3072x1304 clip and man, that's beautiful. In this preset though i've no working preview at all (all just rgb patterns) so i can't focus or check composition, is it "standard" or it's just me?
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on December 11, 2018, 11:26:12 AM
Thanks for feedback. 8bit is not really useful but still there for experimenting. About preview in higher resolution you should get ''framing" preview working. It´s slower but shows the correct framing. Real time cropped preview isn´t working with higher resolutions on the eosm. Might work somehow if someone finds a way to implement mode more like the 5D mark III.
Preview in general could be anything in real time but when i 'framing' mode it should show what you will get as a final result.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: loknar on December 11, 2018, 12:09:05 PM
Well, it is in our best interest to provide you with as much information as possible :).
Yeah,  that 8-bit info was pretty much only FYI. I don't intend to use it, 10-bit seem optimal, 9-bit out of desperation :).
I have framing preview now, thanks. I helps to know it can be done, after that it's only trying of possible combinations :).
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Tullen on December 11, 2018, 11:02:17 PM
is there any way to get the "framing" liveview work on an external display? whatever i choose for preview, it's showing "realtime" for hdmi external. by the way, i searched but i couldn't really get 1x3 crop mode, it shows at liveview and records very wide. i can provide footage does it need to be dng or are compressed formats okay? (i'm using mlv app on windows and i'm really grateful to both firmware and software developers.)

I'm also very interested in this. Anyone knows? Would be great to be able to use the monitor and get proper framing. Another option if it works would be to output full frame (without 5x) and have a frammarking on. Even though a lot of the display would not be in use its not as big of an issue on a 7" or 9" monitor.

Any ideas?
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on December 17, 2018, 06:43:40 PM
New upload in this post:
https://www.magiclantern.fm/forum/index.php?topic=9741.msg208959#msg208959

Eosm is equally good as 100D so we can make a 3k 24fps preset just as well for this little cam. New preset contains:
3K 3032x1436 24(fps)

Didn´t test it too much so feedback welcome...
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: optical-work on December 18, 2018, 04:07:09 PM
Should raw_twk be on? When it is turned on I run sd overlock script as usual but it does nothing. memory patches stays the same (1 rom 2 ram). Without raw_twk it loads normally and able to record.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on December 18, 2018, 04:10:40 PM
Probably not from what you are reporting. I have not tested raw_twk with sd_uhs module so if it interferes just turn it off.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Neilaxe on December 18, 2018, 09:11:12 PM
Hello!

New here. I need a bit of advice. I installed one of the experimental ones for the Firmware 2.0.3. After having a bit of play around with the software, I realized that I don't know how to use it is so I formatted the card again on the camera to remove ML in it and use the camera as it was. It did sure remove the ML software however left some issue that  I couldn't fix.

The issue is that the shutter button won't let me take still pictures anymore or let me start recording. (Good thing the dedicated record button is still working.)

I already tried to reinstall the firmware 2.0.3 straight from canon's website but it still did not fix the issue. So at the moment my EOS M can only take videos and not still pictures.

Anybody here who can help and knows how I can get back the shutter function? If not possible, maybe where I can get the firmware version 2.0.2 as download? I'm keen to give ML another try but I want to downgrade the firmware first.

Thank you!
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Teamsleepkid on December 18, 2018, 09:30:19 PM
absolute mad lad! i tried it with tweak on last night seemed to work fine. need to test more though it was absolutely pitch black in my room when i tested so i only saw noise. did seem like there was more pixels in there though. thanks danne
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on December 19, 2018, 10:53:32 AM
More mad stuff  8)

Updated with another crop_rec preset:
mv1080p 1736x976 45fps
https://www.magiclantern.fm/forum/index.php?topic=9741.msg208959#msg208959

Please test it out. tweaked until it seemed corruption free. It should also work to reduce to let´s say 42 fps or lower with fps override.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Teamsleepkid on December 19, 2018, 11:58:33 PM
ok i tried the 3k in daylight and it only recorded for a few seconds before crashing. i put on sd card overclock as well. also i changed white balance and iso.  how to get continuous recording? lots of detail my god. basically looks like film now. holy crap.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Teamsleepkid on December 20, 2018, 12:14:42 AM
somehow managed to record 27 seconds but without preview by turning on and off then on again sd card overclocking. preview goes wonky but continues to record.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on December 21, 2018, 03:51:14 PM
For usabilty sake I added a 2.35:1 preset from within the crop_rec submenu. It will apply to the first four presets in crop_rec menu. Mainly I do this roundtrip because setting the 2.35:1 from regular RAW video menu will crop differently with mv1080p mode.

(https://www.magiclantern.fm/forum/proxy.php?request=https%3A%2F%2Fi.postimg.cc%2F50QJwwQk%2FVRAM0-PPM-scaled.png&hash=dd24e5176978dbe76da8fbf3d4b96670)

(https://www.magiclantern.fm/forum/proxy.php?request=https%3A%2F%2Fi.postimg.cc%2F6Qmw2Hqv%2FVRAM1-PPM-scaled.png&hash=0de916a20d6af65851211b2186331b34)

(https://www.magiclantern.fm/forum/proxy.php?request=https%3A%2F%2Fi.postimg.cc%2FQMthML8D%2FVRAM2-PPM-scaled.png&hash=c5f9a351fd3e258cb200592ba1576272)

Download here:
https://www.magiclantern.fm/forum/index.php?topic=9741.msg208959#msg208959
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: loknar on December 21, 2018, 04:19:49 PM
For usabilty sake I added a 2.35:1 preset from within the crop_rec submenu. It will apply to the first four presets in crop_rec menu. Mainly I do this roundtrip because setting the 2.35:1 from regular RAW video menu will crop differently with mv1080p mode.

Download here:
https://www.magiclantern.fm/forum/index.php?topic=9741.msg208959#msg208959

You are like daily Santa Claus :)

3K with 2.35 aspect works. I'm getting  ~2 seconds with liveview, ~4 seconds without it (card write speed is 58 MB/s with SD overclock).
This mode is my new favourite :).

mv1080@45 fps works too, longer shots than I am willing to wait, I almost hear DualISO in mv1080  knocking.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on December 21, 2018, 04:31:44 PM
Great. A few more sec if you set it to 10bit?
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: loknar on December 21, 2018, 04:38:30 PM
Quick test
(frames)
LV on/LV Off
12-bit 43/64
10-bit  59/85
9-bit  67/100
All usable.

But card used to be a bit faster, maybe i'll try low level format.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: LinX on December 21, 2018, 05:09:16 PM
Hi guys.
I got some trouble. Once i use lossless dataformat no matter in 12bit or 14bit, my clips will corrupt. But in umcompress is fine...
Pictures how it goes downbellow.
And i'm with magiclantern-Nightly.2018Jul03.EOSM202..
(https://www.magiclantern.fm/forum/proxy.php?request=https%3A%2F%2Fi.ibb.co%2Fn1Y01Qn%2FQQ-20181222000742.png&hash=1decfcc31d3447d240aa36e4edf3ba27) (https://ibb.co/n1Y01Qn)

(https://www.magiclantern.fm/forum/proxy.php?request=https%3A%2F%2Fi.ibb.co%2F0yz02DZ%2FQQ-20181222000113.png&hash=4353259be89388d959201364d6ead779) (https://ibb.co/0yz02DZ)
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: ctfire on December 21, 2018, 10:03:09 PM
Hey, is it any chance to get smooth liveview in mv1080 mode at 24p ?
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on December 21, 2018, 10:55:44 PM
Yes, run real-time preview.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: ctfire on December 22, 2018, 12:35:38 PM
Yes, run real-time preview.

And what about framing?
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on December 22, 2018, 01:08:19 PM
What about reading?
https://www.magiclantern.fm/forum/index.php?topic=9741.msg209067#msg209067

Please use search field or read through the eosm thread regarding mv1080p.


Uploaded a new build which will reduce fps to 19 and set 3K preset to 3008x1280 when 2.35:1 preset is used from crop_rec sub menu. Reason: to be able to record continous in this 3k mode and have fast acces to it. If wanting full blown 24 fps simply unset the 2.35:1 preset in sub menu...
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: liuk718 on December 24, 2018, 03:37:07 PM
Hi,Danne,is the 1920x1080 45fps 1x1 crop mode possible?
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: burtie on December 25, 2018, 04:20:37 PM
Hi!
Is it possible to use ML on a Canon EOS M10?
BeEn searching for some time. Thanks for any help.

Burtie
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Blop_da_pop on December 26, 2018, 02:47:34 AM
Hi, I'm new here, but been using my eos m for a few years, but only just updated the firmware, but couldn't find 2.0.2 anywhere, so I updated to 2.0.3. My question is: is it pos. to get a version of Magic Lantern in this firmware, and/or is there a version of 2.0.2 out there I can download? I haven't found either as yet. Cheers folks.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: koenkooi on December 26, 2018, 08:49:47 AM
Hi!
Is it possible to use ML on a Canon EOS M10?
BeEn searching for some time. Thanks for any help.

Burtie

Short answer: No, you can not. The M10 runs powershot firmware, not EOS firmware. The M1, M2 and M50 run an EOS firmware, the M3, M10, M5, M6 and M100 are all powershot based.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: dfort on December 26, 2018, 08:57:03 AM
Is it possible to use ML on a Canon EOS M10?

@koenkooi answered but I'll just add that the M10 is supported on the CHDK (http://chdk.wikia.com/wiki/CHDK) project.

...I updated to 2.0.3. My question is: is it pos. to get a version of Magic Lantern in this firmware, and/or is there a version of 2.0.2 out there I can download?

Yes for both.

I ported ML to the EOSM.203 firmware and test builds are available on my downloads page (https://bitbucket.org/daniel_fort/magic-lantern/downloads/). Also there you can find a package called EOSM Canon Firmware for Testers.zip that contains both Canon 2.0.2 and 2.0.3 firmware updaters.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Padwoof on December 26, 2018, 10:18:51 PM
@koenkooi answered but I'll just add that the M10 is supported on the CHDK (http://chdk.wikia.com/wiki/CHDK) project.

Yes for both.

I ported ML to the EOSM.203 firmware and test builds are available on my downloads page (https://bitbucket.org/daniel_fort/magic-lantern/downloads/). Also there you can find a package called EOSM Canon Firmware for Testers.zip that contains both Canon 2.0.2 and 2.0.3 firmware updaters.

I wonder if you can help me, I'm getting a little lost trying to find an solution to my issue, My father has tasked me with installing Magic Lantern on his older EOS M (he has an M10 and is not concerned if I brick the M in the attempt) and I'm coming across the same issue repeatedly, the M is on Firmware 2.0.3, if I try to rollback the firmware to 2.0.2 the camera won't let me, I can get as far as launching the firmware update program on the camera itself, but after selecting the version that I wish to install (2.0.2) it asks me to confirm the firmware update however the 'ok' option is greyed out and cannot be selected for some reason it seems the ability to rollback the firmware has been locked out.

After getting nowhere trying to find a solution to this I decided to go the alternative route of trying to find a ML version thats compatible with 2.0.3 and came across this forum thread, I've downloaded your experiemental build dfort and loaded it onto the sd card, placed the card back in the camera, and gone through the same process to launch the firmware update program, when it immidately states that it cannot find any firmware update files.


Am I being incredibly dense/blind and missing something, has anyone else come across this issue and found a resolution? any help would be appreciated.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Blop_da_pop on December 27, 2018, 03:24:32 AM
Has anyone had a problem with messages of code appearing while filming: 'Corruption at slot 42, frames...etc?
Cheers
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: dfort on December 27, 2018, 04:07:05 AM
Those are error messages. It would help if you could give some more information. Which build (experimental or Nightly?), what card are you using, settings, do it save a log file, etc. Photos of the LiveView screen also help us understand what is going on.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: DeafEyeJedi on December 27, 2018, 08:23:35 AM
Thanks @Danne for your builds. Will def get my hands dirty with these new presets and report back!
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on December 27, 2018, 07:36:47 PM
Test away @deafeyejedi :).
Updated with Movie crop mode able to run 42 fps from fps override. I also reduced resolution some to stay coherent with 1736x976(16x9).
On a sidenote I actually had my first soft brick ever on a cam. it happened as I was foolishly forcing registry to be set while in mv720p 50fps when enabling Movie crop mode. To be able to do this I had to surpass a few places in code so not really safe. Anyway. Thanks to a1ex both logs and fix was produced and within the hour all was working nicely again. The procedure to fix it was nothing but amazing.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: loknar on December 27, 2018, 11:37:42 PM
So i took crop_rec_4k_mlv_snd_isogain_1x3_presets_2018Dec21 build for a spin.
Quality is wonderful.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on December 28, 2018, 03:24:18 AM
Cool loknar. I have been filming with 3K 19fps and 9bit for continuous action on my latest eosm builds. Feel free to test that out as well. Maybe one can get away with 19fps  :P
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: IDA_ML on December 28, 2018, 09:55:16 AM
This is what absolutely amazes me with Magic Lantern - Alexa quality with a 200$ camera.  This is a triumph of the engineering genius of our developers!

I wouldn't use 9-bit lossless in critical high-contrast shots though. Underexposed shadows really look ugly at that bit rate.  On the 100D, I was able to get continuous recording at 3K, 18 fps and 10-bit lossless, with a slight underexposure by about 0,5 stops.  Same with 2544x1432 (16:9) resolution where I can even go up to 20 fps at 10-bit lossless.  Quality is stunning and underexposed shadows look normal.  Excellent job, Danne !
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: loknar on December 28, 2018, 10:06:18 PM
Cool loknar. I have been filming with 3K 19fps and 9bit for continuous action on my latest eosm builds. Feel free to test that out as well. Maybe one can get away with 19fps  :P

Thanks, but given it's thanks to you and other lanterners :)...

Make it 20fps and we'll have a deal  8) ...just kidding

I'll try it, but weather will suck for the time being, so no outdoor shots.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on December 28, 2018, 10:13:32 PM
I am planning a 3:1 preset option for 24 fps 3k continuous action. Will be a good alternative to 2:35.1. I know, reinventing presets already available but for real life use it seems smooth to have these two presets available and set on the four first presets within the reach of one button.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: JaspaJami on December 30, 2018, 11:38:28 PM
Tried to search for a long time without any answer.

Is there anyway possible to get live video from EOS M to computer? I would like to use EOS M for live streaming. If it is, how?
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on December 31, 2018, 05:16:39 PM
Inspired of what´s going on here by reindeercity https://www.magiclantern.fm/forum/index.php?topic=19336.msg209877#msg209877 I created a preset with 4000x568 24 fps. In post it will become 4k 2.35:1 4000x1704. Since we are squeezing the recording it will affect quality but in return we get continuous 4K. No build yet in next year I put it in  :P. Will probably work to build the same in 100D, 5D3 etc...

New focus pixels to fight with, eh, dfort, looking in your direction.

MLV file:
https://bitbucket.org/Dannephoto/magic-lantern/downloads/M31-1722.MLV
dng file:
https://bitbucket.org/Dannephoto/magic-lantern/downloads/M31-1722_frame_64.dng

(https://www.magiclantern.fm/forum/proxy.php?request=https%3A%2F%2Fi.postimg.cc%2FfRYxXygh%2FScreenshot-2018-12-31-at-17-11-42-png-scaled.png&hash=ffbb25236e2eb2fe05c738f6e2169817)


Code that I used in crop_rec.c:
Code: [Select]
        cmos_new[5] = 0x280; 

        case 0xC0F06804: return 0x2d7040a;
        case 0xC0F06824: return 0x4ca;
        case 0xC0F06828: return 0x4ca;
        case 0xC0F0682C: return 0x4ca;
        case 0xC0F06830: return 0x4ca;     
        case 0xC0F06010: return 0x45f;
        case 0xC0F06008: return 0x45f050f;
        case 0xC0F0600C: return 0x45f045f;
        case 0xC0F06014: return 0x405;
        case 0xC0F0713c: return 0x320;
case 0xC0F07150: return 0x300;

Import the MLV file into Mlv App and set height stretch to 3.0x


EDIT:

Might need to stretch footage even more with the eosm. Maybe even 5.0x? Needs further investigating....
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: loknar on December 31, 2018, 05:27:57 PM
Wicked :) and kinda unbelievable what can be done...
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: optical-work on December 31, 2018, 07:55:29 PM
well, i think i can wait untill next year.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Teamsleepkid on January 01, 2019, 01:52:04 AM
and the hits just keep on coming...
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on January 01, 2019, 11:32:48 AM
Let´s start 2019 with some eosm love. The setting is called:
4K squeeze 24fps 
It´s working continuously with 10 bit and build files when set to 2.35:1 through crop_rec submenu that gives files sized to 4000x1704. The files are actually recorded into a squeezed mode(4000x696 or 4000x 568 when 2.35:1 is selected). Thanks to mlv metadata the upscaling is done with the default scale tag so it´s merely a question of opening up the file in Mlv App or acr and the unsqueezing will be done automatically.

To use it enable 'framing' to get a preview in liveview. It is working in regular video mode(NOT x3 zoom mode). Set bitrate to 10bit and ratio to 2.35:1 for continuous recording.
Please report back how it works and feel free to share content recorded.
By the way. Do not miss out on this progress!
https://www.magiclantern.fm/forum/index.php?topic=17695.msg209985#msg209985

Build for download in following post:
https://www.magiclantern.fm/forum/index.php?topic=9741.msg208959#msg208959


MLV test file:
https://bitbucket.org/Dannephoto/magic-lantern/downloads/short_M01-0722.MLV
(https://www.magiclantern.fm/forum/proxy.php?request=https%3A%2F%2Fi.postimg.cc%2FzXmykBqk%2FScreenshot-2019-01-01-at-11-27-10-png-800px.png&hash=30a8741acfa40ec13bb160246a92c97d)

TODO:
Focus pixel map(dfort is looking into it).
This mode actually also works in mv720p which yield 5x1 squeeze. Will check if it´s actually useful in real life or not.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Levas on January 02, 2019, 05:56:21 PM
Sorry for off topic, but you are talking here :P

You're right, we hijacked the EOS-M topic, let's discuss further about binning in this topic:

https://www.magiclantern.fm/forum/index.php?topic=16516.msg210028#msg210028 (https://www.magiclantern.fm/forum/index.php?topic=16516.msg210028#msg210028)
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Pacerx999 on January 03, 2019, 03:57:02 PM
I imagine it's that I'm doing something wrong, but I'm not getting much joy out of the latest 4k 3x1 squeeze.

I *think* I have the settings all correct, but mine are below:

Any pointers as to what I have set wrong? All I'm getting is pink screen/static in LV, even when set to framing.

cheers

(https://www.magiclantern.fm/forum/proxy.php?request=https%3A%2F%2Fi.ibb.co%2FdBYmwTw%2FLiveView.jpg&hash=e65ce409a9386a3028da0993e3405837) (https://ibb.co/dBYmwTw)

(https://www.magiclantern.fm/forum/proxy.php?request=https%3A%2F%2Fi.ibb.co%2FB6mznbM%2FMove-Mode-Menu.jpg&hash=6c52f8d8241fd2579deee4431b45b60b) (https://ibb.co/B6mznbM)

(https://www.magiclantern.fm/forum/proxy.php?request=https%3A%2F%2Fi.ibb.co%2FPYgdLcj%2FRAW-Video-Menu.jpg&hash=cac8a9b6ce740aed00f8d08c907202f9) (https://ibb.co/PYgdLcj)

(https://www.magiclantern.fm/forum/proxy.php?request=https%3A%2F%2Fi.ibb.co%2FnLHTPDd%2FCrop-Mode-Menu.jpg&hash=851beec1bc36bcc6825ced43009a6a47) (https://ibb.co/nLHTPDd)
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: optical-work on January 03, 2019, 04:02:52 PM
I imagine it's that I'm doing something wrong, but I'm not getting much joy out of the latest 4k 3x1 squeeze.

I *think* I have the settings all correct, but mine are below:

Any pointers as to what I have set wrong? All I'm getting is pink screen/static in LV, even when set to framing.


disable fps override.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on January 03, 2019, 04:04:35 PM
Did you maximize resolution?
I'm about to put up another version soon but in short. If you want to film without jagged edges set your cam into mv720p mode (50fps) and in x5 mode when filming. (x5 might not work on this version, didn't check)
Will have an optimized build up soon that will work out all the quirks.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Pacerx999 on January 03, 2019, 04:25:09 PM
Disabling FPS override, definitely got me more usable liveview, but still lots of pink flashing.

I'll wait for Danne to upload the new build he mentioned, then give that a go!

Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: optical-work on January 03, 2019, 06:04:16 PM
4k 3x1 working as expected for me.  i tried to reproduce your problem and when i change the video mode in canon menu from 1920x1080 24p to 1280x720 50/60p, vertical purple lines scanning the frame from bottom to top occurs on framing liveview. i guess this is the result of a shutter speed problem that also occurs. shutter speed was "N/A" in magic lantern menu and global draw.

Changing video mode back to 1920x1080 didn't solve the issue by itself even if i reboot the camera. After setting the video mode 1920x1080 24/30p in canon menu, i press the info button and change the shutter speed there and that fixed this issue.

If your problem anything like that you can try this.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Pacerx999 on January 03, 2019, 06:42:45 PM
Ah ha!

Adjusting the shutterspeed back to 1/50 means that it now appears to be working as intended.

Will have a play and report anything else that I find back.

cheers
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: anto on January 04, 2019, 01:36:20 AM
two simple questions:
1 wich EOS M model is better with ML?
2 wich is better for ML video 100d, 700d or EOS M?
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on January 04, 2019, 09:07:27 AM
New 4k version:
https://www.magiclantern.fm/forum/index.php?topic=9741.msg208959#msg208959

Should be no jaggy edges in this one. Select the 4K 3x1 24fps preset. It should set you in x5 zoom mode but still keep the 4k settings. If not in x5 zoom just hit magnifying button to get there.

Please report how it goes...

EDIT:
Pixel peep
Old version:
(https://www.magiclantern.fm/forum/proxy.php?request=https%3A%2F%2Fi.postimg.cc%2FL8YyWjMX%2FScreenshot-2019-01-04-at-10-47-25-png-800px.png&hash=3a635e1dbb4349104b5da92838496a62)
New version:
(https://www.magiclantern.fm/forum/proxy.php?request=https%3A%2F%2Fi.postimg.cc%2FtCmSD2ww%2FScreenshot-2019-01-04-at-10-47-36-png-800px.png&hash=02b877ae313da9c5ccd67db2a9c975be)


Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: IDA_ML on January 04, 2019, 10:28:16 AM
Danne,

Can you make the same build for the 100D too?  Then I'll let you know how it goes.  Good stuff, by the way! 
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: loknar on January 04, 2019, 12:27:24 PM
4K build works.
Is there some special way how to process it? When I use MLVAPP with default settings (3x vertical clearly works) i'm getting a lot of color artifacts (crop 100 %):

(https://www.magiclantern.fm/forum/proxy.php?request=https%3A%2F%2Fi.ibb.co%2Fd7FvrFb%2Fartif.jpg&hash=168c2b6a78bd84fdc73e54e433cd41e9) (https://ibb.co/d7FvrFb)

Also there seems to be an issue with exposure time, when i go to ~1/100 and faster, 5x zoom view starts flashing and framing view splits into several black and part of screen bands.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on January 04, 2019, 12:47:25 PM
Thanks loknar. Reproduced. Not sure why faster shutter speeds causes this. Maybe some overhead issue.
Anyway. Expanded height to 750 so it starts in 16:9 as default. Use crop_rec submenu for 2:35.1.

Upload here:
https://www.magiclantern.fm/forum/index.php?topic=9741.msg208959#msg208959

Color artifacts and focus pixels. We´ll need dfort checking this.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on January 07, 2019, 12:12:34 PM
New preset added:
mv1080p 1736x738 50fps

Means 50 fps in 2.35:1 with 3x3 binning mode. Works in both mv1080p or mv720p selected in canon menu.

Download here per usual:
https://www.magiclantern.fm/forum/index.php?topic=9741.msg208959#msg208959

Really need people to test this preset for corruption. Did my best to tune in timers but might be borderline anyway. I run it with audio off and global draw to off in 10bit. Sd_uhs hack might interfere negatively on this preset. Also needs testing.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: loknar on January 07, 2019, 01:38:56 PM
I captured about 1500 frames and 2 of them are corrupt - lower half pink and shifted sideways.
Also, longest shot was slightly above 11 seconds, it stopped after on screen message saying something about  "incorrect frame order".
I'll test some more.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on January 07, 2019, 01:41:51 PM
I see. Disabled audio and global draw too?
Thanks for testing.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: loknar on January 07, 2019, 01:56:32 PM
I did some more tests
i'm getting ~250 frames without SD overclock (~35MB/s), ~ 550 with SD overclock (~44MB/s)
in second set corruption appeared only in shots with SD overclock (3 ouf of 550). Frame out of order didn't appear again.
As for global draw it's on, but i'm using canon liveview, does it count?
Disabled sound, like not loaded mlv_sound module?
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: loknar on January 07, 2019, 02:03:17 PM
Aaaand some more tests.
When not overclocked no corrupted frames.
Sound doesn't seem to cause problems.

Also i noticed it doesn't want to show dowm when button pressed (it stucks on "Sensor cleaning" and orange led on), needs two additional presses (one to start again asnd switch off)

With SD overclock and no sound it seems to prolong recording to some ~800 frames and no corruption
Sorry about first report, i  enabled sound module on autopilot.

Also, all these are low light situation no Sun here today.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on January 07, 2019, 02:48:34 PM
Thanks for tests. New upload:
https://www.magiclantern.fm/forum/index.php?topic=9741.msg208959#msg208959

Ran five 11 sec recordings with the 50 fps preset and couldn´t create a corrupted frame. Maybe fixed?
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: loknar on January 07, 2019, 03:33:13 PM
It now switches off okay.

For some reason i'm getting longer times 650-800 frames but unfortunately each clip contains 3-5 corrupted frames, not consequent in different parts of clips.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on January 07, 2019, 05:29:33 PM
Ok, final attempt for corruption free files in 50fps:
https://www.magiclantern.fm/forum/index.php?topic=9741.msg208959#msg208959
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: loknar on January 07, 2019, 05:54:15 PM
No corruption and length ~17 seconds shots, I only activated SD overclock, cropmode and set 10 bits in it.

Doesn't like overexposure and sudden changes in brightness, when light conditions don't change too much, it looks like it can be continuous (I have 21 second shot that I had to direct at light bulb in the end to make it stop [after several seconds]).

Btw does ML control over Image Stabilization in lens? I have IS activated in Canon menu, but in replay it says "no IS" (i use manual focus, but that shouldn't be a problem or is it?)
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on January 07, 2019, 07:08:45 PM
Cool.
No idea about image stabilisation in this case.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on January 09, 2019, 11:46:32 AM
New build:
https://www.magiclantern.fm/forum/index.php?topic=9741.msg208959#msg208959

Optimized 2520x1308 setting to 2520x1438(16:9). Works with real-time preview 24fps.

Also added a mv720p 50fps setting. Will record 1736x696 so unstretches in post to 16:9.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Pacerx999 on January 09, 2019, 02:18:33 PM
So utilising crop_rec_4k_mlv_snd_isogain_1x3_presets_2019Jan07.EOSM202

I manage to get both 50fps with mv1080 and the 4k-24fps.

With the 4k-24fps, I was getting a similar colour artefacts to Loknar. I.e. blue/yellow oddness. Seems to be concentrated around horizontal lines

Also overexposure or anywhere close gets pink highlights when exposure is brought down. Highlight reconstruction in MLVApp doesn't help, but Resolve highlight reconstruction does help, but only using MLVFS, which currently doesn't remove focus pixels.

Obviously preview is slow, but finding and maintaining focus is v. difficult.

With all that said, when you get the exposure right (ETTR) and grab focus the quality of the shot is excellent, but the horizontal artefacts are affecting things. Just want to be clear, I think it's Amazing to get 4k RAW out of a 6year old camera, but would like to get this to a great user experience so it could be used for actual project.s

50Fps seems to be working fine, with SD Overclock, I'm getting approx 10sec, but it was a bright scene, so I think that's what limits it due to data rate. But it looks good when slowed down to maybe 80/90fps in Premiere using optical flow.

I see that there is a Jan9 build, so will go on to try that and report back any findings. If MLVs would be helpful for the colour artefacting, just let me know

TA!
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on January 09, 2019, 02:22:00 PM
4k is hard. Compromise is it runs 3x1 binning(mv720p) which is, well, not 3x3 binning. Useful or not I tend to keep prioritized presets first and then the longer down the list the crazier it can get  :P
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: masc on January 09, 2019, 04:28:17 PM
Also overexposure or anywhere close gets pink highlights when exposure is brought down. Highlight reconstruction in MLVApp doesn't help, but Resolve highlight reconstruction does help, but only using MLVFS, which currently doesn't remove focus pixels.
You should be able to correct pink highlights in MLVApp too: correct first RAW White Level. -> activate Highlight Reconstruction and then lower RAW White Level until pink highlights go away.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on January 09, 2019, 06:22:22 PM
New build:
https://www.magiclantern.fm/forum/index.php?topic=9741.msg208959#msg208959

Added a 5K 24 fps (squeezed 2.35:1) preset into the game...
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: optical-work on January 09, 2019, 07:30:17 PM
as far as i can see 4k 3x1 mode has better quality than mv1080 mode and raw therapee's defringe tool gets rid of the color artifacts. but there is too much moire compared to mv1080.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on January 10, 2019, 12:11:12 PM
New upload. Again  8).
https://www.magiclantern.fm/forum/index.php?topic=9741.msg208959#msg208959

Finally got around to fix the cool 1x3 binning mode which until now was restricted to height stop around 1120. The preset now goes all the way to 1712x2184. Files opens up just fine in Mlv App. More info from this thread(@theBilalFakhouri) about 1x3 binning:
https://www.magiclantern.fm/forum/index.php?topic=22818.msg206134#msg206134

Comparison files:
https://bitbucket.org/Dannephoto/magic-lantern/downloads/1_x3_M10-1218.MLV
https://bitbucket.org/Dannephoto/magic-lantern/downloads/3x3_M10-1219.MLV

What eventually worked was bypassing any height restriction for eosm in raw.c and then start expanding registers. Commit:
https://bitbucket.org/Dannephoto/magic-lantern/commits/0b5f6fe465afe77de97d57255151f8644b067395

Also added some rearrangements and took the liberty to rewrite a few info parts.
(https://www.magiclantern.fm/forum/proxy.php?request=https%3A%2F%2Fi.postimg.cc%2F1ttDQKGT%2FVRAM0-PPM-500px.png&hash=0908353fab3644ee7c43bf10a713ec14)

Next up, 100D...
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: jacquaviva on January 10, 2019, 11:07:18 PM
Hi,

I am a bit confused about crop factors from all these new presets.
Are 5K, 4K & 1712x2184 still close to 3.33x crop ?

Is there still any hope about 1.6x crop or it always will be 1736x696 stretched to 1736x1160 ?

Thanks in advance.

By the way, since Canon M flange distance is 18mm the same than Sony E, I found how to build and adapt a Sony E mount part to the EOS M in order to use the Fotodiox ND Throttle Canon EF to Sony E (among others).
It works very well. I only use full sensor 1.6x RAW video and to avoid moire and aliasing, I have bought a 6D VAF Mosaic Engineering AA filter and achived to tinker with to adapt it to the camera. Working very good as well.
If anybody wants more information.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: 12georgiadis on January 10, 2019, 11:23:25 PM
to avoid moire and aliasing, I have bought a 6D VAF Mosaic Engineering AA filter and achived to tinker with to adapt it to the camera. Working very good as well.
If anybody wants more information.
Do you have some instructions and pictures to show us how to adapt VAF filters ? Sounds interesting =)
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: dfort on January 11, 2019, 02:19:07 AM
Here's someone else who shoehorned a VAF filter into the EOSM. No instructions or photos. Hint -- Scotch tape.

Yes but it's on a cheap one. So you have more space to do it.
It's a bad work with scotch, I am not as proud of it to share pictures of it. Sorry.
You just have to put any kind of filter between the lens and the sensor and it's effactive...
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on January 11, 2019, 09:55:16 AM
Is there still any hope about 1.6x crop or it always will be 1736x696 stretched to 1736x1160 ?
?
If you mean to record mv1080p 3x3 binning it´s already working.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: loknar on January 11, 2019, 12:16:11 PM
Is it just me, or build crop_rec_4k_mlv_snd_isogain_1x3_presets_2019Jan10.EOSM202 is creating corrupted frames in 1x3 binning mode?

And this is probably stupid question, but instead of 3x3,1x3,3x1, would it be possible to use binning or line skipping 2x2...? Probably using some array operations, like readout whole sensor and then decrease it in size...not quite sure if limit is on processing side, or write speed size (or if it even possible to edit raw frame before saving it...but given how many "impossible" things have been already done...).
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on January 11, 2019, 12:23:35 PM
Corruption is not unlikely. What were your exact settings? Will check for it.

Anyway, here´s an attempt in Mlv App using dualiso. Looks pretty nice:

Here´s a dualiso attempt coming from eosm and it´s 1x3 mode setting. Recorded in:
10bit,
sd_uhs,
24 fps,
dualiso 100/1600,
1600x2040(2.35:1)


mlv sample:
https://bitbucket.org/Dannephoto/magic-lantern/downloads/1x3_dualiso_eosm_M11-1209.MLV

(https://www.magiclantern.fm/forum/proxy.php?request=https%3A%2F%2Fi.postimg.cc%2F28RwbFXb%2FScreenshot-2019-01-11-at-12-12-16-png-scaled.png&hash=be72ef7dabdebd8f60b57b1f76c5fa38)

(https://www.magiclantern.fm/forum/proxy.php?request=https%3A%2F%2Fi.postimg.cc%2FMK7YyMhs%2FScreenshot-2019-01-11-at-12-11-53-png-scaled.png&hash=b8682314ef350def952c4c9e4c3c84e8)



Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on January 11, 2019, 12:52:35 PM
Here is a likely a fixed version for the corruption in 1x3 binning mode:
https://bitbucket.org/Dannephoto/magic-lantern/downloads/crop_rec_4k_mlv_snd_isogain_1x3_presets_2019Jan11.EOSM202.zip
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: jacquaviva on January 11, 2019, 02:44:32 PM
I mean what will be the max resolution for RAW video using full sensor read out (1.6x crop) ?
I know it's working with 1736x696, but not more for 24fps.

And what are the crop factors for new preset 4k & 5k ?
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on January 11, 2019, 02:56:53 PM
Just try it yourself and draw conclusions. Don´t really get what you´re asking.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Walter Schulz on January 11, 2019, 02:57:44 PM
@jacquaviva:
Crop factor calculation into 35 mm terms:

(Sensor horizontal pixel count / ML horizontal resolution in ML crop mode) x 1.61

It's not exactly rocket science, you know?
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: jacquaviva on January 11, 2019, 03:10:00 PM
Thanks for the crop factor calculation.

I just would like to know if we can get more resolution for full sensor RAW video at 24fps.

Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on January 11, 2019, 03:44:55 PM
New build:
https://www.magiclantern.fm/forum/index.php?topic=9741.msg208959#msg208959

Seems we can get 1736x1160 in mv1080p mode rather than 1736x1120.
This seems to be the friendly match:
Code: [Select]
        case 0xC0F06804: return 0x4a601d4;
        case 0xC0F0713c: return 0x4a7;
case 0xC0F07150: return 0x499;
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: henricusmaria on January 11, 2019, 05:48:04 PM
Just wondering.. is there a big quality difference between the 10-bit and 12-bit option? I did some tests today in the 2.5k setting at lower resolution (1712x964) in order to shoot continuous in 12 bit. Here is a short clip.

https://youtu.be/_6ckNT4LAV4 (https://youtu.be/_6ckNT4LAV4)

I accidentally found out that when I activate movie crop mode in this setting the field of view gets a bit wider.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: dfort on January 11, 2019, 06:26:45 PM
Looks like you'll need one of these to go along with those massive sized files:

(https://www.magiclantern.fm/forum/proxy.php?request=https%3A%2F%2Ffarm8.staticflickr.com%2F7865%2F32828542758_531fdf4573_n.jpg&hash=2c71056aa25a10973e26607c9a8c07c2) (https://flic.kr/p/S1WS2U)

MSRP of $499.99, Yikes!
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: bergamote on January 11, 2019, 09:42:33 PM
Hey guys! happy new year and such.
Been playing around with today's build and 2.5K preset script (and sd card overclock). The max filming time seemed really dependent on the exposure. Underexposed goes on and on, but ETTR and it stops after less than 10s. (more data i take it)
I accidentally managed to get a good shot with 1x3 mode and the result was super awesome!
Tried to get 5K going but without an automated script I tend to mostly mess up the settings and lose the live view (garbled pink stripes) and have to delete the settings folder to get anything working again.

I'm wondering, does the 2.5k-10bit-XXXiso lua script actually change the raw bitrate to 10? mlv_play shows 14 bpp.
Also, is "framing" view available in 2.5k or is it just for 1080mv?
Cheers
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Upstep on January 12, 2019, 08:00:08 PM
I'm getting corrupted frames using 1x3 preset and sd_uhs with the latest build. (They happen here and there. "Purple glitch")
Any information I can give to help you try to solve it?
What exact settings did you @Danne use to get uncorrupted footage?
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: ctfire on January 12, 2019, 08:51:29 PM
hey, is anybody have a problem with shutterspeed in latest build. when activated crop modes can go lower than 1\60 (
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: bergamote on January 12, 2019, 09:06:55 PM
Okay, sorry for the stupid questions, answers were in the thread..
Experimented some more with the 1x3 preset and it's so cool. Only getting a couple of seconds before it crashes but boy, they're good looking seconds!
@ctfire yeah, the shutter speed was a bit weird for me too, it seems to randomly set itself to 1/35 or 1/80 when changing presets. How many fps are you shooting at?


Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: henricusmaria on January 13, 2019, 09:48:46 AM
hey, is anybody have a problem with shutterspeed in latest build. when activated crop modes can go lower than 1\60 (

Yes, the normal mv1080p cropmode changes the shutter speed to 1/390 (!)
The rest of the modes work normal.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on January 13, 2019, 11:00:03 AM
Thanks for feedback guys.
@bergamote
The lua scripts were originally created when I wanted to ge tinto fast action using the sd_uhs module. But I never used them with crop_rec presets enabled.
@ Upstep
For now, try lowering resolution a bit. Trying to find sweet spot not getting corruption. Seems 24fps is on the borderline on highest resolution
@henricusmaria
Will try and reproduce. Shutter speeds reported with global draw on is probably wrong as well, especially on x5zoom. Think it´s related to shutter blanking.
12bit is better and very close to 14bit in quality. 10bit will work most of the time imo.

Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: jacquaviva on January 13, 2019, 01:32:42 PM
@12georgiadis

Here is my setup, E mount ring screwed (lucky that two holes fit), plastic ring with electronic contact for lenses removed to make some space for the filter. Just used two small plastic pieces, glued them and screw the filter on them.


(https://www.magiclantern.fm/forum/proxy.php?request=https%3A%2F%2Fi.ibb.co%2FHq0nWsH%2F1.jpg&hash=0cc3ed57eb54aa2f866506a55410d2c0) (https://ibb.co/Hq0nWsH)


Just to mention, when removing plastic and lens contact ring, you can't take pictures anymore (Err 20) you just can use movie mode.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: henricusmaria on January 13, 2019, 02:52:32 PM
Thanks for feedback guys.

@henricusmaria
12bit is better and very close to 14bit in quality. 10bit will work most of the time imo.

Thanks Danne.
I will do some tests in 12 bit and 14 bit. Is there a difference in image quality between the movie crop mode and the x5 zoom mode? The crop in the movie crop mode is workable, the 5x zoom is a bit much for me.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: optical-work on January 13, 2019, 03:00:05 PM
For more accurate shutter speed, set shutter range under crop mode sub menu to "full range" and use "high jello" or "low light" under fps override sub menu for mv1080 (exact fps looks okay with 2.5k). I thought change of shutter speed, when you change preset, is related to the sensor area that is scanned. Isn't it true?
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: 12georgiadis on January 13, 2019, 06:22:18 PM
@12georgiadis

Here is my setup, E mount ring screwed (lucky that two holes fit), plastic ring with electronic contact for lenses removed to make some space for the filter. Just used two small plastic pieces, glued them and screw the filter on them.


(https://www.magiclantern.fm/forum/proxy.php?request=https%3A%2F%2Fi.ibb.co%2FHq0nWsH%2F1.jpg&hash=0cc3ed57eb54aa2f866506a55410d2c0) (https://ibb.co/Hq0nWsH)


Just to mention, when removing plastic and lens contact ring, you can't take pictures anymore (Err 20) you just can use movie mode.

Thank you ! I think I prefer to adapt my 7D-vaf to 100D than to damage/restrict Eos-m usage but in the same time, I'm happy that with some Diy adjustment it works well !
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: loknar on January 14, 2019, 03:25:08 PM
@danne So i took 1x3 mode for a spin, but now i face kinda problem with processing, i used dual iso and would like to get 1704x72X output, but when i export it from MLVApp i get 5120x2184 files, i wasn't able to find any place where there is this setting, in MLVApp there's normaltransofrmation: Width 1.0x, Height 0.33x, in file metadata there's 1704x2184, so where the 3x1704X2184 comes from?
Other than that it works excellent and i think i'll have some nice shots once i solve export (right now, only think i can do, is to force resolution back down during export, but that seems as bad solution)
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: masc on January 14, 2019, 03:32:42 PM
@danne So i took 1x3 mode for a spin, but now i face kinda problem with processing, i used dual iso and would like to get 1704x72X output, but when i export it from MLVApp i get 5120x2184 files, i wasn't able to find any place where there is this setting, in MLVApp there's normaltransofrmation: Width 1.0x, Height 0.33x, in file metadata there's 1704x2184, so where the 3x1704X2184 comes from?
Other than that it works excellent and i think i'll have some nice shots once i solve export (right now, only think i can do, is to force resolution back down during export, but that seems as bad solution)
0.33x height stretch is now updated (v1.4+) : it will do what you describe: width = width * 3; height = height. We did that to have maximum resolution. If you want to have it smaller, you could use resize function from export settings dialog (ffmpeg export only).
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: loknar on January 14, 2019, 03:52:34 PM
Thank you for reply, but wouldn't be better to include multiplication in drop-down dialogue? This is a bit counterintuitive and also in my case slower, first upscale, then downscale, and i also kinda fear of introducing some artifacts created from interpolation (and there's lot of them in upscaled frame).
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: masc on January 14, 2019, 04:02:17 PM
Thank you for reply, but wouldn't be better to include multiplication in drop-down dialogue? This is a bit counterintuitive and also in my case slower, first upscale, then downscale, and i also kinda fear of introducing some artifacts created from interpolation (and there's lot of them in upscaled frame).
It is not really counterintuitive: no matter which factor is selected, it is always stretched to a bigger size. Only 0.33 became smaller before and behaves the same now. Rescaling speed is identical, if you override it with the smaller resolution, because resizing is done just once. It also won't introduce any artefacts. You just loose 66.6% of quality when downsampling.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on January 14, 2019, 04:02:21 PM
There´s no interpolation when upsampling @loknar.
Could be an option to manually set the sampling downward instead but I think default should be upsampled like it is now. However, with more options comes more confusion  :P
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: loknar on January 14, 2019, 04:05:09 PM
OK, thank you both, i'm going to do the exports.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: loknar on January 14, 2019, 04:07:59 PM
Also, I don't know what beasts of a computer you have, but mine isn't built for processing 24 of 11Mpx frames per second  :o.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: masc on January 14, 2019, 04:15:36 PM
Also, I don't know what beasts of a computer you have, but mine isn't built for processing 24 of 11Mpx frames per second  :o.
...9 years old Core2Duo... LOL. When we introduced we thought: downscaling is never an issue, but upscaling (after quality is lost) is. So, if the resolution is to big, feel free to reduce it.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: loknar on January 14, 2019, 04:40:40 PM
You are clearly very patient :).
I agree with you in general, but in this case X axis is interpolated, so no information lost if no interpolation is done, Y axis is reduced, but given that i'm using dual iso, which (if i remember correctly) decreases vertical resolution by half. So yes, i'm losing some information (33 % on one axis?), but not that much and i'm not quite sure what to do with it anyway.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on January 14, 2019, 05:03:40 PM
New version:
https://www.magiclantern.fm/forum/index.php?topic=9741.msg208959#msg208959

I focused on getting rid of corrupted images in 1x3 binning mode. And also to complete a set up that will record all the presets continuously when a certain set up is performed. To enable continuous recordings do following:
sd_uhs hack on
bitrate to 10bit
ratios set to 2.35:1
(will scale down or reduce bitrate depending on preset chosen)

For instance. 1x3 1736x2150 will be set to 1504x1920 when ratios 2.35:1 is set. Still a stellar file since upsampled in Mlv App you will export a file that´s 4512x1920 in size.
3k will run with reduced fps and so will 5k setting. Most other presets will still keep original frame rate. All presets will record with 2.35:1.
If you want full manual control just skip the 2.35:1 ratios setting and do whatever tweaks in other menus instead.

Enjoy and don´t forget to post what´s working or not…


(https://www.magiclantern.fm/forum/proxy.php?request=https%3A%2F%2Fi.postimg.cc%2Fx8cJFSy6%2FVRAM0-PPM-scaled.png&hash=aadc9e710fb1fba3ac1355b9c0212edc)

(https://www.magiclantern.fm/forum/proxy.php?request=https%3A%2F%2Fi.postimg.cc%2FrmhRJpWd%2FVRAM1-PPM-scaled.png&hash=d72e24bc9d76a3756ea42695c0369bfc)

(https://www.magiclantern.fm/forum/proxy.php?request=https%3A%2F%2Fi.postimg.cc%2F50QJwwQk%2FVRAM0-PPM-scaled.png&hash=dd24e5176978dbe76da8fbf3d4b96670)
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: bergamote on January 14, 2019, 06:39:40 PM
Oh boy this is exciting! This afternoon I managed to get a bit more than 200 frames in the 1x3 mode at 10bit/20fps and came to the conclusion this is the best image quality (without mad crop). Now a new build with a way to do continuous 1x3!!! Man, you rock! Trying this stray away.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on January 14, 2019, 06:47:36 PM
Go nuts  :P
Yes, it´s madness getting this out of the 1st gen eosm cam. 4.5k 24 fps...
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: jacquaviva on January 14, 2019, 10:46:35 PM
Hello, do you think something can be done for non squeezed real time preview shooting at 1736x1120px ? Thanks a lot
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Teamsleepkid on January 14, 2019, 11:30:35 PM
im not getting continuous recording with 10 bit 2:35 1504 sd hack setting only like 2 seconds and crash. does it work for anyone else? also not complaining. thanks so much danne when are you turning blue? :P
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: bergamote on January 15, 2019, 12:44:36 AM
im not getting continuous recording with 10 bit 2:35 1504 sd hack setting only like 2 seconds and crash.

You mean in 1x3 right? Cos here it seems to work, I shot for a minute (but got 4 bad frames).
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: henricusmaria on January 15, 2019, 04:26:02 AM
im not getting continuous recording with 10 bit 2:35 1504 sd hack setting only like 2 seconds and crash. does it work for anyone else?

Same here, it crashes within 2 sec. It works with the bitrate in 'Cropmode' at 12 bit and the data format in 'Raw Video' set to 14-bit lossless. Then I end up with a 10-bit lossless file.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: henricusmaria on January 15, 2019, 08:09:01 AM
How does the upsampling work in mlvapp? I now adjust the height stretch to 1.0x and then multiply the width by 3 in the export settings. Is this the correct way? And is it right that we end up with a 10-bit lossless file in mlv app? Thanks
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: bergamote on January 15, 2019, 12:27:52 PM
Last night I could get continuous (at 1x3 1504x1920 10bit 24fps, with a handful of corrupted frames) but I was a bit underexposed the whole time.
Trying again in the sunshine, it crashes after just over 15s when I'm exposing to the right or slightly overexposed.
To test this, I started a shot underexposed and it rolled without problems for over a minute. Then pointed at the sky (to be massively overexposed) and it crashed within 200 frames.
Maybe I'm jumping to conclusions here, might just be a coincidence.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on January 15, 2019, 12:35:50 PM
That's how lossless works. More highlights, more overhead...
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: IDA_ML on January 15, 2019, 01:46:27 PM
Bergamote,

The reason for the early stop phenomenon that you observe is that bright portions of the scene do not losslessly compress so well as darker ones.  Therefore, the brighter your scene is, the less is the compression and buffer fills much faster causing the camera to stop early.  When you move the camera during filming, watch for the color of the time indicator.  It should be green but when the sky or a brightly lit object enters the screen, it turns yellow, orange and red.  If it turns red, recording will stop any moment.

To avoid this, do the following:

1) AETTR your scene and once you are sure you have proper exposure, dial it one stop back

2) Focus precisely on the main object that you need to place the accent on

3) Activate Dual ISO and select the higher value to be two stops higher than the lower one as selected in 1), e.g. 100/400.  This will compensate for the lower signal-to-noise ratio in the shadows as a result of the reduced exposure in 1)

4) Start filming.  Now the scene will not contain too bright areas and compression will work just fine.  You will get continuous recording.  As a bonus, you will also get a brighter striped preview which will help you frame better.  But watch for the icon color.  If a large and very bright object enters the scene, it still may turn red and you may not have enough time to avoid camera early stop.

5) Process your files with MLVApp and enjoy stunning video quality !!!

6) And don't forget to thank the developers for this miracle! 
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: bergamote on January 15, 2019, 03:38:37 PM
Right right right, that figures, cheers for the explanations guys!
Gonna follow those instructions and try dual iso now.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: ctfire on January 15, 2019, 04:11:29 PM

(https://www.magiclantern.fm/forum/proxy.php?request=https%3A%2F%2Fi.ibb.co%2FTM3K82c%2F2019-01-15-17-15-11.png&hash=16c5b5bf810f444bc67a1d5922f6ab5d) (https://ibb.co/TM3K82c)
 Hey guys, have a problem with latest  build ,try to search some info about focus pixel dots , and find nothing how to fix it . Its in 1080mv 24p. Have anybody fix for it?


And  focus peaking see it even in live view
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on January 15, 2019, 04:18:11 PM
Set chroma smooth to 3x3 in mlv app.
Dfort, the pixeldestroyel, needs to take a look.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: ctfire on January 15, 2019, 04:34:51 PM
Set chroma smooth to 3x3 in mlv app.
Dfort, the pixeldestroyel, needs to take a look.

I'll try, thanks !
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: dfort on January 15, 2019, 06:17:17 PM
Dfort, the pixeldestroyel, needs to take a look.

Ha ha -- need some sample MLV and simple silent stills from the various cameras and settings in order to work on this. Seems like things are changing daily. Lets narrow down just the ones that aren't working in MLV App for now because that seems to be the preferred app.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on January 15, 2019, 06:54:17 PM
Yea, let them pixel presets settle first  8)
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on January 15, 2019, 07:06:49 PM
Updated yet again:
https://www.magiclantern.fm/forum/index.php?topic=9741.msg208959#msg208959

In an attempt to reduce overhead getting a slight more headroom for the 1x3 binning mode setting I started looking at the framing preview in mlv_lite. This mode seems most stable with 5D3 and a working with eosm and the 100D quite often framing options ends up with stuck into real time preview needing to restart the camera. Did a few changes, one which will make framing preview run in grayscale when recording but color while not recording for framing. Also seems more stable going in and out of framing and real-time preview.
If testing please report about corrupted frames or other anomalies.
Would be cool if we could at least get a reliable framing/real-time usage for both eosm and 100D. Should be possible.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: loknar on January 15, 2019, 07:09:16 PM
Ok, so i tried some real world shooting in 1x3 dual ISO mode and here is the result
build crop_rec_4k_mlv_snd_isogain_1x3_presets_2019Jan11.EOSM202
Unfortunately I forgot,  that there are probably some extra steps in Dual ISO processing to avoid flickering...so there's flickering. Also conditions weren't pleasant (freezing, wind gusts over 70 kph) and it was first time i saw that CPU temperature was 0 degrees Celsius :o).
As far as corruption goes, i guess 50 % no problem, 25 % one or two corrupted frames at the begining or at the end and last 25 % unusable due tu mulltiple corrupted frames.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on January 15, 2019, 07:12:30 PM
Thanks for sharing. uploaded a new build to test.
Flickering shouldn´t be an issue. How did you process your files? Mlv App or camera raw?
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: masc on January 15, 2019, 07:18:19 PM
@loknar: you should disable "bad pixel fix", because on detailed dual iso clips it failes sometimes... it brings some pink dots (0:28). Does that help?
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: anto on January 15, 2019, 07:27:41 PM
it seams that link of the new version doesn't work
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Walter Schulz on January 15, 2019, 07:33:04 PM
https://bitbucket.org/Dannephoto/magic-lantern/downloads/
Updated about 13 minutes ago ...
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on January 15, 2019, 07:34:10 PM
Thanks Walter/anto. Updated the link as well.
100D also updated. MIght work more reliable as well regarding preview/framing modes.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: loknar on January 15, 2019, 07:37:42 PM
I used MLVApp, also my clips didn't have correct exposure, so some problems might come from it. I need to get ND filter, I've been getting overexposure at f/22!.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: henricusmaria on January 16, 2019, 03:56:56 AM
How does the upsampling of the 1x3 footage work in mlvapp? When I export the footage is downsampled.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Teamsleepkid on January 16, 2019, 04:46:34 AM
henri you should probably ask in the mlvapp discussion this thread is for eos m. file, export, settings, then under codec look for ffmpeg click the lock change to whatever output size you want. at least thats what I'm guessing they're doing.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: masc on January 16, 2019, 09:54:05 AM
How does the upsampling of the 1x3 footage work in mlvapp? When I export the footage is downsampled.
MLVApp <= v1.4 downsamples by default (you can upsample by using resize option in export settings). MLVApp >1.4 (latest commits) upsample by default (but you can downsample overriding resolution in export settings).

henri you should probably ask in the mlvapp discussion this thread is for eos m. ...
Agree.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: henricusmaria on January 16, 2019, 12:14:53 PM
MLVApp <= v1.4 downsamples by default (you can upsample by using resize option in export settings). MLVApp >1.4 (latest commits) upsample by default (but you can downsample overriding resolution in export settings).
Agree.

Thanks. This was a response to Danne’s post about the upsampling in the mlv app of the eos-m 1x3 footage.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: loknar on January 16, 2019, 02:00:44 PM
Report on crop_rec_4k_mlv_snd_isogain_1x3_presets_2019Jan15.EOSM202
Unfortunately it introduces corrupted frames in all clips in both modes i used (1x3, 3K crop ).
On the plus side, there's magnified live view in 1x3 (stretched and somehow it show area of top right part from the frame) so you can alternate between framing and real time live view focusing (as it works in 2.5K mode).
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on January 16, 2019, 02:14:28 PM
What settings did you use?
I also uploaded a new 16 january build. Might work better.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: ctfire on January 16, 2019, 02:51:09 PM
Hi.Is it possible to make Liveview in 1080mv (1736x1158) real time preview more accurate in height, to the detriment of cropping on the sides, since when shooting people, it is easier to observe cropping when a person’s face is centered, not really worrying about the left and right  edges than when the bottom of the frame is not visible. I really hope that there is such an opportunity. And thank you for what you are doing.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: darthivm on January 16, 2019, 05:49:53 PM
hmm was trying out the modes and 10bit, 2.35:1 and 2.5k with sh_card_hack_script from this build didn't really work stopped after some seconds. it used to work for me. the buffer indication sign was always red. normally it went from red to green after some seconds. my sd card is the extreme pro from sandisk with 95mb/s which used to work with this mode. did somebody experience the same problem?

somehow i feel like the sd card hack does not work anymore with the latest build?

EDIT: After deactivating the raw_twk.mo Module i get again faster writing speeds. So 2.5k works again!
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: kimbray on January 16, 2019, 10:20:34 PM
Is there any differnece on this code on eos M vs M3. I have original M running older ML code. Wondering if any benefit to going to M3. Thanks
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on January 16, 2019, 10:37:41 PM
darthivm. Thanks for telling about raw_twk conflict.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: henricusmaria on January 17, 2019, 02:18:43 AM
Report on crop_rec_4k_mlv_snd_isogain_1x3_presets_2019Jan15.EOSM202
Unfortunately it introduces corrupted frames in all clips in both modes i used (1x3, 3K crop ).
On the plus side, there's magnified live view in 1x3 (stretched and somehow it show area of top right part from the frame) so you can alternate between framing and real time live view focusing (as it works in 2.5K mode).

I also got corrupted frames in all clips in the 1x3 mode with the jan15 build. 2.5k mode works fine. 1080mv(1736x1158) still has the high shutter speed.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: henricusmaria on January 17, 2019, 04:59:50 AM
What settings did you use?
I also uploaded a new 16 january build. Might work better.

Jan16 build seems to work fine.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: briwil on January 17, 2019, 07:46:13 AM
How are you guys getting the 1x3 to work in MLV app? Keeps coming in at 1.0x for width stretch and .33x for height stretch (yes, 1.4).
Where are you guys getting this newer version of MLV app? Surely most people here aren't building and compiling it themselves?
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: masc on January 17, 2019, 07:53:31 AM
How are you guys getting the 1x3 to work in MLV app? Keeps coming in at 1.0x for width stretch and .33x for height stretch (yes, 1.4).
Where are you guys getting this newer version of MLV app? Surely most people here aren't building and compiling it themselves?
Get source code and compile. It is so easy!
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: briwil on January 17, 2019, 08:40:22 AM
Get source code and compile. It is so easy!
pshhh... Yeah right-what the hell is QTCreator? How do I use MinGW?? I hate windows as it, now I have to open up Visual studio? I'm exhausted already.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: masc on January 17, 2019, 08:43:59 AM
pshhh... Yeah right-what the hell is QTCreator? How do I use MinGW?? I hate windows as it, now I have to open up Visual studio? I'm exhausted already.
QtCreator is a Development Suite which installs more or less automatically, MinGW inclusive. No need for Visual Studio, that won't work. If you hate windows you can also do that on Linux or OSX. This process is 99.9% identical.

But if you don't like to use the latest revision, you also can force resize output resolution (export settings) and stretch your 1x3 file in this way. The result will be the same.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on January 17, 2019, 12:14:57 PM
New build:
https://www.magiclantern.fm/forum/index.php?topic=9741.msg208959#msg208959

Need testing for corrupted images, or lack from them. If you still get corrupted frames in 1x3 binning mode 2.35:1 setting try 'framing' preset in RAW video instead of Auto.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: AF-OFF on January 17, 2019, 12:16:30 PM
What settings did you use?
I also uploaded a new 16 january build. Might work better.

Hi , was previously using magiclantern-Nightly.2018Jul03.EOSM202_mv1080p,
used those settings - see my post #1595 in this thread.

testing Danne's Jan16 build, focusing on the 2,5k preset.
- what didn't change : after starting the cam, first have to go to ML Menu and out of it again to activate RAW video. (no need for this anymore if sd-uhs script set to autorun, this will do it automatically)
- what did change : halfshutter hold to temporaly switch from realtime to framing does not work anymore only the other way round. if activated sd_uhs  either way (run or autorun script) halfshutter (switch from realtime to framing) doesn't work
either. Also there is a haze of vertical greenisch lines in the croped display on the eos-m. this will not appear in the recording.

this jan16 build seems to be more stable, in terms of corrupted frames and videos.
with the 95MB Sandisk 128GB I can record continuously with sound @ 20Frames/sec.

Anyway, Thank You Danne, keep up the good work.

 





Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on January 17, 2019, 12:53:06 PM
Thanks.
The green haze comes of roundtrips when lowering bitrate. It's either that or a darkened liveview.
Yes, true when HalfShutter is set in clear overlays real-time setting will not work as before. Using Halfshutter set is to have a steady preview avoiding eosm to get stuck in real-time when going in and out of framing/real-time. Will have to think about it some more.
If this build is working without corruption with 1x3 binning it would be very nice.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: AF-OFF on January 17, 2019, 02:10:09 PM
Yes, true when HalfShutter is set in clear overlays real-time setting will not work as before.

hi Thank Danne for this info !
--> ML Menu / Display / Clear overlays OFF
After power up the cam next time, it turns back to --> ML Menu / Display / Clear overlays HalfShutter.

Will Do more testing with the 1x3mode later.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on January 17, 2019, 02:22:11 PM
Yes, HalfShutter is set via the enable sd_uhs hack lua script if you use that together with the 1x3 binning mode. Once set you will have to manually change settings upon restart.
Either this step is let out and we face real time liveview stuck bugs and we remember to set Halfshutter manually if we remmeber. Or trying to fix the bug so we don´t need to enable HalfShutter at all. Checking mlv_lite it´s very hard to nail down why this happens. Could be this(mlv_lite.c):
Code: [Select]
    /* fixme: any call to raw_update_params() from another task
     * will reset the preview window (possibly during our preview)
     * resulting in some sort of flicker.
     * We'll take care of our own updates with settings_sem.
     * Raw overlays (histogram etc) seem to be well-behaved. */

EDIT:
I checked and see the lua script isn´t cheking for crop mode preset. Could add that to the scrip. Meanwhile. Erase this in the script if you want to skip automation:
Code: [Select]
      if camera.model_short == "EOSM" then
        if menu.get("Display", "Clear overlays", "") ~= "HalfShutter" then
            menu.set("Display", "Clear overlays", "HalfShutter")
           display.notify_box("enabling GD Halfshutter")
          msleep(500)
        end
      end

and...
Code: [Select]
      if camera.model_short == "EOSM" then
        if menu.get("Display", "Clear overlays", "") ~= "HalfShutter" then
            menu.set("Display", "Clear overlays", "HalfShutter")
             menu.set("RAW video", "Preview", "Framing")
           display.notify_box("enabling GD Halfshutter")
          msleep(1500)
        end
      end


EDIT:
Updated the lua script so new build:
https://www.magiclantern.fm/forum/index.php?topic=9741.msg208959#msg208959

Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: AF-OFF on January 17, 2019, 03:59:13 PM

Thanks again Danne. Will check the new 1x3 mode asap.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: javchz on January 17, 2019, 06:41:13 PM
Wow Danne this last build it's amazing, i'm getting more frames than before, Going to play with the new 1x3 mode. Thanks again :D
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: briwil on January 17, 2019, 08:14:39 PM
Can someone help me here- so I complied the MLV app on my mac, but still same issue. When I shoot with the '1x3 1736x2150' crop mode, and my resolution set to 1504x1920, my file is still opening in MLV with Width stretch at 1.0x and height stretch at 0.33x.
I can't change width stretch to 3.0x because 2.0x is the max in the pulldown menu. I want to export my footage out as CinemaDNG.

Compiling the MLV app still shows ver 1.4, should the newer commits show a different version?


(https://www.magiclantern.fm/forum/proxy.php?request=https%3A%2F%2Fi.ibb.co%2Fqjjm6Sw%2FScreen-Shot-2019-01-17-at-11-05-04-AM.png&hash=18596b2ac0f0ada5237b17a11357dcd7) (https://ibb.co/qjjm6Sw)

(https://www.magiclantern.fm/forum/proxy.php?request=https%3A%2F%2Fi.ibb.co%2FN7c4Qnk%2FScreen-Shot-2019-01-17-at-11-05-10-AM.png&hash=b8fe5aab75bce77f7fb403112a5020c8) (https://ibb.co/N7c4Qnk)
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: masc on January 17, 2019, 08:25:14 PM
@briwil: all is correct and as it shall be. Just export and you'll see. Info panel shows always the resolution of your clip. Your clip should look right in the viewer, doesn't it? What the viewer shows and MLVApp exports (by standard) is always upsampled for v1.4+.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: briwil on January 17, 2019, 08:43:20 PM
@briwil: all is correct and as it shall be. Just export and you'll see. Info panel shows always the resolution of your clip. Your clip should look right in the viewer, doesn't it? What the viewer shows and MLVApp exports (by standard) is always upsampled for v1.4+.

Ahh, got it! Confusing as hell, but got it.

Does anyone have a recommended setting/resolution for least jello with best resolution?
The 4k resolutions are giving me serious shutter roll if I move even the slightest.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Upstep on January 17, 2019, 11:13:04 PM
@Danne
Did some 1x3 recording testing on the Jan17 build, and so far it seems promising.
I did about 5minutes+ of video clips in good light. (13 clips in total)
- Most of the clips came out without corruption.
- Some had 1 or 2 corrupted frames. (Still usable)
- 1 clip came out with a lot of corrupted frames. (I can't figure out why, but it was fixed after restarting the camera, so it's probably nothing)
- Sometimes gives a "frame order error" when recording.
Settings I used were your preset on 1x3, 10bit, 2.35:1, sd_uhs, 100 iso, 23.98fps and Preview set to framing (as you stated it may help)

Hope this info helps.
Getting really close!
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: henricusmaria on January 18, 2019, 06:44:44 AM
Thanks for feedback guys.

@henricusmaria
12bit is better and very close to 14bit in quality. 10bit will work most of the time imo.

Sorry to come back at this, I think I wasn’t clear in my question. I wanted to ask if there is a big difference in using the 10, 12 and 14 bit uncompressed raw settings. Or is it better to shoot in lossless 14 bit raw? I’ve been doing some footage in movie crop mode with the 12 and 14 bit uncompressed raw setting. Is the difference between uncompressed and lossless neglible? Thanks
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on January 18, 2019, 07:38:03 AM
Thanks Upstep for tests. Those are my exact observations also. I did some tweaks further very late yesterday. If you or others could run this build and it's not worse or maybe better I will say I keep this version.

@henricus....
There is no visible difference between lossless and uncompressed. Test, compare, read and you'll see why.

Regarding bad frames. The cpu runs much heavier when framing is running. Realtime view not so very much. I guess if one stays longer in real time modes chances for less bad frames are bigger.

Also. It is possible that the sd_uhs overclocking procedure is causing trouble. I never had a corrupted frame when not using overclocking with 1x3 binning modes.
What can I say. It's bleeding edge.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: zzzeosm on January 18, 2019, 07:51:31 AM
Are there any instruction for new builds? :o i was got some troulble with the setting menu.
thanks for all you guys doing and testing with eosm.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: masc on January 18, 2019, 12:07:19 PM
I did some tweaks further very late yesterday. If you or others could run this build and it's not worse or maybe better I will say I keep this version.
I am not sure if it is because of much light outside today, but in 20sec I got 5 corrupted frames with latest build. So it seems not to be better than the build before for me.

Edit: in same conditions as yesterday (office room) I got for another 20 sec clip 0 corrupted frames... hmmmmmm ;)
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: AF-OFF on January 18, 2019, 04:43:11 PM
hi
just tested Danne's new Jan18's build with 1x3 preset.
1504x1920, 24fps, with audio.
MLV.app on HS 13.1 - now exporting as 4512x1920,
no single corrupted frame. recording continuous, the longest clip ca. 45sec.
looks promising, will test also the HD and 2,5k presets later.

really awesome work Danne!


Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on January 18, 2019, 04:48:52 PM
Great! Been testing timing registers all day. The last three uploads seems to work really well.
Also make sure you tested the latest. They are all named the same today ;).
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: bergamote on January 18, 2019, 08:59:45 PM
Man, I can't keep up with this frenetic development schedule  :D
I tested the 1x3 mode in dual iso with the 14jan build (reliably corrupted frames), then the 16jan build and had no corrupted frames but had to be quite underexposed for it to be continuous. On ML's histogram I have to leave between two and three columns (EV?) on the right empty.

About dual iso processing in MLV App, is there a sure fire way to bring the shadows back, like say +1 exposure or +X shadows, or you just play it by eye?
Also, sometimes I do get some kind of flickering in the shadow/midtones, exactly like @loknar has in some shots of his windy winter day vid (great footage btw, shame youtube compresses the hell out of it. Maybe uploading in 4k...?).

Gonna try today's build tomorrow (by which time it will be totally outdated  :P)
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: bobolee on January 19, 2019, 07:11:43 AM

(https://www.magiclantern.fm/forum/proxy.php?request=https%3A%2F%2Fi.ibb.co%2FhF4McSr%2FP90119-133010.jpg&hash=b4a095ab35142fcdf0f3ce13bb3d2ec1) (https://ibb.co/hF4McSr)

(https://www.magiclantern.fm/forum/proxy.php?request=https%3A%2F%2Fi.ibb.co%2FyYkrk4n%2FP90119-132951.jpg&hash=d39e668e500cee093868ae7b77a77a73) (https://ibb.co/yYkrk4n)

(https://www.magiclantern.fm/forum/proxy.php?request=https%3A%2F%2Fi.ibb.co%2F41sSyZT%2FP90119-132831.jpg&hash=64a6b4e0419c3f31c5070ca594938c7d) (https://ibb.co/41sSyZT)

66 yuan(about 10 US dollar)for the fake battery kit,able to take hold of np-f970 f770 f550 etc,50 yuan for the grip,128 yuan battery kit:third party np-f970 with a charger,sdxc:128g sandisk extreme pro
I've tried recent builds,I think the most usable mode is mv1080p 23.976fps raw on 1736*976(16:9) 14bit lossless.Need to use sd overclocking.Post processing:mlv app,convert to cinema dng,drag and drop to premiere pro cc 2017,my complaints are the noises and hot pixels,mostly moire pattens. Other modes seem to have all kinds of issues which make them purely experimental not practically usable as a proper video camera.Looking forward to have more usable mode,thank you.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: AF-OFF on January 19, 2019, 03:58:43 PM
just tested again my footage from yesterday and realized I made a mistake - have to turn off the "drop frame mode" in -> MLV App/Display.
unfortunately out of nine clips, in three of them, one frame is corrupted.
will do further testing later.

many Thanks to Danne and others!


Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on January 19, 2019, 04:03:09 PM
It´s cool. Still a work in progress:
https://www.magiclantern.fm/forum/index.php?topic=9741.msg208959#msg208959
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Jonit on January 19, 2019, 05:28:20 PM
Danne, this is unreal!  :o
I have been playing with it yesterday and today for a couple of hours... testing high res, high fps and dual iso modes.
This is like dream coming true slowly, Its really blowing my mind what you guys can do with these tiny cameras.
Especially I am blown away by 50fps mode. I set fps to 48fps and horizontal res to 1600px (2.35:1) and it is working superbly. Now and then it skips or freezes on one frame but other than that, it is awesome. I think my card is not fast enough to sustain higher res, cos I am getting somewhere arounf 35MB/s writing speeds with SD hack on. (SanDisk Extreme UHS-3 32GB)

In other modes (1x3 binning - the last one) I am getting a few pink frames.

Anyway.. I am super stoked about this!
Thank you and keep up the awesome work Danne.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on January 19, 2019, 05:37:19 PM
Great to hear that it´s working. Almost without quirks. All reports on corrupted images are welcome. I am still tweaking and testing.
Yes, a faster card should work with around 54-55mb with the hack enabled. I am using a sandisk 95mb extreme pro I think it´s called. Not sure what other cards are working or not. A1ex has all the insights...

By the way Jonit. What 50fps setting are you using? There are two:
CROP_PRESET_3x3_mv1080_50fps_EOSM
CROP_PRESET_3x1_mv720_50fps_EOSM
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: AF-OFF on January 19, 2019, 11:42:20 PM
hi
just downloaded Danne's last jan19 build and did some little testing with the 1x3 mode
from 5 clips only one has had two corrupted frames just from start - the first white, the second 'normal corruption'
waiting for tomorrow to do more tests.


(https://www.magiclantern.fm/forum/proxy.php?request=https%3A%2F%2Fi.ibb.co%2FXbXDcq6%2Fjan19-build-test.jpg&hash=675795b10e5eb8ff72cfcad138cbf01d) (https://ibb.co/XbXDcq6)


Image seems to look identical to what I saw on the camera display
settings - 2,35:1, realtime LV, sound, 10bit.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: ctfire on January 20, 2019, 12:59:59 AM
Great to hear that it´s working. Almost without quirks. All reports on corrupted images are welcome. I am still tweaking and testing.
Yes, a faster card should work with around 54-55mb with the hack enabled. I am using a sandisk 95mb extreme pro I think it´s called. Not sure what other cards are working or not. A1ex has all the insights...

By the way Jonit. What 50fps setting are you using? There are two:
CROP_PRESET_3x3_mv1080_50fps_EOSM
CROP_PRESET_3x1_mv720_50fps_EOSM



Also have the same sandisc card but with sd_usd hack the speed not getting higher than 35mb\s ... with old builds it was around 45 mb/s
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on January 20, 2019, 09:33:19 AM
You can test your card through bench  module(not included in this version but get it from one nightly build).
If you run most presets continuous when set to 10bit, 2.35:1, sd_uhs hack on it should be ok. Works here.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: AF-OFF on January 20, 2019, 03:06:18 PM
hi
some results testing Danne's last jan19 build.
camera settings from canon menu - videosystem NTSC, 1920x1080@24
camera settings from ML menu - Overlay>GD on all modes, Focus peak ON, Movie>RAW video>Preview Real-time (Halfshutter press to frame, works great!) , Sound ON


 1.,    the mv1080p 1736x1158 mode (which is 3:2 ratio, same as the sensor, could this be fixed in the croprec/ratio menu? ) records 1736x976 (16:9), (does not change even if I set Aspect ratio to 3:2 in RAW video) @ 24fps without problems. very nice. did a 15 min. recording, cam temperature stays at 48°C, no frames corrupted. green record indicator all the time.
 2.,    the mv720p 1736x696 50fps mode, longest continuous recording ca. 1min. with average of 30-40 sec. continuous, has some corrupted frames, out of a 1200 frames recording it has 14 corrupt frames, another 300 frames recording has one. the bottom of all clips has a approximately 10 pixel thin line in all clips with 50fps. all clips have to be transformed in MLV App to 1,67x height.
3.,     the mv1080p 1736x738 50fps mode, continuous recording between 500 to 800 frames, no bottom pink line, ca. 3-4 corrupt frames per clip.
4.,     the mv1080p 1736x976 45fps mode, continuous for average 200frames, the beginning of most clips heavily corrupted, then ok, one clip without any corrupt frames, no bottom pink line. no transform required
5.,     the 2.5k 2520x1418 mode, 20fps, no corrupt frames, continuous (did 5min. recording)
     
------changed my canon video setting from NTSC, 1920x1080@24 to PAL and 1280x720@50
6.,    the mv720p 1736x696 50fps mode again , max 15 sec. record time, the thin whitisch bottom line still there, the many corrupted frames at the beginning not there anymore, got ca. 5 corrupt frames out of 500
------changed my canon video setting from NTSC, 1920x1080@24 to PAL and 1920x1080@25
7.,   the mv720p 1736x696 50fps mode again, longer recording time up to 20sec., whitish bottom line present, out of 1200 frames only six or seven corrupted
------same canon settings ( PAL and 1920x1080@25) - this didn't work, changed back to NTSC and 1920x1080 30p, broke the whole thing, reseted everything, using again NTSC and 1920x1080 24p.
 
    got the bench.mo from the experimental lua build, skips read speed, no bitmap file saved, write speed of the sandisk extr. pro 128gb goes up to 56 MB/s, one time read speed was reported to be 72 MB/sec - this would be great as write speed .... just kiding

used the august build before, which was good but more unstable, sometimes a complete clip was corupted, once or twice I've got a corrupted frame in a 2.5k crop rec. more difficult to get it running at all, now this changed dramatically, one can switch between the modes easily.

many thanks to Danne and others!


Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: AF-OFF on January 20, 2019, 03:22:02 PM
@ Danne >thanks for the new jan20 version!

Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Tullen on January 20, 2019, 03:39:59 PM
SUPER BLOOD MOON.

This development speed is insane and great. In current options, what would you recommend for capturing the super blood moon tomorrow morning? I have a 220mm F4.0 that I though I could use with the options with highest crop and best light handling. Or should I go for the 135mm F2.8? Dual iso I guess would be good too. Any suggestions for settings and workflow?

Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: AF-OFF on January 20, 2019, 03:44:03 PM
Does anyone have a recommended setting/resolution for least jello with best resolution?
The 4k resolutions are giving me serious shutter roll if I move even the slightest.

as far I understand this, try to use a shutter speed which comes closest to 180 degrees - like 173° or 191°.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: AF-OFF on January 20, 2019, 04:13:59 PM
SUPER BLOOD MOON.

This development speed is insane and great. In current options, what would you recommend for capturing the super blood moon tomorrow morning? I have a 220mm F4.0 that I though I could use with the options with highest crop and best light handling. Or should I go for the 135mm F2.8? Dual iso I guess would be good too. Any suggestions for settings and workflow?

thanks for the info Tullen. and good luck with it! hopefully there are no clouds
I would suggest to use the f4 220mm . also the 2.5k preset, and lower the framerate so You can use even 5.6 or 8 as aperture, to get the best sharpness of the lens, if this is not at f4.
dual iso maybe not that good for this.
hope to catch it here in Berlin too

 
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Tullen on January 20, 2019, 04:16:48 PM
@ AF-OFF

Thanks for the help. Any recommendations for how to get proper exposure. Since the light falling on the moon will change as the shadow disappears.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: AF-OFF on January 20, 2019, 04:31:28 PM
I would take care of the sensor saturation. like overexposing a bit rather then underexposing.
hard to tell, because the moon is still very bright, but I think there would be a better result if You recover highlights then shadows
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Tullen on January 20, 2019, 05:30:12 PM
Regarding motion blur. What shutter speed do you think is good? 1/125 or faster?
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on January 20, 2019, 05:38:01 PM
AF-OFF. Thank you!
Will dive into this when I get more time. Goal to have solid none corrupted recordings. We'll see how far it goes...
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: loknar on January 20, 2019, 05:41:53 PM
Regarding motion blur. What shutter speed do you think is good? 1/125 or faster?
You can compute it.
Moon does (approximately) 360 degrees in 24 hours, that's 12 degrees in one hour, that 720 arcminutes in 1 hour, that's 12 arcminutes in one minute, that's 720 arcseconds in one minute, that's 12 arc seconds in one second.
Now you lens have Field-of-view, and you sensor specific resolution, so you can compute what angle one pixel covers and then you can compute by how many pixels FOV shifts and then you want is to use time during which moon moves less that half of pixel.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Walter Schulz on January 20, 2019, 05:55:03 PM
@Tullen: Don't get overexcited about "super" moon. It's not that much a difference and blood moons are not that rare.
(https://www.magiclantern.fm/forum/proxy.php?request=https%3A%2F%2Fupload.wikimedia.org%2Fwikipedia%2Fcommons%2Fc%2Fca%2FSupermoon_comparison.jpg&hash=422961185e778177eb8b3a4bc9971e73)
Source: Wikepedia

Naked eye may not see a difference at all ...
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: HappyBlack on January 20, 2019, 08:30:00 PM
Guys, what settings would you recommend for shooting video with an 2x anamorphic adapter in front of the EOS M?

Looking for 1:1 or 4:3 in-camera aspect ratio, tops.

The new 1x3 pixel binning looks gorgeous, but I can't use 2.35:1, since after anamorphic desqueeze it'll turn into a terrifying 4.7:1


Regards.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Upstep on January 20, 2019, 08:53:29 PM
@HappyBlack
You can use the mv1080p mode from crop_rec. (3x3 binning)
You can get 3:2 1736x1158.
But if you really need 4:3 set the horizontal resolution in the raw settings to "1600" and you'll be able to get "4:3" 1600x1158. (crops in a bit)

Probably your best bets
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: HappyBlack on January 20, 2019, 09:11:15 PM
Great, thank you very much @Upstep!
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: briwil on January 21, 2019, 03:36:37 AM
How does the upscaling work, its via metadata? If I open 1x3 DNG files in Premiere, it opens correct, but if I bring them into Resolve, they are 1/3 the horizontal resolution (1500something vs 4500something). Is there a way to work with Resolve, vs just scaling it up horizontally 300%? Or is scaling it up 300% basically the exact same thing as what Premiere is doing?
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: masc on January 21, 2019, 08:01:16 AM
Upscaling works via metadata in cdng, right. I also saw that Resolve seems not to be able to scale automatically - whyever. But in editor there is a possibility to scale X axis by 300%.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: thehaxfactory on January 21, 2019, 03:06:26 PM
I hate to ask as I feel like this is likely known information posted somewhere (I haven't been able to find it despite reading half of this thread and searching several times both here and on Google), but if I was to pick up an EOS M would I be able to use it as a webcam for streaming with a capture device and what would the limitations be?

I'd like to find something better than the standard Logitech C920 webcams used all over Twitch, but wouldn't have a huge budget to do so (I mean I can go up to a T3i and I know that should work, I'd just rather not). Plus, if I'm honestly, I did go to school for film and I've wanted a DSLR for years, but could never afford one. Besides, I would need something that can perform double duty like this.

I like the form factor of the EOS M and you really can't beat that price tag either, so if it'd work, it'd really be the ideal choice for me right now.

I know it doesn't support the capture over USB feature.
I am pretty sure I can get clean HDMI output with Magic Lantern from what I've read.
I've heard some things about the video output being locked to 1080i.
I wouldn't be recording while in this mode, I hear time out may be a problem?

I'm just trying to get a feel for this.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Walter Schulz on January 21, 2019, 06:18:40 PM
https://www.magiclantern.fm/forum/index.php?topic=20908.msg193014#msg193014
Applies to EOS M running experimental build "lua_fix", too.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: thehaxfactory on January 21, 2019, 08:53:36 PM
Okay, so I can use a script to functionally kill the timeout.

Does that mean the other things I've researched are correct?

I think the saddest loss for me would be forced 1080i, I'm not quite sure how well trying to deinterlace the footage while streaming would work out.

And thank you for putting up with this odd question.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Walter Schulz on January 21, 2019, 10:05:59 PM
Can't answer that. Not owning an M and there are some pitfalls with M (mv720 ...) and some exciting new developments.
I hope dfort may have an answer about M's HDMI output in photo liveview and non-recording movie liveview.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on January 21, 2019, 10:27:31 PM
New version:
https://www.magiclantern.fm/forum/index.php?topic=9741.msg208959#msg208959


1.,    the mv1080p 1736x1158 mode (which is 3:2 ratio, same as the sensor, could this be fixed in the croprec/ratio menu? ) records 1736x976 (16:9), (does not change even if I set Aspect ratio to 3:2 in RAW video) @ 24fps without problems. very nice. did a 15 min. recording, cam temperature stays at 48°C, no frames corrupted. green record indicator all the time.
Just leave the ratios options altogether to get the full sensor readout.

2.,    the mv720p 1736x696 50fps mode, longest continuous recording ca. 1min. with average of 30-40 sec. continuous, has some corrupted frames, out of a 1200 frames recording it has 14 corrupt frames, another 300 frames recording has one. the bottom of all clips has a approximately 10 pixel thin line in all clips with 50fps. all clips have to be transformed in MLV App to 1,67x height.
Fixed the bottom line.

Regarding pink frames. Main goal is to have the 2.35:1 ratio working corruptionless in all modes. Might be hard but with some hard work and testing maybe possible.
Speaking of helping out. I added some registers in the submenu in crop_rec. Those can be used to tweak on going builds to test and optimize corruption issues:
(https://www.magiclantern.fm/forum/proxy.php?request=https%3A%2F%2Fi.postimg.cc%2FTwFLykQ9%2FVRAM0-PPM-500px.png&hash=d0ec50cb2e93dc20269eba297f0ef162)

For instance. If you notice corruption try reducing 713c a couple of steps. Try also that with 7150 and test record again a few clips.
There also the timers. Pushing 6014 will reduce fps and to push it back up you can reduce the 6008 register. The process can be done the outher way around as well. Report any good numbers here and I can test them out.
The 6804 height and width might not be so easy to play with so maybe leave those alone for now.


Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on January 21, 2019, 11:32:04 PM
Pushed this fix into the code which seems to have fixed mv1080p 50 fps preset from corrupted frames. Also a good example on how to use the registers together.
(https://www.magiclantern.fm/forum/proxy.php?request=https%3A%2F%2Fi.postimg.cc%2FgjQNcFxH%2FVRAM0-PPM-500px.png&hash=8df1991316fb86c998d010274da2b8c8)
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: optical-work on January 22, 2019, 12:56:32 AM
when i use dual iso with 1x3 preset, mlv app chroma smooth settings don't fix focus pixels whether or not fix bad pixels and fix focus dots are turned off. tried with different iso values on 2019Jan20 build.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: bergamote on January 22, 2019, 01:00:08 AM
Shot a few 30s clips in 1x3 with the jan20 build and no corrupted frames! Didn't try dual iso because it didn't seem to crash as much with overexposure (still a bit tho).
Very handy to have the half-press live view for focusing! Framing view does break every now and then (just doesn't come back after half-press) but disabling then re enabling raw video brings it back.
Also found out that raw video needs to be switched on BEFORE running the sd overclock script for it to work. Might be obvious but it took me a mo to work it out.

This is very cool stuff, the image quality is bonkers and it's getting more practical and usable by the day. Thanks a million Danne!
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: bergamote on January 22, 2019, 01:08:18 AM
when i use dual iso with 1x3 preset, mlv app chroma smooth settings doesn't fix focus pixels whether or not fix bad pixels and fix focus dots are turned off. tried with different iso values on 2019Jan20 build.
Same here even without dual iso. I s'pose it's a matter of new use, new focus pixel. If I understood well, dfort could look into this once we know which settings work reliably.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on January 22, 2019, 07:12:02 AM
Is framing working better when Clear overlays 'HalfShutter' is set? Less breaks?
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: optical-work on January 22, 2019, 01:30:59 PM
Same here even without dual iso. I s'pose it's a matter of new use, new focus pixel. If I understood well, dfort could look into this once we know which settings work reliably.

Chroma smooth works without dual iso but i guess it isn't meant to be applied after dual iso post process. because same thing happens with other crop modes.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: bergamote on January 22, 2019, 03:10:34 PM
@Danne
yep, clear overlays does the trick, cheers!

@optical-work
I see. Here, in 1x3 without dual iso, chroma smooth definitely makes the focus pixels less visible but they don't totally go away.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: dfort on January 22, 2019, 05:20:21 PM
Chroma smooth works without dual iso but i guess it isn't meant to be applied after dual iso post process. because same thing happens with other crop modes.

Focus pixel removal on dual iso should be done before it is processed. To get a better understanding why read the Dealing with Focus Pixels in raw video (https://www.magiclantern.fm/forum/index.php?topic=16054.0) topic. Start from this post (https://www.magiclantern.fm/forum/index.php?topic=16054.msg161616#msg161616) and read the following several replies.

Focus pixel removal is basically chroma smoothing applied to specific areas instead overall. For example, let's zero in on a focus pixel and the pixels immediately adjacent to that focus pixel.

0 | 0 | 0
0 | X | 0
0 | 0 | 0


Averaging in the color of the surrounding pixels will hide that focus pixel. However, focus pixels are often in diagonal pairs which means that averaging in the diagonally adjacent pixels won't work.

0 | 0 | 0
0 | X | 0
X | 0 | 0


With dual iso every pair of rows is a different iso. Why not every row? Because of the Bayer pattern of raw video.

0 | 0 | 0
0 | X | 0
X | 0 | 0


So what happens if your subject happens to have a high contrast vertical line in it that is right next to that focus pixel in the middle of this illustration?

0 | 0 | 1
0 | X | 1
X | 0 | 1


Here is an example of what happens if you average the adjacent pixels on dual iso:

(https://www.magiclantern.fm/forum/proxy.php?request=https%3A%2F%2Ffarm2.staticflickr.com%2F1535%2F24656585222_f776c2a2f3_z.jpg&hash=811afaefc93a14c5cf8db981d0a9de4e)

As you can see, dealing with focus pixels with dual iso is challenging.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: thehaxfactory on January 22, 2019, 06:08:24 PM
I'm sorry to ask again, but I believe my question might be getting buried.

What are the limitations of HDMI output?

I'd be interested in hooking up an EOS M to a capture card.

I had heard you can get clear output with Magic Lantern, but I've also heard there are resolution limitations.

But with everything so constantly changing and it not being talked about explicitly I've found it hard to track down definitive information.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: dfort on January 22, 2019, 06:18:56 PM
What are the limitations of HDMI output?

I'd be interested in hooking up an EOS M to a capture card.

I had heard you can get clear output with Magic Lantern, but I've also heard there are resolution limitations.

You don't really need Magic Lantern to hook up the EOSM to HDMI and get clean output (no overlays). As far as I know it doesn't put out a full HD signal. When I tried it the image had a black area around it on the screen. Another issue is that the camera LiveView goes dark, it doesn't mirror the way the 5D3 does with the later firmware updates.

@DeafEyeJedi has experience hooking up an Atmos Ninja to the EOSM so you might want to contact him about it.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on January 22, 2019, 06:19:40 PM
4:2:0 - no raw.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Walter Schulz on January 22, 2019, 06:39:37 PM
You don't really need Magic Lantern to hook up the EOSM to HDMI and get clean output (no overlays). As far as I know it doesn't put out a full HD signal. When I tried it the image had a black area around it on the screen. Another issue is that the camera LiveView goes dark, it doesn't mirror the way the 5D3 does with the later firmware updates.

@DeafEyeJedi has experience hooking up an Atmos Ninja to the EOSM so you might want to contact him about it.

thehaxfactory doesn't own an EOS M. ATM he is thinking about it. And intended use is streaming, thus 30 min timeout without ML is actually an issue. So he is asking about resolution (non-recording modes).

@thehaxfactory:
Another issue is that the camera LiveView goes dark, it doesn't mirror the way the 5D3 does with the later firmware updates.

What dfort is trying to say: As soon as HDMI connection is used M's LCD screen goes black. You can have either cam's monitor *or* external, not both the same time. Which is btw how most ML supported cams work.


I think it would be interesting to know how M's HDMI output is doing compared to cams not hampered by mv720 (if this is an issue at all with HDMI streaming).


Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Walter Schulz on January 23, 2019, 05:57:34 PM
In other news: Recent EOS M developments covered at Slashcam.
https://www.slashcam.de/artikel/Erfahrungsberichte/---2-5K--3K--4K--Die-Canon-EOS-M-als-Mini-RAW-RebelCAM-mit-Magic-Lantern.html
German only, sorry! Just took a glimpse, seems to be correct (not happening the first time, kudos!)

And now the watch is ticking for all those news aggregators to jump the bandwagon and mess it up.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on January 23, 2019, 07:56:31 PM
At least they tested and seem to know how to use the 1x3 bining mode  8)
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: masc on January 23, 2019, 08:07:03 PM
Not bad... all I can find what is not correct is max write speed of 40MB overclocked ( -> ~60MB ) and that you just get some frames in 1x3 binning... but we can get continous @ 4.5K 2.35:1 ;)
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: dfort on January 23, 2019, 08:08:49 PM
Wow, they even posted a link to Danne's downloads page:

Quote
Currently, one of the most avid EOS M co-developers (Danne) downloads new versions with corresponding presets almost every day, which can always be found here (http://bitbucket.org/Dannephoto/magic-lantern/downloads/).

Thanks Google Translate.

In other news, all this testing turned up a problem with one of the EOSM stubs.

@a1ex -- Which branch should we use for stub fixes?
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: henricusmaria on January 24, 2019, 02:07:56 PM
Is there a way to use autofocus with ml? I was hoping to be able to use the back button focus with the eos-m kitlens. But when I do I can only record for a couple of seconds. Is there a way to use the af lock in magic lantern and keep the normal recording times? That would be really convenient!
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on January 24, 2019, 08:06:16 PM
Pushed a new build:
https://www.magiclantern.fm/forum/index.php?topic=9741.msg208959#msg208959

This one needs some testing. Preview framing is now on default set to the same function as for Clear Overlays 'HalfShutter'. Means nothing has to be changed in Clear Overlays menu to ovecome the stuck real time issue. It´s probably not 100% rock solid but better then before. Test by simply start off and film longer takes with framing set in preview menu. If it behaves as it should like 95% of the time we are good to go.

Also note that without mlv_snd module enabled the stuck real time issue seems not to exist.
I spent a lot of time trying to see what is causing this lock. It mostly happens around 28 second into filming and often waithing for the next 30 second cycle reaching a minute it sometimes unlocks. Who can live with this  :P. I suspect some bmp_lock but why it´s happening I cannot explain. Why the zebra.c clearscreen code seems to help I can´t explain either...
Commit:
https://bitbucket.org/Dannephoto/magic-lantern/commits/c5668e08f01ead0bd915b3a6b6b7227ff88cec32


EDIT:
Still needs to create an exception for real-time preview. Will check into it.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: ctfire on January 24, 2019, 09:07:08 PM
Pushed a new build:
https://www.magiclantern.fm/forum/index.php?topic=9741.msg208959#msg208959

This one needs some testing. Preview framing is now on default set to the same function as for Clear Overlays 'HalfShutter'. Means nothing has to be changed in Clear Overlays menu to ovecome the stuck real time issue. It´s probably not 100% rock solid but better then before. Test by simply start off and film longer takes with framing set in preview menu. If it behaves as it should like 95% of the time we are good to go.



Also note that without mlv_snd module enabled the stuck real time issue seems not to exist.
I spent a lot of time trying to see what is causing this lock. It mostly happens around 28 second into filming and often waithing for the next 30 second cycle reaching a minute it sometimes unlocks. Who can live with this  :P. I suspect some bmp_lock but why it´s happening I cannot explain. Why the zebra.c clearscreen code seems to help I can´t explain either...
Commit:
https://bitbucket.org/Dannephoto/magic-lantern/commits/c5668e08f01ead0bd915b3a6b6b7227ff88cec32


EDIT:
Still needs to create an exception for real-time preview. Will check into it.


Just tested some footages from this new build, good news in preview in crop mode 1080mv, when i choose framing the preview became black and wight but good is that framerate of preview is more smoth then in older builds, and more usable overall . Thank you Danne
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on January 24, 2019, 09:40:19 PM
Yeah, I thought b & w was the better choice for speed reasons.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: jacquaviva on January 24, 2019, 10:42:27 PM
Thanks a lot. In my opinion full sensor raw is the best part of your hack. Is there any chance to make framing even smoother with mv1080 crop mode ?
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on January 24, 2019, 11:28:41 PM
Reverted for now:
https://www.magiclantern.fm/forum/index.php?topic=9741.msg208959#msg208959

Needs some more understanding before changing defaults.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: dfort on January 25, 2019, 02:00:29 AM
Speaking of needing some more understanding, there are some fails on the selftest module Stubs API tests that should probably be fixed. I was able to get a perfect score (https://www.magiclantern.fm/forum/index.php?topic=9741.msg201175#msg201175) a while back but trying to find the right combination of changeset, lens used (I know it wasn't an EF-M lens but an EF/EF-S lens with the adapter), camera settings and alignment of the stars has eluded me these past few days. It seems like maybe there is an incorrect stub but which one? Here's the section of code that is showing the problem.

modules/selftest/selftest.c
Code: [Select]
        /* enable autofocus on half-shutter */
        /* lv_focus_status expected to be 3 when focusing and 1 or 2 when idle */
        lens_setup_af(AF_ENABLE);
        module_send_keypress(MODULE_KEY_PRESS_HALFSHUTTER);
        msleep(200);
        TEST_FUNC_CHECK(HALFSHUTTER_PRESSED, == 1);
        if (lv) {
            TEST_MSG("[INFO] ****** EOSM/M2 usually fails here but sometimes passes ******\n");   
            TEST_FUNC_CHECK(wait_focus_status(1000, 3), == 1);
            TEST_FUNC_CHECK(lv_focus_status, == 3)
        } else {
            msleep(1000);
            TEST_FUNC_CHECK(get_focus_confirmation(), != 0);
        }

I put in some annotations to help debug the EOSM2.

Here's the full log. Notice that the only failing tests are the focus tests. This is with the EF-M 22mm f/2 prime lens but it is happening with all lenses in both movie and photo mode. Once today it passed a few of the tests using an EF lens on an adapter in photo mode but I couldn't replicate it. Seems like changing some of the Canon settings may have something to do with the test results. (https://www.magiclantern.fm/forum/index.php?topic=15895.msg210937#msg210937)

Code: [Select]
[Pass] is_play_mode() => 0x1
[INFO] Camera model: Canon EOS M 2.0.2 (0x80000331 EOSM)
[Pass] is_camera("DIGIC", "*") => 0x1
[Pass] is_camera(__camera_model_short, firmware_version) => 0x1
[Pass] src = fio_malloc(size) => 0x4de3609c
[Pass] dst = fio_malloc(size) => 0x4e63a0a8
[Pass] memcmp(dst, src, 4097) => 0x25
[Pass] edmac_memcpy(dst, src, 4097) => 0x4e63a0a8
[Pass] memcmp(dst, src, 4097) => 0x0
[Pass] edmac_memcpy(dst, src, 4097) => 0x4e63a0a8
[Pass] memcmp(dst, src, size) => 0x9c
[Pass] edmac_memcpy(dst, src, size) => 0x4e63a0a8
[Pass] memcmp(dst, src, size) => 0x0
[Pass] memcmp(dst, src, size) => 0x42
[Pass] edmac_memcpy_start(dst, src, size) => 0x4e63a0a8
       dt => 0x2949
[Pass] copied => 0x400558
[Pass] copied => 0x400558
[Pass] copied => 0x400558
[Pass] memcmp(dst, src, copied) => 0x0
[Pass] memcmp(dst, src, copied + 16) => 0x27
       edmac_memcpy_finish()
       free(src)
       free(dst)
Cache test A (EDMAC on BMP buffer)...
[Pass] bmp = bmp_load("ML/CROPMKS/CINESCO2.BMP", 1) => 0x80f2e0
[Pass] old => 0x0
[Pass] irq => 0xc0
[Pass] differences => 0x12ee
[Pass] old => 0x0
[Pass] irq => 0xc0
[Pass] differences => 0x0
Cache test B (FIO on 8K buffer)...
[Pass] tries[0] => 0xf1
[Pass] tries[1] => 0xf3
[Pass] tries[2] => 0xff
[Pass] tries[3] => 0x105
[Pass] failr[0] => 0x63
[Pass] failw[0] => 0xca
[Pass] failr[1] => 0x71
[Pass] failw[1] => 0x0
[Pass] failr[2] => 0x0
[Pass] failw[2] => 0xd4
[Pass] failr[3] => 0x0
[Pass] failw[3] => 0x0
       times[0] / tries[0] => 0x1e
       times[1] / tries[1] => 0x1d
       times[2] / tries[2] => 0x1d
       times[3] / tries[3] => 0x1d
Cache tests finished.

[Pass] HALFSHUTTER_PRESSED => 0x0
[Pass] HALFSHUTTER_PRESSED => 0x1
[INFO] ****** EOSM/M2 usually fails here but sometimes passes ******
[FAIL] wait_focus_status(1000, 3) => 0x0
[FAIL] lv_focus_status => 0x1
[Pass] HALFSHUTTER_PRESSED => 0x0
[Pass] wait_focus_status(1000, 3) => 0x0
[Pass] lv_focus_status => 0x1
[Pass] HALFSHUTTER_PRESSED => 0x1
[Pass] wait_focus_status(1000, 3) => 0x0
[Pass] HALFSHUTTER_PRESSED => 0x0
[Pass] lv_focus_status => 0x1
[Pass] HALFSHUTTER_PRESSED => 0x0
[Pass] HALFSHUTTER_PRESSED => 0x1
[INFO] ****** EOSM/M2 usually fails here but sometimes passes ******
[FAIL] wait_focus_status(1000, 3) => 0x0
[FAIL] lv_focus_status => 0x1
[Pass] HALFSHUTTER_PRESSED => 0x0
[Pass] wait_focus_status(1000, 3) => 0x0
[Pass] lv_focus_status => 0x1
[Pass] HALFSHUTTER_PRESSED => 0x1
[Pass] wait_focus_status(1000, 3) => 0x0
[Pass] HALFSHUTTER_PRESSED => 0x0
[Pass] lv_focus_status => 0x1
[Pass] HALFSHUTTER_PRESSED => 0x0
[Pass] HALFSHUTTER_PRESSED => 0x1
[INFO] ****** EOSM/M2 usually fails here but sometimes passes ******
[FAIL] wait_focus_status(1000, 3) => 0x0
[FAIL] lv_focus_status => 0x1
[Pass] HALFSHUTTER_PRESSED => 0x0
[Pass] wait_focus_status(1000, 3) => 0x0
[Pass] lv_focus_status => 0x1
[Pass] HALFSHUTTER_PRESSED => 0x1
[Pass] wait_focus_status(1000, 3) => 0x0
[Pass] HALFSHUTTER_PRESSED => 0x0
[Pass] lv_focus_status => 0x1
[Pass] HALFSHUTTER_PRESSED => 0x0
[Pass] HALFSHUTTER_PRESSED => 0x1
[INFO] ****** EOSM/M2 usually fails here but sometimes passes ******
[FAIL] wait_focus_status(1000, 3) => 0x0
[FAIL] lv_focus_status => 0x1
[Pass] HALFSHUTTER_PRESSED => 0x0
[Pass] wait_focus_status(1000, 3) => 0x0
[Pass] lv_focus_status => 0x1
[Pass] HALFSHUTTER_PRESSED => 0x1
[Pass] wait_focus_status(1000, 3) => 0x0
[Pass] HALFSHUTTER_PRESSED => 0x0
[Pass] lv_focus_status => 0x1
[Pass] HALFSHUTTER_PRESSED => 0x0
[Pass] HALFSHUTTER_PRESSED => 0x1
[INFO] ****** EOSM/M2 usually fails here but sometimes passes ******
[FAIL] wait_focus_status(1000, 3) => 0x0
[FAIL] lv_focus_status => 0x1
[Pass] HALFSHUTTER_PRESSED => 0x0
[Pass] wait_focus_status(1000, 3) => 0x0
[Pass] lv_focus_status => 0x1
[Pass] HALFSHUTTER_PRESSED => 0x1
[Pass] wait_focus_status(1000, 3) => 0x0
[Pass] HALFSHUTTER_PRESSED => 0x0
[Pass] lv_focus_status => 0x1
[Pass] HALFSHUTTER_PRESSED => 0x0
[Pass] HALFSHUTTER_PRESSED => 0x1
[INFO] ****** EOSM/M2 usually fails here but sometimes passes ******
[FAIL] wait_focus_status(1000, 3) => 0x0
[FAIL] lv_focus_status => 0x1
[Pass] HALFSHUTTER_PRESSED => 0x0
[Pass] wait_focus_status(1000, 3) => 0x0
[Pass] lv_focus_status => 0x1
[Pass] HALFSHUTTER_PRESSED => 0x1
[Pass] wait_focus_status(1000, 3) => 0x0
[Pass] HALFSHUTTER_PRESSED => 0x0
[Pass] lv_focus_status => 0x1
[Pass] HALFSHUTTER_PRESSED => 0x0
[Pass] HALFSHUTTER_PRESSED => 0x1
[INFO] ****** EOSM/M2 usually fails here but sometimes passes ******
[FAIL] wait_focus_status(1000, 3) => 0x0
[FAIL] lv_focus_status => 0x1
[Pass] HALFSHUTTER_PRESSED => 0x0
[Pass] wait_focus_status(1000, 3) => 0x0
[Pass] lv_focus_status => 0x1
[Pass] HALFSHUTTER_PRESSED => 0x1
[Pass] wait_focus_status(1000, 3) => 0x0
[Pass] HALFSHUTTER_PRESSED => 0x0
[Pass] lv_focus_status => 0x1
[Pass] HALFSHUTTER_PRESSED => 0x0
[Pass] HALFSHUTTER_PRESSED => 0x1
[INFO] ****** EOSM/M2 usually fails here but sometimes passes ******
[FAIL] wait_focus_status(1000, 3) => 0x0
[FAIL] lv_focus_status => 0x1
[Pass] HALFSHUTTER_PRESSED => 0x0
[Pass] wait_focus_status(1000, 3) => 0x0
[Pass] lv_focus_status => 0x1
[Pass] HALFSHUTTER_PRESSED => 0x1
[Pass] wait_focus_status(1000, 3) => 0x0
[Pass] HALFSHUTTER_PRESSED => 0x0
[Pass] lv_focus_status => 0x1
[Pass] HALFSHUTTER_PRESSED => 0x0
[Pass] HALFSHUTTER_PRESSED => 0x1
[INFO] ****** EOSM/M2 usually fails here but sometimes passes ******
[FAIL] wait_focus_status(1000, 3) => 0x0
[FAIL] lv_focus_status => 0x1
[Pass] HALFSHUTTER_PRESSED => 0x0
[Pass] wait_focus_status(1000, 3) => 0x0
[Pass] lv_focus_status => 0x1
[Pass] HALFSHUTTER_PRESSED => 0x1
[Pass] wait_focus_status(1000, 3) => 0x0
[Pass] HALFSHUTTER_PRESSED => 0x0
[Pass] lv_focus_status => 0x1
[Pass] HALFSHUTTER_PRESSED => 0x0
[Pass] HALFSHUTTER_PRESSED => 0x1
[INFO] ****** EOSM/M2 usually fails here but sometimes passes ******
[FAIL] wait_focus_status(1000, 3) => 0x0
[FAIL] lv_focus_status => 0x1
[Pass] HALFSHUTTER_PRESSED => 0x0
[Pass] wait_focus_status(1000, 3) => 0x0
[Pass] lv_focus_status => 0x1
[Pass] HALFSHUTTER_PRESSED => 0x1
[Pass] wait_focus_status(1000, 3) => 0x0
[Pass] HALFSHUTTER_PRESSED => 0x0
[Pass] lv_focus_status => 0x1
[Pass] f = FIO_CreateFile("test.dat") => 0x3
[Pass] FIO_WriteFile(f, (void*)0xFF000000, 0x10000) => 0x10000
[Pass] FIO_WriteFile(f, (void*)0xFF000000, 0x10000) => 0x10000
       FIO_CloseFile(f)
[Pass] FIO_GetFileSize("test.dat", &size) => 0x0
[Pass] size => 0x20000
[Pass] p = (void*)_alloc_dma_memory(0x20000) => 0x40862fbc
[Pass] f = FIO_OpenFile("test.dat", O_RDONLY | O_SYNC) => 0x3
[Pass] FIO_ReadFile(f, p, 0x20000) => 0x20000
       FIO_CloseFile(f)
       _free_dma_memory(p)
[Pass] count => 0x3a98
[Pass] buf = fio_malloc(0x1000000) => 0x4de3609c
[Pass] FIO_GetFileSize_direct("test.dat") => 0x82000000
[Pass] f = FIO_OpenFile("test.dat", O_RDWR | O_SYNC) => 0x3
[Pass] FIO_SeekSkipFile(f, 0, SEEK_END) => 0x82000000
[Pass] FIO_WriteFile(f, buf, 0x10) => 0x10
[Pass] FIO_SeekSkipFile(f, -0x20, SEEK_END) => 0x81fffff0
[Pass] FIO_WriteFile(f, buf, 0x30) => 0x30
[Pass] FIO_SeekSkipFile(f, 0x20, SEEK_SET) => 0x20
[Pass] FIO_SeekSkipFile(f, 0x30, SEEK_CUR) => 0x50
[Pass] FIO_SeekSkipFile(f, -0x20, SEEK_CUR) => 0x30
[Pass] FIO_GetFileSize_direct("test.dat") => 0x82000020
[Pass] is_file("test.dat") => 0x1
[Pass] FIO_RemoveFile("test.dat") => 0x0
[Pass] is_file("test.dat") => 0x0
[Pass] SetTimerAfter(0, timer_cbr, overrun_cbr, 0) => 0x15
[Pass] timer_func => 0x2
[Pass] SetTimerAfter(1000, timer_cbr, overrun_cbr, 0) => 0xb4b0
       msleep(900)
[Pass] timer_func => 0x0
       msleep(200)
[Pass] timer_func => 0x1
[Pass] ABS((timer_time/1000 - t0) - 1000) => 0x8
[Pass] ABS((timer_arg - ta0) - 1000) => 0xa
[Pass] timer = SetTimerAfter(1000, timer_cbr, overrun_cbr, 0) => 0xb51c
       msleep(400)
       CancelTimer(timer)
[Pass] timer_func => 0x0
       msleep(1500)
[Pass] timer_func => 0x0
[Pass] SetHPTimerAfterNow(0, timer_cbr, overrun_cbr, 0) => 0x15
[Pass] timer_func => 0x2
[Pass] SetHPTimerAfterNow(100000, timer_cbr, overrun_cbr, 0) => 0x32a1c
       msleep(90)
[Pass] timer_func => 0x0
       msleep(20)
[Pass] timer_func => 0x1
[Pass] ABS(DeltaT(timer_time, t0) - 100000) => 0x11c
[Pass] ABS(DeltaT(timer_arg, ta0) - 100000) => 0xf8
[Pass] ABS((get_us_clock() - t0) - 110000) => 0xffffff93
[Pass] SetHPTimerAfterNow(90000, next_tick_cbr, overrun_cbr, 0) => 0x32a1e
       msleep(80)
[Pass] timer_func => 0x0
       msleep(20)
[Pass] timer_func => 0x3
       msleep(80)
[Pass] timer_func => 0x3
       msleep(20)
[Pass] timer_func => 0x1
[Pass] ABS(DeltaT(timer_time, t0) - 300000) => 0x28
[Pass] ABS(DeltaT(timer_arg, ta0) - 300000) => 0xb
[Pass] ABS((get_us_clock() - t0) - 310000) => 0xffffffa7
       t0 = GET_DIGIC_TIMER() => 0x42af6
       msleep(250)
       t1 = GET_DIGIC_TIMER() => 0x7f3e6
[Pass] ABS(MOD(t1-t0, 1048576)/1000 - 250) => 0x2
       LoadCalendarFromRTC( &now )
       s0 = now.tm_sec => 0x2c
       Date/time: 2019/01/24 14:49:44
       msleep(1500)
       LoadCalendarFromRTC( &now )
       s1 = now.tm_sec => 0x2d
[Pass] MOD(s1-s0, 60) => 0x1
[Pass] MOD(s1-s0, 60) => 0x1
       m0 = MALLOC_FREE_MEMORY => 0x38d18
[Pass] p = (void*)_malloc(50*1024) => 0x136ad0
[Pass] CACHEABLE(p) => 0x136ad0
       m1 = MALLOC_FREE_MEMORY => 0x2c508
       _free(p)
       m2 = MALLOC_FREE_MEMORY => 0x38d18
[Pass] ABS((m0-m1) - 50*1024) => 0x10
[Pass] ABS(m0-m2) => 0x0
       m0 = GetFreeMemForAllocateMemory() => 0x336790
[Pass] p = (void*)_AllocateMemory(128*1024) => 0x862f7c
[Pass] CACHEABLE(p) => 0x862f7c
       m1 = GetFreeMemForAllocateMemory() => 0x316784
       _FreeMemory(p)
       m2 = GetFreeMemForAllocateMemory() => 0x336790
[Pass] ABS((m0-m1) - 128*1024) => 0xc
[Pass] ABS(m0-m2) => 0x0
       m01 = MALLOC_FREE_MEMORY => 0x38d18
       m02 = GetFreeMemForAllocateMemory() => 0x336790
[Pass] p = (void*)_alloc_dma_memory(128*1024) => 0x40862fbc
[Pass] UNCACHEABLE(p) => 0x40862fbc
[Pass] CACHEABLE(p) => 0x862fbc
[Pass] UNCACHEABLE(CACHEABLE(p)) => 0x40862fbc
       _free_dma_memory(p)
[Pass] p = (void*)_shoot_malloc(16*1024*1024) => 0x4de3608c
[Pass] UNCACHEABLE(p) => 0x4de3608c
       _shoot_free(p)
       m11 = MALLOC_FREE_MEMORY => 0x38d18
       m12 = GetFreeMemForAllocateMemory() => 0x336790
[Pass] ABS(m01-m11) => 0x0
[Pass] ABS(m02-m12) => 0x0
[Pass] suite = shoot_malloc_suite_contig(16*1024*1024) => 0x136ad0
[Pass] suite->signature => 'MemSuite'
[Pass] suite->num_chunks => 0x1
[Pass] suite->size => 0x1000000
[Pass] chunk = GetFirstChunkFromSuite(suite) => 0x136af8
[Pass] chunk->signature => 'MemChunk'
[Pass] chunk->size => 0x1000000
[Pass] p = GetMemoryAddressOfMemoryChunk(chunk) => 0x4de36088
[Pass] UNCACHEABLE(p) => 0x4de36088
       shoot_free_suite(suite); suite = 0; chunk = 0;
[Pass] suite = shoot_malloc_suite_contig(0) => 0x1301d0
[Pass] suite->signature => 'MemSuite'
[Pass] suite->num_chunks => 0x1
[Pass] suite->size => 0x1f24000
[Pass] chunk = GetFirstChunkFromSuite(suite) => 0x136980
[Pass] chunk->signature => 'MemChunk'
[Pass] chunk->size => 0x1f24000
[Pass] p = GetMemoryAddressOfMemoryChunk(chunk) => 0x44000064
[Pass] UNCACHEABLE(p) => 0x44000064
       largest_shoot_block = suite->size => 0x1f24000
[INFO] largest_shoot_block: 31MB
       shoot_free_suite(suite); suite = 0; chunk = 0;
[Pass] suite = shoot_malloc_suite(largest_shoot_block + 1024*1024) => 0x1301d0
[Pass] suite->signature => 'MemSuite'
[INFO] ************ Reset Canon settings if suite->num_chunks => 0x1 fails ************
[Pass] suite->num_chunks => 0x5
[Pass] suite->size => 0x2024000
[Pass] chunk = GetFirstChunkFromSuite(suite) => 0x136980
[Pass] chunk->signature => 'MemChunk'
[Pass] total += chunk->size => 0x13b4000
[Pass] p = GetMemoryAddressOfMemoryChunk(chunk) => 0x4de1a070
[Pass] UNCACHEABLE(p) => 0x4de1a070
       chunk = GetNextMemoryChunk(suite, chunk) => 0x136a18
[Pass] chunk->signature => 'MemChunk'
[Pass] total += chunk->size => 0x148c000
[Pass] p = GetMemoryAddressOfMemoryChunk(chunk) => 0x45f240e4
[Pass] UNCACHEABLE(p) => 0x45f240e4
       chunk = GetNextMemoryChunk(suite, chunk) => 0x136a50
[Pass] chunk->signature => 'MemChunk'
[Pass] total += chunk->size => 0x1574000
[Pass] p = GetMemoryAddressOfMemoryChunk(chunk) => 0x4ae00064
[Pass] UNCACHEABLE(p) => 0x4ae00064
       chunk = GetNextMemoryChunk(suite, chunk) => 0x136a88
[Pass] chunk->signature => 'MemChunk'
[Pass] total += chunk->size => 0x1974000
[Pass] p = GetMemoryAddressOfMemoryChunk(chunk) => 0x419ff0a4
[Pass] UNCACHEABLE(p) => 0x419ff0a4
       chunk = GetNextMemoryChunk(suite, chunk) => 0x136ac0
[Pass] chunk->signature => 'MemChunk'
[Pass] total += chunk->size => 0x2024000
[Pass] p = GetMemoryAddressOfMemoryChunk(chunk) => 0x44000064
[Pass] UNCACHEABLE(p) => 0x44000064
       chunk = GetNextMemoryChunk(suite, chunk) => 0x0
[Pass] total => 0x2024000
       shoot_free_suite(suite); suite = 0; chunk = 0;
[Pass] suite = shoot_malloc_suite(0) => 0x1301d0
[Pass] suite->signature => 'MemSuite'
[Pass] suite->num_chunks => 0x5
[Pass] suite->size => 0x3700000
[Pass] chunk = GetFirstChunkFromSuite(suite) => 0x136980
[Pass] chunk->signature => 'MemChunk'
[Pass] total += chunk->size => 0x13b4000
[Pass] p = GetMemoryAddressOfMemoryChunk(chunk) => 0x4de1a070
[Pass] UNCACHEABLE(p) => 0x4de1a070
       chunk = GetNextMemoryChunk(suite, chunk) => 0x136a18
[Pass] chunk->signature => 'MemChunk'
[Pass] total += chunk->size => 0x148c000
[Pass] p = GetMemoryAddressOfMemoryChunk(chunk) => 0x45f240e4
[Pass] UNCACHEABLE(p) => 0x45f240e4
       chunk = GetNextMemoryChunk(suite, chunk) => 0x136a50
[Pass] chunk->signature => 'MemChunk'
[Pass] total += chunk->size => 0x1574000
[Pass] p = GetMemoryAddressOfMemoryChunk(chunk) => 0x4ae00064
[Pass] UNCACHEABLE(p) => 0x4ae00064
       chunk = GetNextMemoryChunk(suite, chunk) => 0x136a88
[Pass] chunk->signature => 'MemChunk'
[Pass] total += chunk->size => 0x1974000
[Pass] p = GetMemoryAddressOfMemoryChunk(chunk) => 0x419ff0a4
[Pass] UNCACHEABLE(p) => 0x419ff0a4
       chunk = GetNextMemoryChunk(suite, chunk) => 0x136ac0
[Pass] chunk->signature => 'MemChunk'
[Pass] total += chunk->size => 0x3700000
[Pass] p = GetMemoryAddressOfMemoryChunk(chunk) => 0x44000064
[Pass] UNCACHEABLE(p) => 0x44000064
       chunk = GetNextMemoryChunk(suite, chunk) => 0x0
[Pass] total => 0x3700000
[INFO] ************ Reset Canon settings if suite->num_chunks => 0x1 fails ************
       shoot_free_suite(suite); suite = 0; chunk = 0;
[Pass] strlen("abc") => 0x3
[Pass] strlen("qwertyuiop") => 0xa
[Pass] strlen("") => 0x0
[Pass] strcpy(msg, "hi there") => 0x213d2c
[Pass] msg => 'hi there'
[Pass] snprintf(a, sizeof(a), "foo") => 0x3
[Pass] snprintf(b, sizeof(b), "foo") => 0x3
[Pass] strcmp(a, b) => 0x0
[Pass] snprintf(a, sizeof(a), "bar") => 0x3
[Pass] snprintf(b, sizeof(b), "baz") => 0x3
[Pass] strcmp(a, b) => 0xfffffff8
[Pass] snprintf(a, sizeof(a), "Display") => 0x7
[Pass] snprintf(b, sizeof(b), "Defishing") => 0x9
[Pass] strcmp(a, b) => 0x4
[Pass] snprintf(buf, 3, "%d", 1234) => 0x2
[Pass] buf => '12'
[Pass] memcpy(foo, bar, 6) => 0x213d00
[Pass] foo => 'asdfghuiop'
[Pass] memset(bar, '*', 5) => 0x213ce0
[Pass] bar => '*****hjkl;'
       bzero32(bar + 5, 5)
[Pass] bar => '****'
       EngDrvOut(LCD_Palette[0], 0x1234)
[Pass] shamem_read(LCD_Palette[0]) => 0x1234
       call("TurnOnDisplay")
[Pass] DISPLAY_IS_ON => 0x1
       call("TurnOffDisplay")
[Pass] DISPLAY_IS_ON => 0x0
       call("TurnOnDisplay")
[Pass] DISPLAY_IS_ON => 0x1
       task_create("test", 0x1c, 0x1000, test_task, 0) => 0xed6c00ca
[Pass] test_task_created => 0x1
[Pass] get_current_task_name() => 'run_test'
[Pass] get_task_name_from_id(current_task->taskId) => 'run_test'
[Pass] task_max => 0x68
[Pass] task_max => 0x68
[Pass] mq = mq ? mq : (void*)msg_queue_create("test", 5) => 0xed6e00b6
[Pass] msg_queue_post(mq, 0x1234567) => 0x0
[Pass] msg_queue_receive(mq, (struct event **) &m, 500) => 0x0
[Pass] m => 0x1234567
[Pass] msg_queue_receive(mq, (struct event **) &m, 500) => 0x9
[Pass] sem = sem ? sem : create_named_semaphore("test", 1) => 0xed7002f8
[Pass] take_semaphore(sem, 500) => 0x0
[Pass] take_semaphore(sem, 500) => 0x9
[Pass] give_semaphore(sem) => 0x0
[Pass] take_semaphore(sem, 500) => 0x0
[Pass] give_semaphore(sem) => 0x0
[Pass] rlock = rlock ? rlock : CreateRecursiveLock(0) => 0xed720036
[Pass] AcquireRecursiveLock(rlock, 500) => 0x0
[Pass] AcquireRecursiveLock(rlock, 500) => 0x0
[Pass] ReleaseRecursiveLock(rlock) => 0x0
[Pass] ReleaseRecursiveLock(rlock) => 0x0
[Pass] ReleaseRecursiveLock(rlock) => 0xf
       SetGUIRequestMode(1); msleep(1000);
[Pass] CURRENT_GUI_MODE => 0x1
       SetGUIRequestMode(2); msleep(1000);
[Pass] CURRENT_GUI_MODE => 0x2
       SetGUIRequestMode(0); msleep(1000);
[Pass] CURRENT_GUI_MODE => 0x0
[INFO] ************ Checking stub = LiveViewShutterApp_handler ************
[Pass] display_idle() => 0x1
       GUI_Control(BGMT_PLAY, 0, 0, 0); msleep(1000);
[Pass] PLAY_MODE => 0x1
[Pass] MENU_MODE => 0x0
       GUI_Control(BGMT_MENU, 0, 0, 0); msleep(1000);
[INFO] ************ EOSM2 fails here ************
[Pass] MENU_MODE => 0x1
[INFO] ************ EOSM2 fails here ************
[Pass] PLAY_MODE => 0x0
[Pass] dialog->type => 'DIALOG'
       GUI_Control(BGMT_MENU, 0, 0, 0); msleep(500);
[Pass] MENU_MODE => 0x0
[INFO] ************ EOSM2 fails here ************
[Pass] PLAY_MODE => 0x0
       SW1(1,100)
[Pass] HALFSHUTTER_PRESSED => 0x1
       SW1(0,100)
[Pass] HALFSHUTTER_PRESSED => 0x0
[Pass] is_play_mode() => 0x1
[INFO] ************ Checking stub = PlayMain_handler ************
[Pass] is_pure_play_photo_mode() => 0x1
[Pass] is_pure_play_movie_mode() => 0x0
[Pass] is_play_mode() => 0x1
[Pass] is_pure_play_photo_mode() => 0x0
[Pass] is_pure_play_movie_mode() => 0x0
[Pass] is_play_mode() => 0x1
[Pass] is_pure_play_photo_mode() => 0x0
[Pass] is_pure_play_movie_mode() => 0x1
[Pass] is_play_mode() => 0x1
[Pass] is_pure_play_photo_mode() => 0x0
[Pass] is_pure_play_movie_mode() => 0x0
=========================================================
Test complete, 11852 passed, 20 failed.
.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on January 25, 2019, 08:57:17 AM
New build. Only affects 'framing' setting. Hopefully solid preview now:
https://www.magiclantern.fm/forum/index.php?topic=9741.msg208959#msg208959

No need for Clear Overlays 'HalfShutter' in framing mode hopefully.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: jacquaviva on January 25, 2019, 10:38:12 AM
Danne, do you mean framing is improved for crop mode mv1080 ? Thank you
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on January 25, 2019, 10:52:22 AM
Nope. Other issues.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: ctfire on January 25, 2019, 11:17:24 AM
New build. Only affects 'framing' setting. Hopefully solid preview now:
https://www.magiclantern.fm/forum/index.php?topic=9741.msg208959#msg208959

No need for Clear Overlays 'HalfShutter' in framing mode hopefully.



Just tested that build, it's awesome improvement in preview. 1080mv in 2.35 : 1 now is more than usable. Thank you. Also tested 50fps option with sd uhs hack , and only downside is that in 14 bit loseless it's only rec 5 sec. But as i understand this is depends more from sd card than from magic lantern. Thank you againe Danne.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on January 25, 2019, 01:12:07 PM
Cool. Yes, probably card. I can record more or less continuous when selecting 10bit.
Just pushed a build with slightly changed registers in 50fps modes. 45fps is still problematic.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: AF-OFF on January 25, 2019, 04:31:22 PM
Did a quick 1x3 recording with the new (Jan25) build
10bit and 1:2.35, sd-uhd, didn't touch any of the regs
had to deaktivate sound, because it would record only few seconds

I was able to record continuously. first clip with the default 'Framing' - setting (Auto),
for 3 1/2 minutes. Then switched to Real-time and recorded 2 1/2 min.

With MLV App (drop frames disabled) both of them without any damage
Will test other modes later

Many thanks to Danne and other developers

 
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: dfort on January 25, 2019, 05:25:05 PM
...Notice that the only failing tests are the focus tests. This is with the EF-M 22mm f/2 prime lens but it is happening with all lenses in both movie and photo mode...

Figured it out (https://www.magiclantern.fm/forum/index.php?topic=14828.msg210980#msg210980). Those failing tests are supposed to run in photo mode outside of LiveView. In other words, the tests aren't valid on the EOSM/EOSM2.

Ok--now back to the cool stuff that Danne is doing.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: masc on January 25, 2019, 06:48:30 PM
Rendered 2 clips recorded with todays build @ 1x3 and another one @50p. No corrupted frame and just one single frame jump. So: nice progress!
I noticed in 1x3 a red line at the bottom. Is it possible to do something against? Or do we have to fix that in post (e.g. by copying blue and green channel from row n-1)?
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on January 25, 2019, 06:52:31 PM
Green line. I will take a look. Full 5k set up or 2.35:1?
What preset caused the frame jump by the way? With or without global draw enabled?
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: masc on January 25, 2019, 07:06:08 PM
Setting was GlobalDraw On, 1504x1920, 10bit lossless, preview=framing.
Here the bottom line is red. You should it also have in the clip I sent you.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on January 25, 2019, 07:50:25 PM
Thanks for noticing! Fixed:
https://www.magiclantern.fm/forum/index.php?topic=9741.msg208959#msg208959

It could be fixed also by using the height reg in the sub menu reg_6804 set to + 1. Well sorry for this, new build posted.

Commit:
https://bitbucket.org/Dannephoto/magic-lantern/commits/133ba5a624c0b5d9bb7af809d8e792d16651ec39
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: masc on January 25, 2019, 08:38:18 PM
Fantastic Danne! Works!
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: henricusmaria on January 26, 2019, 06:35:15 AM
Sounds good! Does it also work in other ratios like 16:9?
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on January 26, 2019, 10:30:31 AM
@henricusmaria
I pushed a fix also for the 5k 3x1 preset. Had a thin red line:

Download
https://www.magiclantern.fm/forum/index.php?topic=9741.msg208959#msg208959

If you or someone else could check all presets for bottom red lines it would be good. With and without ratios from crop rec sub menu set. Lack of time here. Open up the files in Mlv App and simply zoom into the file, scroll to bottom...
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: henricusmaria on January 26, 2019, 01:19:13 PM
I will let you know, when I find the time. I am actually looking for a preset that gives me clean/corrupt free footage. I am shooting a film in China and I want to use the eos m in some areas where it’s a bit difficult (not allowed) to film. Right now I’m thinking of using the 2.5k preset since it’s the cleanest. The mv1080 gives too much aliasing and moire. But it would be great to be able to shoot with a wider angle. The 1x3 preset looks promising!
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on January 26, 2019, 01:32:50 PM
Cool. Yes 1x3 should be the best if it's reliable. If you could test it thoroughly we might work out a solid working 1x3 preset.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: henricusmaria on January 26, 2019, 02:03:29 PM
Yes, will do. I have one more week of testing to go..
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on January 26, 2019, 02:18:31 PM
What I'm thinking is to reduce the 2.35:1 preset to reach 4k and that might be what it takes to create a more robust set up. I could create a version with both 2.35:1 presets available for tests. Let me know what you think.
There's already a 16:9 3.5k 1x3 binning in there. Not sure how that works...
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: masc on January 26, 2019, 02:23:29 PM
I am not sure if it is neccessairy to reduce the resolution. I tried recording clips with many different settings today. The most safe one was the 4.5K 2.35:1 1x3 10bit preset. Selecting 16:9 there (-> smaller resolution) brought more corrupted frames - no idea why. But when speeking of "more corrupted frames" - this were 2 corrupted frames in 20 seconds, where the 2.35:1 preset had one or none.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on January 26, 2019, 02:41:42 PM
4.5k more robust. Good to know.
I am keeping the height since reducing it will kill real time preview. Keeping it is probably one reason for difficulties.
Other than timing registers I don't really know what registers to tweak. Maybe eosm also has some memory routines that works different from each recording so one could look into this as well.

Timer regs are in the sub menu so anyone can try and optimize.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: henricusmaria on January 26, 2019, 03:17:46 PM
I am not sure if it is neccessairy to reduce the resolution. I tried recording clips with many different settings today. The most safe one was the 4.5K 2.35:1 1x3 10bit preset. Selecting 16:9 there (-> smaller resolution) brought more corrupted frames - no idea why. But when speeking of "more corrupted frames" - this were 2 corrupted frames in 20 seconds, where the 2.35:1 preset had one or none.

Thanks. Will try that present tomorrow. I also had more corrupted frames when choosing 16:9. Although I’d rather film in 16:9 since my other footage is in that aspect ratio.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on January 26, 2019, 03:24:22 PM
What happens if you create a 16:9 preset from regular raw video sub menu instead of using my ratios preset?
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: bergamote on January 26, 2019, 03:56:45 PM
If you or someone else could check all presets for bottom red lines it would be good. With and without ratios from crop rec sub menu set. Lack of time here. Open up the files in Mlv App and simply zoom into the file, scroll to bottom...

I just quickly went though the presets, without the crop rec ratio then with it at 2.35 then at 16:9
Only found a line of noise at the bottom of the 2.5k preset with ratio 2.35.
But then again, I think I fudged up something. The sizes selected don't match the clips I got. I only had crop_rec and mlv_lite loaded, do the presets rely on lua scripts or sd hack?

Also, there's always a black line at the bottom of the 1x3 preset but is that because of the resize in MLVApp?
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: henricusmaria on January 26, 2019, 04:05:18 PM
What happens if you create a 16:9 preset from regular raw video sub menu instead of using my ratios preset?

I haven’t tried it with the latest built but I got a lot of corrupted frames before. I will try again tomorrow and report back.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on January 26, 2019, 05:11:42 PM
Pushed some fixes to 16:9 ratios setting when used with 1x3 binning. Couldn,t get any corruption but see if anyone else can:
https://www.magiclantern.fm/forum/index.php?topic=9741.msg208959#msg208959
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: dfort on January 26, 2019, 09:07:14 PM
While checking log files for the EOSM2 and comparing them to the EOSM and 700D I found this should probably be changed:

platform/EOSM.203/consts.h
Code: [Select]
// http://magiclantern.wikia.com/wiki/ASM_Zedbra
-#define YUV422_HD_BUFFER_1 0x44000080
+#define YUV422_HD_BUFFER_1 0x463cc080
 #define YUV422_HD_BUFFER_2 0x46000080

Where is this used? Found a feature called FEATURE_PLAY_EXPOSURE_FUSION that uses this. I'm unfamiliar with this feature but it apparently works on the 700D and with a few tweaks it can be activated on the EOSM.

(https://www.magiclantern.fm/forum/proxy.php?request=https%3A%2F%2Ffarm8.staticflickr.com%2F7888%2F45970869245_ffc9fc7d40.jpg&hash=bc60f174893ca9dd5ac63ceb9614ba54) (https://flic.kr/p/2d3hHPT)

It also turns on a load of other features. Hum--interesting.

(https://www.magiclantern.fm/forum/proxy.php?request=https%3A%2F%2Ffarm5.staticflickr.com%2F4869%2F33010218228_1816de159e.jpg&hash=7d00b5e5580e379309098725aee1f96c) (https://flic.kr/p/ShZZPA)

Here's what I did to turn this on:

https://bitbucket.org/daniel_fort/magic-lantern/commits/79d180e53752ed4d9b54fc097ed949e7cac1721e
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Walter Schulz on January 26, 2019, 09:14:01 PM
You will find a description in outdated
https://wiki.magiclantern.fm/userguide#image_review_settings
422 options are gone, though.

Have to link some example pics in camera_help, WIP.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: dfort on January 26, 2019, 09:41:43 PM
Thanks Walter. There are so many features that I haven't even touched yet!
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Walter Schulz on January 26, 2019, 09:47:19 PM
Thanks Walter. There are so many features that I haven't even touched yet!

... there are spiderwebs and dust bunnies. Lots of.
Some options and features haven't been used for years. See bug reports 2920-2923.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: henricusmaria on January 27, 2019, 03:44:01 AM
Pushed some fixes to 16:9 ratios setting when used with 1x3 binning. Couldn,t get any corruption but see if anyone else can:
https://www.magiclantern.fm/forum/index.php?topic=9741.msg208959#msg208959

Thanks Danne! Will do some tests today. Do you think changing the bit depth to 12 or 14 bit lossless and lowering the resolution will improve the image quality? Or is it better to film in 10 bit lossless with the highest resolution?
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Hmm on January 27, 2019, 12:23:01 PM
Hi everyone! I've encountered an interesting issue. My Samsung EVO 128gb microSD ocassionally starts to work at very low speeds (about 21 MB/s) and keep working like that until I format it. I have sd_uhs hack loading at startup. Things I tried: removing battery, different croprec modes, older ML builds, recording RAW video without croprec, loading sd_uhs manually, loading sd_uhs in photo mode and etc.
And the most interesting thing is, after I formated the card on my PC write speeds returned to normal. BUT, after some tests with ML (I tried using silentpic.mo with 4k croprec preset on 1/4000 shutter speed) my camera froze (so I had to remove the battery), and after 3-4 more crashes like that I decided to check if I am still getting nice write speeds. And guess what, my microSD card starts to underperform once again. This time I decided to format it in camera and it helped.

Any thoughts about what exactly casing it? Is there any way I can fix it without formating my card?

And, I would be very grateful if somebody makes a working silentpic.mo as 4fps burst speed is too low for my needs.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on January 28, 2019, 12:28:26 PM
New build:
https://www.magiclantern.fm/forum/index.php?topic=9741.msg208959#msg208959

Renamed 1x3 binning to simply 5K anamorphic.
Faster routine for sd_uhs module(experimental, use at own risk)
Better centering for the 5K anamorphic presets(2.35:1, 16:9)
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: ctfire on January 28, 2019, 12:32:16 PM

(https://www.magiclantern.fm/forum/proxy.php?request=https%3A%2F%2Fi.ibb.co%2F2nLTGMd%2Fphoto-2019-01-28-13-37-08.jpg&hash=c782dffd4d66c8b04f7075b0049d90a8) (https://ibb.co/2nLTGMd)

Just tested the latest build (_2019Jan27) there is a lot of corrupted frames at start of the footage , in crop rec mv1080p 45 fps preset (2.35:1 10bit)
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: ctfire on January 28, 2019, 12:56:13 PM
New build:
https://www.magiclantern.fm/forum/index.php?topic=9741.msg208959#msg208959

Renamed 1x3 binning to simply 5K anamorphic.
Faster routine for sd_uhs module(experimental, use at own risk)
Better centering for the 5K anamorphic presets(2.35:1, 16:9)

Just downloaded this new build, and also get corrupted frames in  in crop rec mv1080p 45 fps preset (2.35:1 10bit) (at start of the footage)   and in crop rec mv1080p 50 fps preset (2.35:1 10bit)  somewhere afrer the 300-400 frames get 1 or 2 corrupted frames
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on January 28, 2019, 01:05:25 PM
Yes, 45fps and 50fps modes are corrupted.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: ctfire on January 28, 2019, 01:08:46 PM
Yes, 45fps and 50fps modes are corrupted.

Maybe its possible to make a little lower resolution but make them without corrupted frames ?
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on January 28, 2019, 01:12:00 PM
You can reduce fps by pushing reg_6014 forward in the sub menu. Also works with reg_6008. Modifying reg_713c and reg_7150 also affects output.
Even reducing fps straight in FPS override should do.
If you get solid results please share your settings.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: ctfire on January 28, 2019, 01:59:00 PM
You can reduce fps by pushing reg_6014 forward in the sub menu. Also works with reg_6008. Modifying reg_713c and reg_7150 also affects output.
Even reducing fps straight in FPS override should do.
If you get solid results please share your settings.

In crop mode mv 1080p  1736x738 50fps (2.35:1 10 bit) changed reg_6014 to +20 and reg_6008 also +20 . And get more than a minute footage without corrupted frame. FPS override shows that the framerate with this settings is 47.3fps and on 24fps timeline you can do 2x slowmo. Danne if you can make a presset with this values, i will be very thankful.
In mv1080p 1736х976 tryed different values but in all efforts get corrupted frames (
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on January 28, 2019, 02:32:50 PM
Thanks for testing. For 1736x738 50fps I´d prefer if we can have it working with 50fps. When I test it over here it works uncorrupted when global draw is set to off. If you set fps override to 48fps it should run ok?
If nothing works we should really try to find sweet spot for a 48fps preset.

What needs more digging is the 45 fps setting. Seems harder to nail.

EDIT:
By the way. Could you test the 45 fps with following  starting point:
Global draw off
10bit
full 1736x976 ratio
reg_713c -8
reg_7150 -8
reg_6014 +2
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: ctfire on January 28, 2019, 03:18:28 PM
Thanks for testing. For 1736x738 50fps I´d prefer if we can have it working with 50fps. When I test it over here it works uncorrupted when global draw is set to off. If you set fps override to 48fps it should run ok?
If nothing works we should really try to find sweet spot for a 48fps preset.

What needs more digging is the 45 fps setting. Seems harder to nail.

EDIT:
By the way. Could you test the 45 fps with following  starting point:
Global draw off
10bit
full 1736x976 ratio
reg_713c -8
reg_7150 -8
reg_6014 +2


Try your settings and still get video with corrupted frames, and get this on screen
(https://www.magiclantern.fm/forum/proxy.php?request=https%3A%2F%2Fi.ibb.co%2F8z2SYJp%2Fphoto-2019-01-28-16-17-01.jpg&hash=c6a4b264e31f80b714d319322f08a0c2) (https://ibb.co/8z2SYJp)
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on January 28, 2019, 03:20:15 PM
Yeah, thanks, so needs more tweaking and maybe it should be run in 44fps in the end.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: ctfire on January 28, 2019, 03:27:27 PM
also try to set fps override to 48  for 1736x738 50fps presset , and its work fine, whithout any corrupted frames . (2.35:1 10 bit)
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: ctfire on January 28, 2019, 03:35:25 PM
Yeah, thanks, so needs more tweaking and maybe it should be run in 44fps in the end.

set the 45fps presset to 44fps with all your settings, and yes it's corrupted free but when i swich it to 2.35:1 get some pinkish video.
Sorry for my english, this is not my native lenguage ,but hope you understand me.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on January 28, 2019, 05:21:15 PM
New build:
https://www.magiclantern.fm/forum/index.php?topic=9741.msg208959#msg208959

Let´s run these presets for a while(reduced to 48fps). If anyone can achieve 50fps corruption free I will put the old ones back again. Thanks @ctfire for testing.
(https://www.magiclantern.fm/forum/proxy.php?request=https%3A%2F%2Fi.postimg.cc%2Fwx5hqNtw%2FVRAM0-PPM-scaled.png&hash=d25a00fef84203e6d955c25b6579cec7)
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: masc on January 28, 2019, 08:26:46 PM
Tried out latest build.
- 5k anamorphic seems to work. I only get some dots in highlights, I have to check again against version before (all raw corrections off). Same dots are also in mv1080 48fps. Can't remember having seen this before... and you see this already when recording on the liveview screen.
(https://www.magiclantern.fm/forum/proxy.php?request=https%3A%2F%2Fi.ibb.co%2FthMxHC4%2FBildschirmfoto-2019-01-28-um-20-25-09.png&hash=d585ad89ab5451ee70b79b8b9c8c226f)
- mv1080 48fps aborts with this screen (did not see such screens in my few tests with 50fps before):
(https://www.magiclantern.fm/forum/proxy.php?request=https%3A%2F%2Fi.ibb.co%2F4jpKY17%2FIMG-20190128-201008-905a.jpg&hash=c7aa6bda9af25aeff3f1710b1c04319c)
  and I found one missing (just black) frame, but no pink corrupted frame

Edit: I see the dots with the build before in the liveview too! Recorded some more 48fps clips... corrupted frames are very rare, but existing.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on January 28, 2019, 08:52:39 PM
dots, what the heeey  :o
Tested a different converter from Mlv App  :P
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: ctfire on January 28, 2019, 09:30:47 PM
Tried out latest build.
- 5k anamorphic seems to work. I only get some dots in highlights, I have to check again against version before (all raw corrections off). Same dots are also in mv1080 48fps. Can't remember having seen this before... and you see this already when recording on the liveview screen.
(https://www.magiclantern.fm/forum/proxy.php?request=https%3A%2F%2Fi.ibb.co%2FthMxHC4%2FBildschirmfoto-2019-01-28-um-20-25-09.png&hash=d585ad89ab5451ee70b79b8b9c8c226f)
- mv1080 48fps aborts with this screen (did not see such screens in my few tests with 50fps before):
(https://www.magiclantern.fm/forum/proxy.php?request=https%3A%2F%2Fi.ibb.co%2F4jpKY17%2FIMG-20190128-201008-905a.jpg&hash=c7aa6bda9af25aeff3f1710b1c04319c)
  and I found one missing (just black) frame, but no pink corrupted frame

Edit: I see the dots with the build before in the liveview too! Recorded some more 48fps clips... corrupted frames are very rare, but existing.

Yeah there is sometimes corrupted frames , but not consistant, made 5 footages (2.35:1 10 bit)  all 1 minute leght, and only two of them have one corrupted (black) frame each. Set fps override to 47fps , and make my test again and all of them was corrupted frames free.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on January 28, 2019, 10:32:53 PM
Let's give it another go tomorrow. Might have a little something for the 45 fps preset as well.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on January 29, 2019, 02:30:06 PM
New upload:
https://www.magiclantern.fm/forum/index.php?topic=9741.msg208959#msg208959

Reworked higher fps modes. Needs testing. Run them with:
global draw off
10bit
with and without 2.35:1 ratio set
sd_uhs hack


Look for corrupted frames. Note that 45 fps modes absolutely need timer registers to settle down. This can be noted when viewing for stuttering in live view window. If no stuttering, ok to to film.

I increased a register for anamorphic modes as well(2.35:1 and 16:9) so won´t hurt to test them too. The default anamorphic mode is not really working well but I don´t see it useful anyway so stick to 4.5k and 3.5k instead.

(https://www.magiclantern.fm/forum/proxy.php?request=https%3A%2F%2Fi.postimg.cc%2FbwJCww8D%2FVRAM0-PPM-scaled-2.png&hash=c1777571fd368cc884729bc9b7bd1011)
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on January 29, 2019, 06:54:31 PM
New upload:
https://www.magiclantern.fm/forum/index.php?topic=9741.msg208959#msg208959

Dedicated to the mv1080p 50 fps mode. Really hard to get that one working. Fps set to 49.880 now.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: masc on January 29, 2019, 07:39:09 PM
Checked latest build here with mv1080 50fps:
with GLOBAL_DRAW=OFF: average 700 frames, 5 corrupted frames (1st: ~frame 150; the other frames between 650 and last)
with GLOBAL_DRAW=ON: average 270 frames, 2 corrupted frames (1st ~frame 50; 2nd in the last 50 frames)
But no crash so far...
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on January 29, 2019, 07:41:38 PM
The 50fps preset right? Might settle for the 48fps soon then.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: masc on January 29, 2019, 07:52:16 PM
Right... edited.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: henricusmaria on January 30, 2019, 04:53:58 AM
Managed to get 1x3 footage in 16:9 without corrupted frames. Only there is too much aliasing going on to my liking. Anything I can change in my ml settings or mlvapp that can help?
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on January 30, 2019, 05:57:44 AM
Could you upload an example with aliasing? Maybe a shortened mlv?
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: masc on January 30, 2019, 07:57:21 AM
Managed to get 1x3 footage in 16:9 without corrupted frames. Only there is too much aliasing going on to my liking. Anything I can change in my ml settings or mlvapp that can help?
I think I know what you mean, because I also was not satisfied in the beginning. I think you are speeking about artifacts on detailed structures like trees?! Are you able to compile MLVApp? The latest revisions can debayer such MLVs much better. You could compile MLVApp yourself or wait for next release. Using Resolve you should be fine...
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: henricusmaria on January 30, 2019, 08:47:11 AM
@masc I think you know what I mean ;)
How do you compile mlvapp?

@Danne I’ve already deleted the mlv files
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: masc on January 30, 2019, 09:00:42 AM
How do you compile mlvapp?
See compiling information on this site: https://github.com/ilia3101/MLV-App
On the other side, v1.5 is not far away...  8)
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: henricusmaria on January 30, 2019, 09:25:07 AM
Thanks! I will have a look.
V1.5 might not be far away, but I need to find out this week if the 1x3 mode is reliable enough to shoot with.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on January 30, 2019, 11:58:14 AM
New upload:
https://www.magiclantern.fm/forum/index.php?topic=9741.msg208959#msg208959

Focused on corruption free recordings on all presets. Let´s see where and if it breaks:
(https://www.magiclantern.fm/forum/proxy.php?request=https%3A%2F%2Fi.postimg.cc%2FLsW0ZcD4%2FVRAM0-PPM-scaled.png&hash=f14a69debae2b5922f4d769d4a239239)

 
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: AF-OFF on January 30, 2019, 03:54:47 PM
Downloaded new build from Danne and did some little tests.
build Jan30, sd-uhs hack, 10bit, 16:9 global draw off, sound module not loaded, MLV App 1.4 (Playback>Drop Frame Mode off)
first just did a benchmark with the bench.mo from the ML experimental Lua build copied over inside the Modules directory of Danne's build. The performance dropped about 5MB/s but fortunately now the benchmark runs the read-tests too, which it did not in previous builds. So with max of 54MB/s Write and 56MB/s Read I did following quick tests. 
mv720p 1736x694 50fps
recording stopped after 23 seconds. had to stretch the image 1,67x in MLV App, reported Frame rate was 49.959 fps. after 650 frames first corrupted frame, seven in total.
same mode but reduced Frame rate to 47 fps. recording continuous, did a 00:01:36 recording, reported speed 47.009 fps. Have done the same height stretch of 1,67x as before. Somewhere at 00:01:20 mark there was one bad frame.
next I did a mv1080p 1736x976 46/48 fps recording. from start on I lowered the Frame rate to 44 fps. But as MLV App reports, it has the res of 1496x842 pixels which is 16:9 ratio. no stretch needed in MLV App. did a continuos recording of 5896 frames (00:02:13) at frame rate of 44.013 fps.
There were 27 bad frames in the first 40 seconds of the video, so I did another recording but this time did not lower the frame rate.
reported frame rate is 45.983 fps. one minute recording, 2 bad frames .

So this looks very good, many thanks to Danne and others
Will do further testing
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on January 30, 2019, 04:51:41 PM
Thanks AF-OFF. Still much to work on :P. If you lower fps try do it from reg_6014 register in the submenu. Push it forward for decrease.
One goal is to have the 2.35:1 setting working with all presets without issues. THe rest is more or less extras. If you want to test the presets with the 2.35:1 ratios set I wouldn´t mind hearing about the results  8)
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: masc on January 30, 2019, 08:07:13 PM
This test release changes a lot, Danne! mv1080 48fps @1648x702, okay, some pixels are missing now (a little smaller), but I get continous recording @10bit lossless now and after 45sec (>2000 frames) I have no single corrupted frame! WOW! Important: Global Draw has to be OFF. If I leave it ON, the maximum I can get is 800 frames, but with may 1 corrupted frame in 20 frames.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on January 30, 2019, 08:45:26 PM
That is good news. I really want the 2.35:1 presets to be solid and to have a 48fps 3x3 binning is very nice indeed.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Jonit on January 30, 2019, 09:42:06 PM
Awesome work Danne!!!

I did some tests yesterday with yesterday build and I was getting some pink frames in 50fps mode and also 5k anamorphic - dualISO.
I'm going to shoot a wedding in three days so I guess it will be a serious test for this stuff  ;). There will be also a second cameraman on that wedding, otherwise I wouldn't risk the shots with such a bleeding edge stuff. Actualy, that was my requisition, that I would only film if they allow me to film in ML RAW  8), I explained the risks... All this development in RAW video is so exciting, that I didn't touch the normal video mode in a quite long time and I'm shooting almost exclusively in RAW.

Anyway... the most important modes for me are 48fps and DualISO. Today I tested your current build (30.1.) and I was blown away by how much it improved over yesterdays build.
I got some pink frames, but very few in a long recordings, and now I realized that it was probably due to the fact that I didn't turn off the global draw. Need to test it again with GD off.

Here are my results (with GD on, framing LV, 1:2.35, 10bit)(all recordings stopped manualy):
5K-A-DualISO-sound: 20 seconds - 0 corrupted frames
5K-A-DualISO-NOsound: 14 seconds - 0 corrupted frames
1080_3x3-1648x702-48fps-sound: 25 seconds - 5 corrupted frames, evenly happening in the first half of the clip
1080_3x3-1648x702-48fps-NOsound: 40 seconds - 2 corrupted frames (one after another) in the middle of the clip


SIDE QUESTION: I'm getting 700D tomorrow and I'm wondering in what state of development it currently is regarding to 1x3 mode and 48fps mode? I was trying to find something on the forum, especialy about the 48/50fps mode and I didn't find much :(. If any of you guys know, my question is, if there is a working build for 700D with reliable 48fps recording?

Thanks!
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on January 30, 2019, 10:44:43 PM
I would do all recordings with 10bit 2.35:1 sd_uhs on.
48fps with global draw off.
If the anamorphic mode isn't continuous you can reduce offsets manually by using the skip_left, skip_reight etc to reduce ratio straight in the sub menu. This maybe works straight in Raw video resolution menu, not sure.
Anyway. Tell me what presets you aim to use and we can focus on them for a while.
700D has some very intelligent crop_rec code from a1ex. Also ask theBilalfarouk for some useful info.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: AF-OFF on January 31, 2019, 12:02:57 AM
If you want to test the presets with the 2.35:1 ratios set I wouldn´t mind hearing about the results  8)
sure ...
Just downloaded the fresh Jan30 build and did some testing - all recordings 2.35:1 , 10bit, sd-uhs , no GD and no sound. did stop all recordings manualy after 1min.
mv720p, 1736x694 50fps, no bad frames. MLV App reports 1736x442 pixels , 49,959fps. needs a height stretch 1.67x.
mv1080p, 1736x976 46/48 fps, no bad frames, actual size is 1648x702 & 47,991 fps.
mv1080p, 1736x1158, two bad frames, actual size 1736x738 & 24.002 fps.
& finally also 2.5k 2520x1418, no bad frames, actual size 2520x1072 & 23,976 fps.

it gets better and better. Many Thanks Danne and others



   
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Jonit on January 31, 2019, 08:45:43 AM
I would do all recordings with 10bit 2.35:1 sd_uhs on.
48fps with global draw off.
If the anamorphic mode isn't continuous you can reduce offsets manually by using the skip_left, skip_reight etc to reduce ratio straight in the sub menu. This maybe works straight in Raw video resolution menu, not sure.
Anyway. Tell me what presets you aim to use and we can focus on them for a while.

Yeah, I did all recordings with 10bit 2.35:1 sd_uhs on, only difference was that I had GD on. Didn't have time yesterday to test it with GD off. But anamorphic seemed to do OK even with GD on and recording times were also great (possibly continuous). The only "problem" was with 48fps, where it had a couple of pink frames.
Do you think Danne, that there will be a possibility someday to run corruption-free 48fps with GD on? So to have a proper framing... because I find it quite difficult to properly frame a subject without "framing LV" mode.

Thanks a lot.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on January 31, 2019, 09:07:05 AM
You could test the 2.35:1 48fps setting with preview Real-time or Auto. Could give a corrupted file, especially in the beginning.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: ctfire on January 31, 2019, 01:24:23 PM
Just film some footage and also get color dots in blown out areas , for converting mlv i as always use MLVapp
(https://www.magiclantern.fm/forum/proxy.php?request=https%3A%2F%2Fi.ibb.co%2FQdymwLG%2F2019-01-31-14-22-58.png&hash=7e07d66f88ed9e17d58322009f3dc348) (https://ibb.co/QdymwLG)
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: masc on January 31, 2019, 01:29:07 PM
Just film some footage and also get color dots in blown out areas , for converting mlv i as always use MLVapp
(https://www.magiclantern.fm/forum/proxy.php?request=https%3A%2F%2Fi.ibb.co%2FQdymwLG%2F2019-01-31-14-22-58.png&hash=7e07d66f88ed9e17d58322009f3dc348) (https://ibb.co/QdymwLG)

What was your setting (camera and MLVApp)? Would be nice to get some frames of this clip for testing! These dots look different than mine. Have you tried MLVApp version from today? v1.5 is out!
Danne solved one of my dot problems: don't use ISO6400! (I would never do that for serious recording. I only did that for testing... and so the dots came...)
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: gravitatemediagroup on January 31, 2019, 03:28:29 PM
What setting would be causing all highlights to be pink?  I've tried several variations of settings adjustments but pink is all I get, so I figured I'd stop and ask for directions. lmao
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on January 31, 2019, 03:50:06 PM
More info please. Settings etc. Maybe also a mlv file.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: masc on January 31, 2019, 05:02:24 PM
What setting would be causing all highlights to be pink?  I've tried several variations of settings adjustments but pink is all I get, so I figured I'd stop and ask for directions. lmao
There is no setting causing pink highlights. It is the standard of each file where highlights are overexposed (green channel clipped makes pink color). You can repair this: bring down exposure of highlights, check Highlight Reconstruction, setup "the right" RAW White Level. For my EOS M @10bit lossless this is around 2800+-100.
@Danne: sometimes this is a little higher, sometimes a little lower. Do you have an idea why? Normally the value were a channel clips should always be the same.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on January 31, 2019, 05:10:43 PM
Not really sure. Maybe lossless works with variable bitrates in highlight. Maybe I am talking out of my ass  :P.
Anyway. I set 10bit by reducing gain valuse in crop_rec.c:
Code: [Select]
    if (bitrate == 0x3)
    {
/* 10bit roundtrip only not applied here with following set ups */
adtg_new[13] = (struct adtg_new) {6, 0x8882, 60 + reg_analog_gain};
                adtg_new[14] = (struct adtg_new) {6, 0x8884, 60 + reg_analog_gain};
                adtg_new[15] = (struct adtg_new) {6, 0x8886, 60 + reg_analog_gain};
                adtg_new[16] = (struct adtg_new) {6, 0x8888, 60 + reg_analog_gain};
}

In raw.c I hard code White level to 3000. Maybe it should be set to 2800?:
Code: [Select]
        if (shamem_read(0xC0F42744) == 0x4040404)
        {
    /* 10bit by checking pushed liveview gain register set in crop_rec.c */
            int default_white = WHITE_LEVEL;
            return (default_white = 3000);   
        }
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: a1ex on January 31, 2019, 05:11:01 PM
Pink highlights: see this commit (https://bitbucket.org/hudson/magic-lantern/commits/89b7779c6e626d30016cdf562aa6598529357d6f?at=crop_rec_4k) and follow the links.

The workaround for 700D/100D might also work out of the box on EOS M/M2 and 650D, possibly other models, or it might not. Running the tests linked in the above commit is the only way to find out.

If analog gains are tweaked, it might be a different story. Still, the value printed by raw_diag should be a good starting point.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on January 31, 2019, 07:23:18 PM
New upload:
https://www.magiclantern.fm/forum/index.php?topic=9741.msg208959#msg208959

Thanks @a1ex for the white level links. Put it up on todo list. Hopefully someone might dig into the issue.

New upload experimenting with void FAST hack_liveview_vsync() in mlv_lite.c. There´s so much interesting code created by a1ex and g3gg0 it never seems to end. Anyway I used this part to get real time preview while camera is in raw idle mode(standby not recording). Works by pressing halfshutter when using following presets:
    "3K 3032x1436",
    "4K 4038x2558",
    "5K anamorphic",(default setting)

Good for setting focus beforing hitting rec. Before the only way was to use framing mode. Also added for 100D.

Commit:
https://bitbucket.org/Dannephoto/magic-lantern/commits/9fbfa7f95d2bfd436c43ab2d8b01fa200b0e45b3
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: masc on January 31, 2019, 08:02:32 PM
What exactly is the difference to the version before? When using 5K anamorphic, it looks the same for me... or have I forgotten to setup a parameter? (picture gets greenish touch and y axis is stretched)
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on January 31, 2019, 08:09:04 PM
I changed the default preset "anamorphic" so it wouldn´t give real time preview other than in 2.35:1 and 16:9.
The bigger use is with 3k and 4k since they are totally dependent on framing preview when both in idle and while recording. Now at least we can zoom in with real time(cropped) preview before recording.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: masc on January 31, 2019, 08:16:54 PM
Is there any way to "unstretch" realtime preview in anamorphic mode, or is it impossible because of register settings? It is very hard to focus with it (okay... it is better than framing, but...) :)
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on January 31, 2019, 08:30:11 PM
Well. A1ex has some thinking about what and where to look for this kind of reg manipulation. If there´s any solution I don´t see how it would be done in real time live view other than maybe when setting focus before hitting record.
In this hack by the way it´s actually possible to modify regs while recording but of course you will get corrupted output while focusing. Maybe if this hack was done while pausing recording it might be a start for new achievements  :P
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: nikki on January 31, 2019, 08:53:34 PM

Is the evf usable while recording on this model?
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: briwil on January 31, 2019, 09:26:41 PM
Is the evf usable while recording on this model?
Your EOS-M has a viewfinder??
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: henricusmaria on February 01, 2019, 05:19:38 AM
Comparing these modes: Mv1080p vs 5k anamorphic

Apart from the difference in resolution, which mode has the best image quality? Which mode has the least artifacts?
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on February 01, 2019, 07:14:13 AM
You could easily do some testing on this and find out real quick. Also maybe even post your results.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: henricusmaria on February 01, 2019, 07:42:58 AM
My tests today show that the mv1080p mode is more detailed. With the mlvapp v1.5 I don’t see much difference anymore in artifacts betweeen the two modes. But it could be the weather conditions. Lots of smog today which results in low contrast. Before I’ve noticed a fair amount of aliasing with the mv1080p mode in sunny conditions.
I’m asking because I don’t know if it is the weather conditions or maybe the new mlvapp version that gives different results. And I was under the impression that the new 5k amamorphic mode would yield better results (Less aliasing and better image quality).
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on February 01, 2019, 08:43:08 AM
Please upload short example files. Easy to shorten in mlv app.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on February 01, 2019, 01:19:41 PM
New upload:
https://www.magiclantern.fm/forum/index.php?topic=9741.msg208959#msg208959

- Reverted a reg for anamorphic 2.35:1
- Yesterday commit(preview capability in idle mode) only to work when preview set to 'framing'
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: masc on February 01, 2019, 07:44:48 PM
When using 2.5K and pressing halfshutter the liveview shows some kind of modern art and I have to go back to ML-menu, press menu button to get it back normal. Same for 3K, 4K, 3x1 modes. mv1080 and 5K anamorphic modes are working when doing the same. mv720 mode seems to have wrong framing (1.67 stretching missing?), but does not have the bug descibed above.

4.5 anamorphic seems to record corruption free here. No single corrupted frame so far. Great.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on February 01, 2019, 08:11:55 PM
2,3,4,5k modes needs to be in x5 zoom. Only 2.5k has realtime preview while recording. 3k, and 4k works best with framing set...

Generally to switch modes it is safest to enter and exit ml menu for all regs to settle.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: masc on February 01, 2019, 08:23:25 PM
2,3,4,5k modes needs to be in x5 zoom. Only 2.5k has realtime preview while recording. 3k, and 4k works best with framing set...

Generally to switch modes it is safest to enter and exit ml menu for all regs to settle.
Yes, I do so. Framing is on and I enter and exit ml menu. But as soon as I press halfshutter, I get this problem as described. How can I activate x5 zoom? I thought this is activated automatically?!
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on February 01, 2019, 08:27:04 PM
Yes, activates automatically.
Hm, strange issue, will check later.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on February 01, 2019, 08:44:42 PM
Cannot reproduce. Just tested the latest version. Can you try redownload again and see if it works better?
More users? Working or not in this build?
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: masc on February 01, 2019, 09:02:33 PM
Still the same. Choose 2.5K preset, quit menu, halfshutter, voilà. After going back to ML menu, resolution, fps and crop factor looks weird too. Press menu button and all is fine again.
(https://www.magiclantern.fm/forum/proxy.php?request=https%3A%2F%2Fi.ibb.co%2F84swQmq%2Fbbb.jpg&hash=970edecc5bdb52acd15162aad7c1a290)
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on February 01, 2019, 09:15:41 PM
It says that you are not in x5 mode. If you exit menu from ml menu it should refresh the patch.
You can manually enter x5 zoom by pressing info button until you get the magnifier glass. Push that twice.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: masc on February 01, 2019, 09:34:08 PM
Yes, that works too. But I thought having used 2.5K already focusing with halfshutter... maybe I am wrong.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on February 01, 2019, 09:50:09 PM
Hard to fully understand but if it works when in x5 it's alright. X5 can be lost by entering canon menu and back and if so entering ml menu will refresh the preset again.
The semiautomated x5 stuff I implemenred is really a hack. I wish I could do the presets lik a1ex done them for the 5d3 but I lack knowledge here.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: masc on February 01, 2019, 10:02:16 PM
But even after manually entering x5 zoom - as soon as I press halfshutter I get again this "modern art" screen. This does not happen for you?
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on February 01, 2019, 10:10:21 PM
Actually not.
Could you try and disable all global draw stuff and only keep it on for Liveview so global draw is still on? I suspect some interference from histogram or similar.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: masc on February 01, 2019, 10:49:09 PM
I completely disabled Global Draw and all other features on this tab. Restarted camera. Switched some modules. Restarted camera. Nothing helps. No idea what I am doing wrong or different.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on February 01, 2019, 10:58:46 PM
Hm, strange. Sure you are testing the latest? I put up at least two versions today with the same name.
If you are in x5 zoom and framing is set it should work.
If I use canon menu button I get what you are describing. Sure you are going through "ml" menu? They are not the same.
I need to change the description for this in preset menu I notice since it says canon menu button in there which is wrong.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: masc on February 02, 2019, 10:13:37 AM
Hm... I now tried crop_rec_4k_mlv_snd_isogain_1x3_presets_2019Feb02.EOSM202.zip and get still the same.

Yes, I am going through ML menu. And it looks good and I can record in those presets as long I don't touch the shutter button. If I press shutter half way, lievview fails completely.

mv720 has wrong aspect ratio with framing preview, therefor shutter button works correctly.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on February 02, 2019, 10:38:00 AM
Thanks for mv720p check. Will fix the framing preview later for this mode but it's preferred to use real time preview with high fps modes or even global draw off.
Ok, so let's try and clarify each preset:
- 2.5(x5) will work with framing and real time preview while recording and while idle. Real time will be cropped when halfshutter is pushed.
- 3k and 4k presets(x5) will work with framing and real time(cropped) while idle. When recording only framing works. Pushing halshutter will break preview while recording.
- 3x1 4k and 3x1 5k (x5). Only framing works. Pushing halfshutter breaks preview.
-mv1080p(3×3) same as 2.5k
-45, 46, 48, 50fps mv1080p and mv720p works same as 2.5k(first preset).
-5k anamorphic. Default works as 3k, 4k but 2.35:1 and 16:9 works as 2.5k(first preset)
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: masc on February 02, 2019, 12:05:21 PM
I agree, if "will be cropped" = "will be broken" and "cropped" = "broken"; for 2.5K, 3K, 4K. I formatted another card and did a fresh install. Still the same. And ISO100 doesn't help this time... LOL
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on February 02, 2019, 12:38:54 PM
Too strange. Sent you a pm.
How's this version working for others? Feedback?
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: ctfire on February 02, 2019, 12:44:17 PM
Hi, just tasted the latest version
What is working
2.5k preset 2.35:1 work without corrupted frames - superb!
mv1080 preset 2.35:1 work without corrupted frames - superb!
mv1080 46\48 preset 2.35:1 work without corrupted frames - superb!
mv720p 50fps preset 2.35:1 work without corrupted frames - but preview is not framed correctly in real time preview
3k,4k.5k - preview broken
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on February 02, 2019, 12:48:52 PM
Great.
So 3k, 4k. Also broken when used with framing on? That is when recording not using halfshutter.

Mv720p mode. Try set preview to real-time for correct preview.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: ctfire on February 02, 2019, 04:46:04 PM
Great.
So 3k, 4k. Also broken when used with framing on? That is when recording not using halfshutter.

Mv720p mode. Try set preview to real-time for correct preview.
Sorry i understand not correct first time, now retest and yes i'ts work when press hulfshutter. Preview broken only when recording.
Try real time in 720p with global draw off and yes it's work corrupted frames free.
Thank you Danne for your work
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on February 02, 2019, 04:51:48 PM
Good, works as expected in your case then :).

New upload:
https://www.magiclantern.fm/forum/index.php?topic=9741.msg208959#msg208959

Fix for mv720p if using framing preview(Global draw off recommended though)
Also added a compression reduction line in mlv_lite.c that might or might not help against corruption. We,ll see.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on February 02, 2019, 05:06:34 PM
Masc! Reproduced your issue. Set focus to manual or change the middle af-method setting to the bottom setting. The other two seems to break the party completely. I recommend manual focus dude  :P.
Phew, hard to nail this one.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: masc on February 02, 2019, 05:12:38 PM
Haha... ok. Nice found Danne... hey, this time it wasn't ISO setting! :P
AF method plays no role here, but indeed with MF it works fine! With that I can work for now! :) Big thank you!
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: the_real_bill_jones on February 02, 2019, 09:38:56 PM
Thanks for mv720p check. Will fix the framing preview later for this mode but it's preferred to use real time preview with high fps modes or even global draw off.
Ok, so let's try and clarify each preset:
- 2.5(x5) will work with framing and real time preview while recording and while idle. Real time will be cropped when halfshutter is pushed.
- 3k and 4k presets(x5) will work with framing and real time(cropped) while idle. When recording only framing works. Pushing halshutter will break preview while recording.
- 3x1 4k and 3x1 5k (x5). Only framing works. Pushing halfshutter breaks preview.
-mv1080p(3×3) same as 2.5k
-45, 46, 48, 50fps mv1080p and mv720p works same as 2.5k(first preset).
-5k anamorphic. Default works as 3k, 4k but 2.35:1 and 16:9 works as 2.5k(first preset)

Hi everyone. I've been thinking about purchasing the eos m to use in crop mode with c mount lenses for a long time, but the wonky live view always deterred me. It seems from Danne's post that this is fixed now. Is that right? Is there a real time, correctly framed live view in the 5x crop mode now? Thanks
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: gravitatemediagroup on February 03, 2019, 03:54:55 AM
Loading the 1080 12bit script and changing to 10bit seems to get rid of pink highlights? I may have changed something else, but I’m sure changing the bit helped. (https://www.magiclantern.fm/forum/proxy.php?request=http%3A%2F%2F&hash=e328456e3a59589f384b3e257867a432)
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on February 03, 2019, 08:12:55 AM
Please upload sample mlv files. Mixing bits from raw video setting which that script is adding and then adding 10bit in crop rec submenu won't work with most presets but unclear what you did. It could even be that you changed iso from 100 to 400 that clears the issue since it seems the pink issue happens on iso 100.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: masc on February 03, 2019, 11:16:16 AM
Loading the 1080 12bit script and changing to 10bit seems to get rid of pink highlights? I may have changed something else, but I’m sure changing the bit helped. (https://www.magiclantern.fm/forum/proxy.php?request=http%3A%2F%2F&hash=e328456e3a59589f384b3e257867a432)
Changing bitdepth can't change behavior of clipped highlights. Pink highlights will be there if green sensor channel is overexposed. I explained that already here: https://www.magiclantern.fm/forum/index.php?topic=9741.msg211249#msg211249
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: gravitatemediagroup on February 03, 2019, 03:34:57 PM
It was the iso 800 preset, so if it only happens at 100 that explains it.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: DeafEyeJedi on February 04, 2019, 12:24:43 AM
Please upload sample mlv files. Mixing bits from raw video setting which that script is adding and then adding 10bit in crop rec submenu won't work with most presets but unclear what you did.

Curious to see a sample as well.


It could even be that you changed iso from 100 to 400 that clears the issue since it seems the pink issue happens on iso 100.

That’s a good possibility.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: gravitatemediagroup on February 04, 2019, 11:04:02 AM
The pink highlights have vanished, buuuut I was successful in recording 555 frames of 2.5k.  Keep up the good work!
(https://www.magiclantern.fm/forum/proxy.php?request=https%3A%2F%2Fi.ibb.co%2FpLXZ0Qb%2F9904831-E-84-FB-47-AE-BBFF-C085201307-CD.jpg&hash=a67d07addb3dc754f8f940c30253cbff) (https://ibb.co/pLXZ0Qb)
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on February 04, 2019, 11:09:11 AM
Nothing changed regarding white level in later builds. Pink fix still needs attention and testing.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: masc on February 04, 2019, 12:53:45 PM
I did not understand yet, why in different clips I have to set different white levels to eliminate the pink. I would expect an equal value for equal settings.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on February 04, 2019, 01:08:50 PM
I think it's mainly iso 100:
https://www.magiclantern.fm/forum/index.php?topic=16054.msg195395#msg195395
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: dfort on February 04, 2019, 04:48:09 PM
...I've been thinking about purchasing the eos m to use in crop mode with c mount lenses for a long time, but the wonky live view always deterred me....

Using C-mount lenses on the EOSM (https://www.magiclantern.fm/forum/index.php?topic=15660.msg152725#msg152725) has been discussed several times on the forum. If you use Movie crop mode you'll get real time, correctly framed LiveView. The wonky LiveView is happening with the experimental high resolution crop_rec module settings that can use the entire sensor area. So--if you think about it, many C-mount lenses won't cover the entire APS-C sensor so you can't use them with these experimental settings unless this is what you're after:

(https://www.magiclantern.fm/forum/proxy.php?request=https%3A%2F%2Ffarm1.staticflickr.com%2F671%2F20560712359_321d657bac_z.jpg&hash=42ef154020c07760021bbc28dd0ebd82)
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: gravitatemediagroup on February 04, 2019, 09:13:23 PM
Nothing changed regarding white level in later builds. Pink fix still needs attention and testing.

I didn’t think it had, so I’m guessing I had settings overlapping that was creating the issue, when I tried to recreate it last night I couldn’t.  I’m just happy with how fast the stability is improving.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on February 05, 2019, 10:01:29 PM
New upload:
https://www.magiclantern.fm/forum/index.php?topic=9741.msg208959#msg208959

- Cleaned out scripts, kept two. One is new. "eosm cinema 2:35.1". The script will through lua add all necessary parameters to get into anamorphic 4.5K preset. Once the script has finished you can use any of the crop rec presets and they will all run in 2:35.1 and continuous. A fast sd card will be needed. The script also enables the sd_uhs script "sd overclock engine" and sets it to auto. The script is good as starting point instead of fiddling around for 10 minutes before getting into filming.
Why 2:35.1? Easy. Eosm has it´s limitations and restriction and this ratio seems like sweet spot for most presets on this cam.

(https://www.magiclantern.fm/forum/proxy.php?request=https%3A%2F%2Fi.postimg.cc%2FcChG6s3Y%2FVRAM0-PPM-scaled.png&hash=a6dad97b582d2b9231cfc4c7fc596ee4)

- The other feature(also added though "eosm cinema 2:35.1" script) is "Crop rec preview" in mlv_lite menu. Once this is set to auto mode The crop rec presets will work either with framing or real time preview depending on what works better. Reason for this is that it takes a little too long to switch both preset and preview mode for every preset changed. Watch out. This auto mode setting overrides any Preview mode setting aready set from before. Disable auto mode when not in use.
All modes and settings can of course be set manually without the scripts.

(https://www.magiclantern.fm/forum/proxy.php?request=https%3A%2F%2Fi.postimg.cc%2FwMgd6t1g%2FVRAM1-PPM-scaled.png&hash=b48fc51689d345583a81f6162e994458)

All of this is of course experimental, bleeding edge and out here for tests and feedback. As always thanks to a1ex, g3gg0, dmilligan for code and lua api.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: javchz on February 06, 2019, 03:21:44 AM
Amazing build. Trying with a 4K monitor and it's unbelievable that it's anamorphic and not native 4K. Amazing work. thanks so much
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on February 06, 2019, 07:18:24 AM
Great. Hopefully useful now. I tend to use 4.5k anamorphic and 48fps mostly atm.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: gravitatemediagroup on February 06, 2019, 10:08:07 AM
Some quick shots from yesterday, nothing scientific, just random lighting situations,motion cadence, and sound.  There is some stabilization on a couple clips, so if you see any quick jitters, it’s more than likely stabilization, the Jeep logo shot for sure has a slight bounce.  If you have any questions I’ll do my best to answer.
(A majority of this footage was shot with the 2nd newest build, not the updated scripts build)
https://youtu.be/_Yh6A5sVZ64 (https://youtu.be/_Yh6A5sVZ64)
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on February 07, 2019, 02:15:34 PM
New version:
https://www.magiclantern.fm/forum/index.php?topic=9741.msg208959#msg208959

Added x3 zoom mode through a set switch in the crop mode sub menu. Will work for mv1080p + the mv1080p 46/48 fps presets. Good for close ups. Stays coherent with ratio modes also set from crop rec sub menu:
(https://www.magiclantern.fm/forum/proxy.php?request=https%3A%2F%2Fi.postimg.cc%2FR0GV4G9v%2FVRAM0-PPM-scaled.png&hash=ebcac122aede28319ba3c2658e07f09c)

I excluded 3x1 4k, 5k presets. Too much aliasing.
(https://www.magiclantern.fm/forum/proxy.php?request=https%3A%2F%2Fi.postimg.cc%2FrpqFB3Bh%2FVRAM1-PPM-scaled.png&hash=c4f4786dc61c9d04d28605b7c3c9ee29)
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: AF-OFF on February 07, 2019, 04:28:25 PM
made some quick tests and it looks very good.
in mv1080p 44.959fps one damaged frame (16:9)

all other modes I've tested were without frame corruption.

I've tested the 2.35:1 and 16:9 presets.

the 2,5k mode is now somehow locked to 2.35:1, but I don't have to fps override to 19-20 fps anymore.

all recordings with sound and GD off (to be able to see the write speed)

did not test the 3 & 4k modes. and the new 3x-crop

5k mode without problems

Best thanks to Danne and others.



Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on February 07, 2019, 04:43:34 PM
19 fps is for 3k 2.35:1.
2.5k is static 2.35:1 when set in sub menu otherwise not.
Corrupted frames to be expected here and there if not in 2.35:1 ratio.
Thanks for testing.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: DeafEyeJedi on February 08, 2019, 08:45:07 AM
You know something funny... after years, I mean YEARS of not really taking a deep dive into LUA scripting and boy as soon as I installed @Danne's latest crop_rec_4k_mlv_snd_isogain_1x3_presets_2019Feb07.EOSM202 build, THEN after loading all the Modules respectfully... and BOOM!

Lord & behold I first just simply go to the LUA submenu from within ML menu, enable both sd_overclock and the ratio 2.35:1 scripting magic. Honestly, that was just so beautiful to witness the work of yours, @Danne, governing thru my camera and I totally felt your presence right there. Just like Aliens, ain't that right @70MM13?  :D

After about 10 seconds or so is when it should all be enabled automagically and thus ready to shoot w/o the need to manually enable anything on under Movie submenu from within ML’s menu.. I mean WOW.. what more can you ask for from LUA? Ha.

Never seen anything as good as in ISO 3200 (even @ f2.8 which is a tad slow) and better yet in 4.5K is nothing short of absolutely ridiculous stunning images especially coming from this particular cam. Dual-ISO is indeed pretty gnarly to the very least!  8)

I've encountered something odd though (maybe you guys are already aware) but notice if one constantly goes into half shutter for to check real preview/focus while recording which then can get stuck into the real Live Preview after like 4th or 5th time (tho cropped slightly off center upward) and while it doesn't effect the footage. Well other than some of the corrupted frames -- not sure if it's related as I'll have to investigate further.

However, if you're more cautious and only use it like twice or maybe three times to check focus while recording per MLV takes which should help reduce the chances of getting stuck forcing you to turn off/on cam (Canon menu or ML menu in/out doesn't seem to do the trick for this). Just something to point out before I forget.  ::)

As far as corruption-free footage... I would say it's about 70-80% more or less corruption free for me (see video below) while only shooting in 4.5K ANAMORPHIC @ 2.35:1 in 23.98p and is probably most likely due to my SD card being close to full from earlier tests (forgot to format card).

I even went ahead and deleted a bunch of files from within File Manager in ML (good thing we have this ability just imagine while we're out on set w no computers). Anyway, just felt the need of writing this up before I pass out in bed with these thoughts without sharing.  :P


Can't wait to get my hands dirty on this tiny beast for some more in depth testings (Got few ideas of how to show which way is it cropped slightly off center per certain settings as I suspect some if not all seems to be different from one another)... Hopefully this weekend and Thank You, @Danne!
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on February 08, 2019, 09:01:07 AM
Thanks for kind words deafeyejedi :).
Could you check if this versions is less prone to get stuck in real time liveview?
https://bitbucket.org/Dannephoto/magic-lantern/downloads/crop_rec_4k_mlv_snd_isogain_1x3_presets_2019Feb08.EOSM202.zip
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: gravitatemediagroup on February 09, 2019, 06:06:32 AM
If anybody cares, I’ve created a Facebook group dedicated to “MLV RAW ON EOS M“
https://m.facebook.com/groups/375018026655820?ref=share

Build masters and original ML pioneers get automatic admin status. ;)
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on February 09, 2019, 10:25:20 AM
Great @gravitatemediagroup
Put up some videos in there :).

@deafeyejedi
Didn´t see the video before but it looks really cool. No aliasing, pretty amazing. A little worried about the pink frames you are getting. I have been using the anamorphic 2.35:1 mode for a longer period and couldn´t get any corrupted images. Well maybe one or two. Really shitty issue. Would be such a relief to fix that completely.


Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: DeafEyeJedi on February 09, 2019, 10:55:46 AM
@deafeyejedi
Didn´t see the video before but it looks really cool. No aliasing, pretty amazing.

Thanks! Had to post it for others to understand where we are coming from. Heh.

Also test shot some more extremely low night scenes earlier tonight in Dual-ISO and I’m really surprised w how clean the shadows can be even when pushing the exposure level up to +3.00 or +4.00 within MLV App while pulling down the highlights w ease.

I wonder if the ISO-gain experimental builds from you is what makes it look cleaner or have I been smoking’ the wrong reef? How do we go about to ISO 109? Ha.

A little worried about the pink frames you are getting. I have been using the anamorphic 2.35:1 mode for a longer period and couldn´t get any corrupted images. Well maybe one or two. Really shitty issue. Would be such a relief to fix that completely.

Ya it may be shitty but again it’s not exactly a deal breaker. Seems doable. Not every take has corrupted pink images. I’m hoping this could very well lead us to a pattern and eventually we’ll find a way fix this.

Lemme try some more this weekend w few fast SD cards (280 Mb/s) I know I know it’s a bit overkill but it wouldn’t hurt, right? :)
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: 70MM13 on February 09, 2019, 11:47:06 AM
That's some pretty ace video...  The initial closeup of the cat was stunning.
What's with this miraculous camera?  Who needs a 5d3?  :P

It's getting hard to keep up with all the progress lately!

Exciting times...  Keep up the great work everyone!
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: gravitatemediagroup on February 10, 2019, 06:44:04 PM
Anybody getting vertical lines in newest or 2nd newest build or is it more user error on my part?
(https://www.magiclantern.fm/forum/proxy.php?request=https%3A%2F%2Fi.ibb.co%2F64CdLnX%2FB188-ACBE-4086-4-BFC-AC28-71-D972-FAAFB3.jpg&hash=c6c01e06cf9ae7ab43e1d30f28fca7cd) (https://ibb.co/64CdLnX)
😂
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: OlRivrRat on February 10, 2019, 07:32:46 PM
             @DEJedi

       Nice Vid', Great Cat. Have You tried any ML on SL1/100D lately? Please post on SL1 thread.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: masc on February 10, 2019, 07:43:21 PM
Anybody getting vertical lines in newest or 2nd newest build or is it more user error on my part?
(https://www.magiclantern.fm/forum/proxy.php?request=https%3A%2F%2Fi.ibb.co%2F64CdLnX%2FB188-ACBE-4086-4-BFC-AC28-71-D972-FAAFB3.jpg&hash=c6c01e06cf9ae7ab43e1d30f28fca7cd) (https://ibb.co/64CdLnX)
😂
I get those lines especially when overriding Danne's presets with fps=25.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on February 10, 2019, 08:03:55 PM
Overriding fps is problematic when statically set. What you could do if you only want to push it from 24 to 25 you can decrease reg_6014 until it reaches 25 fps.
Otherwise those lines will appear when bitrate is lowered and liveview register is compensated to increase brightness. All is done though round tripping. At least the footage comes out ok looking...
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Jonit on February 10, 2019, 08:42:31 PM
Something to share with you guys... Here I've put together some of the shots from the wedding filming I did for my friend. It's nuts how good the video looks, I'm really happy with the result, even tho it's sometimes a little difficult to focus some of the shots.
And that slow-mo in RAW, that's a dream coming truhe, heh  :o ;D

Outstanding work Danne and others!



(https://www.magiclantern.fm/forum/proxy.php?request=https%3A%2F%2Fi.ibb.co%2FNs32t0J%2FEOS-M-RAW-mp4-snapshot-01-08-109.jpg&hash=c06a3931468a8d6522dc25a48ec868fb) (https://i.ibb.co/Ns32t0J/EOS-M-RAW-mp4-snapshot-01-08-109.jpg)


(link to original file is in the video description if anyone wants to download)
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on February 10, 2019, 08:58:50 PM
Thanks Joni! great stuff.
Still some pink frames to fix I see for the build to be perfect but I must say 4.5k looks very cinematic.
Thanks for sharing.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on February 10, 2019, 09:07:23 PM
New version:
https://www.magiclantern.fm/forum/index.php?topic=9741.msg208959#msg208959

- Liveview will show a clean 14bit preview while not recording(previewing mode). As soon as you hit record liveview change according to bitrate chosen and analog gain registers will kick in.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: masc on February 10, 2019, 09:10:43 PM
Thx Danne, using this register picture looks way better - whyever. Maybe a little less noise - don't understand, maybe my test conditions are not perfect...

@Jonit: great video! :)
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on February 10, 2019, 10:13:52 PM
Not sure how your footage is affected but when reg_6014 is used you change the reg directly in the preset.
I have set all presets on 2.35:1 to 24 fps as we need the speed and that's also what I use most of the time but 25 fps should be working too for most presets.
If footage has artefacts when using fps override it might be a conflict with power timing registry.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: DeafEyeJedi on February 10, 2019, 10:31:50 PM
             @DEJedi

       Nice Vid', Great Cat. Have You tried any ML on SL1/100D lately? Please post on SL1 thread.

Thanks, @OlRivrRat! Will get back into SL1/100D soon.

Something to share with you guys...

Indeed, great stuff @Jonit -- pretty impressive footage especially coming from an 18-55 IS STM lens. Maybe I should pick up one? Ha.

Also If you don't mind me asking how come you chose abnormal ISO settings (i.e. 400/3200 or even 3200/400) for Dual-ISO footage?

I def gotta get my hands down w this slo-mo 3x3 binning in 47.991p which speaks volumes about this tiny cam's potential. Thanks for sharing!  :o
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on February 10, 2019, 10:40:12 PM
And as always. When using 48 fps turn off global draw for best performance.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Jonit on February 11, 2019, 08:30:22 AM
Thanks guys!

@DeafEyeJedi - regarding DualISO settings, it depends on the lighting conditions. During the day, I aim to expose for the highlights with a base iso (e.g. ISO 100) and then I choose recovery ISO a couple stops higher (in this case it would be 100/800). Let's say that I'm filming indoors where is a bright light coming form the window, but there is also an artifical lighting (like in some of the beginning shots), then I would expose for the window (ISO 400 in that specific example) and set recovery ISO to 3200 to "light up" the remaining indoor scene. It works quite nicely I would say.
Sometimes I do it the opposite way, where I film at ISO 3200 and set the recovery ISO to something like 400. I guess it works both ways.. If I'm wrong then correct me please.

And yeah, that 48fps is golden. I like the fact, that on some of the shots (with not much rapid movements), you can slow it down even further with something like Twixtor or Optical flow and not get much artifacts. Pretty neat!

-regarding the 18-55 IS STM lens, I like that lens very much. It's neat and tiny and OIS is great. But what I like the most about it are the flares it produces when shooting against direct sunlight. Beautiful greenish flares. heh  :)
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on February 11, 2019, 09:22:23 AM
Regarding 48 fps you can try shooting 50fps by decreasing reg_6014 until it reaches 50fps. I think dail down to -50 or so. It´s in the sub menu. Also test the latest build and check if it works any better regarding corruption.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: gravitatemediagroup on February 11, 2019, 10:14:45 AM
Those vertical lines were visible, but scouts honor I didn’t adjust fps override.  I’ll see if I can recreate the issue with newest build, but so far I haven’t seen anything of it.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on February 11, 2019, 10:30:03 AM
Yes, reproduce. Do you have the file somewhere?
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: ctfire on February 11, 2019, 01:11:38 PM
Just test Dannes latest build. 1080p 24 and 48 fps are corruption free, and with nice preview , i think it's the best build i've tested. Only issue is that when fps override is on there is some vertical lines in video. But i don't think it's a big problem fore more users.
Thank you Danne for your work.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on February 11, 2019, 01:26:59 PM
Cool.
Again. fps override will interfere with static set fps. What fps are you aiming for? I could set a preset for another fps, let´s say 25fps in the sub menu. Or you can also use reg_6014(decrease it) to achieve higher frame rates. Of course, the higher frame rate, higher risk for corruption.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: ctfire on February 11, 2019, 01:35:13 PM
Cool.
Again. fps override will interfere with static set fps. What fps are you aiming for? I could set a preset for another fps, let´s say 25fps in the sub menu. Or you can also use reg_6014(decrease it) to achieve higher frame rates. Of course, the higher frame rate, higher risk for corruption.

I try to set it to 23.976  like an experiment , and saw that lines , but it's only visible in 2.35:1 aspect ratio , in particular use i think nobody will use that value on practice. So I think the last build is incredible. Eos m is now more usefull than first BMPCC .
Now i am waiting my focal reducer for eos m, and wanna try how it will work , it will be almost full frame raw camera
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on February 11, 2019, 01:44:16 PM
Nice. Yeah, it´s very versatile. Be sure to check out the x3zoom which gives a really nice tele resolution at 1x1 pixel ratio. Nice to use even for 48fps.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: masc on February 11, 2019, 03:13:59 PM
Cool.
Again. fps override will interfere with static set fps. What fps are you aiming for? I could set a preset for another fps, let´s say 25fps in the sub menu. Or you can also use reg_6014(decrease it) to achieve higher frame rates. Of course, the higher frame rate, higher risk for corruption.
+1! I am looking mostly for 23.976 and 25.000 fps. If this would be possible via submenu, this would be cool for quick setup.

Nice. Yeah, it´s very versatile. Be sure to check out the x3zoom which gives a really nice tele resolution at 1x1 pixel ratio. Nice to use even for 48fps.
I really like this for focusing! Unfortunately this can't work for 1x3 mode.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: gravitatemediagroup on February 11, 2019, 03:26:10 PM
Yeah, 24 or 30 is what I shoot most. But in this situation, tre most stable is all that matters. :)
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on February 11, 2019, 03:29:50 PM
30 fps is probably not gonna work too good. 25fps more so.
For focusing masc? But x3zoom will also record in this mode. Are you after a tempory zoom function?
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: masc on February 11, 2019, 03:58:57 PM
For focusing masc? But x3zoom will also record in this mode. Are you after a tempory zoom function?
My biggest problem is, that I nearly never get correct focus on my EOS M. The 3x zoom helps a lot there. Yes I know, you can record with it too... (really nice! I like how easy it is now!). In 1x3 mode focusing is nearly impossible, because the realtime preview has wrong aspect ratio and is way darker (and green), so beeing outside I really see nothing on my display. Indoor I get it here and there...
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on February 11, 2019, 04:34:01 PM
New version:
https://www.magiclantern.fm/forum/index.php?topic=9741.msg208959#msg208959

Added a 25fps switch in the sub menu:
(https://www.magiclantern.fm/forum/proxy.php?request=https%3A%2F%2Fi.postimg.cc%2F4NwYq2JG%2FVRAM0-PPM-scaled.png&hash=30ad1a2755a55116803ec9fcd598fdc6)

Will work with following presets when 2.35:1 or 16:9 is selected:
2.5K 2520x1418
mv1080p 1736x1158
5K anamorphic


@masc 1x3 real time view is preeeetty anamorphic. Better than nothing. Fixing it is beyond my horizon atm.






Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: masc on February 11, 2019, 04:42:42 PM
Oh thanks so much Danne! I'll try out this evening! :)
Yes, sure, I believe it is not easy. Maybe an idea: could it be possible to switch to "mv1080p x3" when halfshutter is pressed (when not recording) and to switch back to 1x3 when halfshutter released? Maybe doing so only if a option switch is set somewhere... just an idea... you can hit me now :D
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on February 11, 2019, 04:52:21 PM
Yes might work. Problem for me right now it includes switching reg 800c. I don't see how to "fast" switch this register. Maybe a1ex has some ideas  :P
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: masc on February 11, 2019, 06:15:46 PM
Tested your new todays version: 14bit preview is already much better. Now I have some contrast on my screen! 25fps also works fine - so far corruption free. What a shame that exact 25fps is not possible with this reg_6014... but maybe nobody recognizes when using in projects... may I get synchronization problems when recording music videos for 3..5min? 0.005 fps is not much ;)
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on February 11, 2019, 06:27:12 PM
na, think your sync is ok.
We could probably refine this more but it will take some work...
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: OlRivrRat on February 11, 2019, 10:19:44 PM
Is there some benefit to 25FPS vs 24FPS?
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on February 11, 2019, 10:31:28 PM
Yes, you gain 1fps.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: MrIndieJ on February 12, 2019, 12:35:28 AM
Let me just say, WOW. This camera has come a long way! Danne, I can't thank you enough for your contribution. I almost gave up on it, because of the frustrations I had with image quality and all the hassle of settings, but with this newest version (crop_rec_4k_mlv_snd_isogain_1x3_presets_2019Feb11.EOSM202) I literally just installed, enabled the modules, and set the 2 presets to autorun. I am VERY new to this (hence the struggling with focusing in the videos), but these developments have given me the push that I needed.

Below is a sample of what I was able to get out of this rainy, foggy day. First two are handheld, second two are tripod. This was taken with a Canon EF 1.8f STM and the Commlite adapter. I just ran the MLV files through the MLVApp to get H.265 format MP4s.

Link - https://drive.google.com/drive/folders/1rvHN5jidLZLFvB20Mj4ptYFwk7_5L7jf
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: OlRivrRat on February 12, 2019, 01:13:08 AM
Well Big Ol Dummy Me ~
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: henricusmaria on February 12, 2019, 03:15:56 AM
Be sure to check out the x3zoom which gives a really nice tele resolution at 1x1 pixel ratio.

Does this x3 zoom turn mv1080p into moviecrop mode?
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: masc on February 12, 2019, 07:55:30 AM
Is there some benefit to 25FPS vs 24FPS?
Here in germany most TVs seem to work with fps numbers x*25 and use optical flows at 50Hz, 100Hz, 200Hz, 400Hz,...
I always feel it looks smoother if the clip has 25fps than something else. 23.x and 29.x always looks a little jumpi over here. But maybe those jumps are the cinematic feeling... :D
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on February 12, 2019, 10:53:44 AM
New version:
https://www.magiclantern.fm/forum/index.php?topic=9741.msg208959#msg208959

Updated white level for 10bit to following:
iso 100 white level 2840
other isos white level 2890

Tested against highlight recovery sliders in Mlv App. Could probably need some more testing. It´s also arguable if analog gain regs should be pushed a little to get closer to 3000 but seems it works good as is right now.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: optical-work on February 12, 2019, 03:06:03 PM
spent some time with today's build.

mv1080 with x3zoom gives me vertical jagged lines like 3x1 modes. so i tried manually activating x5 zoom and jagged lines are gone but also it says mv1080 works only x1 zoom mode.

i never needed to change resolution and aspect ratio in the raw video menu but when i want to get continuous 2.5k 16:9 setting. if 16:9 preset in crop mode menu could be a continuous setting like 1920x1080 it would be usefull.

4.5k anamorphic title at the bottom line of the global draw is a little bit long and it causes focus distance value disappear. it appears when focus ring is turned but that's laggy and usually no use. so the title might be shorter.

and i only have corruption with mv1080 48 fps x3zoom.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on February 12, 2019, 04:32:42 PM
New version:
https://www.magiclantern.fm/forum/index.php?topic=9741.msg208959#msg208959

Cool @optical-work. All fixed!
Please recheck for jagged edges. No need for x5 zoom. As Levas once pointed out reg 8000 needs to be set to 5 and jagged edges are gone. Had forgotten about that. Also shortened name on global draw and added a 16:9 x5 preset(2192x1234). Let me know how it goes...

Edit:
reuploaded a new build. Missed a line.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: masc on February 12, 2019, 07:24:42 PM
Whitelevel seems to be correct now! Cool!
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: optical-work on February 12, 2019, 11:49:41 PM
jagged edges are gone and 2192x1234 is even better. but focus distance isn't still there with 1x3 mode. actually i can't really complain because you already made focusing easier but again that feature comes in very handy especially adjusting the focus for infinity using these focus rings without hard stops. @Danne

there is also another issue with dual iso. i couldn't end up with a video that doesn't flicker when dual iso is on. i tried various iso combinations with still shots and moving camera and it always flickers without any color adjustments. tested 1x3 mode and mv1080 (in which i'm well aware of having smooth videos before). i'll try again tomorrow though.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on February 13, 2019, 05:10:37 AM
that feature comes in very handy especially adjusting the focus for infinity using these focus rings without hard stops. @Danne

i couldn't end up with a video that doesn't flicker when dual iso is on.
X3zoom for infinity focus. Are you using it as a dedicated focusing tool switching back to non crop when recording or is the x3crop used when recording?

Regarding dual iso an example file would be needed for checking what's going on.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Jonit on February 13, 2019, 08:07:45 AM
there is also another issue with dual iso. i couldn't end up with a video that doesn't flicker when dual iso is on. i tried various iso combinations with still shots and moving camera and it always flickers without any color adjustments. tested 1x3 mode and mv1080 (in which i'm well aware of having smooth videos before). i'll try again tomorrow though.
I'm also having problem with flickering DualISO shots. It flickers ocasionaly on some shots through out the entire clip. But I noticed that on many clips there is flickering in the last second of video or so..

I will upload the file later.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Jonit on February 13, 2019, 06:44:48 PM
@Danne - here is the MLV DualISO file that is flickering - https://mega.nz/#!6ZtH2YiD!qf_-i6sM8Mc9Lp88x80-U_g_m9chrmriQEmMAZq95wA
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: zabenoid on February 13, 2019, 07:35:26 PM
Hi! I have a problem: I'm trying to do silent-film style fps pitch, in music video. Electricity is 50hz so i need to shoot 25fps. So i need to pitch backing music and i maybe need 37 or 38 fps for that and slow it to 25, then play slowed down music to get lip sync, then pitch up the footage back to 37 or 38. (or use led lamps and shoot 16 and pitch to 24). So: i need working FPS override AND some ML version to get my camera to record faster in SD card, am i correct? I can only get to a bit over 31 fps with regular build.
Which build i need to use?
Help!
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on February 13, 2019, 07:47:57 PM
You can start reading from here @zabenoid:
https://www.magiclantern.fm/forum/index.php?topic=9741.msg208959#msg208959

You can get fps up to 45 in mv1080p 16:9. This means you will be able to decrease from 45 to 37 fps which makes it even better for continuous shooting. 25 fps is also working.


@Jonit
What were your settings when exporting this file? What program was used to process? Mlv App? Did you compile it yourself? Official download? You could also try sharing the file in the Mlv App thread since I suspect there is something with conversion which can cause this. Lastly. Did you try exportingthe MLV into dng files instead of exportting to mov file? If the dng files are processed ok then we could suspect either post processing sliders or something in dual iso/Mlv App code.

Edit: I exported the file and can confirm small flicker. Try exporting to dng and see if that works better...Still some micro flicker. I think if anyone can draw a good conclusion here it would be bouncyball.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: optical-work on February 13, 2019, 08:38:13 PM
i think x3zoom has no effect on anamorphic mode but distance parameter is placed, just gone when dual iso is on. sorry, i missed that. @Danne.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on February 13, 2019, 08:49:14 PM
Correct. x3 is applied to the mv1080p presets. Not really useful for anamorphic and the mv720p 50fps mode.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: zabenoid on February 13, 2019, 09:38:27 PM
Ok, thanks @Danne!
Now, about shutter speed, i'm confused... let's say i shoot 18 fps, so how do i get to set it to about 36, to follow 180 rule? Looks very complicated!
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on February 13, 2019, 09:42:27 PM
I have no idea. I think though, using fps override decreasing fps is working better than increasing from my presets. Or you could increase or decrease reg_614 to adjust fps.
Maybe someone else can help further. Good luck.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: liuk718 on February 14, 2019, 06:54:27 PM
being comparison 2.5k 30fps and 5k anamorphic 24fps(2:35:1 on),i choosed 5k anamorphic mode fianlly,it's low noise and very nice quality that i need.thanks danne!
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: optical-work on February 14, 2019, 07:56:27 PM
here, two consecutive 5 seconds shots of a wall, frame is fixed, dual iso is on. i tried them with mlv app and mlvfs, both flickers.

400/800 iso: https://we.tl/t-BYPZmQ9bqC

200/800 iso: https://we.tl/t-ZSFpZKR5Bk

there is also one without dual iso if needed: https://we.tl/t-iNi04I5DFY

Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on February 14, 2019, 08:29:29 PM
Any conclusions? Is it also happening when using base iso 100?
I´ve seen slight variations in colr/white balance causing flicker. Cannot find the post about it but I´m sure a1ex knows what´s going on.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: the_real_bill_jones on February 15, 2019, 04:50:37 AM
I've been trying to shoot with the mv1080 preset in x3 crop mode, but the framing in the preview is all wrong. It's squished and doesn't show the whole frame that's being recorded. When I view the file on my computer, it's fine. Just the preview that's messed up. Is this just how it is, or am I doing something wrong? Thanks

Edit: Seems the framing in regular movie crop mode is off too. Also I'm getting focus pixels in mv1080 crop, but not in movie crop.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: dfort on February 15, 2019, 07:02:05 AM
Also I'm getting focus pixels in mv1080 crop, but not in movie crop.

Which build are you using? Focus pixel fixing for Danne's bleeding edge builds is still a work in progress. Check on the Dealing with Focus Pixels in raw video (https://www.magiclantern.fm/forum/index.php?topic=16054.msg211798#msg211798) for updates. If you are using a build from the official ML downloads pages then we have a problem. Which application are you using for your MLV files?
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: the_real_bill_jones on February 15, 2019, 07:12:10 AM
I'm Using MLV APP 1.5 and the Feb 13th build
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on February 15, 2019, 03:06:08 PM
New build:
https://www.magiclantern.fm/forum/index.php?topic=9741.msg208959#msg208959

"mv1080p correct real time preview"

I´m experimenting with reconfiguring Movie crop mode back to mv1080p and it seems to be working. The positive side effect here is that we get 16:9 real time preview with correct ratio just like when filming 1080p H.264.

Select Movie crop mode:
(https://www.magiclantern.fm/forum/proxy.php?request=https%3A%2F%2Fi.postimg.cc%2F132RHHKM%2FVRAM2-PPM-scaled.png&hash=c808a1ee4269a6a5757158ecc8cdb037)

Then select mv1080p MCM rewire 16:9:
(https://www.magiclantern.fm/forum/proxy.php?request=https%3A%2F%2Fi.postimg.cc%2FHsSkJHcq%2FVRAM0-PPM-scaled.png&hash=c8859d6bd0aabfcdc69ca8fef3db6b9e)

At first you should get the x3 zoom but when the rewire preset is chosen it should get you back into mv1080p 23.980 fps. There should be a black border to the right to indicate you are in the right place. The border won´t affect the recording.
You can always push canon MENU button once or twice to refresh registry if things gets stuck. Restart camera if needed.

This kind of proofs the idea from dfort about Movie crop mode working properly and that it could be reconfigured back to mv1080p. Next step would be to find out what registers could be added without going through Movie crop mode to get straight into this mode without roundtrips. Creating logs with adtg_gui would be a good start.

This preset works with regular bits 14/12/10 lossless and uncompressed but will not work with bitrate changes from the Crop mode sub menu. Only 16:9 for now. Might work changing 24 or 25 fps straight in canon menu. Or even better seems to be using FPS override.

MLV file:
https://bitbucket.org/Dannephoto/magic-lantern/downloads/cat_rewired.MLV
(https://www.magiclantern.fm/forum/proxy.php?request=https%3A%2F%2Fi.postimg.cc%2FYqTmR9Fw%2FSka-rmavbild-2019-02-15-kl-16-52-51-png-500px.png&hash=a451d4d65f533ceb2e8008c731acd11e)

Do not forget. These builds are bleeding edge. Test with caution and report back what´s working and not.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: norek on February 15, 2019, 06:18:44 PM
Danne!

No words... incredible...  :o testing all weekend...
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: henricusmaria on February 15, 2019, 06:45:24 PM
Nice!

Does this also mean less aliasing and moiré?
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on February 15, 2019, 07:00:59 PM
Please do tests, compare and post your results.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: kayman1021 on February 15, 2019, 08:28:29 PM
Apart from the center focus pixels in red and blue, i have noticed some repetetive pattern in both greens as well. Under the cat's head. Very faintly i see it in red and blue as well.

(https://www.magiclantern.fm/forum/proxy.php?request=https%3A%2F%2Fi.ibb.co%2FvdgbgHw%2Fcat-rewired-frame-2-deint.png&hash=804a7e0043b09972873e9584f7fc3cf1) (https://ibb.co/vdgbgHw)
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: masc on February 15, 2019, 09:16:31 PM
Hi Danne, something is strange here when trying your todays build: using mv1080p MCM rewire preset I get a resolution of 1672x564 for 16:9... is that expected? Do I have to stretch it in height like the mv720p files? And I only get 29.973fps, not 23.x.

Edit... no... nothing to stretch. it is 1672x564 and needs no stretch. But ratio in liveview is not correct here too.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on February 15, 2019, 09:26:29 PM
You should get 1736x976 mv1080p. Try canon menu button a few times if nothing works. Also set resolution to max under Raw video menu.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: masc on February 15, 2019, 09:36:45 PM
Hm... max resolution is set to 5xxx pixels, pressed Menu button so often now, but nothing changes. I get only this:
(https://www.magiclantern.fm/forum/proxy.php?request=https%3A%2F%2Fi.ibb.co%2FcFjMMXV%2FVRAM0.png&hash=e67e70d4598c10cf948cb5915e437971)

Edit... AAHHH! Movie Crop Mode has to be switched ON? (see it in your screenshot now)
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: masc on February 15, 2019, 09:47:34 PM
Japp... that's it. Forgot to switch on Crop Mode! Looks fantastic now! ;) Great work Danne!
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: dfort on February 16, 2019, 06:14:14 AM
Made a pass at creating a focus pixel map file for this (https://www.magiclantern.fm/forum/index.php?topic=16054.msg212116#msg212116) but it looks like those subtle focus pixels are stubborn.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: masc on February 16, 2019, 12:06:50 PM
The sun is shining, so I was outside with the new reworked mv1080p mode. Handling is fantastic - I can focus fine now! Yay. In the green grass I saw that the bottom line is red. Maybe you know which register has to be get a little hit to make it the right color :)
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on February 16, 2019, 12:22:20 PM
New build:
https://www.magiclantern.fm/forum/index.php?topic=9741.msg208959#msg208959

Great @masc. Thanks for pixelpeeping. Is version above without the bottom red line?
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: masc on February 16, 2019, 01:09:12 PM
Thanks Danne. The red line is away. But did you change more? In my test clip I got so much moiree and "stair effects" at diagonal lines... way more than with yesterdays build (but don't have it anymore to compare). MLVApp 100% zoom ( f/2.8 ):

(https://www.magiclantern.fm/forum/proxy.php?request=https%3A%2F%2Fi.ibb.co%2FKwwFnRy%2FBildschirmfoto-2019-02-16-um-13-05-00.png&hash=766af439606769409b746b8f01e405b5)

Edit: compared to the "old" mv1080p mode, no stairs to see there using same settings. So something is strange with new version.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on February 16, 2019, 02:22:32 PM
Funky. Deleted the build. Will check into it this evening.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on February 16, 2019, 02:56:17 PM
By the way. Could you test and compare like this:
In Crop mode sub menu do:
Skip_top 2
Skip_bottom -2
This is the old settings.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: masc on February 16, 2019, 04:03:29 PM
Yes, it is better with the change of these two variables. Extreme moiree is gone again. But I don't see the red line... find no green to film for test here.

Edit: yes... red line is back again, moiree is gone with +2, -2. It is not just moiree, there is much more noise and very red focus pixels.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on February 16, 2019, 04:15:58 PM
You could test maybe +1 and -1 too? Will check over here as well.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on February 16, 2019, 04:39:47 PM
New build:
https://www.magiclantern.fm/forum/index.php?topic=9741.msg208959#msg208959

@masc, please test.
Confirmed getting sharper focus pixels and more moiré before. Why, I have no idea.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: masc on February 16, 2019, 04:43:38 PM
What's different in this build?
I tested:
+0-0: moiree and no line
+1-1: less moiree and line
+2-2: have to search moiree and line
+3-3: extreme moiree and noise and 2 lines

Maybe -1+1 is better? :D Edit: no.  :P
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: dfort on February 16, 2019, 04:53:30 PM
There are some cases where the edges might show a red line or a green line or just a change in density depending on what app you use (assuming MLV App in your case).

Here's an extreme example that ACR shows but dcraw doesn't:

(https://www.magiclantern.fm/forum/proxy.php?request=https%3A%2F%2Ffarm8.staticflickr.com%2F7885%2F40148732653_ce4df85f1c.jpg&hash=2d1001ad0e52daf68589ef1518b58e2b) (https://flic.kr/p/24aNKsv)

If you pixel peep the bottom of Danne's cat picture there's also something going on:

(https://www.magiclantern.fm/forum/proxy.php?request=https%3A%2F%2Ffarm8.staticflickr.com%2F7875%2F47061141072_1de79cb81c.jpg&hash=3fd5178db817917f778d4f8553daa8fe) (https://flic.kr/p/2eGCDE1)

Not sure how debayering works but depending on the algorithm it seems that things can get messed up at the very edges. I pointed this out (https://www.magiclantern.fm/forum/index.php?topic=16054.msg195932#msg195932) to Dave Coffin, dcraw developer, but never got a reply from him or a clue how this could be fixed. My hunch is that solving this would also help when removing focus pixels from dual iso footage.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: masc on February 16, 2019, 04:59:23 PM
Tested new build... no red line, but very colorful moiree (I think more then in yesterdays build)
(https://www.magiclantern.fm/forum/proxy.php?request=https%3A%2F%2Fi.ibb.co%2FGCYZgH8%2FBildschirmfoto-2019-02-16-um-16-57-32.png&hash=3031b0dff115032f0f1184f44b22898b)
Picture @ f2.8 (full open)
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on February 16, 2019, 05:02:01 PM
I have the issue right now I can´t reproduce. @masc. What are your settings? fps, iso.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: masc on February 16, 2019, 05:07:33 PM
(https://www.magiclantern.fm/forum/proxy.php?request=https%3A%2F%2Fi.ibb.co%2F3pdWL3F%2FBildschirmfoto-2019-02-16-um-17-06-41.png&hash=96e233931bb9ccf1783159651ac13607)
1/97... ups... hahaha
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on February 16, 2019, 05:18:23 PM
From the latest upload I tested a static scene and ran:
0, 0
+1, -1
+2, -2
+3, -3
+4, -4
then:
-1, +1
+2, -2

All files were about the same regarding aliasing and focus pixels. Hmm.

Could you do a static scene with exact same settings and produce two examples which clearly shows the difference imagewise?
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: masc on February 16, 2019, 05:32:09 PM
Have to do it tomorrow. It is getting dark and the best view to reproduce was outside with fences and trees. Inside I don't get moiree.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: masc on February 16, 2019, 05:52:00 PM
All I see with indoor tests is:
+5-5; +6-6: white line and a red line at the bottom
+3-3; +4-4: red line at the bottom
+1-1; +2-2; 0 0; -1+1; -2+2: no line at the bottom
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on February 16, 2019, 06:21:41 PM
Yeah, the line was easy to get rid of. We need to check what else is going on.
By the way. With this applied in adtg_gui I could correct the black border to the right. Having trouble applying it in crop_rec.c though:
Code: [Select]
case 0xc0f383d4: return 0x4f0010;
case 0xc0f383dc: return 0x42401c6;
Not always sure what regs are applied and which are not going to be accepted in there...
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: gravitatemediagroup on February 16, 2019, 06:48:44 PM
I did a quick 1 clip test of the new 1080 setting and my results were similar to the screen shot a few post up.  ISO was at 800, that's the only specific setting remember, I deleted already assuming it was something I had wrong, but I figured I'd report the issue letting you know it may be something in the build
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on February 16, 2019, 07:08:37 PM
I need mlv files and test comparisons since I can't reproduce the issue. You can reproduce.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: masc on February 16, 2019, 07:09:15 PM
@Danne: this was filmed this morning when testing yesterdays build (Feb15). I really loved the quality of this version. It was really hard to find some moiree... (one roof had some). Hope we get this back soon without red line, without noise & moiree! :)
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on February 16, 2019, 09:23:07 PM
Here is a version which will help testing:
https://bitbucket.org/Dannephoto/magic-lantern/downloads/crop_rec_4k_mlv_snd_isogain_1x3_presets_2019Feb16.EOSM202TEST_rewire.zip

Once all is set and rewired you can enter Crop mode sub menu and set test_rewire to "old" for the settings with the thin red line at the bottom. If set to off you get the latest settings without the thin red line. We need static test scenes for comparisons of moiré and other anomalies.

(https://www.magiclantern.fm/forum/proxy.php?request=https%3A%2F%2Fi.postimg.cc%2F0jRY2R8H%2FVRAM0-PPM-scaled.png&hash=c322b9648f10d02da47014e38b5e0a3f)
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: jacquaviva on February 17, 2019, 02:44:30 AM
Thank you Danne for your work, correct preview is wonderful.
Nevertheless, I get a strange white cross pattern in the middle of each frame and more in general all over the frame a black pattern.
(https://www.magiclantern.fm/forum/proxy.php?request=https%3A%2F%2Fi.ibb.co%2F7QR4t3x%2F1.jpg&hash=21a9e08618988eb0c77d7f9730355608) (https://ibb.co/7QR4t3x)

(https://www.magiclantern.fm/forum/proxy.php?request=https%3A%2F%2Fi.ibb.co%2FQHgpNPT%2F2.jpg&hash=b8fc0a2f24f25efd6b22c1ac45f436a4) (https://ibb.co/QHgpNPT)
 
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: dfort on February 17, 2019, 03:35:34 AM
Those are focus pixels. They can be removed in post. Working on it.


Sent from my iPhone using Tapatalk
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: masc on February 17, 2019, 09:57:03 AM
Hi Danne, light is back, so I tried out your build now. But it looks not as expected:
-rewire=old: no red line
-rewire=off, -2+2=no red line
-rewire=off, +0-0/-1+1=red line
-rewire=off, +1-1/+2-2=red line + one white line
-rewire=off, +3-3/+4-4=red line + two white lines
-rewire=off, +5-5/+6-6=red line + three white lines
Moiree looks always identical (better than yesterday, but can't compare to Feb15). But I don't find stair effects.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on February 17, 2019, 10:07:04 AM
Try refreshing after enabling "old" by opening canon menu and also maybe ml menu.
Tested this morning and it´s not possible to reproduce any issues. What happens is that aliasing can be produced differently but that has more to do with focus, not with ratio changes.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: masc on February 17, 2019, 10:26:42 AM
Okay... got it reproduced, but not as expected. Will shorten the files and upload. Best by far is rewire=Off, -2+2. ;)
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: masc on February 17, 2019, 10:45:51 AM
The only two settings without bottom line are rewire=old and rewire=off-2+2. But in rewire=old I get stairs, hard focus pixels and more artifacts. So in this build I prefere rewire=Off, reg_skip_top=-2, reg_skip_bottom=+2.

You'll find a png with some marked areas in the frame where I looked at details and my receipt file.
https://www.dropbox.com/s/wddfxe3p7zmdsn1/RewireTestrun.zip?dl=0
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: jacquaviva on February 17, 2019, 11:29:08 AM
Thank you Dfort. I can get rid of focus pixels by using the debayer amaze in MLVapp, but can't use it by exporting to dng sequence. How to ?
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on February 17, 2019, 11:32:51 AM
Set chroma smooth to 3x3.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on February 17, 2019, 11:50:46 AM
@masc
Settings right now if test_rewire is set to off:
Code: [Select]
        skip_top = 84;
        skip_right = 60;
    skip_bottom = 0;

Let´s apply your optimised setting "So in this build I prefere rewire=Off, reg_skip_top=-2, reg_skip_bottom=+2.":
Code: [Select]
        skip_top = 82;
        skip_right = 60;
    skip_bottom = 2;

Only one problem. The first commit after noticing the thin red line was exactly the setting above:
https://bitbucket.org/Dannephoto/magic-lantern/commits/5cb143d56c2dcb9a16f27c5094e4f8f1ee8fb52b

Your comment to that commit:
https://www.magiclantern.fm/forum/index.php?topic=9741.msg212152#msg212152

So, I revert back to the first commit as long as we all agree this problem is not as easy as we first thought? Any other thoughts?

Also note that when test_rewire is set to old it´s the exact lines as with the build before any thin redline fixes were applied(same as february 15th).
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: masc on February 17, 2019, 12:05:46 PM
Very strange. Do we have a kind of sign error somewhere? Don't understand all this at all.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on February 17, 2019, 12:40:42 PM
Placebo?
Anyway. Here´s a build with your proposed settings working best:
https://www.magiclantern.fm/forum/index.php?topic=9741.msg208959#msg208959

Here is the feb 15th build compiled exactly before the thin red line fix in commit tree(compiled today and renamed):
https://bitbucket.org/Dannephoto/magic-lantern/downloads/crop_rec_4k_mlv_snd_isogain_1x3_presets_2019Feb15.EOSM202.zip
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: jacquaviva on February 17, 2019, 12:42:49 PM
Thank you, chroma smoothing works with dng out.
Danne, is there a way to save crop mode activated when booting the camera. I always have to switch it on again. Thanks
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on February 17, 2019, 12:50:05 PM
Yes, you can enable it but I havn´t found a way to disable it when changing presets in crop rec once it´s enabled. In crop_rec.c put in this at the top:
Code: [Select]
#include "crop-mode-hack.h"
Then inside static int crop_rec_needs_lv_refresh(): in crop_rec.c put in following:
Code: [Select]
if (crop_preset == CROP_PRESET_mcm_mv1080_EOSM)
{
        movie_crop_hack_enable();
}

Compile.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: masc on February 17, 2019, 01:07:26 PM
Placebo?
Anyway. Here´s a build with your proposed settings working best:
https://www.magiclantern.fm/forum/index.php?topic=9741.msg208959#msg208959

Here is the feb 15th build compiled exactly before the thin red line fix in commit tree(compiled today and renamed):
https://bitbucket.org/Dannephoto/magic-lantern/downloads/crop_rec_4k_mlv_snd_isogain_1x3_presets_2019Feb15.EOSM202.zip

No, don't think so. The "stairs" are very easy to identify at 45° edges, same for the red line. But what happened for your "rewire=old" preset? Why activates it the stairs, and -2+2 doesn't. And all this does not fit to yesterdays build. Something must be wrong.

Will test again the posted builds.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: jacquaviva on February 17, 2019, 01:15:20 PM
Thanks Danne, I don't know to compile but I'll figure it out.
Thanks you again for this work !

One question about MLVapp, is there a way to set by default 3x3 chroma smoothing, I have to set it for each MLV file.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: masc on February 17, 2019, 01:27:21 PM
@Danne:
I expect indeed a sign error somewhere. I again tested the first build after the red line (the one with the stairs). Reproduced all I saw yesterday. BUT: reg_skip_top=-4 and reg_skip_bottom=+4 looks perfect ;)
What happens for:
Code: [Select]
        skip_top = 86;
        skip_right = 60;
    skip_bottom = -2;

@jacquaviva
Activate it once for one clip, Ctrl+C (maybe activate in mask chroma smoothing only), Ctrl+A, Ctrl+V.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on February 17, 2019, 01:39:10 PM
-4, +4, link or name of build used?
What's a "sign error"?
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: masc on February 17, 2019, 01:45:10 PM
Build used is: crop_rec_4k_mlv_snd_isogain_1x3_presets_2019Feb17.EOSM202
-4+4 looks perfect. Registers have 82 and 2 by default, you wrote

Build before:
-2+2 looked perfect. Registers were 84 and 0 by default.

So I think the math behind is not default+offset, it is default-offset. The algebraic sign (+ instead of -) should be wrong - or I am... confusing...  :P

So I would try 86 and -2 next.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on February 17, 2019, 02:33:33 PM
Build used is: crop_rec_4k_mlv_snd_isogain_1x3_presets_2019Feb17.EOSM202
-4+4 looks perfect. Registers have 82 and 2 by default, you wrote
-4+4 equals:
Code: [Select]
        skip_top = 78;
        skip_right = 60;
    skip_bottom = 6;

86 and -2 as suggested would become
Code: [Select]
        skip_top = 86;
        skip_right = 60;
    skip_bottom = -2;
And then we have a fat white border at the bottom.

We need to shave at minimum 2 at the bottom to get rid of the bottom pixels:
Code: [Select]
    skip_bottom = 2;Since default skip_top is 72 we can safely add back what´s shaved at the bottom since we here start at:
Code: [Select]
    skip_top = 84; so decreasing to 82 will keep us at 1736x976(16:9):
Code: [Select]
        skip_top = 82;
        skip_right = 60;
    skip_bottom = 2;

I cannot reproduce the issue described so I really suggest you download my branch and get right into crop_rec.c and compile crop_rec.mo with any optimised settings you come up with. It´s easy with Compiler.app. Just get into the modules area and find this menu:
(https://www.magiclantern.fm/forum/proxy.php?request=https%3A%2F%2Fi.postimg.cc%2FBvVHfVZ8%2FSka-rmavbild-2019-02-17-kl-14-24-25-png-800px.png&hash=65eddd4684a50c23c497a8a2f845a61f)
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: masc on February 17, 2019, 02:47:15 PM
-4+4 equals:
Code: [Select]
        skip_top = 78;
        skip_right = 60;
    skip_bottom = 6;
...if the register screen does what we think it does...
86 and -2 as suggested would become
Code: [Select]
        skip_top = 86;
        skip_right = 60;
    skip_bottom = -2;
And then we have a fat white border at the bottom.
Have you tried out? Oh man... I really don't understand what happens here.
I cannot reproduce the issue described so I really suggest you download my branch and get right into crop_rec.c and compile crop_rec.mo with any optimised settings you come up with. It´s easy with Compiler.app.
What a shame it seems I am the only one getting this. Unfortunately I am here with OSX 10.9, which is not supported by your compiler app (or by brew).
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on February 17, 2019, 02:57:00 PM
Yes, tested.
It is not evident what to look for to me. But general tests on static scenes I cannot see anything significant and judging from that we can get different results from same builds and commits it suggests it´s a problem somewhere else.

Why isn´t compiler.app working? Can you try double clicking the main.command inside Compiler.app/Contents/?

You might wanna give the command admin rights:
Code: [Select]
chmod u=rwx main.command
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: masc on February 17, 2019, 03:08:56 PM
Brew isn't supported on OSX 10.9 (or the packages needed). So no chance for your app. It won't install anything.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on February 17, 2019, 03:12:17 PM
Ok, reproduced. Wtf! Some alignment issue:
(https://www.magiclantern.fm/forum/proxy.php?request=https%3A%2F%2Fi.postimg.cc%2FMHLfhs76%2FSka-rmavbild-2019-02-17-kl-15-08-57-png-500px.png&hash=043102ed12e293810115051e3d2970e2)

82, 0
(https://www.magiclantern.fm/forum/proxy.php?request=https%3A%2F%2Fi.postimg.cc%2FyYwSjb6n%2FSka-rmavbild-2019-02-17-kl-15-09-38-png-500px.png&hash=9a5eea2831b4479183dd8749876e526f)

-4, +4
(https://www.magiclantern.fm/forum/proxy.php?request=https%3A%2F%2Fi.postimg.cc%2FTPx5M5DD%2FSka-rmavbild-2019-02-17-kl-15-09-57-png-500px.png&hash=b59a408dc65712a7e9f91c31c12cafed)


82, 0
(https://www.magiclantern.fm/forum/proxy.php?request=https%3A%2F%2Fi.postimg.cc%2Fj2YSNG4J%2FSka-rmavbild-2019-02-17-kl-15-12-31-png-500px.png&hash=d515b286870c6ace1ecdc943e81389bb)

-4, +4
(https://www.magiclantern.fm/forum/proxy.php?request=https%3A%2F%2Fi.postimg.cc%2Fgkd00b0C%2FSka-rmavbild-2019-02-17-kl-15-12-39-png-500px.png&hash=4a42aa58acd5bc876ef8eabf982df88d)


Brew for 10.9?
https://coolestguidesontheplanet.com/setting-up-os-x-mavericks-and-homebrew/


EDIT:
Tested again and cannot reproduce it now. Crazy. Can´t make sense of it.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: masc on February 17, 2019, 03:44:59 PM
Yes, that looks like what I see here. Best use a wideangle lens where a lot is in focus. Then search trees and hard contrast edges at 45°. Very easy to reproduce this way.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on February 17, 2019, 04:37:35 PM
I did a slight change and it seemed to be enough. Is this version working for your wide angle lens?
https://bitbucket.org/Dannephoto/magic-lantern/downloads/crop_rec_4k_mlv_snd_isogain_1x3_presets_2019Feb17.EOSM202.zip

Code: [Select]
        skip_top = 81;
        skip_right = 60;
    skip_bottom = 3;
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: DeafEyeJedi on February 17, 2019, 05:30:53 PM
Tying to reproduce this w both 10mm 2.8 & 11-20mm 2.8 lenses to no avail. I don’t blame you guys for this strangeness though. I’m pointing at a white wall w a fan (to show /aliasing/moire effects) and will try again w the latest build from 50 mins ago.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: masc on February 17, 2019, 06:20:57 PM
I think, first of all, we need a simple strategy to reproduce. I loaded the ISO 12233 test chart, printed with a laser printer... not perfect, but should be enough. I took EF-M 18-55 STM @ 55mm, fully open. And now you might see which picture is which setting:
(https://www.magiclantern.fm/forum/proxy.php?request=https%3A%2F%2Fi.ibb.co%2FDYPX2K7%2FM17-1808-frame-1.png&hash=272c568ed96139280b40632f7a8aa0fc)
(https://www.magiclantern.fm/forum/proxy.php?request=https%3A%2F%2Fi.ibb.co%2FTc8ngcn%2FM17-1809-frame-1.png&hash=e004e37a8789e9d7245e24391916c560)
I think the pics look very different... see the focus pixels and the amount of moiree.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on February 17, 2019, 06:31:39 PM
How does the last build perform?
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: a1ex on February 17, 2019, 06:32:26 PM
Best guess: this must be 3x3 readout with line *and* column skipping!

Here's a test on the resolution chart (roughly this (https://www.magiclantern.fm/forum/index.php?topic=16516.0), but updated for movie crop mode, where IIRC you can't just toggle between x1 and x5 zoom freely). This test will take 2 images, one in the tested video mode and another in x5 zoom, with no absolutely camera or subject motion between them. That will reveal the exact pixel binning mode. Tested on 5D3 (iso-research branch, but should work on any recent experimental build).

Code: [Select]
-- Pixel binning test
-- Save this file as bintest.lua or similar.

--[[
Requirements:
- lua.mo (of course)
- silent.mo
- test subject: resolution chart, perfectly focused and with good light
- camera standing still (important) on a flat surface
- absolutely NO camera or subject movement during the test (important!)
--]]

menu.close()
sleep(1)
display.notify_box("Preparing...")
sleep(1)
assert(camera.mode == MODE.MOVIE)
assert(lv.running)
menu.set("Silent Picture", "Silent Mode", "Simple")
menu.set("Shoot", "Silent Picture", "Simple, DNG")
menu.set("Movie", "RAW video", "OFF")       -- just in case (no need to load mlv_rec or mlv_lite)
menu.set("Movie", "RAW video (MLV)", "OFF") -- but if you do, let's turn them off
sleep(5)

-- first test image in 1080p 3x3 (derived from Canon's crop mode)
display.notify_box("First test image...")
menu.set("Movie", "Movie crop mode", "ON")
menu.set("Movie", "Crop mode", "mv1080p MCM rewire 16:9")
sleep(1)

-- refresh LiveView
camera.gui.menu = true
sleep(1)
assert(not lv.running)
camera.gui.menu = false
sleep(1)
assert(lv.running)
sleep(2)

-- take a silent picture
key.press(KEY.HALFSHUTTER)
sleep(1)
key.press(KEY.UNPRESS_HALFSHUTTER)
sleep(5)

-- now turn off crop mode and enter x5 zoom
display.notify_box("Second test image...")
menu.set("Movie", "Crop mode", "OFF")
menu.set("Movie", "Movie crop mode", "OFF")
sleep(1)

-- refresh LiveView once again, just in case
camera.gui.menu = true
sleep(1)
assert(not lv.running)
camera.gui.menu = false
sleep(1)
assert(lv.running)


lv.zoom = 5
sleep(20) -- large delay to "fix" vertical stripes

key.press(KEY.HALFSHUTTER)
sleep(1)
key.press(KEY.UNPRESS_HALFSHUTTER)
sleep(5)

-- cleanup
menu.set("Shoot", "Silent Picture", "OFF")
lv.zoom = 1
display.notify_box("Finished.")

edit: after writing and testing this script, I've just realized it would be enough to take one test picture with our crop mode enabled (i.e. 1080p 3x3 derived from it), and another one with our crop mode disabled (i.e. 1:1 readout). In both cases, Canon's movie crop mode would be active.

BTW - if my hypothesis is true, the fix is somewhere in the CMOS registers. You are lucky - the search space is very small :D

Tweaking skip offsets will do absolutely nothing to fix the image aliasing. These offsets will specify how to interpret the raw data in post (i.e. how many border pixels to throw away). The effect of that would be only in the alignment of focus pixel maps, but that won't help with the aliasing issue in any way.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: masc on February 17, 2019, 07:28:10 PM
How does the last build perform?
I would say even worse... the moiree is so extreme, that you can see it in liveview already.
(https://www.magiclantern.fm/forum/proxy.php?request=https%3A%2F%2Fi.ibb.co%2FCKX0Z00%2FM17-1924-frame-1.png&hash=76615a4922e5fcfca2c1e9569544696a)
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: masc on February 17, 2019, 07:40:41 PM
@ a1ex: I tried running your script... I saw the outputs "preparing, 1st, 2nd, finished...", but where do I find the pictures? Can't find anything on my card...  :o

Edit: halfshutter for taking a silentpic? Is that correct?
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: a1ex on February 17, 2019, 07:48:39 PM
They should be in the usual place (DCIM directory). If they don't appear, there might be some memory allocation issue. Any relevant message in the Debug tab or on the console?

If you take the pictures manually, with the silent picture module, does that work? Yes, with half-shutter.

Sorry, unable to test the script on the M. It did work on 5D3 (including the pictures).
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: masc on February 17, 2019, 07:50:16 PM
Sorry... found it... too stupid. I have to load silent.mo! Will test again now.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on February 17, 2019, 07:51:20 PM
Ok, could you check into a1ex findings masc? Running out of time here.(Cool, saw masc already tested)

The two cmos regs I can make use of is cmos 5 and cmos 7. Both available for tweaking in Crop mode menu. They are now set to:
cmos 5 0x20
cmos 7 0x800


It is not clear to me where and how to securely reproduce this issue. Just testing now it seemed when I was first starting my cam the aliasing seemed worse but after first recording seemingly som regs settled and the next recording was better. This has to be taken with a grain of salt. No tripod used.

Any other recommended cmos regs to be used are very welcome.
Also curious on a personal note how to add these regs won´t bite in crop_rec.c:
Code: [Select]
case 0xc0f383d4: return 0x4f0010;
case 0xc0f383dc: return 0x42401c6;
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: masc on February 17, 2019, 07:58:35 PM
Hm... still have problems with the script. Again no picture. Then I setup silent shoot manually - no prob - working with halfshutter and DNG availlable.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: a1ex on February 17, 2019, 08:03:46 PM
Any relevant messages on the console (while running the script), or in the Debug menu (afterwards) ?

edit: also tested on 60D, no issues.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: masc on February 17, 2019, 08:04:54 PM
Got it. I enabled silent picture mode manually, run the script -> bingo.
Here are the files: https://www.dropbox.com/s/o3sohi4i88xhwe3/binningtest.zip?dl=0

The setup tested should be:
Code: [Select]
        skip_top = 82;
        skip_right = 60;
    skip_bottom = 2;
->the yesterdays setup "with stairs"
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: a1ex on February 17, 2019, 08:30:34 PM
OK, tested it in QEMU directly on Danne's build. The menu.set calls for the silent picture menu failed, but all others appear to have worked. One of them was my typo.

I wonder what's up with the vertical lines in the x5 mode. This is *after* crop_rec was turned off, and LiveView refreshed by going into Canon menu and back. Maybe it still has some hooks running? I've edited the script with a minor change that should give Canon firmware sufficient time to reduce these stripes.

Mind running the test again, with the lights turned on? The images are quite underexposed.

Edit: is it just me, or was this test done in "regular" 1080p, i.e. not the one derived from Movie Crop Mode? I don't see the "horizontal" aliasing in this picture (the extreme moire just isn't there). I've assumed the right configuration for the "buggy" 1080p was with "Movie crop mode" set to "ON" and "Crop mode" set to "mv1080p MCM rewire 16:9". If this is not the case, just edit the script. Both options appear to work fine in QEMU (menu.set changes them successfully).

Or maybe you need to enter Canon menu and go back to LiveView more than once, or other kind of trickery? What exactly are you doing to enable this mode manually, without a script?
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on February 17, 2019, 08:53:28 PM
Correct about Movie crop mode on and then the mcm preset.
I did an exception raw.c:
Code: [Select]
/* work in progress */
        #ifdef CONFIG_EOSM
if (mv1080crop)
{
        skip_top = 84;
        skip_right = 60;
}
        #endif
Wanted it to match 1736x976(16:9).
Maybe clean out the exceptions and run clean Movie crop mode?
Will do some more checking when I have more time...
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: masc on February 17, 2019, 08:59:21 PM
Updated the script and run again. https://www.dropbox.com/s/oi5y5ebntdh2rnp/binningtest2.zip?dl=0
Sorry... we're very poor here... all 4 lights were on. :D But I raised ISO, so it should look better now. Vertical stripes are still there.

One more finding: I was able to see the aliasing with magic zoom function in liveview. I then pressed somehow 2x canon menu button, enter, leave. After that all the aliasing stairs were away - using the "bad" mode. Recorded another MLV and it looked like the one with -4+4 skipping at top and bottom. Maaaaagic.

How do I enabling the mode:
- switch on camera
- activate crop_rec setup "... rewire ..."
- crop_mode = ON
- leave ML menu
- record

-> when pressing 2x menu button before recording, all is fine.
-> maybe this is why Danne was not able to reproduce?!
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: a1ex on February 17, 2019, 09:03:34 PM
@masc: looks better, but... where's the extreme moire?!

@Danne: No need to change anything in the core code or crop_rec; I want to test the current configuration. I'm looking for a way to switch, from a Lua script, between 1080p (derived from movie crop mode) and some sort of 1:1 crop mode (either x5 zoom, or plain movie crop mode - any of these will do).

The last test images were taken in "regular" 1080p (not the one with extreme moire), and x5. Maybe you can help debugging that script? I need one image in the "extreme moire" 1080p mode, and another in some sort of 1:1 crop mode (x5 or plain movie crop mode).
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: masc on February 17, 2019, 09:13:42 PM
@a1ex: when running the script, canon menu pops up before taking a picture. Maybe after that, moiree is away? Doing that manually it looks like that:
(https://www.magiclantern.fm/forum/proxy.php?request=https%3A%2F%2Fi.ibb.co%2FxFLxxLX%2Ftest.jpg&hash=8bdb40be168aec8e0a7a5b85d042bef2)
1. just configured
2. pressed 2x menu button (enter&leave canon menu)
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: a1ex on February 17, 2019, 09:21:57 PM
A-ha!

So, once you enter and leave Canon menu (which you should do anyway, according to the help, so... that's what I did in the script), it's fixed?

It probably means some of the CMOS registers are not updated until you refresh the LiveView. One of these must control the column binning mode somehow (i.e. whether column skipping or binning is used). As a side note, this "feature" could be used together with IS (to shift the lens in some uncontrolled way) and used for super-resolution experiments - there, you actually *want* aliased data.

OK, then just for my own curiosity about line/column skipping - comment out the menu enter/leave stuff from the script, before the first picture, and it should take the extreme moire version.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on February 17, 2019, 09:37:40 PM
Cool findings.
It´s not possible to enter x5 zoom when the preset is reconfigured. The camera thinks it´s in digital zoom but maybe it´s affected positive "trying" to get into x5. Anyway. Pretty sure some toggling back and forth from canon menu/ml men back and forth should settle the regs.
Will try to find time tomorrow to check scripts and findings.
Thanks again...
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: masc on February 17, 2019, 09:47:31 PM
Deleted the lines for the menu in the script. First picture has "wonderful moiree", but camera won't record a second picture. Instead doing so, screen turns 9/10 white. When pressing menu 2x between the 2 shots, I get a picture... but I will "shake" the camera with that. So... I delete only the 1st menu open/close? Or wouldn't help that?
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: a1ex on February 17, 2019, 09:51:17 PM
Yes, try deleting just the first open/close. After getting the extreme moiré picture, you just need to take a plain 1:1 image. Going into menu and back will be required for disabling crop_rec, I guess.

Or, capture the 1:1 image first. Toggling video modes without crop_rec active (or before touching it) should be a bit more reliable.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: masc on February 17, 2019, 10:01:05 PM
Okay. Done. Here you are: https://www.dropbox.com/s/70ig9z535kixmk0/binningtest3.zip?dl=0
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: optical-work on February 17, 2019, 10:58:00 PM
i tried feb15 and feb16 builds.

feb16 build, test_rewire=off https://we.tl/t-ovOwsGOc9L

feb16 build, test rewire=on https://we.tl/t-JiMxCRBEAG

feb15 build https://we.tl/t-lJ2adcCokh

there is a 1 mm focus length difference between first two and third one happens most likely when i changed the sd card. i don't know if these are eligible but i can't see a particular aliasing issue like masc mentioned or can't reproduce it.

i worked on fresh builds.
- loaded 2.35:1 eosm lua script.
- checking the identical settings for iso, shutter speed, aperture, and white balance
- disable crop mode (and also 10bit and 2.35:1), exit ml menu
- enable movie crop mode, exit ml menu, menu button twice
- enable rewire, exit ml menu, menu button twice

Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on February 18, 2019, 06:17:46 AM
Yes, been testing different fixes for a problem solved(read last 5-10 posts). Toggle menu button for registers to settle to avoid any issues.
Last 17th february build should be ok.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on February 18, 2019, 07:03:17 AM
So conclusion regarding the latest Movie crop mode round trip back to mv1080p. For it to work properly after Movie crop mode has been enabled you absolutely need to enter canon menu and go back again for regs to settle/apply. The difference could be this:

Before:
(https://www.magiclantern.fm/forum/proxy.php?request=https%3A%2F%2Fi.postimg.cc%2Fmk0q88fH%2FSka-rmavbild-2019-02-18-kl-06-56-33-png-800px.png&hash=f062bf2a24ece28002b89def8fa34370)

After:
(https://www.magiclantern.fm/forum/proxy.php?request=https%3A%2F%2Fi.postimg.cc%2FC5ZXG9t0%2FSka-rmavbild-2019-02-18-kl-06-56-26-png-800px.png&hash=f3b38f310ba47c92fdc225289f5d6a05)
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: a1ex on February 18, 2019, 08:50:45 PM
Okay. Done. Here you are: https://www.dropbox.com/s/70ig9z535kixmk0/binningtest3.zip?dl=0

Pretty interesting binning pattern. It is, indeed, 3x3 readout with line/column skipping, i.e. using only one pixel out of 9. However, it has an additional property - every two columns are adjacent. This results in... even more moiré!

(https://www.magiclantern.fm/forum/proxy.php?request=https%3A%2F%2Fa1ex.magiclantern.fm%2Fbleeding-edge%2Flv-binning%2Fbinmode-3x3-rcskip-extrememoire.png&hash=f4d20593f027d6ea933d2e8532c41eea)

Details: extreme-moire.html (https://a1ex.magiclantern.fm/bleeding-edge/lv-binning/extreme-moire.html)
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on February 18, 2019, 10:03:46 PM
extreme moiré  8)
Lovely write up. Hypnotic almost.
Now, how to narrow down the properties and control them?
On a side note I know I soft bricked my eosm once before  :P but I am still intrigued if it´s even possibe to run digital zoom in mv720 mode for faster timers(48fps HDR) for instance...
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: a1ex on February 18, 2019, 11:16:19 PM
The name comes from Masc:

I would say even worse... the moiree is so extreme, that you can see it in liveview already.

Horizontally, I'm pretty sure the "properties" are actually the CMOS registers. I'd start by comparing CMOS configuration before pressing MENU to refresh LiveView, and after.

Caveat: adtg_gui won't work at the same time with crop_rec, so... it's going to require a bit of guesswork. Maybe print debug messages from crop_rec's cmos_hook and figure it out from there.

Digital zoom in 720p... not sure what the question is. Frame rate limits are given by resolution and pixel binning mode. So far, I wasn't able to alter them by starting from some other video mode.

720p normally works by skipping more lines (5x3 vs 3x3); that lets you reduce vertical resolution and increase the frame rate. With 1:1 crop, you are no longer able to do that (unless you use 3x1 with line skipping, which... let's just say it's not the best idea).

Theoretical readout speed on EOS M (and also 700D, 650D, 100D, M2 etc) is 32 MHz x 4 channels. In theory, it should be fast enough for 1080p48. In practice, maybe not. The 700D can do 1736x1160 (3x3) at about 43 FPS IIRC (didn't test it myself). That would be timer A = 520, B = 1431. For 48 fps, you would require B = 1282.  If you trim 150 pixels vertically, that should do the trick.

See 700D.png (https://a1ex.magiclantern.fm/bleeding-edge/lv-resolution/700D.png) and 700D-crop.png (https://a1ex.magiclantern.fm/bleeding-edge/lv-resolution/700D-crop.png) (from here (https://www.magiclantern.fm/forum/index.php?topic=19300.msg207723#msg207723)). Most of the overheads are from the hardware (some of them *might* be tweakable via ADTG registers, e.g. see this picture (https://a1ex.magiclantern.fm/bleeding-edge/1100D/1100D-lv-readout.jpg) from 1100D). There is also a software overhead of about 2.5 ms on 5D3 (https://a1ex.magiclantern.fm/bleeding-edge/lv-resolution/5D3-edmac.png); exact value may be different on other models.

The 1100D is an interesting beast - it uses CH4-6483 (https://www.photo-parts.com.ua/parts/part_profile.php?part=4899), i.e. the same 32 MHz x 4 channels interface as the early DIGIC 5 APS-C models (that's right, 1100D isn't your average DIGIC 4 cam), yet it has its sensor severely throttled in video mode, likely from ADTG configuration. Comparing ADTG/CMOS registers between 1100D and EOS M / 700D / 650D is likely to reveal the key to adjusting these timing "overheads" (or whatever they are).
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: theBilalFakhouri on February 19, 2019, 12:32:08 AM
I could reach 1736x976 @ 50 FPS 3x3 and without problems in uncompressed RAW with maybe very few corrupted frames like 1 to 3 in 250 frames clips sometimes no corrupted frames at all.

So 700D it's capable to do 1080p @ 50 FPS that's interesting too.

Very nice work Danne, masc and a1ex; please make another mistake to Enable Vertical lines Binning in small cameras  :D
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on February 19, 2019, 12:44:59 AM
Could you share some thought reg wise on getting 50fps. i can reach 46 fps but that´s it for higher resolution 1736x976. I can do 48fps at 1648x702, check code below. Could you take a look at  these regs. More to tweak? (Below is NOT the rewired preset but another high fps preset on the eosm.)
Code: [Select]
        case 0xC0F06804: return 0x2f701d4;
        case 0xC0F0713c: return 0x33d;
case 0xC0F07150: return 0x2fa;

     /* 48 fps */
            case 0xC0F06014: return 0x4db;
case 0xC0F0600c: return 0x2170217;
case 0xC0F06008: return 0x2170217;
case 0xC0F06010: return 0x217;

case 0xC0F06824: return 0x206;
case 0xC0F06828: return 0x206;
case 0xC0F0682c: return 0x206;
case 0xC0F06830: return 0x206;

I´d be happy to achieve 48 at the same resolution(1648x702) with the rewire preset to be able to run HDR but messing with reg 6804 is a no go since Movie crop mode dominates the regs when set and then crop_rec will not be able to add anything new except for maybe cmos changes. Tried reducing height in raw.c but still corrupted frames already at 42 fps after modifying fps-engio B-timer to 1283 (A-timer 520). 48 fps the same, corruption.

Any suggestion codewise to come further are most welcome. Thinking 713c and 7150 would not hurt to get access too as well here...
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on February 19, 2019, 08:07:25 AM
Added Movie crop mode resolution for engio_vidmode_ok so now it will be possible to modify engio regs from crop_rec.c. Missed that little detail before. Will add capture regs later.
Code: [Select]
     engio_vidmode_ok =
             (old == 0x4540298) /* x5 zoom */ || (old == 0x42401e4) /* x3 digital zoom */ || (old == 0x4a601d4) /* 1080p */ || (old == 0x2d701d4 /* 720p */);

cmos regs can already be tweaked from inside Crop mode sub menu if one wants to play around with extreme moiré fixing.

Sidenote. Could reg 8000 have something to do with the extreme moiré setting? Noticed it will affect image when all cmos regs are set but it till not enter x3zoom. It´s correctly set to 6 here but maybe it´s not switched on before toggling canon menu.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on February 19, 2019, 11:44:48 AM
New build:
https://www.magiclantern.fm/forum/index.php?topic=9741.msg208959#msg208959

The mv1080p MCM rewire will now work as any other preset. All Crop mode sub menu options available:
bitdepth
ratios
x3crop
set 25fps
registry...

Also added a config fix from long ago. Once Movie crop mode is enabled it will stay enabled upon restart as well. Upon restart it will start in x3zoom so push canon menu button and back to set the preset fully.

No luck on higher frame rates yet. Shaving height is prone to crashing.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: jacquaviva on February 19, 2019, 12:11:30 PM
Hi Danne,

So now we can use the rewire preset without adding "Movie crop mode" ?
Does it mean it records like mv1080p but with the corrected preview ?

No more bugs from the previous rewire mode ? And no need to press menu button ?

Thanks again for your big work, it is really incredible...
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: masc on February 19, 2019, 12:16:10 PM
And no need to press menu button ?
->
Once Movie crop mode is enabled it will stay enabled upon restart as well. Upon restart it will start in x3zoom so push canon menu button and back to set the preset fully.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: jacquaviva on February 19, 2019, 12:16:40 PM
Sorry, you already awnsered in your post; I get it.
Thanks
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: masc on February 19, 2019, 12:33:31 PM
Ok, so "Movie Crop Mode" has still to be set manually. x3 zoom mode works fine. When selecting 2.35:1 : is there a way to crop the top and bottom of the liveview?
In terms of 25fps I was a tiny bit more satisfied before with yesterdays build - because I got 25.000fps and with some Shutter fine tuning I got exactly 1/50.000s. Identical to my 5D2. Now we get 25.003 and 1/50.006s (tuning @ -0.23ms). Is it possible to get the exact thing when activating 25fps in submenu?
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on February 19, 2019, 12:41:39 PM
For preview crop in 2.35:1 I think it has to be set in RAW video menu instead of in the Crop mode menu. Havn't checked.
Fine tuning shutter. Could look into it. Maybe we could keep defaults not touching fps regs except for when set 25 fps is set in Crop mode sub menu. Then we could choose 25fps from canon menu instead as well. Also 30fps should work if set to ntsc.

I could enable Movie crop mode when selecting the preset but since we can't deselect people will wonder why all of a sudden all is wonky changing presets maybe not knowing why Movie crop mode is set. Now at least it has to be turned on for awareness.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on February 19, 2019, 03:32:34 PM
New build:
https://www.magiclantern.fm/forum/index.php?topic=9741.msg208959#msg208959

- Enables Movie crop mode when selecting mv1080p MCM rewire. Will disable Movie crop mode when changing preset to something else in Crop mode menu. Absolutely needs pushing canon MENU button and back between changes. Note that when restarting camera in mv1080p MCM rewire mode will get you right into action. Forgetting canon MENU push at this stage will surely record some of the nastiest moiré clips ever so don´t blame me  when that happens :P (please check a1ex post: Details: extreme-moire.html (https://a1ex.magiclantern.fm/bleeding-edge/lv-binning/extreme-moire.html))

- Canon fps 24, 25, 30 all works as default. If changing ratio or using set 25fps from Crop mode sub menu will instead add preset regs from crop_rec.c leaving canon fps modes.

If anyone can find a way of refreshing canon menu when changing presets please let me know. Also would be good if (cmos?) extreme moiré could be fixed without pushing canon menu etc...
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: jacquaviva on February 19, 2019, 04:06:34 PM
Thank, do you think a 1736x1158 rewire mode would work ?
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on February 19, 2019, 04:10:09 PM
Might work.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: jacquaviva on February 19, 2019, 04:17:48 PM
This would be the perfect super 35 camera, 16:9 & 3:2 Raw.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: theBilalFakhouri on February 19, 2019, 08:10:28 PM
1736x976 @ 50 FPS was done in the new crop_rec for 700D, no Idea what is the registers values or FPS Timers I don't have my cam to check that.

Why not to try to port EOS M to new crop_rec  :D .
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on February 19, 2019, 08:15:10 PM
Believe me, I tried  8). I got it partially working. Still a few extra tweaks to get it going and I will revisit it in the future.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: the_real_bill_jones on February 20, 2019, 12:22:30 AM
Still having troubles with movie crop mode. I'm using Danne's latest build.

First picture is what I see when filming in a 2.35 aspect ratio, in movie crop. Not crop rec

(https://www.magiclantern.fm/forum/proxy.php?request=https%3A%2F%2Fi.ibb.co%2Fd6fhhvS%2FIMG-0446.jpg&hash=d3f3d5e8a7fa6bf91ef50cdd8e6a37f2) (https://ibb.co/d6fhhvS)


And this is the final image. Obviously it's cropped down to 2.35, but it's also shifted to the left slightly.

(https://www.magiclantern.fm/forum/proxy.php?request=https%3A%2F%2Fi.ibb.co%2FmN5NZLb%2FScreenshot-9.png&hash=bcb6183f96098e78f638da10879092d1) (https://ibb.co/mN5NZLb)


So what gives? Is this just how it is? Can I fix it? Thanks
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on February 20, 2019, 12:27:43 PM
New build:
https://www.magiclantern.fm/forum/index.php?topic=9741.msg208959#msg208959

- Fixed preview without black border(should be in perfect alignment)
- Real time preview 2.35:1 should now work with rewire mode(corrected cropmarks)

See to it that you push canon menu button when selecting and changing from mcm rewire mode. Even changing ratio requires a menu push.

Commits:
https://bitbucket.org/Dannephoto/magic-lantern/commits/29b1715bdd43f98b627d7eff35a0dad4523dca51
https://bitbucket.org/Dannephoto/magic-lantern/commits/0bbd0bcca72273e25666626f50807a3c593fc05e


@the_real_bill_jones
Please read at least 10-20 last posts. All has been asked and discussed already.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: jacquaviva on February 20, 2019, 01:11:53 PM
This is genius.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on February 21, 2019, 11:21:45 AM
New build:
https://www.magiclantern.fm/forum/index.php?topic=9741.msg208959#msg208959

- The lua script which auto sets sd_uhs overclocking will now also open and close canon menu if mv1080p MCM rewire mode is set to settle all registers upon starting camera. Hopefully keeps extreme moiré away. So easiest set up would be to run the eosm_cine.lua script and then one is free to change to any preset, ratio, bitdepth etc and can forget about pushes here and there after restarting camera.

On a sidenote it´s actually possible to record 34 fps in H264 with the rewire mode set. Simply turn off RAW video and set FPS override to 34. That´s a few more fps than expected for H264. Going further just stops recording even before it starts. Why? I have no idea but finding out that would be something else..
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: AF-OFF on February 21, 2019, 01:45:28 PM
tested Danne's two last builds. no damaged frames so far
I've found that the 2.5k mode has a 28 pixel row on top in both builds
The res of this mode changed also quite a bit from the initial 2520x1304
then there is a strange haze in mv1080p MCM mode and aliasing
also noticed , when changing iso, like from 200 to 400, on eos-m screen there is a green haze or stripes
the recorded image is without the haze

please see the MLV App screenshots below

I hope this can help a little. I can provide some dngs if necessary.
Many big Thanks to Danne and others!


(https://www.magiclantern.fm/forum/proxy.php?request=https%3A%2F%2Fi.ibb.co%2FNF8tMvZ%2Fscreen.jpg&hash=fe9523bc570a1f056b38cbae9306903a) (https://ibb.co/NF8tMvZ)

(https://www.magiclantern.fm/forum/proxy.php?request=https%3A%2F%2Fi.ibb.co%2F2gLtw4M%2Fscreen2.jpg&hash=4f3eeb2b014bc446eea86ae806c73ccd) (https://ibb.co/2gLtw4M)

(https://www.magiclantern.fm/forum/proxy.php?request=https%3A%2F%2Fi.ibb.co%2FgZCMBbH%2Fscreen8.jpg&hash=5fc4b6ff1a2177294d1a5944808e8fcb) (https://ibb.co/gZCMBbH)

(https://www.magiclantern.fm/forum/proxy.php?request=https%3A%2F%2Fi.ibb.co%2Fs6L5WPt%2Fscreen9.jpg&hash=441a8df320f141aed04931b80ddd8a62) (https://ibb.co/s6L5WPt)

(https://www.magiclantern.fm/forum/proxy.php?request=https%3A%2F%2Fi.ibb.co%2Fz7DYymQ%2Fscreen10.jpg&hash=e561569650deceb608c6f3b6b3543892) (https://ibb.co/z7DYymQ)

Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on February 21, 2019, 02:35:22 PM
New build:
https://www.magiclantern.fm/forum/index.php?topic=9741.msg208959#msg208959


Thanks for samples and tests @AF-OFF
- I fixed the top row for 2k 16:9 setting

Regarding the other stuff all is to be expected. Short anwer:
1 - Run the eosm_cine.lua to start off clean
2 - If changing presets push canon menu and back and also enter ml menu and back for all registers to set. This is even more important with mcm rewire mode. When working with mcm rewire mode itself it often includes pushing canon menu if you e.g change bitdepth etc.
3 - turn off 10bit or 12bit in Crop mode sub menu to record without green cast. The green cast is a result of pushing liveview brightness when running reduced bitdepths. Don´t expect continuous 14bit lossless though.
4 - Regarding aliasing and moiré. Please read through last 20 posts.

If you still can get shitty footage following above please let me know.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: AF-OFF on February 21, 2019, 04:02:01 PM
thanks a lot Danne
I did the steps previously too (1 & 2 in Your post)
the row at top disappeared (2.5k 16:9)
res. in 16:9 is now 2192x1234 and with 2,35:1 2520x1072
what changed also - leaving ML menu und entering/leaving  Canon menu breaks LV. Double Enter/Leave ML menu fixes that. But not in the mv1080p MCM mode. have to restart the cam.
5k preset does not record continuous anymore. did change fps to 18, then it did. Thought it was because 14bit lossless (didn't change bit depth in crop_rec) but MLV App reports 10 bit lossless ...
and no corrupted frames in any res by now

many thanks for explanation ( point 3 & 4 )





Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on February 21, 2019, 04:29:53 PM
Missed a word in the lua script. Maybe works better now:
https://bitbucket.org/Dannephoto/magic-lantern/downloads/crop_rec_4k_mlv_snd_isogain_1x3_presets_2019Feb21.EOSM202.zip
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: AF-OFF on February 21, 2019, 06:14:18 PM
hey Danne
the new version acts now more as expected
if going to 2.5k mode and changing something, leaving ML menu and entering leaving canon menu breaks LV but entering/leaving ML menu once more fixes LV again. All other modes tested don't have this error.

tested 5k, mv1080p MCM & 2.5k & mv_1080p with the last three first with default 2,35:1 & 16:9
with exception of 5k mode 10bit lossless all other 14bit lossless

another thing to mention - as You wrote about the green cast related to 10 & 12bit modes - is this the same as when applying 3x3 chroma smoothing in MLV App makes the image greenish?
Noticed this does not happen with 14bit footage in MLV App

in 5k(10bit) and 2.5k(14bit) I can record with 18 fps continuous ( 51-52 MB/sec)

Thanks for Your work!

tried 5k in 16:9, 10bit works well @ 15fps


(https://www.magiclantern.fm/forum/proxy.php?request=https%3A%2F%2Fi.ibb.co%2FBGVvg6P%2FUntitled.jpg&hash=11d999573d6d3bb7098083fdf41f2926) (https://ibb.co/BGVvg6P)





 
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on February 21, 2019, 06:46:49 PM
I only use 2.35:1 4.5k anamorpic. All modes 10bit except rewired, works 14bit lossless.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: AF-OFF on February 21, 2019, 07:19:32 PM
thanks for info
Anywhere possible I'm now trying to use 14bit lossless

What I also forgot to mention is now the first recording (after power up, mode change always stops after a sec. I've tried card warmup but does not change this. usually the second or third recording goes continuous. This is in all modes I've tested, but was not like this before. hope this is useful for You Danne

Also the 5k mode can do 24fps. the speed is shown as 44-45 MB
I did not try long enough, just thought I have to reduce fps.

 
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on February 21, 2019, 07:43:02 PM
I tested just now but it works as expected. You might want to format card and start with a fresh build. As stated before, continuous should be able for all presets when set to 2.35:1 and 10bit, otherwise not, except for some of the presets(mcm rewire, 2.5k etc. Might work with 16:9).
Thanks for testing.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: AF-OFF on February 21, 2019, 08:42:47 PM
Thank Danne, will do tomorrow. Will start with clean prefs and activate modules then the script as You have mentioned.

Again thanks much for Your effort

Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: AF-OFF on February 22, 2019, 02:41:02 PM
Danne's 21. Feb build
tested
mv1080p 1736x1158 14bit lossless (pic 3)
2.5k 10bit 16:9 & 2.35:1
5k 10bit

no corrupted frames

after changing modes in 5k or 2.5k, somehow the first recording stops immediately the next is continuous, BUT not always

leaving ML menu via touchscreen and enter-leave canon menu, breaks LV in 2.5k and 5k modes (images 4 & 5) have to enter-leave ML menu to fix it 
Found that leaving ML menu by pressing Menu button, doesn't break it and changes seems to be done, recording is ok.

please look at screenshots below

what I did also understand now, when recording 14bit lossless, focus pixels can be removed in MLV App with the "Fix Focus Dots" set to on. No need for 3x3 chroma smoothing. This seems to be only good for 10-12 bit recordings.


(https://www.magiclantern.fm/forum/proxy.php?request=https%3A%2F%2Fi.ibb.co%2Fyn1MdTk%2F2-5k-2-35-2.jpg&hash=c674664f3410d7b131c2c9a737a33249) (https://ibb.co/yn1MdTk)

(https://www.magiclantern.fm/forum/proxy.php?request=https%3A%2F%2Fi.ibb.co%2FH40PDqn%2F2-5k-2-35.jpg&hash=a8ef711854c3f43c067c8ca8f5428146) (https://ibb.co/H40PDqn)

(https://www.magiclantern.fm/forum/proxy.php?request=https%3A%2F%2Fi.ibb.co%2Fm9J6LmN%2F1080p.jpg&hash=896791777da97866ea85cb57365d2ff0) (https://ibb.co/m9J6LmN)

(https://www.magiclantern.fm/forum/proxy.php?request=https%3A%2F%2Fi.ibb.co%2FfYTsDLW%2FIMG-1210.jpg&hash=7d4fc1ef8d85105005a840dbdd92d516) (https://ibb.co/fYTsDLW)

(https://www.magiclantern.fm/forum/proxy.php?request=https%3A%2F%2Fi.ibb.co%2FLgJsT7y%2FIMG-1211.jpg&hash=02b6c1dee7f3ff24df47e934803b1923) (https://ibb.co/LgJsT7y)


Thanks to Danne and Others
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on February 22, 2019, 07:57:03 PM
Check dfort's work and status around focus pixels.
As I see it changing modes has it's quirks. Restart if needed. Plenty registers needs changes and refreshing etc will often include pushing menu buttons.
On a sidenote. Got 1736x1158 flying in rewire mode. Will include it when I have the energy...
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: masc on February 22, 2019, 08:22:25 PM
what I did also understand now, when recording 14bit lossless, focus pixels can be removed in MLV App with the "Fix Focus Dots" set to on. No need for 3x3 chroma smoothing. This seems to be only good for 10-12 bit recordings.
After we got focus pixel maps for the new presets, there is no need for chroma smoothing. Until this, it will be the only simple way to remove them.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on February 22, 2019, 09:41:59 PM
New build:
https://www.magiclantern.fm/forum/index.php?topic=9741.msg208959#msg208959

- mv1080p MCM rewire now includes 1736x1158(3:2) this is default mode. Set ratio to 2.35:1 or 16:9 from Crop mode sub menu.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: rev787 on February 23, 2019, 02:27:48 PM
Greetings. New to video and magic lantern. Thanks for Danne and the team's work on EOS M. Received EOS M today and tried shooting something with Feb22 build using dual iso. I observe tint(?) difference between each frame when using mlvapp. I wonder if this is the same issue mentioned several pages ago about flickering or it's mlvapp processing. I probably should not use dual iso for this kind of scene anyway.
Shortened mlv. https://mega.nz/#!Isw1jIDQ!Ex8lj42WVGB_r9ISw5QzMhZXozQupoYSXuQGI9YID4Q (https://mega.nz/#!Isw1jIDQ!Ex8lj42WVGB_r9ISw5QzMhZXozQupoYSXuQGI9YID4Q)
Another dumb question, how do I take picture with Danne's build? Disable the scripts?
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Jonit on February 23, 2019, 04:36:13 PM
Testing the Feb23 build. This thing is getting better and better Danne. Thanks a lot for your work on this.
There is a one thing/bug I have noticed - when you go over 1/4500s during recording, the screen starts to flicker. Just to note that...

EDIT: I forgot to mention that it was in 1080p MCM mode
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Jonit on February 23, 2019, 05:05:10 PM
Are those a focus pixels?

I was just looking on one clip I just filmed (1/45s, f5.6, ISO100) where a portion of a frame had blown-up highlights. In MLVApp I lowered the exposure to -4EV and then I checked "Highlight reconstruction". These focus pixels (or what are they) showed up in those blown highlights.
So I thought that that may be an easy way to map them all out if they show up this nicely over blown up highlights with reconstruction turned ON.
I tried to reproduce it by using the same settings and aiming at diffused strong white light. I didn't manage to make them appear again. But then I cranked the ISO to 3200 and they showed up (probably wasn't that over-blown with ISO100).

(https://www.magiclantern.fm/forum/proxy.php?request=https%3A%2F%2Fi.ibb.co%2FtcpSwKq%2FM23-1657-frame-70.png&hash=d854fbc9b4611f04dce221f6ecb6c50e) (https://ibb.co/tcpSwKq)
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Jonit on February 23, 2019, 05:14:54 PM
Here Is the first example where I noticed it.
So in that map I posted, the middle focus pixels (bars) are missing.

(https://www.magiclantern.fm/forum/proxy.php?request=https%3A%2F%2Fi.ibb.co%2F52McpGG%2FM23-1643-mov-snapshot-00-10-476.png&hash=7b95c53f5b671bec1e202f9965d72225) (https://ibb.co/52McpGG)
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: dfort on February 23, 2019, 09:14:35 PM
@Jonit - You are mapping out these focus pixels in MLV App? How? If this is from one of Danne's new crop_rec resolutions the code hasn't been written for it yet.

I'd like to take a look at your example to see if the map files I'm preparing will work with that image. Please upload a shortened version of your MLV file and post a link to it. Thanks!

what I did also understand now, when recording 14bit lossless, focus pixels can be removed in MLV App with the "Fix Focus Dots" set to on. No need for 3x3 chroma smoothing. This seems to be only good for 10-12 bit recordings.

Same comment as above -- if this is one of Danne's new crop_rec settings I'd like to check it out.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Jonit on February 23, 2019, 11:56:35 PM
@dfort
Here is how to map this pattern:
-results are from Dannes latest build (Feb23), using "mv 1080p MCM rewire" preset
-yes, I'm using MLVApp 1.5. Just lower the exposure to -4EV and enable "Highlight reconstruction" checkbox
-it works only in 10bit (maybe 12bit also - I haven't checked that)

Here are the short example MLVs: https://mega.nz/#!DB9nTIwS!bPMcXWlVzdO8n8ciaoETrjkeQBcVyXYUVtEfdnbWOa4

@Danne
-this may be maybe of interest to you. I found out that when the aspect ratio in Crop mode sub menu is set to OFF (which means that it is in 3:2 aspect ratio), then there is an empty portion on the bottom of the image which don't contain these focus pixels.


(https://www.magiclantern.fm/forum/proxy.php?request=https%3A%2F%2Fi.ibb.co%2F4sX22B0%2FAspect-ratio-2-35.png&hash=4ee27cc94590535179710c9dbb13e3fd) (https://ibb.co/4sX22B0)

(https://www.magiclantern.fm/forum/proxy.php?request=https%3A%2F%2Fi.ibb.co%2FLz8tKHB%2FAspect-ratio-16-9.png&hash=2d35bcc9b732d55b9d9f5e3eab481831) (https://ibb.co/Lz8tKHB)

(https://www.magiclantern.fm/forum/proxy.php?request=https%3A%2F%2Fi.ibb.co%2FxLZWMHq%2FAspect-ratio-OFF.png&hash=7bb53e3f1afc5312b35a065df33a6321) (https://ibb.co/xLZWMHq)
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: optical-work on February 24, 2019, 12:47:53 AM
Received EOS M today and tried shooting something with Feb22 build using dual iso. I observe tint(?) difference between each frame when using mlvapp.

i'm not certain but 14bit lossless and 12-14 uncompressed flicker less than other options, if any. so mv1080 14bit lossless might be the best choice for continuous dual iso. (mcm mode looked same to me, i didn't try much though.)
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: dfort on February 24, 2019, 01:55:12 AM
@Jonit - I'd recommend skimming through the Dealing with Focus Pixels in raw video (https://www.magiclantern.fm/forum/index.php?topic=16054.0) topic. Yes, there will be areas where there are no focus pixels, some settings they seem to disappear only to come back with a vengeance on your next shot. Two of the three samples you uploaded aren't working with my latest focus pixel map files so I've got some more work to do on this. Once we get all of these new settings mapped out it will be time to figure out how to code these patterns so they can be integrated in the various MLV processing apps. After that, it will just be a matter of keeping the "Fix Focus Dots" option enabled and you'll never have to worry about focus pixels again -- well that's the goal.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: masc on February 24, 2019, 10:48:04 AM
@Jonit: funny, that really works - overexposing by far, and then EV=-4, Highlight Reconstruction = on. You can see the focus pixels.
@Jonit: this does only work, when leaving Focus Pixel Fix enabled. When switching it Off, those pink dots are away.

@dfort: I also recorded some frames, one clip overexposed (@10bit), another with normal exposure (@14bit) using Danne's rewire preset @ 1736x1158. I uploaded the clips with an receipt, so you can see them good in MLVApp. Does this help? It seems there are different types of focus pixels - some are very good to see (white, center), others not so good to see (dark grey, everywhere). The dark ones are good visible in the overexposed clip, processed like Jonit did.

(https://www.magiclantern.fm/forum/proxy.php?request=https%3A%2F%2Fi.ibb.co%2F3Wmcvnk%2FM24-1023-frame-1.png&hash=ed124160ab587bcd66c17222f33b815c)
https://www.dropbox.com/s/beswhuzkoin7axr/FocusPixelEosM_Rewire.zip?dl=0
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: alpicat on February 24, 2019, 01:39:42 PM
@masc just to check, when you're exporting the video (or png file) from MLVapp, are you disabling "Fix focus dots"? If you leave that setting on, as it is by default, I find that additional focus pixels which are really difficult to see show up, and they're not there if turned the setting is turned off. However I did not test this extensively at all and haven't tried with the very latest version of the MCM rewire preset, so don't know if that's still happening.

In any case, in order to get an accurate understanding of where the focus pixels are, I guess it's best to turn off the fix focus dots setting and any other fixes such as chroma smoothing that might intefere with the results in MLVapp?


Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: masc on February 24, 2019, 02:07:58 PM
@alpicat: thanks... I must have been drunken. :D The focus pixel option was still enabled - this brought "the wrong focus pixels" into the frames instead of killing them. Corrected my post, my upload and the picture. Only the white dots are visible now.

@Danne, bouncyball and dfort: will it be possible to recognize if we have a standard mv1080p MLV or an mv1080p-rewire MLV? These two formats look identical but need different focus pixels maps.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: alpicat on February 24, 2019, 02:54:41 PM
@masc brilliant, glad to hear it worked. I thought I was going crazy when I was seeing those extra focus pixels - it didn't make any sense!
To make the focus pixels really show up, I load the png exported from mlvapp into photoshop and adjust saturation and several other settings, and then they become really distinct.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on February 24, 2019, 07:34:13 PM
New build:
https://www.magiclantern.fm/forum/index.php?topic=9741.msg208959#msg208959

- Advised to download this version and replace with whatever you use now
- Fix for extreme moiré when recording with mcm rewired preset(forgetting canon menu button for instance)

So no need for menu pushes for the rewired mode. Major finding from Levas:
https://www.magiclantern.fm/forum/index.php?topic=16516.msg212472#msg212472
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: masc on February 24, 2019, 07:51:50 PM
Findings:
- as long as I use MCM rewire normal -> great! :)
- after switching camera on, it looks like I am in a zoom mode, but I am not (I haven't chosen). Resolution is 1800x1012. 2x canon menu button, all is fine.
- if I use it with x3 option -> need again canon menu enter/leave; resolution is 1624x914, not 1736x976.
- going back to non x3 (normal zoom) again -> needs again canon menu
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on February 24, 2019, 08:36:35 PM
Thanks for feedback. Needed.
Try running the cinema script as a starting point. I think you´re resolution needs expanded to max, that´s why you get 1624x914. Or if not maybe a menu push is all it takes. The only thing that actually was fixed was the extreme moiré issue. That should not appear anymore. We still need canon menu push for when changing presets in MCM mode.

The resolution are as follows atm:
mv1080p MCM rewire
default 1736x1158 in x3crop 1624x1080
2.35:1 1736x738 in x3crop 1800x766
16:9    1736x976 in x3crop 1800x1012
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: masc on February 24, 2019, 08:48:44 PM
Hu... okay. I had no sub menu option chosen (all off). Resolution in RAW Video menu is at 5xxx option.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on February 24, 2019, 08:59:10 PM
Hard to know exactly what to look for. If presets works after a few pushes I think all is as expected. Or else try to explain what to reproduce exactly.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: masc on February 24, 2019, 09:14:04 PM
I think I know what happens:
- I used in RAW Video 5xxx resolution and 16:9.
-> in x3 crop this makes 1624x914 -> I should set it in RAW Video to 3:2 and set 16:9 from crop menu
- somehow it seems the standard is x3 zoom mode. So it was always hard to come out there to get normal mode...
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on February 24, 2019, 09:20:11 PM
I should recommend run the cinema lua script as starting point. It sets to 1:2 in RAW menu and you also end up in anamorphic mode. Then I would leave RAW video alone and only use settings in Crop mode sub menu and start build from there. It´s part of the round trip journey.
Quote
- somehow it seems the standard is x3 zoom mode. So it was always hard to come out there to get normal mode...
Can´t really follow you. But yes, rewire MC mode is a totally different beast from the other crop_rec presets. Getting back to the other presets is a bit harder than usual.
If I knew more c-code I would put it in either as a menu option in Movie crop mode or have it as default when starting up my eosm and selecting RAW video.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Jonit on February 24, 2019, 09:53:39 PM
@masc just to check, when you're exporting the video (or png file) from MLVapp, are you disabling "Fix focus dots"? If you leave that setting on, as it is by default, I find that additional focus pixels which are really difficult to see show up, and they're not there if turned the setting is turned off.

Thanks for pointing that out. Yes, you're right. It was "Fix focus dots" which was causing those pixels.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: dfort on February 25, 2019, 01:03:45 AM
Maybe this will clear up some of the confusion over what is happening with the focus pixels on these new resolutions:

https://www.magiclantern.fm/forum/index.php?topic=16054.msg212529#msg212529

Then again maybe it just adds to the confusion.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: masc on February 25, 2019, 10:11:52 AM
Great work @dfort! That works so good also in MLVApp. Now MCM rewire looks really nice for me (and hopefully many others).
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on February 25, 2019, 10:18:58 AM
Cool. So Mlv app updated for mcm mode now?
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: masc on February 25, 2019, 10:29:43 AM
Not directly. Download 80000331_1872x1190.fpm from dfort's repos and copy it next to executable (.exe on Win, on OSX executable inside app package). MLVApp will recognize this file and use it.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Jonit on February 25, 2019, 10:38:36 AM
Outstanding work dfort! I have such a deep appreciation for this community. You guys are doing great job here.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on February 25, 2019, 11:10:44 AM
Nice masc. I wonder if we can add one pixel map for both x3zoom and mcm rewired in the same context that would work with both setups.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: masc on February 25, 2019, 12:51:16 PM
I don't know why, but the focus pixel map from dfort only works for full (uncropped) MCM rewire clips. So 3:2 works, but e.g. 16:9 doesn't. It looks like there is an wrong offset somewhere (when pixel peeping). Until now I thought, if you have the map for maximal resolution of a preset, it works also for cropped clips. (not zoomed)
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on February 25, 2019, 01:22:34 PM
Is this working with 16:9 and 2.35:1 when it comes to focus pixels in Mlv App?
https://bitbucket.org/Dannephoto/magic-lantern/downloads/crop_rec_4k_mlv_snd_isogain_1x3_presets_2019Feb25.EOSM202.zip
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on February 25, 2019, 02:15:00 PM
Just tested my change and it worked when changing reg 6804 to the same as for the 3:2 preset:
0x4a601e4
So if we now the 0x4a601e4 is working then we can work from this one aand calculate any new offset from that when following the rest of the presets? There are also this for x3zoom in my crop_rec.c:
0x45601e4

For 16:9 and 2.35:1 I have this:
0x42401e4 but will change to working 0x4a601e4

0x4a601e4 = 1736x1190
0x45601e4 = 1736x1110


Maybe should have a talk with the "dotman" dfort...

Edit: 0x45601e4 seems to work with x3zoom...
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: masc on February 25, 2019, 08:46:05 PM
Did a quick test without any crop submenu setting and with 16:9. Both was working with the focus pixel map. Yay. :)

Edit: 2.35:1 at 3x3 working too. At x3 zoom, it is working for 1800x1012 (in two of three clips, must test where the difference is, maybe just forgot the menu buttons), for 1800x766 too, but not for 1624x1080.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on February 25, 2019, 09:55:16 PM
...but not for 1624x1080.

I do some trickery to differ this mode to get around some of a1ex black level autodetection code in raw.c. I knew it would bite me sooner or later. I´ll see if I can do something else here(c-noob):
Code: [Select]
          case 0xC0F06804: return 0x45601e5);

    /* needed for autodetecting black level in mlv_lite.c */
        case 0xc0f06800: return 0x10011;


EDIT:
Ok, let´s try this one. Should work better:
https://bitbucket.org/Dannephoto/magic-lantern/downloads/crop_rec_4k_mlv_snd_isogain_1x3_presets_2019Feb25.EOSM202.zip
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: masc on February 25, 2019, 10:11:24 PM
Ok, let´s try this one. Should work better:
https://bitbucket.org/Dannephoto/magic-lantern/downloads/crop_rec_4k_mlv_snd_isogain_1x3_presets_2019Feb25.EOSM202.zip
Hmm... really? This build is able to toggle my LED. Camera not booting.  :P
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on February 25, 2019, 10:14:08 PM
Happens to me sometimes. Check an extra round if you extracted all ml files onto your card. Or do a battery pull  :P
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: masc on February 25, 2019, 10:14:57 PM
All done. Downloaded, installed, battery pulled... all 2x.  :-[
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on February 25, 2019, 10:17:57 PM
Strange. I just downloaded and ran it on my camera. Hm, older build working? Cam starting without ML on it?
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: masc on February 25, 2019, 10:22:15 PM
Reverted to an older build. Worked. Installed again. Working now. WTF.

Tested all 6 MCM rewire combinations between AR and x3 zoom: all working with dfort's focus pixel file. GREAT!

Positive side effect with MCM rewire: AUTO-ISO is working really good here. ;)
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on February 25, 2019, 10:25:00 PM
Great! Mcm touching prop regs. Seems stable enough though. One really have to abuse some code watch guards to soft brick. Believe me, been there. A1ex fixed it in half an hour though  :P.
Autoiso. Gotta test. Never used it.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: MADagain on February 26, 2019, 02:42:35 AM
Is there a stable build for the EOS M?
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: DeafEyeJedi on February 26, 2019, 04:22:55 AM
Great! Mcm touching prop regs. Seems stable enough though.

Agreed. Been playing with this all afternoon and so far I've been impressed. Still trying to push it's limits.

Autoiso. Gotta test. Never used it.

Same here. Just tried and I can see what @masc is referring to... especially when utilizing the EF-M 18-55 STM. That lens is a fun toy to play with. So light!

Is there a stable build for the EOS M?

Why don't you just give a try at least with today's build from @Danne's bitbucket page?  :P
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: dfort on February 26, 2019, 06:26:47 AM
Maybe should have a talk with the "dotman" dfort...

I just finished going through all the sample files I could find for the EOSM and it looks like there's "only" a half-dozen of these new crop_rec settings that aren't quite working 100% yet with the new map files. I've been pushing to the repository so if you want to give it a try (in MLVFS) please do so.

Off topic: The 100D tests are 100% at this point.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on February 26, 2019, 07:08:40 AM
Great!
By the way. Is it possible to do the same kind of testing but from Mlv App instead?
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: dfort on February 26, 2019, 07:45:00 AM
Not sure. Look in in MLV-App-master/src/mlv/llrawproc/pixelproc.c around line 318 and you'll see there's code there to use ".fpm" files but I'm not sure how it works. The plan is to re-write the code to create the map files as needed for these new crop_rec settings.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: masc on February 26, 2019, 08:05:15 AM
Is it possible to do the same kind of testing but from Mlv App instead?
This is what I do.

Not sure. Look in in MLV-App-master/src/mlv/llrawproc/pixelproc.c around line 318 and you'll see there's code there to use ".fpm" files but I'm not sure how it works.
MLVApp searchs for fpm files first. If it doesn't find one, it uses internal code. If it finds a fpm file, it uses the file. So just copy your fpm next to the executable (.exe on Win, executable inside App package on OSX) and have fun. This will override internal code for this setting.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on February 26, 2019, 08:11:05 AM
This is what I do.
MLVApp searchs for fpm files first. If it doesn't find one, it uses internal code. If it finds a fpm file, it uses the file. So just copy your fpm next to the executable (.exe on Win, executable inside App package on OSX) and have fun. This will override internal code for this setting.
Bloody ace! Great to hear and have.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: IDA_ML on February 26, 2019, 12:49:17 PM
The 100D tests are 100% at this point.

Dfort,

I did test quite extensively your FP maps from February 20-th on the 100D and also performed several stress tests in all modes as you requested.  Did not find any problems with them.  They all seem to work quite well with MLVFS. 

I will do more tests with the latest reworked FP maps that you posted yesterday.  But this will take some time.  Please be patient.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: dfort on February 26, 2019, 05:38:24 PM
Ok--all sample MLV's are working with the latest map files. Feel free to continue testing focus pixel free. Well, at least until you come up with yet another setting that needs attention.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: uy scuti on February 26, 2019, 07:15:05 PM
Friends, tell me who knows, I can not set a long exposure at 25 fps, 1/60, it can be done but only at 25,002 fps, what am I doing wrong?
shooting mode:mv1080p 1736x1158
Sorry for my English
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on February 26, 2019, 09:29:32 PM
 Ah, handcrafted map files. Appreciated. Will run tests soon. Thanks.
Here are test files if anyone wants to have a look:
https://bitbucket.org/Dannephoto/magic-lantern/downloads/focus_pixel_MLV_all_presets_eosm.zip

There could be one or three files not working since I changed offsets a few times. Most files should work.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: dfort on February 27, 2019, 01:13:41 AM
The only one that still has a problem is 01_anamorphic. Strange, worked on that one and thought I had it. The map file fits perfectly so something weird is going on.

(https://www.magiclantern.fm/forum/proxy.php?request=https%3A%2F%2Ffarm8.staticflickr.com%2F7867%2F33347561898_4eb84dde85.jpg&hash=d49e09dc66e78211204dbf3189132c4c) (https://flic.kr/p/SNNYkL)

[EDIT] Just tried it with with dcraw and the map file is working perfectly. Anyone care to try it out? From Danne's samples in the focus_pixel_MLV_all_presets_eosm.zip package located on his Bitbucket downloads page (https://bitbucket.org/Dannephoto/magic-lantern/downloads) look in the first_batch folder and run this on the 01_anamorphic.MLV file:

Code: [Select]
mlv_dump --dng --no-fixfp 01_anamorphic.MLV file
./mlv2badpixels.sh -v 01_anamorphic.MLV
dcraw -T -P EOSM_anamorphic_1664x2126.txt 01_anamorphic_000000.dng

The mlv2badpixels.sh script is located in the ML Focus Pixels repository (https://bitbucket.org/daniel_fort/ml-focus-pixels) in the scripts_archive directory. It takes the full raw buffer map file and trims it to the same size as the image so it can be run through dcraw. Note that I modified that old script to recognize the new crop_rec settings as best as possible using what we know about raw buffer dimensions.

In any case, why isn't this map file working in MLVFS and MLV App?

[EDIT 2] Oops -- my mistake. I must have not updated the focus pixel map file in the apps before testing. All good, all settings are now focus pixel free. You can still try the dcraw exercise, interesting how different apps can use these map files.

BTW--Kudos for the MLV App developers for supporting .fpm files and properly handling 1x3 sampling.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: dfort on February 27, 2019, 02:58:51 AM
Going through all these new crop_rec settings for the EOSM there is one really interesting setting @theBilalFakhouri put into his 700D version that uses the entire sensor area as the full raw buffer. I made a fpm file for this setting though I haven't seen a sample on the EOSM yet. This post (https://www.magiclantern.fm/forum/index.php?topic=5240.msg212604#msg212604) just jogged my memory about that setting.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: MADagain on February 27, 2019, 04:27:50 AM

Why don't you just give a try at least with today's build from @Danne's bitbucket page?  :P

Link... please?

I tried the current nightly and for what I need like magic focus or the overlays... don't seem to work at all.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: DeafEyeJedi on February 27, 2019, 06:56:36 AM
Link... please?

Perhaps try scrolling up two post above yours.

and please bookmark his Bitbucket downloads page (https://bitbucket.org/Dannephoto/magic-lantern/downloads) while you’re at it.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on February 27, 2019, 07:50:10 AM
@dfort
Very nice work dfort. Tested my files regarding focus pixels and all seemingly worked. Next up some real life testing.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: masc on February 27, 2019, 08:04:25 AM
Link... please?

I tried the current nightly and for what I need like magic focus or the overlays... don't seem to work at all.
In version from Danne magic focus and overlays work fine. I use them every day.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Walter Schulz on February 28, 2019, 05:11:25 PM
Friends, tell me who knows, I can not set a long exposure at 25 fps, 1/60, it can be done but only at 25,002 fps, what am I doing wrong?
shooting mode:mv1080p 1736x1158
Sorry for my English

Build used?
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on February 28, 2019, 06:21:37 PM
New build:
https://www.magiclantern.fm/forum/index.php?topic=9741.msg208959#msg208959

Managed to eliminate a few stubborn hot/cold pixels on my screen by tweaking cmos 4.
Code: [Select]
/* all presets */
if (is_EOSM)
{
/* hot/cold pixels. Usually 0x2. 0x34 to be tested */
        cmos_new[4] = 0x34;
}

Not sure how this will affect other eosm cameras but please test and see. The change is applied to all presets. If you have hot/cold pixels on your screen they might dissappear now. If you don´t have them check so nothing breaks the recording(should be safe).

cmos 4 0x2
(https://www.magiclantern.fm/forum/proxy.php?request=https%3A%2F%2Fi.postimg.cc%2FmkL7H47f%2FScreenshot-2019-02-28-at-17-38-09-png-800px.png&hash=c2e883963845e3ade8a3940acf243205)

My three hot friends.
(https://www.magiclantern.fm/forum/proxy.php?request=https%3A%2F%2Fi.postimg.cc%2F44P6TKTJ%2FScreenshot-2019-02-28-at-17-38-45-png-800px.png&hash=1e7aa867fc7c857852a49b7bc0c6791e)

Not easy to see but looks like this:
(https://www.magiclantern.fm/forum/proxy.php?request=https%3A%2F%2Fi.postimg.cc%2FVvm20J7f%2FScreenshot-2019-02-28-at-17-50-31-png-500px.png&hash=0809c03ccdb31fb33dadcd022cc5e5ce)

After the change to cmos4 was applied:
cmos 4 0x34
(https://www.magiclantern.fm/forum/proxy.php?request=https%3A%2F%2Fi.postimg.cc%2FYC5gxYQx%2FScreenshot-2019-02-28-at-17-39-16-png-800px.png&hash=b4131f40afb16ba031d991114d67aacb)

Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: uy scuti on February 28, 2019, 06:36:56 PM
Build used?
Used build Danne:
EOS M ML Build 4K Crop Rec 1x3 12th Feb
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Larouso on February 28, 2019, 09:37:43 PM
Not directly. Download 80000331_1872x1190.fpm from dfort's repos and copy it next to executable (.exe on Win, on OSX executable inside app package). MLVApp will recognize this file and use it.

Hi everyone,
just received the eos M last weekend - and spent already countless hours here reading through the stuff :) You are doing such great work. Thanks a hundred times to everybody contributing so far!

My question is:
I downloaded the 80000331_1872x1190.fpm from dforts bitbucked, placed the file next to the exe. Now whenever I open up a 1080p MCM rewire clip, the video in MLV app stays black, as soon as I hit play it crashes.
Other crop modes are not affected - so it seems to me map file is recognized, but something is going wrong then. Am  doing something ovious wrong?  Used Dannes latest build, but it`s the same with the other ones that I already tried.

Thanks for any hints.


Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on March 01, 2019, 12:21:14 AM
Could you upload a sample MLV that you can confirm is crashing also after you shorten it?
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: dfort on March 01, 2019, 02:24:58 AM
This reminds me, a few (or is it just one) of the samples will trigger a segfault on mlv_dump when creating dng files with or without the --no-fixfp option. Same file works fine on MLV App and MLVFS. Got to dig through the files to find the trouble file.

[EDIT] Here are the problem files:

Code: [Select]
MLV Dumper
-----------------

Mode of operation:
   - Input MLV file: '013_4K 4038x2558.MLV'
   - Using output path '013_4K 4038x2558_' for DNGs
   - Convert to DNG frames
   - Output into '013_4K 4038x2558_'
File 013_4K 4038x2558.MLV opened
File 013_4K 4038x2558.M00 not existing.
Processing...
Segmentation fault: 11

 MLV Dumper
-----------------

Mode of operation:
   - Input MLV file: '015_4K 4038x2558_169.MLV'
   - Using output path '015_4K 4038x2558_169_' for DNGs
   - Convert to DNG frames
   - Output into '015_4K 4038x2558_169_'
File 015_4K 4038x2558_169.MLV opened
File 015_4K 4038x2558_169.M00 not existing.
Processing...
Segmentation fault: 11

I also wrote a post (https://www.magiclantern.fm/forum/index.php?topic=16054.msg212690#msg212690) on how to get rid of your hot pixel "friends" in post -- by modifying the focus pixel map file.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: masc on March 01, 2019, 08:08:45 AM
@Larouso: I tried to reproduce, also on windows. But here it works fine for my MCM rewire testclip and this fpm file. So I need your MLV file (maybe shortend is enough, please try) to debug. Maybe some more info would be nice to have too (which windows, which MLVApp version (32bit, 64bit, v?.?).
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Larouso on March 01, 2019, 06:49:16 PM
I uploaded short MLV file that does not work on my site as long as I have the map file placed in the same folder as the exe. If I relocate the map file the mlv is opened up just fine.
https://ln.sync.com/dl/6f7dff240/wf93hqtf-xde3ktj4-p8enfdfb-4737m5qh
(hope sharing the mlv in that way is all right) - 12.4 MB

I`m using win 10, MLV 1.5; 64 bit version (MLV.App.v1.5.Win64.static.zip)
Let me know if I can provide any further info.

Thanks a lot for looking into it.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: dfort on March 01, 2019, 08:55:49 PM
@Larouso - Your file works fine over here and the focus pixel map file is also working. MLV.App.v1.5.OSX.zip on macOS Mojave 10.14.3.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: masc on March 02, 2019, 10:24:42 AM
@Larouso: thanks for the file. No problem on OSX here (10.9). Have to wait some days until I can test on a windows system. Have you tried 32bit build? Does it crash too, if you do the same? I tried with one of my files on 32bit windows version yesterday and it worked fine.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: DeafEyeJedi on March 02, 2019, 10:53:54 AM
MLV App 1.5 vs MLV App compiled (Mojave 10.14.3) on 3/2/2019 shows @dfort's magic w his latest focus pixel map files FTWAC...


Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Larouso on March 02, 2019, 02:00:08 PM
@Larouso: thanks for the file. No problem on OSX here (10.9). Have to wait some days until I can test on a windows system. Have you tried 32bit build? Does it crash too, if you do the same? I tried with one of my files on 32bit windows version yesterday and it worked fine.

@masc/dfort:
Alright, then it seems the problem is on my PC - or in front of the PC :) ... thanks for looking into it anyway!
I will also check out the 32 BIt Version as well and give feedback.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: masc on March 02, 2019, 03:43:38 PM
@masc/dfort:
Alright, then it seems the problem is on my PC - or in front of the PC :) ...
:) Don't think so. No matter what you do - MLVApp should not crash. Especially on Windows we have the biggest problem. For every smallest bug in MLVApp, on Windows it crashs, on OSX it is more tolerant.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Larouso on March 02, 2019, 09:59:20 PM
:) Don't think so. No matter what you do - MLVApp should not crash. Especially on Windows we have the biggest problem. For every smallest bug in MLVApp, on Windows it crashs, on OSX it is more tolerant.

In fact it works under the latest (v1.5) 32bit version of MLV App. I can load the file, edit it, export it, go frame by frame... how ever occasionally also MLV 32 bit crashes if I hit play.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: tcannon on March 03, 2019, 04:37:02 PM
I'm not sure where to look for my answer but it has been without success. Is there a way to get the 60fps with 1080p video quality? I realize native in the camera it is only with 720p that this can be done, but I wonder how, if possible, to change the settings with ML to achieve the higher quality?
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: ctfire on March 03, 2019, 10:16:08 PM
Hi everyone , finaly get my speedbooster for eos-m , and shoot with it , and one of the latest buid , everything is filmed on iso 800 , 48fps preset.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on March 03, 2019, 10:45:01 PM
Lovely colors and motion.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: AF-OFF on March 03, 2019, 11:49:18 PM
just tested Danne's march 03 build.
have some broken frames in 2.5k and mv1080p MCM modes.
also all 2.5k clips have the right side of the frame damaged.
please see first screenshot below

also tested the feb 28 build before, where the MCM mode with 3x crop was without damage . couldn't activate the 2.5k mode. see further down more about it. this did eventually work again after changing from MCM preset back to 2,5k preset.  clean 2.5k recording

Many thanks to Danne and others!


(https://www.magiclantern.fm/forum/proxy.php?request=https%3A%2F%2Fi.ibb.co%2FJcvfyzR%2Feos-M-2-5k.jpg&hash=b01b0d8182d14a8f34d6bad8f54f3d30) (https://ibb.co/JcvfyzR)


using the feb 28 build, if 2.5k preset is active, a 1800x1200 x3 gives a nice clean image, see next MLV app screenshot. didn't noticed that res before. couldn't increase the res further.
the mcm preset records also well without damage at 1624x1080 and 12bit lossless


(https://www.magiclantern.fm/forum/proxy.php?request=https%3A%2F%2Fi.ibb.co%2F6vL00rh%2Feos-M-1800x1200.jpg&hash=1f8273f9a204aacd7b5beb225dbc409c) (https://ibb.co/6vL00rh)
 
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on March 04, 2019, 07:01:27 AM
I can´t reproduce your issues. in feb28th build I changed cmos4 so if anything should affect footage it could be that but then again you say that it works.
When checking your 2.5k screenshot it says 17fps? What´s up with that? If you changed fps override it might be the reason to your issues. You could have better luck increasing reg_6014 in the crop mode sub menu.
I recently also added adtg_gui into this build since I use it a lot and don´t want to add it after compilation etc. This module should not be turned on if not using it. Just a tip.
Thanks, and I would gladly hear about more test results.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: masc on March 04, 2019, 08:48:59 AM
In fact it works under the latest (v1.5) 32bit version of MLV App. I can load the file, edit it, export it, go frame by frame... how ever occasionally also MLV 32 bit crashes if I hit play.
I tested with both windows versions here, but unfortunately I can't reproduce some errors. Works as it should without crash.  :o
If you like to help the project getting better, you could install Qt and start the debugger. The debugger will tell (hopefully) at which line the program crashes.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: AF-OFF on March 04, 2019, 04:15:37 PM
I can´t reproduce your issues. in feb28th build I changed cmos4 so if anything should affect footage it could be that but then again you say that it works.
When checking your 2.5k screenshot it says 17fps? What´s up with that? If you changed fps override it might be the reason to your issues. You could have better luck increasing reg_6014 in the crop mode sub menu.
I recently also added adtg_gui into this build since I use it a lot and don´t want to add it after compilation etc. This module should not be turned on if not using it. Just a tip.
Thanks, and I would gladly hear about more test results.
thanks Danne, Yes I did have had the adtg_gui module loaded (in both versions) &
did reduce fps to 17 to record continuously
just loaded the march04 build. did load the modules crop-rec, lua, mlv-lite, mlv-snd & sd-uhs
did set sd overclock script to autoload, enabled raw video and activated the crop rec preset 2.5k, restarted camera.
2.5k preset active, raw video shows 1920x1080, changed to 2520x1418. in crop mode changed bitdepth to 12bpp. restarted camera again. could not get more than 2-3 secs clips. changed preset bit depth to 10bpp, again did restart cam. no more than two seconds clips again. in raw video reduced to 1920x1280. recording ok. increased to 2240x1418. got some more frames, but not continuous.
Checking the clips in mlv app - everything looks fine ,and the two modes run continuously (round about 50MB/s) 1920x1080 14bpp lossless & 1920x1280 10 and 12bpp lossless.
Tried to go with 2520x1418 and 10,12 & 14bpp lossless but reduced framerate.
set the above res and changed to 18fps, restarted cam
did record with 10bpp, as usual the first 2 clips were 1-2 secs, but the next went continuously. changed mode in crop rec q submenu to 12bpp, restarted cam
but no longer recording possible so changed fps to 15 fps and did a restart.
now the first recording at 15 fps went continuous (...50 MB/sec)
changed the bitdepth in crop rec submenu to OFF, did restart cam,
on second attempt achieved continuos at 2,5k 14bpp and 15.017 fps
now , loaded the clips in mlv app and all clips were ok. no corrupted frames in ca 600 frames per recording.
summary 10bpp ok with 18fps (50MB), 12bpp (52MB) and 14bpp (55MB) at 15fps

will check the other presets soon
noticed nice moire regardless of bit depth.
 



 




Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on March 04, 2019, 04:21:00 PM
I see you have some testing going on so keep on to find something that´s useful for you. You probably already know about the eosm_cine.lua script which sets all parameters for continuous 2.35:1 recordings which should work for all presets.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: alzubi on March 04, 2019, 07:00:11 PM
Hey thanks for all the great work Danne and everyone else! I usually just lurk but had a question about external monitor use, I want to use my external monitor with the 5k anamorphic cine script. The only problem being that when I plug my monitor in the preview switches from framing which i prefer to live view which i dont want to use. Is there anyway to keep preview on framing when using an external monitor?
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: AF-OFF on March 05, 2019, 01:35:13 AM
@Danne
just tested the mcm 1080p preset with 2.35:1 1584x672 14bpp. first four tries didn't roll, then jumped to continuous, with GD off 44MB was reported green. dialed the resolution down to compare the footage with the 50d which has this limit of 1584 without crop.
yes this 2.35:1 is interesting.

I'm aware of the 2.35 script.  will try it again with the 2.5k crop mode. that would be quit a fit with HD1072 
with your march 04 build I am very happy, thank You very much! 
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on March 05, 2019, 08:08:53 AM
When you thought all hope was gone getting even more extreme aliasing:
MLV:
https://bitbucket.org/Dannephoto/magic-lantern/downloads/xtreme_aliased_2.0_M05-0849.MLV

(https://www.magiclantern.fm/forum/proxy.php?request=https%3A%2F%2Fi.postimg.cc%2FncZfZD9K%2FScreenshot-2019-03-05-at-07-53-11-png-scaled.png&hash=848a6eec2faba7de009434e215e47e6d)

I experimented with a reg that pops out when taking a cr2
802C

So I set to following in crop rec.c:
Code: [Select]
adtg_new[2] = (struct adtg_new) {6, 0x800C, 4 + reg_800c};
adtg_new[2] = (struct adtg_new) {6, 0x802C, 0};

Then I need to adjust 713c and 7150 and increase to 450 in crop mode sub menu working with following menu preset:
mv720p 1736x694 50fps
Had to lower framerate to around 30 and after pushing canon menu button a couple of times I managed to get a correct mv720p image.
Not sure how this reg can help if ever but I thought I´d put it out there.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: marcelolippi on March 05, 2019, 03:23:11 PM
Hi,
I installed your latest version and the magiclantern screen is empty, I'm back to the 23 Feb version. nothing, December, the same and that of July the same. Not being able to access the magic lantern menu can I install original firmware 2.0.2? thank you. PS previously up until the 23 Feb version worked well
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on March 05, 2019, 03:28:17 PM
Sorry, can´t follow what you´re doing. Could you make a video of what is going on or some screenshots/photos?. Latest version works here and also seems to be working for others(didn´t hear anything else).
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Walter Schulz on March 05, 2019, 05:49:21 PM
I think it resembles what's happening with missing autoexec.bin. Cam stuck.

@marcelolippi:
Check card's root directory. It should look like this: (https://www.magiclantern.fm/forum/proxy.php?request=https%3A%2F%2Fbuilds.magiclantern.fm%2Fcard_contents.png&hash=e6d8b700929875d89ef42c4e802dcf3d)
If all files and directories are there:
Remove battery.
Insert card.
Insert battery.
Startup cam.
Report back.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: kayman1021 on March 05, 2019, 05:55:22 PM
Hello Danne

I don't think your post had aliasing.
Your picture seemingly consists 4 pixel(2 pattern) wide columns
I think every second column is offset by 8 pixels.
Here's what it looks like reordered:


(https://www.magiclantern.fm/forum/proxy.php?request=https%3A%2F%2Fi.ibb.co%2F3FjTzWh%2Freordered.jpg&hash=ea624caed4964b48bbc5cf0f78f7a5f4) (https://ibb.co/3FjTzWh)


The keyboard keys are a bit blurry, but the icons on the desktop look fine. Was this a handheld shot?
Is this usuable at all?
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: DeafEyeJedi on March 05, 2019, 09:26:16 PM
A quick test run (Thanks @Danne for the build earlier 20 mins or so ago) and been trying to cause corruption frames to no avail other than certain abnormal aliasings and few pink highlights w Dual-ISO. Everything was shot in Lossless 10-bit @ ISO 3200 (ISO 100/1600 for Dual) within 11-20mm 2.8 for kicks.


...and what's up with those mysterious Focus Pixels? Hmmm... More to come...  :)
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on March 05, 2019, 09:42:43 PM
Dualiso is not the safest bet for movie recordings. Thanks for sharing @deafeyejedi.

New build:
https://www.magiclantern.fm/forum/index.php?topic=9741.msg208959#msg208959

I am playing around with HDR implemented in crop rec.c. Overriding cmos 0(idea from a1ex). It´s kind of working with all presets but it´s only in it´s infancy state so take it with a grain of salt. Halfpress shutter when in idle mode to preview flickery style, other wise it will be in one of the isos before starting record button and HDR kicks in. Thanks @masc for ideas and discussions of vsync function and what not :).

Known bugs: Framing will work but if used when recording it will break recording. Anyway, set to real time for the time being. Base iso static set to iso 100.

(https://www.magiclantern.fm/forum/proxy.php?request=https%3A%2F%2Fi.postimg.cc%2F15KdYkt3%2FVRAM1-PPM-500px.png&hash=12d057b4d05c694fd37b6c7a19f30342)

(https://www.magiclantern.fm/forum/proxy.php?request=https%3A%2F%2Fi.postimg.cc%2FFF380dXc%2FVRAM0-PPM-500px.png&hash=c28977bf840db24fded999c15156e491)
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: DeafEyeJedi on March 05, 2019, 09:50:07 PM
Whoa I am digging this new HDR feature BIG time...

Thanks so much @masc for inspiring all of us!

Hoping to use this while in crop_rec @ 48p.......
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: geroinnn on March 06, 2019, 03:07:56 PM
Has anyone managed to connect a monitor via HDMI and record video without distortion? One person wrote that he managed to get rid of the green bars when recording video in RAW, when he reduced the monitor resolution to 480p. Please share your experience .
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Dutchflyingpilot on March 07, 2019, 01:18:36 AM
Hi, Yes!
Check out:
In short: Whatever monitor you use, make sure you can set it to accept 480p/60hz and/or set it to 'Camera Mode',
otherwise you'll end up with a badly synced 1080p image (flickering) and distorted recordings.
The problem lies in the synchronisation of the HDMI ports; both 'resolutions' have to match for the camera and monitor to work properly.


Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: alzubi on March 07, 2019, 02:30:20 AM
The problem lies in the synchronisation of the HDMI ports; both 'resolutions' have to match for the camera and monitor to work properly.

Is there any possible way to fix the sync issue so that other monitors would work or are we just sol? I wouldn't mind putting time and money to get it working, just not sure if this is something to be fixed with software.

Also why is this a raw specific issue? Monitor use with non raw footage works great but once raw is disabled the footage becomes choppy and purple frames.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on March 07, 2019, 09:24:00 AM
New build:
https://www.magiclantern.fm/forum/index.php?topic=9741.msg208959#msg208959

commit:
https://bitbucket.org/Dannephoto/magic-lantern/commits/26722bf3abdf6613c707397763de382b0f9aeffd

Reworking HDR:
(https://www.magiclantern.fm/forum/proxy.php?request=https%3A%2F%2Fi.postimg.cc%2F0jcCkwrd%2FVRAM0-PPM-scaled.png&hash=d59adca5954656a0f494909552c8f053)
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: gravitatemediagroup on March 07, 2019, 09:32:52 AM
Has anybody else noticed or experienced, after installing a new build (specifically in the past week or so), upon first boot of the camera, you can record without crop in a resolution that is very close to 1080, (1800x1032) but after that take, the liveview gets messed up, until you magnify to 5x crop and then it will record in the 2.5K resolution, but all of this happens without making any settings changes in the ML menu.  If this could be a permanent setting without the screen glitch...that would be the most perfect build in my opinion  8)
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on March 07, 2019, 09:42:36 AM
Please upload a MLV file which recorded uncropped in this resolution. The resolution you mention is only working with Movie crop mode(x3crop) without rewired preset applied. This resolution can probably be starting point also with rewired preset on when starting cam but push canon menu to get into correct mode.
If you managed to record in non cropped mode you need to inspect the actual file recorded. Proof.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: gravitatemediagroup on March 07, 2019, 10:00:37 AM
Please upload a MLV file which recorded uncropped in this resolution. The resolution you mention is only working with Movie crop mode(x3crop) without rewired preset applied. This resolution can probably be starting point also with rewired preset on when starting cam but push canon menu to get into correct mode.
If you managed to record in non cropped mode you need to inspect the actual file recorded. Proof.


(https://www.magiclantern.fm/forum/proxy.php?request=https%3A%2F%2Fi.ibb.co%2Fss35nPY%2FC85-E0-B29-C95-B-4-DEC-BD60-288378733922.jpg&hash=781eefd45617b2e15d4967ed3f6cc2c1) (https://ibb.co/ss35nPY)


This has happened about 3 times now, I purposely tried to test it with most recent build but it didn’t happen, so i may install the previous build to see if it happens with it.

Also, I’ve lost sound in the past few builds, whereas before it was flawless.  Sound setting is enabled.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: gravitatemediagroup on March 07, 2019, 10:17:13 AM
I need the build from March 6th to test and hopefully able to duplicate, but don't see it on the bitbucket page, do you happen to still have that build handy?
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on March 07, 2019, 10:29:22 AM
I need a shortened MLV not a screengrab.
Todays build and march 6th are identical except for a few hdr changes.
About loosing audio. I need more info and more repetitive patterns to reproduce. You don´t mention settings used etc.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: geroinnn on March 07, 2019, 11:42:26 AM
Hi, Yes!
Check out:
In short: Whatever monitor you use, make sure you can set it to accept 480p/60hz and/or set it to 'Camera Mode',
otherwise you'll end up with a badly synced 1080p image (flickering) and distorted recordings.
The problem lies in the synchronisation of the HDMI ports; both 'resolutions' have to match for the camera and monitor to work properly.
Yep, I watched this video
I would like to know about similar experience with other displays: any monitor capable of transmitting an image at 480p / 60Ghz is suitable or is it better not to take the risk and take the Feelworld F570, since there is already a positive experience of use?

Is there any possible way to fix the sync issue so that other monitors would work or are we just sol? I wouldn't mind putting time and money to get it working, just not sure if this is something to be fixed with software.

Also why is this a raw specific issue? Monitor use with non raw footage works great but once raw is disabled the footage becomes choppy and purple frames.
I also do not mind sponsoring this idea if it is solved programmatically. I think that many will be interested in this option.

P.s.
Is nobody else using an external monitor on this camera?
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on March 08, 2019, 10:48:56 AM
New build:
https://www.magiclantern.fm/forum/index.php?topic=9741.msg208959#msg208959

Autofocusing during filming should now work. If it affects recording times needs to be checked so feedback welcome:
https://www.magiclantern.fm/forum/index.php?topic=3064.msg213120#msg213120

EDIT:
Back to set to af off for defaults. Enable af on in small_hacks sub menu in RAW video section.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Pacerx999 on March 08, 2019, 01:28:02 PM
P.s.
Is nobody else using an external monitor on this camera?

So I'm a couple of versions out of date (using crop_rec_4k_mlv_snd_isogain_1x3_presets_2019Feb25.EOSM202)

But re: using an external monitor, and checking for corruption. I used the eos m with an Atomos Ninja Assasin (https://www.atomos.com/ninja-assassin) and it worked for displaying the signal and allowing for easier focus. No weird flickering etc etc. It still appeared to be a 480p signal, but I couldn't verify using the monitor as it was only a quick test.

Also, if I turned off Global draw the signal was clean enough to use the focus peaking in built into the monitor

For reference i was on the MCM rewire preset.

On checking the file, no corrupt frames. To be honest, it was probably the nicest footage I shot as I wasn't hunting for focus on a tiny screen.

I would assume the reason not many are using external monitors is because the monitor probably costs as much if not more than the EOS M.

Anyway, on to play with the latest build!
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: geroinnn on March 08, 2019, 01:51:33 PM
So I'm a couple of versions out of date (using crop_rec_4k_mlv_snd_isogain_1x3_presets_2019Feb25.EOSM202)

But re: using an external monitor, and checking for corruption. I used the eos m with an Atomos Ninja Assasin (https://www.atomos.com/ninja-assassin) and it worked for displaying the signal and allowing for easier focus. No weird flickering etc etc. It still appeared to be a 480p signal, but I couldn't verify using the monitor as it was only a quick test.

Also, if I turned off Global draw the signal was clean enough to use the focus peaking in built into the monitor

For reference i was on the MCM rewire preset.

On checking the file, no corrupt frames. To be honest, it was probably the nicest footage I shot as I wasn't hunting for focus on a tiny screen.

I would assume the reason not many are using external monitors is because the monitor probably costs as much if not more than the EOS M.

Anyway, on to play with the latest build!
Thanks for the response. Using an external monitor really makes focusing easier, so I want to buy it.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: marcelolippi on March 08, 2019, 09:25:15 PM
Thanks Danne, great work! I put the lua sd and 5k active, I can also record for several seconds but the duration is random ... will also be problems with card speed? (sdxc c10 u3, should be 60mb in writing). Regarding the exposure I do not understand how sometimes the exposure is correct and sometimes burns with the usual pink pixels. What should I check?
Below some frames, failed (random but on average one every 2 seconds) and the "pink" problem.
Thanks again
(https://www.magiclantern.fm/forum/proxy.php?request=https%3A%2F%2Fi.ibb.co%2F4NQw3jx%2FP-20190308-170236.jpg&hash=1689cfd7b70b1f4b126f32e61a7c5a9d) (https://ibb.co/4NQw3jx)

(https://www.magiclantern.fm/forum/proxy.php?request=https%3A%2F%2Fi.ibb.co%2FjR2FK0W%2FP-20190308-170304.jpg&hash=2e40711eec88eeb932c886728303fc05) (https://ibb.co/jR2FK0W)

(https://www.magiclantern.fm/forum/proxy.php?request=https%3A%2F%2Fi.ibb.co%2FGpm56MQ%2FP-20190308-170414.jpg&hash=068fb20499df0feb4cdaca77a655accf) (https://ibb.co/Gpm56MQ)
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on March 08, 2019, 09:41:10 PM
First question. Are you reording 2.35:1? Starting point, the cinema script in lua section?
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: AF-OFF on March 09, 2019, 01:31:28 AM
@Danne
was testing the march04 build with all presets .
found no corrupt recording at all with corrupted frames. did a fresh start and formatted the card in cam (canon menu) enabled after auto reboot the essential modules - crop rec, lua, mlv lite and sound & sd uhs
after reboot initialized the 2,35:1 cine script.
just downloaded the march 07 & 08 builds and will try more testing and more this weekend

Thanks to all and Danne!
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: marcelolippi on March 09, 2019, 01:55:11 AM
124/5000
yes I loaded module 2.35 1, can there maybe a max 60mbs sd speed  in writing?
However, I check with the new version. Thank you
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on March 09, 2019, 08:12:26 AM
The sd_uhs module is highly experimental and will or will not increase card speeds. Sandisk ones seems more stable.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: bobolee on March 10, 2019, 06:14:38 AM
Very cool!I tested the March 2019 build,the morie issue is solved !!This is another milestone in my opinion.
Now,can we have real FHD 24fps ?
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: alzubi on March 10, 2019, 07:56:14 AM
So I'm a couple of versions out of date (using crop_rec_4k_mlv_snd_isogain_1x3_presets_2019Feb25.EOSM202)

But re: using an external monitor, and checking for corruption. I used the eos m with an Atomos Ninja Assasin (https://www.atomos.com/ninja-assassin) and it worked for displaying the signal and allowing for easier focus. No weird flickering etc etc. It still appeared to be a 480p signal, but I couldn't verify using the monitor as it was only a quick test.

The thing is that monitors work when on 480p input on the monitor the problem is that majority of monitors dont have this feature i just purchased 2 diffrent monitors hoping to find one with the 480p input option and neither had the option. I purchased a feelworld s55 which is an overall great monitor but some of the firmwares have the feature and some of them dont. I didnt get one with the option.

The solution is to find out whats causing corrupt footage on 1080p or 1080i monitors, and why does it work fine when the monitor is set to 480p. I have a wedding im shooting later this year and without an external monitor im just not going to be able to use the eosm, probably will just pick up a blackmagic if i cant figure this out.

If we do figure this out it means anyone with $250-300 can have a full cinema rig capable of high quality raw which is insane. I just really want monitor support if anyone is willing to figure it out and does figure it out I will personally pay you.

Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: marcelolippi on March 10, 2019, 07:31:49 PM
 Again, great work, the quality it's very good! I want to make only two question, the limit of write speed with sd overclock is more or less 55mbs? The cause of bads half frame pink are the card speed? Thanks
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: anto on March 11, 2019, 12:22:40 AM
Grande Danne!
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: alzubi on March 14, 2019, 03:12:46 AM
PSA the feelworld monitor zeek had gotten doesnt always come with the 480p or what its called in the menu as "camera mode" option. I purchased multiple monitors 3 to be exact hoping to find one that worked with my eosm and all 3 did not have the 480p option or the camera mode option. I have spent $500 on monitors trying to find one and have been unsuccessful.

The feel world i purchased even said it had the option but upon purchasing it did not and the support have yet to follow up with me im going to guess because there is not an actual way to switch firmware out of factory even though they claim the upgrade firmware port as a feature. 

If you want to look into it the monitor from feelworld that claims it as a feature is the f570 which is the same one used in the zeek video, and on their page : http://www.feelworld.cn/ShowInfo.aspx?id=519&py=

it even says its a feature. I can show proof that i dont have the option on firmware 1.25
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: gravitatemediagroup on March 14, 2019, 04:43:32 PM
anybody else notice a flicker in latest build?  almost like a line sync effect
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on March 14, 2019, 06:45:17 PM
What was your shutter set to? More info is needed. Steps to reproduce.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: gravitatemediagroup on March 14, 2019, 10:59:01 PM
1/50 ISO 800
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on March 14, 2019, 11:33:21 PM
I really need more here. fps, preset used environment, maybe some recording of the issue, uploading the settings folder etc. Minimized answers/questions will not get us closer to solving.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: gravitatemediagroup on March 15, 2019, 12:44:08 AM

(https://www.magiclantern.fm/forum/proxy.php?request=https%3A%2F%2Fi.ibb.co%2FP647Qsr%2F2-A7-C67-A1-895-E-4074-A23-E-6-DC392-FB1687.jpg&hash=ad58483bb5906ee93c379bdb6b8a74ad) (https://ibb.co/P647Qsr)
nothing changed from what the preset script loads. seems to only be doing it in 5x crop.  It doesn't do it at 1/100 shutter and above, only below. It's not just in cameras live view, it's baked in to the MLV file

about to load the March 14th build and see if it's still present
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: gravitatemediagroup on March 15, 2019, 01:08:20 AM

(https://www.magiclantern.fm/forum/proxy.php?request=https%3A%2F%2Fi.ibb.co%2Fvqc2Q7m%2F40-A12531-B3-D5-4-FCD-8278-F9-DC769-A3-D3-C.jpg&hash=78939773f0f30e5d5efc6ee6b96de1a8) (https://ibb.co/vqc2Q7m)


Turning this off has stopped it.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on March 15, 2019, 06:10:59 AM
What preset was used in x5 mode? What preset script? I need more info. Instead of waiting for more riddles I would like you to upload:
1 - a short mlv file with this issue
2 - your SETTINGS folder from inside your ML folder on your sd card

I need exact steps to reproduce the issue.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: masc on March 15, 2019, 08:04:48 AM
@gravitatemediagroup: what is the light source in your pictures? Natural light or artifical light? 2nd might produce such artifacts, with or without ML.

(https://www.magiclantern.fm/forum/proxy.php?request=https%3A%2F%2Fi.ibb.co%2Fvqc2Q7m%2F40-A12531-B3-D5-4-FCD-8278-F9-DC769-A3-D3-C.jpg&hash=78939773f0f30e5d5efc6ee6b96de1a8) (https://ibb.co/vqc2Q7m)

Turning this off has stopped it.
--> artifical light and a setting on the edge.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: AF-OFF on March 15, 2019, 06:39:15 PM
last (march14) build
first did reformat the card
loaded crop-rec, lua, mlv lite und mlv sound, sd uhs
preset mv1080p MCM gets automaticaly activated (nice)
did activate sd uhs in crop mode submenu, disabled 25fps, didn`t change 12bit & 16:9 settings restarted the cam
in raw video submenu - resolution 1736x976, real-time, crop rec preview set to automode, sound recording off. restarted the cam
did some recordings. everything is ok. the green record indicator all time
switched to next preset - mv1080p 46 fps, restarted cam
did record 3 clips of 1000frames. unfortunately had there from 4 to 10 bad frames per clip.
all recordings show the red indicator first, changing to orange after some time
resolution was 1496x844.

also noticed focus pixels in MCM preset and no focus pixels in 46fps preset.


Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: masc on March 15, 2019, 07:03:01 PM
For 46fps preset, switch GlobalDraw=OFF. Otherwise you'll get much more corrupted frames.
For removing focus pixels use the latest focus pixel maps from dfort.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: AF-OFF on March 15, 2019, 08:39:45 PM
For 46fps preset, switch GlobalDraw=OFF. Otherwise you'll get much more corrupted frames.
For removing focus pixels use the latest focus pixel maps from dfort.

thank You masc
did turn on the new raw video submenu kill GD. did record several longer clips withous problems and almost without corruption (only 2 bad frames in several 1000 frames)
also  used with x3crop
I have installed the focus pixel maps from dfort

later I tested the 2.5k preset. at 2112x1188, 10bit lossless and 23,976 fps, without problems & after disabling the ratio of 16:9 in crop mode submenu, I increased the res in raw video submenu to 2520x1418 and did set fps override to 18fps, was able to record continuous, without any corrupted frames.

great Work Danne

 
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on March 15, 2019, 08:47:24 PM
Great, thanks for feedback. I might set 16:9 to 45 fps for better  takes and maybe corruption free. 1 fps decrease probably would go unnoticed anyway.
Af-off. If you could increase reg_6014 so you get 45fps and test for corruption it would be nice.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: gravitatemediagroup on March 15, 2019, 10:03:32 PM
@masc  was probably a couple different light sources, natural from a window, tungsten overhead, but no fluorescent.  I've tested all other builds from the past couple months in the same environment, with same shutter, but this is the first I've noticed this in the past couple builds.   
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: AF-OFF on March 15, 2019, 10:04:09 PM
Af-off. If you could increase reg_6014 so you get 45fps and test for corruption it would be nice.

Yes Danne, I 've increased the reg_6014 to 1 and 4 but the recordings did have a bad frame each. then I increased to 15 and did a 1 min. recording at 44,457fps and everything is fine!

Is this normal, that after powering cam off and later back on these reg_ value is again 0 ?
Anyway, I will try this reg_ in 2.5k preset too, instead of using fps override.

Thanks much Danne
will report later
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on March 15, 2019, 10:07:58 PM
Yes. Turning off will reset regs. They are only for testing. Anyway. Are you sure finetuning to 45 fps isn't working?
By the way. If you set sd_uhs from crop mode sub menu and restart cam there's no longer need for sd_uhs.mo enabled.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: AF-OFF on March 15, 2019, 11:17:13 PM
@Danne - Disabled sd_uhs.mo
did test the 2.5k preset 2520x1412 10bit and adjusted the value of reg_6014 to 615 which gave me continuous at 18,028fps. value of 619 gave me 17,999fps, which was the closest to 18 I could get

all recordings where ok!

the value of 15 just worked for the mv1080p 46fps preset. isn't it better to have no bad images than an odd value of fps? will check this soon anyway, playing with this reg_6014 is fun somehow
 
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: AF-OFF on March 16, 2019, 12:29:49 AM
Are you sure finetuning to 45 fps isn't working?

in mv1080p 46fps preset- with biggest res.
10bit, sd_uhs enabled, reg_6014 = 28 &
1736x976, 1:1, preview Real-time, crop rec preview = automode, kill GD ON, sound off
reg_6014 = 28 is 45.026 fps
reg_6014 = 29 is 44,993 fps -  250 frames with max res. , with resolution of 1600x900 up to 15 sec.two bad frames, with 1536x864 about 30 sec. everything good

so I did decrease the res. to record continuous to 1504x846 at 44,993 fps & formatted card
could record easily 2 mins. (5,79GB) took some time to watch it with playback speed in mlv app of 14.15 fps, no corrupted images.



Noticed cam gets much hotter in these high speed mode



Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on March 16, 2019, 07:23:49 AM
Ok, I see. You manually set ratio. Good to know it works. There is a fixed preset ratio 16:9 among the 46fps presets. I thought you were testing that. Is that one also working out of the box?
Sidenote. reg_6008 is also related to fps together with reg_6014.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: AF-OFF on March 16, 2019, 03:22:48 PM
yes, was working first with Your presets. then tried using own settings
as You have suggested.
If the ratio is set in crop rec submenu, either 16:9 or 2.35:1, the mlv resolutions are limited. as we know, some resolutions work only at ratios like 1:2 or 1:1, right?
I like the new x3crop for the mv 1080p modes. This is because I like to use some c-mount glass sometimes. Therefore I like also the most the 2.5k preset. in the max possible res, I get a nice fov with the 12,5mm one.
the MCM mode is also very nice if using non c- mount glass.

will do some more testing and comparing the footage.

thank You very much for this good work Danne
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: AF-OFF on March 16, 2019, 03:25:04 PM
I thought you were testing that. Is that one also working out of the box?
Sidenote. reg_6008 is also related to fps together with reg_6014.

Yes, out of box, but as macs mentioned, disabling GD is essential to ged rid of corruption in frames.
Will take the other register into account, thanks!
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: AF-OFF on March 16, 2019, 05:07:02 PM
further testing, Danne's march14 build
->scripts - eos cinema 2.35:1, activates 5k preset
res is now 1504x1390, preview changed to real time, kill GD on, soundrec. off
->canon menu, format card
crop mode menu - 10bit, 2.35:1, sd_uhs enabled, reg_6014 =19, reg_6008 =20,reg_6800_height =950 <-----this centers the realtime preview
can't get continuous, so ->prefs,config options, ->restore ML defaults
after restart, in modules activated crop-rec,lua,mlv lite, mlv sound, sd-uhs, silent
-> Overlay,magic zoom to off
after restart, formated card again from canon menu
raw video menu, sound off, Kill GD ON
crop mode menu - 12bit, 16:9, disable 25fps, sd_uhs ON, restart
checking - ->Debug , Memory Patches - 4rom 2ram, crop_rec & sd uhs, sdr104
recording MCM video, continuous at 42MB, 20% idle, recording OK
changing preset to 5k , and restarting cam
unchanged entries in crop mode menu
raw video menu - 1184x2000, 1:2, real-time, kill GD
recording (shows now 3.5k anamorphic) continuous, 47MB, 32% idle, recording OK
changing crop rec reg_6800 to 950 again
now somehow the res did change, to 1184x1050 - don't know why, clips ok, did use ca. 37MB write speed at 37% idle

so far, will do some more testing later
thanks to Danne and all others





Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: AF-OFF on March 16, 2019, 10:19:53 PM
interestingly, still using Danne's march14build, I found something interesting in 5k preset.
crop mode changes: bitdepth 10bit, ratios OFF, x3crop enabled, sd_uhs still enabled
raw video changes : Preview Framing, crop rec preview - automode, Resolution 1664x2126 , unchanged also kill GD & aspect ratio of 1:2 & sound OFF

tried recording, the liveview got scrambled, but recording went on, tried with Preview-Frozen LV, nothing, restarting cam (have also to change the battery which shows the red sighn since 15 minutes....

after power up, 12bit, thought to have changed it to 10bpp, will check , but now the indicator inLV reads 5k anamorphic instead of 3.5k before res change. did change the bpp to 10 and the reported res is still 1668x2126

after restart tried another recording, which got everythime scrambled while recording some frames and then restored back the Framing preview
so decided to go down as much as 11 fps for the next shot
activated fps override and set the framerate to 11 and optimized for Exact fps. Then most importantly I switched ->Overlay - GD to off. this gave me the scrambled LV (back)
the recording kicked in at 39.5MB, so recorded a minute and then did change following : crop mode - bitdepth to off (was 10bpp)
so now this was 14bit lossless as its default in raw video, preview still scrambled, did another recording, which on second attempt jumped from the start in continuous at 51,2MB and recorded almost 2mins (i've stopped it, green light all time)

now time to check the files in mlv app
and yes, all clips are fine, but the best is the one with 14bpp lossless. if anyhow, You don't rely on fps, this is very nice image at 4992x2126 - maybe I missed the boat, but this is the biggest resolution I've ever seen on the old eosM.

any suggestions




Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on March 16, 2019, 11:03:52 PM
A lot of stuff going on here  :P
You are right about biggest resolution for eosm. I works with framing mode so global draw needs to be on. While recording.
Easiest access is to run the cinema script then turn off the ratios in crop mode sub menu. RAW video always 14bit lossless. Set to 10bit in crop mode sub menu.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: AF-OFF on March 17, 2019, 08:17:58 PM
A lot of stuff going on here  :P
You are right about biggest resolution for eosm. I works with framing mode so global draw needs to be on. While recording.
Easiest access is to run the cinema script then turn off the ratios in crop mode sub menu. RAW video always 14bit lossless. Set to 10bit in crop mode sub menu.

nice thanks Danne,
it works!
I've noticed, its usefull to format card before beginning a new session with each card. just deleting the file on pc isn't enough. cards seem to perform worst without.
so first deleted all configs (restore ML defaults), then formatted card in canon menu
activated crop rec, lua, mlv lire and sound, sd uhs and silent
disabled magic zoom and restarted cam
->Scripts-eosm cinema
now I have in LV 12bit 4.5k anam. framed preview
in crop rec enable x3crop and sd_uhs
in raw video cannot change res any higher than 1624x1160, sound recording to off,
restart the cam
ok now LV tells me 10bit, 5k anamorphic, Framing
but just before the framing preview kicks in, there is the familiar white magenta black scrambled LV for short time
going to ML menu (again shorttime scrambled)
first checking the debug menu, 4rom 2 ram patches executed
in movie menu
raw video shows now res of 1624x2126
able to increase manually to 1664x2126, so now I dont use the kill GD
wow, now the preview gets Framing and B/W while recording
it records 5 and 7 seconds.
now I want to test something
in raw video menu I change the resolution to 1280x2126, where the info text at bottom changes to green, leaving menu
can record continuously for 1min.
now because I'm using a c-mount glass and thus seeing the crop isn't centred, I go to the crop rec menu and trying to change the reg_6800 to 800 and this breaks the preview and limits the vertical res to 1326 , so I set the reg_6800 back to 0 and restart cam
so now everything is back again

reducing image width makes in some resolutions the preview jump, so there would be probably corrupted frame(s).

let's look at clips so far in mlv app
at 1184x2126 there are some bad frames
at 1168x2126 the images are somewhat jumping to the left, as it was in LV be seen
at 1232x2126 bingo! please test this one, no corrution
at 1200x2126 as notived while recording, jumping around
at 896x2126 (which makes it almost rectangular, the same as with 1168 and 1200 previously
at 960x2126 bingo, please test this one (looks similar to 4:3 aspect ratio, like this somehow)
at 1008x2126 bingo again, this looks more 3:2 isch
at 1280x2126 only 4 bad frames out of 1511, this looks like 16:9, although for a c-mount glas, this is much to high res, see pic below
at 1664x2126 bingo

somehow the center alignment isn't right. and reg_6800 doesn't on it alone do the job
anyway, this build is great for further experimentation with


thanks to Danne and others 


(https://www.magiclantern.fm/forum/proxy.php?request=https%3A%2F%2Fi.ibb.co%2FmGdjJbw%2F1280x2126-eos-M.jpg&hash=577675eb1b9641e2faffc17f0b3f4bd3) (https://ibb.co/mGdjJbw)




Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: AF-OFF on March 18, 2019, 02:56:49 AM
did test all resolutions with the 5k preset, all recordings at 10bit lossless, 23,976 fps
each recording if not stated otherwise around 500 Frames, 50GB total

resolution - behavior during recording - playing in mlv app (OK means no damaged frames)

640x2126 - LV jumps during recording, ML console comes up, restarted, jumps
656x2126 - LV seems undisrupted during rec. , 2 bad images at beginning
672x2126 - LV seems undisrupted during rec. , 1 bad image
688x2126 - LV seems undisrupted during rec. , 1 bad image
704x2126 - LV jumps once after starting recording, jumps
720x2126 - LV jumps once after starting recording, some bad frames
736x2126 - LV jumps once after starting recording, 3 bad frames at beginning
752x2126 - LV seems undisrupted during rec. , some bad images , jumps
768x2126 - LV jumps during recording, ML console comes up, restarted, jumps
784x2126 - LV jumps several times after starting recording, jumps
800x2126 - LV seems undisrupted during rec. , 4 bad frames
816x2126 - LV two bad frames then seems undisrupted during rec. , some bad images
832x2126 - LV seems undisrupted during rec. , OK
848x2126 - LV two bad frames then seems undisrupted during rec., 3 bad fr. at start
864x2126 - LV one bad frame then seems undisrupted during rec. ,  1 bad fr. at start
880x2126 - LV jumps once after starting recording, OK
896x2126 - LV jumps during recording, many bad trames
912x2126 - LV seems undisrupted during rec. , OK
928x2126 - LV seems undisrupted during rec. , OK
944x2126 - LV two bad frames then seems undisrupted during rec. , 2 bad frames
960x2126 - LV two bad frames then seems undisrupted during rec. , jumping frames
976x2126 - LV two bad frames then seems undisrupted during rec. , 2 bad frames
992x2126 - LV two bad frames then seems undisrupted during rec. , jumping frames
1008x2126 - LV jumps during recording, 2 bad frames
1024x2126 - LV seems undisrupted during rec. , OK
1040x2126 - LV seems undisrupted during rec. , OK

battery is hot, make a small break

1056x2126 - LV jumps during recording, some bad frames
1072x2126 - LV jumps 4x after starting recording, jumps at beginning
1088x2126 - LV jumps during recording,  jumps
1104x2126 - LV seems undisrupted during rec., OK
1120x2126 - LV seems undisrupted during rec. , OK
1136x2126 - LV jumps 1x after starting recording , jumps once then ok
1152x2126 - LV jumps during recording, jumps
1168x2126 - LV seems undisrupted during rec. , 2 bad fr. at end
1184x2126 - LV seems undisrupted during rec., OK
12oox2126 - LV seems undisrupted during rec., OK
1216x2126 after switching to this res, LV broken, restarting cam,
everything works again but recording jumps around, jumping all over
1232x2126 - LV jumps during recording, jumps around
1248x2126 - LV jumps 1x after starting recording, one jump at beginning
1264x2126 - LV seems undisrupted during rec. , OK
1280x2126 - LV jumps once during recording, one bad frame
1296x2126 - LV seems undisrupted during rec. , one bad frame
1312x2126 - LV seems undisrupted during rec. , OK
1328x2126 - LV jumps heavily during recording, strong jumping
1344x2126 - LV seems undisrupted during rec. OK
1360x2126 - LV jumps 1x after starting recording, one bad frame
1376x2126 - LV seems undisrupted during rec., OK
1392x2126 - LV jumps heavily during recording, jumps
1408x2126 - LV jumps heavily at beginning recording, jumps heavy at first third
1424x2126 - LV jumps twice laggy after starting recording, jumps
1440x2126 - LV seems undisrupted during rec. , one bad frame

cam temp reaches 50°C, making a break, batt. hot

1456x2126 - (first rec stop), then   LV seems undisrupted during rec., OK
1472x2126 - LV seems undisrupted during rec. , OK
1488x2126 - LV seems undisrupted during rec. , OK
1504x2126 - LV seems undisrupted during rec. , continuos for 26sec., OK
1520x2126 - LV seems undisrupted during rec. , continuos for 21sec., OK
1536x2126 - LV seems undisrupted during rec. , continuos for 15sec. OK
1552x2126 - LV seems undisrupted during rec. , continuos for 14sec. OK
1568x2126 - LV seems undisrupted during rec. , continuos for 14sec. OK
1584x2126 - LV seems undisrupted during rec. , continuos for 12sec., one bad fr.
1600x2126 - LV seems undisrupted during rec. , continuos for 11sec. one bad fr.
1616x2126 - LV seems undisrupted during rec. , continuos for 9 sec.OK
1632x2126 - LV seems undisrupted during rec. , continuos for 7 sec. jumping
1648x2126 - LV seems undisrupted during rec. , continuos for 8 sec one bad fr.
1664x2126 - LV seems undisrupted during rec. , continuos for 6 sec.., jumping



Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on March 18, 2019, 09:37:05 AM
Are you testing by using raw video ratios? The first 5k option is really just a proof of concept and unlike the other two ratios real time preview is not working while recording.
There are four skip regs to play with as well in crop mode sub menu. Maybe works too. (Called skip_left, skip_right etc)
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: SGrim on March 18, 2019, 01:48:58 PM
Been researching n days about RAW on EOS M, and the more info had found the more questions had raised. Some of them (maybe) can be solved by buying camera and trying out ML myself, but because i’m a little bit poor, i need to know before buying that it’s worth it. So a few questions/thoughts about RAW on EOS M, and if i misunderstood something – feel free to correct me.

1) 2.5k RAW (in which i'm interested most) can be recorded in 3.33x “crop mode” which makes lenses focal length three times more (for example, 10 mm lens =~33 mm in 35mm equivalent).
2) LiveView is working fine most of the time.
3) Crop factor of LiveView is only 5x due to some unavoidable restrictions (it cannot be 3, for example).
4) EOS M itself seem to have no limitations to SD card capacity, so any card up to 2 TB (SDXC format limit, but in terms of money saving i would probably buy 256 GB) can be used.
5) Could it be a better thing to use V60/V90-alike cards so sustain write speed would be closer to ~70 MB/s ML RAW than SanDisk Extreme Pro (which is V30 class)?
6) My main question. Is EOS M config is reliable for real continuous shooting for more than hour or two in any weather conditions (lets say up to +35 degrees Celsius in terms of possibility of overheating)?

I understand that 5D or 7D is most obvious choice for stability, but they cost half of my car - going over 200ish$ for body is not an option at all.

Thanks in advance.

(probably should have created a separate topic in RAW "subforum" but general thread seems to be more or less right for what kind of answers i'm looking for)
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: AF-OFF on March 18, 2019, 02:08:39 PM
I have shut ratios to OFF in crop menu, otherwise all the resolutions shouldn't be possible.
reg_skip_top destroys the colors, reg_skip_bottom cuts portions of the image.

my idea was to use the 5k preset as supplement to 2.5k preset - in the latter max res is 2520x1418, which is 16:9 but cannot roll at 23,976 fps, but with the 5k preset set to 1264x2126, which is the closest to 16:9 can record with 23,976 fps.

2126 x 1,77 = 3763,02 / 3 = 1254,34 and the closest I've found stable would be then 1264x2126




 
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on March 18, 2019, 02:29:25 PM
I see. Well keep on testing  8)
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: AF-OFF on March 18, 2019, 03:01:25 PM
I see. Well keep on testing  8)

Yes will do! I've noticed and downloaded Your new build - march 18 - any news on the new version?

as ever thanks a lot for the great work !
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on March 18, 2019, 03:13:02 PM
You can check commits. I added some black level fixes for previewing while recording reduced bitdepths. Still a halfway solution...
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: AF-OFF on March 18, 2019, 03:29:38 PM
5k preset
reg_skip_right   -70
reg_skip_top     -100 <---- when doing this, there is white border on top
raw video resolution 1264x2126
recording continuous for 30 sec. max....


(https://www.magiclantern.fm/forum/proxy.php?request=https%3A%2F%2Fi.ibb.co%2FW6pX2nt%2Feos-M-1264x2236.jpg&hash=9014fd2b69e134c9bf32e4df15ac085b) (https://ibb.co/W6pX2nt)


in mlv app, the resolution is shown as 1264x2236 , seems the reg_skip_top had changed this somehow.... see picture

I've found a good res that works for me - 1024x1728, records a clean video continuous and suitable for mount-c glass




Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: gravitatemediagroup on March 18, 2019, 08:44:19 PM
The greenish tint in liveview while recording is gone! now it looks like a vintage 70's LUT, which is fine by me.  :P
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: marcelo.lippi on March 18, 2019, 11:13:06 PM
I was able with the March 14 version to work very well with 4.5k at 24 and 25 fps, one minute without corrupt files. Now I have replaced with today's version and when I start recording the monitor turns white or pink. I can't understand the vertical definition that sometimes stands at 2120 and others at 1920. Maybe I should re-install the previous one.
Thank you for all
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: marcelo.lippi on March 18, 2019, 11:43:11 PM
maybe i'm going crazy? in the bitbucket download area I can't find a March 14 version ... did I dream about it and am I awake now?
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: marcelolippi on March 19, 2019, 01:24:19 AM
i read up, the 14 march version exist, i'm not crazy! Is it possible to have the 14 version again? I deleted it. THANK's
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Teamsleepkid on March 19, 2019, 03:30:04 AM
af off can you post your setting or build good for c mount lens 1024 resolution? interested in trying it. i have lots of c mount lenses. thanks.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: AF-OFF on March 19, 2019, 03:36:31 PM
af off can you post your setting or build good for c mount lens 1024 resolution? interested in trying it. i have lots of c mount lenses. thanks.

easy, please read my Reply #2434 and following.
use Danne's latest build. ---> https://bitbucket.org/Dannephoto/magic-lantern/downloads/

@marcelo.lippi please use Danne's latest build . differences to the march14 build are here
---> https://bitbucket.org/Dannephoto/magic-lantern/commits/all

Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: ctfire on March 19, 2019, 06:13:10 PM
Hey, can anybody tell how to use focus dots map , and in what programm it's work ? And is it work better than 3x3 chroma smooth ?
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on March 19, 2019, 10:28:10 PM
Try Mlv App. If you find any dots in recent builds please report about it. Dfort fixed map files for all presets.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: AF-OFF on March 19, 2019, 10:31:57 PM
just tested the new build from Danne (18March)
with my settings (folder) from the March14's build

using the 5k preset as described above

did longer recordings this time (around 2&1/2 mins.) and and did reduced the res to match the 2.5k 16:9 preset. (2520x1418)
I choosed 880x1468 and could record continuous without any corrupted frames.

But, I've noticed that randomly the motion in the image hangs, freezes for short period.
didn't have this in the 2.5k preset. I've tested this with both builds and it does this in both builds, regardless of bit depth (10 or 12)

all at 23,976 or 24 fps, fresh formatted card before testing, each build on an identical card.
 




Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: marcelo.lippi on March 19, 2019, 11:57:03 PM
These are my approximate tests. I also have to reformat the card to have more stability. Regarding the experience it seems to be random: I don't understand why sometimes I normally see, with the delay given by the signal processed, others in anamorphic magnified x5, sometimes the screen becomes completely dark (less than the set ISO value) sometimes normal. This is the camera monitor, the HDMI output is unpredictable. Very often I can't see anything (lilliput 7 ", neither in 480p or 1080i)
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: masc on March 20, 2019, 08:53:10 AM
Hey, can anybody tell how to use focus dots map , and in what programm it's work ? And is it work better than 3x3 chroma smooth ?
Try Mlv App. If you find any dots in recent builds please report about it. Dfort fixed map files for all presets.
Download dforts maps and copy them to same folder as MLVApp executable. MLVApp uses them then.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on March 20, 2019, 09:37:00 AM
@masc:
Could the map files be included in Mlv App as default? Good stuff.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on March 20, 2019, 09:42:12 AM
New build:
https://www.magiclantern.fm/forum/index.php?topic=9741.msg208959#msg208959

- Modifying black level for isos higher than iso 100 by checking raw_iso from lens.h. Only affects preview when recording reduced bitdepths.

in lens.h:
#define ISO_100 72 but seems eosm runs iso_100 as 0x48. Need to check this later. Might help fixing hdr stuff in main builds.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: ctfire on March 20, 2019, 10:01:44 AM
Download dforts maps and copy them to same folder as MLVApp executable. MLVApp uses them then.
Thank you
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: AF-OFF on March 20, 2019, 06:09:11 PM
some more tests with Danne's March20 build

I followed the instructions from Danne -> https://www.magiclantern.fm/forum/index.php?topic=9741.msg208959#msg208959

so basically I started the cam with the new build on it, enabled the essential modules, formatted the card from canon menu, after restart I executed the "eosm cinema 2.35:1" script.

then in croprec submenu I've removed the 25fps and in raw video menu dialed down the res to 1136x1920 (which is fairly close to 16:9 ratio)
now, this is interesting - I've forgot to mess with the ratio setting in croprec submenu, so there was still ratio of 2.35:1 set. result was nice, only one corrupt frame out of 3100 and no stuttering or so.
then I've noticed I've forgot to change the ratio, so I changed it in croprec to 16:9 and recorded another two minutes. I noticed also after the ratio change, that res was corrected to 1136x2000, which is little less 16:9 then my set res before. viewing in mlv app, in this clip I've had 7 corrupt frames and stuttering in the movements, not that much, but it was there.

then I changed the preset to 2.5k and recorded at max res of 2192x1234 another 2 mins. no corrupted frames or anything else, clean picture at 24 fps.

so maybe its best not to touch the ratio setting after executing the script.

one is still a bit of disadvantage that even if I can push the crop a bit to the left with reg_skip_left
trying to move the crop up with the other reg results in bad image, so its now impossible to properly center the crop, which at this high res is not quite suitable for c-glass   

will test further, thanks to Danne and others for this.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: marcelo.lippi on March 20, 2019, 07:53:29 PM
Today's version installed. Very stable in 4.5k resolution with the cine 2.35 script. More than a thousand frames without errors but when I connect the hdmi monitor it becomes unusable: 1 corrected frame 1 corrupt. Any ideas? Thanks for all!
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: AF-OFF on March 20, 2019, 08:49:28 PM
Today's version installed. Very stable in 4.5k resolution with the cine 2.35 script. More than a thousand frames without errors but when I connect the hdmi monitor it becomes unusable: 1 corrected frame 1 corrupt. Any ideas? Thanks for all!
just curious - how come, 4.5k anamorphic AND old cam / old hdmi should work ? isn't it to much to expect?
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: marcelo.lippi on March 20, 2019, 09:35:26 PM
I read that it could be used and in fact it works, it looks very good, you can't use the touch but at least you can fire and follow the action without problems ... but it produces so many errors in the recorded frames
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: AF-OFF on March 20, 2019, 09:57:47 PM
I read that it could be used and in fact it works, it looks very good, you can't use the touch but at least you can fire and follow the action without problems ... but it produces so many errors in the recorded frames
I can't help You with that one. But using logic,
I would suggest - maybe You could have a special version with err viewfinder but clean recording, or clean preview with corrupt recording, which if I understood You,
is the case now). for You.
maybe even possible to have both, but for what price?
and a question - does this setup of Yours work with other versions then Danne's ?
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on March 20, 2019, 10:13:42 PM
Practically no experience with hdmi out connected but seems the setup steals some good overhead causing frame corruption.
Regarding different ratios and stability around them. I put in some heavy testing around 2.35:1 ratio to get that working. Very likely room for improvements and my pragmatic approach fine tuning reg 6008, 7150 and 713c might hold a more stable math that I don't see but I can't calculate it. Yet.
For stable ratios 16:9 or other ratios I could look into suggestions, at least start off for further tweaking...
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: marcelo.lippi on March 20, 2019, 10:15:14 PM
I have not used other versions than Danne's. I'll try. However the Danne version seems to me to be of the highest quality result. I only try to find a minimum workflow to record a comfortable and safe way
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: AF-OFF on March 21, 2019, 03:53:25 AM
I have not used other versions than Danne's. I'll try. However the Danne version seems to me to be of the highest quality result. I only try to find a minimum workflow to record a comfortable and safe way
thanks marcello.& wish You luck, trying the nightly , experimental and dforts, even the old TL versions with, to check out Your pref. setup. sometimes also imagined the need to have another than the build IN screen for convenience or sheer necessity. f.E. indoors, having the cam on tripod 6 feet high, the wall behind, then you think, its impossible to check the picture without a ladder .
me too & all of us like Danne's and other Dev's effort and Knowledge to circumvent the crazy-ness of the cartel of the industries.
so more resolution what everybody wants and willingly pays for - we get for just a smile.

this is great and the question is, - how come, I don't help at all with this stuff, but I wish, that to become true, what I need right now, because this would be awesome. isn' it strange , how difficult (see  diffi - cult) it is, to help with something, one self wish to the heart? so what can we do about it, as non dev's.
I hope You check out Your setup with the other versions of ML which are at Your fingertips and if You don't mind report here Your findings.

@Danne - thanks for clarification in general, much appreciated.
@masc - thanks for the new MLV App !
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: IDA_ML on March 22, 2019, 12:52:50 PM
Pretty exciting new stuff on the EOS-M, congratulations Danne!  Any chance that the 100D receives an update too?  I would love to test, especially now that MLVApp v.1.6 handles this new HDR stuff so well.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on March 22, 2019, 03:41:33 PM
Not my 100D here but I think it handles hdr well already. Just set mv1080p_mv720p mode to 50fps and enable hdr from the usual place to enable iso switching. Maybe the mv720p 3x3 crop rec setting would be even better here.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: IDA_ML on March 22, 2019, 04:34:17 PM
Thanks a lot, Danne!  Can't wait to test!
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on March 23, 2019, 06:21:02 PM
New build:
https://www.magiclantern.fm/forum/index.php?topic=9741.msg208959#msg208959

Some bleeding edge stuff. Tested around some on my eosm. Also added for 100D(untested).
commit:
https://bitbucket.org/Dannephoto/magic-lantern/commits/cdbae199254873317ea7b665ee6f4d443bc7edc7

Please report how it works.

- Moved sd_uhs code into RAW video(mlv_lite) and erased sd_uhs.mo and the related lua script
- Refined eosm cinema 2:35.1 lua script(will enable sd_uhs in RAW video menu)

(https://www.magiclantern.fm/forum/proxy.php?request=https%3A%2F%2Fi.postimg.cc%2FnrtkThvs%2FVRAM0-PPM-scaled.png&hash=6f889c1bac0926d0057228929e4e4e58)

(https://www.magiclantern.fm/forum/proxy.php?request=https%3A%2F%2Fi.postimg.cc%2FkGFyHPcT%2FVRAM1-PPM-scaled.png&hash=7cb7294a849802e1936b9d1f7dc39be0)
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: ctfire on March 23, 2019, 07:10:42 PM
Just test the last build MCM mode 24fps 16:9  48fps - 12 and 10 bit 16:9 works perfect first time i get some corrupted frames , but then format card and try again and there was perfect footage. Also good idea to put sd hack into raw menu. Thanks again Danne
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: a1ex on March 23, 2019, 07:27:43 PM
Also good idea to put sd hack into raw menu.

Why? I'd use this option for still photos, too.

In my opinion, sd_uhs and MLV recording are very different things and should not stay in the same file.

@Danne: sorry to say, but you really need to make your commits atomic and readable. Otherwise, you'll end up with code nobody else can follow. OK, I can probably reverse engineer it, but that's not the point.

Some good reading material:
https://medium.com/@fagnerbrack/one-commit-one-change-3d10b10cebbf
https://hackernoon.com/what-makes-a-good-commit-message-995d23687ad
https://robots.thoughtbot.com/5-useful-tips-for-a-better-commit-message
https://chris.beams.io/posts/git-commit/
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on March 23, 2019, 07:36:55 PM
I'll have a look @alex. Thanks for links.
And yeah, good for stills and maybe even h264 recording(pushing fps override etc)
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: ctfire on March 24, 2019, 04:13:47 PM
Today retested the last build and unfortunally get corrupted frames in 48fps mode , not consistant but somwhere after 5 - 10  seconds after starting video/ in 16:9 and 2.35:1 aspect ratios and 12 or 10 bit.  Global Dwar off .

MCM mode works perfectly in all aspect ratios and bit depth
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on March 24, 2019, 07:03:32 PM
New build:
https://www.magiclantern.fm/forum/index.php?topic=9741.msg208959#msg208959

Commit:
https://bitbucket.org/Dannephoto/magic-lantern/commits/7ef1f2beaf21823431c8e6ac6cb18fca20f7b71a

- Moved sd_uhs.mo back into the game and erased the sd_uhs sub menu item in RAW video
- By enabling sd_uhs.mo the sd card gets patched upon start up bypassing any need for menu pushing on every start up
- Works for EOSM and 100D
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: shiva66 on March 26, 2019, 09:03:07 PM
Hi, I´m new to this forum and this buid of Magic Lantern and i love it!
But after the first clip my screen gets really weird, wrong aspect ratio and if I try to record some more movie I get an error and I have to re install the magic lantern before i can record some more.
Anyone else have this problem or mayby a fix for it?

Best regards.

Pontus
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Walter Schulz on March 26, 2019, 11:18:33 PM
Instead of reinstalling you may use
Prefs tab -> Config Options -> Restore ML defaults
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: stef7 on March 27, 2019, 02:22:17 PM
When using last version from 24th of March get always a message at the start:

Please enable sd_uhs module.

But this module is enabled. Somehow ML doesn't recognize it. Is somebody else getting this error or it's just me ?

Reverted back to the 14th of March version and there everything is OK. sd_uhs is recognized and started with the start of the camera.

Another small issue is with live view and custom ratios.

Using 2.5K 2520 1418 mode from crop_mode menu

With standard ratio of 2.35:1 set by the script in crop_mode menu, live view works correctly. Image is refreshed at slower rates and turns black and white when recording but presents a correct view of what will be recorder. This in my understanding and experience is how live view works in crop mode.

But my preferred ratio for video is 2:1. And in order to get it follow Danne's instructions in previous post:
   - 2.35:1 ratio in crop_mode is turned off
   - change the ratio to 2:1 and resolution 2400x1200 in RAW_video menu. 2520x1250 doesn't give me enough seconds of recording so I lower the resolution a bit

But at this point live view doesn't work as it was working when 2.35:1 ratio was set. It turns to x5 crop. So I see only a portion of the recorded image. Only when half pressing the shutter, then see the picture as it will be recorded - at lower fps and as it was when ratio is 2.35:1.

So my question is: Is this behavior by design ? And could it be made to work consistently across all ratios ?
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on March 27, 2019, 03:50:58 PM
Please enable sd_uhs module.
Seems to me you are still using the lua overclocking script. It´s not needed anymore. Simply enable sd_uhs module and it will patch when starting camera. If notplease send me your whole SETTINGS folder from inside ML folder on card root.

Ratio issue. Is your preview mode set to framing?
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: optical-work on March 27, 2019, 03:57:51 PM
But at this point live view doesn't work as it was working when 2.35:1 ratio was set. It turns to x5 crop. So I see only a portion of the recorded image. Only when half pressing the shutter, then see the picture as it will be recorded - at lower fps and as it was when ratio is 2.35:1.

entering canon menu might interfere with auto preview mode. in raw video menu set crop rec preview to "off" and preview to "framing".
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: stef7 on March 27, 2019, 05:07:27 PM
Thank you Danne and optical-work for the help! Setting preview to 'framing' indeed made live view work as wanted and expected.
Was not aware that lua script was not needed anymore. Formatted the card, installed ML latest version and message about sd_uhs is gone. Maybe there is an easier way to stop lua script but this one works too :)

Many thanks to Danne and others for the great work that made EOS M such a nice raw video camera ! 
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: darthivm on March 28, 2019, 12:49:17 PM
Hey guys, thank you for all your effort :)
I am following all the discussions here since half a year and the results so far have been great!

1) I am wondering how can i use dfort pixel maps for MLVApp 1.6. I recorded a video in 1280x1920 with 5k anamorphic (which will result in 3840x1920) and i am seeing focus pixels, how can i get rid of it. i know there are some focus pixel maps from dfort. i downloaded his whole repository and put my mlvapp in the directory of the *.fpm files. but i think there is none for this resolution. so what to do ?

2) i was wondering what is the difference in between the mcm mode and the mv1080 mode from before. somehow i forgot it and there is too much in the forum to find the explanation back again. Thanks ;)
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: masc on March 28, 2019, 01:09:06 PM
1)... i downloaded his whole repository and put my mlvapp in the directory of the *.fpm files. ...
Should work. Doesn't picture in viewer change when toggling the focus pixel buttons? Please send a short MLV...

2) i was wondering what is the difference in between the mcm mode and the mv1080 mode from before. somehow i forgot it and there is too much in the forum to find the explanation back again.
Main difference for the user is:
-mv1080: slow preview
-mv1080 mcm: real time preview
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: marcelolippi on March 30, 2019, 01:13:01 AM
 The march 24 version is amazing, I work in 4.5k continually, without problems... I don't change this version it's stable...THANKS DANNE!
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: 2blackbar on March 31, 2019, 01:58:18 AM
Hey guys is it possible to record mov files cropped  and save some cpu cycles?
I noticed i have less rolling shutter when im recording raw 2.35:1 compared to recroding 16:9 even in mov h264.
That pre recording crop for sure lets camera record faster when i use 2.35:1 so it doesnt have to sweat as much as when recording 16:9, so is it possible to record actual 2.35:1 to h264 mov files ? That improves rolling shutter and would be worthy from what i see.
What do You guys think ?
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Teamsleepkid on March 31, 2019, 11:10:07 AM
I think h.264 looks like crap so why bother?
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: ricardopt on March 31, 2019, 01:31:38 PM
Hey guys is it possible to record mov files cropped  and save some cpu cycles?
I noticed i have less rolling shutter when im recording raw 2.35:1 compared to recroding 16:9 even in mov h264.
That pre recording crop for sure lets camera record faster when i use 2.35:1 so it doesnt have to sweat as much as when recording 16:9, so is it possible to record actual 2.35:1 to h264 mov files ? That improves rolling shutter and would be worthy from what i see.
What do You guys think ?

If that is possible it would be a nice addition to the magic lantern features, i think everyone in the past has cropped 16:9 mp4 video to 2:35 aspect ratio, if magic lantern could do 2:35 native mp4, the bitrate distribution/video quality would be better on 2:35 video since no bitrate is wasted on "future" cropped areas, only used on actual video.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Walter Schulz on March 31, 2019, 01:38:18 PM
if magic lantern could do 2:35 native mp4, the bitrate distribution/video quality would be better on 2:35 video since no bitrate is wasted on "future" cropped areas,

I don't think it works this way. Do you have some data backing up your opinion?
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: ricardopt on March 31, 2019, 01:51:12 PM
Hi Walter.

1 situation - using EOS M and record a 16:9 (1920x1080) mp4 and crop it to 2:35 for whatever/cinematic reason.
2 situation - using EOS M to record a true 2:35 (1920x817) mp4 video

since the actual picture dimensions of a 2:35 video is smaller than a 16:9 video the video bitrate efficiency would be better and in theory should have better quality since no bitrate is wasted, lets say that the eosm records at 30mb/s using h264, the quality on the true 2:35 would be better than a 16:9 cropped to 2:35 using the same bitrate.

Since 2:35 is using 263 less height pixels the bitrate used on those (top and bottom)  in situation 1 IS wasted if you are cropping.

Im not a pro but i think i understand a little of the basics, sorry for any confusion...lets imagine that the EOS M has a 16:9 and 2:35 modes using h264, both use 30mb/s for video bitrate, if we crop the 16:9 to 2:35 and compare its quality to the 2:35 version we could see that the 2:35 has better quality, better bitrate efficiency.

but i could be completely wrong...this is my opinion based on what i learned reading several video forums over the years.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: 2blackbar on March 31, 2019, 03:04:30 PM
Good questions...
- i cant preview mlv in camera smoothly or i dont know how im using raw since a couple of days.
- filesize , raw is about 3 times , sometimes i dont need so much freedom to color correct as much i try to get good image in camera so im recording 10bit losless.
- mostly i would like better rolling shutter and its definitely better when recording raw.
I actually record raw but im curious is it possible to do the same thing with canon's h.264 mov files and get rolling shutter improvement like when filming raw.
If not possible then fine.
Anyone knows whats good enough card to get 1080p in raw recording on M , 14 bit with continuous, so i dont have to worry about anything?
Not the best card, just good enough.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: ricardopt on March 31, 2019, 03:20:46 PM
I'm using a Kingston 64Gb (Canvas go!)
https://www.amazon.com/Kingston-Canvas-32GB-Memory-SDG/dp/B079SQBCWF?th=1

continuous recording at 1736x976 14bit, fills up the card in 30minutes.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: 2blackbar on March 31, 2019, 05:27:37 PM
Thanks ! After correcting a few shots i did today with RAW i just realized, im not coming back to h.264, it just doesnt make sense and ill just get better SD card.
With some shots i could not believe RAW is that good, i thought i had another shot underexposed to preserve highlights but its almost like magic, the amount of highlights you can restore with raw is like a miracle to me.
Sorry for dumb question with h.264... now it feels almost insulting to bring h.264 suggestions in here.I love RAW.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: jetrotal on March 31, 2019, 07:00:12 PM
Hey, i'm testing out the Raw recording for the eosm, i have some newbie questions:

1 - Does the MLV file comes with the Picture Style grading?

2 - Should the MLV footage be darker than the live view output?
I can't ever recover the exposure when i record it at 10bit color range.

Thanks in advance
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: gravitatemediagroup on March 31, 2019, 08:31:56 PM
I don't want this to come across as advertising, because this ain't that. lol
but if anybody has any "noob or newbie" questions, the facebook group I started may be a better place to ask "getting started" type questions instead of the development thread.  There are also several videos people have shared of what they've shot with the M and I'm sure there are more on the way.  Any and all are welcome :) if not allowed, delete. 

https://www.facebook.com/groups/375018026655820/?ref=group_header
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: baris3 on April 02, 2019, 09:07:56 AM
New build:
https://www.magiclantern.fm/forum/index.php?topic=9741.msg208959#msg208959

Commit:
https://bitbucket.org/Dannephoto/magic-lantern/commits/7ef1f2beaf21823431c8e6ac6cb18fca20f7b71a

- Moved sd_uhs.mo back into the game and erased the sd_uhs sub menu item in RAW video
- By enabling sd_uhs.mo the sd card gets patched upon start up bypassing any need for menu pushing on every start up
- Works for EOSM and 100D

Hello,

I am new to the magic lantern and I purchased my M50 2 months ago, so I decided to give ML a try on my EOS M. My main purpose is record 4k video (not raw).

I have downloaded the nigthly build first and there was no 4k record option.

Then I have found your latest release on this thread with 2.35:1 script and downloaded it, installed it on camera.

I have set the resolution to 4k, 2.5k etc with 2.35:1 ratio and,

I recorded short videos and when I look them up on the computer, the resolution is 1920x1088.

What am I doing wrong ? I just want to record normal 4k video with 2.35:1, is it possible ? Or do I need to shoot raw and enable the RAW modules ?

Can you help me ?


Thanks.

EDIT: I have loaded the RAW recording module. But when I select 4k it says it does not support more than 1800 resolution and when I try to record it that way recording stops, liveview brokes. *turns pink. Also the liveview occasionally turns pink and can be only fixed by restarting the camera. Is it because I press the half shutter button to go back into live view mode ? How to go back to liveview mode from ML menu without pressing the half shutter ?

I do not even need raw 4k 2.5k normal video should be fine but I can not record.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: marcelo.lippi on April 02, 2019, 11:44:13 AM

I would like to take a zoom c mount 12.5 75 and ask you if with resolution 4.5k it will produce vignettes. I can't figure out which size of sensor it uses. Thank you
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: 2blackbar on April 02, 2019, 04:58:32 PM
baris3 you need at least 45mb write speed card, usually it comes with 90mb read speed but not always, i have one it was recommended to me a few posts before yours, works great and i can record at 2520x1418 as maximum size.
I had 10mb speed sdhc card class10 and i could record 11bit lossless  raw in cinemascope 2.35:1 for 20 seconds which is quite good considering 10mb speed.It was 1768xsomething
You cant record above 1080p without using raw, if you want to record something else than canon 1080p files you have to use raw.
marcelo with some c lenses you get soft corners in 3x3 crop mode, there are some tests on youtubes with c mount raw which look great but jey probably use 5x5 crop
In worst case scenario you will sell the camera if you wont like it.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: baris3 on April 02, 2019, 06:53:57 PM
baris3 you need at least 45mb write speed card, usually it comes with 90mb read speed but not always, i have one it was recommended to me a few posts before yours, works great and i can record at 2520x1418 as maximum size.
I had 10mb speed sdhc card class10 and i could record 11bit lossless  raw in cinemascope 2.35:1 for 20 seconds which is quite good considering 10mb speed.It was 1768xsomething
You cant record above 1080p without using raw, if you want to record something else than canon 1080p files you have to use raw.
marcelo with some c lenses you get soft corners in 3x3 crop mode, there are some tests on youtubes with c mount raw which look great but jey probably use 5x5 crop
In worst case scenario you will sell the camera if you wont like it.

I own this original M back from 2014. I have 18-55 and 22mm f2 lens for it. I do not know if the dynamic video stabilization works while using magic lantern though. Because 18-55 lens have dynamic IS specifially for video mode (dynamic IS is a video thing not photography and only this lens have it).

My problem is, today I have tried recording something and I could not record more than 5 seconds. And what I am trying to record is mv1080. Not even 2.5k or something like that. It says "early stop, should have recorded more frames". Also, I can not set 2.5k, 4k because it says this crop mode does not support more than 1700x resolution, it says it only works in 5x zoom mode. And I do not know how to change the crop mode. I have tried to access every setting but I could not find how to set 3x3 crop mode. I have only found a thing like 3x zoom or something like that and I do not get what it does.

For the card, I have Sandisk Ultra 32gb. My fastest cards might be samsung microSDXC's mounted on SD adapter, I will give them a try. And I have tried both card overclock module on or off.

But all I want is record 10 bit or 12 bit mv1080 video. More bits mean more colors and quality right ? I have shoot projects on EOS M and canon 1080p is not that bad but I want more quality like a small cinema camera.

Also, the magic lantern stats (overlay) when shooting video have dissappeared. Now it is back to normal canon video shooting overlay. I tried resetting the config but it is still the same.

Can someone help me ? If I can not get it working in 1080p 10 bit, I am going to record without magic lantern.

Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: baris3 on April 02, 2019, 06:55:20 PM
I own this original M back from 2014. I have 18-55 and 22mm f2 lens for it. I do not know if the dynamic video stabilization works while using magic lantern though. Because 18-55 lens have dynamic IS specifially for video mode (dynamic IS is a video thing not photography and only this lens have it). However as the autofocus on M is very bad, I am using a 1.4 50mm FD Canon lens on it via FD-M adapter. I think it will be good for video because that lens should have special coating compared to todays basic canon standart lenses.

My problem is, today I have tried recording something and I could not record more than 5 seconds. And what I am trying to record is mv1080. Not even 2.5k or something like that. It says "early stop, should have recorded more frames". Also, I can not set 2.5k, 4k because it says this crop mode does not support more than 1700x resolution, it says it only works in 5x zoom mode. And I do not know how to change the crop mode. I have tried to access every setting but I could not find how to set 3x3 crop mode. I have only found a thing like 3x zoom or something like that and I do not get what it does.

For the card, I have Sandisk Ultra 32gb. My fastest cards might be samsung microSDXC's mounted on SD adapter, I will give them a try. And I have tried both card overclock module on or off.

But all I want is record 10 bit or 12 bit mv1080 video. More bits mean more colors and quality right ? I have shoot projects on EOS M and canon 1080p is not that bad but I want more quality like a small cinema camera.

Also, the magic lantern stats (overlay) when shooting video have dissappeared. Now it is back to normal canon video shooting overlay. I tried resetting the config but it is still the same.

Can someone help me ? If I can not get it working in 1080p 10 bit, I am going to record without magic lantern.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: 2blackbar on April 02, 2019, 08:45:03 PM
There are tutorials on youtube, start simple, enable just mlvlite,mlvsound and nothing more, remember to use fps override with raw recording.
If your card is at least 10mb writing speed then you can record raw at 1768x444 , its cinemascope ratio, about 20 seconds will be saved, its not much but definitely useable even on such slow cards.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: baris3 on April 02, 2019, 10:13:20 PM
There are tutorials on youtube, start simple, enable just mlvlite,mlvsound and nothing more, remember to use fps override with raw recording.
If your card is at least 10mb writing speed then you can record raw at 1768x444 , its cinemascope ratio, about 20 seconds will be saved, its not much but definitely useable even on such slow cards.

https://www.amazon.com/SanDisk-Ultra-Class-Memory-SDSDUNC-032G-GN6IN/dp/B0143RT8OY

my card is that. I need to record more than 1 minute and I want it 1080p 10 bit or 12 bit. Possible ?

I have already tried all the ways, I loaded less modules and tried different ratios. I want 2.35 anyway.

Help me I don t know what to do
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Walter Schulz on April 02, 2019, 10:25:36 PM
You may want to benchmark this card. Either use card in cam with recent nightly build (Modules tab -> Bench.mo ON -> Restart -> Debug tab -> Benchmarks -> Card Benchmarks -> Quick R/W benchmark (1 min)) or a decent cardreader. According to https://www.cameramemoryspeed.com/reviews/sd-cards/ this card may do anything betwenn 19 and about 55 MByte/s in write mode and that's quite a difference!
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on April 02, 2019, 10:41:44 PM
Restore ml settings to zero by erasing config file or redownload a new version and start fresh.
Then enable:
Sd_uhs.mo
Mlv_lite.mo
Mlv_snd.mo
Lua.mo
Croprec.mo

Restart cam. It should then throw you right into mv1080p mcm rewired mode. Movie crop mode should already be activated.
If you have little or no clue of what's going on please start reading from the download post and do deep testing of presets. Give it a few weeks or more.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: AF-OFF on April 02, 2019, 11:09:13 PM
I would recommend also to format card in cam either after step one (delete ML config) or with step two (enable modules).

 
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: AF-OFF on April 02, 2019, 11:28:57 PM
I would like to take a zoom c mount 12.5 75 and ask you if with resolution 4.5k it will produce vignettes. I can't figure out which size of sensor it uses. Thank you
my post 2445 -I've found a good res that works for me - 1024x1728, records a clean video continuous and suitable for mount-c glass

depends also which aspect ratio You use. wider formats more horizontal resolution
best, try for yourself

btw. whats up with hdmi-setup of Your's?
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: 2blackbar on April 02, 2019, 11:30:56 PM
baris after reading some comments on your card i suspect its about 20MB writing speed, it should be fine for 11 bits raw lossless but i recommend buying faster one, i have 45mb writing speed and i can record 5k anamorphic raw mode , i can record 1504x1920 then after stretch its 4512x1920 :o
This is magical! I feel even dumber for asking about h.264 :D
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: baris3 on April 03, 2019, 02:08:03 AM
baris after reading some comments on your card i suspect its about 20MB writing speed, it should be fine for 11 bits raw lossless but i recommend buying faster one, i have 45mb writing speed and i can record 5k anamorphic raw mode , i can record 1504x1920 then after stretch its 4512x1920 :o
This is magical! I feel even dumber for asking about h.264 :D
Guys is there a way to always get 1/48 shutter in 23.976 ? Or 180degree, you know like film camera, currently i can get 1/45 and 1/50 and im not sure how to get it to 48.
I remember long time ago there was setting in fps override to get 180degree shutter according to the fps, it was removed ?

Thanks for all the answers. I made a fresh start as Danne advised me and used this card with adapter:
https://www.amazon.com/SanDisk-Extreme-microSDHC-UHS-3-SDSQXAF-032G-GN6MA/dp/B06XWMQ81P/ref=sr_1_3?keywords=SanDisk+Extreme+32GB+microSDXC&qid=1554244329&s=electronics&sr=1-3

It worked, mv1080 mcm rewired 12 bit mode. I was able to record 1 min long clip. But what does that MCM rewired means ? I do not know. The shooting modes confuses me because there are so many. I have tried to select 4k, but it did not let me. It says it only works in 5x zoom mode. However I could not go into 5x zoom mode because I do not know how to do so. Then I selected 2.5k 1:1 mode and from there accidetally I was able to set 4k 5x mode. I can only set 3x zoom mode. And I turn it off because I believe it uses less sensor area in that mode. I have also tried different bitrates like 14bit canon uncompressed and I could only record for seconds with very bad quality and noise.

How can I record 4k ? If it crops too much or lowers the quality because of the sensor area, I can go with the 5k anamorphic option (if I can record of course because my card can limit me). But I have no idea how to turn that (stretch) into real 4k resolution in post. I have played with MLV app and I have found it great because I was able to set the correct white balance. And there was dead pixels, I selected forced, aggressive search and they were gone in the export. Is it possible to record without dead pixels at all ? However, there is a spider-like shaped transparent area in the middle and I have noticed it during focus change because it becomes prominent at that time. I think it disappeared on the prores export too but I do not remember selecting an option to clear it, what is that area ?
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: nlantz on April 03, 2019, 02:34:31 AM
Hey all, we have some chatter on our facebook group about the March 29 rewire working well with external monitors. Anyone know if this is the case? I gave it a quick shot but still have occasional corrupt frames.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: 2blackbar on April 03, 2019, 02:35:18 AM
i think rewire means you record entire screen of the camera, not just 16:9.
For 4.5K follow this :
I use mv1080p and then crop.This creates moire/aliasing free footage much more details than mov h264 and colours you never suspected this camera could capture.
I have some issues sometimes in most recent build and mv1080p, shutter speeds cant go below 70 , cant get 1/50, not sure yet whats triggering it.Also sometimes shutter jums back to previous values by itself, i change 50 to 53,58 and it goes back to 50 after 2 seconds.
Guys is there a way to always get 1/48 shutter in 23.976 ? Or 180degree, you know like film camera, currently i can get 1/45 and 1/50 and im not sure how to get it to 48.
I remember long time ago there was setting in fps override to get 180degree shutter according to the fps, it was removed ?
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: baris3 on April 03, 2019, 08:19:59 AM
i think rewire means you record entire screen of the camera, not just 16:9.
For 4.5K follow this :
I use mv1080p and then crop.This creates moire/aliasing free footage much more details than mov h264 and colours you never suspected this camera could capture.
I have some issues sometimes in most recent build and mv1080p, shutter speeds cant go below 70 , cant get 1/50, not sure yet whats triggering it.Also sometimes shutter jums back to previous values by itself, i change 50 to 53,58 and it goes back to 50 after 2 seconds.
Guys is there a way to always get 1/48 shutter in 23.976 ? Or 180degree, you know like film camera, currently i can get 1/45 and 1/50 and im not sure how to get it to 48.
I remember long time ago there was setting in fps override to get 180degree shutter according to the fps, it was removed ?

I have tried recording all night and I have only one video which looks 4k to me. It was a short clip and it's resolution is 4464x1900. I have tried several after that but their resolution did not go up to 4464x1900 in MLV app. And those recordings were all very noisy.

Also cropped recording module only runs for 1 shooting and then crashes. By crashing I mean it turns off itself and I have to restart the camera.

I do not know what I am doing wrong. I was able to record and export a 4464x1900 footage but now I can not do it. What do you suggest ?
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on April 03, 2019, 09:40:41 AM
You really should get more familiar with quirks and workflows already described and discussed before. With that said. One quirk with all x5 modes is that you sometimes get kicked out and back into x1 mode. When that happens open up magic lantern menu and then go out of it and the preset should update back into x5 mode.
Another quirk is mcm rewired mode. Since that one is starting point when enabling modules it will enable both Movie crop mode and crop mode setting for this round trip to work. However. When selecting another preset you need to do following:
1 - Select the new preset
2 - Push canon menu button and go back
3 - Push magic lantern menu button(trash can) and go back.
After this the new preset should work.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: baris3 on April 03, 2019, 10:01:53 AM
You really should get more familiar with quirks and workflows already described and discussed before. With that said. One quirk with all x5 modes is that you sometimes get kicked out and back into x1 mode. When that happens open up magic lantern menu and then go out of it and the preset should update back into x5 mode.
Another quirk is mcm rewired mode. Since that one is starting point when enabling modules it will enable both Movie crop mode and crop mode setting for this round trip to work. However. When selecting another preset you need to do following:
1 - Select the new preset
2 - Push canon menu button and go back
3 - Push magic lantern menu button(trash can) and go back.
After this the new preset should work.

Yes, I have realized that the hard way. Thank you for confirming. I still do not know exactly what to do for entering in to x5 mode :)

Now I recorded a video in 5k anomorphic preset using 16:9 and 2.35:1, the file MLV app exported is 3552x1510 resolution. The exported video seems fine at first but it starts to skip frames after 40 seconds and at 1 minute there is pink bad frame occurs. I have finished recording by myself though.

What I can't remember is how I did the recording of the exported 4464x1900 resolution file. Because I was trying many presets I do not remember but all I know is that video is error free and has more resolution than 4k. 


I did this but it does not give 4464x1900 when stretched. And if I increase the resolution more than in the video, recording stops.

What do you guys think ? How would I record the 4464x1900 exported video ?

Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: geroinnn on April 03, 2019, 10:06:47 AM
Hey all, we have some chatter on our facebook group about the March 29 rewire working well with external monitors. Anyone know if this is the case? I gave it a quick shot but still have occasional corrupt frames.
Hi!
Yep, a few days ago I tried to connect my computer monitor and recorded video in different resolutions, I still received broken frames, but they were much smaller!
Now I shot a video for one minute and did not find a single broken frame! I use the following settings:
1080p MCM, 25 FPS, 16:9, 1736:976, 10-BIT.
I don’t know if Dunn has done anything with the HDMI, but it looks great. But you need more tests!

P.S. monitor resolution during the tests was 1920x1080
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: 2blackbar on April 03, 2019, 06:05:38 PM
Any idea how to avoid half pink frames with raw mv1080 ? Or the only way is to reshoot, i can actually see when theyre goin to happen because screen flickers in a certain way.
I did some diggin on forums and found out histogram might be the cause and overall ML overlay so its best to disable them during raw record, ill check this.Some other guys said that framing preview during recording causes this.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: baris3 on April 03, 2019, 09:51:48 PM
Any idea how to avoid half pink frames with raw mv1080 ? Or the only way is to reshoot, i can actually see when theyre goin to happen because screen flickers in a certain way.
I did some diggin on forums and found out histogram might be the cause and overall ML overlay so its best to disable them during raw record, ill check this.Some other guys said that framing preview during recording causes this.

I have m50 anyway. I can shoot 4k with manual focus with it. My purpose was to get a good resolution raw video from my original EOS M. But now I see magic lantern is problematic and it gives half pink frames, even on mv1080 like you said. However I have not encountered any pink frames in my mv1080p clips, but I think it is because I have not recorded that much mv1080.

Other than that I do not see why I would use Magic lantern on my eos m, it is not stable and just adds to work flow. Yes 12 bit recording is good and captures so much data about colours but not good when it randomly gives half pink frames.

Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: 2blackbar on April 03, 2019, 10:52:50 PM
I used mlv lite before croprec and it doesnt gave me even one pink frame with histogram onscreen, is it possible to merge it with croprec ? From what i see croprec is using rawrec 2.0 and mlv lite is faster for a lot of guys.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: baris3 on April 04, 2019, 12:38:32 AM
I used mlv lite before croprec and it doesnt gave me even one pink frame with histogram onscreen, is it possible to merge it with croprec ? From what i see croprec is using rawrec 2.0 and mlv lite is faster for a lot of guys.

What is the the advantage of croprec ? Can I record 4k without crop rec ? I do not think so, no ?
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on April 04, 2019, 01:28:18 AM
Guys. I don´t know fully what´s going on but clearly I hear a lot of complaints about pink frames and what not. Either you start helping out uploading sample files, explaining specific settings, and I mean exact settings, or nothing but zip will come out of this. Magic lantern is simply not for everyone.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: gravitatemediagroup on April 04, 2019, 01:58:35 AM
which build is being complained about?  I've not shot a ton with the latest, but I've not seen any anything unusual yet.  I also try and stick with the settings I know are stable with my card.  I have a feeling, most of the people complaining are more than likely trying to run settings their card can't handle. 
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: baris3 on April 04, 2019, 02:10:10 AM
which build is being complained about?  I've not shot a ton with the latest, but I've not seen any anything unusual yet.  I also try and stick with the settings I know are stable with my card.  I have a feeling, most of the people complaining are more than likely trying to run settings their card can't handle.

Do you know which cards required to record 4k ? I am complaining about the this latest build, I am new to ML and I thought I could record clean 4k footage with my original M after all this years.

crop_rec_4k_mlv_snd_isogain_1x3_presets_2019Mar29.EOSM202
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: gravitatemediagroup on April 04, 2019, 02:16:42 AM
Do you know which cards required to record 4k ? I am complaining about the this latest build, I am new to ML and I thought I could record clean 4k footage with my original M after all this years.

crop_rec_4k_mlv_snd_isogain_1x3_presets_2019Mar29.EOSM202

which card are you using? everything it says on the front, or just take a pic of it.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: baris3 on April 04, 2019, 02:43:37 AM
which card are you using? everything it says on the front, or just take a pic of it.

https://www.amazon.com/SanDisk-Extreme-microSDHC-UHS-3-SDSQXAF-032G-GN6MA/dp/B06XWMQ81P/ref=sr_1_3?keywords=SanDisk+Extreme+32GB+microSDXC&qid=1554244329&s=electronics&sr=1-3

This is the card I am using.

I just can not record 4k resolution without lower half pink frame after 1 min, and it starts to skip frames after 40 seconds or so. I am using 5k anamorphic mode and I tweak the settings to 16:9 in croprec and 2.35:1 in 5k anamorphic settings, then max the resolution which equals to 3500x1500 when strectched. I was able to record 4464x1900 resolution (when strecthed) but now I can not achieve it again and I do not remember which mode I have used to record it.

Which mode is best for recording 4k ?
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: gravitatemediagroup on April 04, 2019, 04:00:11 AM
https://www.amazon.com/SanDisk-Extreme-microSDHC-UHS-3-SDSQXAF-032G-GN6MA/dp/B06XWMQ81P/ref=sr_1_3?keywords=SanDisk+Extreme+32GB+microSDXC&qid=1554244329&s=electronics&sr=1-3

This is the card I am using.

I just can not record 4k resolution without lower half pink frame after 1 min, and it starts to skip frames after 40 seconds or so. I am using 5k anamorphic mode and I tweak the settings to 16:9 in croprec and 2.35:1 in 5k anamorphic settings, then max the resolution which equals to 3500x1500 when strectched. I was able to record 4464x1900 resolution (when strecthed) but now I can not achieve it again and I do not remember which mode I have used to record it.

Which mode is best for recording 4k ?

I'm not sure if using a microSD, especially one of that speed, will be able handle what you're trying to throw at it, especially depending on what other settings you have set within ML.  I think most people use the ExtremePro 95MBs cards, wheras I think your card is 30MBs.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: baris3 on April 04, 2019, 05:38:01 AM
I'm not sure if using a microSD, especially one of that speed, will be able handle what you're trying to throw at it, especially depending on what other settings you have set within ML.  I think most people use the ExtremePro 95MBs cards, wheras I think your card is 30MBs.

Can you send me samples of what you shoot ?

This card can record 4k in EOS m50, though I know it is 8 bit. I do not understand why it would not record 40 mb/s data in ML eos m.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: gravitatemediagroup on April 04, 2019, 06:00:11 AM
Can you send me samples of what you shoot ?

This card can record 4k in EOS m50, though I know it is 8 bit. I do not understand why it would not record 40 mb/s data in ML eos m.

HUGE difference in 8bit 4k and RAW.  A completely different beast, it's pretty much the purpose of ML. 
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: marcelolippi on April 04, 2019, 08:45:58 AM
I used all Danne builds from February until March 24th. I was able to continuously record the build on March 24th, shooting the two sd luas and 2.35 cinemas, in 4.5k. Proved that if I cast two or three recordings the pink frames occur but then in the next recording stabilizes and stops making them. This is my card
(https://www.magiclantern.fm/forum/proxy.php?request=https%3A%2F%2Fi.ibb.co%2FF8BcCRY%2FScreenshot-20190404-083305.jpg&hash=051a6bdf4a99b413a3a3c87d4be2f844) (https://ibb.co/F8BcCRY)

hosting gif (https://it.imgbb.com/)
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on April 04, 2019, 08:57:12 AM
Seems that card will be able to do write speed of 60mb/s while smaller than 64gb will do max 40mb/s:
https://www.cameramemoryspeed.com/reviews/sd-cards/sandisk-extreme-90mbs-64gb-sdhc-memory-card/

To be sure one needs to benchmark the card. There are modules for this created by a1ex. Simply use another build and run the benchmark tests. Search on the forum how to do the tests correctly.
One way to test is by filming. If youre card reaches around 53 to 55 mb/s while recording 5k anamorphic 2.35:1 it´s probably ok to use. If not, reconsider getting a faster card. The only card I use that I know reliably works is the extreme pro version but others might find other brands or cards.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: baris3 on April 04, 2019, 10:11:26 AM
Seems that card will be able to do write speed of 60mb/s while smaller than 64gb will do max 40mb/s:
https://www.cameramemoryspeed.com/reviews/sd-cards/sandisk-extreme-90mbs-64gb-sdhc-memory-card/

To be sure one needs to benchmark the card. There are modules for this created by a1ex. Simply use another build and run the benchmark tests. Search on the forum how to do the tests correctly.
One way to test is by filming. If youre card reaches around 53 to 55 mb/s while recording 5k anamorphic 2.35:1 it´s probably ok to use. If not, reconsider getting a faster card. The only card I use that I know reliably works is the extreme pro version but others might find other brands or cards.

https://www.cameramemoryspeed.com/reviews/sd-cards/sandisk-extreme-90mbs-u3-v30-32gb-microsdhc-memory-card/

The card I am using is that one. It says it easily reached 60 mb/s and even exceeds it. I will benchmark the card while shooting. I want to shoot exported 4464x1900 resolution, I have a clip like that but it is only 3 seconds. I do not remember if I stopped the recording or not, but I do not remember the settings I recorded for that clip so I dont have an idea how to do it again. Does auto stop recordings save to card ? I mean, when it becomes red it only records for 1 sec or so and automagically stops recording.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on April 04, 2019, 10:24:05 AM
There´s two ways to find out what is pratical to use when it comes to recording and what works or not

1 - Start reading from here and check all posts:
https://www.magiclantern.fm/forum/index.php?topic=9741.msg208959#msg208959

2 - Short answer. Install magic lantern and run the cinema 2:35.1 lua script. By doing this you will get right into this preset:
5K anamorphic but it will run in 2.35:1 ratio and continuous. The new ratio will be:
1488x1900 Which when imported into Mlv App will upscale to magical, tada:

4464x1920

The other highres presets simply won´t work with full fps(24fps or 25fps that is) but with reduced fps.
Please. Before posting further do go through all posts starting from the provided link above.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: ctfire on April 04, 2019, 02:12:02 PM

(https://www.magiclantern.fm/forum/proxy.php?request=https%3A%2F%2Fi.ibb.co%2F0ZxvW4h%2F111.jpg&hash=d169452e60ade246238428e67de81fbd) (https://ibb.co/0ZxvW4h)

(https://www.magiclantern.fm/forum/proxy.php?request=https%3A%2F%2Fi.ibb.co%2FX834TV2%2Fphoto-2019-04-02-11-30-27.jpg&hash=683355008cd876c728caba26ff00467f) (https://ibb.co/X834TV2)

hi everyone , today tasted the latest build and notice some strange dots line in bottom of the frame in 2.35 : 1 45\48 fps mode 10 bit . It's very simmilar  to focus pixel dots.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on April 04, 2019, 02:20:57 PM
Maybe it´s focus dots then? Tested chroma smooth 3x3? Tested dfort pixel map files and put them into Mlv App?
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: dfort on April 04, 2019, 06:32:38 PM
Yes, those are focus pixels.

When the pixels are too close to the edges of the image the interpolation algorithm can't handle it because there are not enough pixels to sample. Adding more chroma smoothing or the "median filter" in dcraw won't help. (https://www.magiclantern.fm/forum/index.php?topic=16054.msg195932#msg195932) One way around this is to crop out a few pixels in post. You need to resize anyway if you are working on a standard HD or UHD project. Another way around this is to try a larger image size. Yes, larger because the focus pixels at the edges of the sensor usually don't light up.

Here is an image of the full frame buffer showing the out of bounds area in dark grey and the focus pixels on the active area.

(https://www.magiclantern.fm/forum/proxy.php?request=https%3A%2F%2Ffarm5.staticflickr.com%2F4487%2F37257348780_bcb3d65171_c.jpg&hash=b954d39c2aa8836fc60389878afc8824)
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: 2blackbar on April 04, 2019, 08:42:09 PM
Guys is it possible to hide only histogram when recording raw and making it appear autimatically when not recording ? That would be super useful.
Or display only camera passepartout when recording raw for chosen aspect ratio to save as much cpu cycles as possible without disabling overlays completely.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: baladev on April 05, 2019, 04:33:10 PM
I've just finished smoking this thread starting from page 70. First of all I would like to thank Danne, dfort and many others who helped testing releases and iron out the bugs. It is absolutely incredible what you guys have achieved here. I used to be a Sony guy with 3 Sony bodies and only one Canon (6D), but because of ML and mainly the video raw capabilities that have opened up to us recently I now have 5 Canon bodies (withing a month I purchased a 5Dm3 and 3 x EOS M). Raw video is so addictive.

Now, while I've been reading the thread and came across many 'bug' reports, I felt that possibly?? some/many of them could be related to the cards people are using (which is possibly the reason why they couldn't be reproduced by Danne). For raw filming I personally use Sandisk Extreme Pro cards exclusively and have come across very few glitches with ML on my 6D or EOS M and they have been the same - I routinely get one or two corrupted frames at the very beginning of my takes  with the rest of the footage being fine. Since we 'overclock' the interface, making it write faster than Canon wanted us to, maybe it's crucial to use the highest quality cards.

I only have limited experience with EOS M - so far I've been using the old Nightly.2018Aug07.EOSM202_mv1080p build because it gave me a quick access to full sensor 1736x976 mode which I used for filming two music clips last weekend and a few test takes in the last two weeks. I wanted to read the thread and get up to speed with all the new development that took place after July last year before installing the latest build, which is what I'm going to do now and dive into all the new stuff.

I hope to be useful to the community that has given me so much and give back something. Would there be any interest if I shared my experience with different raw processing workflows?

baris3 - if all you want is trouble free 4K footage and don't care/don't understand/don't need RAW and just want higher resolution videos - I would suggest you stick with M50 and 4K video it can produce. RAW video, especially using ML is much more involved, especially if you want to push it to extract every bit of detail/color information out of it. Do you shoot raw photos or jpgs? If you shoot raw and understand what advantages it gives then you can understand the advantages of raw video - it's the same. However if you take jpg pictures and are happy with them, raw post processing workflow will be overwhelming for you. I can record only about 27 minutes of 1736x976 14bit raw onto my 64Gb card (are you ready for HUGE files?) If you increase these dimensions by a factor of two (which is close to what you will get when approaching 4K anamorphic), that's 4 times more information, so a 64Gb card would be able to hold only about 7min of recording (a bit more if you record 10bit). Do you want/need that?
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on April 05, 2019, 06:02:40 PM
Great baladev :)
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: 2blackbar on April 06, 2019, 10:34:38 AM
Found a bug with dots appearing on footage in most recent build:
(https://www.magiclantern.fm/forum/proxy.php?request=http%3A%2F%2Fpicplus.ru%2Fimg%2F1904%2F06%2Fd219b005.jpg&hash=e46fc1022417c1e49907f8ba2c6a2f99)
It happens when i use aspect ratio 2.35:1 from croprec menu or 16:9 and if i turn aspect ratio off then dots disappear but then i have serious problem with shutter speeds and cant get lower than 70 cause it loops back to 4000.
mv1080p 1736x1158 mode.not see it on rewire mode.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on April 06, 2019, 10:44:10 AM
Known already. And solved too. Use search function or read through the posts I pointed to way too many times already.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: 2blackbar on April 06, 2019, 03:39:50 PM
YEah i have dfort pixel map files in folder with mlvapp but it doesnt help when i press buttons in fix focus dots.OR do i need to do something more?
Its resolution 1736x738 and i dont see this resolution in focus maps scripts folder.Does anyone has that ? How to generate it ?
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on April 06, 2019, 03:51:00 PM
Good. Also upload a small mlv sample file with the issue in question.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: 2blackbar on April 06, 2019, 04:38:43 PM
Yeah i did, im looking for some info how to do focus pixels map myself so i dont have to bother him.
Found something here  https://www.magiclantern.fm/forum/index.php?topic=16054.msg207474#msg207474
and posting for myself later mlvdump with gui to work faster https://www.magiclantern.fm/forum/index.php?topic=19460.0
aaand dcraw gui http://meguidcraw.blogspot.com/2009/07/descarga-download.html
Well, it appears that 1808x1108 focus pixel map is for my particular file but it still doesnt work, is there any way to fix this in cam? I can clearly see focus dots disappear for hal second when i exit ML menu so it(disabling focus pixels) is something thats already being done by ML with menu exit function.Why not making it a feature to turn on/off for manual focus lenses?
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Dutchflyingpilot on April 06, 2019, 09:25:39 PM
I noticed when using MCM Rewire the HDMI 480 (lo-res) output stopped functioning (I use a Feelworld 4k monitor).
HDMI 1080 works just fine, so no problem there, but you loose Magic Zoom and that's a pitty I think.
Focusing is much harder now. Is there a fix?
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: 2blackbar on April 07, 2019, 04:22:25 PM
Danne is there any way that i could get different pattern of focus pixels so MLVapp would be able to remove them ?
The ones i currently have are having some issues:
https://www.magiclantern.fm/forum/index.php?topic=16054.new#new
Id rather change something in camera in the future so it would be possible to remove my focus pixels, i also by accident got different patern of focus pixels in ML, it was something like this but i cant turn it on again:
(https://www.magiclantern.fm/forum/proxy.php?request=https%3A%2F%2Ffarm8.staticflickr.com%2F7874%2F47280353381_4bfdfa9f23.jpg&hash=9fba65182d1730cef7c2e5e27f6045a5)
I would like to change something in camera so dfort focus pixels map would work on my future cinemascope 1736x738 footage.I think its smarter this way instead of having every situation covered , just make camera show focus pixels in a pattern that is known to be removable.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on April 07, 2019, 04:47:29 PM
It´s not clear to me what exact setting was used. Could you share me your whole SETTINGS folder inside ML folder?

Was it mcm rewired set to 2.35:1?
Only reduced to 12bit from Crop mode sub menu or any other changes?
Need to know exact set up to reproduce so sending the SETTINGS folder should be best.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: 2blackbar on April 07, 2019, 05:13:00 PM
no it was not rewired it was the one above it, 1736x1158 under Q settings were 12 bit and 2.35:1 ratio.
raw video settings were
res 1736x738
aspect 2.35:1
14 bit lossless
preview frozen lv
In canon menu AF method - flexizoneAF⟁
My settings folder
https://drive.google.com/open?id=1jfQCNMKw0hsiG6r4JPhvAQd5bTbbWK0d
What focus pixel pattern do You have on your canon M in the same mode ? Can you record in cinemascope 1736x738 and then remove focus dots in MLVapp ? If yes then could you share your settings folder so i could adapt my cam? Maybe theres something wrong here in my cam because this format is quite popular.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on April 07, 2019, 05:28:40 PM
Thanks.
Frozen liveview? Why using that?
Anyway. Try using the mcm rewired mode and set it to 2.35:1 and 12 bit in Crop mode sub menu. Should work better with real time and perfectly aligned liveview.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: 2blackbar on April 07, 2019, 06:13:08 PM
Because i had pink frames when using framing preview and now i have 0 pink frames if i use this black/white preview.Also its mostly because of histogram.This mode works ok with histogram on.framing mode gives pink frames with histogram on, unless there would be an option to disable histogram during recording , i mean histogram is not on screen when recording but disabling it and switching to blackwhite view made pink frames thing of the past for me, i dont really need anything besides properly cropped image on screen but using kill global draw removes cropmarks for cinemascope, i would like them on and everything else gone when im in framing mode recording .
Ill do as you say and will try to remove pixels again in mlvapp.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: optical-work on April 07, 2019, 06:50:35 PM
i don't know if relevant but it was mentioned that mcm rewire mode doesn't work with bit options in crop mode sub menu. must be set in raw video sub menu if needed.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on April 07, 2019, 06:56:55 PM
Other way around. You set it in Crop mode sub menu.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: 2blackbar on April 07, 2019, 09:28:59 PM
Love You man ! It worked and i dont have any focus pixels when i use rewire, :D
But i see histogram :) can i disable it during recording and have it only when previewing? It will get me pink frames
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on April 07, 2019, 10:32:44 PM
Nice.
I guess you need crop marks still on. Will have a look tomorrow.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: 2blackbar on April 08, 2019, 12:51:23 AM
Also one interesting thing i noticed is that i have one red pixel on my liveview and it gets recorded on the raw video, this is not dead pixel, it does not appear when i remove card with magic lantern and it does not appear in photo mode.
What is it ?
http://picplus.ru/img/1904/07/c66d3869.png
From my tests it looks like it appears when i turn on rec crop mode, rewire or the one above, i turn off this mode and press canon menu button, back to liveview and pixel is gone.
Or is it dead pixel hidden by canon ?Id prefer it to be hidden .
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: dfort on April 08, 2019, 02:18:42 AM
If this is the image you are pointing to -- could please point out the red pixel? I don't see it.

(https://www.magiclantern.fm/forum/proxy.php?request=https%3A%2F%2Flive.staticflickr.com%2F7885%2F47559984801_9d447633d1.jpg&hash=b177bd8464c6cba8ae72dd5cfe22bfaa) (https://flic.kr/p/2fsHmvX)

A while back I wrote a post on how to add dead/hot/whatever pixels to a focus pixel map file (https://www.magiclantern.fm/forum/index.php?topic=16054.msg212690#msg212690) and Danne wrote another post on how he got rid of his "three hot friends" in camera (https://www.magiclantern.fm/forum/index.php?topic=9741.msg212680#msg212680).
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on April 08, 2019, 06:18:57 AM
Probably more dead pixels in there if I would remove this:
https://www.magiclantern.fm/forum/index.php?topic=9741.msg212680;topicseen#msg212680

Oops. Noticed dfort already linked.
In mlv_app select fix for cold pixels or similar.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: 2blackbar on April 08, 2019, 12:06:39 PM
So i do have even more dead pixels and camera is hiding them while mcm rewire partially shows how they really look like ?
Is it possible to hide the ones i have as well with another tweak to cmos 4?
I tried removing it in mlvapp its not working, maybe if there would be an option to select it manually.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on April 08, 2019, 12:13:43 PM
In your provided example I can´t see any dead/hot/cold pixels so before I can see anything it will be hard. Try getting a clear example of the issue.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: 2blackbar on April 08, 2019, 01:02:15 PM
Its this one
http://picplus.ru/img/1904/07/c66d3869.png
The stuck pixel is here
(https://www.magiclantern.fm/forum/proxy.php?request=http%3A%2F%2Fpicplus.ru%2Fimg%2F1904%2F08%2F7a7e5361.png&hash=65d2b3354a34775cd920795091feb70f)
flickr compression kills it so its not visible.
Also i didnt had it onscreen before i tried last build, and before that i had 12 february and a couple other builds.
Why the pixel wont show up if i disable croprec ?
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on April 08, 2019, 01:40:06 PM
If not removed in Mlv app the usual way you do like this(dfort posted a link too):
https://www.magiclantern.fm/forum/index.php?topic=16054.msg212690#msg212690
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: 2blackbar on April 08, 2019, 01:41:16 PM
I tried chroma blur 3x3 and its gone but im wondering why it disappears when i disable croprec ? Id prefere not to use chroma blur if i dont have to because it destroys some saturation data and colours look quite bland.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: AF-OFF on April 09, 2019, 04:53:44 PM
just quick tested Danne's new April09 build.
looks good, tested the new 2.5k 1:1 preset, and the MCM preset. Nice! no corrupt frames

Anyone looking for cheap and sufficiently fast card please look here -
https://www.magiclantern.fm/forum/index.php?topic=12630.msg214903#msg214903

 
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: dfort on April 09, 2019, 09:20:07 PM
Id prefere not to use chroma blur if i dont have to because it destroys some saturation data and colours look quite bland.

Show us some examples.

I've heard this so many times yet when I compare files processed with and without chroma smoothing there's very little difference, certainly not enough to avoid using it when it helps get rid of those last few stubborn focus pixels.

BTW--I first got into compiling ML because I wanted to use the chroma smoothing feature in raw2dng to remove the focus pixels from my EOSM and the only way to get it was to uncomment one line and compile it.

modules/lv_rec/raw2dng.c
Code: [Select]
/* useful to clean pink dots, may also help with color aliasing, but it's best turned off if you don't have these problems */
//~ #define CHROMA_SMOOTH
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: 2blackbar on April 09, 2019, 10:19:25 PM
Chroma blur does not work for focus pixels Daniel but it works fine for red stuck pixels, maybe also because of the fact that its just one.
I was doing som color correction and used chroma blur on chroma sharpness in mlvapp ,then noticed my dark areas arent so saturated anymore.
http://picplus.ru/img/1904/09/7a1ad0c0.png
http://picplus.ru/img/1904/09/2f75f8c1.png
More green one is the one with chroma smooth, i dont like how it looks, cyan tone disappeared.Maybe example that i had a couple dauys ago was change from green to kinda brownish tone in shadows which could appear like loss of colour, but it definitely affects the colours.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: dfort on April 10, 2019, 12:41:44 AM
Really? My eyes must be getting old. Which is which? I really don't see what you are talking about. Might help if you exposed properly or put a color chart in the shot or...well, let's take a look:

http://picplus.ru/img/1904/09/7a1ad0c0.png
(https://www.magiclantern.fm/forum/proxy.php?request=https%3A%2F%2Flive.staticflickr.com%2F7900%2F47522025512_4acb67104a.jpg&hash=fd92bb9ffb146888dd6ca68b5ba18eb2) (https://flic.kr/p/2fpmNxs)

http://picplus.ru/img/1904/09/2f75f8c1.png
(https://www.magiclantern.fm/forum/proxy.php?request=https%3A%2F%2Flive.staticflickr.com%2F7925%2F33698020558_5ccf622ba8.jpg&hash=1aac16b5eab2ead4de345a1d70072d13) (https://flic.kr/p/TkMaus)

I think that some very minor chroma smoothing image degradation might be real but there's also quite a bit of emporer has no clothes phenomena going on here.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: 2blackbar on April 10, 2019, 02:21:02 PM
Daniel i think i spent a lot of time on color correction and im a painter so i detect color changes in darks and bright areas faster than people who dont paint, i can clearly se that shadows are lacking blue tint in top example , bottom one has blue/gree tone that id like to preserve, its the main reason i swtiched to raw, because regular colorspace for h264 wont let us to bring these colours out so easily.
top image is green on dark walls , bottom one is cyan.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: gravitatemediagroup on April 10, 2019, 04:41:57 PM
I know the Overlook Hotel when I see it. lmao that's what those screen grabs look like. The Shining.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: baladev on April 10, 2019, 05:08:25 PM
There's definitely difference, but nothing a quick post processing won't fix. Here's you green frame quickly adjusted to look more or less like the cyan one:

(https://www.magiclantern.fm/forum/proxy.php?request=https%3A%2F%2Fi.ibb.co%2FHDwwSFQ%2F47522025512-c6014479dc-o.png&hash=19b3fabc24fb8ad262cf4f9f0771a63b) (https://ibb.co/HDwwSFQ)


I've been doing digital color correction for 15 years (photos and printers) and pretty much the only thing I care about is details. They can't be brought back if lost. Color can be made almost anything you want nowadays, especially with the power raw presents us.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: dfort on April 10, 2019, 05:24:51 PM
I worked 25 years in editorial and post production and before that work another 20 years as a still photographer. Yeah, I'm an old guy so maybe it is my eyes.

@2blackbar - So you are saying that chroma smoothing (which you referred to as "Chroma blur") is causing a subtle shift in greens? It that the reason you would avoid using it? Seems like that can be easily fixed in color grading.

...pretty much the only thing I care about is details. They can't be brought back if lost. Color can be made almost anything you want nowadays, especially with the power raw presents us.

My point is that chroma smoothing is a useful tool that has gotten an unjustified bad rap. It is worth reading the comments in the source code to see what is going on:

modules/lv_rec/raw2dng.c
Code: [Select]
             * for each red pixel, compute the median value of red minus interpolated green at the same location
             * the median value is then considered the "true" difference between red and green
             * same for blue vs green

By the way, it is very hard to judge what is going on when you are posting 8-bit images. It is best upload DNG or even short MLV files.

...that's what those screen grabs look like. The Shining.

LOL

In any case, we're getting off topic here.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: 2blackbar on April 10, 2019, 06:01:50 PM
Good observations and ideas guys , thanks .
baladev thats quite accurate but its just example, shot is underexposed and was just high iso test of how much i could smooth out noise, is it better to shoot 1600 and brighten up or shoot 64000 and darken shadows.The answer is - bring more light.Sometimes you just dont have them.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: baladev on April 10, 2019, 06:29:15 PM
Quote
was just high iso test of how much i could smooth out noise, is it better to shoot 1600 and brighten up or shoot 64000 and darken shadows.

I recently tried editing in DaVinci Resolve. One thing that impressed the heck out of me is very powerful noise reduction. It has this tool.. not sure what it does, frame blending or something, but i was able to reduce noise in some quite noisy footage (iso 3200 if remember correctly) to almost nothing without destroying details. It was like magic to me.. used Adobe stuff for years and have never seen anything like this! BTW, there's a free version of it.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: masc on April 10, 2019, 07:58:53 PM
But free version of Resolve has no noise reduction. (as far as I know)
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: 2blackbar on April 10, 2019, 08:44:40 PM
resolve needs gpu rendering and im on tabletpc used for work, so it doesnt even run after install.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Hek on April 11, 2019, 05:33:07 PM
When in either of the 2.5k modes, if fps is set to anything other than 23.976, the black bar on the right returns. Tested this on the 4/9 build and the build from today. Tested using 2.35:1 aspect ratio.  To test, set fps override to exact fps, and fps to 24. You will see the black bar on the right in framing preview.

edit- This is on an EOSM
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on April 11, 2019, 08:14:53 PM
Not very clear what you are doing or what issue you have.
On a sidenote. Fps override will not be recommended to use if preset includes static fps already set.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Hek on April 12, 2019, 01:48:25 AM
Here are two stills from an mlv, first one taken at 23.976 fps, the second at 24fps. Notice the black vertical bar on the right.
(https://www.magiclantern.fm/forum/proxy.php?request=https%3A%2F%2Fi.postimg.cc%2FDJ3tdLcB%2F23-976fps.png&hash=d22b5a4aee862ae19d370a0391ad0095) (https://postimg.cc/DJ3tdLcB)
(https://www.magiclantern.fm/forum/proxy.php?request=https%3A%2F%2Fi.postimg.cc%2F7Jxdj4dz%2F24fps.png&hash=35914fbfc4e854281f6b17167b3b584f) (https://postimg.cc/7Jxdj4dz)

Also noticed this in the code, not sure if it's related.

Code: [Select]
/* gets rid of the black border to the right */
EngDrvOutLV(0xc0f383d4, 0x4f0010 + reg_83d4);
EngDrvOutLV(0xc0f383dc, 0x42401c6 + reg_83dc);

Just something I noticed when I was editing some clips. I'll stick to 23.976fps from now on.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: dfort on April 12, 2019, 02:20:23 AM
Now that you bring it up--I would prefer if the default fps on the bleeding edge settings could be set to 23.98 instead of 25fps. Yeah, I know that we have users in PAL land and NTSC land but pretty much all film production these days is being done at 23.98 (even if they tell you it is 24). In addition, it does allow for just a tiny bit more max resolution than true 24fps.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on April 12, 2019, 03:32:46 AM
It's been default 24 fps for a while now although 25fps is to prefer often here in pal country. Flicker frequencies and such.
@Hek
You can use shutter fine tuning instead of fps override.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: baladev on April 12, 2019, 04:33:14 PM
Danne

I tested your last build today. Very nice!
Still get some occasional pink frames. Can't narrow down what's causing them.
The statistics from today is:
5K anamorphic
1136 x 1918 - out of 5 clips 2 had pink frames - 1 and 2 in each
1184 x 1998 - out of 5 clips 1 had 1 pink frame
new 4k anamorphic rewired
1136 x 1900 - out of 3 clips no pink frames

BTW, what's the difference between these two presets?

Will do more tests tomorrow. I film some clips in LV and others in LV with GD off and yet others on non LV mode, maybe this has influence.

Thank you!
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on April 12, 2019, 04:41:52 PM
The most trusted way is to run the lua cinema script and record 2:35.1 ratio. If you also enable Kill global draw setting I think youll have a hard time getting pink frames.
Other settings could work and could not work.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: baladev on April 12, 2019, 04:56:33 PM
I see, I'm a 16:9 guy, so this script won't work for me..
Where is this Kill global draw setting?
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on April 12, 2019, 05:01:33 PM
One of the menus.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: baladev on April 12, 2019, 05:28:08 PM
Ok, Thank you, found it, will test tomorrow.

I've noticed that your build is so smooth and responsive, feels great comparing to my 6D, which feels a little sluggish. Also things don't seem to break, at least I haven't been able to break anything so far, which would require a reboot.. So, congrats, feels very polished.

About pink frames.. I though they were caused by corruption that occurs when a camera runs out of processing power and can't keep up with the data flow or recording it onto a card.. But my observations with today's footage don't seem to support this.. I observed pink frames in places in my footage where I would expect them the least if my theory was correct, like I pan the camera from a brighter spot to a darker spot and a pink frames occurs in the dark spot, where, according to what I've read, the data flow should be smaller.. Strange  ::)
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on April 12, 2019, 05:44:43 PM
Could be timer regs, compression code, cpu or a mix of things. Who knows. It's a real pain in the ass, that's for sure...
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: baladev on April 12, 2019, 06:17:26 PM
If it's of any help.. I don't think I ever got any corrupted frames on my 6D. I get 2nd and 3rd frames corrupted all the time, they are practically never good, but apart from that, I can't remember ever getting a pink or mangled frame.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on April 12, 2019, 06:31:42 PM
No help here i'm afraid. I must say I feel lost when tweaking regs. Shooting from hip, testing comparing until I tested all I could think of testing.
At this point I think a1ex could take a look at my anamorphic parts in crop_rec.c and maybe he sees something that can be refined.
What you can help with is tweaking following regs straight in crop mode sub menu:
713c
7150
6014
6008

Maybe you find a better combination for 16:9.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: baladev on April 12, 2019, 06:39:32 PM
Ok, I will try these.

So, the 6D and EOS M have different values in these regs? Can't take them from one put in the other?
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Walter Schulz on April 12, 2019, 06:49:32 PM
If you ever wondered why it takes so long to get ML ported to new hardware or even to new firmware versions ...
And some cams are worse than that. My 650D won't work with Dual-ISO without tweaking a value which works perfectly well on other 650Ds.
Welcome to the fascinating world of reverse engineering!
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on April 12, 2019, 06:51:18 PM
Not the same @baladev. They follow the same relation and they are named the same. A1ex got them all pretty much figured out. Should check his bad ass crop_rec.c for 700D...

Speaking 650D Walter. We should get that one too into anamorphic world.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Walter Schulz on April 12, 2019, 06:58:29 PM
Speaking 650D Walter. We should get that one too into anamorphic world.

Sorry, unable! I'm pretty sure I'm occupied with other things until April 2020.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on April 12, 2019, 07:11:34 PM
I could prepare a preset for testing. Let me know if any interest here 650D users...
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: dfort on April 12, 2019, 07:15:29 PM
As long as we're moving off topic:

My 650D won't work with Dual-ISO without tweaking a value which works perfectly well on other 650Ds.

Happens with some 700D's too. For the new crop_rec settings, these two cameras are so similar it might just be a matter of using the registers we already found on the 700D on the 650D and Bob's your uncle.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: aulden on April 12, 2019, 07:58:04 PM
Danne! Tried out your newest build with the 4k anamorphic rewire - Does that mean that the live view will match the framing, you see realtime what you get? If so i cant get it to work. Any tips? The regular 1080p MCM rewire works perfectly though. Thanks!
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: ctfire on April 13, 2019, 09:50:22 PM
Try the last build 4k anamorphic rewire awesome but framming in real-time is taking the top of the frame , it will be cool if there is some possobility to make it more centered.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: baladev on April 14, 2019, 05:28:38 AM
Danne

I did some more testing to try to establish some pattern in pink frames.

Used your latest preset 4k Anamorphic rewired @14bit, 16:9, 1120x1890 res.

1 In LV with GD on I got this
clip 1 1m30s - 10 pink frames
clip 2 1m12s - 13 pink frames
clip 3 1m7s - 10 pink frames
clip 4 23s - 4 pink frames

2 In LV with Kill GD on I got
clip 1 1m30s - 0 pink frames
clip 2 54s - 0 pink frames
clip 3 50s - 0 pink frames
clip 4 50s - 0 pink frames

I also ran tests with your 5k anamorphic preset. With Kill GD enabled, out of 10 clips I only got 3 pink frames in the first one (maybe some settings didn't update correctly?), all other were pink frame free.

Not sure if this info is of any value, but could it be that GD somehow contributes to PF effect?

Another thing I noticed is that in 5K preset video 'jerks' often. After watching clips for a while I started noticing that it happens when the camera changed direction of movement. I think it might be related to IS not working properly in this preset? In 4k preset I didn't notice any jerkiness. Sorry if this is known or has already been discussed.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on April 14, 2019, 07:44:42 AM
Kill global draw is there for the reason giving som more overhead.  No more tests needed since those issues are already stated many times. Run 2.35:1 for pf free frames.
A helping test is if you could refine your preset tests by changing the regs I pointed to before and compare results.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: henricusmaria on April 14, 2019, 08:03:02 PM

I use mv1080p and then crop.This creates moire/aliasing free footage much more details than mov h264 and colours you never suspected this camera could capture.

What is the difference with using only movie crop mode (without mv1080p). Or do you use mcm rewire?
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Pacerx999 on April 15, 2019, 07:26:06 PM
Hi Danne,

Got the latest build (11 April) and saw the 4K anamorphic rewire.

Just wondering if this preset was hooked up yet to get a real-time, proper framed preview.

I’m well aware that it’s probably a long shot, but I got excited when I saw the preset name.

If it is hooked up, could you share some working settings as I could manage to get a good preview without framing on, which is similar to previous builds/presets.

Not trying to be demanding, just got excited by the name. If there’s something to help test:try just let me know.

Thanks
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: berechiah on April 15, 2019, 07:29:21 PM
What is the difference with using only movie crop mode (without mv1080p). Or do you use mcm rewire?


Yes I'd like to know too
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: AF-OFF on April 16, 2019, 02:27:33 AM
This is the difference
First picture shows the 2.5k preset
Second picture shows modified 4k anamorphic preset
Lens used was a mount-c 12.5mm f1.7
With the first one no continuous rec, but with the other

Thanks to Danne, used the recent build
2464x1418

(https://www.magiclantern.fm/forum/proxy.php?request=https%3A%2F%2Fi.ibb.co%2F4Y2GQPG%2F2-5kpreset-C-mount.jpg&hash=3e59a06d5c2dc2675acfae19df5cc2c7) (https://ibb.co/4Y2GQPG)


I apologize for the motive, this is 960x1900

(https://www.magiclantern.fm/forum/proxy.php?request=https%3A%2F%2Fi.ibb.co%2FMP0WxNm%2F4kpreset-C-mount.jpg&hash=1953af2d7817aeb8ecfd323f3da2e5dc) (https://ibb.co/MP0WxNm)
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: 2blackbar on April 16, 2019, 02:01:05 PM
What is the difference with using only movie crop mode (without mv1080p). Or do you use mcm rewire?

Yes I'd like to know too
Now i use rewire mode cause i had problems removing focus pixels, higher resolutions in anamorphic mode will give you lot less aliasing.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: rev787 on April 16, 2019, 04:40:11 PM
I wonder if this gets mentioned in the thread. If I boot in anamorphic mode, the live view first shows up in seems correct aspect ratio, and then after about one second it gets stretched.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: henricusmaria on April 16, 2019, 10:07:18 PM
Now i use rewire mode cause i had problems removing focus pixels, higher resolutions in anamorphic mode will give you lot less aliasing.
Mv1080 rewire gives me way too much aliasing. Is there a difference between just moviecrop mode and mv1080 with moviecrop mode?
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: 2blackbar on April 16, 2019, 11:27:03 PM
Just test it and compare
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: marcelolippi on April 17, 2019, 03:11:21 AM
I am using the 9 April night version, in 4.5k the 1502 x 1920 resolution has disappeared for some reason? The 14bit lossless data rate with correct exposure amounts to more than 70MBs, using ettr 90 or more of it ... right so? I'm working with sandisk pro 170 card in reading, the maximum speed at which I arrive is 55 and maximum 60/61, someone else has the same results? Thank you
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: MrIndieJ on April 17, 2019, 04:52:52 AM
Is there any way to center the live view after running the included script? When looking at the live view, I only see about the top half of the framing preview. It's not a problem if in static shots, because I'm able to use the framing preview and then just hit record. But when I'm trying to film moving shots or frame my dogs in a shot, I can't ever get the shot I want due to the way the live view only shows the top half of what is being recorded. Am I doing something wrong?
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: baladev on April 17, 2019, 05:02:57 AM
Gentlemen, please read this thread starting with page 71 post 1765 to familiarize yourself with the limitations/quirks/oddities of ML implementation on the EOS M. Answers to most of your questions contain there. I'm doing exactly that the 2nd time now to fill in the gaps I missed the 1st time :)
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: henricusmaria on April 18, 2019, 09:47:47 AM
Just test it and compare

I don't see a difference that is why I asked if you had a reason to use mv1080 with moviecrop. Maybe you had a reason..
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: theBilalFakhouri on April 18, 2019, 10:29:07 AM
@henricusmaria

Normal mv1080 has stretched LiveView, mv1080 with Move Crop mode rewire has correct real-time LiveView.

Consider using the latest build from Danne, some of previous build has Extreme Moire when using MCM rewire, in the newest ones the problem has been fixed.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: 2blackbar on April 19, 2019, 12:08:28 AM
I see now in recent build realtime preview looks properly alligned like "Framing" preview.Great work Danne!
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: marcelolippi on April 19, 2019, 12:53:41 PM
I'm confused, what are the statistically more stable resolutions that allow me to record continuously with a real-time display at least in black and white? Due to lossless compression I find that the bit rate increases up to 60% more, you have the same result?
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on April 19, 2019, 01:35:14 PM
Run the cinema lua script. All presets should then be lossless. If you also enable Kill global draw in RAW video menu chances increases even more. If this isn't working, check your card. Should be able to pass 55mb/s write speed.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: marcelolippi on April 19, 2019, 02:22:15 PM
Great Danne, my card arrive at 60/61-2 MBs. unfortunately with the high resolutions as soon as I exposed the signal correctly the bit rate rises to 80/90 MBs
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on April 19, 2019, 02:25:33 PM
Then you probably didn't run the lua script. Please do a screen recording of what you're doing otherwise since a lot of information is missing now.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: marcelolippi on April 19, 2019, 02:42:43 PM
 I start always with lua cinema...
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on April 19, 2019, 02:53:08 PM
Still need to see from start to finish with a clean build what's going on. Also, what's the exact name and spec of your sd card?
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: marcelolippi on April 19, 2019, 03:24:36 PM
Sorry Danne, I was talk about 9 april. I re test with the 11 april version, I think much better. My card is sandisk extreme pro read 170 MBs.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: marcelolippi on April 19, 2019, 03:43:57 PM
the only certain thing is that with 14 lossless, exposing to the right also increases the bit rate by 60%
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: baladev on April 19, 2019, 04:37:47 PM
@marcelolippi Make sure you have no clipped highlights. Picture should be a bit underexposed to get the best result, especially if you have large bright/white objects in the frame. GD causes pink frames in crop mode, so unless you don't mind them, use Kill GD, of course then you won't have LV and no framing, if you need framing, afaik your only option without pink frames is MCM rewired preset. I also reduce audio sampling to 11KHz, this helps to give more room for video. Tonight I was able to film two clips (~12min each) clips of band performance with 1120x1890 14bit anamorphic (used 4K preset). It was dark, in daylight it won't give me continuous.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: henricusmaria on April 19, 2019, 07:20:13 PM
@henricusmaria

Normal mv1080 has stretched LiveView, mv1080 with Move Crop mode rewire has correct real-time LiveView.

Consider using the latest build from Danne, some of previous build has Extreme Moire when using MCM rewire, in the newest ones the problem has been fixed.

I have the latest build. Mcm rewire still gives aliasing/moire. Using only Movie crop mode gives me cleaner footage. My question was if there is a difference between using just movie crop mode and (standard) mv1080 with movie crop mode.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: theBilalFakhouri on April 19, 2019, 08:07:16 PM
@henricusmaria

Movie Crop Mode will give x3 lossless zoom and it uses small area of the sensor 1x1 sampling, in mv1080 you are using the entire sensor 3x3 sampling same as MCM rewire. I don't know why it wasn't clear enough,  have you tested the two mods before?

The aliasing and moire come from the line skipping in 3x3 sampling, to get rid of that and if you want to keep crop factor 1.6 or close (like 3x3), use 1x3 sampling as known as 5K Anamorphic.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: henricusmaria on April 19, 2019, 11:57:02 PM
I know.. again, I was responding to what 2blackbar wrote about using mv1080 (no mcm) and moviecrop together. This way you are not using the entire sensor.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: 2blackbar on April 20, 2019, 12:05:37 AM
I think  crop raw records 5x5 not 3x3(had to disable it to record 3x3), so you can force it to record 3x3 (kinda like normal h264 3x crop area) but real noalias mode is 5x5 from what i understand.
I actually tried both 3x3 and 5x5 raw and i prefere 5x5, 3x3 looks a bit artificially upscaled to my eye but that might be my lens resolving power not being good enough.
MAin reason i use mcm rewire is that i can remove focus pixels with it in mlvapp and i cant with regular mv1080, they both looked similar to my eye and mcm can record full sensor which is super amazing.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: fanfzero on April 20, 2019, 12:49:48 AM
So i've just installed today ml on a eos m (after messing with a 100d), I've been testing it and reading the thread. I've been using it in my room, tomorrow I'll take it to the street with daylight. My question is about the resolution of the 4k and 5k modes, for what I'm reading it records in a resolution lower than 1080p and then it gets upscaled when exported to dng, is it then a fake 4k/5k?
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: 2blackbar on April 20, 2019, 01:58:32 AM
It records almost two times higher than 1080 -  height is 1900 pixels but width is upscaled later from 1488 pixels to 4464 to match aspect ratio.
dngs are actually 1488x1900, final res is 4464x1900.You can round it to 1920p.
I suspect these are highest resolutions cam bufers can provide at the moment in this combination.Highest width without 5x5 crop is 1736 pixels.
Its the best possible quality that you can get from canon M and its amazing that it even works.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: fanfzero on April 20, 2019, 02:22:17 AM
Well, 4k (uhd) is 2160p, so it gets pretty close, I guess then this is better to use this than using an h264 4k camera (like a lumix) due to the options in post-processing and color, right?
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: 2blackbar on April 20, 2019, 02:33:34 AM
Thats up to You , if You prefere RAW file with upscaled width , perceived resolution for me is pretty high , much higher than recording in 1080p modes but i didnt compare it with actual 4k frame.
You also have 4038x2558 in 5x5crop mode if you want highest res no matter if cropped.
I could not get them to work for me tho, highest i could do was 2.5k in 5x5 mode, 3k and 4k have broken preview and they wont record actual image from lens.
Also You need fast card for this, with 45mb writing speed i can barely make anamorphic 5k work for about 10 seconds, i will buy new cards tho cause its totally worth it, get fastest you can actually, who knows what future brings.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on April 20, 2019, 08:28:34 AM
It's not just some simple upscaling. Hardly fake. You can compare resolution and upscale non anamorphic to anamorphic starting point. Start by viewing the absence of aliasing in anamorphic mode.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: 2blackbar on April 20, 2019, 05:21:54 PM
So width of the video in anamorphic mode is limited by hardware binning method or it could be higher in the future ? In 5x5 mode horizontal res is above 2000 pixels, would it be possible someday to have that over 2000 pixels res in mcm rewire ? With 2x2 binning would be 2607 horizontally.
I read this and anamorphic quality is next to full res
https://www.magiclantern.fm/forum/index.php?topic=16516.25
--
Ok i made this test of 5k anamorphic mode, one image is crop from fullscale JPEG photo at 5184x3456(3:2 ratio), and second frame is anamorphic 5k - 4464x1900(cinemascope 2.35:1 ratio), both at 100% resolution.
Its from helios 44 58mm f4 or so, maybe on iso100 i will be able to get better sharpness but this is very impressive, i would not be able to tell the difference if i wouldnt be pixel peeping so close.I have kit lens 18-55 but sharpness looks the same as helios.
(https://www.magiclantern.fm/forum/proxy.php?request=http%3A%2F%2Fpicplus.ru%2Fimg%2F1904%2F20%2F8d930c59.gif&hash=cf184edbed1a12379c72c8fef5721c7d)
Here is full photo with middle part inserted from anamorphic(a bit brighter wall)

https://drive.google.com/open?id=1XxiJt7nWQTKfaTTFlP3AziSkWl86x7Mo
This is amazing, did anyone did some resolution charts with 5k anamorphic mode ?
---
2 more test images on next day, helios 58mm closed to f16, the difference is more visible
(https://www.magiclantern.fm/forum/proxy.php?request=http%3A%2F%2Fpicplus.ru%2Fimg%2F1904%2F21%2F4987a95c.gif&hash=5580b9bf006b2eb138010658f2c9c1b1)
(https://www.magiclantern.fm/forum/proxy.php?request=http%3A%2F%2Fpicplus.ru%2Fimg%2F1904%2F21%2Ff13c2134.gif&hash=866165178a1fa63e34e3687acdda2b03)
on 75degree angle the staircases are most visible, maybe there are some upscalers that handle 75degree angle a bit better and interpolate smoothly.
Also here is interesting experiment using b-spline resize on original dng to 4464:
(https://www.magiclantern.fm/forum/proxy.php?request=http%3A%2F%2Fpicplus.ru%2Fimg%2F1904%2F21%2F305539dd.gif&hash=b00ac0d9a8a579da1c01714ab5d22d63)
Looks like using b-spline gets rid of more staircases but perceived sharpness isnt as good.It is interesting option to have IMO.You could then sharpen in post with less aliasing.
fullframe photo,bspline,mlvapp
(https://www.magiclantern.fm/forum/proxy.php?request=http%3A%2F%2Fpicplus.ru%2Fimg%2F1904%2F21%2F2b192400.gif&hash=f1525d0703c05a9d8538344c7eae2d37)
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Jip-Hop on April 23, 2019, 07:18:17 PM
To get started, I'd like to try to record raw continuously with the smallest sensor crop possible in 16x9 ratio at 25fps.

So I loaded crop_rec_4k_mlv_snd_isogain_1x3_presets_2019Apr11.EOSM202 on my camera. Enabled the modules: crop_rec, dual_iso, file_man, lua, mlv_lite, mlv_play, mlv_snd, sd_uhs. Restarted the camera. Ran the cinema 2:35.1 script. It puts me into 4.5K anamorphic mode, with sluggish live view. So I enter ML menu. It shows "Crop mode" set to 5K anamorphic and "RAW video" to ON, 1488x1900 1.88x. I assume this 1.88x is the crop factor in this recording mode. Correct?

I'd like to minimize the crop, so I change "Crop mode" to "mv1080p MCM rewire", and go in and out of the Canon menu. This seems to decrease the crop when checking the FOV in live view, which is what I'm after, but now it shows "RAW video" is "ON, 1736x738 4.83x". What does the 4.83x mean? Is it correct? Haven't seen this discussed before I think.

I enter the "Crop mode" submenu and enable "set 25fps" and change the "ratios" to "16:9". Also in "RAW video" submenu I set "Aspect ratio" to 16:9. The resolution is now at 1736x976. It still says 4.83x. If that's the crop factor I think it's incorrect and would be useful if this could be fixed.

I'd like to set the shutter speed to 1/50 but can 1/45 is the closest I can get (using the Shutter menu in Expo ML menu).

By the way I read all of the posts from page 71 up until here. So I'm trying to put the theory into practice here.

Going to try a recording to see if it's continuous with these settings (I guess it will be, I'm using SanDisk 64GB SD Extreme Pro UHS-I U3 V30 170MB/s)
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on April 23, 2019, 07:26:45 PM
Should work. You can ignore the 4x crop stuff. It's all kinds of rewiring and round trips going on but if it looks ok in live view usually things will fly.
There's some fine shutter menu you could use to fine tune to 1/50. Search around.

Edit:
No need to set ratio in RAW video tab.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Jip-Hop on April 23, 2019, 08:18:30 PM
Thanks for the tip and good to know you're aware of the incorrect crop factor value. If possible I'd find it useful if it would show the correct factor. Just made a 27minute test recording that filled up the 64GB card. For me it seems to work continuous without issues in this mode. I greatly overexposed to test, as I understood that increases the datarate.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on April 23, 2019, 08:55:49 PM
I can take a look. Meanwhile. Trust your eyes and test results...
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: 2blackbar on April 24, 2019, 04:49:07 AM
Danne I managed to record actual 4000x17000 raw in 10fps (without any upscale later)above 10 seconds and could go longer , im in shock but shutter speed and fps stays at 10 , is this some sort of limitation ? Is it possible to force shutter 50 or 40 and fps to 24 ? Or it wont be possible and is capped by camera not card
 writing speed ?
also where is now 1736x2150 mode ?
(https://www.magiclantern.fm/forum/proxy.php?request=https%3A%2F%2Fi.postimg.cc%2Fx8cJFSy6%2FVRAM0-PPM-scaled.png&hash=aadc9e710fb1fba3ac1355b9c0212edc)
Im looking for mode to record 1736 in anamorphic 5k but its limited to 1488, is there any way to get full width of 1736  or there are some technical reasons its cropped a bit ?
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on April 24, 2019, 08:29:46 AM
New build:
https://www.magiclantern.fm/forum/index.php?topic=9741.msg208959#msg208959

Commit:
https://bitbucket.org/Dannephoto/magic-lantern/commits/eb45a9540a60188f092a4b45309241d347d4254d

@2blackbar
4000x1700, seems about right for 2.35:1 ratio mode.
Your questions have been answered before so please check other posts. I also suggest you learn how to compile if you want to test older builds like the one you are pointing too. Tutorials for both mac and windows are freely available.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: ctfire on April 24, 2019, 11:31:39 AM
New build:
https://www.magiclantern.fm/forum/index.php?topic=9741.msg208959#msg208959

Commit:
https://bitbucket.org/Dannephoto/magic-lantern/commits/eb45a9540a60188f092a4b45309241d347d4254d

@2blackbar
4000x1700, seems about right for 2.35:1 ratio mode.
Your questions have been answered before so please check other posts. I also suggest you learn how to compile if you want to test older builds like the one you are pointing too. Tutorials for both mac and windows are freely available.

Danne can you write what is changed from previous build? To know what to test?
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on April 24, 2019, 11:36:29 AM
Come on. Click the commit link, read later posts.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Jip-Hop on April 25, 2019, 06:46:01 PM
Did some recording experiments and noticed my footage got corrupted when I choose the 12-bit lossless and 11...8-bit lossless option.
Then I checked what my settings were in the "Crop mode" and noticed the "Bitdepth" was set to "10 bit".
Just trying to make sense of all the options here, I think it works as follows:

"Bitdepth" in the "Crop mode" submenu should be set to "off" when you want to change the "Data format" in RAW video menu.

In case you want to change "Bitdepth" in the "Crop mode" submenu, then you should set the "Data format" in "RAW video" to 14-bit lossless.

The footage becomes corrupted if you change "Bitdepth" in "Crop mode" submenu and change the "Data format" in "RAW video" menu to something else than 14-bit lossless.

Question: is setting "Bitdepth" in the "Crop mode" submenu (when "Data format" in "RAW video" is set to 14-bit lossless) the same thing as setting "Data format" in "RAW video" to 12-bit lossless when "Bitdepth" in the "Crop mode" submenu is set to "off"?

Just trying to understand where I'm supposed to change what, and what it affects.


Noticed something else wile testing:

In mv1080p 1736x967 46/48fps mode the 11-bits mode gives corrupt footage. Half of one frame combined with part of another, stutter etc. 10-bit and 14-bit work fine.

I get some color artefacts in mv1080p 1736x967 46/48fps and MCM rewired mode that I can't get rid off in MLV App (focus pixels and chroma smoothing didn't help). See picture. Does anyone have an idea how to solve it? When I activate 3x crop mode via the "Crop mode" submenu the same scene is very clean.

(https://www.magiclantern.fm/forum/proxy.php?request=https%3A%2F%2Fi.ibb.co%2FfFrBNyS%2Fartifact.png&hash=c0db5255c3e717b1e69d13015e6d306a) (https://ibb.co/fFrBNyS)

Link to MLV: https://www.dropbox.com/s/69jo5hicddv5l0v/M25-1740.MLV?dl=0 (https://www.dropbox.com/s/69jo5hicddv5l0v/M25-1740.MLV?dl=0).

Tested with crop_rec_4k_mlv_snd_isogain_1x3_presets_2019Apr11.EOSM202.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on April 25, 2019, 07:00:44 PM
Thanks for feedback.
Always keep 14bit lossless in RAW viideo menu. If you need reduced bitdepth go through crop mode sub menu. The result is about the same as  going through raw video menu but that way will not work.

Your aliasing issue is what sensor read out brings. Use x5 modes or anamorphic for nonaliased footage.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Jip-Hop on April 25, 2019, 07:36:17 PM
Thanks for clarifying! Will do that from now on :)

Also the mv1080p MCM rewired mode with 3x crop enabled gives very clean (no aliasing) footage and real time color preview (no lag) in 1624x1080 resolution. Continuous recording. Quite nice and easy to use if a big crop is appropriate.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on April 25, 2019, 07:42:43 PM
Yes, digital zoom works like x5 zoom. You can run Movie crop mode without crop rec to get the standard digital zoom. Think width is a little higher then.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Larouso on April 25, 2019, 08:57:28 PM
Hi all, hope I did not miss it... I skipped some builds... is it on purpose that SDoverclock.lua script is not included in the latest build?

Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on April 25, 2019, 09:05:06 PM
Yes. Sd overclock patch is applied on start up once sd_uhs module is enabled. No need for the script solution.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Larouso on April 25, 2019, 09:10:15 PM
Thanks !
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: ErickTim on April 29, 2019, 12:20:42 PM
Guys... Danne is working really hard to make us awesome new builds, I don't think he has the time to answers questions that had been answered many times before. Someone made this Facebook page where many people will be very happy to answer your questions. This forum is here to help ML team make new builds and continue improving the builds. If you're new to ML I suggest you post your questions in this Facebook page. I myself will answer your questions.

https://www.facebook.com/groups/375018026655820/
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Walter Schulz on April 29, 2019, 12:33:45 PM
Sorry? Where is the benefit in using a second platform (media splitt) hosted by a company with dubious privacy practices which will require another account?
Unasked service, clickbait or what? Not going there and asking forum members to avoid it!
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on April 29, 2019, 12:50:38 PM
I would agree with Walter here. Let´s keep questions and feedback all in one place and one thread. For this very reason haven´t split my branch and build from this eosm thread. Feel free to answer questions in here @ErickTim, and by all means, keep the facebook group but for other reasons than posting about bugs and such.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Levas on April 29, 2019, 01:20:01 PM
Also here is interesting experiment using b-spline resize on original dng to 4464:
(https://www.magiclantern.fm/forum/proxy.php?request=http%3A%2F%2Fpicplus.ru%2Fimg%2F1904%2F21%2F305539dd.gif&hash=b00ac0d9a8a579da1c01714ab5d22d63)
Looks like using b-spline gets rid of more staircases but perceived sharpness isnt as good.It is interesting option to have IMO.You could then sharpen in post with less aliasing.

@2blackbar: Interesting, the example looks much better with b-spline, how exactly did you do b-spline on the DNG, what software what picture formats etc?

@Danne: Looking at the examples, are you sure horizontal pixelbinning is done in this 1x3 mode ?
On the 6d I use this part for 1x3 mode for pixelbinning:
Code: [Select]
            case CROP_PRESET_1x3:
            case CROP_PRESET_1x3_24FPS:
            adtg_new[11] = (struct adtg_new) {6, 0x8000, 6};    // 6=pixelbinning (8183&8184 needed) 5 is not pixelbinning.
            adtg_new[12] = (struct adtg_new) {6, 0x800C, 0};    // lineskipping
            adtg_new[13] = (struct adtg_new) {6, 0x8183, 0x35}; //sets horizontal pixelbinning, needed if pixelbinning is wanted in 5x zoom mode
            adtg_new[14] = (struct adtg_new) {6, 0x8184, 0x3b};

Because I use 1x3 mode in 5x zoom mode, I need to set 8000 register to value 6 and I have to set values for 8183 and 8184 registers (default values Canon uses in normal non zoom mode)
The difference between horizontal binning or not is very big, both pictures are from 1x3 mode on 6d, the left does horizontal pixelbinning, the right one not.

(https://www.magiclantern.fm/forum/proxy.php?request=https%3A%2F%2Flive.staticflickr.com%2F65535%2F47731833691_6faa94e46e_o.png&hash=6a8874e0533afa3eefc5e45b77a06fa2)
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on April 29, 2019, 01:25:15 PM
@Levas
Yes, noticed the jagged edges posted so I double checked my presets and it was fine in my anamorphic modes. No idea why and how he got those jagged lines. Maybe from some early build.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: baladev on April 29, 2019, 02:06:26 PM
I second that. I've never seen jagged lines like this produced by anamorphic  presets in Danne's builds.. but then again I've never pushed them above and beyond like some people here, who try to squeeze every last pixel and frame out of this camera, sometimes getting weird results like this..
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: masc on April 29, 2019, 03:19:10 PM
I think the pictures of 2blackbar are zoomed to 200% or something. With the EOS M I get something like the left picture from Levas: if you look on some ~45° edges, you see the stairs. If you sharpen before resizing you'll get "strong(er) stairs". I also tried with b-spline, lanzcos and bilinear rescaling: bilinear brings the strongest stairs, lanzcos and b-spline looks very close - lanzcos maybe a little sharper, but both smooth the stairs very well.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Levas on April 29, 2019, 04:30:09 PM
Maybe zoomed to 200% or more indeed ?

The aliasing 'stairs' at 45 degree angles are the only thing spoiling high resolution 1x3 stretch for me.
Did some testing, but couldn't get any better than what I got in the left picture.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: arthur2064 on April 30, 2019, 11:07:13 AM
Good morning, for some time I wanted record videos and I opted for the camera eos m, I want to install magic lantern but I am confused about what version to use?. I read that dannephoto versions are highly recommended but I do not know what would be the best for me, I just want to record at 2.5k, Anamorphic Module, 14bit lossles and sd hack module , please guide me.

Also i could not find information for field monitor compatible with ml, does anyone have any idea which ones are compatible? Thank you very much.
PS: sorry for my bad english.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: masc on April 30, 2019, 02:46:32 PM
... I just want to record at 2.5k, Anamorphic Module, 14bit lossles and sd hack module...
There is exactly one branch: Danne's experiment branch. https://www.magiclantern.fm/forum/index.php?topic=9741.msg208959#msg208959
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Luther on April 30, 2019, 03:20:10 PM
There is exactly one branch: Danne's experiment branch. https://www.magiclantern.fm/forum/index.php?topic=9741.msg208959#msg208959

Wouldn't it be better to push at least some of those changes into main tree? Lot's of questions in this thread this month about where to find the right package for EOS M. Is it too unstable yet?
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: baladev on April 30, 2019, 04:23:58 PM
I agree, it would have been much simpler for everyone if the first post in a thread dedicated to a particular camera build was where the description of the build with the link was. It is standard practice on most forums dedicated to releasing mods and such. It would reduce number of questions like above.

In terms of stability, Danne's build is rock solid and has all the features available for this camera. The only problem pretty much is a phenomenon of pink/corrupted frames that occur in footage produced in crop or anamorphic modes. I'm planning to have a go at it when I finish my current dealings with the 6d build.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: masc on April 30, 2019, 05:05:53 PM
... on the other side: this link can be found on nearly every page in this thread (>= page 71). So reading and finding needs not longer than 3 minutes! I am sorry to not be able to understand the confusion: the link is always the same.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: 2blackbar on April 30, 2019, 06:09:58 PM
I used this and compared results
https://www.imageenlarger.com/
These are 100% crop images
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on April 30, 2019, 08:03:09 PM
Hey guys. I wish I had more time. I have a hard time estimating hours put into testing and hacking/understanding parts of ml code so I could make good use of my ideas but atm energy is rather low. All my dedication went into testing out and building a stable version so now I rely on users to point to link/posts giving helping hands when I can't.

Even if working rather stable I see most of my solutions rather primitive and probably could need a real workthrough. Yet all code is there, I even provide compiled builds, so not a big problem finding it. What seems harder is getting newcomers to be more patient and putting in the effort of reading through forum posts. Hey, what can I say. I am rather lazy about that too sometimes.

Still occasional issues with corrupted frames. If we could create areas to dig into regarding those issues maybe we could eliminate these issues. Personally I hit a road block on the subject.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on May 01, 2019, 02:46:10 PM
New version:
https://www.magiclantern.fm/forum/index.php?topic=9741.msg208959#msg208959

- if x3 zoom is active with mv1080p MCM rewire mode it now gives 1736x1158 for x3 zoom too

Commit:
https://bitbucket.org/Dannephoto/magic-lantern/commits/a89e83d20b77c5d95a1d3fc0a6201bbfdd053343?at=crop_rec_4k_mlv_snd_isogain_1x3_presets


EDIT: uploaded new version just now. Centred the x3 zoom with cmos 5
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Larouso on May 01, 2019, 09:24:53 PM
I had some time today to test the build from 24th April. Always started with cinema script. Worked all good, the only thing that I encountered on regular basis was a completely white screen when start recording (in various crop modes). Video itsself was recorded ok. To me it strikes that it only happens when I set ISO to auto... don`t kow if this already a known thing.

BTW: Is there any way to you use zooming 10x on half shutter release (or any other button) also in video mode like in photo mode (to align fous)?
Have a nice evening all.

Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on May 01, 2019, 10:15:34 PM
As long as footage is ok a white flash in beginning is ok. If not using auto iso, works differently?
What happens when you zoom into x10? I tend to use magic zoom for closer previewing capability.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Larouso on May 01, 2019, 11:37:15 PM
As long as footage is ok a white flash in beginning is ok. If not using auto iso, works differently?
It`s not a flash - it stays completely white, so you have no preview of what you are capturing.  My assumption was, it is kind of a way overexposed preview / live view.
If auto iso is not enabled I never had the issue.
-> just checked again in a dark environment - it is for sure an overexpose thing - in dark environment you can see slightly the real preview like under a transparent white layer.

What happens when you zoom into x10? I tend to use magic zoom for closer previewing capability.
Yes right... In photo-mode I can use 10x zoom to really nail focus on the subject. In video mode magic zoom is available, true, but with its 3x I found it is not that precise. If you film 1080 and you subject is farer away it`s already pretty hard to determine if you  have the correct focus point. Just was wondering if there is a way to enable that also in video.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: dfort on May 02, 2019, 04:51:58 AM
If you are using Auto Movie Mode with raw video you should see this warning flash on the screen:

Quote
!!! Auto exposure !!!
Set 'Movie Exposure -> Manual' from Canon menu

Heed this warning.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: 2blackbar on May 02, 2019, 10:38:16 AM
Great work Danne ! I think most of us understand why you would like people to read more, You put a lot of effort into Your work and they should put some too, its also great way for them to learn more about ML and why some functions behave certain way.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: marcelolippi on May 03, 2019, 10:41:20 PM
today I started a documentary filmed with the eos m, 150gb, 1480x1900, 23.97, 4.5k, sandisk 128gb extreme pro 170MBs, focus peaking and magic zoom on. Only 2 clips stopped. Maximum duration of one 17 minutes without a pink frame. The final clip fills the card but I still find it legible. Thanks, great work!
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on May 04, 2019, 12:12:24 AM
Wohoo. Fantastic. Looking forward to the final result.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: AF-OFF on May 06, 2019, 02:10:40 PM
@Danne - having problems with the May 02 build regarding card formatting.
everything as usual until I choose "format card" from canon menu. normally card was formatted and cam restarted automatically , but now there are two different errors - firstly, if the card was formatted successfully,  ML does not get restored. second variant is, the card doesn't format and after restarting, ML is gone also and cards name now is "Untitled".
Did test this several times to be sure, never had this before.
Back to build April 11

Thanks  & Best to You Danne. 
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on May 06, 2019, 02:47:44 PM
Is it related to rewired mode? What if crop rec and raw video is turned off?

EDIT: Tested here and seems to work as before both with mcm rewired on or off.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: AF-OFF on May 06, 2019, 04:14:27 PM
Is it related to rewired mode? What if crop rec and raw video is turned off?

EDIT: Tested here and seems to work as before both with mcm rewired on or off.
I've been setting to 2.5k 1:1, which is nice to use @ 1920x1080
I like to format the card before doing new recording, because otherwise there seems to be more likely corrupt frames.

EDIT: in the April 24 build, with the 2.5k 1:1 the 1920x1080 setting has to be "activated"
after restart with going and leaving the ML menu, otherwise the res is not that one. in May 02 this is fixed somehow, like in the April 11 build.
just tested April 11 build again, there its working and I am able to format the card

EDIT 2:
tested again (MAY 02) with mcm rewire - activated only crop rec, mlv lite, mlv sound and sd uhs
after restart did a short recording and then tried to format the card. formatting starts and at the end it hangs a while, then a message appears - cannot format the card.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on May 06, 2019, 04:26:17 PM
Ok, reproduced. It´s related to sd_uhs module. I changed a routine in that code lately cause it fixed issues with 70D and 100D. I will take a look. Meanwhile, just stay off formatting if sd_uhs is enabled.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: AF-OFF on May 06, 2019, 04:34:52 PM
Nice
thanks a lot for Your awesome work!
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on May 06, 2019, 05:54:50 PM
New version:
https://www.magiclantern.fm/forum/index.php?topic=9741.msg208959#msg208959

Seems fixed AF-OFF. Could you test it?

Commit:
https://bitbucket.org/Dannephoto/magic-lantern/commits/8050b0f7bb837a1a7ad50ad89206b05d0d9befaa
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: AF-OFF on May 06, 2019, 06:24:00 PM
unfortunately its the same as before. cannot format card....ML gone
this was with the 2.5k 1:1 preset - but nice that the 1920x1080 is there right from beginning
tried also with the default mcm - again - "cannot format change card"
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on May 06, 2019, 06:27:56 PM
Yes, very strange. Will probably need to go back to older routines around sd_uhs. Will do some more testing later.
By the way. Did you do a clean install with the new build or did you simply copy the new file onto the card? If so try to install fresh.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: AF-OFF on May 06, 2019, 06:35:01 PM
@Danne - check the answer in  Your commit

EDIT : Yes, clean install with FW update in photo mode
EDIT 2 : the erased card (untitled) still exfat, so the card is formatted but not bootable anymore. must do FW update otherwise no ML
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on May 06, 2019, 06:36:39 PM
Yes, noticed. Put up another build so please test.

EDIT:
Hm, seems harder than I thought. Could be something else related to sd_uhs so no quick fixes here it seems.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: AF-OFF on May 06, 2019, 06:52:07 PM
sorry Danne, still not working.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on May 06, 2019, 06:57:35 PM
Ok, went back to more or less the same sd_uhs code as in april 11th build. Seems to work at least for eosm. Thanks for tests AF-OFF.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: AF-OFF on May 06, 2019, 07:05:06 PM
Yes with the old sd_uhs module its working as usual
 
Could anyone with 70D or 100D please test this too? maybe this helps Danne a bit somehow....
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on May 06, 2019, 07:08:59 PM
Well, bleeding edge. Be happy the cams aren't burning up.
Any tests here is unknown territory to me. I expect similar issues as on eosm.
Recommend eosm users to redownload todays build.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: liuk718 on May 07, 2019, 02:40:25 PM
Hi all,anyone knows how to continue recording video automatically after current clip stopped without push recording button again?
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Walter Schulz on May 07, 2019, 02:46:13 PM
https://wiki.magiclantern.fm/camera_help#movie_tweaks -> Movie restart
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: 2blackbar on May 07, 2019, 04:54:16 PM
my canon m totally hangs on may7 build when card is full and i change shuter speed from clean install .Had to pull battery.
Other card not full works fine.
Deleted one file, works ok.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on May 07, 2019, 04:58:19 PM
my canon m totally hangs on may7 build when card is full and i change shuter speed from clean install .Had to pull battery.
Other card not full works fine.
I have no idea what you are telling me. Please try and reproduce the issue a couple of times and if what you are saying is true describe the exact steps how to reproduce.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: 2blackbar on May 07, 2019, 05:15:34 PM
I just recorded raw files until card is full, then installed new build by deleting old folders besides raw files and copied new ml files.
When i tried to change shuter speed from 33 to something else then camera hanged - i could not press anything from now on , menu was locked on shutter speed and i couldnt get out, i think ML wasnt loaded fully when card was full and that caused some issues but thats just assumptions.
By deleting one file and releasing free space on card the problem disappears.
--
tested again, just recorded file again on almost full card, when it went full i restarted camera, when trying to change shutter speed camera hangs.
I mean its not a big deal cause i cant record more to the card anyway but the behaviour is definitely there and easy to reproduce.
Also maybe its happening not only with may7 build , i just only noticed this now by accident.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on May 07, 2019, 05:18:18 PM
If I understand you correctly this behaviour comes when your card is full. Has nothing to do with the latest build? Well, if so, I think you know the answer here yourself.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: 2blackbar on May 07, 2019, 05:20:11 PM
Yeah, if its a known issue thats ok
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on May 08, 2019, 06:41:35 PM
New version:
https://www.magiclantern.fm/forum/index.php?topic=9741.msg208959#msg208959

Long time shutter bug in x5 zoom mode fixed. Will affect all included cams in this code:
https://bitbucket.org/Dannephoto/magic-lantern/commits/f415e0407d7525c4a8c4dc194d3acfe91eb44396

Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: chrispwilliams on May 09, 2019, 01:53:05 PM
Anybody else getting weird pink lines in the centre of their frame?
Getting this with latest build and in all crop modes.

(https://www.magiclantern.fm/forum/proxy.php?request=https%3A%2F%2Fi.ibb.co%2FgWfhvxt%2FM09-1258-frame-196.png&hash=0fba3a0fcdf8389773d94fa2a013be4a) (https://ibb.co/gWfhvxt)
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on May 09, 2019, 02:46:34 PM
Download daniel fort´s pixel map files and place them inside Mlv App inside MacOS folder if you´re on mac.
https://bitbucket.org/daniel_fort/ml-focus-pixels/downloads/

These files:
https://bitbucket.org/daniel_fort/ml-focus-pixels/src/default/focus_pixel_map_files/

If that isn´t working select chroma smoothing 3x3, should clear focus pixels more or less completely.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: 2blackbar on May 09, 2019, 05:40:39 PM
chrispwilliams use mcm rewire mode, the one above it is the only one thats tricky to get focus pixels removed.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: dfort on May 09, 2019, 07:11:04 PM
If there are any settings where the focus pixels can't be removed using my map files please upload a short MLV file and post on the Dealing with Focus Pixels in raw video (https://www.magiclantern.fm/forum/index.php?topic=16054.0) topic.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: CaseClosedTV on May 10, 2019, 05:33:12 PM
Hey guys i just wanted to thank everyone for working on these constant updates.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: mangurian on May 14, 2019, 12:16:58 AM
I started with page one of this thread and have been going through a page at a time.
I am trying to see if the shutter bug has been fixed.
I will try to short circuit my search by just asking.  Is it fixed ?
also,
What is the general state of ML for the EOS-M as of today.

Many thanks,
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Audionut on May 14, 2019, 05:17:14 AM
https://bitbucket.org/hudson/magic-lantern/issues?q=shutter
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on May 14, 2019, 08:05:24 AM
What is the general state of ML for the EOS-M as of today.
And also :P:
EDIT: Oops, wrong link(corrected)
https://www.magiclantern.fm/forum/index.php?topic=9741.msg208959#msg208959
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: kuchka94 on May 14, 2019, 11:03:01 PM
Hi! I'm in your family now=)
Thank you for your work, that's amazing!

I have problem on all latest builds - I can't make photo!
Is this problem that called SHUTTER BUG?

On Nightly.2018Jul03 everything is ok with photo.

So am I right, that latest builds can be used only for video mode?
And no chance to use it in photo?

On this latest builds not working SD UHS module out of the box, seems like it doesn't load, I turned on it, but it doesn't appear in debug menu.
So i used ftom another builds. And on new builds i don't see script for loading sd module. So i took from older build)
Is it ok? Or something wrong on my side?

Just have my cam few days, sorry for novice questions...
Thank you for reply!
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on May 15, 2019, 06:48:02 AM
Please more info about not being able to take photos. Tried reinstall ml? Clear camera settings? Are you even in photo mode?
Sd_uhs don't need any script anymore. Enabling the module is enough.
To get out of the novice corner do read though the last ten to twenty pages of this thread. Most has been covered.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on May 16, 2019, 12:16:04 PM
New version:
https://www.magiclantern.fm/forum/index.php?topic=9741.msg208959#msg208959

- Possible fix for corrupted frames in anamorphic modes

For all "anamorphers" out there you may wanna test this version since it seems we can get corruptionless footage. Not that there was a lot of it but still.
Shortly. I am testing to short circuit the real time buffer while we are in framing preview. Since we are in framing it doesn´t matter anyway. I then free buffer again when pressing halfshutter to get back into real time framing.

Freeze with these two regs:
Code: [Select]
          EngDrvOutLV(0xc0f383d4, 0x4efffc);
  EngDrvOutLV(0xc0f383dc, 0x42401b2);
Then set them back to original numbers when going into real time again. I guess it works something like a "dynamically" hacked liveview setting.

Commit:
https://bitbucket.org/Dannephoto/magic-lantern/commits/bbdec706c04f2e9bf443d47d4590356d03c52b99

For now only works with preview set to framing and with anamorphic modes.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: baladev on May 16, 2019, 06:23:31 PM
God bless your heart Danne for your relentless work on pushing forward and fixing/improving stuff. Without you and a few other people we would be in the dark ages in terms of ML development.

I will test your latest build in the next couple of days. This corrupted frames nonsense is time consuming to troubleshoot because of its random nature. Sometimes I get 10 corrupted frames and sometimes none in a clip of the same length.

Thank you!
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: DarkCAL on May 17, 2019, 12:14:16 AM
First of all I would like to thank Danne and the rest of the ML team for helping us all out !
I was and am reading a ton here on the forum specifically in this subforum and finally decided to become a member
Also I became the owner of a black EOS-M in the meantime
I'll post some pictures of my run & gun rig later on

@Danne,
I am running / testing ML May14 and ML May15
Just downloaded ML May 16 and gonna try it in a minute
What is actually the difference between these 3 versions please ?
ML May14 improved the pink frames a lot in all settings for me
Thanks
Dark
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: kuchka94 on May 17, 2019, 12:28:49 AM
Please more info about not being able to take photos. Tried reinstall ml? Clear camera settings? Are you even in photo mode?
About photo:
Tried to clear camera settings, reinstall ML, I'm in photo mode of course.
On latest builds camera can't took photos with kit lens 18-55I'm.
When I try to make photo, camera start try to make focus AF, after pressing shutter button - no reaction. Photo doesn't make.
I tried it in all focus modes, if, af, mf+af,  tried to change different settings and it didn't work.
When I enable shoot by taping on screen - camera seems try to make and stuck on that moment. Live View work, show real time picture, but camera stuck and didn't react on any buttons or screen taps.
After pulling out battery, I restarted camera, it shows that modules not loaded, and in this mode after few times suddenly pulling out battery, camera in some times can make photo as everything is ok. IMPORTANT - it happen not every time, and it very hard to catch that moment.
I thought, maybe problem in modules - disabled every module, but it didn't work. As at the start.
On fully manual lens photo start to work, and seems everything to be ok. I just turn on shutter without lens option, in C.Fn settings. But it don't work for kit lens.

On nightly 2018 Jul 03 everything works perfectly out of the box, after install, without any manipulation.

So, I think that maybe this is problem with working together with kit lens, but I don't understand why, what's a problem.

Video works ok on that lens.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: dfort on May 17, 2019, 12:57:29 AM
@kuchka94 - Welcome to the infamous shutter-bug (https://bitbucket.org/hudson/magic-lantern/issues/1893/eos-m-shutter-bug). This has been bugging the EOSM for years. It only affects EF-M lenses that have Image Stabilization and it only happens in still photo mode.

Current workarounds include:
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: baladev on May 17, 2019, 04:40:58 AM
Hmm.. the last couple of days I've been taking my M with me for walks around the bay area here, taking some short clips and an occasional photo in between. Didn't notice any strange behavior like that.
Apr 11 build
18-55 kit lens
SanDisk Extreme Pro 128Gb card

Could it be the card?
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: dfort on May 17, 2019, 05:08:22 AM
Apr 11 build
18-55 kit lens
SanDisk Extreme Pro 128Gb card

Could it be the card?

I've got that card and it shows the shutter-bug. Try turning off all the modules, start camera in photo mode and shoot a still with that kit lens attached. Chances are the shutter won't fire.

Which April 11 build are you using? Maybe one of Danne's experiments squashed the bug?
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: kuchka94 on May 17, 2019, 05:38:45 AM
Great :)
But do you know, why everything works fine on nightly 2018 Jul 03?
This bug was dated in 2014... Why it is now here in latest builds?
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: baladev on May 17, 2019, 06:29:39 AM
I've got that card and it shows the shutter-bug. Try turning off all the modules, start camera in photo mode and shoot a still with that kit lens attached. Chances are the shutter won't fire.

Which April 11 build are you using? Maybe one of Danne's experiments squashed the bug?

Nope, can't reproduce. Disabled all modules, started in photo mode, takes pictures fine.

I'm on this at present:
crop_rec_4k_mlv_snd_isogain_1x3_presets_2019Apr11.EOSM202 by Danne
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on May 17, 2019, 06:47:46 AM
I've got that card and it shows the shutter-bug. Try turning off all the modules, start camera in photo mode and shoot a still with that kit lens attached. Chances are the shutter won't fire.

Which April 11 build are you using? Maybe one of Danne's experiments squashed the bug?
I got the same set up and it´s not happening here. My colleague experienced the bug though a week ago, so it´s there alright. Not gonna open up that can of worms...
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: a1ex on May 17, 2019, 07:19:04 AM
This bug was dated in 2014... Why it is now here in latest builds?

Are you aware of how many (https://bitbucket.org/hudson/magic-lantern/issues/1893/eos-m-shutter-bug) man-years (https://www.magiclantern.fm/forum/index.php?topic=21728.msg198529) went into diagnosing just this specific bug (i.e. "that can of worms") ?

So far, the current hypothesis (https://www.magiclantern.fm/forum/index.php?topic=21728.msg201551#msg201551) is that it's primarily caused by what happens before our code even has a chance to run (yes, before even loading autoexec.bin). If my theory is valid, the shutter bug happens if and only if the time required by Canon bootloader to mount the SD card and load autoexec.bin (details (https://www.magiclantern.fm/forum/index.php?topic=23641.msg213338#msg213338)), is "too long" (whatever that means for Canon's firmware that runs on the MPU, in parallel with the main CPU).

Therefore...

Maybe one of Danne's experiments squashed the bug?

Fixing it would require one of these, if my theory is valid:

- reprogramming the MPU (unfamiliar CPU architecture; unexplored territory; currently, the MPU is a black box for us)
- resetting lens communication somehow via MPU messages (good luck figuring out how exactly...)
- reprogramming (reflashing) Canon's bootloader (pretty extreme)

So... zero chances of getting this fixed (even by pure luck) with video-related experiments ;)



TLDR: the outcome (whether you are experiencing the shutter bug or not) depends on card contents, card speed, size, filesystem, autoexec.bin size, fragmentation... you get the idea. It does not depend on what build you are using. The only things under our control are:

- autoexec.bin size (reducing it to a few K - from roughly half of MB - is going to result in a *minor* improvement)
- card filesystem (FAT32 vs exFAT; this one is worth exploring, as a workaround; formatting with a large cluster size might help)
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on May 17, 2019, 07:35:55 AM
Are you aware of how many (https://bitbucket.org/hudson/magic-lantern/issues/1893/eos-m-shutter-bug) man-years (https://www.magiclantern.fm/forum/index.php?topic=21728.msg198529) went into diagnosing just this specific bug (i.e. "that can of worms") ?
Yes, my statement doesn´t adress any time span or what others did before. I simply realize it´s not within reach on a personal level. Respecrt for work done here all the way.

While you´re around. Could you share some thoughts on this:
https://www.magiclantern.fm/forum/index.php?topic=9741.msg216553#msg216553

What I notice is a constant bitrate when recording lossless while liveview is frozen. Meaning, even if pointing towards very bright areas bitrate seems to stay the same where as we know that too bright areas usually means early stops.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: a1ex on May 17, 2019, 07:42:15 AM
That reply was not for you, but for the question in the quote ;)

Quote
What I notice is a constant bitrate when recording lossless while liveview is frozen. Meaning, even if pointing towards very bright areas bitrate seems to stay the same where as we know that too bright areas usually means early stops.

Is the resulting video valid, or it's encoding the same LiveView frame (or a small group of frames) over and over?
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: dfort on May 17, 2019, 07:47:02 AM
Got a few grey hairs myself trying to track down the shutter-bug. This bug is very easy to reproduce, I can't believe you're not seeing it. Any card over 32GB should show it as long as you are using a native EF-M lens with image stabilization -- not an EF/EF-S with the adapter.

I loaded up Danne's changeset a8ccb36 (April 11) on a SanDisk Extreme Pro 128GB card and -- sorry, shutter-bug is present. Didn't think it was going to work but needed to see for myself.

[EDIT] Tried this too:

..taking some short clips and an occasional photo in between...

Switching from video to photo mode or shooting stills while in photo mode doesn't clear out the shutter-bug.

a1ex--I knew it was a long shot that the shutter-bug would disappear on this build but since Danne was doing some tweaking on the sd_uhs module I thought maybe it would do something with the card that would delay the boot process just enough--but no such luck.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on May 17, 2019, 08:09:29 AM
That reply was not for you, but for the question in the quote ;)
My own mishap as usual then  8).

Back to the question. Files recorded are perfectly valid. Cancelling out(freezing) real time buffer while running framing mode has a signifcant impact on recordings. On 100D it went from plenty pink corruption party to zero pinkys.

Anyway. Going from dark to extreme bright does show a very slight increase in compression handling(50.6 to 51.3mb/s, 0.7mb/s neglible right?), check vid:


Well, I redid test without the liveview hack freeze and not really consistent. First darker input yields around 52mb and brighter slightly increased bitrate to around 53. So my hack is slightly reducing overhead but the effective part is by far reduction of corrupted frames. Whatever that means. SOmething with liveview running is causing the corruption. Some regs maybe?
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: baladev on May 17, 2019, 01:22:35 PM
I can't believe you're not seeing it. Any card over 32GB should show it as long as you are using a native EF-M lens with image stabilization -- not an EF/EF-S with the adapter.

I loaded up Danne's changeset a8ccb36 (April 11) on a SanDisk Extreme Pro 128GB card and -- sorry, shutter-bug is present. Didn't think it was going to work but needed to see for myself.

[EDIT] Tried this too:

Switching from video to photo mode or shooting stills while in photo mode doesn't clear out the shutter-bug. Danne himself said it's working for him.

a1ex--I knew it was a long shot that the shutter-bug would disappear on this build but since Danne was doing some tweaking on the sd_uhs module I thought maybe it would do something with the card that would delay the boot process just enough--but no such luck.

Do you believe me it works the way I described or should I make a video? Configuration is exactly as I described above. Native EF-M kit lens used.

BTW I have 3 EOS M cameras, one is a Japanese version. The screen on it is a bit different (it has bluish anti-glare coating) maybe some internals are different too? Maybe there are slightly different versions of the camera for different markets? The one I use with ML atm is original Aussie variety.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: niono on May 17, 2019, 04:09:18 PM
Hi,guys
 I testing my lots of sd cards for my eos m, toshiba 64g sdxc is best,it can be wrating in 55mb/s,when i change to 14 bit,is recording few seconds then stoped.
  that is not point!,i find the inel m.2 have a sdio route,so i google it, woooo,look!!!!


(https://www.magiclantern.fm/forum/proxy.php?request=https%3A%2F%2Fi.ibb.co%2F4KZXFVd%2FEXM2E-3.jpg&hash=5721e3efdb27c7f9a6e42b862189c16d) (https://ibb.co/4KZXFVd)

(https://www.magiclantern.fm/forum/proxy.php?request=https%3A%2F%2Fi.ibb.co%2FvHNCL1c%2FEXM2E-1.jpg&hash=dfc900d60a9f82b062bb5eafafe7d76d) (https://ibb.co/vHNCL1c)
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: dfort on May 17, 2019, 05:18:30 PM
@baladev - Great, I've got three of these puppies too. All exhibit the shutter-bug. Here's a video I made a while back:


If you don't mind doing some further testing--

Do you have another EF-M lens with IS that you can test? There's a slight chance that maybe the IS isn't working properly on your lens.

Check the capacity of your 128GB card. There were some "fake" cards sold that weren't labeled properly. If it is less than 32GB it might not show the bug.

Finally--the shutter-bug is fickle. At one point it wasn't showing up when the card was freshly formatted in the camera but it eventually came back.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: baladev on May 17, 2019, 06:27:24 PM
@dfort
Oh, a red one - very sexy! I have a white and two black ones. The white is very pretty (even my wife who's not into cameras said that).

I've got x3 18-55 kit lenses and x2 22mm f2. IS is working properly on this one, I've just tested - tried to turn it off and on and see a very distinct difference in shakiness of picture on the screen. But, I will test two other lenses tomorrow and report back. So, you want me to disable all modules, start in photo mode and take photos?

All my cards are genuine SanDisk stock - I only buy from authorized distributors, plus I get proper speed with them (close to 60 mb/s) and the capacity is what it should be - filled them to their capacity a few times.

Right, I wasn't even aware of this bug until today, when this discussion started, I will keep an aye on it. However, Danny said above "I got the same set up and it´s not happening here." So, I'm not the only one?
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: DarkCAL on May 18, 2019, 06:40:18 PM
@Danne

I am running ML build May16
Below is a picture of my run & gun rig (if not allowed please remove)
And here is a YouTube link to a test video I shot yesterday


Settings used are :
mv1080 MCM rewire
Bitdepth 12
Ratios 16:9
RAW video ON
Resolution 1736x976
Aspect ratio 16:9
14 bit lossless
Preview Realtime
Global Draw LiveView
Magic Zoom HalfS, Med, TL, 2:1
All modules activated
FPS override 24 fps
Image fine-tuning as close as possible to 1/48 sec
Picture style Faithfull

Footage shot using a Rokinon 35mm T1.5 Cine EF
Viltrox M2
T8.0
ISO 400
Available light

All works fine
Footage is awesome !

Only issue is when I use my F570 monitor and if I turn Kill GD OFF using the above setting it gives me pink frames

I know it might or is just a small detail
But when this would be fixed / resolved ML will be running 100% on my EOS-M
And I suppose on many others as well

Thanks again for all the effort you're putting in
Just recently got my EOS-M but really loving it as you can see !
.

(https://www.magiclantern.fm/forum/proxy.php?request=https%3A%2F%2Fi.ibb.co%2FggPkYFN%2F20190517-125559-2.jpg&hash=a7ec77ee9f7c026d10e741c9f5b4b1cb) (https://ibb.co/ggPkYFN)

(https://www.magiclantern.fm/forum/proxy.php?request=https%3A%2F%2Fi.ibb.co%2FvzVKRXP%2F20190517-120644-2.jpg&hash=70a80710eae7e7c1d1e15b4879ead6b4) (https://ibb.co/vzVKRXP)
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: kuchka94 on May 18, 2019, 09:23:42 PM
Using build 16 may, and I can say that sd uhs module doesn't work for me. Speed is near 30 mb. Can't test exactly, there is no bench module.
Jul03 2018 with module + script give me near 57mb.
When I load old module + script on 16 may build, it start to work fine, so I can get continuous footage in RAW.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: DarkCAL on May 18, 2019, 11:05:53 PM
@kuchka94

Rookie here on a crash course
How can I test the speed of the sd uhs module please ?

Just test running ML build May18
Runs fine
Except for the same problem when using my monitor
Kill GD OFF as posted above in ML build May16 (and the previous builds) gives pink frames
About 4 per minute of footage
With Kill GD ON not one pink frame !
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: kuchka94 on May 19, 2019, 02:09:35 PM
I tested that way:
Choose raw footage size and proportions and see demand of the speed in the bottom. For example 36mb.
After start record and see at the top right color of timer, if red - speed is not enough for 36mb/s footage, if yellow - almost enough, green - continuous footage.
So for my case on jul 03 2018 build I had settings for 55-60mb/s footage, and green, times yellow, timer, that allowed me get continuous shoots.
But now I have red and yellow timer, and footage stops on settings 30mb/s.
For me that means that sd uhs module doesn't work.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on May 19, 2019, 02:20:09 PM
You can build your own sd_uhs module which likely will fix your issue. Here you go:
https://www.magiclantern.fm/forum/index.php?topic=16040.msg216464#msg216464
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: lightspeed on May 21, 2019, 08:34:19 AM
for the anamorphic mode, would it be possible to have a stretch of .5 instead of the .33 so it doesn't upsample as much.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: masc on May 21, 2019, 10:28:16 AM
for the anamorphic mode, would it be possible to have a stretch of .5 instead of the .33 so it doesn't upsample as much.
Physically impossible. You can read each column or each third column. Otherwise you'll never read in some colors. Look at a bayer matrix... This is also why there is a 1x1 and a 3x3 mode, but no 2x2.
(https://www.magiclantern.fm/forum/proxy.php?request=https%3A%2F%2Fupload.wikimedia.org%2Fwikipedia%2Fcommons%2Fthumb%2Fe%2Fef%2FBayer_matrix.svg%2F220px-Bayer_matrix.svg.png&hash=9031178ed88a6ee323e394f9b8651b71)
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: lightspeed on May 21, 2019, 10:00:24 PM
but it is already stretched to 16:9. it just uses a lower resolution. Can we not stretch it to 16:9 but using the resolution in the 2.35 setting?
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: masc on May 21, 2019, 10:48:07 PM
but it is already stretched to 16:9. it just uses a lower resolution. Can we not stretch it to 16:9 but using the resolution in the 2.35 setting?
There is nothing stretched. It is cropped!
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: lightspeed on May 22, 2019, 01:16:15 AM
So it is not possible to turn 1664 x 2126 into 3763 x 2126
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: masc on May 22, 2019, 10:07:01 AM
Have you read and understood this (https://www.magiclantern.fm/forum/index.php?topic=9741.msg216788#msg216788) post?

This is the sensor:
RGRGRGRGR...
GBGBGBGBG...
RGRGRGRGR...
....

Now read each column (=1x1=no stretching needed):
RGRGRGRGR...
GBGBGBGBG...
RGRGRGRGR...

Now read each 3rd column (=1x3=needs 3x horizontally stretching in post)
RGR...
GBG...
RGR...

Now read you suggestion, each 2nd column (=1x2=needs 2x horizontally stretching in post)
RRRR...
GGGG...
RRRR...
But where is the blue gone?! ---> impossible.

On the other side, 1664x2126 is already to large to get continuous recording. How do you want to save the double data at the same time?
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: lightspeed on May 23, 2019, 03:56:31 AM
I see. thanks
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: baladev on May 23, 2019, 05:48:48 PM
- Possible fix for corrupted frames in anamorphic modes

For all "anamorphers" out there you may wanna test this version since it seems we can get corruptionless footage. Not that there was a lot of it but still.
@Danne

Tested your latest build - crop_rec_4k_mlv_snd_isogain_1x3_presets_2019May20.EOSM202
Filmed two clips - 10 and 5 minutes long at 1072x1810 25fps 12bit with 4k anam preset.
In the 10 min clip I found 23 corrupted frames in the first 4m20s of it, didn't check after that.
In the 5 min clip I found 0 corrupted frames, the difference is that I was filming during sunset and the second clip was much darker.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on May 23, 2019, 06:03:29 PM
Nice with test.
I wonder if the original preset 1072x1900 works with 10bit and 24fps? The 16:9 is really only experimental. I rely on 2:35.1 to see if they can be considered reliable.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: baladev on May 23, 2019, 06:41:05 PM
Do you mean the 1488x1900 preset you get by running your cinema 2:35 script? I will test it, but it seems to me current anamorphic presets get corruption when they are close to maximum writing speed when data pipeline is saturated and something starts to break. So, one needs to make sure not to go above 60-62mbs or maybe even lower and things should be ok?
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on May 23, 2019, 07:10:24 PM
New version:
https://www.magiclantern.fm/forum/index.php?topic=9741.msg208959#msg208959

@Baladev.
Untested:
I did following(ananorphic rewired mode). If selecting 16:9 10 bit you´ll get 1120x1900 but if you select 12bit it will instead do 1064x1800. Hit menu button if changing bitdepth. Test if 12bit is corruption free with 25fps.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: masc on May 23, 2019, 08:49:24 PM
I did following(ananorphic rewired mode). If selecting 16:9 10 bit you´ll get 1120x1900 but if you select 12bit it will instead do 1164x1800. Hit menu button if changing bitdepth. Test if 12bit is corruption free with 25fps.
Really? But 1164x1800 is 17.5x9 ... is that correct?
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on May 23, 2019, 09:15:55 PM
Yes, the magic ratio @masc  8)
Na, sorry typo, should be 1064x1800.

Added also 12bit reduction resolution in 2.35:1 mode so this will jump into 1328x1700 when selecting 12bit(use menu button to activate regs).
Reuploaded a build in above link.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: baladev on May 24, 2019, 07:33:36 AM
Ok, did a tests with these settings:
crop_rec_4k_mlv_snd_isogain_1x3_presets_2019May23.EOSM202
4k anamorph preset, 1064x1800 12bit 25fps iso100
Bright sunny day, lots of trees and some white roof tops in the frame (can't post pictures for some reason).
Scene underexposed by ~1 stop (i believe vertical lines in the histogram are stops?) to avoid highlights clipping and to reduce data rate.
Two clips - 10 and 5 minutes.
For the first 6 minutes the time indicator was green, then became orange when the sun came out from behind a cloud, making rooftops very bright.
Result - 0 corrupted frames.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on May 24, 2019, 08:35:38 AM
Wow. That sounds great. Thanks for the test.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Jip-Hop on May 24, 2019, 05:30:17 PM
Bought the EF-M 22mm f/2 STM today and it came with a free EOS M. Now I've got 2! Can't wait to start using ML extensively on both of them ^^
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: baladev on May 25, 2019, 04:59:30 AM
Try turning off all the modules, start camera in photo mode and shoot a still with that kit lens attached. Chances are the shutter won't fire.
I'm now on the latest Danne's build - crop_rec_4k_mlv_snd_isogain_1x3_presets_2019May23.EOSM202
Just repeated the test with all 3 of my 18-55mm kit lenses.

With two I couldn't reproduce the shutter bug by doing this:
1 disable all modules
2 start camera in photo mode
3 take pictures
4 switch to video mode
5 take pictures
6 switch back to photo mode
7 take pictures

The camera focused and took photos fine.

With the third lens I was getting one misfire (when I press the shutter button and nothing happened) at 2nd and 7th steps. First attempt of taking photo didn't work, consecutive attempts worked fine.

A few days ago when I was trying to purposefully reproduce the shutter bug with the original lens, I managed to succeed by messing around in ML menu and doing crazy things like disabling modules and re-enabling them again right away:) Then I would get one misfire and then it worked fine again. One time I managed to get it permanent - all attempts of taking photos let to shutter not firing - don't remember what I did ( I think I started in video mode and filmed a short raw clip and then switched to photo and attempted to take a shot), but a camera reboot fixed it and it went back to normal.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: berechiah on May 27, 2019, 10:15:25 AM
Bought the EF-M 22mm f/2 STM today and it came with a free EOS M. Now I've got 2! Can't wait to start using ML extensively on both of them ^^

Can u give me a like I'd actually buy one right now if I could

I'm in Ireland
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: berechiah on May 27, 2019, 10:16:53 AM
Thanks Danne and baladev
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: 2blackbar on May 28, 2019, 05:00:19 PM
RAW vs H.264 highlight details on CANON M if someone is tempted to go back to H.264
(https://www.magiclantern.fm/forum/proxy.php?request=http%3A%2F%2Fpicplus.ru%2Fimg%2F1905%2F28%2F9c221615.jpg&hash=5896c9b7a0a4732f59ff4d857cba65f9)
(https://www.magiclantern.fm/forum/proxy.php?request=http%3A%2F%2Fpicplus.ru%2Fimg%2F1905%2F28%2Fb6d0343c.jpg&hash=3f9984c2a8701b0e9bc32163e06b05d0)
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: lightspeed on May 28, 2019, 11:12:14 PM
Is there anyway to have a 4x crop? instead of the 3.33? I have a lens that vignettes in the corners
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: theBilalFakhouri on May 28, 2019, 11:49:52 PM
Is there anyway to have a 4x crop? instead of the 3.33? I have a lens that vignettes in the corners

2048x1080 has 4.07 crop factor, chose it from mlv_lite submenu.

Here is a useful calculator for resolutions and crop factors .. etc
https://rawcalculator.netlify.com/calculator_desktop

Edit: you can use main dial to make small increments, from mlv_lite submenu highlight the resolution and use main dial to decrease/increase resolution.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: lightspeed on May 29, 2019, 12:00:01 AM
Thanks. I guess there isn't a way to use it with the 3k setting. The vignetting is actually off center. is it possible to scan the image to the right at all?
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on May 29, 2019, 06:47:17 AM
Thanks. I guess there isn't a way to use it with the 3k setting. The vignetting is actually off center. is it possible to scan the image to the right at all?

In crop mode sub menu you can reach cmos5. Try setting it to 300 and onwards. Test 320, 340 etc. Also 400 and above. Maybe you find a good setting. Then report back.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: lightspeed on May 29, 2019, 09:02:25 AM
I tried some of them but was not able to fix the vignetting. guess the lens is just to small
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: rev787 on May 29, 2019, 05:10:56 PM
Going through some old threads, Danne's dual-iso demo file at #1860 seems doesn't flicker. So I tried to build from last commit of Jan.11, still got flicker. May be that clip is too short to show that. At least I learned how to compile ML today and didn't break my camera. Thanks Danne and all the devs.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: dfort on May 29, 2019, 05:12:13 PM
...The vignetting is actually off center. is it possible to scan the image to the right at all?

If you can compile you can adjust the skip offsets to center the image. There was a similar issue on the 60D. You can read how we resolved that on the Raw Video framing is off when using 60D's 'Movie Crop Mode'. Help! (https://www.magiclantern.fm/forum/index.php?topic=16912.0) topic.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Jip-Hop on June 01, 2019, 04:30:40 PM
First time taking my EOS M for a spin outside.
I used the latest build:
crop_rec_4k_mlv_snd_isogain_1x3_presets_2019May26.EOSM202

So far I'm really impressed with the results.
Filmed mostly in mv1080p MCM rewire.
Didn't have any major issues, but I noticed I have to toggle the Canon menu button almost every time I startup the camera.
It seems to start up in crop mode by default.
Clicking the Canon menu button twice gave me the expected wider field of view.

This is my ML folder with the settings:
https://www.dropbox.com/s/eqonfs69xx9aaqm/M28-1255.MLV?dl=0

When I filled up my SanDisk Extreme PRO 64GB 170MB/s card, I continued with a slower KomputerBay card. Didn't get continuous recording on that one, but that was expected.

However, six clips came out at 1736x696 resolution.
Here's one of the clips: https://www.dropbox.com/s/eqonfs69xx9aaqm/M28-1255.MLV?dl=0.
MLV App opens it with a height stretch of 1.67 to make it 1736x1160 which is a 3x2 aspect ratio.

The rest of the clips are 16x9 at 1736x976 resolution, as expected.

What could be the cause those clips were recorded at a different resolution?
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on June 01, 2019, 06:12:03 PM
As you say. Pressing canon menu will mostly settle all correct registers.
If it starts in crop mode. Try clearing ml config files and start over.
If it recorded in mv720p mode regs did not apply correctly. Why I don't know. There's still plenty to refine regarding presets but I do my best.
On the other hand I look at the crop_rec as a truly creative window into ml work and making it possible to test out ideas as it's connected to registrys and raw back end stuff.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Jip-Hop on June 01, 2019, 07:40:55 PM
Thanks! Just wanted to post my findings in the hope they'd be helpful for further development :)
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on June 02, 2019, 09:32:59 AM
New version:
https://www.magiclantern.fm/forum/index.php?topic=9741.msg208959#msg208959

- Should no longer start in x3 zoom mode on start up(took out the x3 config file fix since interefing with crop_rec)
- Should be a little more robust when starting camera in rewired modes. Registrys should apply and not randomly miss out on crop_rec patches. (Well it´s not perfect. Could still make it start in mv720p 29.997 but better.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: dokipen on June 02, 2019, 12:17:33 PM
Thanks Danne, I noticed the 3x crop startup issue too. Downloading the new build now. I only recently got back into ML after being away for a few years (having kids takes up your life man).

Anyways, my dormant EOS-M has now noy only been given new life but is one of the best cameras out there now that is has usable raw video. 1080 MCM rewire is my go now :)

Thanks so much. Really appreciate it.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on June 03, 2019, 04:39:21 AM
New version:
https://www.magiclantern.fm/forum/index.php?topic=9741.msg208959#msg208959

- Still addressing start up routines. Once in a while crop_rec engio and adtg regs would not apply. Hopefully fixed now. Issue seems related to sd_uhs module. Maybe some race condition.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: berechiah on June 03, 2019, 10:28:05 AM
Thanks Dannie

Your some man to be able to do these things
I have the Eos m for about 5 or 6 months now
and its just getting better and better !!!!


PS I just saw today (I don't know if it was there all along)
set frame rate to 30fps

So happy to see it I love to slow 30fps down
One thing I did notice is there are some pink frames
any idea how ro get rid of them?

Thanks for everything
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on June 03, 2019, 10:39:56 AM
Try kill global draw under RAW video menu.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: berechiah on June 03, 2019, 11:04:41 AM
ILL give it a go now

your prob sick of this but

YOUR A SUPERSTAR!

THANKS
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: berechiah on June 03, 2019, 11:25:59 AM
Try kill global draw under RAW video menu.

GAVE IT A GO NOW

It works
no pink frames
I recorded for 1 min and no pink frames
where as before I had about 10 or so per minute

Thanks Danne your a gentle man
Really appreciate the reply
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on June 03, 2019, 12:57:12 PM
Cool.
Uploaded a new version just now. Shutter on display seems more correct now. Some more bugs.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: berechiah on June 03, 2019, 03:23:45 PM
Hi I did some videos today and this is just copy and paste the text in the browser with the info from the video.

If you notice M03-1221.MLV the res is 1800 x 1012
I looked at the video and there is no missed frames or pink frames

what is this about? I think it might be fault but its a fault for the better right?




Filename   Preview    Frames   Audio   Resolution   Framerate   Duration   Camera Model   Camera Serial   Lens Name   Date/Time   Shutter   ISO   Aperture
M03-1217.MLV      1258   yes   1736 x 976   30.012   00:41   Canon EOS M   2ADA60C98D   EF24-105mm f/4L IS USM   2019-6-3 12:17:38   16ms   100   f/5.6
M03-1221.MLV      220   yes   1800 x 1012   30.012   00:07   Canon EOS M   2ADA60C98D   EF24-105mm f/4L IS USM   2019-6-3 12:21:04   16ms   100   f/3.5
.fseventsd   
M03-1218.MLV      1248   yes   1736 x 976   30.012   00:41   Canon EOS M   2ADA60C98D   EF24-105mm f/4L IS USM   2019-6-3 12:18:31   16ms   100   f/4.5
M03-1219.MLV      2017   yes   1736 x 976   30.012   01:07   Canon EOS M   2ADA60C98D   EF24-105mm f/4L IS USM   2019-6-3 12:19:24   16ms   100   f/4.5
M03-1137.MLV      118   yes   1736 x 976   30.012   00:03   Canon EOS M   2ADA60C98D   EF24-105mm f/4L IS USM   2019-6-3 11:37:31   16ms   100   f/5.6
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on June 03, 2019, 03:27:35 PM
It's movie crop mode getting confused with crop_rec regs. Use the latest build. Shouldn't happen in recent builds.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: berechiah on June 03, 2019, 04:12:03 PM
Thanks for that. I will download the crop_rec_4k_mlv_snd_isogain_1x3_presets_2019Jun03 1.EOSM202

thanks
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Apxub on June 05, 2019, 10:01:48 PM
Hello people!
5d mark ii has theese maximum mlv resolutions for 4:3 aspect ratio and continuous rec:
                    standart mode  = 1664x1248 1.12x
crop1920 1:1 not centered = 1024x768   5.48x
       crop3.5k 1:1 centered  = 1600x1200 3.51x

Could someone write here the same max.with "x factor" for 4:3 ratio continuous rec on EOS M ?
All crop modes centered?
Actual correct framing only possible in ml grayscale preview?
Its also a frozen frame while recording with ml grayscale?
Moire and aliasing are strong without crop mode?
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on June 05, 2019, 10:10:14 PM
1600x1158 mv1080p mode
X3 digital zoom same
X5 zoom, probably a little more depending on height and coninuous or not.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: dokipen on June 06, 2019, 10:16:42 AM
Something I noticed that changed between the 2nd June and 4th June builds.

2nd June MCM rewire 16:9, the max res is 1800x1012 when I thought it should be 1736x976
4th June the res goes back to what it should be but the live view preview shows wrong for resolutions that aren't the max 1736x976. The crop goes in from the side but the full height remains until you lower it to around 1392x794 and then the top starts cropping. but it looks like the wrong aspect ratio.

Keep up the good work danne and everyone. I'm very much enjoying this community and the amazing results.

Thanks
Dan
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on June 06, 2019, 10:53:47 AM
Something I noticed that changed between the 2nd June and 4th June builds.

2nd June MCM rewire 16:9, the max res is 1800x1012 when I thought it should be 1736x976
4th June the res goes back to what it should be but the live view preview shows wrong for resolutions that aren't the max 1736x976. The crop goes in from the side but the full height remains until you lower it to around 1392x794 and then the top starts cropping. but it looks like the wrong aspect ratio.

Keep up the good work danne and everyone. I'm very much enjoying this community and the amazing results.

Thanks
Dan

It should always be 1736x976. If not just press canon menu and the reg will correct itself.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: dokipen on June 06, 2019, 11:05:03 AM
Yes the canon menu does refresh the res, but after a second or so it jumps back to the 1800x1012 res. In the 4th June build that doesn't happen but it has the preview crops display height thingy.

Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on June 06, 2019, 11:10:25 AM
Oki, I noticed this too now. That has probably been there all along. It seems to work if you set ratios to off in crop mode sub menu. Then you can use RAW video resolution changes. WIll take a look later on this. And yeah, use 4th june build. I was experimenting a lot before that with a few things trying to fix refresh stuff.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: lightspeed on June 07, 2019, 03:00:01 AM
for some reason fps override doesn't work in 3k. is there a fix for this?
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on June 07, 2019, 06:53:46 AM
New version:
https://www.magiclantern.fm/forum/index.php?topic=9741.msg208959#msg208959

- Adressed 30fps when recording in mcm rewired mode(16:9 and 2.35:1 ratios). More robust timing. Should work also with global draw enabled
Could you test @berechiah?

This fix will need two new focus pixel maps which dfort kindly enough built already:
https://bitbucket.org/daniel_fort/ml-focus-pixels/commits/31f8b131007f6f7281dd5e9e3d4e93c5c29b0d26

Put following two map files inside Mlv App:
80000301_1872x1060.fpm
80000301_1872x1059.fpm

Find map files here(download whole repo):
https://bitbucket.org/daniel_fort/ml-focus-pixels/downloads/

Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: berechiah on June 07, 2019, 09:17:02 AM
Thanks for this Danne
I'll download it now and will use it later today

I'll get back to you tonight with the results.

Your a star!
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: dokipen on June 07, 2019, 10:13:45 AM
hi danne, that june 07 file doesn't seem to be in the downloads section yet :)

I'll be happy to give it a whirl as soon as its up though.

Cheers
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on June 07, 2019, 10:20:40 AM
Uploaded now!

EDIT: Yet another upload right now. Refined timers 30fps mode
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: marcelolippi on June 07, 2019, 03:45:35 PM
I'm starting to classify my documentary filmed with eosm 4.5k 2.35: 1 in davinci, setting the project in 4k dci but the closest option is 2.39, how do you work? do you leave the black bands and then cut them on delivery?
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on June 07, 2019, 03:58:12 PM
I'm starting to classify my documentary filmed with eosm 4.5k 2.35: 1 in davinci, setting the project in 4k dci but the closest option is 2.39, how do you work? do you leave the black bands and then cut them on delivery?
Interesting. Have not looked into post production issues. Maybe I should include a 2.39:1 preset in there s well as it seems what is used for cinema these days rather than 2.35:1.

Your issue, could you describe more in detail, maybe upload a few screen grabs?
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: marcelolippi on June 07, 2019, 04:03:50 PM
Maybe tomorrow, now work :(...THANKS
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: berechiah on June 07, 2019, 11:23:38 PM
Interesting. Have not looked into post production issues. Maybe I should include a 2.39:1 preset in there s well as it seems what is used for cinema these days rather than 2.35:1.

Your issue, could you describe more in detail, maybe upload a few screen grabs?

Hey buddy
I tried the latest build and I recovered for 3min
with out global draw checked
so normal mode

and its PERFECT

I just mlvfs and put files directly into Davinci

Your a serious dude when it comes to this
I have to say
WELL DONE
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: henricusmaria on June 08, 2019, 03:38:43 AM
@berechiah Sounds good! Can you give your settings?
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on June 08, 2019, 08:53:01 AM
Thanks, great to hear it´s working.
@henricusmaria
He´s using mcm rewired mode, canon meny set to ntsc and 30fps. Global draw on.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: lightspeed on June 08, 2019, 01:55:49 PM
may be a strange idea but anyone thought about shooting with two Eos m at the same time. Wouldn't you get 5 k for the cost of the two cameras which would be around 300 dollars these days.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: whitelight on June 08, 2019, 06:59:10 PM
may be a strange idea but anyone thought about shooting with two Eos m at the same time. Wouldn't you get 5 k for the cost of the two cameras which would be around 300 dollars these days.

Mmhhhh... That reminded me a friend who said "If you need a 3D printer, why don't you just use two 2D printers together so you get a 4D print and then get rid of 1D?"
Jokes aside, how do you imagine this would be feasible?
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: ilia3101 on June 08, 2019, 08:00:57 PM
Do it as a panorama, always wanted to try that. It's a very good idea.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: lightspeed on June 08, 2019, 09:43:09 PM
Or shoot 2000x2000 and then when you combine it will be 4000x2000
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: 2blackbar on June 08, 2019, 10:46:18 PM
Why 2 ? Cinerama did it with 3 cameras for widescreen
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on June 09, 2019, 12:09:43 AM
Now we're talkin'.
I got 4 eos m's. Just sayin'...
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: whitelight on June 09, 2019, 12:31:52 AM
You should find a way to arrange three cameras similarly to this

http://stanleylivingston.com/sitebuildercontent/sitebuilderpictures/CINERAMA_CAMERA_3_LENSES.jpg

Maybe three eos M with 22/2 in vertical configuration could do the trick
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: lightspeed on June 09, 2019, 01:39:48 AM
My thoughts as well. You could connect 2 by the tripod mount and shoot vertically
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: baladev on June 09, 2019, 04:05:59 AM
Or shoot 2000x2000 and then when you combine it will be 4000x2000
I don't think this would be optimal. You will have some vignetting and distortion in the corners/edges. You would need to correct these in post, otherwise you will have darker lines/blobs in the middle of your video (like in the example video above) and also the stretched/distorted corners will meet in the middle of your frame and you will get a weird looking picture. Also, how about sharpness decrease in the corners? For this reason when making panoramas you always overlap shots by about 30%, maybe this won't be a problem with low res videos..

Now we're talkin'.
I got 4 eos m's. Just sayin'...
Gosh, and I thought my 3 were an excess. How did you come to own 4?!

All in all, this is a neat idea, I need to try it out.. I imagine a custom mounting plate should be used - cameras either looking away or towards each other.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on June 09, 2019, 09:10:53 AM
They sell sometimes for no money over here. A1ex unbricked one of them and them so here I am with 4 beuaties. But selling one. Three is enough ;)
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: berechiah on June 09, 2019, 11:27:20 AM
@berechiah Sounds good! Can you give your settings?

So sorry I didn't see this
I'll write the full list of info on here later for you

But there is a guy on YouTube called zeek
Just type "eos m zeek" and he has some seriously good videos on all this info
I'd be lost without his help also its extremely informative

Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: dfort on June 09, 2019, 05:39:47 PM
Three is enough ;)

Make sure to make room for an M2 and an M50 -- and get a few of those shutter-bugged lenses too.

(https://www.magiclantern.fm/forum/proxy.php?request=https%3A%2F%2Flive.staticflickr.com%2F65535%2F48030710436_935438cbb2.jpg&hash=ff7e6419d47b19ea37af67df7602bfd4) (https://flic.kr/p/2gbiWRb)
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on June 09, 2019, 06:31:49 PM
You miss the silver version dfort ;)

New version:
https://www.magiclantern.fm/forum/index.php?topic=9741.msg208959#msg208959

- Added the more up to date cinema ratio 2.39:1 into the preset menu in crop mode sub menu. Works on all presets:
- Updated the lua cinema script to enter 4K anamorphic rewired 2.39:1 mode as starting point

2.39:1
(https://www.magiclantern.fm/forum/proxy.php?request=https%3A%2F%2Fi.postimg.cc%2Fx8Vhjy5g%2FVRAM0-PPM-scaled.png&hash=a6a58a1b403f6c906bd5c021d3dc56c8)
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: dfort on June 09, 2019, 11:23:43 PM
You miss the silver version dfort ;)

My first EOSM was silver.

(https://www.magiclantern.fm/forum/proxy.php?request=https%3A%2F%2Flive.staticflickr.com%2F1607%2F24557694310_136815b315.jpg&hash=74e60fe438e4549940ed8ce10ec4f276) (https://flic.kr/p/Dq5AWA)

Did a lot of experiments on that camera.

(https://www.magiclantern.fm/forum/proxy.php?request=https%3A%2F%2Flive.staticflickr.com%2F1594%2F24485578289_afa133e3ea.jpg&hash=0cdb17cd865699c910a07f9d48f6508a) (https://flic.kr/p/DiGZmV)
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on June 09, 2019, 11:37:35 PM
Those rig days. Almost broke my back   :P
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: lightspeed on June 10, 2019, 01:58:45 AM
I've been looking through the forums but can anyone tell me if turning off sound and kill global draw will result in longer recording times? does setting to greyscale have any effect?
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: baladev on June 10, 2019, 04:54:27 AM
I've been looking through the forums but can anyone tell me if turning off sound and kill global draw will result in longer recording times? does setting to greyscale have any effect?

From my experiments turning off sound and killing global draw will definitely help to either make a recording a bit longer or if it is borderline continuous become one. Not sure what you mean by greyscale, if you mean setting preview to Frozen LV, it will help a bit as well, but not as much as turning LV off altogether.

From my experiments, the biggest improvement comes from changing bitrate from 14 bit to 12 bit - improvement of almost 11% in terms of reducing generated data. Strangely, going from 12 bit to 10 bit reduces data by only 7.5% - still a good improvement though. Turning off sound and killing global draw has much smaller effect than reducing bitrate. I never measured it but I would say maybe 2-3%.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on June 10, 2019, 06:42:32 AM
Kill global draw will have a bigger impact than turning off wav. Tested grayscale preview but couldn't see any speed difference. Frozen liveview will have a big impact, even if using halfshutter to get framing preview too.
Workaround when using 10bit for example in crop mode sub menu is doing the same as when reducing to 12 or 11 bits in RAW video section. Not as sophisticated but works.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: henricusmaria on June 10, 2019, 08:54:10 AM
So sorry I didn't see this
I'll write the full list of info on here later for you

But there is a guy on YouTube called zeek
Just type "eos m zeek" and he has some seriously good videos on all this info
I'd be lost without his help also its extremely informative

Thanks. I am familiar with Zeek’s videos. Mcmrewire still gives me too much aliasing/moire. Maybe it’s the lenses I’m using (ef-m lenses) or something in the settings. But I have a feeling it’s the lenses. When I shoot in moviecrop mode it’s much better, but the crop factor..
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on June 10, 2019, 09:34:21 AM
Anamorphic or zoom modes. There's no other way killing aliasing.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: baladev on June 10, 2019, 09:37:53 AM
Workaround when using 10bit for example in crop mode sub menu is doing the same as when reducing to 12 or 11 bits in RAW video section. Not as sophisticated but works.
Are you saying changing bitrate in crop mode sub menu is different from doing the same in RAW video section?
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on June 10, 2019, 10:07:41 AM
Yes. It's not working from RAW video section. Workaround is changing analog gain regs directly in crop mode submenu. So, always stay in 14bit lossless then change bitdepth in crop mode sub menu.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: henricusmaria on June 10, 2019, 10:09:39 AM
Thanks Danne.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: ricardopt on June 10, 2019, 12:30:18 PM
Hi everyone

Following Danne's advice im trying anamorphic mode (1x3 pixel binning), i start the lua script and then select 4k anamorphic and select 25fps but i get a zoomed in video, is this correct? Also when i select to autorun the lua script it says "cinema script is now disabled" everytime i turn on the eos m, autorun is supposed to be the oposite?

Thanks for any help/info.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on June 10, 2019, 12:44:11 PM
Yes, no autorun with this script. You run the script once and it sets you up with all you need for filming in anamorphic mode. All settings persists.
Real time(cropped) preview while pressing half shutter, otherwise framing preview.
Download latest version, will get you into anamorphic rewired mode, slightly better real time previewing.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: ricardopt on June 10, 2019, 01:04:15 PM
Thanks Danne,im using the latest version, my doubt was about the zoom in effect, is it normal? when i started to use magic lantern some modes had a zoom effect but by reading the forum tought that 1x3 mode didnt have the zoom in effect, also in orden to use 1x3 binning i need to select 4k anamorphic? When "hovering" 4k anamorphic it says it uses it, the other modes mcm rewire etc dont use that method?



Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on June 10, 2019, 01:34:45 PM
Not sure what you are asking here. To verify you recorded a file in anamorpic mode simply drop it in Mlv App and export a still file. Check resolution, should be upsampled.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: baladev on June 10, 2019, 02:20:12 PM
ricardopt

You are correct, when using anamorphic mode you only get a crop of the sensor. In fact, the only mode that gives you full sensor picture is mv1080p varieties, all other modes only read a part of the sensor, hence what you call a zoom in effect. The difference between 1x1 and 1x3 (anamorphic) modes is that the latter is able to capture a larger part of the sensor. With 1x1 mode you get around x3 crop, with 1x3 you get around x1.5-1.6 (crop depends on the resolution chosen, the higher the res, the larger the crop,  the smaller the crop factor).

Does it make sense?
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: masc on June 10, 2019, 02:32:32 PM
In theory 1x3 mode must not have a crop factor (okay, very little crop: 1664 columns from 1736). We just crop it slightly to not get too much corrupted frames and to be able to record longer clips.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: baladev on June 10, 2019, 02:37:16 PM
I think you meant to say 'doesn't have to have a crop'. Obviously we crop because the cameras don't keep up with capturing and recording full sensor readout even in 1x3 mode, so we are bandwidth limited.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on June 10, 2019, 02:47:39 PM
I implemented it on 5D3, runs something like 5.5k 16:9, Can´t fully remember but it was quite the difference. Surprised nobody started recording anamorphic with this cam as well.

Also just uploaded a version for eosm which can record anamorphic rewired 1736x1900(5208x1900) when ratios is set to off in crop mode sub menu.
https://bitbucket.org/Dannephoto/magic-lantern/downloads/crop_rec_4k_mlv_snd_isogain_1x3_presets_2019Jun10.EOSM202.zip

Continuous, hell no  :P
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: baladev on June 10, 2019, 03:20:44 PM
Thanks Danne

Should try this new build and see if it is pink frame free. With your April builds I got continuous at 1120 x 1890 24fps 12bit, but it was pink frame hell.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on June 10, 2019, 03:25:21 PM
Thanks Danne

Should try this new build and see if it is pink frame free. With your April builds I got continuous at 1120 x 1890 24fps 12bit, but it was pink frame hell.

If you set ratios to 16:9(crop mode sub menu) and 12bit in 4k anamorphic rewired mode it sets resolution to 1064x1800. Tested that?(Don´t forget to press canon menu and back when changing bitdepth by the way)
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: baladev on June 10, 2019, 04:36:06 PM
The April 11 build that I used for a while allowed me to set resolutions up to 1890 vertical in 4k Anamorphic Rewired. Lower resolutions, around 1800 vertical in 16:9 gave almost pink frame free footage with kill GD on. The lowest I tested was 1072 x 1810 24fps 14bit. And yes, I'm in the habit of going to Canon menu now every time I change something.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: henricusmaria on June 10, 2019, 04:37:08 PM
If you set ratios to 16:9(crop mode sub menu) and 12bit in 4k anamorphic rewired mode it sets resolution to 1064x1800. Tested that?(Don´t forget to press canon menu and back when changing bitdepth by the way)

I’ve tested it with one of the latest builds. It worked fine, no pink frames.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on June 10, 2019, 04:38:03 PM
I’ve tested it with one of the latest builds. It worked fine, no pink frames.
Yes, tested as well, seemed to work fine also with global draw on. Cool.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: ricardopt on June 10, 2019, 06:11:03 PM
ricardopt

You are correct, when using anamorphic mode you only get a crop of the sensor. In fact, the only mode that gives you full sensor picture is mv1080p varieties, all other modes only read a part of the sensor, hence what you call a zoom in effect. The difference between 1x1 and 1x3 (anamorphic) modes is that the latter is able to capture a larger part of the sensor. With 1x1 mode you get around x3 crop, with 1x3 you get around x1.5-1.6 (crop depends on the resolution chosen, the higher the res, the larger the crop,  the smaller the crop factor).

Does it make sense?

Thanks for the explanation, i follow the eosm subforum, untill recently i didnt have time to test the builds, so all my "following" was done by reading comments and reading other people results, i probably misread something about the 1x3 as i tought it didnt have any crop.

Thanks once again for the explanation.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: marcelolippi on June 10, 2019, 08:02:36 PM
You miss the silver version dfort ;)

New version:
https://www.magiclantern.fm/forum/index.php?topic=9741.msg208959#msg208959

- Added the more up to date cinema ratio 2.39:1 into the preset menu in crop mode sub menu. Works on all presets:
- Updated the lua cinema script to enter 4K anamorphic rewired 2.39:1 mode as starting point

2.39:1
(https://www.magiclantern.fm/forum/proxy.php?request=https%3A%2F%2Fi.postimg.cc%2Fx8Vhjy5g%2FVRAM0-PPM-scaled.png&hash=a6a58a1b403f6c906bd5c021d3dc56c8)
Grazie Danne, will be mine settings for the next documentaries
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: ricardopt on June 10, 2019, 10:25:31 PM
here's a few clips, 4k anamorphic, only changed aspect ratio to 16:9 and set 25fps, 1064x1800 resized to 4k, very "clean" videos only selected 3x3 smooth in mlvapp and it was ready to go, @Danne where's the aliasing now? :)
watch in 2k or 4k resolution
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on June 11, 2019, 12:04:44 AM
Oh yes. Clean as clean can be. Very nice looking. Good colors too.
Yes, chroma smooth 3x3 needed. Notified dfort on pixel maps for these new anamorphic modes. Hopefully he finds time soon.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: henricusmaria on June 11, 2019, 11:42:39 AM
here's a few clips, 4k anamorphic, only changed aspect ratio to 16:9 and set 25fps, 1064x1800 resized to 4k, very "clean" videos only selected 3x3 smooth in mlvapp and it was ready to go, @Danne where's the aliasing now? :)
watch in 2k or 4k resolution

Nice clips!
4K anamorphic works nice. For people and plants it works great. However with buildings I sometimes get wobbling/aliasing on vertical lines.
Edit: the wobbling is due to the IS lens
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: dokipen on June 12, 2019, 12:29:53 AM
I like that 4k anamorphics 16:9, I was trying to do something like that myself the other night.

Is there a definitive list somewhere of what the differences are between the different crop_rec modes? I know that mv1080p is 3x3 binning and anamorphic is 1x3 binning but I don't fully understand all the modes and what exactly they do (ie what do 4k anamorphic and 5k anamorphic do differently?). If I haven't searched properly in this thread then please point me in the right direction.

Cheers
Dan
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: 2blackbar on June 12, 2019, 12:00:08 PM
i dont think anyone did that cause menu in ML kinda describes it well.
First modes are for 5x5 zoom,
2.5k zoom modes  are the ones without aliasing but zoomed in and with full shutter speed control
3k and 4k  zoom modes are similar but you cant choose shutter speed above 30 and fps is low so its for timelapses maybe.
next modes arewithout zoom until anamorphic modes on bottom - 4k and 5k modes which have full vertical resolution (every pixel rom sensor is captured) and horizontal binning(every third) So image is stretched but its best quality, comparable to full size photo with full shutter speed and fps control unlike previous 3k and 4k modes.
https://www.magiclantern.fm/forum/index.php?topic=9741.msg215467#msg215467
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: aulden on June 12, 2019, 05:52:55 PM
Would an anamorphic 3:1 mode in the display tab work with the anamorphic croprec mode?
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on June 12, 2019, 06:17:07 PM
Not sure what you mean but what is stopping you from testing?
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: aulden on June 12, 2019, 07:13:10 PM
Not sure what you mean but what is stopping you from testing?

For correcting the real time preview of the rewired anamorphic modes. It only goes up to 2:1, would it be hard to implement a 3:1 mode aswell?
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on June 12, 2019, 07:19:56 PM
I tried some of that a while ago. Seemed not so straightforward. Besides it's also cpu hungry so corrupted frames would occur. Didn't look any further myself.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Nibby99 on June 12, 2019, 07:58:01 PM
when you plug in an external monitor, the touch screen stops working, therefore, there is no way to navigate ml menu when external monitor is attached.  Same problem if you're using a screen loupe viewfinder on the eosm screen, u have to remove the loupe to navigate, pain in the butt...

Just wondering if this has every been addressed. I want to be able to change shutter speed and possibly aperture in ML menus (so I can see my changes real-time). I want to buy a viewfinder LCD magnifier as I find it impossible to shoot in direct sun.

(ie:MagiDeal 2.8X 3.0'' LCD Screen Viewfinder Magnifier V6)

I was hoping to be able to access ML without popping off the hood everytime.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: masc on June 12, 2019, 10:28:24 PM
You can access ML menu without touchscreen, just with the buttons. Use trash button and play button. So no need to pop off the magnifier.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Pacerx999 on June 13, 2019, 06:17:25 PM
For correcting the real time preview of the rewired anamorphic modes. It only goes up to 2:1, would it be hard to implement a 3:1 mode aswell?

I've previously compiled a version with a 3:1 anamorphic mode. It's pretty straightforward in the code.

The issue is currently that that rewired anamorphic mode is not showing the full height of the image. It feels like it's only showing approximately half of the 1866 height (of the 1488x1866 4k anamorphic rewired).

@Danne, I've been through your previous repository, but I couldn't find how the MCM rewired happens/takes place/is controlled or even if it could be. If you have any pointers for trying to rewire the full height of the 4k anamorphic mode that would be great.

We could then look to test a 3:1 anamorphic liveview mode (and see the effect on CPU/pink frames) or I have an external monitor which can be set to anamorphic desqueeze, so that could also be an option.

Another couple of questions/thoughts

At the moment I'm getting continuous - Orange marker for most of the record, then green for a portion. But records over 5mins (with a sandisk extreme pro). This is, obviously, AMAZING (props to you Danne)
But my thought is that 4k 2.39:1 is normally thought of as 4096x1728 - which means we *could* lower the res to 1365x1728

@Danne - again if you could point me in the direction (of the raw code) that controls the height/resolution on the preset that would be great

Then potentially if we can get the whole image rewired to the liveview in realtime, means we can then figure out the desqueeze.

Interested to hear your thoughts. Feels like this could be another (ANOTHER) big leap for the EOS M.

cheers all
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on June 13, 2019, 06:51:38 PM
You can modify resolution with skip offsets like following. Enter crop mode sub menu, enter following:
(https://www.magiclantern.fm/forum/proxy.php?request=https%3A%2F%2Fi.postimg.cc%2Fd0YDMgs4%2FVRAM0-PPM-scaled.png&hash=32c0a8f99b288804d3cb7ff973b18001)

ML code will round to this:
(https://www.magiclantern.fm/forum/proxy.php?request=https%3A%2F%2Fi.postimg.cc%2FwjJ3G9p1%2FVRAM2-PPM-scaled.png&hash=f9f59411055496aa09512277efcf21d1)

Now go to this part in crop_rec.c and add the new numbers if you want to hard code resolution presets. Starts like this:
Code: [Select]
case CROP_PRESET_anamorphic_rewired_EOSM:
/* see autodetect_black_level exception in raw.c */
  if (ratios == 0x0)
  {
    skip_right      = 58;
    break;
  }
/* 2.39:1 */
  if (ratios == 0x1)
  {
        skip_bottom = 54;
        skip_right = 186;
        skip_left = 190;
   if (bitdepth == 0x4)
   {
        skip_bottom = 54;
        skip_right = 266;
        skip_left = 270;
   }
        break;
  }

Hard code numbers in this part:
Code: [Select]
/* 2.39:1 */
  if (ratios == 0x1)
  {
        skip_bottom = 54;
        skip_right = 186;
        skip_left = 190;

Becomes:
Code: [Select]
/* 2.39:1 */
  if (ratios == 0x1)
  {
        skip_bottom = 192;
        skip_right = 248;
        skip_left = 252;

Personally I wouldn´t do this since I record a smaller area of the sensor. Instead I´d scale down to propr standards in post.

What do you want to know about CROP_PRESET_anamorphic_rewired_EOSM preset? You can follow all registers added by searching keyword:
CROP_PRESET_anamorphic_rewired_EOSM
Or:
reg_override_anamorphic_rewired_eosm
to get the capture registers


One interesting workaround with the rewired modes is that it starts out in movie crop mode(x3digital) since then eosm will work in regular mv1080 readout in liveview. I then alter cmos and adtg regs so that we get back into non crop mv1080p mode. If you want to understand code from here you´ll need adtg_gui etc but even so it´s not like one can just copy paste the regs and get the mv1080p liveview working outside x3 zoom.
I call movie crop mode here in crop_rec.c:
Code: [Select]
/* always disable Movie crop mode if using crop_rec presets, except for mcm mode, Only eosm and 100D */
 if (is_EOSM || is_100D)
 {
/* always disable Movie crop mode if using crop_rec presets, except for mcm mode */
    if ((crop_preset == CROP_PRESET_mcm_mv1080_EOSM) || (crop_preset == CROP_PRESET_anamorphic_rewired_EOSM) || (crop_preset == CROP_PRESET_anamorphic_rewired_100D))
    {
     if (is_EOSM || is_100D) movie_crop_hack_enable();
    }
    else
    {
     if (is_EOSM || is_100D) movie_crop_hack_disable();
    }

 }

If you can share a version also with 3x1 anamorphic and how you alter it it would cool.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: berechiah on June 14, 2019, 01:27:03 AM
Hey guys

Just wondering if its possible to get 45fps in rewire view (not stretched view)

I have been playing with it a lot since danne made it 10x better (THANKS SO MICH BY THE WAY)
I just love shooing slo motion video of my children
I think it is a big feature for me. Even though its scaled down a lot. Its seriously cool.

Thanks again guys

You guys are seriously the best I ever saw
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on June 14, 2019, 09:20:18 AM
Hey guys

Just wondering if its possible to get 45fps in rewire view (not stretched view)

I have been playing with it a lot since danne made it 10x better (THANKS SO MICH BY THE WAY)
I just love shooing slo motion video of my children
I think it is a big feature for me. Even though its scaled down a lot. Its seriously cool.

Thanks again guys

You guys are seriously the best I ever saw
I´m pretty sure you got an answer when you pm:ed me the very same question.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Pacerx999 on June 14, 2019, 11:27:10 AM
If you can share a version also with 3x1 anamorphic and how you alter it it would cool.

So it's pretty straightforward for the 3x1 desqueeze.

The code is stored in tweaks.c, around line 3545 you'll see this:

 
Code: [Select]
.name = "Anamorphic",
        .priv     = &anamorphic_preview,
        .update = anamorphic_preview_display,
        .max = 7,
        .choices = (const char *[]) {"OFF", "5:4 (1.25)", "4:3 (1.33)", "7:5 (1.4)", "3:2 (1.5)", "5:3 (1.66)", "9:5 (1.8)", "2:1"},
        .help = "Stretches LiveView image vertically, for anamorphic lenses.",
        .depends_on = DEP_LIVEVIEW | DEP_GLOBAL_DRAW,

So we have to a) update the max number of options, and add one to the choices. So it would look like

Code: [Select]
.name = "Anamorphic",
        .priv     = &anamorphic_preview,
        .update = anamorphic_preview_display,
        .max = 8,
        .choices = (const char *[]) {"OFF", "5:4 (1.25)", "4:3 (1.33)", "7:5 (1.4)", "3:2 (1.5)", "5:3 (1.66)", "9:5 (1.8)", "2:1", "3:1"},
        .help = "Stretches LiveView image vertically, for anamorphic lenses.",
        .depends_on = DEP_LIVEVIEW | DEP_GLOBAL_DRAW,

so we've updated the menu, but now need to add the actual maths for the desqueezing.

if we goto line 2833 we see:

Code: [Select]
#ifdef FEATURE_ANAMORPHIC_PREVIEW

static int anamorphic_ratio_num[10] = {5, 4, 7, 3, 5, 9, 2};
static int anamorphic_ratio_den[10] = {4, 3, 5, 2, 3, 5, 1};

which is the array for how things get tweaked, so we just need to add another choice like this:

Code: [Select]
#ifdef FEATURE_ANAMORPHIC_PREVIEW

static int anamorphic_ratio_num[10] = {5, 4, 7, 3, 5, 9, 2, 3};
static int anamorphic_ratio_den[10] = {4, 3, 5, 2, 3, 5, 1, 1};


The only thing that I've found in terms of getting it to work on the liveview is you have to turn it to realtime and turn off the crop-rec preview.

@Danne, I'm going to have a play with the registers for the raw video size. I think I actually typo'd the dimensions for 4k 2.39:1. According to this site: https://blog.chameleondg.com/post/111891072017/resolution-aspect-ratio-cheat-sheet

it's 4096x1716, so we can probably adjust down the 3x1 to: 1366x1716 which will probably be continuous.

I'll also have a look at the register values for the MCM rewire and see what I can start to figure out, but I may come back with some more questions about what is going on. My knowledge of the EOS M registers is still very low, so it would be great to get some more pointers once I've had a dive in.

Cheers

Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: berechiah on June 14, 2019, 11:32:36 AM
Sorry Danne
No matter how I try to understand it seems not to get through lol
I spent hours and hours with the camers just some things seem to be hard go get.

So I only see 30fps in 1080 mcm rewire mode

I changed all the settings I could
But the only option was to set my max to 30fps

If i was in mc1080p 46/48fps mode
I see the option to set the max fps to 45fps

Am I going wrong somewhere

I'm sure it's simple but I am missing something

Sorry to be such a novis
It's not for the lack of time I am spending on learning or just being lazy
I really appreciate any advice
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on June 14, 2019, 11:52:20 AM
No problems. You can set FPS override to maybe 38 in mcm modes.

@Pacerx999
Thanks. Will look into this later.
Good luck on regs and just ask anything if needed. Learn to use adtg_gui is my tip right now.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: berechiah on June 14, 2019, 01:24:41 PM
Hey again

Im wondering if you don't mind to shed some light again please.

I am in ml menu my settings are

fps override: 38 (from 30)

Crop mode: mv1080p MCM rewire
Crop mode Sub menu: bit depth = off
Crop mode Sub menu: ratios 16:9


Raw video:
Aspect ration: 16:9
kill global Draw: on

every thing else is normal
But I can't seem to allow my shutter speed past 60-70 or so.
should                        ((((((((((fps override: 38 (from 30)))))))))))
not say something like ((((((((((fps override: 38 (from 38)))))))))))
Am I doing it right


So I did 38fps and it works and 2.35:1 works too no pink frames
sorry to be a pain just hoping to get a grip on it
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: berechiah on June 14, 2019, 01:49:16 PM
Just a quick update

I ended up leaving the fps to 36
and I can't make my shutter speed go past 74

its the almost double fps so seems to be the sweep spot.

I am lost likely doing it wrong LOL but as they say in Ireland
Im doing it arse ways
LOL

Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on June 14, 2019, 01:49:41 PM
TEsted and reproduced. Something maybe conflicitting with fps override and shutter blanking. One need to take a look in crop_rec.c and maybe also fps-engio.c code.

EDIT: Found the issue. Will check into it.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: berechiah on June 14, 2019, 01:58:13 PM
Fair play Danne

But even if I can't go past 36fps its still ok
there is is no pink frames

and if I got to 8-11bit lossless I can get about 30 - 60 sec from it.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: aulden on June 14, 2019, 05:10:18 PM
@Danne,
Is there anything us users can do to help develop a larger real time preview for the 4k rewired anamorphic?
Also, can we help test regs for eliminating the focuspixel field? Or is that a lost cause?
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on June 14, 2019, 05:46:53 PM
New version:
https://www.magiclantern.fm/forum/index.php?topic=9741.msg208959#msg208959

@berechiah
A little bit better regarding FPS override. It will still show wrong when set in mcm mode but it will apply faster canon shutters anyway.

@Danne,
Is there anything us users can do to help develop a larger real time preview for the 4k rewired anamorphic?
Also, can we help test regs for eliminating the focuspixel field? Or is that a lost cause?
You tell me what you can do to help?
If you don´t know how to use adtg_gui I suggest you start learning how to use it. If you ask for what to look for, I don´t know. If I knew it would already be fixed right?
There´s no shortcut into this. If you mean serious help please spend a year or so trying to solve this, starting with what already has been discussed on the topic. Good luck!
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: 2blackbar on June 14, 2019, 06:37:03 PM
Greg here wrote something about being able to find focus pixels table https://www.magiclantern.fm/forum/index.php?topic=23086.msg209902#msg209902
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: lightspeed on June 14, 2019, 08:25:07 PM
is there anyway to fix fps override in 3k mode. When ever I set it to 18 fps the preview is scrambled.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on June 14, 2019, 09:06:48 PM
Increase reg_6014 in crop mode sub menu, select framing preview. Report back.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: lightspeed on June 14, 2019, 10:48:50 PM
Yes it works when you do it that way. And that’s how I have been doing it but I have to change it every time I turn on the camera. If I could use FPS then it would save the setting I believe
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on June 14, 2019, 10:58:04 PM
Find this part in crop_rec.c:
Code: [Select]
  if (ratios == 0x1 || ratios == 0x2)
  {
    switch (reg)
    {
/* will change to 19fps for continous action */
        case 0xC0F06804: return 0x5190310 + reg_6804_width + (reg_6804_height << 16); /* 3008x1280 19fps  x5 Mode(2.35:1) */
        case 0xC0F0713c: return 0x519 + reg_713c;
        case 0xC0F07150: return 0x514 + reg_7150;
        case 0xC0F06014: return 0x7cd + reg_6014;
    }
  }
Change:
Code: [Select]
        case 0xC0F06014: return 0x7cd + reg_6014;to:
Code: [Select]
        case 0xC0F06014: return 0x839 + reg_6014;Then comppile for your camera.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: berechiah on June 14, 2019, 11:02:22 PM
Thanks Danne for that today. It works perfectly now. Really appreciate your help.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on June 15, 2019, 05:02:39 PM
New version:
https://www.magiclantern.fm/forum/index.php?topic=9741.msg208959#msg208959

Commits:
https://bitbucket.org/Dannephoto/magic-lantern/commits/7f1e2337ec69f259bffe378c512fb407f0d7f45b
https://bitbucket.org/Dannephoto/magic-lantern/commits/485593fabdf978710105603b2432e5148ada4586

- Reworked 4k, increased height
- Timelapse presets. Only active in conjuction with 4k preset. Timelapse option allows also for 5k.

(https://www.magiclantern.fm/forum/proxy.php?request=https%3A%2F%2Fi.postimg.cc%2FL4t5m8GS%2FVRAM0-PPM-scaled.png&hash=1c3d3abb5864a39ff2fd7cd36146ba55)

(https://www.magiclantern.fm/forum/proxy.php?request=https%3A%2F%2Fi.postimg.cc%2FL538Dxj5%2FVRAM1-PPM-scaled.png&hash=ee81a6d9ea2b16342bbb720321dd0ec4)

(https://www.magiclantern.fm/forum/proxy.php?request=https%3A%2F%2Fi.postimg.cc%2FZnSq6GBX%2FVRAM2-PPM-scaled.png&hash=52da157da38cf4ea821e4a52ad4b158e)

On eosm timelapse or reduced fps works also with FPS override and then you´ll get shutter blanking included too. This works through crop rec with 100D straight in crop_rec.c but not with eosm, go figure. So eosm timelapse from crop rec will be slow shutter only. If you have no idea what I´m talking about just grab a beer and start playin´ 8)
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: dokipen on June 16, 2019, 01:58:06 AM
here's a few clips, 4k anamorphic, only changed aspect ratio to 16:9 and set 25fps, 1064x1800 resized to 4k, very "clean" videos only selected 3x3 smooth in mlvapp and it was ready to go, @Danne where's the aliasing now? :)
watch in 2k or 4k resolution

I'm on 7th June build and 4k anamorphic mode at 16:9 gives a res of 1064x1975. I could only get that resolution (1064x1800) when setting the aspect ratio to 5:3. Did something change between builds?
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on June 16, 2019, 06:08:27 AM
1120x1900 when set to 16:9
Above mode becomes 1064x1800 when bitdepth is set to 12bit.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: dokipen on June 16, 2019, 09:47:53 AM
I'm on 7th June build and 4k anamorphic mode at 16:9 gives a res of 1064x1975. I could only get that resolution (1064x1800) when setting the aspect ratio to 5:3. Did something change between builds?

Never mind, i seem to be getting good results with setting the ratio to 1:2 in raw vid module and 16:9 in crop rec. I get 1120x1900 which expands to 3360x1900 which i guess is '4k'.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: dokipen on June 16, 2019, 09:48:40 AM
1120x1900 when set to 16:9
Above mode becomes 1064x1800 when bitdepth is set to 12bit.

ah just saw your reply too. :) cheers danne.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on June 16, 2019, 09:55:15 AM
4k with 2.35:1 preset.

Don't touch the ratio tab in raw video. Instead set it to maximum or run the cinema lua script and then choose the ratio presets in crop mode sub menu.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: AF-OFF on June 16, 2019, 03:53:31 PM
On eosm timelapse or reduced fps works also with FPS override and then you´ll get shutter blanking included too.  8)

Hey Danne
many thanks for the shutter speeds which were not available with fps override before!
I've noticed this by accident in some may version. I could then for the first time use FPS override with shutter speeds much quicker (1/100 sec for example) at 2.5 fps.
This is awesome!
I've tested the June 04 version extensively and have not had a single corrupt frame in some 70+GB of footage.
Many many thanks for Your incredible efforts and work!

p.s. made with Danne's experimental build
https://www.magiclantern.fm/forum/index.php?topic=24252.0
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on June 16, 2019, 04:51:21 PM
No corrupted frames. Sounds great. Keep up the good work and tests.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: berechiah on June 16, 2019, 07:43:43 PM
Hi Danne
Just did some video today.
I can set any shutter speed now regardless what ever u set my fps to.

But it seems if I go past 36 of 30fps i see a distorted liveview

I did every other type if setting to see if it went away
But the live view is pinky and messed up if I go past 36fps

Any ideas ?
Its not so important it is just an update
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on June 16, 2019, 08:09:04 PM
If you refer to mcm rewired mode set to 16:9 in crop mode menu and canon fps set to 30fps I can over here set FPS override to 42fps with good liveview.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: berechiah on June 16, 2019, 10:01:26 PM
Yes I am in 1080p rewire and I am 37fps all the way to 42fps (40 or 30fps)

and I still see the bad live view
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: berechiah on June 16, 2019, 10:03:39 PM
I have a bit issue

I used my camera today for a cake smash for my 1year old

I am am looking at the video an I see the focus dots

I had them gone before but they seem to be back again

I am doing my best to find old posts to try to fix it

can anyone help me I am totally at a lost I am 1 hour searching and testing
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on June 16, 2019, 10:54:33 PM
What preset used? If you're not using dfort's pixel maps try chroma smooth 3x3.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: berechiah on June 16, 2019, 11:04:09 PM
Dose 3x3 soothing make is softer?

I got the files dfort uploaded
I downloaded the Download repository

I copy all the files in focus_pixel_map_files folder its full of .fpm files

I just pasted them into

/Users/admin/Library/Services/mlvfs/contents

I am most likely doing it wrong but it seems to have made it a bit better
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on June 16, 2019, 11:36:06 PM
Use your eyes and tools to actually look at the file and be your own judge about softness.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: berechiah on June 17, 2019, 12:03:15 AM
Ok ill do that.
Thaksn
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: berechiah on June 18, 2019, 01:03:23 AM
Use your eyes and tools to actually look at the file and be your own judge about softness.

Got it figured out after all.
I went trough the whole form and found step by step instructions how to put the .fpm files in the mlvapp and mlvfs

Also I looked an 3x3 in the mlvapp dose not take away any quality from what I noticed

Sorry its very simple stuff for you guys but it was a great to finally get time to get it sorted.

Thanks for the advice
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: masc on June 18, 2019, 10:00:31 AM
Got it figured out after all.
I went trough the whole form and found step by step instructions how to put the .fpm files in the mlvapp and mlvfs

Also I looked an 3x3 in the mlvapp dose not take away any quality from what I noticed

Sorry its very simple stuff for you guys but it was a great to finally get time to get it sorted.

Thanks for the advice
Could you tell, what exactly the problem was? Regarding MLVApp I really don't know how to make it more clear and easier... so would be cool to hear what the problem was. In MLVApp: Help->Help you find this:
(https://www.magiclantern.fm/forum/proxy.php?request=https%3A%2F%2Fi.ibb.co%2FPgCYJYF%2FBildschirmfoto-2019-06-18-um-09-56-07.png&hash=33968a11f72abc22e3175bae1bf21d59)
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: berechiah on June 18, 2019, 11:44:53 AM
No you did explain it perfect

But I was able to use the mlvapp and mlvfs to remove focus dots before.

But it seems one day after updating my eos m firmware the focus dots came back
In mlvfs the focus dots was always there from what i remember until months later I found out I can ad the fpm file to mlvfs and remover focus dots.
But it also came back once I updated

But the mlvapp was perfect until I updated the eos ml update

So Danne suggest to update the Dfort pixel map when he updated the ml file

So I needed to find the files
I did and I put them in the app and mlvfs
I found it in the end

Look I am kinda tec savvy when using it and troubleshooting but some of these things go way over my head.

Hope I explain it ok

But its working now 100%

Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: ricardopt on June 18, 2019, 01:25:39 PM
Just passing trough just to say that im trying out the latest version with the 4k anamorphic mode and the video quality that this "old/small mirrorless" camera can produce with its specs... just  fu... blows my mind ... thanks everyone :)
(https://www.magiclantern.fm/forum/proxy.php?request=https%3A%2F%2Fi.ibb.co%2FrypYqmV%2Fmlscreen.jpg&hash=460b138f93adc5817fa5391335bb2236)
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: ZEEK on June 18, 2019, 02:29:37 PM
Hey all, I've been really impressed with the ML Build June 14th. No crazy focus dots, no need to enable chroma smooth, maps, fix bad pixels or even focus dots in MLV App.

Crop Mode
- MCM Rewire
- Bitdepth = 10bit
- Ratios = 16:9 or OFF (to increase max resolution in 1:2)

RAW Video:
- Resolution - 1736x976
- Aspect Ratio - 1:2 (16:9)
- Card Warm-Up 64 MB
- Small Hacks - af on
- Sound Recording - OFF

Just thought I'd share. Surprised there are "zero" focus pixels and that no chroma smooth etc. is needed. Just drop and edit.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on June 18, 2019, 02:52:32 PM
Great. Looking forward to your next movie :)
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: ZEEK on June 18, 2019, 02:59:42 PM
Been testing 4K Anamorphic Rewired, no focus pixels either or need for chroma smooth. Thanks for the builds! 
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: ricardopt on June 18, 2019, 03:00:46 PM
I've uploaded it, work limits the time i have available, it was a short test.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: berechiah on June 18, 2019, 04:53:18 PM
It's fine

U did a good Job


I am not that good at these things but I'm learning
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: berechiah on June 18, 2019, 04:54:34 PM
Hi guys

How to I get the mini menu up on the eos m

Like the photo on the website
https://www.magiclantern.fm/img/eosm.png
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: baladev on June 18, 2019, 05:22:18 PM
Press the Menu button while in ML.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: marcelo.lippi on June 18, 2019, 05:39:53 PM
Guys, working with 4.5k 2.35: 1 aspect I can apply the mask of focus points of dfort or only with the formats rewired, mcm, 16: 9 etc. Help me, maybe I don't understand, thanks
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on June 18, 2019, 05:44:19 PM
Press the Menu button while in ML.

Actually, that exits menu and back to liveview. Not sure why it´s not working. Feel free to investigate this issue further.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: baladev on June 18, 2019, 06:08:22 PM
Actually, that exits menu and back to liveview. Not sure why it´s not working. Feel free to investigate this issue further.
Crap. Sorry, you are right! 4 cameras with ML working slightly differently on all of them can get a man confused  ::)
This explains my annoyance when I get this screen on my other cameras - I expect to exit ML as with EOS M but instead I get this...
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on June 18, 2019, 06:13:30 PM
What´s that menu even called? Also, what compilation works differently with the menu button?
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: berechiah on June 18, 2019, 06:15:23 PM
Lol
It looks like a handy menu

But I pressed evry botton every way but dotn know how to get it up

It's not important though but it would be nice to have
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on June 18, 2019, 06:29:47 PM
CHecked some. Seems to be called junkie menu. It´s supposed to be defined in features.h. However. Defining it doesn´t get it to work. I guess one needs some digging here.
https://www.magiclantern.fm/forum/index.php?topic=8741.0
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: baladev on June 18, 2019, 06:34:08 PM
What´s that menu even called? Also, what compilation works differently with the menu button?

Hmm.. just checked. 5Dm3 exits ML upon pressing Menu but 7D goes into this menu, which has two different screens - one with fewer bigger buttons and the other one with more buttons of smaller size. Pressing Menu cycles ML - sceen 1 - screen 2 - ML. The build is https://bitbucket.org/ArcziPL/magic-lantern/downloads/magiclantern-Nightly.2019Mar07.70D112_crop_rec_4k_mlv_lite_lossless.zip
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on June 18, 2019, 06:55:12 PM
Nice. I'll have a look later. Probably onle needs to bbe defined in features.h in eosm platform so if you can compile try and define it there.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on June 18, 2019, 09:55:00 PM
Added a possibility to add back junkie menu into the eosm:
https://bitbucket.org/Dannephoto/magic-lantern/commits/d283181580d93c04acf86c57ee9093ebef182afc

Inside the platform folder for eosm define this in features.h then compile your own version or ask for someone to help you out on this. I will not include it to my ongoing builds for the time being:
#define FEATURE_JUNKIE_MENU
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: berechiah on June 18, 2019, 11:00:58 PM
Brill
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: ricardopt on June 19, 2019, 01:46:00 PM
was trying the new timelapse option in 4k anamorphic, let the eosm record for 6 minutes, choose 3fps, when opening the mlv in mlvapp it showed that the video has a duration of 6 minutes, it seems i need to speed up the video after.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: masc on June 19, 2019, 02:13:07 PM
was trying the new timelapse option in 4k anamorphic, let the eosm record for 6 minutes, choose 3fps, when opening the mlv in mlvapp it showed that the video has a duration of 6 minutes, it seems i need to speed up the video after.
Right. In MLVApp's export settings dialog, choose fps override and export to whatever you need. Then the clips becomes shorter.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: ricardopt on June 19, 2019, 02:31:42 PM
I know a camera is not a smartphone, on my phone it records @30fps, i select to take a pic every 3 seconds, if i do this for 6 minutes i'll have a 5 second video @30fps.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on June 19, 2019, 02:46:34 PM
Yes, the preset is designed like this. It will use a 7fps wrapper if I recall correctly. This is because we then don´t need the major lag that otherwise will happen. Only when recording the fps is changed to the lower one but still with the 7fps wrapper. If you experiment some in Mlv App you should be able to get what you want in post.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: ricardopt on June 19, 2019, 02:52:47 PM
i dont have much time now (work starts in a bit) but the final timelapse video is the same as a normal video recording for 6min, no difference at all.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on June 19, 2019, 02:54:46 PM
hehe, ok, I will have to take a look at this. Maybe a bug.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: masc on June 19, 2019, 03:07:09 PM
i dont have much time now (work starts in a bit) but the final timelapse video is the same as a normal video recording for 6min, no difference at all.
Sure, if you don't setup fps override in MLVApp this is expected. Type e.g. 25fps in this field and you'll get what you want.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on June 19, 2019, 03:07:36 PM
Just tested. Seems to work as I told you. Recorded a 3fps file for a minute and about 174 frames. Turned it off and then 7fps and around 500 frames after a minute. So speeding up the timelapse i the solution to your problem.
Maybe I can set a different metadata tag when ending recording. Will have a look on this.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: masc on June 19, 2019, 03:17:23 PM
But to what framerate do you set then? Some person like 24, some other 25, the next guys love 30...
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on June 19, 2019, 03:18:25 PM
True, Either set to the same fps as set 3fps or just leave at the wrapper 7fps one.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: anto on June 21, 2019, 12:24:01 PM
it seams that last link doesn't work
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: baladev on June 21, 2019, 02:05:19 PM
You can download everything directly for Danne's repo:
https://bitbucket.org/Dannephoto/magic-lantern/downloads/
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: sirminder on June 22, 2019, 11:38:44 AM
Hi everyone, new guy here.  After seeing some of Zeek's videos, I was motivated to jump on the MLV bandwagon and got me a used EOS M.

I loaded it with Danne's ML from early in June (thanks for your work and dedication Danne!).  Also, I went ahead and got the Viltrox EF-EOS M2 Speedbooster, so I can use some of my EF lenses.

I have been doing some tests using the Canon 50mm 1.8 and I am very pleased with the results so far, but still need to go through all the settings and menus.  However, I seem to be having a battery drain issue...only when the SD card with ML is inserted.  I have been going through some of the 116 pages that are now in this thread, but I cannot find the answer to fix this.  Some people had said upgrading the firmware on the Viltrox to 1.4 fixed their problem, so made sure fw1.4 was on mine.  Still, if I leave the battery in the camera along the Viltrox attached and the ML SD card, the battery will be drained while the camera is off.

To test what the problem could be, I did the following:
- Camera Off, Viltrox w/50mm 1.8 attached, 64G ML SD Card inserted, I switched from AF to MF on Lens and back - led on camera flashes a few times = battery drain.
- Camera Off, Viltrox w/50mm 1.8 attached, NO ML SD Card inserted, I switched from AF to MF on Lens and back - NO led at all and battery keeps its charge.

Unfortunately, I do not have an EOS lens to test without the Viltrox.

Is there a menu setting that covers this? Sorry if this has already been covered before, but I am still reading through everything here.

Thanks.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: ZEEK on June 23, 2019, 01:45:42 PM
It has nothing to do with the SD Card + ML. It's merely the Viltrox Focal Reducer that's causing the issue here (or a faulty battery). I haven't experienced the issue myself 'ever' and I own (x2) Viltrox Focal Reducers [EF-M2].

The battery draining issue caused by the Viltrox is identified here by other users of the adapter:
https://www.dpreview.com/forums/thread/4350743
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: masc on June 23, 2019, 02:48:24 PM
My Viltrox speedbooster drains the battery too... sometimes. No idea what I could have done differently when it is drained or when not. Also the speedbooster sometimes sends wrong metadata to the EOS M. So for the EF 50mm 1.4, mostly it sends 35mm and f/1.0, bot sometimes 50mm f/1.4.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: uEOSM on June 23, 2019, 03:46:37 PM
...only when the SD card with ML is inserted...
The same problem, the battery is discharged. I do not have a speedbuster, a standard 18-55 lens. From the first day I installed ML, a year ago.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: ZEEK on June 23, 2019, 03:52:19 PM
When the Viltrox sends the wrong signal, you just detach and retach the lens and it should automatically adjust to the correct information. I cant say much on the battery draining issue as I only have one AF lens (Canon 50mm STM) and use mostly manual focus lenses. I have one Canon EF zoom with IS coming in soon so I'll see how that performs...

It is expected that any lens with electronic connection or signals sent to the  camera will decrease battery quicker than dumb adapters with manual lenses. Even my Zeiss Milvus which is full time manual focus drained the battery quicker than anything I've seen as it has electronic connections.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: masc on June 23, 2019, 04:28:05 PM
Yes, detach and retach helps. But even then, without changing the lens: when using the cam next time it might be wrong again...
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: a1ex on June 23, 2019, 04:53:30 PM
The same problem, the battery is discharged. I do not have a speedbuster, a standard 18-55 lens. From the first day I installed ML, a year ago.

To troubleshoot this problem, try the current lua_fix build from the download page. In case of incomplete shutdown, it should keep the SD LED always on, so you should notice it right away.

That change doesn't seem to be included in Danne's builds.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on June 23, 2019, 04:59:27 PM
Hm, I will try and merge lua fix here.
If cam was not shut down over here it showed a red light though so never had those issues. On eosm2 however...
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: a1ex on June 23, 2019, 05:32:17 PM
With the old codebase, ML turns on the LED when receiving the shutdown message. If anything turns off the LED meanwhile (such as, from a SD card write finished afterwards), the LED will remain off, even if the camera doesn't shut down completely.

This happened to me a lot more often than I've expected. During development, I've noticed that - after the shutdown signal - the LED was sometimes turned off for 1-2 seconds (and then, turned back on for a split-second, until power down). Those 1-2 seconds were long enough to make me think the shutdown was complete, when it wasn't, so I was removing the card too early. Result: corrupted filesystem, had to format the card, prepare it from scratch, yadda yadda. Eventually, that became pretty annoying, so I made this change (https://bitbucket.org/hudson/magic-lantern/commits/99301f4fe05beddde611a1a8746aac52bf9e29f1).

With the new codebase, ML turns on the LED every 20 ms, in background, since receiving the shutdown signal. That is, as long as DryOS is still alive (and it normally is, until the MPU cuts off the power), the LED will stay on, even if some other tasks will try to turn it off.

Besides revealing incomplete shutdowns, with the new method, one is no longer tempted to remove the card before the shutdown completes.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on June 23, 2019, 05:52:27 PM
Aight, sound very good. Will test tonight.

Speaking corrupted files I had some of that related to sd_uhs before adding back reconfiguration fix yesterday. I had to try really hard though to force patch and it was only on one card, only on 100D.

Removing card and being real abusive to my eosm testing stuff shutting it on and off, pulling card too early is rather mandatory here. However abusive there hasn't been one time a battery pull didn't fix it. I'm pretty amazed about how this works all of the time. The safety level i consider to be very high...
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: a1ex on June 23, 2019, 09:18:21 PM
Quote
However abusive there hasn't been one time a battery pull didn't fix it.

Heh, I could count at least two (https://www.magiclantern.fm/forum/index.php?topic=9741.msg212273#msg212273) times (https://www.magiclantern.fm/forum/index.php?topic=24224.msg217222#msg217222) just from your side :)

Add at least one SD card damaged by sd_uhs and one CF card damaged by my own code (https://www.magiclantern.fm/forum/index.php?topic=12862.msg199680#msg199680) (which I thought to be harmless before running it).

And a bunch of other similar events that happened to other developers (dfort's EOS M, chris_overseas' 5D3 and Greg's 500D are just the ones I remember right now). In all these cases, the issue was from faulty ML code (invalid value for some property). These were recovered.

Yes, the probability of things going wrong is low, but quite a bit above zero. That applies to all ML builds.

Quote
Speaking corrupted files I had some of that related to sd_uhs before adding back reconfiguration fix yesterday.

With all the recent testing, I still consider sd_uhs extremely unreliable (based on my own experience with it). There are two major issues: one is thread safety (https://www.magiclantern.fm/forum/index.php?topic=12862.msg201773#msg201773) during card reconfiguration, and the other is signal timing likely on the edge (I've got benchmarks running in LiveView, but failing outside, or viceversa, on some cards).

Quote
The safety level i consider to be very high...

I disagree - there are so many things that could go wrong. This article (https://marcan.st/2011/01/safe-hacking/) gives some pretty good background info, although it's not specific to our project. This one (https://www.magiclantern.fm/forum/index.php?topic=3624.0) was written back in 2012, when I didn't really know what I was doing.

The worst issue comes from the way DryOS is designed - any task can write anywhere into RAM (even on memory belonging to other tasks). Then, at shutdown, Canon code writes stuff into their persistent memories - one of them being the main ROM (that's right, they reflash the ROM at every shutdown). It's not hard to imagine a sequence of events that would result in garbage written into ROM, resulting a camera that doesn't boot. Wait, it actually happened - two years ago I've bricked quite a few 5D3's with early crop_rec_4k builds (luckily recovered all of them, to my knowledge).

So, one of my unfinished quests is to find a way to prevent Canon code form reflashing the ROM (https://bitbucket.org/hudson/magic-lantern/pull-requests/825/prevent-canon-settings-from-being-saved/). Ideally, by disabling ROM writes at hardware level, to keep the camera safe even from reflashing code called by mistake. Current status: if you end up calling e.g. EraseSectorOfRom (https://chdk.setepontos.com/index.php?topic=5503.0) (even indirectly or unintentionally) with the wrong arguments, you might end up erasing the bootloader, and I won't be able to recover the camera. That didn't happen yet, to my knowledge, but it is theoretically possible.

Another thing I've started to think about lately, is how to prevent data loss in the case of hard crash, power cutoff or other stuff like that. For example, ML could create some backups of the FAT tables. I might even be able to completely undo a card format, after the fact. Or, if you record a long MLV file and there is a crash / power cutoff / whatever the middle of recording, ML should be able to recover that file at the next reboot (currently it doesn't). Or, even while transferring the files to PC, a flaky USB connection could result in data loss (it happened to me some years ago, and a backup of the FAT would have saved the day).

Sorry for the off-topic.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on June 23, 2019, 10:32:27 PM
Heh, I could count at least two (https://www.magiclantern.fm/forum/index.php?topic=9741.msg212273#msg212273) times (https://www.magiclantern.fm/forum/index.php?topic=24224.msg217222#msg217222) just from your side :)

This article (https://marcan.st/2011/01/safe-hacking/) gives some pretty good background info, although it's not specific to our project.
Eh, two times messing with crop mode regs  :P
Besides those two mistakes no persistent damage.
Great article shared by the way. Should be read by users, recommended.

Yes, sd_uhs is a golden gem but could need some polishing. I try to but it's all pragmatically based slow understanding of how it works. Thankful for all info shared from yourself here.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: sirminder on June 24, 2019, 05:24:41 AM
Thanks for the help and feedback. I will troubleshoot further as suggested and report back my findings.

Sent from my SM-G930F using Tapatalk

Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: lightspeed on June 24, 2019, 07:16:46 AM
is it possible to get a 3.5 k mode with a 16 fps. obviously wouldn't be continuous but would be nice to have the option. 9 fps is just too low.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on June 24, 2019, 09:54:29 AM
If you manage to decrease reg_6014 and get higher fps then it works. Or else not.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on June 24, 2019, 04:19:06 PM
New version:
https://www.magiclantern.fm/forum/index.php?topic=9741.msg208959#msg208959

Commits:
https://bitbucket.org/Dannephoto/magic-lantern/commits/72d33da5618f5ce1d8ebfbbb5d7d897de11079c9
https://bitbucket.org/Dannephoto/magic-lantern/commits/d1672795e552aac3ce74f6155027c97faf8591ac

- Shutdown routine from lua_fix(Thanks a1ex)
- 4k timelapse preset. Added shutter blanking when working wiht 4k timelapse presets. Works like this:
Select 4k preset. In sub menu add a 4k timelapse fps preset. Now shutter blanking is applied but preview is also very slow.
Select Slow shutter on top of above and as it says shutter will be slow as the fps selected. Shutter blanking will be off. Preview will be in around 7fps so faster and easier to set up due to some workaround foolishness  :P.
Tip: 4k timelapse mode will work very good with Rec trigger set to Half-shutter: start/pause

EDIT: Noticed lua isn´t compiling. Will take a look. Stay tuned.
FIXED!
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: 2blackbar on June 24, 2019, 05:53:46 PM
Great work ! Im planning to buy M-EF adapter to use electric AF lenses(i have manuals ATM) i know that M was kinda failure for canon because of problems with slow autofocus but ive seen some videos with magic lantern that improved autofocusing with auto lenses a lot, is that true ?
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: baladev on June 24, 2019, 06:58:18 PM
Auto focusing with original firmware was very slow, but then Canon improved it a lot with a firmware upgrade. But, it is still CDAF which breathes a lot when focusing, so quite useless for serious work. If you need good AF, 70D is the best in this regard, it has DPAF, which is very smooth and doesn't breathe in good to moderate light.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: 2blackbar on June 24, 2019, 07:35:10 PM
Thanks, ive seen this exact video and its not that bad
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: sirminder on June 25, 2019, 07:59:02 PM
To troubleshoot this problem, try the current lua_fix build from the download page. In case of incomplete shutdown, it should keep the SD LED always on, so you should notice it right away.

That change doesn't seem to be included in Danne's builds.

New version:

- Shutdown routine from lua_fix(Thanks a1ex)
.
.
.
EDIT: Noticed lua isn´t compiling. Will take a look. Stay tuned.[/s] FIXED!

I did a few tests with Danne's JUN25 build and there is still some battery drain when the camera is set to OFF.

For the record, the issue that I am having does indeed seem to be with the Viltrox speed booster, AND NOT ML as I previously stated.  Even though I have the latest FW on the Viltrox, I am still having this problem and I seem to be the only one.

Other than removing the battery or even the Viltrox, does anyone have any other suggestions?

Thnx

Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: masc on June 25, 2019, 08:14:00 PM
For the record, the issue that I am having does indeed seem to be with the Viltrox speed booster, AND NOT ML as I previously stated.  Even though I have the latest FW on the Viltrox, I am still having this problem and I seem to be the only one.
You're not alone. ;)
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: masc on June 25, 2019, 08:20:58 PM
- Shutdown routine from lua_fix(Thanks a1ex)
- 4k timelapse preset. Added shutter blanking when working wiht 4k timelapse presets. Works like this:
Select 4k preset. In sub menu add a 4k timelapse fps preset. Now shutter blanking is applied but preview is also very slow.
Select Slow shutter on top of above and as it says shutter will be slow as the fps selected. Shutter blanking will be off. Preview will be in around 7fps so faster and easier to set up due to some workaround foolishness  :P.
Tip: 4k timelapse mode will work very good with Rec trigger set to Half-shutter: start/pause

EDIT: Noticed lua isn´t compiling. Will take a look. Stay tuned.
FIXED!

Does this lua_fix routine work automatically?
For the timelapse preset: with slow shutter OFF it works here with 2..5fps, for 1fps the screen gets black and stays black until I go into photo mode.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on June 25, 2019, 09:14:28 PM
Lua_fix is automated.
1fps works both 4k and 5k and slowshutter off but it's very slow. What we want is liveview to run 7fps when not recording and change to 1fps when recording like it's working with 100D. On eosm this workaround disables shutter blanking. No idea why.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: masc on June 25, 2019, 09:21:22 PM
Now I was waiting long enough... the cam seems to be frozen for around 30sec here. But then it awakes to life again and works with 1fps.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on June 25, 2019, 11:32:54 PM
Yeah, I guess you could preview in 4k without selecting timelapse or slowhutter and just before recording timelapse fps. It shouldn´t be 30 seconds, more like 4-5 s. Delays is very high upon restarting cam though...
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: lightspeed on June 26, 2019, 12:17:17 AM
thanks. just seems odd that 9 fps works ok and is continuous but it won't let you do 10 or 11 non continuous
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on June 26, 2019, 07:33:37 AM
It's more odd that this cam can film 4k anamorphic 24fps.
There are limits, believe it or not ;).
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: lightspeed on June 27, 2019, 02:39:09 AM
Does anyone know how to download video through the usb micro cable? I can only download photos.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on June 27, 2019, 06:09:16 AM
@lightspeed
Try to use search more. Both your recent questions have been asked and answered many times before.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: guerchi on June 27, 2019, 09:08:53 PM
Hello everyone here I am a silent user of ML since its inception. I remember talking to Alex in a videoconference about the possibility of cropping the sensor center to avoid alaising. The days of the t2i were relegated when I bought a bmpcc, camera with which I have been working for 6 years. I have closely followed the evolution of the EOS M, here and on YouTube, amazed at the results you have achieved. I got one of these little giants, and I was doing several tests. The first thing that surprised me is the ease with a few basic adjustments to get results in colorimetry that would take me a lot more work in the Blackmagic!
The MCM Rewire mode is beautiful to use, but I can not avoid the alaising even with old manual lenses.
The 2.5K CROP and 4k Anamorphic Rewire modes are simply incredible. For specific cases such as macros or teles, having the option of 5x Crop is great.
For the rest of the cases I was trying to get shots, free of pink frames in the 4k anamorphic rewire mode. Try all possible combinations.
The most stable mode is still with the 2.35 aspect ratio, I got a 2 minute clip with 0 pink frames indoors with few lights and one outside in the middle of the day with trees and sun of 4 minutes 13 seconds with only 6 pink frames.
The settings were:
12bit Losless
GD Kill ON
1280x1632
in a Sandisk Extreme Pro 95 MB / s
with the version crop_rec_4k_mlv_snd_isogain_1x3_presets_2019Jun20.EOSM202

I just wanted to share my experience, and thank you for this incredible work. I will certainly use this camera for some future project.
I could upload later a test of what I was seeing about the behavior of these unwanted guests, the pink frames if you think it could be of some help.
Greetings to all.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: 2blackbar on June 27, 2019, 09:32:09 PM
Does anyone know how to download video through the usb micro cable? I can only download photos.
I can download mov and photos connecting camera with mini usb cable on win7, just plug and play.PEople wont help if you wont specify your Operating system.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: lightspeed on June 27, 2019, 10:05:42 PM
On Mac OS x
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: john5788 on June 28, 2019, 01:37:10 AM
New version:
https://www.magiclantern.fm/forum/index.php?topic=9741.msg208959#msg208959

Commits:
https://bitbucket.org/Dannephoto/magic-lantern/commits/72d33da5618f5ce1d8ebfbbb5d7d897de11079c9
https://bitbucket.org/Dannephoto/magic-lantern/commits/d1672795e552aac3ce74f6155027c97faf8591ac

- Shutdown routine from lua_fix(Thanks a1ex)
- 4k timelapse preset. Added shutter blanking when working wiht 4k timelapse presets. Works like this:
Select 4k preset. In sub menu add a 4k timelapse fps preset. Now shutter blanking is applied but preview is also very slow.
Select Slow shutter on top of above and as it says shutter will be slow as the fps selected. Shutter blanking will be off. Preview will be in around 7fps so faster and easier to set up due to some workaround foolishness  :P.
Tip: 4k timelapse mode will work very good with Rec trigger set to Half-shutter: start/pause

EDIT: Noticed lua isn´t compiling. Will take a look. Stay tuned.
FIXED!

Just curious, are these builds that I find within the forum threads going to make it to the Downloads/Main Builds page on the top of the website at some point in time? Or at least the changes merged back to the main code repo for new builds? There seems to be plenty of changes hiding within these threads but we have no new "stable" builds for 2019 on any of the ML cameras.

I'm not familiar with the official build process for ML, but I am aware that these are just user builds on independent code repos and aren't really meant for general usage.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on June 28, 2019, 07:16:13 AM
The branch I started working on was crop_rec_4k_mlv_snd. Crop_rec developed by a1ex and audio included by g3gg0.
The way Ive been learning, experimenting, working out bugs on eosm etc are maybe not going into experimental builds etc but I consider most of my presets and fixes well tested and functioning. Mostly. Eos m is what it is. Not really a power horse in terms of cpu power.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: AF-OFF on June 28, 2019, 02:57:41 PM
@Danne
new 28june build has difficulties to reach ML menu
if (after updating fw in photo-mode) starting cam in photo mode.
if one starts cam in video mode, ML menu can be reached as usual

Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on June 28, 2019, 03:03:34 PM
Updating fw? Could you give an example I could try and reproduce here?
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: AF-OFF on June 28, 2019, 03:08:29 PM
sure, copied new build to card and extracted the archive
replaced the original files with the new ones
started cam in photomode and from canon menu updated the firmware
restarted cam in photomode
then wanted to enable modules from within ML menu, but it was impossible to enter ML menu
powering cam down, switching to videomode and powering back up could enter ML menu as usual
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Walter Schulz on June 28, 2019, 03:47:22 PM
The update process you described changed this:
- Setting cam's bootflag (which was set before)
- Making card bootable (which is only necessary after formatting card outside cam or using a new card).
So you changed nothing at all.

Instead of replacing files (which will do in most cases) it might be a better idea to rename ML folder to avoid messing up with outdated/incompatible magic.cfg settings and obsolete modules.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: AF-OFF on June 28, 2019, 04:03:39 PM
maybe, thought this is correct procedure
also fw update generates the rom files
replacing the old files with the new ones prevents imho that something can get messed up

Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Walter Schulz on June 28, 2019, 04:16:06 PM
ROM0.BIN and ROM1.BIN files located in ML\LOGS will not be overwritten ...
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: AF-OFF on June 28, 2019, 04:37:01 PM
@Danne
Found the error, somehow "Touch Shutter" was Enabled (canon menu, third wrench). Somehow this got activated.
Now the 28june build behaves as expected
Sorry for this false alarm

@Walter
I'm on osx, replacing files and folders with others having the same name will delete files and directories first then write the new files and dir. In the ML dir there are no LOGS or SETTINGS folders after replacing, so there are no rom or cfg files either

Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on June 28, 2019, 05:52:11 PM
Touch shutter, hmm, Been ages since I fiddled in the canon menus  :P
Good that you solved your issue.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: dfort on June 28, 2019, 06:12:36 PM
Yeah, touch shutter bit me a few times too.

Walter is suggesting renaming the ML folder before copying over the new ML download. That way you have your old settings and log files saved on the card.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: AF-OFF on June 28, 2019, 06:32:33 PM
@Danne
Don't know how this happened. It was since months disabled in canon menu, which I used mostly to format card
@dfort
I did get what Walter suggested, but I like to setup all custom settings every time, I put a new build from Danne on the card - this way, I learn better where all the settings in ML-menu are

Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Romain182 on June 29, 2019, 01:56:25 PM
Hi all
And hi Danne

I'm using your lastest build (28 june) and i'm having issues with focusing dots...
I know there's a lot of topics about It but i spend my night reading and still struggling with It.

I tryed the Zeek settings told us working fine for him but not for me.

Settings are:
Crop Mode
- MCM Rewire
- Bitdepth = 10bit
- Ratios = 16:9 or OFF (to increase max resolution in 1:2)

RAW Video:
- Resolution - 1736x976
- Aspect Ratio - 1:2 (16:9)
- Card Warm-Up 64 MB
- Small Hacks - af on
- Sound Recording - OFF

chroma smooth x3 solve a part but not all.
Especially when i add sharpness on MLV, White dots appears on edges.
But when using crop x3 they goes away.

I downloaded the focus map files but since my MLV app is standalone with no folders i don't know where i'm supposed to put It...
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on June 29, 2019, 04:11:50 PM
If on mac you can download the compiler in the first post:
https://www.magiclantern.fm/forum/index.php?topic=20025.0

As of lately you get a prompt to install focus pixel maps here:
https://www.magiclantern.fm/forum/index.php?topic=20025.msg217959#msg217959

Not all modes might be working with latest pixel maps so so it would be great if you could help the community out and tell us exactly what modes aren´t working and what actually works. Maybe upload short mlv files of the problematic modes. Post your findings here:
https://www.magiclantern.fm/forum/index.php?topic=16054.msg217953#msg217953
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Romain182 on June 29, 2019, 04:28:30 PM
Thanks for the quick reply !
unfortunatly i'm on Windows 10.
So i guess the compiler will not work on my PC.

Settings are:
Crop Mode
- MCM Rewire
- Bitdepth = 10bit
- Ratios = 16:9

RAW Video:
- Resolution - 1736x976
- Aspect Ratio - 16:9
- Card Warm-Up 64 MB
- Small Hacks - af on
- Sound Recording - OFF

I'll try to upload an MLV file asap.

I'm really depressed to see Zeek videos that great and not being able to get any good quality out of the same camera, same ML and same settings...

I guess i fail somewhere !
Maybe an option on the Canon native menu.
Or in ML.

Edit: i dont mentioned all the modes i'm using cause it's just the same focusing dots on any modes.
looks like changing mode doesn't affect It.
Only x3 crop works great on any settings.
but i prefer being able to use the Rewire cause it's more a good to go on any situation imo.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on June 29, 2019, 04:30:51 PM
There will be focus pixels in all eosm modes. The preset you are using should work but who knows. If you search on the forum there are post about where to put the map files also on windows 10.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Romain182 on June 29, 2019, 04:40:33 PM
Maybe it's a bug on ML.
Cause i've already like 4 roms in It and Maybe need to clear some.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on June 29, 2019, 04:42:18 PM
Bug? Don´t think so. Pleasy upload examples of what you look at being a problem. A MLV file, dng or something to inspect.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: ZEEK on June 29, 2019, 04:45:12 PM

I guess i fail somewhere !
Maybe an option on the Canon native menu.
Or in ML.

Edit: i dont mentioned all the modes i'm using cause it's just the same focusing dots on any modes.
looks like changing mode doesn't affect It.
Only x3 crop works great on any settings.
but i prefer being able to use the Rewire cause it's more a good to go on any situation imo.

There is nothing in-camera, I don't think that will solve the focus pixels. I'm currently using June 14th Build and it works perfectly with the focus pixels, no chroma smooth needed at all.
- Ensure in MLV App, you have 'enabled' 'fix focus pixels' or dots which essential in removing the dots. I was frustrated as to why I was getting the red focus pixels a few weeks back and realised this was not enabled in MLV App. Now there is no issue. There has been no issue with the June 14 Build for me, I've been hesitant to update ml. Cheers :)
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Romain182 on June 29, 2019, 05:19:12 PM
Hi Zeek !
Maybe i need to roll back to the previous build from 14th june.
Is It possible for you to upload your ML folder somewhere ?
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on June 29, 2019, 05:24:43 PM
No change in june 14th for the mcm modes. Could you upload a sample please?
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Jip-Hop on June 29, 2019, 05:39:26 PM
Would it be possible to toggle between 3x crop mode with a single button? E.g. the set or info button? Would be super convenient to use it like the Extended Tele Conversion on some Panasonic models. Currently I haven't built up the muscle memory to switch quickly. It takes about 5 seconds and 5 key presses to toggle.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on June 29, 2019, 06:01:54 PM
All the way to the right you have a triangle ´modified´and in there you can get into fast toggle presets.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: ZEEK on June 29, 2019, 11:36:15 PM
No change in june 14th for the mcm modes. Could you upload a sample please?

Sure. What sample would you like to see? A screenshot of a clip in MLV App with no chroma smooth enabled?
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: berechiah on June 29, 2019, 11:37:27 PM
Hey Danne

I just uploaded a quick video at 36fps

But I know we talked about it before but I still can't get to 40fps with out the screen going weird

I choose 40fps then press the canon menu the go back to main screen and BOOM the screen goes weird again.
Any ideas. Its nice to go past 36fps but if I can't its fine too.

PS I didn't know about my menu option until you said there now. its great all the things I use on one page.

HANDY
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: ZEEK on June 29, 2019, 11:38:35 PM

Is It possible for you to upload your ML folder somewhere ?

Yes I can.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on June 30, 2019, 12:09:21 AM
Hey Danne

I just uploaded a quick video at 36fps

But I know we talked about it before but I still can't get to 40fps with out the screen going weird

I choose 40fps then press the canon menu the go back to main screen and BOOM the screen goes weird again.
Any ideas. Its nice to go past 36fps but if I can't its fine too.

PS I didn't know about my menu option until you said there now. its great all the things I use on one page.

HANDY

I need more info. What build version used? Exact settings. Maybe even upload you're entire ML build straight from camera. Just tested 40fps works here with mcm rewired preset modes.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Romain182 on June 30, 2019, 12:26:56 AM
Bug? Don´t think so. Pleasy upload examples of what you look at being a problem. A MLV file, dng or something to inspect.

https://1drv.ms/u/s!Ao7sNkSiu5ZxmgoDvEexGwXMnxIC?e=OTAESn (https://1drv.ms/u/s!Ao7sNkSiu5ZxmgoDvEexGwXMnxIC?e=OTAESn)https://1drv.ms/u/s!Ao7sNkSiu5ZxmgoDvEexGwXMnxIC?e=OTAESn

Here is the DNG file you where asking.
For remember the settings was:
Crop Mode
- MCM Rewire
- Bitdepth = 10bit
- Ratios = 16:9
RAW Video:
- Resolution - 1736x976
- Aspect Ratio - 16:9
- Card Warm-Up 64 MB
- Small Hacks - af on
- Sound Recording - OFF

Record on Sandisk Extreme Pro 95Mb/s 64GB
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: ZEEK on June 30, 2019, 12:35:03 AM
I need more info. What build version used? Exact settings. Maybe even upload you're entire ML build straight from camera. Just tested 40fps works here with mcm rewired preset modes.

Using MCM 1080 Rewired (the higher frame rates one, I think 45/46fps), I can get 45fps max. The LV freezes, but you double press the menu button and then it's up and running as usual. 45fps looks really nice and I'm sure you can take it up a notch to 50fps in MLV App and slap it on to a 24p timeline. Build used 14th June.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: berechiah on June 30, 2019, 12:44:07 AM
I need more info. What build version used? Exact settings. Maybe even upload you're entire ML build straight from camera. Just tested 40fps works here with mcm rewired preset modes.

I am on the 30fps from the canon menu
I am on the build from 4 hours ago as of this time
I am using 1080p MCM Rewire
16:9 in crop mode (But also 2:35:1)
I am using kill global draw
I am choosing the "desired FPS 40 out of 30

Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: berechiah on June 30, 2019, 12:47:26 AM
Using MCM 1080 Rewired (the higher frame rates one, I think 45/46fps), I can get 45fps max. The LV freezes, but you double press the menu button and then it's up and running as usual. 45fps looks really nice and I'm sure you can take it up a notch to 50fps in MLV App and slap it on to a 24p timeline. Build used 14th June.

True that mode works fine.

But Danne mentioned before that in the normal 1080p MCM Rewire mode
I can set the fps higher and still work out ok

I just like the normal view in the MCM Rewire mode

if it is posable to get to 40 COOL but if not its a class job so far.

Hope I am not being a pain by asking this question
but it is a great job how advanced the Eos m is now. thanks for all the hard work Danne and to those other people too
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on June 30, 2019, 12:54:35 AM
I am on the 30fps from the canon menu
I am on the build from 4 hours ago as of this time
I am using 1080p MCM Rewire
16:9 in crop mode (But also 2:35:1)
I am using kill global draw
I am choosing the "desired FPS 40 out of 30
This too works on my cam at 40fps. Probably missing a setting if something's not working. If you want to go to the bottom here we would need you to film when you are setting up your cam. It could also be something affecting in canon menu. Who knows.
If you can send me your ml build from sd card after you have it all set I could test it here.
Also. Since you set 2.35:1 why not just select the 48 fps preset instead? It will be more or less the same quality.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: berechiah on June 30, 2019, 01:15:20 AM
This too works on my cam at 40fps. Probably missing a setting if something's not working. If you want to go to the bottom here we would need you to film when you are setting up your cam. It could also be something affecting in canon menu. Who knows.
If you can send me your ml build from sd card after you have it all set I could test it here.
Also. Since you set 2.35:1 why not just select the 48 fps preset instead? It will be more or less the same quality.

I'll do that
Ill take a video tomorrow and upload it to YouTube so you can see exactly what is happening

I can use the 48fps crop mode but it is the stretched view but iits fine anyway

Thamks Danne your life saver

U too zeek really appreciate all your utube videos
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: ZEEK on June 30, 2019, 01:54:45 AM
I know what you mean with the stretchy live view, i can live with it. But it would be nice to have the normal live view like in MCM Rewire. Like they say, the EOS M is what it is..at least for now. Got an EOS M2 coming in (^_^)
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: berechiah on June 30, 2019, 02:09:35 AM
I know what you mean with the stretchy live view, i can live with it. But it would be nice to have the normal live view like in MCM Rewire. Like they say, the EOS M is what it is..at least for now. Got an EOS M2 coming in (^_^)

I just got a 5d2 its top class but the eos m is way more advanced I think.
Love all the features

Is ml available for the m2?
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: ZEEK on June 30, 2019, 02:20:14 AM
I just got a 5d2 its top class but the eos m is way more advanced I think.
Love all the features

Is ml available for the m2?

5D2 is nice indeed.
Dfort has some test builds up on his site. But I believe they still need a bit of work. I think some stuff freeze, not too sure. Just bought in hopes that a good build will come out for the eos m2 like the EOS M. The eos m2 has WiFi, slightly better autofocus, slightly better dynamic range (11.2 vs 11.4) and 8% smaller.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on June 30, 2019, 10:53:03 AM
I have a version for eosm2 that kind of worked with rewired and anamorphic mode. A bit buggy. Let me know if you want to test it.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: berechiah on June 30, 2019, 11:22:14 AM
Hi danne
Here is a link to what I see on my screen
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on June 30, 2019, 11:49:34 AM
Try to press canon menu and go back when you see the blink. This is common procedure especially around rewired modes since regs are changed in more places.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: berechiah on June 30, 2019, 12:03:05 PM
I did that I tried pressing the canon menu and every different setting

Like every bit rate
Fine tune on and off
Global draw on and off
Change the fps in the canon menu
Every different way I can think I spent a long time trying all different setting to make it go away

But it's still there

It's ok tho it would be nice to have it but if it odnt work its fine
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: ZEEK on June 30, 2019, 12:31:54 PM
I have a version for eosm2 that kind of worked with rewired and anamorphic mode. A bit buggy. Let me know if you want to test it.

Would love to test it out, though the EOS M2 hasn't arrived yet. Should come in later this week. I'll give a shout out to you once it arrives and see how the build goes (fingers crossed).
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Romain182 on June 30, 2019, 12:50:15 PM
Update on focus dots
Still have them on x3 crop
Same settings has before, only x3 crop enable

(https://www.magiclantern.fm/forum/proxy.php?request=https%3A%2F%2Fimage.noelshack.com%2Fminis%2F2019%2F26%2F7%2F1561891687-m30-1257-00-00-00-00-image-fixe001.png&hash=af76f5d7d8d46c2b943c4b1ce231b615) (https://www.noelshack.com/2019-26-7-1561891687-m30-1257-00-00-00-00-image-fixe001.jpg)
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on June 30, 2019, 01:50:45 PM
I'll do that
Ill take a video tomorrow and upload it to YouTube so you can see exactly what is happening
Reproduced. Most likely you have AF method set to tracking. Go into photo mode and set canon menu to FlexizoneAF. Then reinstall magic lantern and start fresh. When I set AF method to tracking it starts to flicker but it still would flicker even after changing back to FlexizoneAF so a reinstall or cleaning the config file would eventually cure the issue.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Romain182 on June 30, 2019, 03:25:17 PM
Update on focus dots
Still have them on x3 crop
Same settings has before, only x3 crop enable

(https://www.magiclantern.fm/forum/proxy.php?request=https%3A%2F%2Fimage.noelshack.com%2Fminis%2F2019%2F26%2F7%2F1561891687-m30-1257-00-00-00-00-image-fixe001.png&hash=af76f5d7d8d46c2b943c4b1ce231b615) (https://www.noelshack.com/2019-26-7-1561891687-m30-1257-00-00-00-00-image-fixe001.jpg)

I tryed the 14th June build i found somewhere in my download folder
Still the same...

I'm desperate

Zeek,
Is there anything special you does on your build settings ?
I totally remove the 28th June build before installing the 14h June,
just tweaking to get the same settings has yours and BOOM focus dots appears.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on June 30, 2019, 03:35:33 PM
Dots they still can be there with x3crop mode and other modes. These maps needs updating every once in a while since resolutions and tweaks occur all the time at the time being...
Best way is for you to learn how they are build over at the focus pixel thread and then you can create your own maps.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: berechiah on June 30, 2019, 04:01:26 PM
Reproduced. Most likely you have AF method set to tracking. Go into photo mode and set canon menu to FlexizoneAF. Then reinstall magic lantern and start fresh. When I set AF method to tracking it starts to flicker but it still would flicker even after changing back to FlexizoneAF so a reinstall or cleaning the config file would eventually cure the issue.


Thanks Danne.
I did uninstall ml and I your right it was on focus tracking but it is still giving the weird preview

I dont mind its 36 fps perfect
It's not the end of the world if it dose not work for me. Maybe I'm doing something wrong. I didn't spend a load of time.Trying to figure it out. But I'm sure its something simple I'm missing
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: 2blackbar on June 30, 2019, 04:01:49 PM
focus pixels can be removed in mlvapp if you use chroma smooth in raw corrections if focus pixels removal options in mlvapp wont work.For me sometimes they wont and i have to use chroma smooth, nothing to be worried about but good to know, if it works it works.
I dont believe there was build without focus pixels, sometimes they just arent visible that well depending on what you shoot and they appear again with the same build and settings if you shoot something else.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: berechiah on June 30, 2019, 04:05:59 PM
Reproduced. Most likely you have AF method set to tracking. Go into photo mode and set canon menu to FlexizoneAF. Then reinstall magic lantern and start fresh. When I set AF method to tracking it starts to flicker but it still would flicker even after changing back to FlexizoneAF so a reinstall or cleaning the config file would eventually cure the issue.


But really 48fps woth stretch view is fine

And 36fps normal view is perfect too

It is most likely working and I'm making a mess of something. I'll continue to spend time on it but of I can I'll do all I can to get it going

Thanks man
Your d best
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on June 30, 2019, 04:06:26 PM

Thanks Danne.
I did uninstall ml and I your right it was on focus tracking but it is still giving the weird preview

I dont mind its 36 fps perfect
It's not the end of the world if it dose not work for me. Maybe I'm doing something wrong. I didn't spend a load of time.Trying to figure it out. But I'm sure its something simple I'm missing
Well, I still think it´s related to this issue. Try uninstall and reinstall magic lantern in photo mode maybe after you have switched to flexizone. Like I said. It´s very stubborn.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: berechiah on June 30, 2019, 04:44:53 PM
Hey so I just happened to stumble upon something

I am in 42fps and if I change the shutter speed to 64 I get clear view on the screen  if I go over 64fps
and if I go to 40fps I get clear view to 70fps if I go over 70fps it goes all wonky

Dose this sound right?
I think it is one step closer to finding the issue
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on June 30, 2019, 04:56:47 PM
Let's check you shutter blanking regs.
1 - disable all modules
2 - enable adtg_gui.mo restart camera
3 - find ADTG Registers and turn it on
4 - go into ADTG Registers and go to the bottom part until you find ADTG2[805F]N. Now stand on that register. Write down what it says at the bottom. Evf:33 and so on.
Do the same with register below ADTG2[8061]N.

You could probably use the Screenshot function if you are quick enough.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Jip-Hop on June 30, 2019, 05:09:21 PM
All the way to the right you have a triangle ´modified´and in there you can get into fast toggle presets.
This menu is quite useful, but when the 3x mode is disabled, it won't show up in this menu. And toggling from here still isn't very quick. I thought maybe it's possible to trigger a Lua script when pressing the set or info button that would toggle the 3x crop setting and also enter and exit the canon menu.

I could try to base a script on your cine.lua script if there's a way to run a script from the set or info button.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on June 30, 2019, 05:13:41 PM
Probably works. Good luck :)
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: berechiah on June 30, 2019, 05:53:08 PM
Let's check you shutter blanking regs.
1 - disable all modules
2 - enable adtg_gui.mo restart camera
3 - find ADTG Registers and turn it on
4 - go into ADTG Registers and go to the bottom part until you find ADTG2[805F]N. Now stand on that register. Write down what it says at the bottom. Evf:33 and so on.
Do the same with register below ADTG2[8061]N.

You could probably use the Screenshot function if you are quick enough.

Unfortunately I am not home yet I will be in about 2 hours I will definitely check it once I'm home and let you know straight away
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Jip-Hop on June 30, 2019, 07:18:04 PM
Probably works. Good luck :)

Made this script. Allows me to toggle between 3x crop mode with 2 key presses, info button and immediately after the menu button. Switching takes about 1 second. Didn't find a good way to exit the Canon menu after the first key.press(KEY.MENU). Tried adding msleep up to 2000 but it just didn't exit out of the Canon menu. What would be a reliable way to immediately exit the Canon menu?

Have this script set to autorun, but then it shows the console output: "[Lua] all scripts loaded." Any way to hide this?

Code: [Select]
-- ETC 

-- Toggle between 3x crop mode

-- end this script if not eosm
if camera.model_short ~= "EOSM" then
    display.notify_box("Script not working on this cam")
    msleep(2000)
    return
end
   
-- warnings
while camera.mode ~= MODE.MOVIE do
    display.notify_box("enable MOVIE mode")
    msleep(1000)
end   

function toggle_x3crop()
    -- crop mode
    if menu.get("Crop mode", "x3crop") == "x3crop" then
        menu.set("Crop mode", "x3crop", 0)
    else
        menu.set("Crop mode", "x3crop", "x3crop")
    end
   
    key.press(KEY.MENU)
end

event.keypress = function(key)
    if key == KEY.INFO and menu.visible == false then
        toggle_x3crop()
        return false
    end
end
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on June 30, 2019, 07:30:46 PM
Nice. Will try it later. It would be nice to actually have a menu item base on lua which lines up a bunch of presets for fast acces. Still on todo list. Seems you are fast learning here so feel free to keep it up.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: berechiah on June 30, 2019, 09:09:20 PM
Let's check you shutter blanking regs.
1 - disable all modules
2 - enable adtg_gui.mo restart camera
3 - find ADTG Registers and turn it on
4 - go into ADTG Registers and go to the bottom part until you find ADTG2[805F]N. Now stand on that register. Write down what it says at the bottom. Evf:33 and so on.
Do the same with register below ADTG2[8061]N.

You could probably use the Screenshot function if you are quick enough.

ADTG2[805F] N  0x588 Shutter ... x40/f
Evf:33be8:40481b20 v=1868(0x74c) nrzi_dec=1416(0x588).

ADTG2[8061] N 0x425 Shutter ... x56/f
Evf:33be8:40481b24 v=1591(0x637) nrzi_dec=1061(0x425).

here is a link to the photo I took

(https://www.magiclantern.fm/forum/proxy.php?request=https%3A%2F%2Fi.postimg.cc%2F5HL8gD1y%2F20190630-195821.jpg&hash=ab4e0e4ac68decd127a51859d95cc802) (https://postimg.cc/5HL8gD1y)

(https://www.magiclantern.fm/forum/proxy.php?request=https%3A%2F%2Fi.postimg.cc%2Fk6CKpwXc%2F20190630-195900.jpg&hash=dc3ef15731a512818f0af1e22705388b) (https://postimg.cc/k6CKpwXc)
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: berechiah on June 30, 2019, 09:11:05 PM
hope you can figure it out

You are a serious man if you have half an idea what this means
id love to know these things but they got way past me unfortunately
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on June 30, 2019, 11:18:56 PM
Thanks. Numbers are good so problem lies elsewhere. But where...
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: berechiah on June 30, 2019, 11:33:45 PM
Thanks. Numbers are good so problem lies elsewhere. But where...

Seems similar to the issue before
Hight the frame rate the lower the shutter speed

But I have not a clue

Dont worry about it
I can beg 40fps thanks to u
And a shutter of 70
This is perfect tbh

The eos m is so advanced thanks to u
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Jip-Hop on July 01, 2019, 08:46:16 AM
Is anybody using the SanDisk Extreme PRO - 256 GB - SDXC UHS-I - 95 MB/'s card? And is it any good for continuous recording?
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: berechiah on July 01, 2019, 10:07:03 AM
Is anybody using the SanDisk Extreme PRO - 256 GB - SDXC UHS-I - 95 MB/'s card? And is it any good for continuous recording?

Thata the exact one I have
I get continuous record no problem

Handles video very well
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Jip-Hop on July 01, 2019, 12:01:50 PM
Good to know! My 64gb card fills up way to quickly obviously.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on July 01, 2019, 05:33:41 PM
New version:
https://www.magiclantern.fm/forum/index.php?topic=9741.msg208959#msg208959

Commit:
https://bitbucket.org/Dannephoto/magic-lantern/commits/97b85292c2584f3060535c190a67c2be4c26b773?at=crop_rec_4k_mlv_snd_isogain_1x3_presets

- x3crop toggle switch in Crop mode sub menu. Works for all mv1080p modes(including mcm rewired mode that is)

3xcrop toggle
(https://www.magiclantern.fm/forum/proxy.php?request=https%3A%2F%2Fi.postimg.cc%2FtRh0Z3mw%2FVRAM1-PPM-scaled.png&hash=30dcbbb01395339f893161b1a5d51bfa)


What´s it all about:
Often thought about a way to toggle between regular and x3crop mode sort of not missing the opportunity to record zoomed and non zoomed without having to dig deep in menus. Jip-Hop recently also asked about this and built a lua script here so I´d thought I´d take a look at it but c-code wise:
https://www.magiclantern.fm/forum/index.php?topic=9741.msg218100#msg218100

Borrowed some code from mlv_lite.c and mixed it into a few places in crop_rec.c and it works fairly well.
1 - Enable x3crop toggle
2 - Press halfshutter for around a second and it will will switch mode
3 - Press record

Wouldn´t use autofocus on this one ;) If so you need to put in a msleep after this part:
Code: [Select]
if (get_ms_clock() - last_hs_unpress > 500 && (crop_patch && get_halfshutter_pressed() && x3toggle == 0x1))
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: garry23 on July 01, 2019, 05:37:50 PM
@Danne and @Jip-Hop

You may wish to look at and adapt by Cycler script.

 https://www.magiclantern.fm/forum/index.php?topic=23679.0

This allows me to use keys as normal and extend them.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Jip-Hop on July 01, 2019, 06:15:34 PM
Thanks for looking into it Danne! I was out today shooting with my script and found it super convenient to quickly toggle the 3x crop mode.
Just tried out your new build and it toggles the 3x crop mode nicely :)

Some feedback:
Toggling with longpress of half shutter button feels a bit less responsive than what I experienced with my script today.
Before toggling it goes into the slow black and white live view first, and sometimes stays there a second or two.
Also I have Magic Zoom assigned to half shutter press, so for me this conflicts at the moment.
I find the info button a good choice because I don't really use that one.

I guess I could stick with your neatly integrated solution, and instead make a script which toggles Magic Zoom always on/off with the info button instead.
For this I'd definitely look at the Cycler script made by garry23!
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on July 01, 2019, 06:20:23 PM
Let me know what you come up with.
Response with a delay since it's the halfshutter button. Maybe not the best button. If you get a script working with info button I could include it.
He, your script already does that. Well, gonna check into that later...
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Jip-Hop on July 01, 2019, 06:45:22 PM
Nice thing about your solution, which doesn't seem to rely on Lua api, is that there's no need to enter and exit the Canon menu to get the x3cropmode to come into effect.

If there'd be a way to refresh the regs from Lua, like you do without enter and exit Canon menu, then it would become a lot easier to switch between different modes from Lua scripts.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: garry23 on July 01, 2019, 07:19:11 PM
@Jip-Hop

All ML menu items cam be controlled from Lua  ;)
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Jip-Hop on July 01, 2019, 08:04:11 PM
I know and that's awesome! But for toggling the 3x crop mode, or switching between modes like mv1080 and anamorphic mode, you need to enter the Canon menu (not ML menu) and exit it. It's a workaround so the settings will actually take effect.

But this workaround doesn't work so nicely in Lua. Nice thing about Danne's method now is that he doesn't seem to rely on the workaround (enter/exit Canon menu). If we'd be able to call Danne's method of applying these settings from Lua, then we could make custom scripts to quickly change between different raw recording modes.

Or perhaps I'm misunderstanding how all this works :P
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: garry23 on July 01, 2019, 08:10:04 PM
Ok, I get it now.

Remember, I don’t do ‘that video’ stuff  ;) :)

Just a simple photographer.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: berechiah on July 01, 2019, 08:42:20 PM
WHAT A GREAT IDEA

The x3 toggle
I never knew I needed it until now
It's so handy
And the shutter botton is fine its handy to have there

Well done danne
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: ZEEK on July 02, 2019, 03:05:35 AM
Cheers Danne, looks good! 8)
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Jip-Hop on July 03, 2019, 10:05:39 PM
I improved my previous script with inspiration from Danne's latest build.
Now you can choose three buttons (INFO, SET or HALFSHUTTER) to toggle between normal and 3x crop in mv1080.
Or you can disable this functionality.

It's a LUA script which should be set to autorun.
It adds a menu entry in the ML video section.

(https://www.magiclantern.fm/forum/proxy.php?request=https%3A%2F%2Fi.ibb.co%2F0Bg91gb%2Fsignal-2019-07-03-215218.jpg&hash=d3dc9d511628d29f6c9f4af83459cbcb)

(https://www.magiclantern.fm/forum/proxy.php?request=https%3A%2F%2Fi.ibb.co%2FRzB45xS%2Fsignal-2019-07-03-215234.jpg&hash=799a54d1385910872b2cc78c9946a2eb)

No need to enter and exit the Canon menu anymore.
I'm pausing and resuming Live View, which I spotted Danne doing in his latest commit.
But I find my way of switching is a more responsive.
This solution switches instantly whereas with the latest build I need to keep the halfshutter pressed for a bit before it toggles.
Plus you get the choice to use other keys.

The script is on GitHub: https://gist.github.com/Jip-Hop/688253710f25d3a0ff008f908241d1b0 (https://gist.github.com/Jip-Hop/688253710f25d3a0ff008f908241d1b0).

I found it quite tricky to get the menu working like I wanted.
Tried to mimic how "RAW video" menu item works (SET button to toggle on and off and Play Button for submenu).
But couldn't figure out how to do that (for me it would always enter the submenu and never toggle with SET...)
So the menu isn't perfect, oh well...

By the way Danne, in the cine.lua script you forgot to replace the last occurrence of cinema 2:35.1 with cinema 2.39:1.
Now the code in first if statement would not work I think.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on July 03, 2019, 10:38:17 PM
By the way Danne, in the cine.lua script you forgot to replace the last occurrence of cinema 2:35.1 with cinema 2.39:1.
Now the code in first if statement would not work I think.
Nice. Thanks. Updated my script.

Nice to see your lua implementation in progress. Lua is very powerful and has come a long way since dmilligan and a1ex refined api etc immensely.

I keep a few early scripts here by the way. Very basic stuff:
https://bitbucket.org/Dannephoto/lua_magic/src/default/
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on July 03, 2019, 11:16:32 PM
@Jip-Hop
Lovely script man. Very responsive and super useful. What a nice way to be able to choose button to. Most likely I´ll inlcude this script into my coming builds. Good and inspiring work!
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: ZEEK on July 04, 2019, 02:58:32 AM
@Danne, the EOS M2 arrived today, so when you're ready just upload a link to the EOS M2 build you want me to test out. Cheers :)
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on July 04, 2019, 09:10:33 AM
@ZEEK
If you want to test here´s a version:
https://www.magiclantern.fm/forum/index.php?topic=15895.msg218233#msg218233

Don´t expect much here. I do not own the camera and there´s groundwork issues that I cannot fix that needs attention. I also no longer have the camera myself to play with.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: ZEEK on July 04, 2019, 10:13:43 AM
Don´t expect much here. I do not own the camera and there´s groundwork issues that I cannot fix that needs attention. I also no longer have the camera myself to play with.

Thanks for that. No problem, I'll give it a go see how it plays out! Cheers :)
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Jip-Hop on July 04, 2019, 04:57:27 PM
I updated my script. It should now restart movie recording more or less as quick as it can when you toggle x3crop while recording.
https://gist.github.com/Jip-Hop/688253710f25d3a0ff008f908241d1b0 (https://gist.github.com/Jip-Hop/688253710f25d3a0ff008f908241d1b0)

Haven't addressed Danne's comments yet about also allowing normal use of the chosen button.
Right now the button you choose loses it's normal function for as long as my toggle menu is activated.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: garry23 on July 04, 2019, 05:05:29 PM
@jip-hop

I’ve scripted dual functionality via a long press feature, ie short press activates the augmented functionality and a long press gives you normal functionality.

Just a idea.

Cheers

Garry
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Jip-Hop on July 04, 2019, 05:08:34 PM
Thanks Garry, sounds like a good way to do it.
Is it in your Cycler B script?
Would like to include that functionality in the next version of the script.

Also I made this Automator workflow for developing scripts on MacOS.
https://www.dropbox.com/s/kv13hoajbnjerej/ML%20script%20development%20without%20any%20script%20specified.workflow.zip?dl=0 (ftp://www.dropbox.com/s/kv13hoajbnjerej/ML%20script%20development%20without%20any%20script%20specified.workflow.zip?dl=0)
- You need to open it in Automator first (not Automator Installer).
- Choose the .LUA script(s) your working on in the first "Get Specified Finder Items" block.
- Save the workflow.
- Double click the workflow file in Finder to open with Automator Installer.
- Click Install.

Now every time you insert the SD card from your camera it will copy the scripts you're working on to the SD and unmount the SD.
So it's as easy as pop it in the SD card reader, wait 1 second (until you see in Finder that it mounted and unmounted instantly) and take it out of the reader and insert back into the camera to test the script :)

I hope it speeds up script development :D
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on July 04, 2019, 05:13:04 PM
@jip-hop

I’ve scripted dual functionality via a long press feature, ie short press activates the augmented functionality and a long press gives you normal functionality.
Exactly what´s needed.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on July 04, 2019, 05:15:45 PM
I updated my script. It should now restart movie recording more or less as quick as it can when you toggle x3crop while recording.
https://gist.github.com/Jip-Hop/688253710f25d3a0ff008f908241d1b0 (https://gist.github.com/Jip-Hop/688253710f25d3a0ff008f908241d1b0)

Haven't addressed Danne's comments yet about also allowing normal use of the chosen button.
Right now the button you choose loses it's normal function for as long as my toggle menu is activated.
Great. On my side I removed the delay when x3crop toggle is enabled in Crop mode sub menu. Response right away. Better...
https://bitbucket.org/Dannephoto/magic-lantern/downloads/crop_rec_4k_mlv_snd_isogain_1x3_presets_2019Jul04.EOSM202.zip

Edit: One nice addition is that if RAW video is disabled but you leave Crop_rec on it will record h264 mov both x3crop or non cropped...
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: garry23 on July 04, 2019, 05:28:24 PM
@Jip-Hop

The long press approach is in my hand held helper script.

Another approach I have tried is multiple presses within given time window.

Yet another approach is to use one key to modify another.

Bottom line: loads of options, but, some become camera specific. Which is why I caveat my scripts, ie they are written for me on my cameras  ;)
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Jip-Hop on July 04, 2019, 05:39:00 PM
Great. On my side I removed the delay when x3crop toggle is enabled in Crop mode sub menu. Response right away. Better...
https://bitbucket.org/Dannephoto/magic-lantern/downloads/crop_rec_4k_mlv_snd_isogain_1x3_presets_2019Jul04.EOSM202.zip

Cool!

@Jip-Hop

The long press approach is in my hand held helper script.


Do you mean this one https://gist.github.com/pigeonhill/3c351242740c84f0581fa57ac27e0656 (https://gist.github.com/pigeonhill/3c351242740c84f0581fa57ac27e0656)?

There you distinguish between long and short press of half shutter button.
But INFO button only has one state right? Not a separate one for pressed and unpressed.

So can it also be done with INFO button?
Say, short press INFO for the enhanced functionality and longpress for the normal functionality?
Seems unlikely at first thought.

The SET button does have an unpressed state, so maybe that one is better. Also these keys have unpressed state: UNPRESS_UDLR and UNPRESS_FLASH_MOVIE. But don't know if EOS M has them xD
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: garry23 on July 04, 2019, 06:31:12 PM
@Jip-Hop

No, you are right. You can only do the long press trick on certain keys.

That’s why sometimes I also use two keys, ie

Key1 followed by Key1 = normal Key1

Key1 followed by Key2 = modified Key2

Key2 followed by Key2 = normal Key2

Key1 followed by Keyn, but not (Key1 or Key2) = Keyn
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: garry23 on July 04, 2019, 06:39:55 PM
Plus

You can use pseudo long presses by detecting a key press of key1, say, and starting a timer, then test the timer if key1 pressed next, say x seconds later.

I’ve used this approach as well, but you need to use shoot_task event as well.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Jip-Hop on July 04, 2019, 11:32:04 PM
Thanks for the tips garry23! Will keep it in mind when I continue to work on my script.

Having used the EOS M for a bit now, I'm super excited about it :)
But I also got a couple of things I wish it had.

I'd like to be able to switch easily between various RAW recording modes.
Have some modes preconfigured so I can easily toggle between e.g. mv1080 MCM rewire 14bit with 3x crop and 4k anamorphic 10bit.
Or toggle between 2.5k and mv1080 MCM rewire 3x crop.
This could also help with focus before recording since the preview in 2.5k and anamorphic is not great.
And then just toggle and hit record.
I hope I can make this possible with a LUA script and will look into it next week.

Other things I wish it had are:
- Working auto white balance in RAW recording. Currently it doesn't log the actual measured white balance (kelvin, tint/shift). I don't know anything about how WB works, but I feel like this should be possible. To me this thread from 2013 seems relevant: https://www.magiclantern.fm/forum/index.php?topic=6779.0 (https://www.magiclantern.fm/forum/index.php?topic=6779.0).
- A button which auto sets exposure (ettr) in shutter speed priority mode. So leave the shutter speed alone, but adjust aperture first and if necessary ISO.
- Better live view for 2.5k and anamorphic modes, but this is probably only possible in my dreams :P
- Full time manual focus, with the possibility to autofocus by pressing a button. The default Canon behaviour is either no autofocus, or very limited manual focus (MF only after AF while keeping half shutter pressed). I guess this could be easily fixed with LUA too, just leave focus set to manual in Canon menu and map half shutter press to autofocus with LUA.

Danne do you have any plans for the camera you wish to share?
What do others feel like could be added/removed/improved?

Magic Lantern is really awesome stuff :) thanks devs and contributors!
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: ZEEK on July 05, 2019, 02:08:16 AM
It's a shame the EOS M2 doesn't receive much attention as the EOS M. I just played around with the M2 files on MLV APP and I can recover highlights much better than I can with the EOS M. I just turned a white sky into a blue sky simply by pulling down the highlights in mlv app and it didn't turn pink as it would sometimes with the EOS M. The image quality is obviously the same, just the M2 lacks the EOS M resolution. If it had the proper resolution/modes, I would pick the M2 any day of the week. It's got Wi-fi, slightly better low light, slightly better AF, Better DR (11.2 M VS 11.4 M2). Guess most are just focusing on the dream cameras, M50, 7DII, EOS R. Bought an M50 by the way just for future proof Magic Lantern (before the price rises you know ;))
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Jip-Hop on July 05, 2019, 07:36:30 AM
I also invested in an M50 xD
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: ZEEK on July 05, 2019, 02:10:13 PM
I also invested in an M50 xD

Nice one! The future looks bright ahead... 8)
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Naviddabest on July 05, 2019, 06:04:46 PM
I have just bought a Samsung Evo plus 128gb the faster version and I want to benchmark it in camera. But I don't have the benchmark module using danne build.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: dfort on July 05, 2019, 11:17:22 PM
It's a shame the EOS M2 doesn't receive much attention as the EOS M.

There aren't as many M2's as there are original M's. It was only distributed to a few territories when it first came out.

I thought this would be a good camera for a first crack at porting ML but if you go through the EOSM2 topic (https://www.magiclantern.fm/forum/index.php?topic=15895.0) you'll see it wasn't that easy and it isn't quite there yet. A couple of others guys messed around with M2's and Danne tried adding some of his EOSM settings to the M2. We do have it running on Danne's experimental branch though it isn't completely integrated yet.

If you want a challenge by all means get an M2 and see if you can figure out how to shake out the last few bugs and get this camera onto the main repository.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: ZEEK on July 06, 2019, 01:28:01 AM
See if you can figure out how to shake out the last few bugs and get this camera onto the main repository.

Yeah I have an EOS M2 in my hands. I'm no scientist, but I'll see what I can do. 📽
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: dfort on July 06, 2019, 03:48:48 AM
Cool. I've got some test builds on my downloads page (https://bitbucket.org/daniel_fort/magic-lantern/downloads/). A few features are working fine but others are quite broken. Give it a test drive and report back on the EOSM2 topic (https://www.magiclantern.fm/forum/index.php?topic=15895.0).
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: ZEEK on July 06, 2019, 11:07:20 AM
@dfort Thanks!
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: marcelo.lippi on July 06, 2019, 09:36:13 PM
Hi Danne and other friends. I uploaded the July 5th version after a few weeks of stopped shooting and I can't get to the bottom of a myriad of bugs, display errors, when I try to see a timelapse it freezes and then open error 07 sign, solution so far restart, remove batteries, open in photo mode and then switch to movie. Not even the lua 4.5k 14 bit lossless cinema workflow looks the same, with the same parameters the info color seems to compress less, so I barely can record 2 or 3 frames before it locks. The workflow that I had standardized no longer works. I deleted early June builds, where can I find them? I attach the crash files

https://drive.google.com/open?id=1mfC9M_6W9LInI13NB7y-CmaP9IzSXg1T
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on July 06, 2019, 09:49:52 PM
Older builds you have to compile yourself. Check relevant compiler threads.
Maybe you have some canon menu setting interfering? Tried formatting card? I don't experience your issues. I would need more reports and clear steps how to reproduce to be able to help.
What are others experiencing?
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: guerchi on July 06, 2019, 10:46:24 PM
I am using the version of July 5 without problems. I did not do timelapse, I mostly use mv1080p MCM rewire and 4k Anamorphic Rewired modes. In 10bit 2.35 1280x1700 it is quite stable, although it gave me a couple of pink frames in a 2 minute clip. I'm using a Sandisk Extrem PRO 128gb 95Mb/s. I also think that due to the 10bit there is a greenish tone with grain in the shadows near the black.
I did another test yesterday of 4k anamorphic rewire in 12 bit, iso 800. Today I will convert to see if there are pink frames. I chose this mode because in addition  to get a better resolution and less alaising than in mv1080p, note to my surprise that it responds a much much better in noise levels with high ISO, I will try to upload a comparison later.

On the other hand it is amazing the option of 3x crop Toggle! I found myself using it a lot. With the 24-70 it is like having the 70-200 mounted at the same time with the plus that the image has less artifacts in the 3x Crop mode. Beautiful.
Very grateful to Danne, Jip Hop, and all that make it possible. :)
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on July 07, 2019, 01:35:35 AM
I am using the version of July 5 without problems. I did not do timelapse, I mostly use mv1080p MCM rewire and 4k Anamorphic Rewired modes. In 10bit 2.35 1280x1700 it is quite stable,

On the other hand it is amazing the option of 3x crop Toggle! I found myself using it a lot. With the 24-70 it is like having the 70-200 mounted at the same time with the plus that the image has less artifacts in the 3x Crop mode. Beautiful.
Very grateful to Danne, Jip Hop, and all that make it possible. :)
Thanks for the feedback.
1280x1700? Not a resolution I´m familiar with. Are you using the ratios presets?
3xcrop toggle. Agree. Since available from a push on a button it´s a breeze to go in and out of close up using the same lens.
By the way. Greenish tone is only visible in liveview preview not on the recorded footage.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on July 07, 2019, 01:37:44 AM
New version:
https://www.magiclantern.fm/forum/index.php?topic=9741.msg208959#msg208959

- x3crop toggle will also work with anamorphic modes. It´s a ittle different. By keeping halfshutter pressed it will temporarily enter x3crop for focusing purposes. Releasing the button will enter back to anamorphic mode.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on July 07, 2019, 09:04:24 AM
Reuploaded a new build. Was testing out a new preview reg which dodn´t work in x5 zoom so redownload above version.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Jip-Hop on July 07, 2019, 10:05:39 AM
Cool stuff Danne! Can't try right now so I'll have to ask. Temporary x3crop in anamorphic as focus helper works only when not recording right?
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on July 07, 2019, 10:26:20 AM
yup
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on July 07, 2019, 02:57:45 PM
New upload again. Reverted back to older registry aorund preview brightness.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: marcelolippi on July 07, 2019, 04:13:36 PM
Hi guys, with the new Danne build, 7 july, all come back right...I didn't even install the new build ... mysteries, I don't ask for anything and I'm going to enjoy the recordings. Thanks and good job!
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on July 07, 2019, 05:58:48 PM
Yet another fix for metadata. New build uploaded:
https://www.magiclantern.fm/forum/index.php?topic=15895.msg218381;topicseen#msg218381
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: marcelolippi on July 07, 2019, 06:06:53 PM
will it be possible that the timecode of each single clip can be set or at least, follow the camera clock? to avoid that every clip starts from 0 that confuses the passage between AVID and DAVINCI RESOLVE? Thanks!
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: guerchi on July 08, 2019, 08:16:58 AM
1280x1700? Not a resolution I´m familiar with. Are you using the ratios presets?
Good Question  :o I'm not sure how I get to that resolution. From what I see, it is the resolution of option 2.20 when it is 2.35 in crop mode. I converted  that videos(4 videos of one minute approx.) And there is not a single pink frame! This is one still of these shots in 800ISO 12bits:
http://www.guerweb.com/pics/M06-2236_frame_101.png (http://www.guerweb.com/pics/M06-2236_frame_101.png)

By the way. Greenish tone is only visible in liveview preview not on the recorded footage.
I did not see it in the liveview, which only becomes a bit magenta. I noticed it from the MLV APP:
http://www.guerweb.com/pics/M06-1738_frame_62.png (http://www.guerweb.com/pics/M06-1738_frame_62.png)
Anyway, it seems that i could shoot in 12bits even more stable than in 10bits.
Today I test a video in aspect ratio 2.1 (with aspect ratio OFF in crop mode), 12bit,  1280x1820 res, 1:12 duration, without corrupted frames too! I do not know what you did with your latest version but it seems to have done wonders about the pink frames.

The only problem in this mode is the preview,  framing is very slow and realtime, I can deal with the narrow, but there is a significant cut in the frame, only shows the top part.
This is what it captures:
http://www.guerweb.com/pics/M08-2111_frame_285.png (http://www.guerweb.com/pics/M08-2111_frame_285.png)
and this is what I see:
http://www.guerweb.com/pics/IMG_20190707_205900.jpg (http://www.guerweb.com/pics/IMG_20190707_205900.jpg)

There is also a magenta bar in the middle that becomes notorious especially in the shadows that I don't know if it is possible to draw from the MLV App:
http://www.guerweb.com/pics/M09-0013_frame_736.png (http://www.guerweb.com/pics/M09-0013_frame_736.png)

Thanks Danne for answering and for all the work you are doing, let me know if you need to test more options. Despite these details, it is incredible what this little camera is already capable of.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on July 08, 2019, 08:22:54 AM
Run the lua cinema script and then use the ratios in crop mode sub menus instead of in RAW video section.
Or experiment but who knows where it takes you :)
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: mix_vfx on July 08, 2019, 01:00:35 PM
Hi!

I'm Miklos, from Hungary, and have been following ML development, especially for the Eos M lately. First of all, wanted to thank everyone's contribution, its truly amazing stuff.

I started using a Liliput A5 field monitor, and it works great in MCM Rewire mode.
4K Anamorphic is partially working with HDMI out. Liveview is stuck just 1 step before the 7fps correct framing view that works with internal screen, thus it is live, but squeezed.
Records countinously in 1488x1866, but gives half pink frames quite often.

Can I help to investigate what causes it? Can I make a log maybe with adtg_gui with and without the HDMI out enabled to help the process?

I'll do my research about it meanwhile, I'd like to contribute as I can. : )

Cheers
Miki
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Jip-Hop on July 10, 2019, 03:23:31 PM
The only difference between "2.5K 1:1 centered" and "2.5K 2520x1418" is the centering right? No other differences that affect quality, like possible resolutions and bit-depths? If no other differences, I'm wondering why anyone would want to record off-center...
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Danne on July 10, 2019, 04:11:55 PM
Greater height, centre is the same.
Title: Re: Danne's crop_rec_4k experiments for EOS M
Post by: Jip-Hop on July 10, 2019, 04:56:31 PM
So what does centered mean then?
And bot both are 1:1 crops right?

With ratios set to off the 2.5K 2520x1418 mode indeed has greater hight.

2.5K 1:1 centered records max 2520x1080.
2.5K 2520x1418 records in 2520x1416.

In 16:9 aspect ratio 2.5K 1:1 centered records max 1920x1080.
2.5K 2520x1418 records in 2192x1234.
So not only greater hight, but also greater width.

In 2.39:1 ratio both record in 2520x1054.
In 2.35:1 ratio both record in 2520x1072.

So there's no difference at all between these modes in these ratios?
Title: Re: Danne's crop_rec_4k experiments for EOS M