Best SD card for Canon EOS M + Magic Lantern

Started by jer3my, August 14, 2019, 10:18:04 AM

Previous topic - Next topic

0 Members and 1 Guest are viewing this topic.

Walter Schulz

Please follow instructions!
1) Start benchmark
2) Press "Play" button

Not other way round!

theBilalFakhouri

Quote from: wyup on June 27, 2022, 12:31:49 AM
1st test:  1st pass:  W: 59.7 MB/s   R: 64.3 MB/s
              2nd pass: W: 60.0 MB/s   R: 64.1 MB/s

BTW, these numbers matches my Sandisk Extreme Pro 64GB UHS-I U3 170MB/s at the same settings/mode.

We still need a benchmarks outside LiveView to check how fast your SD card can reach.

wyup

Sandisk Extreme Pro 64GB SDXC UHS-I 3 V30 - 200 MB/s 90 MB/s
Canon EOS M, ML 2022 May 30

HD 1080p, RAW OFF, Sound OFF, Global Draw OFF, 192 MHz
In Play Mode:

PHOTO MODE:

1st test:  1st pass:  W: 76.1 MB/s   R: 85.9 MB/s
              2nd pass: W: 75.7 MB/s   R: 85.9 MB/s
2nd test: 1st  pass: W: 76.1 MB/s   R: 86.0 MB/s
              2nd pass: W: 75.0 MB/s   R: 86.0 MB/s

VIDEO MODE:

1st test:  1st pass:  W: 75.7 MB/s   R: 85.9 MB/s
              2nd pass: W: 75.7 MB/s   R: 85.9 MB/s
2nd test: 1st  pass: W: 75.2 MB/s   R: 85.9 MB/s
              2nd pass: W: 76.1 MB/s   R: 85.9 MB/s
EOS M, 15-45 IS STM, 64GB Sandisk Extreme Pro UHS-I 200 MB/S

theBilalFakhouri

Okay, your SD card performs as 170MB/s version in 192 MHz, which mean you reached the maximum possible write speed when using 192 MHz overclock (your card is fine).

Back to your question, why you only get ~57 MB/s during RAW video recording?

-Enable the new hacks (lvface + aewb) from RAW video submenu, see:
https://youtu.be/a8FM_nlA8R8?t=39

Report back.

You can also use lower bit-depths (this will reduce required write speed).

TrincaEspinhas

Quote from: theBilalFakhouri on June 26, 2022, 08:57:54 PM
@wyup

Run card benchmarks in PLAY mode:

-Set SD overclock to 192 MHz.
-Load Bench.mo from "Modules" tab in ML settings, restart camera.
-Turn OFF RAW video and crop modes.
-Go to "Debug" tab from ML settings --> Benchmarks --> Card Benchmarks --> Quick R/W benchmark (1 min)  then press PLAY button.

Share the result.

Not sure if I should've changed from 2.5k FRTP mode to anything else before pressing "Play", but HOLY that did the trick on my end... Does it mean that I should/can keep the Samsung Pro Plus 128GB or I'd still get faster speeds with a Sandisk Extreme Pro?

1st test (165hz OC):  1st pass:  W: 67.9 MB/s   R: 74.7 MB/s
              2nd pass: W: 67.9 MB/s   R: 74.7 MB/s

2nd test(165hz OC): 1st  pass: W: 68.0 MB/s   R: 74.6 MB/s
              2nd pass: W: 67.9 MB/s   R: 74.7 MB/s

EDIT: I've noticed that I can't go above W: 56MB/s and I get a malloc error when reading even if I have the "lvface + aewb" hack enabled and the "af off" set while in "record mode".
What I mean is, having RAW enabled with the hacks enabled or having raw completely disabled is the exactly same thing in terms of speed.
Why would that happen?
Thanks!

wyup

Quote from: theBilalFakhouri on June 27, 2022, 02:42:07 AM
Okay, your SD card performs as 170MB/s version in 192 MHz, which mean you reached the maximum possible write speed when using 192 MHz overclock (your card is fine).

Back to your question, why you only get ~57 MB/s during RAW video recording?

-Enable the new hacks (lvface + aewb) from RAW video submenu, see:
https://youtu.be/a8FM_nlA8R8?t=39

Report back.

You can also use lower bit-depths (this will reduce required write speed).

With (lvface + aewb) hack, benchmark speed results are the same. With 240 MHz, results drop to ~20 MB/s. With 160 MHz, results drop to 67/74 MB/s.

In practical recording, (lvface + aewb) hack enabled, 5k frtp 2.39:1 14-bit, I can't get past 59-60-61 MB/s, I can record up to ~10 secs. With 12-bit, I can get almost continous recording.

How much practical recording speed do you get with 170 MB/s Sandisk Extreme Pro?
EOS M, 15-45 IS STM, 64GB Sandisk Extreme Pro UHS-I 200 MB/S

theBilalFakhouri

@wyup

I didn't ask to test other overclocking presets.

Quote from: wyup on June 27, 2022, 12:41:41 PM
In practical recording, (lvface + aewb) hack enabled, 5k frtp 2.39:1 14-bit, I can't get past 59-60-61 MB/s, I can record up to ~10 secs. With 12-bit, I can get almost continous recording.

Are using 192 MHz or 160 MHz overclock here?

Just to make sure, are these speeds (59-60-61 MB/s) are coming from card benchmarks or RAW video?
These hacks will have an effect only while recording RAW video, it won't have an effect while in Idle.

Check the write speed reported by RAW video while recording, like this image, take a picture for camera screen using smartphone and show me the picture.
If you can record a video showing what are you doing (your camera settings), that's would be better too.

Quote from: wyup on June 27, 2022, 12:41:41 PM
How much speed do you get with 170 MB/s Sandisk Extreme Pro?

~72 MB/s while recording at the same settings (192 MHz overclock).

wyup

Quote from: theBilalFakhouri on June 27, 2022, 01:08:14 PM
@wyup

I didn't ask to test other overclocking presets.

Are using 192 MHz or 160 MHz overclock here?

Just to make sure, are these speeds (59-60-61 MB/s) are coming from card benchmarks or RAW video?
These hacks will have an effect only while recording RAW 14-bit video, it won't have an effect while in Idle.

Check the write speed reported by RAW video while recording, like this image, take a picture for camera screen using smartphone and show me the picture.
If you can record a video showing what are you doing (your camera settings), that's would be better too.

~72 MB/s while recording at the same settings (192 MHz overclock).

These speeds (59-60-61 MB/s) are coming from RAW actual video scene shooting, at standard 192 MHz, (lvface + aewb) hack, and as I said, in practical recording, not benchmarking. Of course, it is the small corner screen reading, none otherwise.
I'm trying 5k frtp, raw ON 1440x1810 1:1, Kill global Draw ON, lvface +aewb ON, ratio 2.39:1, sound recording OFF, Global Draw OFF, rest defaults.
I'm using MF, Servo OFF, Manual Exposure, ISO 100, about 1/60, F8, exterior, white wall optimal exposure.

Is there any other max bitrate mode or best setting to test?
I'm still far from 72 MB/s.

 



EOS M, 15-45 IS STM, 64GB Sandisk Extreme Pro UHS-I 200 MB/S

theBilalFakhouri

@wyup

Perform "Low level format" in camera from Canon menu, does that help? same write speed?

wyup

Yes, I did low level format from Canon menu.
EOS M, 15-45 IS STM, 64GB Sandisk Extreme Pro UHS-I 200 MB/S

theBilalFakhouri

What write speed you get if you disabled "More hacks" with the same settings above?

Also, what option are you using for "Small hacks" in RAW video submenu?
Small hacks affect write speed too.

Danne

You don't get 72Mb/s in 192Mhz and 240Mhz don't work on eos m. Around 60 seems right.
If you do benchmark stay in photo mode and also push play button just before bench marking starts.

theBilalFakhouri

Quote from: Danne on June 28, 2022, 04:08:04 PM
You don't get 72Mb/s in 192Mhz .. . Around 60 seems right.

What makes EOS M perform worse at the same settings compared to 100D/700D?

At same the used settings, both 100D/700D get up to ~70 MB/s with 192 MHz overclock.
~10 MB/s is a big difference.

@wyup
There is a case, if your scene requires high write speed like 80 MB/s or higher when you shoot at 14-bit lossless, in this case RAW video will report ~60MB/s and recording would stop early.
Anyway, I will prepare card benchmarks test with all hacks enabled, to be run in 1080p HD mode and 5K FRTP preset (while not recording), and then let's what benchmarks numbers would say.

Walter Schulz

Sometimes my Adata writes with 80 MByte/s in 192 MHz. Not consistent, though. And benchmark, of course.

theBilalFakhouri

Here is Bench.mo with all hacks enabled. Only for EOS M.

-Hacks included:
-All "Small hacks".
-lvface + aewb.

-How to:
-Copy bench.mo to ML/modules folder, replace the old bench.mo with the provided one.
-Load the module, restart camera.
-Set your crop mode preset and other settings.
-Run "Quick R/W benchmark (1 min)".
-Share the result.

-Camera might freeze in 1080p HD, iirc new hacks doesn't work in MCM, 1080p HD preset is using MCM, so if that happens, skip benchmarking in this mode, pull the battery.
-After benchmarks finish, you need to make a camera restart to turn off the hacks.
-If you ran benchmarks and you want to run new benchmarks with different settings/crop mode, restart the camera first.

wyup

Benchmark test with Bilal's 'bench.mo', from Photo mode + play button as Danne says, I get:

1st: W: 75.8 R:85.9
2nd:W: 76.0 R:86.0

Recording without modules, raw submenu> small hacks: af OFF, more hacks: lvface + aewb, Use SRM memory ON, kill global draw ON, aspect ratio: 1:1, resolution: 1360x1976, rest: 5k anamorphic frtp, sd overclock 192MHz, sound recording OFF,overlay global draw OFF, 14-bit

Average recording speed: 57-58-59 Mb/s, MF, ME, ISO 3200, bright exposure lasts for ~6 seconds.
EOS M, 15-45 IS STM, 64GB Sandisk Extreme Pro UHS-I 200 MB/S

theBilalFakhouri

Run benchmarks in video mode, in LiveView with this bench.mo, not Play mode.

wyup

Quote from: theBilalFakhouri on June 28, 2022, 06:57:35 PM
Run benchmarks in video mode, in LiveView with this bench.mo, not Play mode.

1st:  W: 70.3  R:71.5
2nd: W: 70.9  R:70.0

+malloc errors
EOS M, 15-45 IS STM, 64GB Sandisk Extreme Pro UHS-I 200 MB/S

theBilalFakhouri

You can get rid of malloc errors if you turn off RAW video before running benchmarks.



Anyway, now your result matches 100D/700D with (Sandisk 170MB/s) at the same settings. RAW video recording should get up to 70 MB/s too (at least this happens on 100D/700D).
And again, your SD card seems fine.

I don't know if this an issue related to what things Danne have changed in his custom build which prevent getting 70 MB/s write speed, it could be his implementation/changes to small/new hacks (hacks don't work in some cases while recording RAW video?), or maybe other things?.

I can't help with these since I don't have an EOS M to check.



Could you check "Free memory" on EOS M?, follow this guide.
Less memory has an impact on write speed too.

wyup

Guys, I've found the fastest way to record, I manage sustained 63-64-65 Mb/s (65.7 max) in yellow, 5k frtp 1360x1976 14-bit, almost continous, and 2.8k 10-bit continous.

The trick is to format externally with lowest possible sector size. I've found out physical sector size of SD card is 512 bytes. You find out with 'fsutil fsinfo sectorinfo volume:' in Windows. From there, manual format to minimum camera bootable, which I've found is 1024 bytes. I format with this command:

FORMAT /FS:EXFAT /A:1024 /Q  G:

and then copy your ML filesystem and install.
It takes some 15 seconds to boot. Also I've found that sometimes at first it stops recording, but next time it gets to full 63 MB/s.

The first sector size I tried was 4096 bytes, it booted normally and it seemed already faster. 1024 is stable enough for me and the fastest.

EDIT: This trick *seems* to freeze ML debug memory info submenu. At 1024, it takes +12 seconds to boot. At 2048, it takes some 8 seconds to boot. At 4096, the lowest selectable from windows format ui, it boots normally and speed sets to ~61 MB/s. With stock in-camera format (128k sector), recording speed drops again to 57-58 Mb/s.

I think there is something to look upon on ML software regarding low level card writing strategy, we're talking about 5-8 MB/s faster writing with smaller sector sizes.

EDIT 2: I think the improvement is with just formatted card. As long as I record, speeds seem to return to normal.
EOS M, 15-45 IS STM, 64GB Sandisk Extreme Pro UHS-I 200 MB/S

2blackbar

I dont know man , it boots forever ( over 30 seconds blinking green ) and boots without magic lantern, how did you set bootable flag ? I used EOSCard 1.40 but it didnt help

Walter Schulz

Try EOScard, select boxes "EOS_DEVELOP" and "BOOTDISK" and press "Save" button.

2blackbar

OK works, i  tried 2048 , and eoscard to set bootable flag and develop...
So , it boots about 10 seconds blinking red,

OK after a bit of testing 1024, i think this is too unstable , sure yo uget some seconds but then it drops and stops , stock settings are just more stable but lets others try it out
Boot times are killing me as well, takes like 15 seconds to boot into magic lantern and with 1024 mode is like 30 secs.
OK on 2048 its more stable but then its almost as good as stock format settings in cam + stock settigs have better boot time.
Maybe this would be better to test with 2.9k mode or 3k mode and 24fps but these are not in camera.

lightspeed

what is the command for Mac?

sudo news_exfat -s 2 disk2s1

is that right?

theBilalFakhouri

BTW, I tried these on my Sandisk Extreme PRO 64GB UHS-I U3 170 MB/s and it performed worse when I ran benchmarks (using 240 MHz overclock on 700D):

Write speed:
1024 bytes: 82 MB/s
2048 bytes: 88 MB/s
4096 bytes: 89 MB/s
8192 bytes: 90 MB/s (matches 128 KB)

Read speed:
All was ~106 MB/s, no differences here.