Author Topic: UHS-I / SD cards investigation  (Read 68419 times)

Sapporo

  • Freshman
  • **
  • Posts: 68
Re: UHS-I / SD cards investigation
« Reply #275 on: June 08, 2018, 09:47:25 AM »
Had anyone tried the hack with this one??


UHS-II, SanDisk and Canon? Slow combination.

OlRivrRat

  • Senior
  • ****
  • Posts: 483
Re: UHS-I / SD cards investigation
« Reply #276 on: June 08, 2018, 06:32:08 PM »
           @Sapporo

Why is that?
ORR~DeanB  ~~  80D-ML  &  SL1+ML  &  5D2+ML  &  5DC+ML  &  70D+ML(AliveAgain)

alpicat

  • Freshman
  • **
  • Posts: 56
Re: UHS-I / SD cards investigation
« Reply #277 on: June 08, 2018, 06:53:58 PM »
@OlRivrRat  That's a UHS-II card. Canon cameras use UHS-I, so there's no point trying an expensive UHS-II card - I'm guessing they'd end up being slower in a Canon than a fast UHS-I card. Although I don't know if anyone's tested this.

@Sapporo  Wondering if there's a faster alternative to Sandisk cards, in particular to their Extreme Pro 95mb/s V30 UHS-I SD cards? I've tested two of those and the max write speed I can get on an EOS M is 55mb/s. I've seen people get faster benchmark results but unsure exactly which cards they were using.
 

Sapporo

  • Freshman
  • **
  • Posts: 68
Re: UHS-I / SD cards investigation
« Reply #278 on: June 08, 2018, 08:39:44 PM »
           @Sapporo

Why is that?
Check yourself http://www.cameramemoryspeed.com/canon-7d-mark-ii/fastest-sd-cf-card-comparison/

SanDisk Extreme Pro 280MB/s UHS-II 32GB 39.8MB/s average speed with the 7D II.

Sapporo

  • Freshman
  • **
  • Posts: 68
Re: UHS-I / SD cards investigation
« Reply #279 on: June 08, 2018, 08:40:39 PM »
@OlRivrRat  That's a UHS-II card. Canon cameras use UHS-I, so there's no point trying an expensive UHS-II card - I'm guessing they'd end up being slower in a Canon than a fast UHS-I card. Although I don't know if anyone's tested this.

@Sapporo  Wondering if there's a faster alternative to Sandisk cards, in particular to their Extreme Pro 95mb/s V30 UHS-I SD cards? I've tested two of those and the max write speed I can get on an EOS M is 55mb/s. I've seen people get faster benchmark results but unsure exactly which cards they were using.

I got 71MB/s with 6D and SanDisk Extreme Pro 95MB/s 64GB.

alpicat

  • Freshman
  • **
  • Posts: 56
Re: UHS-I / SD cards investigation
« Reply #280 on: June 08, 2018, 09:13:17 PM »
I got 71MB/s with 6D and SanDisk Extreme Pro 95MB/s 64GB.

That's very impressive - maybe it's something to do with the EOS M rather than the card. I have this same card, and also tried another one which was the same.

theBilalFakhouri

  • Contributor
  • Senior
  • *****
  • Posts: 304
Re: UHS-I / SD cards investigation
« Reply #281 on: June 08, 2018, 10:05:36 PM »
@alpicat

You are maybe running the benchmark in video mode -- same thing in the other cameras about ~55mb/s  write speed.
But in Play mode you should got at least 65mb/s write speed with Sandisk Extreme Pro 95mb/s U3 32GB which I use.

However -- Using fps override at 12 fps or less in video mode you will got a higher write speeds like play mode --> So more FPS I think it will make a CPU overhead which will affect in the write speeds especially like 720p @ 60 fps ~40mb/s.
700D 1.1.5 | no more ISOless LV err 8

OlRivrRat

  • Senior
  • ****
  • Posts: 483
Re: UHS-I / SD cards investigation
« Reply #282 on: June 09, 2018, 07:15:57 PM »
      @Sapporo & Alpicat

   Can certainly understand that the UHS-II SDs are unnecessary in Our EOSs.

I was curious as to why the "Combo" of "UHS-II, SanDisk and Canon" would be thought to be "Slow".
ORR~DeanB  ~~  80D-ML  &  SL1+ML  &  5D2+ML  &  5DC+ML  &  70D+ML(AliveAgain)

Sapporo

  • Freshman
  • **
  • Posts: 68
Re: UHS-I / SD cards investigation
« Reply #283 on: June 10, 2018, 01:02:37 AM »
      @Sapporo & Alpicat

   Can certainly understand that the UHS-II SDs are unnecessary in Our EOSs.

I was curious as to why the "Combo" of "UHS-II, SanDisk and Canon" would be thought to be "Slow".
You have the write speed in the link. Lexar UHS-II has not the same issue.

alpicat

  • Freshman
  • **
  • Posts: 56
Re: UHS-I / SD cards investigation
« Reply #284 on: June 11, 2018, 06:23:39 PM »
@theBilalFakhouri thanks for this - running the benchmark with fps override at less than 12fps now gives me around 62mb/s write speed. Unsure how to use benchmark testing whilst in Play mode on the EOS M though, since I can't access the magic lantern menu in that mode.


theBilalFakhouri

  • Contributor
  • Senior
  • *****
  • Posts: 304
Re: UHS-I / SD cards investigation
« Reply #285 on: June 12, 2018, 09:01:26 PM »
@alpicat
Run the benchmark then press PLAY button.
700D 1.1.5 | no more ISOless LV err 8

alpicat

  • Freshman
  • **
  • Posts: 56
Re: UHS-I / SD cards investigation
« Reply #286 on: June 13, 2018, 12:07:14 AM »
@theBilalFakhouri aha, that's better. Now getting 68.7mb/s write speed (72mb/s read speed). Thanks so much!

Lolignon

  • New to the forum
  • *
  • Posts: 3
Re: UHS-I / SD cards investigation
« Reply #287 on: July 13, 2018, 08:35:23 PM »
Hi,
I tried the build magiclantern-Nightly.2018Jun27.600D102HDR_ext.zip from https://bitbucket.org/Dannephoto/magic-lantern/downloads/,
especially looking to use the sd_uhs module on my 600D, but when I selected it to be loaded on next reboot,
it gave me the following message: "FIXME: unsupported model" on boot,
and despite having no problem recording video in the regular video mode (default Canon's mode),
when the mlv_lite module was enabled and while trying to rec some raw footage, the console showed up with an error about data corruption and compression error

Some pics:










PS:I'm using a Sandisk extreme pro 95mb/s uhs-1 sd card
and sorry for my bad English

Danne

  • Contributor
  • Hero Member
  • *****
  • Posts: 5328
Re: UHS-I / SD cards investigation
« Reply #288 on: July 14, 2018, 10:48:38 AM »
The 600D isn't supported when using the sd_uhs module.

Lolignon

  • New to the forum
  • *
  • Posts: 3
Re: UHS-I / SD cards investigation
« Reply #289 on: July 15, 2018, 09:03:36 PM »
Ok, will be supported?

A.Werfhorst

  • New to the forum
  • *
  • Posts: 2
Re: UHS-I / SD cards investigation
« Reply #290 on: July 19, 2018, 01:13:34 PM »
Ok, will be supported?
Guys, correct me if I am wrong, as I am mostly a reader who follows this with interest.

If I am correct the investigation currently mostly focuses on the SD hardware that is available in the 650D and newer models. So for optimizing write speeds in older models someone should start a similar investigation, if we want any progress for those.

Danne

  • Contributor
  • Hero Member
  • *****
  • Posts: 5328
Re: UHS-I / SD cards investigation
« Reply #291 on: July 19, 2018, 02:34:12 PM »
Best you can do is check into the sd_uhs code. First check the bottom what cameras are supported and take it from there. Probably possible to find registers needed but level of difficulty I have no idea about...

dfort

  • Developer
  • Hero Member
  • *****
  • Posts: 3677
Re: UHS-I / SD cards investigation
« Reply #292 on: July 19, 2018, 03:30:00 PM »
...So for optimizing write speeds in older models someone should start a similar investigation, if we want any progress for those.

It might be possible but the method will probably be different.

I doubt - D4 uses only 2 bits for clock speed (0xC0400004). Feel free to prove me wrong (possibly by brute-forcing the other bits).

1300D has a string that explains these 2 bits: SetSdClock %d ->0:210K 1:16MHz 2:24MHz 3:48MHz

We often group all Digic 4 cameras in the "older models" category but the 1300D has a Digic 4+ processor that is newer than the Digic 5. In fact if the introduction dates listed on Wikipedia can be trusted the Digic 4+ is even newer than the Digic 6.

Anyway, I looked for the stubs on an old Digic 4 but came up a little short:

I looked at the stubs for the 7D and found just one. Strange thing is that camera only has one CF slot and no SD slot yet it has "SD_ReConfiguration" -- wonder what it does?

As far as I know UHS-I doesn't apply to CF cards so that was probably going to be a dead end anyway but I also came up empty searching for these stubs on other Digic 4 cameras.
5D3.* 7D.206 700D.115 EOSM.203 EOSM2.103 M50.102

barbona

  • New to the forum
  • *
  • Posts: 4
Re: UHS-I / SD cards investigation
« Reply #293 on: August 10, 2018, 07:13:49 PM »
Hello, could anyone point me to the correct link to download the correct "sd_uhs.mo" module for a 6d. I've tried one (dump the module file in the july 3 nightly build) but it gives a error.

Sorry for my english. Thanks!

reddeercity

  • Contributor
  • Hero Member
  • *****
  • Posts: 2001
Re: UHS-I / SD cards investigation
« Reply #294 on: September 11, 2018, 07:54:48 AM »
Looking at CF card timing again , now that the 5d2 can record 3k but not continuous .
dm-spy.log
Code: [Select]
825FE>  CSMgrTask:00095f98:00:00: *** register_interrupt("CFDriver", 0x82, 0xffb8b8cc, 0x0), from ffb8bb58
834A0>  CSMgrTask:ffb8a92c:22:05: [ID:Model Number] = LEXAR ATA FLASH CARD                   
834C8>  CSMgrTask:ffb8aabc:22:05: IDE = 4, PCMCIA = 80, UDMA = 6
83572>  CSMgrTask:ffbdb8a0:22:01: cfDecideTiming: UDMA Mode 6 (CFA4.0)
83592>  CSMgrTask:ffbdbb3c:22:03: CF_GetAccessTiming : DatTim = 3, DatMod = 6

as seen the cf card is only being access @ UDMA 6 which limit to 80MB/s thou the card is capable of UDMA 7 ,
so can I assume that  DatMod = 6 is (UDMA = 6) ? Would this be a parameter that can change to "7"  if indeed that what it means .

....  but some blocks were written at ~120MB/s, others at ~85MB/s, and a very small percentage of them were written at lower speeds.
@reddeercity: more details after I'll get a new card (it *is* possible to overclock the 5D2 CF interface).

Any info on this @a1ex ?
How is something like this coded , as a module or just code in ML source ?

You can send ATA commands to the CF card (QEMU emulates them), so if the only difference between UDMA 6 and 7 is timing, it might even be possible to put the card in UDMA7.
How would I do this in QEMU ?

Is there any special Log file I can generate for the CF Card interface ?

Edit: found this for 7D & 5D3  -- need to find this for 5D2
http://magiclantern.wikia.com/wiki/Register_Map#CFDMA

Audionut

  • Global Moderator
  • Hero Member
  • *****
  • Posts: 3559
  • Blunt and to the point
Re: UHS-I / SD cards investigation
« Reply #295 on: September 11, 2018, 12:28:03 PM »
How is something like this coded , as a module or just code in ML source ?

sd_uhs.mo (5D3 only)
https://www.magiclantern.fm/forum/index.php?topic=12862.msg199158#msg199158

Doesn't look like the source is public yet.

Danne

  • Contributor
  • Hero Member
  • *****
  • Posts: 5328
Re: UHS-I / SD cards investigation
« Reply #296 on: September 11, 2018, 01:38:32 PM »
Source?
https://bitbucket.org/hudson/magic-lantern/branch/sd_uhs

Still seems there's some unpublished stuff around this but then again it's not the safest hack in the toolshed it seems.

allemyr

  • Member
  • ***
  • Posts: 205
  • http://www.allemyr.com/
Re: UHS-I / SD cards investigation
« Reply #297 on: September 13, 2018, 11:23:58 PM »

as seen the cf card is only being access @ UDMA 6 which limit to 80MB/s thou the card is capable of UDMA 7,

The reel bottleneck of this isnt the cf card, its the camera in all cases 5D2, 5D3 and 5D4.

UDMA6 is 133mb/s not 80? UDMA7 is 167mb/s.

I don’t know what the 5D2 writespeed is, 80 as you say but thats because of the cameras interface. As same with the 5D3 maxing out at around 90-100mb/s write, even with a 160mb/s cf card inside. The 5D4 maxes out at 105mb/s. In 14 bit raw all those cameras will be limited to around 1080p cause of bandwith in camera interface. Shure 10 bit and 12 bit get you to higher resolution, but max of all these cameras will be different and 5D4 won’t go above 105mb/s when solved.

Just my thought, worth looking into, if iam not totally wrong.

waza57

  • New to the forum
  • *
  • Posts: 40
Re: UHS-I / SD cards investigation
« Reply #298 on: September 14, 2018, 08:51:48 AM »
I used DIGIC POKE to simply modify this values I found in  http://magiclantern.wikia.com/wiki/Register_Map#CFDMA :

0xC062850C --> 0x1213 and I obtain UDMA 0 speed (around 15MB/s)
                     --> ...........
                     --> ...........
                     -->0x0202 and I obtain UDMA 6 speed (around 80MB/s) i suppose original value
                     -->0x0101 and sadly I obtain UDMA 6 speed  too :(

a1ex

  • Administrator
  • Hero Member
  • *****
  • Posts: 12198
  • Maintenance mode
Re: UHS-I / SD cards investigation
« Reply #299 on: September 14, 2018, 09:00:55 AM »
My raw notes:

Code: [Select]
CF 5D3:
 0.932.277   CSMgrTask:ff6aa02c:MMIO : [0xC0628504] <- 0x04060503
 0.932.285   CSMgrTask:ff6aa050:MMIO : [0xC0628508] <- 0x010A1105
 0.932.291   CSMgrTask:ff6a9e4c:MMIO : [0xC062850C] <- 0x00000202

    0xC0628504 0xC0628508 0xC062850C
u7: 0x04060503 0x010A1105 0x00000202
u6: 0x04060503 0x010A1105 0x00000303
u5: 0x04060503 0x010A1105 0x00000303
u4: 0x04060503 0x010A1405 0x01000505
u3: 0x04060503 0x030A1405 0x01000808
u2: 0x04060503 0x060A1405 0x01000B0B
u1: 0x04060503 0x090A1905 0x01000F0E
u0: 0x05040402 0x04060503 0x01001616

Can you try 102 or 201?