Author Topic: Card benchmark - what's the optimal write buffer size?  (Read 113318 times)

Shizuka

  • New to the forum
  • *
  • Posts: 36
Re: Card benchmark - what's the optimal write buffer size?
« Reply #25 on: May 17, 2013, 11:46:19 PM »
A rather relevant question is "how repeatable are these tests at the same buffer size"? A card might be rather fast when it's empty, but fill it up, and it'll slow down as it does live garbage collection. An old card I had been using for an embedded system wrote at 15MB/sec initially, which degraded to 9MB/sec after a month of use.

The old 50nm X25-M comes to mind here

Jason Montalvo

  • Freshman
  • **
  • Posts: 54
  • 5D3/5D2 & Some BlackMagic
Re: Card benchmark - what's the optimal write buffer size?
« Reply #26 on: May 18, 2013, 12:37:52 AM »
Buffer size experiment
ML v2.3.NEXT.2013May17.5D3113, 3046238719b2+ (unified) tip
Mode: photo, Global Draw: ON
CF LEXAR ATA FLASH CARD LEXAR ATA FLASH CARD                   
10312704 763
15885312 849
80896 354
8949760 870
28661760 875
16264192 900
24521728 1185
16424960 1125
13148160 1151
15619072 1155
1658880 1051
21001216 1157
8548352 1145
19760128 1155
5965824 1133
24906752 1156
13968384 1153
16770048 1157
4542464 1124
13063168 1150
33263616 1164
30312448 1157
16713728 1157
3887104 1115
21841920 1160
12846080 1149
16192512 1155
3333120 1082
6719488 1136
17313792 1155
23374848 1155
2865152 1098
32488448 1159
18588672 1157
4186112 1118
821248 940
3661824 1111
18359296 1154
19875840 1157
22754304 1156
13665280 1152
24957952 1156
28555264 1160
33442816 1140
10708992 1149
20242432 1157
8774656 1144
11216896 1147
23156736 1158
12750848 1152
12369920 1150
2157568 1076
15279104 1154
29943808 1157
30321664 1158
19004416 1157
268288 656
23778304 1159
467968 835
1905664 1064
32368640 1163
19829760 1155
26281984 1162
24153088 1153
11364352 1149
32160768 1162
5944320 1134
24118272 1159
28511232 1159
31526912 1159
15956992 1154
1732608 1056
13881344 1152
6106112 1132
17367040 1157
21693440 1154
30835712 1160
1139712 988
13698048 1068
19388416 1158
1532928 1043
16333824 1156
15963136 1152
23540736 1159
23770112 1158
7317504 1140
6019072 1134
13303808 1151
32039936 1156
13137920 1151
24311808 1135
25442304 1158
8986624 1119
25421824 1159
2720768 1071
18526208 1154
12448768 1151
6514688 1136
6632448 1138
17897472 1154
26569728 1160
22568960 1156
11912192 1149
22007808 1159
30651392 1158
29615104 1162
18367488 1156
21049344 1155
15778816 1155
24951808 1155
5359616 1130
23476224 1157
17125376 1157
3318784 1102
12782592 1153
30965760 1160
1974272 1067
32021504 1076
24463360 1156
28246016 1159
23352320 989
27161600 910
25191424 1011
10841088 1068
22846464 1158
19111936 1159
26234880 1163
32610304 1157
14385152 1153
18029568 1073
11080704 1149
3933184 1114
22414336 1156
8314880 1143
27988992 1157
20073472 1160
23487488 1159
30233600 1158
25299968 1159
2406400 1062
28059648 1158
2145280 1076
27503616 1156
20705280 1154
28731392 1162
2458624 1086
19662848 1158
6198272 1134
21655552 1158
32225280 1163
21788672 1157
16669696 1156
12007424 1152
4321280 1120
14878720 1155
10118144 1148
2836480 1074
21092352 1157
17086464 1155
1707008 1055
17509376 1152
28161024 1155
18457600 1156
16290816 1154
10758144 1147
17766400 1157
28011520 1158
19835904 1158
11879424 1150
18191360 1158
12581888 1150
15906816 1151
6525952 1135
30545920 1155
934912 962
6738944 1114
18920448 1157
27171840 1156
19916800 1157
28598272 1130
23926784 1134
10470400 1148
20392960 1158
7282688 1139
4824064 1123
11820032 1149
30988288 1156
26221568 1161
13527040 1150
30140416 1159
6785024 1138
25762816 1160
23324672 1152
26011648 1161
4475904 1118
33500160 1163
8732672 1144
29461504 1159
12411904 1147
12294144 1151
11481088 1148
12786688 1150
15858688 1153
16142336 1153
29415424 1164
32114688 1160
18460672 1157
15672320 1154
12832768 1152
23447552 1158
18734080 1158
25832448 1159
20690944 1150
27086848 1157
24894464 1157
32919552 1163
30015488 1159
2870272 1097
27643904 1157
25778176 1158
4189184 1118
13642752 1152
7861248 1141
21999616 1159
4232192 1117
12140544 1148
3162112 1082
27608064 1157
18791424 1055
5019648 1126
15958016 1154
20426752 1160
685056 927
18709504 1131
6188032 1112
6668288 1139
30684160 1158
9438208 1142
20264960 1157
1707008 1055
4702208 1125
27417600 1159
31681536 1161
1326080 1026
9743360 1145
29618176 1163
28645376 1161
21629952 1157
21515264 1158
12170240 1128
29555712 1136
2771968 1095
30593024 1159
23996416 1160
31484928 1160
24702976 1156
24359936 1160
32328704 1160
21560320 1156
18289664 1155
26721280 1162
33334272 1163
29471744 1162
30886912 1154
10810368 1146
16393216 1156
4559872 1120
17182720 1156
251904 680
10129408 1147
18564096 1156
30530560 1187
5036032 1103
10642432 1149
1025024 991
20564992 1159
17504256 1157
19713024 1157
12450816 1151
596992 884
20088832 1157
3368960 1105
12530688 1151
29465600 1163
10443776 1147
23064576 1158
32175104 1162
9240576 1146
30198784 1150
11613184 1148
7633920 1140
22871040 1159
22456320 1157
16783360 1152
1076224 981
1472512 1018
53248 268
22145024 1158
13445120 1152
15488000 1153
17851392 1156
8222720 1141
3790848 1038
31733760 1160
4009984 1093
29513728 1162
29906944 1185
25694208 1160
16442368 1156
3623936 1088
29339648 1162
27055104 1158
12034048 1126
32011264 1156
32172032 1161
22600704 1186
13225984 1127
28665856 1160
11716608 1148
28250112 1159
5085184 1102
28856320 1161
218112 639
21444608 1157
30626816 1157
7068672 1135
31740928 1159
27124736 1157
17964032 1153
23683072 1160
10264576 1148
23499776 1161
23206912 1155
29933568 1155
13522944 1152
28731392 1158
13669376 1153
18453504 1158
8773632 1143
31521792 1157
32563200 1161
14050304 1152
23192576 1075
2580480 1091
12610560 1151
8542208 1121
21291008 1128
1245184 998
9519104 1149
29709312 1163
14656512 1151
19511296 1156
17680384 1156
31774720 1161
17035264 1152
16637952 1157
24604672 1156
23776256 1157
12297216 1151
31228928 1158
19137536 1157
11517952 1149
25170944 1159
10852352 1148
14022656 1150
27422720 1156
2764800 1092
31773696 1161
25122816 1159
6719488 1136
20889600 1157
13719552 1152
26656768 1160
27925504 1159
25307136 1158
30016512 1157
15267840 1152
1992704 1069
7454720 1140
13520896 1151
19296256 1155
15080448 1154
2733056 1001
6084608 1135
7767040 1140
19521536 1155
11791360 1147
4573184 1123
31201280 1157
12889088 1151
10139648 1143
24348672 1161
178176 577
9086976 1145
1422336 1014
20881408 1184
2706432 1072
29356032 1163
9225216 1147
9115648 1145
19433472 1154
2195456 1076
31977472 1161
7171072 1136
8365056 1144
31093760 1160
17173504 1154
2191360 1077
2806784 1073
26635264 1160
11782144 1148
25329664 1158
23643136 1159
26715136 1162
3762176 1114
4759552 1120
21786624 1160
12112896 1151
28181504 1160
25351168 1152
33405952 1165
19030016 1159
9690112 1066
23938048 1160
13831168 1154
14360576 1148
5323776 1129
12928000 1152
7570432 1114
13710336 1151
7164928 1137
13621248 1151
29969408 1155
29436928 1137
9693184 1147
10413056 1148
16844800 1154
6436864 1133
3139584 1100
1518592 1043
22846464 1152
15690752 1155
31619072 1160
19501056 1157
16398336 1153
6238208 1135
15412224 1155
13130752 1152
32825344 1162
19061760 1159
22163456 1159
24397824 1133
18536448 1155
24160256 1159
22958080 1158
4352000 1045
11240448 1147
6855680 1140
3570688 1111
4942848 1125
12975104 1153
24314880 1161
12750848 1149
3128320 1079
29314048 1162
5171200 1124
18586624 1155
12131328 1151
22717440 1156
6662144 1138
3102720 1103
13159424 1152
21650432 1157
1045504 995
6996992 1117
8030208 1141
41984 223
646144 901
2521088 1088
24885248 1155
14108672 1155
6751232 1113
1507328 1022
27210752 1157
4873216 1125
8120320 1143
25854976 1158
5417984 1129
26497024 1161
15966208 1152
8155136 1135
11756544 1150
25576448 1158
14921728 1150
8012800 1142
24283136 1163
18381824 1153
29868032 1156
16788480 1153
29538304 1162
28482560 1160
22857728 1158
11183104 1150
1052672 977
5559296 1131
15012864 1153
32344064 1160
13061120 1151
28729344 1159
9480192 1146
30612480 1157
20639744 1159
10013696 1145
5862400 1133
18298880 1155
23938048 1154
29583360 1163
2676736 1092
31510528 1159
2937856 1099
23347200 1158
11726848 1148
2904064 1097
20049920 1132
26983424 1156
1421312 1014
13773824 1153
26993664 1156
15478784 1155
6122496 1134
31414272 1160
24333312 1160
16172032 1155
31551488 1157
30025728 1068
24596480 1156
16249856 1155
21200896 1156
1811456 1060
12495872 1151
22435840 1157
1756160 1054
19796992 1157
6949888 1138
32049152 1162
26814464 1162
5679104 1131
5804032 1129
8168448 1138
7987200 1117
7357440 1114
10604544 1149
32722944 1160
22999040 1157
16946176 1155
27879424 1158
16748544 1131
26218496 1162
8698880 1143
24347648 1158
17693696 1156
11396096 1150
27094016 1156
18161664 1155
17741824 1158
7563264 1140
11387904 1146
6795264 1058
13068288 1150
33315840 1163
1360896 1010
179200 578
31031296 1162
29638656 1162
6290432 1132
17600512 1157
23806976 1161
22608896 1153
13219840 1153
2768896 1095
28721152 1157
13686784 1151
31881216 1161
21140480 1155
27467776 1155
6325248 1136
18780160 1159
29000704 1159
5698560 1132
13757440 1154
32033792 1158
1196032 994
7829504 1114
13819904 1151
4787200 1125
31131648 1160
6534144 1135
17713152 1157
10491904 1147
28841984 1158
8125440 1143
30911488 1157
19365888 1155
11707392 1149
5778432 1133
16601088 1155
21358592 1160
26169344 1160
1667072 1052
4779008 1101
29435904 1162
662528 920
28992512 1156
24974336 1128
23857152 1160
401408 800
15919104 1154
27906048 1153
23015424 1156
4002816 1117
24198144 1159
29455360 1161
25784320 1158
17810432 1133
1175552 992
33447936 1165
4911104 1126
20684800 1155
11038720 1149
22244352 1161
3306496 1106
13486080 1152
21708800 1160
8059904 1142
23488512 1158
27561984 1157
29150208 1160
22958080 1157
79872 360
3001344 1102
25936896 1158
5336064 1130
7099392 1134
18265088 1156
5236736 1125
29139968 1160
30307328 1048
28890112 1133
8766464 1117
6253568 1134
32888832 1162
25340928 1159
5874688 1133
8569856 1142
13980672 1155
12325888 1150
10957824 1149
21971968 1159
27854848 1160
32061440 1162
20875264 1156
27922432 1158
12000256 1151
24394752 1162
33127424 1163
18564096 1157
28583936 1156
1114112 1005
12428288 1147
29057024 1160
18947072 1155
31187968 1159
6689792 1138
24388608 1136
9733120 1121
14794752 1157
27363328 1154
22615040 1045
4679680 1124
29193216 1159
29623296 1163
2713600 1093
18762752 1156
18162688 1153
5191680 1128
31337472 1159
10897408 1149
3752960 1112
15242240 1153
4296704 1120
7144448 1139
3975168 1091
11262976 1146
3813376 1110
29945856 1156
22281216 1160
11097088 1149
25664512 1159
21757952 1155
19299328 1155
27878400 1160
5765120 1131
6858752 1137
29338624 1161
17524736 1156
9234432 1145
18404352 1156
12910592 1152
32882688 1158
17588224 1157
353280 768
20793344 1157
25840640 1160
24542208 1153
12421120 1151
1551360 1043
26938368 1155
3689472 1018
25926656 1153
13207552 1151
14135296 1151
29024256 1161
6199296 1133
22039552 1159
15332352 1153
12561408 1149
30338048 1156
5548032 1129
18877440 1159
14754816 1154
3061760 1101
16175104 1153
21693440 1160
18046976 1153
16389120 1155
7243776 1139
9588736 1146
26919936 1153
2068480 1071
21771264 1159
3138560 1082
18165760 1127
8387584 1119
25266176 1159
13416448 1148
26480640 1160
27202560 1154
13935616 1155
9308160 1143
24699904 1156
32326656 1161
8325120 1142
13915136 1153
19608576 1155
15007744 1153
31070208 1158
10235904 1147
22617088 1070
5702656 1132
20756480 1157
4559872 1120
15673344 1157
19785728 1157
13262848 1151
30248960 1156
24855552 1157
26693632 1161
456704 830
4195328 1118
22641664 1151
5236736 1126
10093568 1147
28576768 1160
25004032 1153
16843776 1153
31466496 1159
18185216 1155
14026752 1154
12017664 1151
15603712 1156
5610496 1129
6509568 1137
32446464 1161
10720256 1149
10158080 1148
21427200 1156
30187520 1157
1676288 1053
5825536 1108
14540800 1126
28965888 1162
26448896 1159
17480704 1157
23667712 1073
14379008 1156
22979584 1152
32209920 1161
9079808 1142
19117056 1158
1785856 1057
3345408 1105
28873728 1161
10025984 1145
32382976 1161
5965824 1133
23553024 1157
6449152 1109
30467072 1187
25605120 1159
2913280 1076
29967360 1186
6344704 1111
7871488 1143
19953664 1155
27994112 1157
11735040 1149
32824320 1161
9994240 1146
13592576 1150
17856512 1156
2124800 1073
2849792 1096
32727040 1161
10672128 1149
27549696 1159
21854208 1158
24068096 1159
20750336 1154
9348096 1147
2812928 1095
22634496 1157
32300032 1160
19179520 1154
33179648 1164
28841984 1160
16781312 1151
11229184 1148
31198208 1157
4141056 1114
17610752 1130
11081728 1125
4424704 1121
23146496 1156
32856064 1164
22829056 1155
12701696 1154
9548800 1120
16521216 1156
11356160 1149
3127296 1101
12703744 1152
10955776 1147
28401664 1160
18853888 1157
22069248 1158
13550592 1151
11600896 1149
4472832 1097
30237696 1156
20249600 1156
12144640 1149
11231232 1123
13005824 1125
16504832 1130
27447296 1183
5755904 1106
32446464 1158
10725376 1149
14983168 1151
25935872 1156
27013120 1155
31343616 1154
3565568 1111
20889600 1155
1732608 1055
28553216 1158
30673920 1157
24933376 1156
4856832 1125
14187520 1148
23174144 1158
2248704 1079
4705280 1123
29597696 1162
31090688 1157
30476288 1155
21278720 1157
23795712 1161
3159040 1100
1011712 972
12483584 1151
16698368 1155
9614336 1146

Kunibert

  • New to the forum
  • *
  • Posts: 7
Re: Card benchmark - what's the optimal write buffer size?
« Reply #27 on: May 18, 2013, 02:19:29 AM »
Komputer Bay Professional 32GB 600x CompactFalsh UDMA
Quite slow... Something wrong? Expected at least something like 65-75 out of the 90MB/s
Code: [Select]
Buffer size experiment
ML v2.3.NEXT.2013May17.5D3113, 3046238719b2+ (unified) tip
Mode: photo, Global Draw: OFF
CF Vendor CF Card                                 
10312704 312
15885312 314
80896 184
8949760 311
28661760 314
16264192 311
24521728 314
16424960 312
13148160 314
15619072 312
1658880 302
21001216 314
8548352 311
19760128 314
5965824 310
24906752 314
13968384 311
16770048 312
4542464 308
13063168 313
33263616 313
30312448 313
16713728 312
3887104 311
21841920 312
12846080 311
16192512 312
3333120 307
6719488 309
17313792 313
23374848 314
2865152 306
32488448 313
18588672 314
4186112 309
821248 288
3661824 310
18359296 312
19875840 314
22754304 312
13665280 313
24957952 314
28555264 312
33442816 313
10708992 313
20242432 312
8774656 310
11216896 312
23156736 313
12750848 311
12369920 311
2157568 304
15279104 313
29943808 312
30321664 312
19004416 311
268288 250
23778304 313
467968 268
1905664 302
32368640 310
19829760 312
26281984 310
24153088 310
11364352 311
32160768 310
5944320 308
24118272 314
28511232 310
31526912 313
15956992 311
1732608 301
13881344 312
6106112 309
17367040 310
21693440 313
30835712 312
1139712 293
13698048 312
19388416 312
1532928 298
16333824 313
15963136 311
23540736 313
23770112 311
7317504 311
6019072 309
13303808 302
32039936 311
13137920 312
24311808 311
25442304 313
8986624 310
25421824 313
2720768 304
18526208 312
12448768 312
6514688 309
6632448 300
17897472 313
26569728 312
22568960 312
11912192 310
22007808 312
30651392 312
29615104 314
18367488 311
21049344 312
15778816 311
24951808 312
5359616 309
23476224 311
17125376 313
3318784 306
12782592 310
30965760 312
1974272 306
32021504 313
24463360 312
28246016 310
23352320 312
27161600 312
25191424 310
10841088 311
22846464 311
19111936 314
26234880 312
32610304 314
14385152 311
18029568 313
11080704 311
3933184 300
22414336 313
8314880 310
27988992 313
20073472 312
23487488 313
30233600 312
25299968 311
2406400 304
28059648 313
2145280 304
27503616 313
20705280 313
28731392 312
2458624 304
19662848 313
6198272 310
21655552 314
32225280 312
21788672 314
16669696 312
12007424 311
4321280 309
14878720 314
10118144 311
2836480 305
21092352 313
17086464 311
1707008 302
17509376 314
28161024 311
18457600 313
16290816 312
10758144 312
17766400 312
28011520 313
19835904 311
11879424 312
18191360 311
12581888 302
15906816 313
6525952 309
30545920 312
934912 291
6738944 308
18920448 311
27171840 312
19916800 313
28598272 311
23926784 313
10470400 309
20392960 311
7282688 308
4824064 308
11820032 309
30988288 311
26221568 309
13527040 311
30140416 311
6785024 307
25762816 310
23324672 312
26011648 310
4475904 308
33500160 311
8732672 309
29461504 311
12411904 312
12294144 305
11481088 284
12786688 282
15858688 301
16142336 309
29415424 311
32114688 287
18460672 285
15672320 285
12832768 282
23447552 286
18734080 286

g3gg0

  • Developer
  • Hero Member
  • *****
  • Posts: 3166
Re: Card benchmark - what's the optimal write buffer size?
« Reply #28 on: May 18, 2013, 02:35:45 AM »
maybe this is useful for this test:

https://bitbucket.org/hudson/magic-lantern/commits/1d5cc48c11dbb80b5e48fff8012a0b769ba07d44

it directly accesses CF controller and reads out CF internal data.
see ATA/CF specification for IDENTIFY DRIVE command 0xEC

screenshots:

Help us with datasheets - Help us with register dumps
magic lantern: 1Magic9991E1eWbGvrsx186GovYCXFbppY, server expenses: paypal@g3gg0.de
ONLY donate for things we have done, not for things you expect!

RenatoPhoto

  • Moderators
  • Hero Member
  • *****
  • Posts: 1509
  • 5DM3 / 7D
Re: Card benchmark - what's the optimal write buffer size?
« Reply #29 on: May 18, 2013, 03:03:58 AM »
5D3 + SanDisk 30 MB/s 16GB Until Battery died

Code: [Select]
Buffer size experiment
ML v2.3.NEXT.2013May17.5D3113, dd53ca8bbeab+ (unified) tip
Mode: playback, Global Draw: ON
CF SanDisk SanDisk SDCFH-016G                     
10312704 314
15885312 316
80896 171
8949760 304
28661760 315
16264192 317
24521728 309
16424960 316
13148160 311
15619072 314
1658880 299
21001216 314
8548352 309
19760128 315
5965824 305
24906752 314
13968384 323
16770048 310
4542464 307
13063168 307
33263616 315
30312448 309
16713728 315
3887104 305
21841920 313
12846080 311
16192512 313
3333120 315
6719488 312
17313792 312
23374848 315
2865152 303
32488448 317
18588672 311
4186112 308
821248 286
3661824 310
18359296 308
19875840 323
22754304 318
13665280 315
24957952 312
28555264 310
33442816 312
10708992 307
20242432 313
8774656 309
11216896 322
23156736 309
12750848 315
12369920 316
2157568 312
15279104 318
29943808 322
30321664 326
19004416 310
268288 259
23778304 318
467968 277
1905664 314
32368640 318
19829760 324
26281984 303
24153088 308
11364352 314
32160768 315
5944320 308
24118272 308
28511232 314
31526912 310
15956992 316
1732608 296
13881344 318
6106112 305
17367040 315
21693440 311
30835712 320
1139712 289
13698048 311
19388416 310
1532928 295
16333824 313
15963136 312
23540736 307
23770112 325
7317504 309
6019072 305
13303808 315
32039936 314
13137920 312
24311808 308
25442304 315
8986624 308
25421824 305
2720768 308
18526208 318
12448768 305
6514688 313
6632448 308
17897472 302
26569728 315
22568960 310
11912192 305
22007808 313
30651392 308
29615104 305
18367488 323
21049344 308
15778816 317
24951808 314
5359616 311
23476224 309
17125376 314
3318784 316
12782592 319
30965760 315
1974272 305
32021504 311
24463360 324
28246016 316
23352320 323
27161600 320
25191424 315
10841088 313
22846464 317
19111936 313
26234880 313
32610304 320
14385152 319
18029568 316
11080704 311
3933184 306
22414336 315
8314880 309
27988992 321
20073472 314
23487488 308
30233600 314
25299968 308
2406400 300
28059648 323
2145280 302
27503616 310
20705280 303
28731392 314
2458624 303
19662848 307
6198272 311
21655552 310
32225280 307
21788672 314
16669696 321
12007424 307
4321280 310
14878720 310
10118144 305
2836480 309
21092352 312
17086464 299
1707008 301
17509376 305
28161024 313
18457600 318
16290816 310
10758144 318
17766400 310
28011520 322
19835904 304
11879424 323
18191360 310
12581888 304
15906816 322
6525952 309
30545920 303
934912 298
6738944 321
18920448 316
27171840 325
19916800 313
28598272 315
23926784 318
10470400 314
20392960 314
7282688 318
4824064 318
11820032 313
30988288 306
26221568 317
13527040 310
30140416 305
6785024 312
25762816 311
23324672 304
26011648 314
4475904 305
33500160 319
8732672 311
29461504 310
12411904 315
12294144 307
11481088 313
12786688 311
15858688 320
16142336 316
29415424 316
32114688 310
18460672 313
15672320 322
12832768 309
23447552 313
18734080 310
25832448 314
20690944 310
27086848 310
24894464 314
32919552 309
30015488 310
2870272 307
27643904 317
25778176 314
4189184 306
13642752 313
7861248 307
21999616 314
4232192 304
12140544 321
3162112 315
27608064 324
18791424 318
5019648 313
15958016 317
20426752 317
685056 286
18709504 315
6188032 316
6668288 316
30684160 326
9438208 320
20264960 319
1707008 311
4702208 316
27417600 316
31681536 320
1326080 309
9743360 319
29618176 324
28645376 321
21629952 314
21515264 310
12170240 306
29555712 308
2771968 307
30593024 314
23996416 313
31484928 304
24702976 314
24359936 321
32328704 319
21560320 308
18289664 312
26721280 313
33334272 306
29471744 315
30886912 312
10810368 306
16393216 317
4559872 309
17182720 307
251904 259
10129408 311
18564096 307
30530560 323
5036032 311
10642432 310
1025024 282
20564992 315
17504256 312
19713024 312
12450816 314
596992 290
20088832 307
3368960 309
12530688 311
29465600 308
10443776 312
23064576 320
32175104 324
9240576 305
30198784 314
11613184 318
7633920 315
22871040 313
22456320 319
16783360 312
1076224 297
1472512 299
53248 137
22145024 324
13445120 319
15488000 304
17851392 322
8222720 319
3790848 310
31733760 320
4009984 316
29513728 317
29906944 323
25694208 325
16442368 314
3623936 306
29339648 317
27055104 307
12034048 313
32011264 312
32172032 307
22600704 315
13225984 316
28665856 325
11716608 305
28250112 316
5085184 307
28856320 309
218112 244
21444608 311
30626816 308
7068672 314
31740928 315
27124736 310
17964032 315
23683072 317
10264576 310
23499776 307
23206912 315
29933568 315
13522944 310
28731392 316
13669376 316
18453504 310
8773632 306
31521792 315
32563200 321
14050304 305
23192576 313
2580480 309
12610560 310
8542208 313
21291008 306
1245184 308
9519104 317
29709312 314
14656512 324
19511296 319
17680384 306
31774720 314
17035264 308
16637952 315
24604672 312
23776256 317
12297216 304
31228928 324
19137536 320
11517952 313
25170944 321
10852352 319
14022656 319
27422720 307
2764800 316
31773696 321
25122816 315
6719488 320
20889600 325
13719552 321
26656768 308
27925504 316
25307136 311
30016512 309
15267840 312
1992704 310
7454720 305
13520896 315
19296256 312
15080448 324
2733056 299
6084608 314
7767040 309
19521536 308
11791360 314
4573184 306
31201280 312
12889088 320
10139648 314
24348672 309
178176 239
9086976 311
1422336 295
20881408 316
2706432 304
29356032 307
9225216 313
9115648 310
19433472 316
2195456 300
31977472 313
7171072 314
8365056 314
31093760 321
17173504 315
2191360 314
2806784 314
26635264 315
11782144 323
25329664 319
23643136 317
26715136 325
3762176 315
4759552 311
21786624 325
12112896 319
28181504 315
25351168 325
33405952 312
19030016 316
9690112 322
23938048 323
13831168 317
14360576 314
5323776 320
12928000 318
7570432 314
13710336 323
7164928 318
13621248 318
29969408 316
29436928 317
9693184 313
10413056 325
16844800 324
6436864 308
3139584 302
1518592 301
22846464 311
15690752 306
31619072 316
19501056 313
16398336 307
6238208 321
15412224 321
13130752 307
32825344 316
19061760 311
22163456 306
24397824 316
18536448 313
24160256 307
22958080 315
4352000 307
11240448 305
6855680 323
3570688 306
4942848 304
12975104 313
24314880 313
12750848 311
3128320 300
29314048 313
5171200 305
18586624 306
12131328 313
22717440 320
6662144 312
3102720 318
13159424 317
21650432 315
1045504 304
6996992 308
8030208 313
41984 119
646144 294
2521088 306
24885248 324
14108672 319
6751232 302
1507328 313
27210752 314
4873216 315
8120320 312
25854976 316
5417984 306
26497024 314
15966208 315
8155136 307
11756544 319
25576448 324
14921728 309
8012800 315
24283136 314
18381824 315
29868032 313
16788480 309
29538304 310
28482560 319
22857728 319
11183104 301
1052672 295
5559296 306
15012864 313
32344064 315
13061120 321
28729344 316
9480192 306
30612480 324
20639744 311
10013696 306
5862400 310
18298880 314
23938048 310
29583360 313
2676736 300
31510528 323
2937856 305
23347200 308
11726848 313
2904064 303
20049920 307
26983424 314
1421312 295
13773824 305
26993664 314
15478784 314
6122496 318
31414272 305
24333312 313
16172032 310
31551488 305
30025728 313
24596480 314
16249856 313
21200896 313
1811456 313
12495872 318
22435840 315
1756160 303
19796992 320
6949888 312
32049152 314
26814464 311
5679104 312
5804032 322
8168448 317
7987200 315
7357440 321
10604544 321
32722944 315
22999040 324
16946176 325
27879424 321
16748544 318
26218496 323
8698880 320
24347648 308
17693696 325
11396096 319
27094016 306
18161664 325
17741824 310
7563264 305
11387904 324
6795264 308
13068288 307
33315840 315
1360896 301
179200 232
31031296 314
29638656 318
6290432 311
17600512 310
23806976 308
22608896 311
13219840 312
2768896 300
28721152 314
13686784 313
31881216 315
21140480 315
27467776 315
6325248 317
18780160 307
29000704 313
5698560 307
13757440 307
32033792 312
1196032 299
7829504 308
13819904 315
4787200 303
31131648 314
6534144 315
17713152 306
10491904 311
28841984 311
8125440 304
30911488 324
19365888 310
11707392 303
5778432 320
16601088 312
21358592 325
26169344 307
1667072 311
4779008 316
29435904 308
662528 288
28992512 321
24974336 316
23857152 323
401408 283
15919104 310
27906048 316
23015424 316
4002816 310
24198144 327
29455360 319
25784320 309
17810432 315
1175552 295
33447936 309
4911104 311
20684800 316
11038720 307
22244352 325
3306496 308
13486080 307
21708800 318
8059904 310
23488512 307
27561984 325
29150208 317
22958080 318
79872 180
3001344 301
25936896 317
5336064 316
7099392 315
18265088 306
5236736 311
29139968 316
30307328 312
28890112 314
8766464 316
6253568 311
32888832 313
25340928 306
5874688 311
8569856 320
13980672 314
12325888 324
10957824 319
21971968 306
27854848 325
32061440 325
20875264 320
27922432 314
12000256 323
24394752 319
33127424 309
18564096 313
28583936 313
1114112 300
12428288 313
29057024 321
18947072 314
31187968 324
6689792 308
24388608 314
9733120 315
14794752 319
27363328 324
22615040 307
4679680 311
29193216 317
29623296 316
2713600 320
18762752 319
18162688 307
5191680 312
31337472 312
10897408 304
3752960 309
15242240 311
4296704 302
7144448 312
3975168 298
11262976 321
3813376 311
29945856 315
22281216 319
11097088 317
25664512 314
21757952 312
19299328 306
27878400 315
5765120 308
6858752 305
29338624 314
17524736 310
9234432 308
18404352 316
12910592 320
32882688 314
17588224 311
353280 264
20793344 310
25840640 315
24542208 319
12421120 310
1551360 299
26938368 323
3689472 305
25926656 313
13207552 319
14135296 320
29024256 315
6199296 319
22039552 322
15332352 320
12561408 323
30338048 321
5548032 320
18877440 320
14754816 323
3061760 316
16175104 322
21693440 321
18046976 324
16389120 319
7243776 316
9588736 309
26919936 315
2068480 317
21771264 320
3138560 311
18165760 323
8387584 320
25266176 318
13416448 324
26480640 321
27202560 317
13935616 323
9308160 321
24699904 314
32326656 315
http://www.pululahuahostal.com  |  EF 300 f/4, EF 100-400 L, EF 180 L, EF-S 10-22, Samyang 14mm, Sigma 28mm EX DG, Sigma 8mm 1:3.5 EX DG, EF 50mm 1:1.8 II, EF 1.4X II, Kenko C-AF 2X

Colemar

  • Freshman
  • **
  • Posts: 52
Re: Card benchmark - what's the optimal write buffer size?
« Reply #30 on: May 18, 2013, 03:09:04 AM »
These long tests are really nice. Keep them coming, please!
I have the results from 4hrs of SanDisk Extreme Pro 128GB 100MB/s CompactFlash card and 2.1hrs of Lexar Professional 32GB 1000x CompactFlash card, but it exceeds the maximum limit of characters for the forum.  A1ex, send me instructions to email to you if you wish.

Audionut

  • Global Moderator
  • Hero Member
  • *****
  • Posts: 3634
  • Blunt and to the point
Re: Card benchmark - what's the optimal write buffer size?
« Reply #31 on: May 18, 2013, 04:57:23 AM »
but it exceeds the maximum limit of characters for the forum.

Paste it to pastebin http://pastebin.com/

skrull

  • New to the forum
  • *
  • Posts: 15
Re: Card benchmark - what's the optimal write buffer size?
« Reply #32 on: May 18, 2013, 05:04:27 AM »
Hey a1ex and g3gg0, there's something that maybe you're missing. All flash cards (SD/CF/SSD/etc) have a fixed erase block size.

If there's no partition and the card is just formatted with filesystem then it is ok. But for those who have a partition table on them, the partition must be aligned with EBS to have optimal performance (See articles on partition alignment for SSD)

All partitions of the cards I've tested were misaligned out-of-the-box. Besides Dane-elec and Sandisk I couldn't recall the other brands. I couldn't recall the numbers but I did see performance improvements.

Instead of trying to find EBS for all cards, I suggest aligning the partition at 1MB, so it should fit almost (if not all) EBS.

An utility to check alignment: http://www.tcpdump.com/kb/os/windows/disk-alignment/all-pages.html
(Or using MS System Information - msinfo32.exe) http://whirlpool.net.au/wiki/checking_ssd_alignment

Instructions for Windows XP here: http://support.microsoft.com/kb/929491
Linux users should set fdisk to show entry/units to sectors and create a partition with starting sector 2048.
Of course you can use any partition manager to move/resize the beginning of the partition.

Regards,

Rodrigo

Colemar

  • Freshman
  • **
  • Posts: 52
Re: Card benchmark - what's the optimal write buffer size?
« Reply #33 on: May 18, 2013, 05:14:41 AM »
thanks Audionut!

http://pastebin.com/fKzZ8ee5 -- 4+hr benchmark of SanDisk Extreme Pro 100MB/s

http://pastebin.com/jU0Jv3DH -- 2+hr benchmark of Lexar Professional 1000x


noisyboy

  • Guest
Re: Card benchmark - what's the optimal write buffer size?
« Reply #34 on: May 18, 2013, 05:19:31 AM »
Hey a1ex and g3gg0, there's something that maybe you're missing. All flash cards (SD/CF/SSD/etc) have a fixed erase block size.

If there's no partition and the card is just formatted with filesystem then it is ok. But for those who have a partition table on them, the partition must be aligned with EBS to have optimal performance (See articles on partition alignment for SSD)

All partitions of the cards I've tested were misaligned out-of-the-box. Besides Dane-elec and Sandisk I couldn't recall the other brands. I couldn't recall the numbers but I did see performance improvements.

Instead of trying to find EBS for all cards, I suggest aligning the partition at 1MB, so it should fit almost (if not all) EBS.

An utility to check alignment: http://www.tcpdump.com/kb/os/windows/disk-alignment/all-pages.html
(Or using MS System Information - msinfo32.exe) http://whirlpool.net.au/wiki/checking_ssd_alignment

Instructions for Windows XP here: http://support.microsoft.com/kb/929491
Linux users should set fdisk to show entry/units to sectors and create a partition with starting sector 2048.
Of course you can use any partition manager to move/resize the beginning of the partition.

Regards,

Rodrigo

Hey dude - cool reading! Would this affect performance then or just test results?

noisyboy

  • Guest
Re: Card benchmark - what's the optimal write buffer size?
« Reply #35 on: May 18, 2013, 05:22:14 AM »
Wow - just done some more reading on optimizing drives with disk alignment. Never new this stuff! Will have a play as soon as I can understand it  8)

noisyboy

  • Guest
Re: Card benchmark - what's the optimal write buffer size?
« Reply #36 on: May 18, 2013, 05:41:41 AM »
This is handy! http://www.techpowerup.com/articles/other/157

Ignore the shit out of me.

Audionut

  • Global Moderator
  • Hero Member
  • *****
  • Posts: 3634
  • Blunt and to the point
Re: Card benchmark - what's the optimal write buffer size?
« Reply #37 on: May 18, 2013, 06:34:36 AM »
All flash cards (SD/CF/SSD/etc) have a fixed erase block size.

I've done all my SSD's but never thought to do the flash cards.

The maximum resolution (consistent - no frame drops) I could do previously was 1600x840.  After aligning the partition table I was able to get 1920x840.  Good times!

Also, the expected MB/s calculations are borked with high frame-rates.  I've noticed occasionally that FPS override sometimes displays funky results after being set.  Most times if you go back to live-view and then back to ML menu it seems to reset itself correctly.
When trying to adjust for 23.976, often times I get it close enough, say 23.978, go back to live-view and mess around and when going back to ML menu, FPS override will now say 24.001 for instance.

Also, if I override to 48fps for instance, it appears that the MB/s calculations are getting based off 60fps set be Canon.

Also, raw2dng is displaying 30.848 fps on footage that was shot at 48fps

a1ex

  • Administrator
  • Hero Member
  • *****
  • Posts: 12518
Re: Card benchmark - what's the optimal write buffer size?
« Reply #38 on: May 18, 2013, 06:59:31 AM »
Quote
The maximum resolution (consistent - no frame drops) I could do previously was 1600x840.  After aligning the partition table I was able to get 1920x840.

Wow, quite significant. Need to try it.

Quote
When trying to adjust for 23.976, often times I get it close enough, say 23.978, go back to live-view and mess around and when going back to ML menu, FPS override will now say 24.001 for instance.

If you are in some NTSC mode (e.g. 24p), FPS override will try to multiply by 1000/1001. Photo mode and zoom are considered PAL for the purposes of rounding. To disable rounding, try exact FPS.

Quote
Also, raw2dng is displaying 30.848 fps on footage that was shot at 48fps

I'm pretty sure raw2dng is right here. Look in the FPS menu.

Audionut

  • Global Moderator
  • Hero Member
  • *****
  • Posts: 3634
  • Blunt and to the point
Re: Card benchmark - what's the optimal write buffer size?
« Reply #39 on: May 18, 2013, 07:06:58 AM »
I'm pretty sure raw2dng is right here. Look in the FPS menu.

Not sure what FPS menu you are talking about.  FPS override was set to 48 fps from 60 fps (should have been in PAL) in exact mode.  I was using shutter adjustment to get perfect 180 degree shutter.  I went from live-view to ML menu a couple of times to double check FPS override was staying correct.

Just thought, would my 48fps settings get overridden because I'm shooting for a higher resolution then 1280x720?

edit:  It defiantly recorded at 30fps not 48.

Wow, quite significant. Need to try it.

I formatted the card in exFat while I was at it also, not sure what difference this has on speed.  Previously Fat32.

a1ex

  • Administrator
  • Hero Member
  • *****
  • Posts: 12518
Re: Card benchmark - what's the optimal write buffer size?
« Reply #40 on: May 18, 2013, 07:25:31 AM »
If you select 48fps and then move to 1080p or to zoom mode, it will clamp down to the maximum your camera can do (a little over 30fps). The value is printed in ML menu and in top-right corner.

Audionut

  • Global Moderator
  • Hero Member
  • *****
  • Posts: 3634
  • Blunt and to the point
Re: Card benchmark - what's the optimal write buffer size?
« Reply #41 on: May 18, 2013, 07:28:41 AM »
If you select 48fps and then move to 1080p or to zoom mode,

I was in zoom mode. 

Cheers a1ex.

a1ex

  • Administrator
  • Hero Member
  • *****
  • Posts: 12518
Re: Card benchmark - what's the optimal write buffer size?
« Reply #42 on: May 18, 2013, 08:07:56 AM »
Back to topic. Here are some results:



Just had a crazy thought: what if we change buffer sizes randomly during writing?

Source: https://bitbucket.org/hudson/magic-lantern/commits/425a8abeb7ef
5D3 113 binary: autoexec.bin
Debug - Benchmarks - Random buffer size test

My quick 10-minute test seems promising. If it gets rid of the large speed drops, it's worth exploring further imo.

g3gg0

  • Developer
  • Hero Member
  • *****
  • Posts: 3166
Help us with datasheets - Help us with register dumps
magic lantern: 1Magic9991E1eWbGvrsx186GovYCXFbppY, server expenses: paypal@g3gg0.de
ONLY donate for things we have done, not for things you expect!

Yomommassis

  • New to the forum
  • *
  • Posts: 42
Re: Card benchmark - what's the optimal write buffer size?
« Reply #44 on: May 18, 2013, 09:03:29 AM »
So is the card stress test a priority or the card random buffer test?

also would the results very much from camera to camera?
because I'm currently running three tests simultaneously
5d3, 5d2, t2i
EOS 5D MkIII (ML alpha 3)| EOS 5D MkII (ML v2.3) | EOS 7D (ML alpha 2) | EOS T2i (ML v2.3)
f/2.8 70-200MM L USM | f/1.4 50mm USM | f/1.4 35mm L USM | T/1.5 24mm
Zoom H4n | Rode NTG2

a1ex

  • Administrator
  • Hero Member
  • *****
  • Posts: 12518
Re: Card benchmark - what's the optimal write buffer size?
« Reply #45 on: May 18, 2013, 09:12:09 AM »
Woauh... what's causing this difference?!

g3gg0

  • Developer
  • Hero Member
  • *****
  • Posts: 3166
Re: Card benchmark - what's the optimal write buffer size?
« Reply #46 on: May 18, 2013, 09:19:47 AM »
my card:

just formatted it with correct alignment and exFAT clustersize 16M.
lets see what happens.
Help us with datasheets - Help us with register dumps
magic lantern: 1Magic9991E1eWbGvrsx186GovYCXFbppY, server expenses: paypal@g3gg0.de
ONLY donate for things we have done, not for things you expect!

g3gg0

  • Developer
  • Hero Member
  • *****
  • Posts: 3166
Re: Card benchmark - what's the optimal write buffer size?
« Reply #47 on: May 18, 2013, 09:25:06 AM »
http://upload.g3gg0.de/pub_files/7005e69d9e57dc3b15abedcd92daee01/BENCH.LOG
with exFAT clustersize 16M and start sector alignment.
Help us with datasheets - Help us with register dumps
magic lantern: 1Magic9991E1eWbGvrsx186GovYCXFbppY, server expenses: paypal@g3gg0.de
ONLY donate for things we have done, not for things you expect!

a1ex

  • Administrator
  • Hero Member
  • *****
  • Posts: 12518
Re: Card benchmark - what's the optimal write buffer size?
« Reply #48 on: May 18, 2013, 09:36:08 AM »
Updated the graph; variations are much lower, but it's still slower than the other two, can't explain this...

Peter

  • New to the forum
  • *
  • Posts: 17
Re: Card benchmark - what's the optimal write buffer size?
« Reply #49 on: May 18, 2013, 09:45:14 AM »
1h Random Test Sandisk Extreme Pro 32GB

https://dl.dropboxusercontent.com/u/10273766/BENCHRND.LOG