TIObench Software Raid

From Ye Ole Stash
Jump to: navigation, search

Contents

Info

General

OS:
CPU(s):
System Manufacturer/model ::
Arch:
Raid Controller:
Cache:
Raid Level:
Results File (XLS):
Harddrive Model:
RPM
Cache

Tests

Commands run for tests

tiobench Command : tiobench --size 4096 --numruns 4 --dir /mnt/test/
hdparm : hdparm -tT /dev/$device
Optional
(test1) dd if=/dev/zero of=/mnt/test/test.test bs=1k count=10000000
(test2) dd if=/dev/zero of=/mnt/test/test.test bs=1000M count=2

Pass 1 (Raid 10 4K block size)

Commands

Raid Create Command : (already existing raid10)
Filesystem Create Command :

Results

hdparm results
 Timing cached reads:   16040 MB in  2.00 seconds = 8036.50 MB/sec
 Timing buffered disk reads:  422 MB in  3.00 seconds = 140.49 MB/sec
tiobench results
Sequential Reads
2.6.18-164.15.1.el5           4096  4096    1  130.00 11.08%     0.120      580.55   0.00000  0.00000  1172
2.6.18-164.15.1.el5           4096  4096    2   63.89 9.806%     0.480     1282.50   0.00000  0.00000   652
2.6.18-164.15.1.el5           4096  4096    4   87.91 26.50%     0.688     1388.73   0.00000  0.00000   332
2.6.18-164.15.1.el5           4096  4096    8  104.84 61.47%     1.082     1771.29   0.00000  0.00000   171
 
Random Reads
2.6.18-164.15.1.el5           4096  4096    1    1.42 0.408%    11.004      117.38   0.00000  0.00000   347
2.6.18-164.15.1.el5           4096  4096    2    2.64 1.484%    11.254      126.94   0.00000  0.00000   178
2.6.18-164.15.1.el5           4096  4096    4    4.04 4.338%    14.225      166.74   0.00000  0.00000    93
2.6.18-164.15.1.el5           4096  4096    8    4.88 10.63%    20.235      465.43   0.00000  0.00000    46
 
Sequential Writes
2.6.18-164.15.1.el5           4096  4096    1  138.17 44.10%     0.098     6507.31   0.00019  0.00000   313
2.6.18-164.15.1.el5           4096  4096    2  138.72 125.2%     0.189    17211.38   0.00124  0.00000   111
2.6.18-164.15.1.el5           4096  4096    4  136.10 356.7%     0.368    16754.08   0.00172  0.00000    38
2.6.18-164.15.1.el5           4096  4096    8  133.58 721.0%     0.739    18504.69   0.00229  0.00000    19
 
Random Writes
2.6.18-164.15.1.el5           4096  4096    1    5.07 1.330%     0.025        0.15   0.00000  0.00000   381
2.6.18-164.15.1.el5           4096  4096    2    5.04 3.304%     0.030        0.33   0.00000  0.00000   152
2.6.18-164.15.1.el5           4096  4096    4    4.90 8.235%     0.041        0.61   0.00000  0.00000    60
2.6.18-164.15.1.el5           4096  4096    8    4.76 14.32%     0.051       23.98   0.00000  0.00000    33

Pass 1 (Raid 0 4k chunk size 4K block size)

Commands

Raid Create Command : mdadm --create /dev/md2 --chunk=4 --level=0 --raid-devices=4 /dev/sdc1 /dev/sdd1 /dev/sde1 /dev/sdf1
Filesystem Create Command : mke2fs -m 1 -O dir_index -j /dev/md2

Results

Sequential Reads
2.6.18-164.15.1.el5           4096  4096    1  315.38 42.42%     0.049      389.69   0.00000  0.00000   743
2.6.18-164.15.1.el5           4096  4096    2   98.43 21.92%     0.315      557.25   0.00000  0.00000   449
2.6.18-164.15.1.el5           4096  4096    4   70.60 22.26%     0.871     1157.58   0.00000  0.00000   317
2.6.18-164.15.1.el5           4096  4096    8   61.99 33.06%     1.950     2645.42   0.00000  0.00000   187
 
Random Reads
2.6.18-164.15.1.el5           4096  4096    1    1.50 0.429%    10.424      127.40   0.00000  0.00000   349
2.6.18-164.15.1.el5           4096  4096    2    2.56 1.398%    11.562       90.50   0.00000  0.00000   183
2.6.18-164.15.1.el5           4096  4096    4    4.18 3.858%    13.871      138.20   0.00000  0.00000   108
2.6.18-164.15.1.el5           4096  4096    8    6.36 12.63%    17.125      266.59   0.00000  0.00000    50
 
Sequential Writes
2.6.18-164.15.1.el5           4096  4096    1  259.40 81.79%     0.059     2042.80   0.00000  0.00000   317
2.6.18-164.15.1.el5           4096  4096    2  255.63 224.9%     0.111     4115.58   0.00000  0.00000   114
2.6.18-164.15.1.el5           4096  4096    4  255.66 589.6%     0.190     6390.10   0.00000  0.00000    43
2.6.18-164.15.1.el5           4096  4096    8  249.81 1339.%     0.405     7150.67   0.00020  0.00000    19
 
Random Writes
2.6.18-164.15.1.el5           4096  4096    1   11.06 2.795%     0.025        0.14   0.00000  0.00000   396
2.6.18-164.15.1.el5           4096  4096    2   11.58 7.041%     0.030        0.20   0.00000  0.00000   164
2.6.18-164.15.1.el5           4096  4096    4   10.50 28.22%     0.042        0.41   0.00000  0.00000    37
2.6.18-164.15.1.el5           4096  4096    8   10.39 24.35%     0.044       12.26   0.00000  0.00000    43

Pass 1 (Raid 0 32k chunk size 4K block size)

Commands

Raid Create Command : mdadm --create /dev/md2 --chunk=32 --level=0 --raid-devices=4 /dev/sdc1 /dev/sdd1 /dev/sde1 /dev/sdf1
Filesystem Create Command : mke2fs -m 1 -O dir_index -j /dev/md2

Results

Sequential Reads
2.6.18-164.15.1.el5           4096  4096    1  319.02 30.24%     0.048      209.05   0.00000  0.00000  1055
2.6.18-164.15.1.el5           4096  4096    2  110.43 21.52%     0.280      664.11   0.00000  0.00000   513
2.6.18-164.15.1.el5           4096  4096    4   90.46 39.80%     0.674     1274.38   0.00000  0.00000   227
2.6.18-164.15.1.el5           4096  4096    8   87.35 74.01%     1.373     2548.44   0.00000  0.00000   118
 
Random Reads
2.6.18-164.15.1.el5           4096  4096    1    1.59 0.393%     9.850      161.74   0.00000  0.00000   403
2.6.18-164.15.1.el5           4096  4096    2    2.62 1.229%    11.715      165.91   0.00000  0.00000   213
2.6.18-164.15.1.el5           4096  4096    4    4.22 4.409%    13.388      136.50   0.00000  0.00000    96
2.6.18-164.15.1.el5           4096  4096    8    6.24 12.79%    16.857      198.51   0.00000  0.00000    49
 
Sequential Writes
2.6.18-164.15.1.el5           4096  4096    1  262.62 79.00%     0.057     3612.67   0.00000  0.00000   332
2.6.18-164.15.1.el5           4096  4096    2  253.44 204.2%     0.109     4639.14   0.00000  0.00000   124
2.6.18-164.15.1.el5           4096  4096    4  248.34 569.6%     0.212     5423.04   0.00019  0.00000    44
2.6.18-164.15.1.el5           4096  4096    8  253.53 1184.%     0.395     7313.92   0.00020  0.00000    21
 
Random Writes
2.6.18-164.15.1.el5           4096  4096    1   11.25 2.898%     0.025        0.10   0.00000  0.00000   388
2.6.18-164.15.1.el5           4096  4096    2   10.80 7.221%     0.030        0.14   0.00000  0.00000   150
2.6.18-164.15.1.el5           4096  4096    4   10.53 21.95%     0.043        1.46   0.00000  0.00000    48
2.6.18-164.15.1.el5           4096  4096    8   10.02 28.88%     0.046       12.53   0.00000  0.00000    35

Pass 1 (Raid 0 128k chunk size 1K block size)

Commands

Raid Create Command : mdadm --create /dev/md2 --chunk=128 --level=0 --raid-devices=4 /dev/sdc1 /dev/sdd1 /dev/sde1 /dev/sdf1
Filesystem Create Command : mke2fs -b 1024 -m 1 -O dir_index -j /dev/md2

Results

hdparm results
 Timing cached reads:   17736 MB in  2.00 seconds = 8886.59 MB/sec
 Timing buffered disk reads:  1022 MB in  3.00 seconds = 340.34 MB/sec
tiobench results
Sequential Reads
2.6.18-164.15.1.el5           4096  4096    1  248.24 25.37%     0.062      627.05   0.00000  0.00000   978
2.6.18-164.15.1.el5           4096  4096    2  116.15 21.71%     0.264      987.76   0.00000  0.00000   535
2.6.18-164.15.1.el5           4096  4096    4   87.75 33.77%     0.704     1815.26   0.00000  0.00000   260
2.6.18-164.15.1.el5           4096  4096    8  106.03 84.38%     1.156     1825.56   0.00000  0.00000   126
 
Random Reads
2.6.18-164.15.1.el5           4096  4096    1    1.44 0.425%    10.814      673.35   0.00000  0.00000   340
2.6.18-164.15.1.el5           4096  4096    2    2.12 1.381%    13.703      111.47   0.00000  0.00000   153
2.6.18-164.15.1.el5           4096  4096    4    3.69 4.605%    16.358      151.76   0.00000  0.00000    80
2.6.18-164.15.1.el5           4096  4096    8    5.45 12.32%    21.359      428.82   0.00000  0.00000    44
 
Sequential Writes
2.6.18-164.15.1.el5           4096  4096    1  118.73 80.86%     0.122     1977.42   0.00000  0.00000   147
2.6.18-164.15.1.el5           4096  4096    2  109.74 231.3%     0.255     5756.40   0.00010  0.00000    47
2.6.18-164.15.1.el5           4096  4096    4  138.29 1173.%     0.397     2265.61   0.00000  0.00000    12
2.6.18-164.15.1.el5           4096  4096    8  140.46 2427.%     0.765     6399.81   0.00010  0.00000     6
 
Random Writes
2.6.18-164.15.1.el5           4096  4096    1   10.02 4.358%     0.037        0.20   0.00000  0.00000   230
2.6.18-164.15.1.el5           4096  4096    2    6.98 10.81%     1.930      361.15   0.00000  0.00000    65
2.6.18-164.15.1.el5           4096  4096    4    9.84 33.88%     0.060        1.56   0.00000  0.00000    29
2.6.18-164.15.1.el5           4096  4096    8    9.66 49.10%     0.120      167.73   0.00000  0.00000    20

Optional Tests

DD: results
(10 GB) copied, 122.23 seconds, 83.8 MB/s
(2.1 GB) copied, 11.9498 seconds, 175 MB/s


Pass 1 (Raid 0 128k chunk size 4K block size)

Commands

Raid Create Command : mdadm --create /dev/md2 --chunk=128 --level=0 --raid-devices=4 /dev/sdc1 /dev/sdd1 /dev/sde1 /dev/sdf1
Filesystem Create Command : mke2fs -m 1 -O dir_index -j /dev/md2

Results

hdparm results
 Timing cached reads:   18792 MB in  2.00 seconds = 9417.85 MB/sec
 Timing buffered disk reads:  1022 MB in  3.00 seconds = 340.53 MB/sec
tiobench results
Sequential Reads
2.6.18-164.15.1.el5           4096  4096    1  318.63 24.93%     0.049      114.61   0.00000  0.00000  1278
2.6.18-164.15.1.el5           4096  4096    2  138.96 21.22%     0.217      574.64   0.00000  0.00000   655
2.6.18-164.15.1.el5           4096  4096    4  138.06 41.41%     0.444     1135.30   0.00000  0.00000   333
2.6.18-164.15.1.el5           4096  4096    8  127.16 76.84%     0.947     2256.29   0.00000  0.00000   165
 
Random Reads
2.6.18-164.15.1.el5           4096  4096    1    1.54 0.395%    10.159      288.37   0.00000  0.00000   388
2.6.18-164.15.1.el5           4096  4096    2    2.45 1.249%    11.693      257.20   0.00000  0.00000   196
2.6.18-164.15.1.el5           4096  4096    4    4.52 4.327%    12.619      237.20   0.00000  0.00000   104
2.6.18-164.15.1.el5           4096  4096    8    6.53 11.23%    16.985      238.80   0.00000  0.00000    58
 
Sequential Writes
2.6.18-164.15.1.el5           4096  4096    1  259.44 77.80%     0.057     2708.91   0.00000  0.00000   333
2.6.18-164.15.1.el5           4096  4096    2  253.50 212.7%     0.108     3145.21   0.00000  0.00000   119
2.6.18-164.15.1.el5           4096  4096    4  253.18 614.2%     0.199     5072.47   0.00010  0.00000    41
2.6.18-164.15.1.el5           4096  4096    8  245.77 1287.%     0.423     5964.60   0.00029  0.00000    19
 
Random Writes
2.6.18-164.15.1.el5           4096  4096    1   11.24 3.038%     0.025        0.14   0.00000  0.00000   370
2.6.18-164.15.1.el5           4096  4096    2   10.72 6.720%     0.030        0.14   0.00000  0.00000   159
2.6.18-164.15.1.el5           4096  4096    4   10.61 24.39%     0.042        1.08   0.00000  0.00000    43
2.6.18-164.15.1.el5           4096  4096    8   10.04 29.53%     0.046       17.32   0.00000  0.00000    34

Optional Tests

DD: results
(10 GB) copied, 58.8458 seconds, 174 MB/s
(2.1 GB) copied, 4.9887 seconds, 420 MB/s

LVM of the same 4 drives

Commands

LVM Create Command : lvcreate -L 150G -n webstorage StorageVG01
Filesystem Create Command : mke2fs -m 1 -j -O DIR_INDEX /dev/mapper/StorageVG01-webstorage

Results

hdparm results
 Timing cached reads:   18620 MB in  2.00 seconds = 9332.17 MB/sec
 Timing buffered disk reads:  256 MB in  3.01 seconds =  84.95 MB/sec
tiobench results
Sequential Reads
2.6.18-164.15.1.el5           4096  4096    1   80.78 6.795%     0.193      594.69   0.00000  0.00000  1189
2.6.18-164.15.1.el5           4096  4096    2   71.10 11.65%     0.438      915.75   0.00000  0.00000   610
2.6.18-164.15.1.el5           4096  4096    4   69.22 22.38%     0.893     1738.41   0.00000  0.00000   309
2.6.18-164.15.1.el5           4096  4096    8   68.21 43.96%     1.806     4770.07   0.00000  0.00000   155
 
Random Reads
2.6.18-164.15.1.el5           4096  4096    1    1.38 0.402%    11.292      252.27   0.00000  0.00000   343
2.6.18-164.15.1.el5           4096  4096    2    1.89 1.035%    16.379      867.17   0.00000  0.00000   182
2.6.18-164.15.1.el5           4096  4096    4    2.37 2.519%    25.685      923.74   0.00000  0.00000    94
2.6.18-164.15.1.el5           4096  4096    8    2.75 6.129%    42.267      935.98   0.00000  0.00000    45
 
Sequential Writes
2.6.18-164.15.1.el5           4096  4096    1   71.29 22.45%     0.179     6828.50   0.00010  0.00000   317
2.6.18-164.15.1.el5           4096  4096    2   71.65 51.61%     0.351     6165.73   0.00000  0.00000   139
2.6.18-164.15.1.el5           4096  4096    4   69.37 127.0%     0.709     8027.30   0.00029  0.00000    55
2.6.18-164.15.1.el5           4096  4096    8   67.02 265.1%     1.419    21788.37   0.00515  0.00000    25
 
Random Writes
2.6.18-164.15.1.el5           4096  4096    1    2.65 0.795%     0.069       13.77   0.00000  0.00000   333
2.6.18-164.15.1.el5           4096  4096    2    2.77 1.802%     0.030        0.23   0.00000  0.00000   154
2.6.18-164.15.1.el5           4096  4096    4    2.76 4.470%     0.042        0.18   0.00000  0.00000    62
2.6.18-164.15.1.el5           4096  4096    8    2.56 6.763%     0.043        6.24   0.00000  0.00000    38

Optional Tests

DD: results
(10 GB) copied, 137.409 seconds, 74.5 MB/s
(2.1 GB) copied, 17.7556 seconds, 118 MB/s


LVM w/ Stripe 2 Drives

LVM Create Command : lvcreate -i2 -I4 --size 150G -n webstorage StorageVG01
Filesystem Create Command : mke2fs -m 1 -j -O DIR_INDEX /dev/mapper/StorageVG01-webstorage

Results

hdparm results
 Timing cached reads:   19160 MB in  2.00 seconds = 9603.43 MB/sec
 Timing buffered disk reads:  512 MB in  3.01 seconds = 170.16 MB/sec
tiobench results
2.6.18-164.15.1.el5           4096  4096    1  165.27 19.62%     0.094      149.72   0.00000  0.00000   842
2.6.18-164.15.1.el5           4096  4096    2  102.24 25.16%     0.302      493.16   0.00000  0.00000   406
2.6.18-164.15.1.el5           4096  4096    4   75.00 40.91%     0.811     1305.29   0.00000  0.00000   183
2.6.18-164.15.1.el5           4096  4096    8   59.55 75.16%     2.059     3030.56   0.00000  0.00000    79
 
Random Reads
2.6.18-164.15.1.el5           4096  4096    1    1.37 0.401%    11.381      484.98   0.00000  0.00000   342
2.6.18-164.15.1.el5           4096  4096    2    2.15 1.203%    13.983      109.58   0.00000  0.00000   179
2.6.18-164.15.1.el5           4096  4096    4    3.07 3.252%    18.479      270.34   0.00000  0.00000    94
2.6.18-164.15.1.el5           4096  4096    8    4.27 8.866%    26.524      503.68   0.00000  0.00000    48
 
Sequential Writes
2.6.18-164.15.1.el5           4096  4096    1  140.64 45.16%     0.093     4871.85   0.00000  0.00000   311
2.6.18-164.15.1.el5           4096  4096    2  136.94 116.2%     0.190     6384.27   0.00000  0.00000   118
2.6.18-164.15.1.el5           4096  4096    4  134.86 347.2%     0.370     6819.16   0.00000  0.00000    39
2.6.18-164.15.1.el5           4096  4096    8  132.11 636.3%     0.732    12017.86   0.00087  0.00000    21
 
Random Writes
2.6.18-164.15.1.el5           4096  4096    1    5.39 1.699%     0.185        7.27   0.00000  0.00000   317
2.6.18-164.15.1.el5           4096  4096    2    5.57 3.299%     0.030        2.75   0.00000  0.00000   169
2.6.18-164.15.1.el5           4096  4096    4    5.33 8.429%     0.044        0.62   0.00000  0.00000    63
2.6.18-164.15.1.el5           4096  4096    8    5.01 12.93%     0.045       11.25   0.00000  0.00000    39

Optional Tests

DD: results
(10 GB) copied, 70.9073 seconds, 144 MB
(2.1 GB) copied, 8.28582 seconds, 253 MB/s


LVM w/ software Raid 1 (4 drives)

LVM Create Command : lvcreate -L150G -n webstorage StorageVG01
Filesystem Create Command : mke2fs -m 1 -j -O DIR_INDEX /dev/mapper/StorageVG01-webstorage

Results

hdparm results
 Timing cached reads:   18284 MB in  2.00 seconds = 9162.44 MB/sec
 Timing buffered disk reads:  254 MB in  3.01 seconds =  84.41 MB/sec
tiobench results
Sequential Reads
2.6.18-164.15.1.el5           4096  4096    1   72.82 10.16%     0.214     1001.66   0.00000  0.00000   716
2.6.18-164.15.1.el5           4096  4096    2  134.10 38.76%     0.231     3431.08   0.00000  0.00000   346
2.6.18-164.15.1.el5           4096  4096    4  121.16 61.76%     0.463     2267.62   0.00000  0.00000   196
2.6.18-164.15.1.el5           4096  4096    8  124.19 114.7%     0.837     5359.42   0.00000  0.00000   108
 
Random Reads
2.6.18-164.15.1.el5           4096  4096    1    0.96 0.330%    16.239      126.98   0.00000  0.00000   291
2.6.18-164.15.1.el5           4096  4096    2    2.71 1.937%    11.307      139.95   0.00000  0.00000   140
2.6.18-164.15.1.el5           4096  4096    4    2.89 3.590%    16.964      219.31   0.00000  0.00000    81
2.6.18-164.15.1.el5           4096  4096    8    3.83 8.093%    25.058      881.35   0.00000  0.00000    47
 
Sequential Writes
2.6.18-164.15.1.el5           4096  4096    1   69.42 23.41%     0.191    37482.45   0.00058  0.00030   296
2.6.18-164.15.1.el5           4096  4096    2   67.64 67.12%     0.369    31171.09   0.00095  0.00057   101
2.6.18-164.15.1.el5           4096  4096    4   65.57 187.3%     0.749    44685.12   0.00362  0.00162    35
2.6.18-164.15.1.el5           4096  4096    8   65.01 396.1%     1.392    35590.08   0.00429  0.00181    16
 
Random Writes
2.6.18-164.15.1.el5           4096  4096    1    2.87 0.832%     0.024        0.14   0.00000  0.00000   345
2.6.18-164.15.1.el5           4096  4096    2    2.73 2.006%     0.030        0.16   0.00000  0.00000   136
2.6.18-164.15.1.el5           4096  4096    4    2.45 4.624%     0.042        1.83   0.00000  0.00000    53
2.6.18-164.15.1.el5           4096  4096    8    2.37 7.970%     0.046       20.28   0.00000  0.00000    30

Optional Tests

DD: results
(10 GB) copied, 135.664 seconds, 75.5 MB/s
(2.1 GB) copied, 20.7802 seconds, 101 MB/s
Personal tools