Wednesday, June 16, 2010

zpool scrub - 4GB/s

Open Solaris 2009.06 + entry level 2U x86 server Sun Fire x4270 + 1U xxxx array.

# iostat -xnzCM 1|egrep "device|c[0123]$"
[...]
extended device statistics
r/s w/s Mr/s Mw/s wait actv wsvc_t asvc_t %w %b device
8182.1 0.0 1022.1 0.0 0.1 152.8 0.0 18.7 0 1077 c0
8179.1 0.0 1021.7 0.0 0.1 148.7 0.0 18.2 0 1076 c1
8211.0 0.0 1025.9 0.0 0.1 162.8 0.0 19.8 0 1081 c2
8218.0 0.0 1026.8 0.0 0.1 164.5 0.0 20.0 0 1085 c3
extended device statistics
r/s w/s Mr/s Mw/s wait actv wsvc_t asvc_t %w %b device
8080.2 0.0 1010.0 0.0 0.1 168.3 0.0 20.8 0 1070 c0
8080.2 0.0 1010.0 0.0 0.1 167.6 0.0 20.7 0 1071 c1
8165.2 0.0 1020.3 0.0 0.1 166.0 0.0 20.3 0 1079 c2
8157.2 0.0 1019.3 0.0 0.1 151.4 0.0 18.6 0 1080 c3
extended device statistics
r/s w/s Mr/s Mw/s wait actv wsvc_t asvc_t %w %b device
8192.0 0.0 1023.4 0.0 0.1 174.6 0.0 21.3 0 1085 c0
8190.9 0.0 1023.1 0.0 0.1 174.2 0.0 21.3 0 1085 c1
8140.9 0.0 1016.9 0.0 0.1 145.5 0.0 17.9 0 1078 c2
8138.9 0.0 1016.7 0.0 0.1 142.7 0.0 17.5 0 1075 c3
extended device statistics
r/s w/s Mr/s Mw/s wait actv wsvc_t asvc_t %w %b device
8129.1 0.0 1015.6 0.0 0.1 153.0 0.0 18.8 0 1066 c0
8125.2 0.0 1015.1 0.0 0.1 155.1 0.0 19.1 0 1067 c1
8156.2 0.0 1018.8 0.0 0.1 162.1 0.0 19.9 0 1074 c2
8159.2 0.0 1019.2 0.0 0.1 162.0 0.0 19.9 0 1076 c3
extended device statistics
r/s w/s Mr/s Mw/s wait actv wsvc_t asvc_t %w %b device
8177.9 0.0 1022.0 0.0 0.1 165.0 0.0 20.2 0 1088 c0
8184.9 0.0 1022.9 0.0 0.1 165.2 0.0 20.2 0 1085 c1
8209.9 0.0 1026.1 0.0 0.1 162.4 0.0 19.8 0 1085 c2
8204.9 0.0 1025.5 0.0 0.1 161.8 0.0 19.7 0 1087 c3
extended device statistics
r/s w/s Mr/s Mw/s wait actv wsvc_t asvc_t %w %b device
8236.4 0.0 1029.2 0.0 0.1 170.1 0.0 20.7 0 1092 c0
8235.4 0.0 1029.0 0.0 0.1 170.2 0.0 20.7 0 1093 c1
8215.4 0.0 1026.4 0.0 0.1 165.3 0.0 20.1 0 1091 c2
8220.4 0.0 1027.0 0.0 0.1 164.9 0.0 20.1 0 1090 c3


Then with a small I/O it can sustain over 400k IOPS - more HBAs should deliver even more performance.

It is really amazing how fast technology is progressing.
To achieve above numbers 10 years ago it would have cost a small fortune.

Saturday, June 12, 2010

Heat Maps

Brendan Gregg wrote an article in ACM Queue about Visualizing System Latency as heat maps. The article explains really well what latency heat maps are and how to read them. It is also a good read if you want to learn about a rainbow pterodactyl (shown below) flying over an icy lake inside a disk array.

WAN Emulation - hxbt

I didn't know about it :)

Thursday, June 10, 2010