Oh Thumpers, Oh Thumpers

August 29, 2006 - by jason

I can’t tell you what a pleasure it is to have your storage run the same operating system as your “normal” servers. So much so that I have to share it with you all after doing some more tooling around on one.

So when you have 47 discs sitting around

$ zpool create joyous1
raidz2 c{5,4,7,6,1,0}t4d0 c{4,7,6,1,0}t0d0  {can lose 2; notice how it cuts across controllers}
raidz2 c{5,4,7,6,1,0}t5d0 c{4,7,6,1,0}t1d0  {can lose 2; notice how it cuts across controllers}
raidz2 c{5,4,7,6,1,0}t6d0 c{4,7,6,1,0}t2d0  {can lose 2; notice how it cuts across controllers}
raidz2 c{5,4,7,6,1,0}t7d0 c{4,7,6,1,0}t3d0  {can lose 2; notice how it cuts across controllers}
spare c5t{1,2,3}d0 {three hot spares}

And instantly you get

But the thing isn’t just about space.

It’s really about spindles.

For many things (mail, postgresql or any database for that matter), it’s all about the number of spindles: can the disk I/O (that’s in-out) be as fast as say … one’s network connection (gigabit+ in a good world)? cpu memory (generally ~22Gbps)?

And how do you scale disc IO? That’s correct, you add spindles.

So let’s take filebench and just look at what the “webserver” profile does (90% reads, 10% writes).

[private:/] $ /opt/filebench/filebench
filebench> load webserver
26073: 43.569: Webserver Version 1.13 2005/06/21 21:18:53 personality successfully loaded
filebench> set $dir=/joyous/jason/
filebench> run 60

IO Summary: 5544761 ops 91746.2 ops/s, (29594/2961 r/w) 499.3mb/s, 60us cpu/op, 0.0ms latency
26073: 142.218: Shutting down processes

:

Sign up now for Instant Cloud Access Get Started