I forgot to mention, the server was jumpstarted with Solaris 10 U9, and the latest patch cluster was downloaded and applied. ---------------------------------------- Original Message ---------------------------------------- Subject: [zfs-discuss] Sun T3-2 and ZFS on JBODS From: "Sigbjorn Lie" <sigbjorn at nixtra.com> Date: Wed, March 2, 2011 12:35 To: zfs-discuss at opensolaris.org -------------------------------------------------------------------------------------------------- Hi, We have purchased a new Sun (Oracle) T3-2 machine and 5 shelves of 12 x 2TB SAS2 JBOD disks for our new backup server. Each shelf is connected via a single SAS cable to a seperate SAS controller. When the system arrived it had Solaris 10 U9 preinstalled. We tested ZFS performance and got roughly 1.3GB / sec when we configured a RADIZ2 per 12 disks, and roughly 1.7GB / sec when we configured a RAIDZ1 per 6 disks. Good performance. Then I noticed that some packages we''re missing from the installation, and I decided to jumpstart the server to get the server installed the same way as every other Solaris server we have. After it''s been reinstalled I get 100-300MB / sec, and very sporadic writes. I''ve played around with turning on and off mpxio on the mpt_sas driver, disabling increased the performance from 30MB / sec, but it''s still far from the original performance. I''ve attached some dumps of zpool iostat before and after reinstallation. Any suggestions to what settings might cause this? What to try to increase the performance? Regards, Siggi Before: pool0 51.5G 109T 93 10.4K 275K 1.27G pool0 59.8G 109T 92 10.8K 274K 1.32G pool0 68.1G 109T 92 10.6K 274K 1.30G pool0 76.5G 109T 92 11.4K 274K 1.39G pool0 85.0G 109T 92 10.2K 274K 1.25G pool0 93.6G 109T 92 11.2K 274K 1.37G pool0 93.6G 109T 0 9.77K 0 1.20G pool0 102G 109T 1 10.6K 5.99K 1.30G pool0 111G 109T 0 11.5K 0 1.41G pool0 119G 109T 1 10.7K 5.99K 1.31G pool0 127G 109T 89 11.1K 268K 1.36G pool0 136G 109T 1 11.8K 5.99K 1.44G After: pool0 30.8G 109T 0 297 0 36.2M pool0 30.8G 109T 0 2.85K 0 358M pool0 33.7G 109T 0 760 0 91.5M pool0 33.7G 109T 0 0 0 0 pool0 33.7G 109T 0 0 0 0 pool0 33.7G 109T 0 0 0 0 pool0 33.7G 109T 0 954 0 117M pool0 33.7G 109T 0 2.03K 0 255M pool0 36.2G 109T 0 358 0 42.2M pool0 36.2G 109T 0 0 0 0 pool0 36.2G 109T 0 858 0 105M pool0 36.2G 109T 0 1.28K 0 160M pool0 38.4G 109T 0 890 0 107M pool0 38.4G 109T 0 0 0 0 pool0 38.4G 109T 0 0 0 0 pool0 38.4G 109T 0 1.57K 0 197M pool0 40.3G 109T 0 850 0 103M pool0 40.3G 109T 0 0 0 0 pool0 40.3G 109T 0 0 0 0 pool0 40.3G 109T 0 0 0 0 pool0 40.3G 109T 0 2.58K 0 320M pool0 42.2G 109T 0 12 0 102K _______________________________________________ zfs-discuss mailing list zfs-discuss at opensolaris.org http://mail.opensolaris.org/mailman/listinfo/zfs-discuss