alan bryan
2008-Mar-04 18:06 UTC
7.0-Release and 3ware 9550SXU w/BBU - horrible write performance
Hi, I've got a new server with a 3ware 9550SXU with the Battery. I am using FreeBSD 7.0-Release (tried both 4BSD and ULE) using AMD64 and the 3ware performance for writes is just plain horrible. Something is obviously wrong but I'm not sure what. I've got a 4 disk RAID 10 array. According to 3dm2 the cache is on. I even tried setting The StorSave preference to "Performance" with no real benefit. There seems to be something really wrong with disk performance. Here's the results from bonnie: File './Bonnie.2551', size: 104857600 Writing with putc()...done Rewriting...done Writing intelligently...done Reading with getc()...done Reading intelligently...done Seeker 1...Seeker 2...Seeker 3...start 'em...done...done...done... -------Sequential Output-------- ---Sequential Input-- --Random-- -Per Char- --Block--- -Rewrite-- -Per Char- --Block--- --Seeks--- Machine MB K/sec %CPU K/sec %CPU K/sec %CPU K/sec %CPU K/sec %CPU /sec %CPU 100 9989 4.8 6739 1.0 18900 7.8 225973 98.5 1914662 99.9 177210.7 259.7 Any ideas? Anybody have one of these that's working with FreeBSD 7? ____________________________________________________________________________________ Looking for last minute shopping deals? Find them fast with Yahoo! Search. http://tools.search.yahoo.com/newsearch/category.php?category=shopping
Erik Stian Tefre
2008-Mar-05 11:18 UTC
7.0-Release and 3ware 9550SXU w/BBU - horrible write performance
alan bryan wrote:> I've got a new server with a 3ware 9550SXU with the > Battery. I am using FreeBSD 7.0-Release (tried both > 4BSD and ULE) using AMD64 and the 3ware performance > for writes is just plain horrible. Something is > obviously wrong but I'm not sure what.> Any ideas? Anybody have one of these that's working > with FreeBSD 7?Check you controller firmware version. Last time I checked, the current "stable" firmware release was 3.08.00.016. dmesg | grep Firmware twa0: INFO: (0x15: 0x1300): Controller details:: Model 9550SX-8LP, 8 ports, Firmware FE9X 3.08.00.016, BIOS BE9X 3.08.00.004 Results from bonnie++ with default settings on my box (7.0-RELEASE, amd64, 480 MB system memory, BBU, write cache enabled, 7 drive raid-5, storsave = balance, NCQ on): Version 1.93d ------Sequential Output------ --Sequential Input- --Random- Concurrency 1 -Per Chr- --Block-- -Rewrite- -Per Chr- --Block-- --Seeks-- Machine Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP /sec %CP xxxxxxxxxxxxxxxx 1G 275 83 72440 23 24990 6 644 83 76548 15 460.6 6 Latency 47041us 522ms 559ms 139ms 300ms 116ms Version 1.93d ------Sequential Create------ --------Random Create-------- xxxxxxxxxxxxxxxxxxx -Create-- --Read--- -Delete-- -Create-- --Read--- -Delete-- files /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP 16 5212 12 +++++ +++ 27581 45 8454 20 +++++ +++ +++++ +++ Latency 1147ms 371us 3529us 197ms 15397us 703us -- Erik
Andrew L. Davydov
2008-Mar-05 21:24 UTC
7.0-Release and 3ware 9550SXU w/BBU - horrible write performance
alan bryan ?????:> Hi, > > I've got a new server with a 3ware 9550SXU with the > Battery. I am using FreeBSD 7.0-Release (tried both > 4BSD and ULE) using AMD64 and the 3ware performance > for writes is just plain horrible. Something is > obviously wrong but I'm not sure what. > > >Hi! Try to add the following variable in your /etc/sysctl.conf #Disk TWA vfs.hirunningspace=5242880 vfs.read_max=256 reboot or execute /etc/rc.d/sysctl start and try your test again My results Seeker 1...Seeker 2...Seeker 3...start 'em...done...done...done... -------Sequential Output-------- ---Sequential Input-- --Random-- -Per Char- --Block--- -Rewrite-- -Per Char- --Block--- --Seeks--- Machine MB K/sec %CPU K/sec %CPU K/sec %CPU K/sec %CPU K/sec %CPU /sec %CPU 1024 80443 80.6 104481 45.2 43386 19.1 84372 80.4 507936 98.6 19422.9 192.7 Machine MB K/sec %CPU K/sec %CPU K/sec %CPU K/sec %CPU K/sec %CPU /sec %CPU 100 51012 46.6 103153 38.0 27272 7.4 116210 98.7 989831 99.3 72496.6 183.3 -- Best regards Mr Andrew L. Davydov +7 985 773 8819