CentOS - Sep 2013 - Intel 10G X520-2 and iscsi storage poor performance

Hi,

we have a storageserver (Centos 6.4) with a dualport Intel 10G X520-2
Adapter.

A QSan P600Q-D316 Storage is configured with 8*SATA Drives raid 5 for
test, connected trought a Cisco UCS 6100 Series Fabric
Interconnect 10G Switch.

I formated the storage with ext4 defaults, one volume and got r/w rates
about 10MB/s some up to 40MB/s .... VERY POOR....

So we returned the storage to our dealer and they tested the hardware
and did some IO Meter Test with VMware ESXi 5.1 Server -> virtual
Windows 2k8-R2 on the Qsan Storage.

The VM did some r/w IO Meter Benchmark up to 1000 MB/Sec. Better.
Hardware looks o.k.

Than they installed a Windows 2k8-R2 server and attached the QSAN. The
r/w speed is about 400-500 MB/s.

After that the dealer installed a Centos 6.4 as I did and the r/w
performance is back to our results .... up to 40MB/s ....

What the hell? Are the default driver and settings so bad? I know and
researched a lot of tuning options like buffers, new drivers etc.

We did not check that for now, but are'nt there some defalut values and
settings which apply as well to be much faster?

Or in other words, are some realy simple hints and suggestions to

a) debug / find the bottleneck and

b) to increase the performance to the same level as windows?


	Thanks a lot for any help and feedback . G?tz


-- 
G?tz Reinicke
IT-Koordinator

Tel. +49 7141 969 82 420
Fax  +49 7141 969 55 420
E-Mail goetz.reinicke at filmakademie.de

Filmakademie Baden-W?rttemberg GmbH
Akademiehof 10
71638 Ludwigsburg
www.filmakademie.de

Eintragung Amtsgericht Stuttgart HRB 205016

Vorsitzender des Aufsichtsrats: J?rgen Walter MdL
Staatssekret?r im Ministerium f?r Wissenschaft,
Forschung und Kunst Baden-W?rttemberg

Gesch?ftsf?hrer: Prof. Thomas Schadt

From: G?tz Reinicke - IT Koordinator <goetz.reinicke at filmakademie.de>
> we have a storageserver (Centos 6.4) with a dualport Intel 10G X520-2
> Adapter.
> 
> A QSan P600Q-D316 Storage is configured with 8*SATA Drives raid 5 for
> test, connected trought a Cisco UCS 6100 Series Fabric
> Interconnect 10G Switch.
> 
> I formated the storage with ext4 defaults, one volume and got r/w rates
> about 10MB/s some up to 40MB/s .... VERY POOR....
Maybe have a look at:
?http://downloadmirror.intel.com/14687/eng/readme.txt
There are some performance tuning sections...

JD

Hi,

try installing the tuned package and using tuned-adm. Available performance
profiles include:

- enterprise-storage
- throughput-performance

You might get better results with one of these profiles applied.

-----Urspr?ngliche Nachricht-----
Von: centos-bounces at centos.org [mailto:centos-bounces at centos.org] Im
Auftrag
von G?tz Reinicke - IT Koordinator
Gesendet: Freitag, 27. September 2013 16:01
An: CentOS mailing list
Betreff: [CentOS] Intel 10G X520-2 and iscsi storage poor performance

Hi,

we have a storageserver (Centos 6.4) with a dualport Intel 10G X520-2
Adapter.

A QSan P600Q-D316 Storage is configured with 8*SATA Drives raid 5 for
test, connected trought a Cisco UCS 6100 Series Fabric
Interconnect 10G Switch.

I formated the storage with ext4 defaults, one volume and got r/w rates
about 10MB/s some up to 40MB/s .... VERY POOR....

So we returned the storage to our dealer and they tested the hardware
and did some IO Meter Test with VMware ESXi 5.1 Server -> virtual
Windows 2k8-R2 on the Qsan Storage.

The VM did some r/w IO Meter Benchmark up to 1000 MB/Sec. Better.
Hardware looks o.k.

Than they installed a Windows 2k8-R2 server and attached the QSAN. The
r/w speed is about 400-500 MB/s.

After that the dealer installed a Centos 6.4 as I did and the r/w
performance is back to our results .... up to 40MB/s ....

What the hell? Are the default driver and settings so bad? I know and
researched a lot of tuning options like buffers, new drivers etc.

We did not check that for now, but are'nt there some defalut values and
settings which apply as well to be much faster?

Or in other words, are some realy simple hints and suggestions to

a) debug / find the bottleneck and

b) to increase the performance to the same level as windows?


	Thanks a lot for any help and feedback . G?tz


-- 
G?tz Reinicke
IT-Koordinator

Tel. +49 7141 969 82 420
Fax  +49 7141 969 55 420
E-Mail goetz.reinicke at filmakademie.de

Filmakademie Baden-W?rttemberg GmbH
Akademiehof 10
71638 Ludwigsburg
www.filmakademie.de

Eintragung Amtsgericht Stuttgart HRB 205016

Vorsitzender des Aufsichtsrats: J?rgen Walter MdL
Staatssekret?r im Ministerium f?r Wissenschaft,
Forschung und Kunst Baden-W?rttemberg

Gesch?ftsf?hrer: Prof. Thomas Schadt