freebsd stable - Jun 2016 - mfi driver performance too bad on LSI MegaRAID SAS 9260-8i

On Fri, Jun 17, 2016, at 02:17, Jason Zhang wrote:
> Hi,
> 
> I am working on storage service based on FreeBSD.  I look forward to a
> good result because many professional storage company use FreeBSD as its
> OS.  But I am disappointed with the Bad performance.  I tested the the
> performance of LSI MegaRAID 9260-8i and had the following bad result:
> 
>   1.  Test environment:
>        (1) OS:   FreeBSD 10.0 release
10.0-RELEASE is no longer supported. Can you test this on 10.3-RELEASE?

Have you confirmed that both servers are using identical RAID controller
settings? It's possible the CentOS install has enabled write caching but
it's disabled on your FreeBSD server. Are you using UFS or ZFS on
FreeBSD? Do you have atime enabled? I believe CentOS is going to have
"relatime" or "nodiratime" by default to mitigate the write
penalty on
each read access.

We need more data :-)


-- 
  Mark Felder
  ports-secteam member
  feld at FreeBSD.org

Mark,

Thanks

We have same RAID setting both on FreeBSD and CentOS including cache setting. 
In FreeBSD, I enabled the write cache but the performance is the same.

We don?t use ZFS or UFS, and test the performance on the RAW GEOM disk ?mfidx?
exported by mfi driver.  We observed the ?gstat? result and found that the write
latency
is too high.  When we ?dd" the disk with 8k, it is lower than 1ms, but it
is 6ms on 64kb write.  It seems that each single write operation is very slow.
But I don?t know
whether it is a driver problem or not.


Jason

> ? 2016?6?22????12:36?Mark Felder <feld at FreeBSD.org> ???
> 
> 
> 
> On Fri, Jun 17, 2016, at 02:17, Jason Zhang wrote:
>> Hi,
>> 
>> I am working on storage service based on FreeBSD.  I look forward to a
>> good result because many professional storage company use FreeBSD as
its
>> OS.  But I am disappointed with the Bad performance.  I tested the the
>> performance of LSI MegaRAID 9260-8i and had the following bad result:
>> 
>>  1.  Test environment:
>>       (1) OS:   FreeBSD 10.0 release
> 
> 10.0-RELEASE is no longer supported. Can you test this on 10.3-RELEASE?
> 
> Have you confirmed that both servers are using identical RAID controller
> settings? It's possible the CentOS install has enabled write caching
but
> it's disabled on your FreeBSD server. Are you using UFS or ZFS on
> FreeBSD? Do you have atime enabled? I believe CentOS is going to have
> "relatime" or "nodiratime" by default to mitigate the
write penalty on
> each read access.
> 
> We need more data :-)
> 
> 
> -- 
>  Mark Felder
>  ports-secteam member
>  feld at FreeBSD.org