Gluster users - Sep 2016 - Fwd: Very slow performance when enabling tierd storage with SSD

Hello all,

I've discovered an issue in my lab that went unnoticed until recently, or
just came about with the latest Centos release.

When the SSD hot tier is enabled read from the volume is 2MB/s, after
detaching AND committing, read of the same file is at 150MB/s to /dev/null

If I copy the file to the hot bricks directly the write is 150MB/s and read
is 500MB/s on the first read, and then 4GB/s on the subsequent reads
(filesystem RAM caching)

Just enabling tier storage takes the performance to ~10-20IOPS and 2-10MB/s
even for local node mounted volume.

I don't see any major log issues and I detached and did a fix-layout, but
it persists when re-enabling the tier.
-------------- next part --------------
An HTML attachment was scrubbed...
URL:
<http://www.gluster.org/pipermail/gluster-users/attachments/20160901/3ba1a77a/attachment.html>

Hello all,

I've discovered an issue in my lab that went unnoticed until recently, or
just came about with the latest Centos release.

When the SSD hot tier is enabled read from the volume is 2MB/s, after
detaching AND committing, read of the same file is at 150MB/s to /dev/null

If I copy the file to the hot bricks directly the write is 150MB/s and read
is 500MB/s on the first read, and then 4GB/s on the subsequent reads
(filesystem RAM caching) to /dev/null

Just enabling tier storage takes the performance to ~10-20IOPS and 2-10MB/s
even for local node mounted volume.

I don't see any major log issues and I detached and did a fix-layout, but
it persists when re-enabling the tier.
-------------- next part --------------
An HTML attachment was scrubbed...
URL:
<http://www.gluster.org/pipermail/gluster-users/attachments/20160902/d038888a/attachment.html>