Nathan March
2011-Oct-19 22:51 UTC
[Xen-users] QOS for NFS backed disks / VM lags with high IO?
dm-ioband seems to be the generally accepted solution to implement disk bandwidth controls, but unless I''m misunderstanding it doesn''t seem possible to use this for nfs backed disks (netapp filer). Can someone point me in the direction of what I''m looking for here? Haven''t had any luck with google / lists to see what other people are using, is this even possible? Currently I''m able to cause lag spikes on all the DomU''s of a particular Dom0 by running bonnie++ inside one of them, I''d like to be able to put something in place that''ll keep a single DomU from saturating the storage. Alternatively if anyone knows what I''ve failed to tune to avoid this happening at all, that would be appreciated =) It doesn''t affect other Dom0''s and then netapp stats show low usage, so seems to be a nfs client issue.... nfsstat shows 0 retrans and I am using jumbo frames. Mounting with: rw,nosuid,noatime,nfsvers=3,tcp,rsize=32768,wsize=32768,bg,hard,intr Thanks, Nathan _______________________________________________ Xen-users mailing list Xen-users@lists.xensource.com http://lists.xensource.com/xen-users
Nathan March
2011-Oct-19 23:33 UTC
Re: [Xen-users] QOS for NFS backed disks / VM lags with high IO?
On 10/19/2011 3:51 PM, Nathan March wrote:> It doesn''t affect other Dom0''s and then netapp stats show low usage, > so seems to be a nfs client issue.... nfsstat shows 0 retrans and I am > using jumbo frames. > > Mounting with: > rw,nosuid,noatime,nfsvers=3,tcp,rsize=32768,wsize=32768,bg,hard,intrJust to add, I''ve cranked up the wmem/rmem buffers considerably with no improvement: net.core.rmem_default = 20971520 net.core.wmem_default = 20971520 net.core.rmem_max = 20971520 net.core.wmem_max = 20971520 net.ipv4.tcp_rmem = 4096 87380 20971520 net.ipv4.tcp_wmem = 4096 65536 20971520 net.ipv4.tcp_mem = 8388608 12582912 20971520 net.ipv4.udp_mem = 8388608 12582912 20971520 - Nathan _______________________________________________ Xen-users mailing list Xen-users@lists.xensource.com http://lists.xensource.com/xen-users