We are currently shooting in the dark...If possible update the Firmware of the
NICs and FW of the switch .
Have you tried if other systems (on the same switch) have issues with the Jumbo
Frames ?
Best Regards,Strahil Nikolov?
Yes, i did test the ping with a jumbo frame mtu and it worked without
problems. There is no firewall between the storage nodes and the
hypervisors. They are using the same layer 2 subnet, so there is only
the switch in between. On the switch jumbo frames for the specific wlan
is enabled.
I also increased the tx and rx queue length, without succes in relation
to the problem.
Am 17.09.2022 10:39 schrieb Strahil Nikolov:> Usually that kind of problems could be on many places.
> When you set the MTU to 9000, did you test with ping and the "Do not
> fragment" Flag ?
>
> If there is a device on the path that is not configured (or doesn't
> support MTU9000) , it will fragment all packets and that could lead to
> excessive device CPU consumption. I have seen many firewalls to not
> use JF by default.
>
> ping <IP/HOSTNAME from brick definition> -M do -s 8972
>
> Best Regards,
> Strahil Nikolov
>
>? ? ?????, 16 ????????? 2022 ?., 22:24:14 ?.
> ???????+3, Gionatan Danti <g.danti at assyoma.it> ??????:
>
> Il 2022-09-16 18:41 dpgluster at posteo.de ha scritto:
>> I have made extensive load tests in the last few days and figured
> out
>> it's definitely a network related issue. I changed from jumbo
frames
>> (mtu 9000) to default mtu of 1500. With a mtu of 1500 the problem
>> doesn't occur. I'm able to bump the io-wait of our gluster
storage
>> servers to the max possible values of the disks without any error or
>> connection loss between the hypervisors or the storage nodes.
>>
>> As mentioned in multiple gluster best practices it's recommended to
>> use jumbo frames in gluster setups for better performance. So I
> would
>> like to use jumbo frames in my datacenter.
>>
>> What could be the issue here?
>
> I would try with a jumbo frame setting of 4074 (or 4088) bytes.
>
> Regards.
>
> --
> Danti Gionatan
> Supporto Tecnico
> Assyoma S.r.l. - www.assyoma.it
> email: g.danti at assyoma.it - info at assyoma.it
> GPG public key ID: FF5F32A8
-------------- next part --------------
An HTML attachment was scrubbed...
URL:
<http://lists.gluster.org/pipermail/gluster-users/attachments/20220918/afd065c8/attachment.html>