The Mellanox ConnectX-4 does not seem to load any firmware looking at dmesg.?
I upgraded the firmware on the card on Server2 (that is what I'll call it)
so
that it matches what was on Server1.? Server2 multichannel still works.? I
removed the 802.3ad LACP on Server1 (and removed the config in the switch) and
set up both NICs to have an IP on the same subnet.? Multichannel still does
not work.? I went into the BIOS on Server1 and nothing stood out as a problem
preventing multichannel.? I upgraded Server2 to 4.15rc2 so everything matches
as closely as possible to Server1.
Does Samba do any kind of logging for multichannel?? I have logging turned up
to 10 and all I see is is the option " oing parameter server multi channel
support = yes" and nothing else.? How does one debug why Samba is not using
multichannel when it's enabled?
I'm actually having to work on my vacation right now to try and solve this
as
we need it working this Tuesday for our project.? I'm frustrated right now
as
I cannot see why this is not working.
BTW, even though I'm frustrated, I very much appreciate the help being
provided.
??? Chris
On 8/18/21 7:20 AM, Chris Dos via samba wrote:> I'll check to make sure the card is not loading any firmware and if so,
I
> normally update to the latest firmware packages provided by kernel.org.
>
> The server that is working only seems to be working on the 100G interface
and
> not on a 1G on a different network.? So something is still not right.? It
> almost seems like it's voodoo right now when it does work.? :)
>
> ??? Chris
>
>
> On 8/18/21 6:45 AM, L.P.H. van Belle via samba wrote:
>> Hai Chris,
>>
>>> -----Oorspronkelijk bericht-----
>>> Van: samba [mailto:samba-bounces at lists.samba.org] Namens
>>> Chris Dos via samba
>>> Verzonden: woensdag 18 augustus 2021 14:17
>>> Aan: samba at lists.samba.org
>>> Onderwerp: Re: [Samba] Multichannel and RSS Not Detected
>>>
>>> I was digging into the difference between the servers again
>>> and I noticed some other difference.?
>>>
>>> I had upgraded the firmware a couple of months ago on the
>>> Supermicro Mellanox card (had to get the firmware from Supermicro)
that is in the
>>> server that is not working.? I'm also running the Mellanox
driver itself on
>>> the server that is not working.?
>> Well, after you did this, did you check for new firmware packages for
debian also.
>> These might be out of sync.
>>
>> dpkg -l |grep firmware
>> I dont know if linux is also loading firmware, but check that, should
be somewhere in the bootlog/dmesg output.
>> If thats the case, i would look in : packages.debian.org if the current
firmware is available in newer packages.
>>
>>> Both of these servers are multi-homed and are connected to three
different
>>> networks.? I discovered this morning that when looking at the
server that is
>>> working on the storage interface, that multichannel is not working
on the
>>> internal interface which is using a different NIC.? So there is
another piece
>>> added to this puzzle.? You gave an example to disable offloading of
the NICs.?
>>> Is that required for multichannel/RSS to work?
>> I dont think its required.
>>
>> I would start here with newer kernel and linux firmwares.
>>
https://packages.debian.org/search?suite=buster-backports§ion=all&arch=any&searchon=names&keywords=linux-image-5.10
>>
>>
https://packages.debian.org/search?suite=buster§ion=all&arch=any&searchon=names&keywords=firmware-linux
>> And possible the "specific firmwares"
>> ( like i use : firmware-bnx2 )
>>
>> Cant help much beside above, i hope i gave you some ideas where to look
at.
>>
>>
>> Greetz,
>>
>> Louis
>>
>>
>>> ??? Chris
>>>
>>> On 8/17/21 8:28 AM, L.P.H. van Belle via samba wrote:
>>>> On the virtual hosts and possible guest..
>>>> Did you check if there not any problem with drivers and
>>> possible offloading of the nics..
>>>> I use XenServer, so thats the example i can give.
>>>>
>>>>
>>> https://github.com/cloudnull/XenServer-Offloading-Off/blob/mas
>> ter/offloadingoff.sh
>>>> But which one does work now?
>>>> You didnt tell that. :-(
>>>>
>>>> Greetz,
>>>>
>>>> Louis
>>> --
>>> To unsubscribe from this list go to the following URL and read the
>>> instructions: https://lists.samba.org/mailman/options/samba
>>>
>>>