Hello, I'm a bit desperate so I'm trying to seek help here. Many year ago, I built myself 2 file servers (5 disks enclosure for data, 2 disks enclosure for the OS) on a computer. It was running on Debian 7.11 for years without an issue and I was getting 75MB/95MB when transferring file from it to a Windows client, all having a 1gbs network card. https://i.ibb.co/N618Z4W/Debian-7.png However, after upgrading to Debian 8 and more recently Debian 11, I keep noticing a? huge performance drop. The near 100 MB drop to a roller coaster of between 25MB and 60 MB/S, the average being 40 MB/S I've been googling trying various 'performance' tweak', but nothing seem to work as expected. https://i.ibb.co/RPjbMKV/Debian-10-Tweaks.png https://i.ibb.co/mqwZtgR/Debian-10-No-Tweaks.png The latest bloc of 'performance' setting were those: # Settings to enhance performance: strict locking = no read raw = yes write raw = yes oplocks = yes max xmit = 65535 deadtime = 15 getwd cache = yes socket options = TCP_NODELAY SO_SNDBUF=128480 SO_RCVBUF=128480 max protocol = SMB2 # End of performance section I've also tried an empty smb.conf file to fallback to default. Nothing seem to work. Spec of the current machine: CPU: Intel(R) Core(TM)2 CPU 6600 @ 2.40GHz RAM: 2 GB Ethernet controller: Qualcomm Atheros AR8121/AR8113/AR8114 Gigabit or Fast Ethernet (rev b0) SATA controller: Marvell Technology Group Ltd. Device 9215 (rev 11) I know this isn't my machine though, as I can rsync at the same speed on both version of the OS. Debian 7 sent 7,962 bytes received 4,467,150,861 bytes 81,966,216.94 bytes/sec total size is 4,466,564,278 speedup is 1.00 Debian 11 sent 8,574 bytes received 4,467,697,711 bytes 80,499,212.34 bytes/sec total size is 4,466,564,278 speedup is 1.00 Anyone have any idea why such a speed drop? What default config could be triggering this drop? All point out to the upgrade from Samba 3 to Samba 4, the lastest being tested being 4.9.5-Debian I'm only interested in the File sharing of Samba. I have no need for any of the Active Directory addition added in Samba 4 that may have introduced this performance hit. Any help on what to do to fix this would be greatly appreciated. Thanks
Rowland penny
2020-Jul-20 13:10 UTC
[Samba] Performance issues since upgrading to 3.X to 4.X
On 20/07/2020 14:02, Dragoniade via samba wrote:> Hello, > I'm a bit desperate so I'm trying to seek help here. > > Many year ago, I built myself 2 file servers (5 disks enclosure for > data, 2 disks enclosure for the OS) on a computer. > It was running on Debian 7.11 for years without an issue and I was > getting 75MB/95MB when transferring file from it to a Windows client, > all having a 1gbs network card. > https://i.ibb.co/N618Z4W/Debian-7.png > > However, after upgrading to Debian 8 and more recently Debian 11, I > keep noticing a? huge performance drop. > The near 100 MB drop to a roller coaster of between 25MB and 60 MB/S, > the average being 40 MB/S > > > I've been googling trying various 'performance' tweak', but nothing > seem to work as expected. > https://i.ibb.co/RPjbMKV/Debian-10-Tweaks.png > https://i.ibb.co/mqwZtgR/Debian-10-No-Tweaks.png > > The latest bloc of 'performance' setting were those: > # Settings to enhance performance: > strict locking = no > read raw = yes > write raw = yes > oplocks = yes > max xmit = 65535 > deadtime = 15 > getwd cache = yes > socket options = TCP_NODELAY SO_SNDBUF=128480 SO_RCVBUF=128480 > max protocol = SMB2 > # End of performance section > > > I've also tried an empty smb.conf file to fallback to default. Nothing > seem to work. > > Spec of the current machine: > CPU: Intel(R) Core(TM)2 CPU 6600 @ 2.40GHz > RAM: 2 GB > Ethernet controller: Qualcomm Atheros AR8121/AR8113/AR8114 Gigabit or > Fast Ethernet (rev b0) > SATA controller: Marvell Technology Group Ltd. Device 9215 (rev 11) > > I know this isn't my machine though, as I can rsync at the same speed > on both version of the OS. > Debian 7 > sent 7,962 bytes received 4,467,150,861 bytes 81,966,216.94 bytes/sec > total size is 4,466,564,278 speedup is 1.00 > > Debian 11 > sent 8,574 bytes received 4,467,697,711 bytes 80,499,212.34 bytes/sec > total size is 4,466,564,278 speedup is 1.00 > > > Anyone have any idea why such a speed drop? What default config could > be triggering this drop? > All point out to the upgrade from Samba 3 to Samba 4, the lastest > being tested being 4.9.5-Debian > I'm only interested in the File sharing of Samba. I have no need for > any of the Active Directory addition added in Samba 4 that may have > introduced this performance hit. > > Any help on what to do to fix this would be greatly appreciated. > > Thanks > > > >Can we see your entire smb.conf, not just part of it ? Rowland
L.P.H. van Belle
2020-Jul-20 13:15 UTC
[Samba] Performance issues since upgrading to 3.X to 4.X
Debian 10 or 11? 11 = testing and samba 4.12.5 10 = buster and samba 4.9.5 Also show smb.conf. Im running 4.12.5 on my home media device, and always 110MB/s copy speeds on my gigabit nic. (same as the 4.11 or 4.10 or 4.9 or 4.8 versions) Can you show your smb.conf? And running kernel version.> https://i.ibb.co/N618Z4W/Debian-7.pngIs a bit speculative. If .. i copy 1 file of 1GB to a share with a disk formated with 4Kb sectors its slower then i.. copy 1 file of 1GB to a share with a disk formated with 4Mb sectors. So first we like to see smb.conf, that will help us. Greetz, Louis> -----Oorspronkelijk bericht----- > Van: samba [mailto:samba-bounces at lists.samba.org] Namens > Dragoniade via samba > Verzonden: maandag 20 juli 2020 15:03 > Aan: samba at lists.samba.org > Onderwerp: [Samba] Performance issues since upgrading to 3.X to 4.X > > Hello, > I'm a bit desperate so I'm trying to seek help here. > > Many year ago, I built myself 2 file servers (5 disks enclosure for > data, 2 disks enclosure for the OS) on a computer. > It was running on Debian 7.11 for years without an issue and I was > getting 75MB/95MB when transferring file from it to a Windows client, > all having a 1gbs network card. > https://i.ibb.co/N618Z4W/Debian-7.png > > However, after upgrading to Debian 8 and more recently Debian > 11, I keep > noticing a? huge performance drop. > The near 100 MB drop to a roller coaster of between 25MB and 60 MB/S, > the average being 40 MB/S > > > I've been googling trying various 'performance' tweak', but > nothing seem > to work as expected. > https://i.ibb.co/RPjbMKV/Debian-10-Tweaks.png > https://i.ibb.co/mqwZtgR/Debian-10-No-Tweaks.png > > The latest bloc of 'performance' setting were those: > # Settings to enhance performance: > strict locking = no > read raw = yes > write raw = yes > oplocks = yes > max xmit = 65535 > deadtime = 15 > getwd cache = yes > socket options = TCP_NODELAY SO_SNDBUF=128480 SO_RCVBUF=128480 > max protocol = SMB2 > # End of performance section > > > I've also tried an empty smb.conf file to fallback to > default. Nothing > seem to work. > > Spec of the current machine: > CPU: Intel(R) Core(TM)2 CPU 6600 @ 2.40GHz > RAM: 2 GB > Ethernet controller: Qualcomm Atheros AR8121/AR8113/AR8114 Gigabit or > Fast Ethernet (rev b0) > SATA controller: Marvell Technology Group Ltd. Device 9215 (rev 11) > > I know this isn't my machine though, as I can rsync at the > same speed on > both version of the OS. > Debian 7 > sent 7,962 bytes received 4,467,150,861 bytes 81,966,216.94 bytes/sec > total size is 4,466,564,278 speedup is 1.00 > > Debian 11 > sent 8,574 bytes received 4,467,697,711 bytes 80,499,212.34 bytes/sec > total size is 4,466,564,278 speedup is 1.00 > > > Anyone have any idea why such a speed drop? What default > config could be > triggering this drop? > All point out to the upgrade from Samba 3 to Samba 4, the > lastest being > tested being 4.9.5-Debian > I'm only interested in the File sharing of Samba. I have no > need for any > of the Active Directory addition added in Samba 4 that may have > introduced this performance hit. > > Any help on what to do to fix this would be greatly appreciated. > > Thanks > > > > > -- > To unsubscribe from this list go to the following URL and read the > instructions: https://lists.samba.org/mailman/options/samba > >
L.P.H. van Belle
2020-Jul-20 13:53 UTC
[Samba] Performance issues since upgrading to 3.X to 4.X
Pretty close to what i have that : [global] workgroup = PRIVATE server string = %h server log file = /var/log/samba/log.%m max log size = 1000 log level = 0 ####### Authentication ####### ## stand alone everything open. security = user guest ok = yes map to guest = bad password ## map id's outside to domain to tdb files. idmap config * : backend = tdb idmap config BUILTIN : range = 3000-3999 ####### ## Printing disabled. load printers = no printing = bsd printcap name = /dev/null disable spoolss = yes Im using Kodi with above, this is running since ubuntu 12.04, upgraded every lts, now 20.04 Always full speed with copying. Yours,> [global] > ?? workgroup = DRAGONLAIR > ?? server string = Samba Server > ?? server role = standalone server < remove > ?? log file = /usr/local/samba/var/log.%m << that looks like a self compiled Samba install path, i suggest correct it. > ?? max log size = 50 > ?? server signing = disabled < remove > ?? server services = smb < remove > ?? dns proxy = noAnd try again. Greetz, Louis> -----Oorspronkelijk bericht----- > Van: Dragoniade [mailto:dragoniade0 at gmail.com] > Verzonden: maandag 20 juli 2020 15:41 > Aan: L.P.H. van Belle > Onderwerp: Re: [Samba] Performance issues since upgrading to > 3.X to 4.X > > My bad, typo copying the data. > > Debian 7.11? vs Debian 10 > > > Here is the 'current' smb.conf. > > The current one was taken from the smb.conf.default.gz as the > fix posted > previously didn't make change, and someone? mentioned some config may > not have liked the upgrade. > > As for sector size, > The same machine with the same disk perform differently > between samba 3 > and samba 4. > I get 100% performance on rsync. > I also get the same drop on Centos 8.1 than Debian 10 (both samba 4) > > Philippe > > =======================================> [global] > ?? workgroup = DRAGONLAIR > ?? server string = Samba Server > ?? server role = standalone server > ?? log file = /usr/local/samba/var/log.%m > ?? max log size = 50 > ?? server signing = disabled > ?? server services = smb > ?? dns proxy = no > > [myuser] > ??????? path = /home/myuser > ??????? invalid users = root > ??????? valid users = myuser > ??????? read only = no > > [virtualbox] > ??????? path = /home/virtualbox > ??????? invalid users = root > ??????? valid users = myuser > ??????? read only = no > > [Video] > ??????? path = /vol0/Video > ??????? invalid users = root > ??????? valid users = myuser > ??????? read only = no > > [Episodes] > ??????? path = /vol0/Episodes > ??????? invalid users = root > ??????? valid users = myuser > ??????? read only = no > > [Vol0] > ??????? path = /vol0 > ??????? invalid users = root > ??????? valid users = myuser > ??????? read only = no > > [Vol1] > ??????? path = /vol1 > ??????? invalid users = root > ??????? valid users = myuser > ??????? read only = no > > [Vol2] > ??????? path = /vol2 > ??????? invalid users = root > ??????? valid users = myuser > ??????? read only = no > > [Vol3] > ??????? path = /vol3 > ??????? invalid users = root > ??????? valid users = myuser > ??????? read only = no > > [Vol4] > ??????? path = /vol4 > ??????? invalid users = root > ??????? valid users = myuser > ??????? read only = no > > > [Vol9] > ??????? path = /vol9 > ??????? invalid users = root > ??????? valid users = myuser > ??????? read only = no > [VolP] > ??????? path = /volP > ??????? invalid users = root > ??????? valid users = myuser > ??????? read only = no > > [backup] > ??????? path = /mnt/backup > ??????? invalid users = root > ??????? valid users = myuser > ================================================> > On 2020-07-20 09:15, L.P.H. van Belle via samba wrote: > > Debian 10 or 11? > > 11 = testing and samba 4.12.5 > > 10 = buster and samba 4.9.5 > > > > Also show smb.conf. > > Im running 4.12.5 on my home media device, and always > 110MB/s copy speeds on my gigabit nic. > > (same as the 4.11 or 4.10 or 4.9 or 4.8 versions) > > > > Can you show your smb.conf? And running kernel version. > > > >> https://i.ibb.co/N618Z4W/Debian-7.png > > Is a bit speculative. > > > > If .. > > i copy 1 file of 1GB to a share with a disk formated with > 4Kb sectors its slower then i.. > > copy 1 file of 1GB to a share with a disk formated with > 4Mb sectors. > > > > So first we like to see smb.conf, that will help us. > > > > Greetz, > > > > Louis > > > > > > > >> -----Oorspronkelijk bericht----- > >> Van: samba [mailto:samba-bounces at lists.samba.org] Namens > >> Dragoniade via samba > >> Verzonden: maandag 20 juli 2020 15:03 > >> Aan: samba at lists.samba.org > >> Onderwerp: [Samba] Performance issues since upgrading to 3.X to 4.X > >> > >> Hello, > >> I'm a bit desperate so I'm trying to seek help here. > >> > >> Many year ago, I built myself 2 file servers (5 disks enclosure for > >> data, 2 disks enclosure for the OS) on a computer. > >> It was running on 7Debian 7.11 for years without an issue and I was > >> getting 75MB/95MB when transferring file from it to a > Windows client, > >> all having a 1gbs network card. > >> https://i.ibb.co/N618Z4W/Debian-7.png > >> > >> However, after upgrading to Debian 8 and more recently Debian > >> 11, I keep > >> noticing a? huge performance drop. > >> The near 100 MB drop to a roller coaster of between 25MB > and 60 MB/S, > >> the average being 40 MB/S > >> > >> > >> I've been googling trying various 'performance' tweak', but > >> nothing seem > >> to work as expected. > >> https://i.ibb.co/RPjbMKV/Debian-10-Tweaks.png > >> https://i.ibb.co/mqwZtgR/Debian-10-No-Tweaks.png > >> > >> The latest bloc of 'performance' setting were those: > >> # Settings to enhance performance: > >> strict locking = no > >> read raw = yes > >> write raw = yes > >> oplocks = yes > >> max xmit = 65535 > >> deadtime = 15 > >> getwd cache = yes > >> socket options = TCP_NODELAY SO_SNDBUF=128480 SO_RCVBUF=128480 > >> max protocol = SMB2 > >> # End of performance section > >> > >> > >> I've also tried an empty smb.conf file to fallback to > >> default. Nothing > >> seem to work. > >> > >> Spec of the current machine: > >> CPU: Intel(R) Core(TM)2 CPU 6600 @ 2.40GHz > >> RAM: 2 GB > >> Ethernet controller: Qualcomm Atheros AR8121/AR8113/AR8114 > Gigabit or > >> Fast Ethernet (rev b0) > >> SATA controller: Marvell Technology Group Ltd. Device 9215 (rev 11) > >> > >> I know this isn't my machine though, as I can rsync at the > >> same speed on > >> both version of the OS. > >> Debian 7 > >> sent 7,962 bytes received 4,467,150,861 bytes > 81,966,216.94 bytes/sec > >> total size is 4,466,564,278 speedup is 1.00 > >> > >> Debian 11 > >> sent 8,574 bytes received 4,467,697,711 bytes > 80,499,212.34 bytes/sec > >> total size is 4,466,564,278 speedup is 1.00 > >> > >> > >> Anyone have any idea why such a speed drop? What default > >> config could be > >> triggering this drop? > >> All point out to the upgrade from Samba 3 to Samba 4, the > >> lastest being > >> tested being 4.9.5-Debian > >> I'm only interested in the File sharing of Samba. I have no > >> need for any > >> of the Active Directory addition added in Samba 4 that may have > >> introduced this performance hit. > >> > >> Any help on what to do to fix this would be greatly appreciated. > >> > >> Thanks > >> > >> > >> > >> > >> -- > >> To unsubscribe from this list go to the following URL and read the > >> instructions: https://lists.samba.org/mailman/options/samba > >> > >> > > > >
Andreas Schneider
2020-Jul-23 08:19 UTC
[Samba] Performance issues since upgrading to 3.X to 4.X
On Monday, 20 July 2020 15:02:30 CEST Dragoniade via samba wrote:> The latest bloc of 'performance' setting were those: > # Settings to enhance performance: > strict locking = no > read raw = yes > write raw = yes > oplocks = yes > max xmit = 65535 > deadtime = 15 > getwd cache = yes > socket options = TCP_NODELAY SO_SNDBUF=128480 SO_RCVBUF=128480 > max protocol = SMB2 > # End of performance sectionTake a look at https://wiki.samba.org/index.php/Performance_Tuning for performance tuning and DO NOT set socket options! Especially the SO_(RCV| SND)BUF options are doing the opposite. 'testparm -s' is your friend for a working smb.conf file! Also you should provide a complete output of 'testparm -s' or we can't really help. If you have a modern Linux version configure the vfs_io_uring module -> 'man vfs_io_uring' -- Andreas Schneider asn at samba.org Samba Team www.samba.org GPG-ID: 8DFF53E18F2ABC8D8F3C92237EE0FC4DCC014E3D