Hi, we are running samba 4.4 on two machines as file servers. Both are running a GFS (stornext). The storage is attached using 8G HBA. You can get up to 800MB/s local speed. We are exporting the shares using 2x1GB and 2x10G. However the clients are only getting 40-50MB/s. With samba3 I think we had up to 80-90MB/s. Using a 100MB/s link for the client we see 12-13MB/s (wire speed). Using NFS (3) we see up to 120MB/s (GB). How can we improve the speed ? How can we find the bottle neck ? (I tested already various samba versions (4.4{5,6}) without any success. -- Bye, Peer ________________________________________________________ Max-Planck-Institut für Biogeochemie Dr. Peer-Joachim Koch Hans-Knöll Str.10 Telefon: ++49 3641 57-6705 D-07745 Jena Telefax: ++49 3641 57-7705
Hello, is your scenario possibly using Windows SMB2 clients and a large/huge number of small files per directory? If so, please have a look here and see whether my issue might apply for you as well: https://lists.samba.org/archive/samba-technical/2017-October/123611.html Hope this helps & best regards Andreas Am 02.11.2017 um 14:05 schrieb Dr. Peer-Joachim Koch via samba:> Hi, > > we are running samba 4.4 on two machines as file servers. > Both are running a GFS (stornext). The storage is attached using 8G HBA. > You can get up to 800MB/s local speed. We are exporting the shares > using 2x1GB > and 2x10G. However the clients are only getting 40-50MB/s. With samba3 > I think we had up to 80-90MB/s. > Using a 100MB/s link for the client we see 12-13MB/s (wire speed). > Using NFS (3) we see up to 120MB/s (GB). How can we improve the speed ? > How can we find the bottle neck ? (I tested already various samba > versions (4.4{5,6}) without > any success.
On Thu, Nov 02, 2017 at 02:05:18PM +0100, Dr. Peer-Joachim Koch via samba wrote:> Hi, > > > we are running samba 4.4 on two machines as file servers. > > Both are running a GFS (stornext). The storage is attached using 8G HBA. > > You can get up to 800MB/s local speed. We are exporting the shares > using 2x1GB > > and 2x10G. However the clients are only getting 40-50MB/s. With > samba3 I think we had up to 80-90MB/s. > > Using a 100MB/s link for the client we see 12-13MB/s (wire speed). > > Using NFS (3) we see up to 120MB/s (GB). How can we improve the speed ? > > How can we find the bottle neck ? (I tested already various samba > versions (4.4{5,6}) without > > any success.What clients ? What protocol are they using ? What is your smb.conf. These are some basics we'll need to proceed.
On Thu, Nov 02, 2017 at 06:57:21PM +0100, awl1 via samba wrote:> Hello, > > is your scenario possibly using Windows SMB2 clients and a > large/huge number of small files per directory? If so, please have a > look here and see whether my issue might apply for you as well: > > https://lists.samba.org/archive/samba-technical/2017-October/123611.html > > Hope this helps & best regards > Andreas > > Am 02.11.2017 um 14:05 schrieb Dr. Peer-Joachim Koch via samba: > >Hi, > > > >we are running samba 4.4 on two machines as file servers. > >Both are running a GFS (stornext). The storage is attached using 8G HBA. > >You can get up to 800MB/s local speed. We are exporting the shares > >using 2x1GB > >and 2x10G. However the clients are only getting 40-50MB/s. With > >samba3 I think we had up to 80-90MB/s. > >Using a 100MB/s link for the client we see 12-13MB/s (wire speed). > >Using NFS (3) we see up to 120MB/s (GB). How can we improve the speed ? > >How can we find the bottle neck ? (I tested already various samba > >versions (4.4{5,6}) without > >any success.Doesn't sound like a copy issue, more a raw read/write one.
On 02.11.2017 18:57, Jeremy Allison via samba wrote:> On Thu, Nov 02, 2017 at 02:05:18PM +0100, Dr. Peer-Joachim Koch via samba wrote: >> Hi, >> >> >> we are running samba 4.4 on two machines as file servers. >> >> Both are running a GFS (stornext). The storage is attached using 8G HBA. >> >> You can get up to 800MB/s local speed. We are exporting the shares >> using 2x1GB >> >> and 2x10G. However the clients are only getting 40-50MB/s. With >> samba3 I think we had up to 80-90MB/s. >> >> Using a 100MB/s link for the client we see 12-13MB/s (wire speed). >> >> Using NFS (3) we see up to 120MB/s (GB). How can we improve the speed ? >> >> How can we find the bottle neck ? (I tested already various samba >> versions (4.4{5,6}) without >> >> any success. > What clients ? What protocol are they using ? What is your > smb.conf. These are some basics we'll need to proceed. >Hi, sorry for the missing information's. Most of the clients are windows 7, we still have also some older windows versions. Also all kind of MAC (10.6-12) is in use. I did all measurements using a windows 7 system (dual boot linux). The folder I used contains only 50 ISO-files. I copied one ISO (2.5GB) multiple times (3-5) in both directions. We have two different samba setups, one we created(A) which was a little bit modified from Björn Jacke when we moved our domain to samba4. The second one is from a appliance (Quantum so called work flow extender(WFE)-(B)). This system is preconfigured from quantum. Both setups are showing for large files the same (bad) performance (40-50MB/s). smb.conf (A) running on SuSE SLES 11 SP2 (sernet-samba-4.4.14-40) [global] workgroup = BGC client ldap sasl wrapping = sign server string = DVA. BGC New SNFS Fileserver for Group folders (Minerva) interfaces = lo bond0:min security = ads load printers = No show add printer wizard = No log level = 4 winbind:5 printcap cache time = 0 map to guest = Bad User log file = /var/log/samba/%I.log read only = no max disk size = 4194300 idmap config BGC : backend = ad idmap config BGC : range = 100-999999 idmap config * : backend = tdb idmap config * : range = 1000000-1999999 smb.conf (B) running CENTOS 6.6 (sernet-samba-4.2.12-20) [global] workgroup = BGC server string = "Quantum Appliance Controller" security = ads password server = * passdb backend = tdbsam template shell = /bin/bash template homedir = /home/%u winbind separator = + local master = no domain master = no auth methods = guest sam_ignoredomain winbind guest ok = no winbind use default domain = yes allow trusted domains = yes winbind enum users = no winbind enum groups = no winbind nss info = template winbind nested groups = yes idmap config BGC : backend = ad idmap config BGC : default = yes idmap config BGC : range = 100-33554431 idmap config BGC : schema_mode = rfc2307 idmap config * : range = 33554432-67108862 idmap config * : backend = tdb printing = bsd load printers = no disable spoolss = yes printcap name = /dev/null log level = 1 log file = /var/log/samba/samba.log.%m debug timestamp = yes oplocks = 1 unix extensions = yes smb ports = 445, 139 mangled names = yes default case = lower preserve case = yes short preserve case = yes enable core files = no winbind max clients = 1000 winbind request timeout = 60 bind interfaces only = yes case sensitive = auto What else would be helpfull ? Thanks a lot! -- Bye, Peer ________________________________________________________ Max-Planck-Institut für Biogeochemie Dr. Peer-Joachim Koch Hans-Knöll Str.10 Telefon: ++49 3641 57-6705 D-07745 Jena Telefax: ++49 3641 57-7705