Knut Krüger
2018-Apr-21 06:30 UTC
[Samba] What is the maximum speed for download from a samba share
> Limiting the linux-server's max cpu-speed had > the most affect on performance: > (limited to 1.6GHz instead of 2.4GHz) (33% limitation)The server is equipped with an 6 core / 12 tread 3.6 GHz CPU (Intel Core i7-980x and a Raid 10 Disk array. The cpu is 90% idle (including webserver traffic and mailserver traffic) during downloads. There is no encryption because the samba VM it is over vpn (I get fulls speed with FTP over VPN) For the rest I will test your hints. Kind Regards Knut
L A Walsh
2018-Apr-22 02:30 UTC
[Samba] What is the maximum speed for download from a samba share
Knut Krüger via samba wrote:>> Limiting the linux-server's max cpu-speed had >> the most affect on performance: >> (limited to 1.6GHz instead of 2.4GHz) (33% limitation) >> > The server is equipped with an 6 core / 12 tread 3.6 GHz CPU (Intel Core > i7-980x and a Raid 10 Disk array. > The cpu is 90% idle (including webserver traffic and mailserver traffic) > during downloads. >--- In protocols before cifsV3, only 1 tcp connection was allowed between a user at workstation and a server. So multi-cores make no difference. When you say "the cpu is 90% idle", you realize that means 10% busy. 10% * 12 cores = 1.2 cores busy. That may imply one core is "pegged". Though it sounds unlikely even with a 100Mb network that your cpu is the problem. For my testing, I run my test script on cygwin and "cd" to my home directory on the server (/h) where my test "files" (character devices) are located (/h/zero and /h/null) From there I usually run it with "bin/iotest". I'll attach the bash script. If you find it of any use, great! else, ignore it. My linux-box has bash-4.4 on it and is currently using a 4.14.0 kernel. Good luck...don't want to overwhelm, so I'll end here. -------------- next part -------------- An embedded and charset-unspecified text was scrubbed... Name: iotest URL: <http://lists.samba.org/pipermail/samba/attachments/20180421/bf26f9b0/iotest.ksh>
Knut Krüger
2018-Apr-25 06:28 UTC
[Samba] Speedup windows client [was] What is the maximum speed for download from a samba share
Am 22.04.2018 um 04:30 schrieb L A Walsh via samba:> Knut Krüger via samba wrote: >>> Limiting the linux-server's max cpu-speed had >>> the most affect on performance: >>> (limited to 1.6GHz instead of 2.4GHz) (33% limitation) >> The server is equipped with an 6 core / 12 tread 3.6 GHz CPU (Intel >> Core i7-980x and a Raid 10 Disk array. >> The cpu is 90% idle (including webserver traffic and mailserver >> traffic) during downloads. > --- > In protocols before cifsV3, only 1 tcp connection was allowed between > a user at workstation and a server. So multi-cores make no difference.Ok this clarifies why two downloads are getting more bandwidth than 1> > When you say "the cpu is 90% idle", you realize that means 10% > busy. 10% * 12 cores = 1.2 cores busy. That may imply one > core is "pegged". Though it sounds unlikely even with a 100Mb > network that your cpu is the problem.To clarify the setup The root server is the 6 core/12 tread machine. it is an stretch proxmox installation this machine is minimum 90% idle one of the virtual machine is the samba VM connected via VPN Looking to the cpu usage of this VM ist nearly zero during downloads. There is no difference wehter the VM gets 1 ore more cores or changing the CPU limit. /CPU Limit us unlimited doing some additional test, it seems that a part of the speed lag is client depending. 4 core client with Linux is about 25.000 Kbits Lenovo Thinkpad T520 with Windows 7 is the worst client (unfortunately the most important) with 750 kbits/sec :-( So as a first step (as it is really important) i have to speed up the windows client. Any hints? After that I will try to speedup the server. Kind regards Knut> > For my testing, I run my test script on cygwin and > "cd" to my home directory on the server (/h) where my > test "files" (character devices) are located (/h/zero and /h/null) > > From there I usually run it with "bin/iotest". I'll attach > the bash script. If you find it of any use, great! else, ignore it. > My linux-box has bash-4.4 on it and is currently using a 4.14.0 kernel. > > Good luck...don't want to overwhelm, so I'll end here. > > >
L.P.H. van Belle
2018-Apr-25 07:56 UTC
[Samba] Speedup windows client [was] What is the maximum speed for download from a samba share
As counter example. My slowest server, AMD E350 2 core, max 1.6Gz. On 1Gb lan, disk 2x 5400rpm software raid 1 + 1 ssd. Copy Speed 115Mb/s as in max 1Gb bandwith, from a win7 and win10 pc to the raid1. File sizes. 100Mb+ get max 115Mb/s to a 4MB blocksized partition. 1-10mb files ,max 90-115Mb/s to a 1MB blocksized partition. 0.0-1mb files ,max 60-100Mb/s to a 4k blocksized partition. I get these speeds while im watching my kodi. ;-) Samba 4.6.x on ubuntu 17.10 One note here, i use kernel 4.16.1 from http://kernel.ubuntu.com/~kernel-ppa/mainline/?C=M;O=D Thats mostly for kodi and the amd GPU driver, but i do notice bit better perfomance with these higher kernels. Is the Lenovo Thinkpad T520 with Windows 7, connecting over Wifi? Because on wifi, even if i set my laptop 3 meters from the AP, i dont get max. About 1/2 the speeds, if lucky 3/4 the above speeds. Test you wifi with inSSIDer, optimze the chanels. Gave me about +25% speed at home on the wifi.> one of the virtual machine is the samba VM connected via VPN > Looking to the cpu usage of this VM ist nearly zero during downloads.Did you tweak your MTU sizes? With things like : iptables -A PREROUTING --match policy --pol ipsec --dir in -i eth+ -p tcp -m tcp --tcp-flags SYN,RST SYN -m tcpmss --mss 1361:1536 -j TCPMSS --set-mss 1360 Maybe disable Path MTU discovery to prevent packet fragmentation problems. Helps alo ( net/ipv4/ip_no_pmtu_disc=1 ) Last, login on the proxymod monitor IRQ use, if you have extra cards in the server, you might have one the using a "shared IRQ" I make sure, if possible, that my NIC have there own irq set and not a shared one. And can you post your smb.conf ? That might help also. Greetz, Louis> -----Oorspronkelijk bericht----- > Van: samba [mailto:samba-bounces at lists.samba.org] Namens Knut > Krüger via samba > Verzonden: woensdag 25 april 2018 8:29 > Aan: samba at lists.samba.org > Onderwerp: Re: [Samba] Speedup windows client [was] What is > the maximum speed for download from a samba share > > Am 22.04.2018 um 04:30 schrieb L A Walsh via samba: > > Knut Krüger via samba wrote: > >>> Limiting the linux-server's max cpu-speed had > >>> the most affect on performance: > >>> (limited to 1.6GHz instead of 2.4GHz) (33% limitation) > >> The server is equipped with an 6 core / 12 tread 3.6 GHz > CPU (Intel > >> Core i7-980x and a Raid 10 Disk array. > >> The cpu is 90% idle (including webserver traffic and mailserver > >> traffic) during downloads. > > --- > > In protocols before cifsV3, only 1 tcp connection was > allowed between > > a user at workstation and a server. So multi-cores make no difference. > Ok this clarifies why two downloads are getting more bandwidth than 1 > > > > When you say "the cpu is 90% idle", you realize that means 10% > > busy. 10% * 12 cores = 1.2 cores busy. That may imply one > > core is "pegged". Though it sounds unlikely even with a 100Mb > > network that your cpu is the problem. > To clarify the setup > The root server is the 6 core/12 tread machine. > it is an stretch proxmox installation > this machine is minimum 90% idle > > one of the virtual machine is the samba VM connected via VPN > Looking to the cpu usage of this VM ist nearly zero during downloads. > There is no difference wehter the VM gets 1 ore more cores or > changing > the CPU limit. /CPU Limit us unlimited > > doing some additional test, it seems that a part of the speed lag is > client depending. > > 4 core client with Linux is about 25.000 Kbits > Lenovo Thinkpad T520 with Windows 7 is the worst client > (unfortunately the most important) with 750 kbits/sec :-( > > So as a first step (as it is really important) i have to > speed up the > windows client. > Any hints? > > After that I will try to speedup the server. > > Kind regards Knut > > > > For my testing, I run my test script on cygwin and > > "cd" to my home directory on the server (/h) where my > > test "files" (character devices) are located (/h/zero and /h/null) > > > > From there I usually run it with "bin/iotest". I'll attach > > the bash script. If you find it of any use, great! else, ignore it. > > My linux-box has bash-4.4 on it and is currently using a > 4.14.0 kernel. > > > > Good luck...don't want to overwhelm, so I'll end here. > > > > > > > > -- > To unsubscribe from this list go to the following URL and read the > instructions: https://lists.samba.org/mailman/options/samba > >
Possibly Parallel Threads
- Speedup windows client [was] What is the maximum speed for download from a samba share
- What is the maximum speed for download from a samba share
- Speedup windows client [was] What is the maximum speed for download from a samba share
- example configuration for VFS recycle
- Errors for shares since 4.12.0