search for: aio_pthread

I'm trying to learn more about samba by experimenting with samba on FreeNAS. This involves a certain amount of reading how default smb4.conf parameters are set in FreeNAS and then reading the manpages for those parameters. Async I/O is implemented in samba in freenas via the aio_pthread VFS module. The manpage for vfs_aio_pthread states: "the smb.conf parameters aio read size and aio write size must also be set appropriately for this module to be active" These parameters (aio read size and aio write size) are not set by default in the smb.conf. The manpage implies that t...

Hello list, I am looking to enable samba aio on my Wheezy test box (I have version 4.1.17 from back ports). The output of smbd -b shows that the stable packages for my distro are not compiled using --with-aio-support. It appears that without recompiling I can use vfs objects = aio_pthread to achieve a similar effect? I'm aware that this somewhat dips into Debian specifics, but I figured it would be worth asking the list. Can anybody tell me if I'm barking up the right tree? Any guidance is much appreciated! Thanks.

...s really doing everything as async? I expect it is possible to find out with a bit of work.. Thanks again. From: Volker Lendecke <Volker.Lendecke at SerNet.DE> Sent: 10 March 2015 15:51 To: Gardiner, Alex (alex.gardiner at canterbury.ac.uk) Cc: samba at lists.samba.org Subject: Re: [Samba] aio_pthread on Debian? On Tue, Mar 10, 2015 at 01:24:28PM +0000, Gardiner, Alex (alex.gardiner at canterbury.ac.uk) wrote: > Hello list, > > > I am looking to enable samba aio on my Wheezy test box (I have version 4.1.17 from back ports). > > > The output of smbd -b shows that the stable...

Hi, I need to to open existing readonly files. Yes you are right, not the open call takes the time, but stat() system call. I looked at aio_pthread source, the lines which needs to be removed to make it work are just the lines which tests for O_CREAT|O_EXCL? What problems can cause such solution for readonly share? On Tue, Apr 26, 2016 at 8:42 PM, Jeremy Allison <jra at samba.org> wrote: > On Tue, Apr 26, 2016 at 03:49:44PM +0200, P...

In the vfs pages for aio_pthread, it gives as an example for aio read/write size, 1024 for each and states an "appropriate" value must be set. Byt in smb.conf it states that the only reasonable values are 0 or 1 (also that there's a default = 1 so no value need be given explicitly). Which of these is correct? Th...

...o veto files = /.snapshot/.windows/.mac/.zfs/ writeable = yes browseable = yes shadow:snapdir = .zfs/snapshot shadow:sort = desc shadow:localtime = yes shadow:format = auto-%Y%m%d.%H%M-1w shadow:snapdirseverywhere = yes vfs objects = shadow_copy2 zfs_space zfsacl aio_pthread streams_xattr hide dot files = yes guest ok = no nfs4:mode = special nfs4:acedup = merge nfs4:chown = true zfsacl:acesort = dontcare veto oplock files = /*.dbf/*.DBF/*.ndx/*.NDX/ [deploy] path = /mnt/trunk/MM/deploy printable = no veto files = /.snapshot/.w...

On a related note: Some time ago, you instructed a user to use the following aio_pthread parameter:     aio_pthread:aio open = true This is not undocumented in the man page. Does the parameter have any effect, and what is the effect? Although I tried for a while, I couldn't locate your original message. I don't remember whether it was posted on bugzilla or on a mailing l...

.../ > writeable = yes > browseable = yes > shadow:snapdir = .zfs/snapshot > shadow:sort = desc > shadow:localtime = yes > shadow:format = auto-%Y%m%d.%H%M-1w > shadow:snapdirseverywhere = yes > vfs objects = shadow_copy2 zfs_space zfsacl aio_pthread streams_xattr > hide dot files = yes > guest ok = no > nfs4:mode = special > nfs4:acedup = merge > nfs4:chown = true > zfsacl:acesort = dontcare > veto oplock files = /*.dbf/*.DBF/*.ndx/*.NDX/ > > > [deploy] > path = /mnt/trun...

...veto files = /.snap/.windows/.zfs/ writeable = yes browseable = yes recycle:repository = .recycle/%U recycle:keeptree = yes recycle:versions = yes recycle:touch = yes recycle:directory_mode = 0777 recycle:subdir_mode = 0700 vfs objects = zfsacl streams_xattr aio_pthread hide dot files = yes guest ok = no nfs4:mode = special nfs4:acedup = merge nfs4:chown = yes zfsacl:acesort = dontcare [TESTME1] path = /mnt/vol0/TESTME1 printable = no veto files = /.snap/.windows/.zfs/ writeable = yes browseable = yes recycle:r...

...= dfs_samba4, acl_xattr [netlogon] path = /var/lib/samba/sysvol/salamone.local/scripts read only = No [sysvol] path = /var/lib/samba/sysvol read only = No [share1] path = /data/share1 read only = No aio read size = 16384 aio write size = 16384 map acl inherit = Yes vfs objects = aio_pthread, acl_xattr acl_xattr:ignore system acls = yes [share2] path = /data/share2 read only = No aio read size = 16384 aio write size = 16384 map acl inherit = Yes write cache size = 262144 vfs objects = aio_pthread, acl_xattr acl_xattr:ignore system acls = yes [SALAMONE_LOCAL] path = /dat...

...ing like 25MB/s tops. That's well below the capacity of my Gb > > network and my disk system. FWIW iperf shows >900Mbits/sec in both > > directions on the link. > > > > # smbd -b|grep aio > > vfs_aio_fork_init > > vfs_aio_posix_init > > vfs_aio_pthread_init > > You don't need these, modern Samba includes a pthread pool > implementation that will parallelize SMB io requests. The main reason for our user-space threaded approach is lack of aio in Linux. Proper kernel support for posix AIO might be faster than our implementation. &quot...

...a pthread > > pool to complete, allowing as many requests as your client will send > > to be outstanding (and your disk and network bandwith will allow of > > course :-). > > > > Oh great, now it works much better! > > I've added: > > vfs objects = aio_pthread # very important!!! ^^^^ That's only used for async open. Are you doing many opens per second ? > aio read size = 1 > aio write size = 1 > read raw = Yes > write raw = Yes The two above are also not needed. Not for about 15 years. > strict locking = No The above might help....

...15346: 2-3min delays at reconnect with smb2_validate_sequence_number: ???? bad message_id 2. o? Stefan Metzmacher <metze at samba.org> ?? * BUG 15346: 2-3min delays at reconnect with smb2_validate_sequence_number: ???? bad message_id 2. ?? * BUG 15441: samba-tool ntacl get segfault if aio_pthread appended. ?? * BUG 15446: DCERPC_PKT_CO_CANCEL and DCERPC_PKT_ORPHANED can't be parsed. o? MikeLiu <mikeliu at qnap.com> ?? * BUG 15453: File doesn't show when user doesn't have permission if ???? aio_pthread is loaded. o? Noel Power <noel.power at suse.com> ?? * BUG...

...15346: 2-3min delays at reconnect with smb2_validate_sequence_number: ???? bad message_id 2. o? Stefan Metzmacher <metze at samba.org> ?? * BUG 15346: 2-3min delays at reconnect with smb2_validate_sequence_number: ???? bad message_id 2. ?? * BUG 15441: samba-tool ntacl get segfault if aio_pthread appended. ?? * BUG 15446: DCERPC_PKT_CO_CANCEL and DCERPC_PKT_ORPHANED can't be parsed. o? MikeLiu <mikeliu at qnap.com> ?? * BUG 15453: File doesn't show when user doesn't have permission if ???? aio_pthread is loaded. o? Noel Power <noel.power at suse.com> ?? * BUG...

...>> browseable = yes >> shadow:snapdir = .zfs/snapshot >> shadow:sort = desc >> shadow:localtime = yes >> shadow:format = auto-%Y%m%d.%H%M-1w >> shadow:snapdirseverywhere = yes >> vfs objects = shadow_copy2 zfs_space zfsacl aio_pthread >> streams_xattr >> hide dot files = yes >> guest ok = no >> nfs4:mode = special >> nfs4:acedup = merge >> nfs4:chown = true >> zfsacl:acesort = dontcare >> veto oplock files = /*.dbf/*.DBF/*.ndx/*.NDX/ >> >...

...os charset = CP437 unix charset = UTF-8 log level = 1 [homes] valid users = %U path = /mnt/volume1/homes/%U comment = Home Directories printable = no veto files = /.snapshot/.windows/.mac/.zfs/ writeable = yes browseable = yes vfs objects = zfs_space zfsacl aio_pthread streams_xattr hide dot files = yes guest ok = no nfs4:mode = special nfs4:acedup = merge nfs4:chown = true zfsacl:acesort = dontcare [Archive] path = /mnt/volume1/Archive printable = no veto files = /.snapshot/.windows/.mac/.zfs/ writeable = yes browsea...

...ize" is more than or equal to 256 kilobytes,in the beginning the transmission is good. But 3~5 seconds later,the throughput will drop to zero. Server OS: Ubuntu Server 14.04.1 LTS Samba: Version 4.1.6-Ubuntu Dialect: SMB 2.0 AIO settings : aio read size = 1 aio write size = 1 vfs objects = aio_pthread Client OS: Win 8.1 professional 64Bit Iometer Setting: Iometer 2006.07.27 Worker : 8 Max Disk Size (Sectors) : 16777216 Outstanding I/Os : 128 Starting Disk Sector : 0 100% Random read Any insight into why this is so and any other tuning suggestion is appreciated. Thanks. Regards, Mike --...

On Thu, Jul 21, 2016 at 12:23:01PM -0500, Russell R Poyner wrote: > One more data point for comparison > > I installed the stock samba 4.2 rpm on a centos 7 machine and ran > the same diskspd tests against a share configured with: > vfs objects = aio_pthread > aio read size = 1024 > aio read size = 1024 > > smb2 leases = yes > > I get 27MB/s with 4k blocks and 145MB/s with 64k blocks. Disabling > cacheing by passing the -h switch to diskspd lowered these to 72MB/s > and 11MB/s. Which I view as 'close enough' t...

Hi, I have problem with my samba. I have shared folder which contains many smaller files (few MB each), this files are stored on very fast disk array. Locally, from that machine I can read this files in parallel with speed about 500-1000 MB/s, but when I read them through samba, I get only 50-100 MB/s on a 10 gigabit network. I tried to find the problem, so I analyzed strace logs and found out,

..., Jul 21, 2016 at 12:23:01PM -0500, Russell R Poyner wrote: >>> One more data point for comparison >>> >>> I installed the stock samba 4.2 rpm on a centos 7 machine and ran >>> the same diskspd tests against a share configured with: >>> vfs objects = aio_pthread >>> aio read size = 1024 >>> aio read size = 1024 >>> >>> smb2 leases = yes >>> >>> I get 27MB/s with 4k blocks and 145MB/s with 64k blocks. Disabling >>> cacheing by passing the -h switch to diskspd lowered these to 72MB/s...