search for: fastcopy

..., the application layer drives IO with the IO size it >> chooses. But when the application layer issues IOs larger then the >> maximum IO size allowed by SMB (8 MB iirc), the Windows SMB kernel >> client will segment the larger application segments into smaller ones. > > Fastcopy is doing *something* weird :-). > > 1. FastCopy (FastCopy.exe), 8MB (need to revise FastCopy default setup) > Process Name??? Operation?????? Path??? Detail > System? TCP Send??????? 10.19.7.63:64845 -> 10.19.250.98:445??? Length: > 8388724, startime: 3459115, endtime: 3459149,...

...yers, > >well, sure, the application layer drives IO with the IO size it >chooses. But when the application layer issues IOs larger then the >maximum IO size allowed by SMB (8 MB iirc), the Windows SMB kernel >client will segment the larger application segments into smaller ones. Fastcopy is doing *something* weird :-). 1. FastCopy (FastCopy.exe), 8MB (need to revise FastCopy default setup) Process Name Operation Path Detail System TCP Send 10.19.7.63:64845 -> 10.19.250.98:445 Length: 8388724, startime: 3459115, endtime: 3459149, seqnum: 0, connid: 0 Syste...

...es IO with the IO size it >>>chooses. But when the application layer issues IOs larger then the >>>maximum IO size allowed by SMB (8 MB iirc), the Windows SMB kernel >>>client will segment the larger application segments into smaller >>>ones. >> >>Fastcopy is doing *something* weird :-). >> >>1. FastCopy (FastCopy.exe), 8MB (need to revise FastCopy default setup) >>Process Name??? Operation?????? Path??? Detail >>System? TCP Send??????? 10.19.7.63:64845 -> 10.19.250.98:445??? >>Length: 8388724, startime: 3459115, end...

On Fri, Aug 18, 2023 at 04:25:28PM +0000, Jones Syue ??? wrote: >Hello Ivan, > >'FastCopy' has an option to revise max I/O size and works for SMB :) >it is a tool for file transferring and could be installed to win10, >download here: https://fastcopy.jp/ > >This is an example for writing, a job would write a file named '1GB.img' >from a local disk 'H:'...

Hello Ivan, 'FastCopy' has an option to revise max I/O size and works for SMB :) it is a tool for file transferring and could be installed to win10, download here: https://fastcopy.jp/ This is an example for writing, a job would write a file named '1GB.img' from a local disk 'H:' to a remote SMB mo...

On 8/21/23 11:53, Jones Syue ??? via samba wrote: >> OH - that's *really* interesting ! I wonder how it is >> changing the SMB3+ redirector to do this ? > > It looks like applications could do something and give a hint to SMB3+ > redirector, so far not quite sure how to make it, > per process monitor (procmon) could show that write I/O size seems > could be pass

...ive a hint to SMB3+ redirector, so far not quite sure how to make it, per process monitor (procmon) could show that write I/O size seems could be pass from the application layers, (https://learn.microsoft.com/en-us/sysinternals/downloads/procmon) this is a example for writing, using applications (Fastcopy.exe, explorer.exe, and robocopy.exe) to transfer a file named '1GB.img' from local disk 'H:' to remote SMB mount disk 'Z', and monitor them with procmon: 1. FastCopy (FastCopy.exe), 8MB (need to revise FastCopy default setup) Process Name Operation Path Detail System TC...

On 8/22/23 18:02, Jeremy Allison wrote: > On Tue, Aug 22, 2023 at 08:50:03AM +0200, Ralph Boehme wrote: >> I don't get it. Iirc 8 MB is the default max io size the kernel client >> will use which is also, iirc, the limit of the protocol. > > Don't get what ? The FastCopy.exe above is using 8MB write sizes. sure, so? FastCopy.exe uses 8 meg, Explorer and Robocopy use a smaller IO size. Or am I missing something? -------------- next part -------------- A non-text attachment was scrubbed... Name: OpenPGP_signature Type: application/pgp-signature Size: 840 bytes Desc...

On Wed, Aug 16, 2023 at 04:02:47PM +0100, Ivan Clayson via samba wrote: >Hello, > >We are currently running a Linux Samba gateway with a CephFS >kernel-client to allow Windows 10 clients to transfer data to and from >our Ceph storage cluster. We have been using this in production for a >while now quite successfully but we are finding that our Windows >clients are having

...0664 ??? directory mask = 0775 ??? guest only = Yes ??? guest ok = Yes ??? force user = nasuser ??? force group = nas ??? vfs objects = btrfs, io_uring (also tried without the btrfs module) ===== * Connected from a Windows 10 computer over 1G ethernet. * Copy data using Windows Explorer and FastCopy(1) from the Samba share to a local disk. * Verify the sha-256 sum on the files. From what I can see there is data corruption on many of the files. Sha-256 does not match. I copied the same files many times and the data corruption occurs within minutes. The total data set is about 800GB. When...

On 2020-04-26 19:46, Jeremy Allison via samba wrote: > On Sun, Apr 26, 2020 at 11:51:42AM +0200, A L via samba wrote: >> * Connected from a Windows 10 computer over 1G ethernet. * Copy data >> using Windows Explorer and FastCopy(1) from the Samba share to a >> local disk. * Verify the sha-256 sum on the files. From what I can >> see there is data corruption on many of the files. Sha-256 does not >> match. I copied the same files many times and the data corruption >> occurs within minutes. The to...

...t Output ... each of these contain numerous subcategories, and there is a coherent relationship between the subcategories and the directory structure for installed modules. So, to use functions to search for files on my file system, I say use File::Find; and if someone writes a new module, say FastCopy.pm it goes into /usr/lib/perl5/File/FastCopy.pm in my Perl library. In R, on the other hand, everything goes into R/rw104x/library, and each pachage contains all its functions within packagename/R, so there is only a very flat organization across packages and within packages. Some packages are qu...

...AM +0200, A L via samba wrote: >> On 2020-04-26 19:46, Jeremy Allison via samba wrote: >>> On Sun, Apr 26, 2020 at 11:51:42AM +0200, A L via samba wrote: >>>> * Connected from a Windows 10 computer over 1G ethernet. * Copy >>>> data using Windows Explorer and FastCopy(1) from the Samba share to >>>> a local disk. * Verify the sha-256 sum on the files. From what I >>>> can see there is data corruption on many of the files. Sha-256 does >>>> not match. I copied the same files many times and the data >>>> corrupti...

...ing to need more info to track this > down in your environment I'm afraid. > I'll do some more testing with locally mounted samba using the cifs module and also the smbclient tool. Does mget use multiple concurrent threads? I notice that when I copy from Windows explorer (and using FastCopy), I have about 10 I/O threads with smbd, according to iotop.

...:27:17AM +0200, A L via samba wrote: > > On 2020-04-26 19:46, Jeremy Allison via samba wrote: > > On Sun, Apr 26, 2020 at 11:51:42AM +0200, A L via samba wrote: > > > * Connected from a Windows 10 computer over 1G ethernet. * Copy data > > > using Windows Explorer and FastCopy(1) from the Samba share to a > > > local disk. * Verify the sha-256 sum on the files. From what I can > > > see there is data corruption on many of the files. Sha-256 does not > > > match. I copied the same files many times and the data corruption > > > occurs wi...

...e: > > > On 2020-04-26 19:46, Jeremy Allison via samba wrote: > > > > On Sun, Apr 26, 2020 at 11:51:42AM +0200, A L via samba wrote: > > > > > * Connected from a Windows 10 computer over 1G ethernet. * > > > > > Copy data using Windows Explorer and FastCopy(1) from the > > > > > Samba share to a local disk. * Verify the sha-256 sum on the > > > > > files. From what I can see there is data corruption on many > > > > > of the files. Sha-256 does not match. I copied the same > > > > > files many...

Hi, First I appreciate for you all, with your last week's points mentioned in the problem I meet with slow samba vfs write performance. Then I use fastcopy software to test windows clients write performance, it tells the same performance with iozone rewrite results, reach 450MB/s each client. Then I use the same smb.conf test read performance, it shows slow read performance compare with write performance, I received two clients total result: 500MB/s...

...his >> down in your environment I'm afraid. >> > I'll do some more testing with locally mounted samba using the cifs > module and also the smbclient tool. > > Does mget use multiple concurrent threads? I notice that when I copy > from Windows explorer (and using FastCopy), I have about 10 I/O > threads with smbd, according to iotop. > So I did some more tests. smbclient mget does not copy in the same way Windows Explorer does. When copying in Windows Explorer, there are many multiple concurrent threads used to transfer the files. With smbclient mget there...