similar to: rsync very very slow with multiple instances at the same time.

Displaying 20 results from an estimated 1500 matches similar to: "rsync very very slow with multiple instances at the same time."

2018 Mar 23
1
Aw: Re: rsync very very slow with multiple instances at the same time.
An HTML attachment was scrubbed... URL: <http://lists.samba.org/pipermail/rsync/attachments/20180323/66c46d5a/attachment.html>
2018 Mar 23
0
rsync very very slow with multiple instances at the same time.
Ok, so i did some tests. find /path -type f -ls > /dev/null First on my local SSD disk (1.9 millions files) : 1 find : real 2m16.743s user 0m7.607s sys 0m45.952s 10 concurrent finds (approx same results for each) : real 4m48.629s user 0m11.013s sys 2m0.288s Almost double time is somehow logic. Now same test on my server on the iSCSI disk (when there is no other activity) (2.8 millions
2008 Jul 02
1
Non-clean Rsync 3.0.3 exit on OSX
-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 I've compiled rsync 3.0.3 on OSX 10.4 PPC via the plain jane ./configure; make method (no patches). The resulting binary has then been moved to /usr/local/bin/rsync3 and copied to a OSX 10.5.4 Intel client machine as rsync3. I then run the following command: rsync3 -vvv -e ssh -avAX --progress --delete -
2008 Mar 07
2
rsync3 universal binary for Mac OS X?
Did anyone ever get rsync3 to compile as a universal binary and work correctly on both tiger and leopard on ppc and intel? David.
2018 Mar 20
2
Very slow to start sync with millions of directories and files
On Tue, Mar 20, 2018 at 5:49 PM Kevin Korb <kmk at sanitarium.net> wrote: > Nothing there should be preventing incremental indexing. That means it > should start copying as soon as it finds a file that needs to be copied. > Doesn't it tries to create all (empty) directories first? > On 03/20/2018 02:33 PM, Bráulio Bhavamitra wrote: > > > > > > Em seg, 19
2014 Dec 12
3
Aw: Re: Re: rsync not copy all information for font file
what is the source and destination filesystem? here is some report that rsync has some problem with HFS+ filesystems and "ressource forks": http://quesera.com/reynhout/misc/rsync+hfsmode/ but as you are using ubuntu and not osx i`m curious what`s the problem, so i think we need more information here. regards roland > Gesendet: Freitag, 12. Dezember 2014 um 15:31 Uhr > Von:
2018 Mar 20
2
Very slow to start sync with millions of directories and files
Em seg, 19 de mar de 2018 11:34, Kevin Korb via rsync <rsync at lists.samba.org> escreveu: > The performance of rsync with a huge number of files is greatly > determined by every option you are using. So, what is your whole > command line? > rsync -avP /data-old/ /data > > On 03/19/2018 09:05 AM, Bráulio Bhavamitra via rsync wrote: > > Hi all, > > > >
2018 Mar 20
0
Very slow to start sync with millions of directories and files
It creates the directories as it needs them. If you want to watch it looking through files it doesn't need to copy you can add -ii (see --itemize-changes for what the output means). On 03/20/2018 05:24 PM, Bráulio Bhavamitra wrote: > > > On Tue, Mar 20, 2018 at 5:49 PM Kevin Korb <kmk at sanitarium.net > <mailto:kmk at sanitarium.net>> wrote: > > Nothing
2014 Dec 14
1
Aw: Re: Re: rsync not copy all information for font file
An HTML attachment was scrubbed... URL: <http://lists.samba.org/pipermail/rsync/attachments/20141214/3d32f770/attachment.html>
2018 Mar 19
2
Very slow to start sync with millions of directories and files
Hi all, I'm using rsync 3 to copy all files from one disk to another. The files were writen by Minio, an S3 compatible opensource backend. The number of files is dozens of millions, almost each of them within its own directory. Rsync takes a long time, when not several hours, to even start syncing files. I already see a few reasons: - it first create all directories to put files in, that
2018 Mar 20
0
Very slow to start sync with millions of directories and files
Nothing there should be preventing incremental indexing. That means it should start copying as soon as it finds a file that needs to be copied. On 03/20/2018 02:33 PM, Bráulio Bhavamitra wrote: > > > Em seg, 19 de mar de 2018 11:34, Kevin Korb via rsync > <rsync at lists.samba.org <mailto:rsync at lists.samba.org>> escreveu: > > The performance of rsync with
2007 Feb 05
1
rsync 3-cvs missing prereqs/deps on osx
hi, as it's been awhile since my last attempts w/ v269, i'm building the latest rsync3-svs on osx 10.4.8; looking to see what's evolved re: acls & xattrs support on osx ... @ build, i note complaint abt a missing yodl2man, which originates with YODL. YODL, then requires icmake. as neither is available on osx, it's src build time. on building debian's icmake (already
2014 Dec 15
2
rsync not copy all information for font file
Hi Bryan, thanks for your kind reply but it happend only with some fonts not all font file, (email with attachment is under verification by admin, so i resend this without attachment file) here i attach 2 screenshot one original folder and second backup folder, you can notice that the font .otf, .ttf, .dfont have no problem in rsync it copied as it is but the font that not show extension (Font
2004 May 09
2
2.6.2 not displaying permissions errors on client side
Hello, Noticed this (bug?) while testing out rsync. For a little background, I need to push files real-time to some front-end servers, and I am thinking of switching from some custom shell scripts that do this job to rsync. I am thinking of running rsync as a daemon on the front-end servers, and doing an upload from the back-end server to push the data out as it comes in. So, here is the deal:
2002 Feb 18
1
fixes for bugs in error handling in rsync-2.5.2; and updates for rsync3.txt
Rsync-2.5.2 does not gracefully report connection and transfer errors and always properly return with a non-zero exit code, despite many assurances to the contrary in the code and commit logs. It seems a kludge to handle a special case of lost connections to older servers was FAR too aggressive! With '-vvv' I also print the source of the exit_cleanup() call, and optionally with
2018 Mar 19
0
Very slow to start sync with millions of directories and files
The performance of rsync with a huge number of files is greatly determined by every option you are using. So, what is your whole command line? On 03/19/2018 09:05 AM, Bráulio Bhavamitra via rsync wrote: > Hi all, >   > I'm using rsync 3 to copy all files from one disk to another. The files > were writen by Minio, an S3 compatible opensource backend. > > The number of files
2002 Oct 24
1
Using rsync for backup trashes st_atime
Hi! I've just tried to do a backup of a machine with rsync. While doing this (I was reading emails:-) I noted that mbox for mbox, I had no longe new mails, but I've never read off these mailboxes lately... This seemed to be a st_atime problem, and indeed, I could verify that. This is what I used for backup: rsync --archive \ --recursive \
2008 Apr 29
2
writefd_unbuffered failed to write 4 bytes
Hi All. On Mac OS10.4, using rsync 3.0, it stops during a transfer. I mount an SMB share, and then use the line: sudo rsync -avhi --delete --stats --timeout=360 --progress --log-file=/Volumes/backup/20080429/rsynclog.txt --exclude="*:*" /Volumes/RAID_One /Volumes/backup/20080429 There's a few terabytes of data, and it never finishes a complete run. It can stop at anywhere during
2006 Apr 19
4
DO NOT REPLY [Bug 3701] New: rsync_xal_set: lsetxattr system.posix_acl_default failed: Permission denied
https://bugzilla.samba.org/show_bug.cgi?id=3701 Summary: rsync_xal_set: lsetxattr system.posix_acl_default failed: Permission denied Product: rsync Version: 2.6.7 Platform: x86 OS/Version: Linux Status: NEW Severity: major Priority: P3 Component: core AssignedTo:
2005 Apr 14
2
Mounting a Windows Share with UTF8 files
Hi all, Can anyone please advise if it is possible to mount a Windows share and view files with chinese filenames ? I am able to view the files on the local disk, however the files on the Windows share display as ??????.htm I have tried mounting with the following commands smbmount //xxxxxxxx/filesync /mnt/filesync -o username=xxxxx,codepage=cp950,isocharset=utf8 or mount -t smbfs -o