Displaying 20 results from an estimated 1500 matches similar to: "rsync very very slow with multiple instances at the same time."
2018 Mar 23
1
Aw: Re: rsync very very slow with multiple instances at the same time.
An HTML attachment was scrubbed...
URL: <http://lists.samba.org/pipermail/rsync/attachments/20180323/66c46d5a/attachment.html>
2018 Mar 23
0
rsync very very slow with multiple instances at the same time.
Ok, so i did some tests.
find /path -type f -ls > /dev/null
First on my local SSD disk (1.9 millions files) :
1 find :
real 2m16.743s
user 0m7.607s
sys 0m45.952s
10 concurrent finds (approx same results for each) :
real 4m48.629s
user 0m11.013s
sys 2m0.288s
Almost double time is somehow logic.
Now same test on my server on the iSCSI disk (when there is no other activity) (2.8 millions
2008 Jul 02
1
Non-clean Rsync 3.0.3 exit on OSX
-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1
I've compiled rsync 3.0.3 on OSX 10.4 PPC via the plain jane
./configure; make method (no patches). The resulting binary has then
been moved to /usr/local/bin/rsync3 and copied to a OSX 10.5.4 Intel
client machine as rsync3.
I then run the following command:
rsync3 -vvv -e ssh -avAX --progress --delete
-
2008 Mar 07
2
rsync3 universal binary for Mac OS X?
Did anyone ever get rsync3 to compile as a universal binary and work
correctly on both tiger and leopard on ppc and intel?
David.
2018 Mar 20
2
Very slow to start sync with millions of directories and files
On Tue, Mar 20, 2018 at 5:49 PM Kevin Korb <kmk at sanitarium.net> wrote:
> Nothing there should be preventing incremental indexing. That means it
> should start copying as soon as it finds a file that needs to be copied.
>
Doesn't it tries to create all (empty) directories first?
> On 03/20/2018 02:33 PM, Bráulio Bhavamitra wrote:
> >
> >
> > Em seg, 19
2014 Dec 12
3
Aw: Re: Re: rsync not copy all information for font file
what is the source and destination filesystem?
here is some report that rsync has some problem with HFS+ filesystems and "ressource forks": http://quesera.com/reynhout/misc/rsync+hfsmode/
but as you are using ubuntu and not osx i`m curious what`s the problem, so i think we need more information here.
regards
roland
> Gesendet: Freitag, 12. Dezember 2014 um 15:31 Uhr
> Von:
2018 Mar 20
2
Very slow to start sync with millions of directories and files
Em seg, 19 de mar de 2018 11:34, Kevin Korb via rsync <rsync at lists.samba.org>
escreveu:
> The performance of rsync with a huge number of files is greatly
> determined by every option you are using. So, what is your whole
> command line?
>
rsync -avP /data-old/ /data
>
> On 03/19/2018 09:05 AM, Bráulio Bhavamitra via rsync wrote:
> > Hi all,
> >
> >
2018 Mar 20
0
Very slow to start sync with millions of directories and files
It creates the directories as it needs them. If you want to watch it
looking through files it doesn't need to copy you can add -ii (see
--itemize-changes for what the output means).
On 03/20/2018 05:24 PM, Bráulio Bhavamitra wrote:
>
>
> On Tue, Mar 20, 2018 at 5:49 PM Kevin Korb <kmk at sanitarium.net
> <mailto:kmk at sanitarium.net>> wrote:
>
> Nothing
2014 Dec 14
1
Aw: Re: Re: rsync not copy all information for font file
An HTML attachment was scrubbed...
URL: <http://lists.samba.org/pipermail/rsync/attachments/20141214/3d32f770/attachment.html>
2018 Mar 19
2
Very slow to start sync with millions of directories and files
Hi all,
I'm using rsync 3 to copy all files from one disk to another. The files
were writen by Minio, an S3 compatible opensource backend.
The number of files is dozens of millions, almost each of them within its
own directory.
Rsync takes a long time, when not several hours, to even start syncing
files. I already see a few reasons:
- it first create all directories to put files in, that
2018 Mar 20
0
Very slow to start sync with millions of directories and files
Nothing there should be preventing incremental indexing. That means it
should start copying as soon as it finds a file that needs to be copied.
On 03/20/2018 02:33 PM, Bráulio Bhavamitra wrote:
>
>
> Em seg, 19 de mar de 2018 11:34, Kevin Korb via rsync
> <rsync at lists.samba.org <mailto:rsync at lists.samba.org>> escreveu:
>
> The performance of rsync with
2007 Feb 05
1
rsync 3-cvs missing prereqs/deps on osx
hi,
as it's been awhile since my last attempts w/ v269, i'm building the
latest rsync3-svs on osx 10.4.8; looking to see what's evolved re:
acls & xattrs support on osx ...
@ build, i note complaint abt a missing yodl2man, which originates with YODL.
YODL, then requires icmake.
as neither is available on osx, it's src build time.
on building debian's icmake (already
2014 Dec 15
2
rsync not copy all information for font file
Hi Bryan,
thanks for your kind reply but it happend only with some fonts not all font file, (email with attachment is under verification by admin, so i resend this without attachment file) here i attach 2 screenshot one original folder and second backup folder, you can notice that the font .otf, .ttf, .dfont have no problem in rsync it copied as it is but the font that not show extension (Font
2004 May 09
2
2.6.2 not displaying permissions errors on client side
Hello,
Noticed this (bug?) while testing out rsync. For a little background, I
need to push files real-time to some front-end servers, and I am
thinking of switching from some custom shell scripts that do this job
to rsync. I am thinking of running rsync as a daemon on the front-end
servers, and doing an upload from the back-end server to push the data
out as it comes in.
So, here is the deal:
2002 Feb 18
1
fixes for bugs in error handling in rsync-2.5.2; and updates for rsync3.txt
Rsync-2.5.2 does not gracefully report connection and transfer errors
and always properly return with a non-zero exit code, despite many
assurances to the contrary in the code and commit logs. It seems a
kludge to handle a special case of lost connections to older servers was
FAR too aggressive!
With '-vvv' I also print the source of the exit_cleanup() call, and
optionally with
2018 Mar 19
0
Very slow to start sync with millions of directories and files
The performance of rsync with a huge number of files is greatly
determined by every option you are using. So, what is your whole
command line?
On 03/19/2018 09:05 AM, Bráulio Bhavamitra via rsync wrote:
> Hi all,
>
> I'm using rsync 3 to copy all files from one disk to another. The files
> were writen by Minio, an S3 compatible opensource backend.
>
> The number of files
2002 Oct 24
1
Using rsync for backup trashes st_atime
Hi!
I've just tried to do a backup of a machine with rsync. While doing this
(I was reading emails:-) I noted that mbox for mbox, I had no longe new
mails, but I've never read off these mailboxes lately... This seemed to
be a st_atime problem, and indeed, I could verify that. This is what I
used for backup:
rsync --archive \
--recursive \
2008 Apr 29
2
writefd_unbuffered failed to write 4 bytes
Hi All.
On Mac OS10.4, using rsync 3.0, it stops during a transfer.
I mount an SMB share, and then use the line:
sudo rsync -avhi --delete --stats --timeout=360 --progress
--log-file=/Volumes/backup/20080429/rsynclog.txt --exclude="*:*"
/Volumes/RAID_One /Volumes/backup/20080429
There's a few terabytes of data, and it never finishes a complete run.
It can stop at anywhere during
2006 Apr 19
4
DO NOT REPLY [Bug 3701] New: rsync_xal_set: lsetxattr system.posix_acl_default failed: Permission denied
https://bugzilla.samba.org/show_bug.cgi?id=3701
Summary: rsync_xal_set: lsetxattr system.posix_acl_default
failed: Permission denied
Product: rsync
Version: 2.6.7
Platform: x86
OS/Version: Linux
Status: NEW
Severity: major
Priority: P3
Component: core
AssignedTo:
2005 Apr 14
2
Mounting a Windows Share with UTF8 files
Hi all,
Can anyone please advise if it is possible to mount a Windows share and
view files with chinese filenames ?
I am able to view the files on the local disk, however the files on the
Windows share display as ??????.htm
I have tried mounting with the following commands
smbmount //xxxxxxxx/filesync /mnt/filesync -o
username=xxxxx,codepage=cp950,isocharset=utf8
or
mount -t smbfs -o