Displaying 20 results from an estimated 6000 matches similar to: "Rsyncing a very large directory tree (over 50,000 files)"
2007 Oct 01
6
reducing file list bytes transferred
Hello,
This is my first posting to the rsync list. I mirror a database
containing directories which contain a very large number of files (say
30,000), and sending the file list can often take longer than transferring
the new files. (Rsync ends up sending nearly the same file list on
every transfer, with only the addition of a few new files.)
Has the rsync team considered an rsync option
2009 Feb 16
6
Renamed files and directories
What is the current status of both rename-patches ?
Are there alternative measures ?
Frequently users reorganise directories and files.
Recently a directory of 40GB was renamed...
It took 3 weeks to re-copy all over an ADSL-link.
I have followed the last couple of years the postings,
and realise it is not as easy as it seems.
But the users do not understand this at all 8-(
Thanks, Nico
2005 Nov 24
10
Any change of rsync using threads instead of fork?
On a typical embedded Linux device, with no MMU, there is no fork() or
it returns ENOSYS.
The nearest replacements are vfork() (which is only useful before
exec*()), or to create threads with pthread_create().
rsync would be a very useful program on such devices, and I was a bit
disappointed to build it, only to find the compile went fine but it
failed at runtime due to ENOSYS.
Is there any
2007 May 02
5
Status of --ignorcase option in main tree/build?
Hi,
I'm very interested in learning the status of the --ignorecase patch
being included in the main tree... is there a reason it still isn't in
there?
For anyone who is forced to dealing with backing up windows boxes, this
is a big problem, and I can't believe that it isn't affecting a lot of
people...
Or maybe there is a simple workaround?
I'm trying to backup files
2007 Nov 01
4
rsyncing files that might change
Hi, I hope I have not been google-incompetant, but I have been unable to
find
an explicit answer a case I am concerned about.
If am rsyncing a file and I have the the following sequence of events happen
in
the same second
1. rsync starts
2. rsync sends some chunk of data to the other end
3 a local process modifies the chunk that has just been sent
I have seen statements that rsync does
2006 May 23
2
cross platform rsync avz lists all directory names in tree
Hi,
I have tried googling and reading the docs and examples but haven't yet
managed to solve this issue.
rsyncing from Mac OS X to FreeBSD and from Linux to Windows XP, with the
arguments avz I get the same thing in the reports (mailed from cron):
path/
path/to/
path/to/directories/
path/to/directories/changedfile.txt
another/path/
another/path/withoutanychangedfiles/
yet/anotherpath/
2006 Jun 13
2
Compare ignoring the size AND file suffix: (not/) compressed files in a directory tree
Hello all,
Here, we use rsync for years to share software tests distributions
between from France
to USA, Singapore and London, and all is working fine.
But to save space we also need to compress files depending on their
access time, and
on purpose uncompress automatically before use.
This makes rsync useless because it makes, of course re-transfer and
deletions. when a
new file is detected
2007 Jun 30
2
checksum-xattr.diff [CVS update: rsync/patches]
On 6/30/07, Wayne Davison <wayned@samba.org> committed:
> Added Files:
> checksum-xattr.diff
> Log Message:
> A simple patch that lets rsync use cached checksum values stored in
> each file's extended attributes. A perl script is provided to create
> and update the values.
Wayne,
You should be aware of two drawbacks of caching checksums in xattrs:
First,
2006 Sep 21
5
rsyncing from win1251 to UTF-8
Hello!
I need to sync directories from one machine to another.
Source server uses win1251 (russian) codepage to store filenames. Destination server uses UTF-8.
How could I avoid garbage in filenames after rsyncing?
Can rsync recode filenames from one codepage to another?
If no, is there any way to do this task?
Thank you.
2009 May 03
6
[RFC] The reflink(2) system call.
Hi everyone,
I described the reflink operation at the Linux Storage &
Filesystems Workshop last month. Originally implemented as an
ocfs2-specific ioctl, the consensus was that it should be a syscall from
the get-go. Here's some first-cut patches.
For people who have not seen reflink, either at LSF or on the
ocfs2 wiki, the first patch contains
Documentation/filesystems/reflink.txt to
2015 Feb 09
2
Another Fedora decision
On 10 February 2015 at 10:08, Kahlil Hodgson
<kahlil.hodgson at dealmax.com.au> wrote:
> I think you can simply submit a bug report under fedora documentation.
Via bugzilla:
https://bugzilla.redhat.com/enter_bug.cgi?product=Fedora%20Documentation
2010 Nov 05
3
ZFS vs mpxio vs cfgadm in Solaris.
Folks,
I''m trying to figure out whether we should give ZFS / mpxio a shot
on one of our research servers, or simply skip it (as we have
previously).
In Nov 2009 Cindy responded to a thread concerning ZFS device
issues, cfgadm, and mpxio:
http://mail.opensolaris.org/pipermail/zfs-discuss/2009-November/033496.html
I''ve got an x2270 with the Sun EZ-SAS HBA and external SATA
2006 Jun 14
6
Cygwin rsync to RH rsync server
Hi all,
I'm new to the rsync list. I've been searching for two days and have
tried five different installs and so far none work the way I need them
to.
I have an "backup" server running rsync --version:
rsync version 2.6.6 protocol version 29
Copyright (C) 1996-2005 by Andrew Tridgell and others
<http://rsync.samba.org/>
Capabilities: 64-bit files, socketpairs, hard
2015 Dec 23
3
Starting stunnel on boot with CentOS7
On my CenOS7 system with stunnel from base
stunnel-4.56-4.el7.x86_64
there's a systemd service file
/etc/systemd/system/stunnel.service
try
sudo systemctl enable stunnel.service
Hope this helps,
K
?al?
2008 Mar 04
3
Could you make the 2.6.9 source available via http again?
I noticed you've made rsync 3.0.0 available at
http://www.samba.org/ftp/rsync/rsync-3.0.0.tar.gz, which is great!
However, until it's upgraded (if ever), the buildroot system I'm using to build
embedded linux tries to download rsync 2.6.9 from
http://www.samba.org/ftp/rsync/rsync-2.6.9.tar.gz, which fails since this file
is no longer available -- even though it's linked from
2015 May 15
2
Back to eth shuffling ...
Actually, I know what the MAC is for the builtin Port1 and 2. Those are
listed in the BIOS. But ultimately I don't want to rely on them as I want
the same kickstart file to work for other machines, so hardcoding those in
the kickstart file wouldn't quite work, unless I start writing multiple
kickstart files, one per machine.
Anyway, lspci reports this:
00:19.0 Ethernet controller: Intel
2015 May 15
2
Back to eth shuffling ...
Right, I understand that part. However I believe I'm now in the realm of
making this specific to this machine as I have no guarantee that another
identical machine will pop up with those same bus IDs. Maybe for the
internal ports, but I don't know if the same will happen for the PCIe bus.
Would that be correct?
On Thu, May 14, 2015 at 6:21 PM, Kahlil Hodgson <
kahlil.hodgson at
2015 Feb 09
2
Another Fedora decision
On 10 February 2015 at 10:15, PatrickD Garvey <patrickdgarveyt at gmail.com> wrote:
> Please allow me to make sure I am perceiving this correctly,
> reports of errors found in RedHat documentation are to be reported
> against the Fedora Documentation product type in the RedHat bugzilla?
> and
> reports of errors found in Fedora documentation are, also, to be
> reported
2006 Jan 17
2
getting "diff" of directory trees
Given two directories "foo" and "fooprime", can I have rsync make a file
or directory "d", that contains the differences between these two
directories such that I can take d and apply it to foo to get fooprime,
or take fooprime and reverse-apply d to it to get foo?
I'm not sure that the --backup and --backup-dir options to rsync will
give me exactly what I want.
2012 Jan 15
2
6.2 install fails on HP 6200pro (Intel Q65X chipset).
CentOS 5.6 x64 installs successfully on HP 6200pro SFF box with
Intel Q65X Express chipset (including HD graphics), Core i5 and
added NVS300 graphics card. Actually, it works great. HP lists
"RedHat Enterprise x64" as a supported OS. The 6200pro is a
"business desktop" that became available in early summer 2011.
CentOS 6.2 x64 install halts during initial boot, with boot