similar to: Rsyncing a very large directory tree (over 50,000 files)

Displaying 20 results from an estimated 6000 matches similar to: "Rsyncing a very large directory tree (over 50,000 files)"

2007 Oct 01
6
reducing file list bytes transferred
Hello, This is my first posting to the rsync list. I mirror a database containing directories which contain a very large number of files (say 30,000), and sending the file list can often take longer than transferring the new files. (Rsync ends up sending nearly the same file list on every transfer, with only the addition of a few new files.) Has the rsync team considered an rsync option
2009 Feb 16
6
Renamed files and directories
What is the current status of both rename-patches ? Are there alternative measures ? Frequently users reorganise directories and files. Recently a directory of 40GB was renamed... It took 3 weeks to re-copy all over an ADSL-link. I have followed the last couple of years the postings, and realise it is not as easy as it seems. But the users do not understand this at all 8-( Thanks, Nico
2005 Nov 24
10
Any change of rsync using threads instead of fork?
On a typical embedded Linux device, with no MMU, there is no fork() or it returns ENOSYS. The nearest replacements are vfork() (which is only useful before exec*()), or to create threads with pthread_create(). rsync would be a very useful program on such devices, and I was a bit disappointed to build it, only to find the compile went fine but it failed at runtime due to ENOSYS. Is there any
2007 May 02
5
Status of --ignorcase option in main tree/build?
Hi, I'm very interested in learning the status of the --ignorecase patch being included in the main tree... is there a reason it still isn't in there? For anyone who is forced to dealing with backing up windows boxes, this is a big problem, and I can't believe that it isn't affecting a lot of people... Or maybe there is a simple workaround? I'm trying to backup files
2007 Nov 01
4
rsyncing files that might change
Hi, I hope I have not been google-incompetant, but I have been unable to find an explicit answer a case I am concerned about. If am rsyncing a file and I have the the following sequence of events happen in the same second 1. rsync starts 2. rsync sends some chunk of data to the other end 3 a local process modifies the chunk that has just been sent I have seen statements that rsync does
2006 May 23
2
cross platform rsync avz lists all directory names in tree
Hi, I have tried googling and reading the docs and examples but haven't yet managed to solve this issue. rsyncing from Mac OS X to FreeBSD and from Linux to Windows XP, with the arguments avz I get the same thing in the reports (mailed from cron): path/ path/to/ path/to/directories/ path/to/directories/changedfile.txt another/path/ another/path/withoutanychangedfiles/ yet/anotherpath/
2006 Jun 13
2
Compare ignoring the size AND file suffix: (not/) compressed files in a directory tree
Hello all, Here, we use rsync for years to share software tests distributions between from France to USA, Singapore and London, and all is working fine. But to save space we also need to compress files depending on their access time, and on purpose uncompress automatically before use. This makes rsync useless because it makes, of course re-transfer and deletions. when a new file is detected
2007 Jun 30
2
checksum-xattr.diff [CVS update: rsync/patches]
On 6/30/07, Wayne Davison <wayned@samba.org> committed: > Added Files: > checksum-xattr.diff > Log Message: > A simple patch that lets rsync use cached checksum values stored in > each file's extended attributes. A perl script is provided to create > and update the values. Wayne, You should be aware of two drawbacks of caching checksums in xattrs: First,
2006 Sep 21
5
rsyncing from win1251 to UTF-8
Hello! I need to sync directories from one machine to another. Source server uses win1251 (russian) codepage to store filenames. Destination server uses UTF-8. How could I avoid garbage in filenames after rsyncing? Can rsync recode filenames from one codepage to another? If no, is there any way to do this task? Thank you.
2009 May 03
6
[RFC] The reflink(2) system call.
Hi everyone, I described the reflink operation at the Linux Storage & Filesystems Workshop last month. Originally implemented as an ocfs2-specific ioctl, the consensus was that it should be a syscall from the get-go. Here's some first-cut patches. For people who have not seen reflink, either at LSF or on the ocfs2 wiki, the first patch contains Documentation/filesystems/reflink.txt to
2015 Feb 09
2
Another Fedora decision
On 10 February 2015 at 10:08, Kahlil Hodgson <kahlil.hodgson at dealmax.com.au> wrote: > I think you can simply submit a bug report under fedora documentation. Via bugzilla: https://bugzilla.redhat.com/enter_bug.cgi?product=Fedora%20Documentation
2010 Nov 05
3
ZFS vs mpxio vs cfgadm in Solaris.
Folks, I''m trying to figure out whether we should give ZFS / mpxio a shot on one of our research servers, or simply skip it (as we have previously). In Nov 2009 Cindy responded to a thread concerning ZFS device issues, cfgadm, and mpxio: http://mail.opensolaris.org/pipermail/zfs-discuss/2009-November/033496.html I''ve got an x2270 with the Sun EZ-SAS HBA and external SATA
2006 Jun 14
6
Cygwin rsync to RH rsync server
Hi all, I'm new to the rsync list. I've been searching for two days and have tried five different installs and so far none work the way I need them to. I have an "backup" server running rsync --version: rsync version 2.6.6 protocol version 29 Copyright (C) 1996-2005 by Andrew Tridgell and others <http://rsync.samba.org/> Capabilities: 64-bit files, socketpairs, hard
2015 Dec 23
3
Starting stunnel on boot with CentOS7
On my CenOS7 system with stunnel from base stunnel-4.56-4.el7.x86_64 there's a systemd service file /etc/systemd/system/stunnel.service try sudo systemctl enable stunnel.service Hope this helps, K ?al?
2008 Mar 04
3
Could you make the 2.6.9 source available via http again?
I noticed you've made rsync 3.0.0 available at http://www.samba.org/ftp/rsync/rsync-3.0.0.tar.gz, which is great! However, until it's upgraded (if ever), the buildroot system I'm using to build embedded linux tries to download rsync 2.6.9 from http://www.samba.org/ftp/rsync/rsync-2.6.9.tar.gz, which fails since this file is no longer available -- even though it's linked from
2015 May 15
2
Back to eth shuffling ...
Actually, I know what the MAC is for the builtin Port1 and 2. Those are listed in the BIOS. But ultimately I don't want to rely on them as I want the same kickstart file to work for other machines, so hardcoding those in the kickstart file wouldn't quite work, unless I start writing multiple kickstart files, one per machine. Anyway, lspci reports this: 00:19.0 Ethernet controller: Intel
2015 May 15
2
Back to eth shuffling ...
Right, I understand that part. However I believe I'm now in the realm of making this specific to this machine as I have no guarantee that another identical machine will pop up with those same bus IDs. Maybe for the internal ports, but I don't know if the same will happen for the PCIe bus. Would that be correct? On Thu, May 14, 2015 at 6:21 PM, Kahlil Hodgson < kahlil.hodgson at
2015 Feb 09
2
Another Fedora decision
On 10 February 2015 at 10:15, PatrickD Garvey <patrickdgarveyt at gmail.com> wrote: > Please allow me to make sure I am perceiving this correctly, > reports of errors found in RedHat documentation are to be reported > against the Fedora Documentation product type in the RedHat bugzilla? > and > reports of errors found in Fedora documentation are, also, to be > reported
2006 Jan 17
2
getting "diff" of directory trees
Given two directories "foo" and "fooprime", can I have rsync make a file or directory "d", that contains the differences between these two directories such that I can take d and apply it to foo to get fooprime, or take fooprime and reverse-apply d to it to get foo? I'm not sure that the --backup and --backup-dir options to rsync will give me exactly what I want.
2012 Jan 15
2
6.2 install fails on HP 6200pro (Intel Q65X chipset).
CentOS 5.6 x64 installs successfully on HP 6200pro SFF box with Intel Q65X Express chipset (including HD graphics), Core i5 and added NVS300 graphics card. Actually, it works great. HP lists "RedHat Enterprise x64" as a supported OS. The 6200pro is a "business desktop" that became available in early summer 2011. CentOS 6.2 x64 install halts during initial boot, with boot