similar to: rsync algorithm

Displaying 20 results from an estimated 40000 matches similar to: "rsync algorithm"

2012 Jan 18
2
rsync overall progress patch
Hi everyone, I'm trying to implement calculation of overall progress for rsync. Currently it shows progress only on per file basis. So I need for the feature size of all files to be synced - this is obvious and already exists in the code. I can calculate size of transferred files, but I can't find the piece of code that is responsible for calculation of checksums. I don't understand
2007 Jun 30
2
checksum-xattr.diff [CVS update: rsync/patches]
On 6/30/07, Wayne Davison <wayned@samba.org> committed: > Added Files: > checksum-xattr.diff > Log Message: > A simple patch that lets rsync use cached checksum values stored in > each file's extended attributes. A perl script is provided to create > and update the values. Wayne, You should be aware of two drawbacks of caching checksums in xattrs: First,
2008 Apr 27
1
rsync checksums
Hi all ! I am currently trying to find a smart way to long-term-backup my data. I currently do link-dest-updates to an external hdd. However, I am concerned about data corruption in the backup or the original, i.e. corruption of the data inside the files. Thus i am wondering if there is a way to check the integrity of the backups on the external disk. i.e. to avoid data degradation for
2008 Jul 11
1
rsync to servers highly sensitive to IO load
We would like to use rsync to deploy large data files over an (all to often) faulty WAN connection. In the past, we've used scp and, when a transfer got interrupted, it would have to be restarted from scratch. This is why we've begun experimenting with rsync. The problem we're having with rsync stems from its use of checksums. The target systems we're deploying data to are highly
2017 Mar 23
2
rsync: "-c" option clarification
Before anyone yells at me, yes, you can use rsync's --checksum to detect (and fix) files that are incorrect despite having correct timestamps and sizes. This would mean that a previous rsync had been corrupted not the current one. But it is important to note that this would only be reported to you if you also use --itemize-changes and what to look for (a file with a c but not an s or a t).
2007 Nov 09
1
Re: binary does not run on samba-3.0.26a
hce <webmail.hce@gmail.com> wrote: > I built the samba from source samba-3.0.26a on FC6. But when I run > "nmbd -F --debuglevel=5 --configfile=/home/test/smb.conf > --log-basename=/home/test/log.txt", nothing happens. The process is > not there, the log file is not created. What could I be missing here? Not really samba-specific, but whenever I need to track down
2010 Aug 11
4
backup option
Hi, I am using rsync to backup files. Is it possible to specify an option not to delete files from backup directory if the files are deleted from source? In that way, I can always keep something I may or may not need in the backup disk, but remove it from a work computer. Thank you. Kind Regards. hce
2013 Nov 12
1
Need hint for my question regarding the working of rsync.
Hello, Since English is my second language, forgive me for any typing errors. I have been studying rsync for my academic project. I learned quite a lot but I need little help. My question is, does rsync sends all checksum of a file at once or in batches. For example suppose I have a 2 GB file, so after generating checksum on receiver side, does the receiver sends all the generated checksum to the
2017 Mar 23
2
rsync: "-c" option clarification
Hi I am using "rsync" to send files from a source machine to a remote machine as one typically does. I would like to clarify that the "-c" option will cause the checksum on the receiving end to be created by reading the already written file and NOT the data stream on the receiving end. This would help in catching disk I/O errors if the checksum is done on the file on disk.
2005 Feb 24
6
Rsyncing really large files
Hello everyone, I have a question regarding syncing of large files. We have a setup where we need to sync a 500GB file with changes in random blocks. The changes are made in a manner, so moving blocks is not probable (actually it will never happen). As I understand it, the way rsync works is: - remote server calculates all checksum blocks and transmits these to client - local client calculates
2009 Sep 04
2
rsync algorithm for large files
I thought rsync, would calculate checksums of large files that have changed timestamps or filesizes, and send only the chunks which changed. Is this not correct? My goal is to come up with a reasonable (fast and efficient) way for me to daily incrementally backup my Parallels virtual machine (a directory structure containing mostly small files, and one 20G file) I?m on OSX 10.5, using rsync
2003 Jan 28
1
Rsync checksums
Hi, This is a newbie type'o'question so I'm most probably talking about something I know nothing about ;) Would it be possible to archive files on a removable drive, save the checksums for the archived files, and later compare existing files against the saved checksums without plugging in the removable drive? I imagine in theory this would allow for an easy incremental-backup-to-CD
2008 Mar 10
2
New rsync option checksum-path
This is a suggestion for adding to rsync an option "--checksum-path=PROGRAM". Once this option is given, provided it is accompained by option "--checksum", both the receiving and sending side of rsync would compute checksums calling PROGRAM, instead of the usual checksum program. Why is this usefull? Suppose I have two collections of MP3 files at different locations which I
2008 May 22
6
DO NOT REPLY [Bug 5482] New: apply the rsync comparison algorithm specially to .mov and .mp4 files
https://bugzilla.samba.org/show_bug.cgi?id=5482 Summary: apply the rsync comparison algorithm specially to .mov and .mp4 files Product: rsync Version: 3.0.2 Platform: All OS/Version: All Status: NEW Severity: enhancement Priority: P3 Component: core AssignedTo: wayned@samba.org
2001 Nov 14
3
times difference causes write
Using rsync-2.4.6: Is a times difference supposed to cause a write? Also -t vs -I makes no difference. Below shows the problem, I think: [dmahurin@pc16 /tmp]$ mkdir x y [dmahurin@pc16 /tmp]$ cp /bin/ls x [dmahurin@pc16 /tmp]$ ls -l x/ls -rwxr-xr-x 1 dmahurin users 43024 Nov 13 12:46 x/ls [dmahurin@pc16 /tmp]$ rsync -vrtW x/ y building file list ... done ./ ls ./ wrote 43112 bytes
2005 Feb 09
1
Query re: rolling checksum algorithm of rsync
Hi, I had a query wrt the topic of rsync's rolling checksum algorithm: If I have a fileA that is a database file of size 100 MB on local machine. I back it up first time (full backup) using rsync to the server assuming block_size to be 30 KB and --compress option to compress data as it is transferred. Next time, I modify the fileA with another 100 MB new contents towards the end
2019 Jan 02
6
[Bug 13735] New: Synchronize files when the sending side has newer change times while modification times and sizes are identical on both sides
https://bugzilla.samba.org/show_bug.cgi?id=13735 Bug ID: 13735 Summary: Synchronize files when the sending side has newer change times while modification times and sizes are identical on both sides Product: rsync Version: 3.1.3 Hardware: All OS: All Status: NEW
2009 Aug 06
5
rsync speedup - how ?
Hello, i`m using rsync to sync large virtual machine files from one esx server to another. rsync is running inside the so called "esx console" which is basically a specially crafted linux vm with some restrictions. the speed is "reasonable", but i guess it`s not the optimum - at least i don?t know where the bottleneck is. i`m not using ssh as transport but run rsync in
2007 Oct 30
3
Rsync hard-links devices with different mtimes despite -t: expected?
I noticed that rsync is happy to hard-link a device node from a --link-dest dir even if its mtime differs from that of the source device node and --times is given. Is this behavior expected? It seems to break the rule that a difference in preserved attributes disqualifies a hard link. To see the behavior, run the following as root: mkdir src dest basis mknod src/null c 1 3 sleep 1 mknod
2004 May 06
2
rsync-2.6.2: NFS clients confused after an rsync
We use rsync to update an nfs server. After an update, we noticed that a large number of clients didn't see the updated data. It took me a while to be able to reliably reproduce this problem, but it happens on old and new versions of rysnc. It also happens across all the platforms we use here (sun/linux/netapp). This shows the problem: [Note my home directory is NFS mounted]