search for: korb

Displaying 20 results from an estimated 695 matches for "korb".

2018 Mar 20
2
Very slow to start sync with millions of directories and files
On Tue, Mar 20, 2018 at 5:49 PM Kevin Korb <kmk at sanitarium.net> wrote: > Nothing there should be preventing incremental indexing. That means it > should start copying as soon as it finds a file that needs to be copied. > Doesn't it tries to create all (empty) directories first? > On 03/20/2018 02:33 PM, Bráulio...
2016 Jun 02
2
rsync keeps writing files over
...ing how to interpret —itemize-changes? The timestamps aren’t changing, so the target must not be storing them, which I have no idea why. The directory I’m writing to is 777. What is the flag to tell rsync to ignore the timestamps? Thanks, Blake On 6/2/16, 6:18 PM, "rsync on behalf of Kevin Korb" <rsync-bounces at lists.samba.org on behalf of kmk at sanitarium.net> wrote: >It is saying the timestamp is wrong and that it is copying the file and >changing the timestamp. If it does that every time then either the >timestamps are changing on the source or the target isn...
2017 Apr 07
3
modification times questions
...rsync dryrun with -i I can see that it wants to transfer the files because of times. When I run rsync a second time with your suggestion the times do transfer over. I don't know why... B ________________________________________ From: rsync [rsync-bounces at lists.samba.org] on behalf of Kevin Korb via rsync [rsync at lists.samba.org] Sent: Friday, April 07, 2017 2:58 PM To: rsync at lists.samba.org Subject: Re: modification times questions If you are sure the content is correct you can run rsync with both --times and --size-only. This will cause rsync to "fix" the timestamps on f...
2018 Mar 20
2
Very slow to start sync with millions of directories and files
Em seg, 19 de mar de 2018 11:34, Kevin Korb via rsync <rsync at lists.samba.org> escreveu: > The performance of rsync with a huge number of files is greatly > determined by every option you are using. So, what is your whole > command line? > rsync -avP /data-old/ /data > > On 03/19/2018 09:05 AM, Bráulio Bhavamitra...
2016 Jun 02
2
rsync keeps writing files over
...px >f..t....... >2012_79_1_14_1__1199_Workprint/2012_79_1_14_1__1199_Workprint__UHD_DPX/119 >9WP_00086405.dpx >f..t....... >2012_79_1_14_1__1199_Workprint/2012_79_1_14_1__1199_Workprint__UHD_DPX/119 >9WP_00086406.dpx ~Blake On 6/2/16, 5:44 PM, "rsync on behalf of Kevin Korb" <rsync-bounces at lists.samba.org on behalf of kmk at sanitarium.net> wrote: >Instead of the second -v (or even the first) add --itemize-changes. It >will tell you why each file is being copied. If the file timestamps are >not correct then perhaps the underlying storage does...
2016 Jun 02
9
rsync keeps writing files over
...using. Yes, I imagine rsync is not the best for linear tape but give the choice between cp (which is faster and causes less problems but offers almost zero verbosity) and rsync, I’ll choose rsync. If people know of other options, I’d be very happy to know of them. On 6/2/16, 6:33 PM, "Kevin Korb" <kmk at sanitarium.net> wrote: >The man page has a section on what all the itemize-changes flags do. > >There is a --ignore-times but the result is what you have now, re-copy >everything even if the timestamp matches. > >The best you can really do with storage that ca...
2016 Jun 24
2
--partial not working?
.... So, if I am running partial (-P) and not using --whole-file or disabling the delta-transmission, why would an incomplete file be deleted and the transfer start anew after an interruption? Blake -----Original Message----- From: rsync [mailto:rsync-bounces at lists.samba.org] On Behalf Of Kevin Korb Sent: Friday, June 24, 2016 12:03 PM To: rsync at lists.samba.org Subject: Re: --partial not working? Partial means don't delete the incomplete file. The file is being transferred because it doesn't match. But rsync does delta-transfers so it won't actually transfer the parts that ma...
2016 Jun 24
2
--partial not working?
...understand what you mean by "rsync isn't doing the networking", but if it is not doing this then is there no checksumming occurring during the transfer? Unless, of course, -c. Thanks! -----Original Message----- From: rsync [mailto:rsync-bounces at lists.samba.org] On Behalf Of Kevin Korb Sent: Friday, June 24, 2016 3:07 PM To: rsync at lists.samba.org Subject: Re: --partial not working? If you are doing a local only copy (rsync isn't networking) then --whole-file is forced. There is no benefit of reading and checksumming files to reduce network transfer when there is no netwo...
2016 Jun 02
0
rsync keeps writing files over
...sync is not the best for linear tape but give the choice > between cp (which is faster and causes less problems but offers almost > zero verbosity) and rsync, I’ll choose rsync. If people know of other > options, I’d be very happy to know of them. > > On 6/2/16, 6:33 PM, "Kevin Korb" <kmk at sanitarium.net> wrote: > >> The man page has a section on what all the itemize-changes flags do. >> >> There is a --ignore-times but the result is what you have now, re-copy >> everything even if the timestamp matches. >> >> The best you c...
2016 Jan 23
2
Why is my rsync transfer slow?
-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 I want to know what your whole command line was so I can understand your results. On 01/23/2016 04:57 PM, dbonde+forum+rsync.lists.samba.org at gmail.com wrote: > On 2016-01-23 22:02, Kevin Korb wrote: >> What was your rsync source and target that made those? > > What do you mean? Filesystem is HFS (Mac OS X). Rsync version is > 3.1.2 from MacPorts. Source is a regular directory/folder on an > external HD, destination is a disk image. > - -- ~*-,._.,-*~'`^`'...
2016 Jan 23
2
Why is my rsync transfer slow?
-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 I need to know what the paths were so I know how they relate to the file names you listed. On 01/23/2016 05:10 PM, dbonde+forum+rsync.lists.samba.org at gmail.com wrote: > On 2016-01-23 22:59, Kevin Korb wrote: >> I want to know what your whole command line was so I can >> understand your results. > > % rsync -HzvhErlptgoDW --stats --progress --out-format="%t %f %b" > /source/ /destination/ > > (and after the interruption I removed z) > - -- ~*-,._.,-*~...
2016 Jan 23
2
Why is my rsync transfer slow?
-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 What was your rsync source and target that made those? On 01/23/2016 03:44 PM, dbonde+forum+rsync.lists.samba.org at gmail.com wrote: > On 2016-01-23 21:16, Kevin Korb wrote: >> As long as it still sees both links it is fine. >> >> Essentially, the way it works is that whenever rsync -H (on the >> source) sees a file with a link count >1 it remembers the >> inode#>filename pair. If it finds another instance of that inode &g...
2016 Mar 27
2
Memory consumption for rsync -axv --delete
Thanks I'll look this up. There is still the issue of how to get the target box cleaned up since I can no longer run --delete. /jl On Sun, Mar 27, 2016 at 02:49:02AM -0400, Kevin Korb wrote: > -----BEGIN PGP SIGNED MESSAGE----- > Hash: SHA1 > > You miss-understand the purpose of --link-dest. Yes, it gives you > multiple complete backups, but each only consumes the disk space > needed to store files that are unique to that backup. Files that are > the same...
2015 Sep 10
2
Doubt on usage of rsync for chown of existing folders
...su). Then, by trying again with rsync but with no modification in the source folder, I see that file ownership continues the same. Would be possible for rsync to change the ownership in this case (I am not root) ? Thanks, Regards,CJ Em Quinta-feira, 10 de Setembro de 2015 20:01, Kevin Korb <kmk at sanitarium.net> escreveu: -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 The syntax looks correct.  However, note that only root can chown. You must be running rsync on the target end as root for --chown or - --owner to work.  If you aren't using root access then just run th...
2018 Mar 20
0
Very slow to start sync with millions of directories and files
It creates the directories as it needs them. If you want to watch it looking through files it doesn't need to copy you can add -ii (see --itemize-changes for what the output means). On 03/20/2018 05:24 PM, Bráulio Bhavamitra wrote: > > > On Tue, Mar 20, 2018 at 5:49 PM Kevin Korb <kmk at sanitarium.net > <mailto:kmk at sanitarium.net>> wrote: > > Nothing there should be preventing incremental indexing.  That means it > should start copying as soon as it finds a file that needs to be copied. > > Doesn't it tries to create all (empt...
2017 Mar 23
2
rsync: "-c" option clarification
...e you can cause a case of a file with matching mtime+size but not matching checksum due to gzip's metadata even though the uncompressed result is identical. I would not consider this to be a case worth updating the remote copy but I am sure someone will disagree. On 03/23/2017 03:49 PM, Kevin Korb via rsync wrote: > The -c option causes rsync to checksum EVERY file on both ends BEFORE > rsync does anything else. It checksums files that are on only 1 end. > It checksums files that are different sizes. It will not catch a > hardware problem preventing rsync from writing a file co...
2020 Mar 16
2
Would you expect --perms -M--fake-super to set the file mode to the original one?
Thanks. This is a bit counter-intuitive to me. So how would you tell rsync to store the original permissions in the xattr, but do not touch the real file mode? On Thursday, March 12, 2020 6:26:18 PM CET, Kevin Korb via rsync wrote: > I would expect that the sending rsync would only send the perms provided > modified by the --chmod. I wouldn't expect the receiver to even know > the other permissions. > > On 3/12/20 1:23 PM, Dimitrios Apostolou via rsync wrote: >> Thank you for the fee...
2015 Apr 13
4
How to discern when like dir names exist in 2 places
Hi, On Mon, 13 Apr 2015 12:59:07 -0400 Kevin Korb wrote: > Hmmm, according to my interpretation of the man page (I am on 3.1.1) > that is supposed to work however when I test using the "-/ > /etc/passwd" example the / seems to have the same effect as commenting > the line. I get /etc/passwd copied whether the source is / or...
2017 Apr 07
3
modification times questions
How do I transfer just the modification times with rsync? I now the file content is the same but the modification times are different. Is there a way to do this? Every way that I have tried causes the whole file to transfer as well. Thanks -------------- next part -------------- An HTML attachment was scrubbed... URL:
2016 Jan 23
2
Why is my rsync transfer slow?
...ly on the next run. It just won't handle it if you rsync tree #1 then rsync tree #2. It won't see a hard link that is common to both since it wasn't analyzing them together. On 01/23/2016 03:04 PM, dbonde+forum+rsync.lists.samba.org at gmail.com wrote: > On 2016-01-23 17:50, Kevin Korb wrote: >> It will, assuming it sees both links in the same rsync run. > > How does one handle interrupted transfers if one wants to preserve > hard links? Would --partial and --append-verify work? > - -- ~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~...