Thanks I'll look this up. There is still the issue of how to get the target box cleaned up since I can no longer run --delete. /jl On Sun, Mar 27, 2016 at 02:49:02AM -0400, Kevin Korb wrote:> -----BEGIN PGP SIGNED MESSAGE----- > Hash: SHA1 > > You miss-understand the purpose of --link-dest. Yes, it gives you > multiple complete backups, but each only consumes the disk space > needed to store files that are unique to that backup. Files that are > the same in 2 backup runs are actually the same file in multiple > directories requiring only 1 to actually be stored. > > On 03/27/2016 02:39 AM, John Long wrote: > > Hi, > > > > On Fri, Mar 25, 2016 at 11:16:47AM -0400, Kevin Korb wrote: > > > >> If you were using --link-dest to make multiple backups you > >> wouldn't need --delete because the target is always a new empty > >> directory (with - --link-dest pointing to the previous backup > >> run). > > > > The source is around 200G and the target box only has 500G total > > and some of it is used for other data. What I want to do is mirror > > the source on the target and be able to prune the files that get > > deleted from the source from the target also. I don't have enough > > space to back up the whole thing and that is very time consuming > > anyway over 100M/b link which is why I was using --delete. For a > > long time it was ok, but now I don't have enough RAM. > > > > There is one giant directory that is probably problematic because > > it has a huge number of files. I suspect this is the one that's > > causing me problems but it is relatively static. I suppose it could > > be backed up and cleaned up separately. > > > > Is there any way to reduce RAM consumption on the target box while > > still getting the benefit of the --delete function? I am thinking > > of trying to back up everything but the gigantic directory with a > > large number of files, and then backing up only that directory. Is > > this a reasonable strategy? I just couldn't understand if --delete > > with --exclude would delete files from the target outside the > > --exclude path. I guess the answer is no but it would be a very > > time consuming mistake. I'm trying to make sure before I try it. > > > > Thanks for your help and I'm sorry for my poorly worded post(s). > > > > /jl > > > > - -- > ~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._., > Kevin Korb Phone: (407) 252-6853 > Systems Administrator Internet: > FutureQuest, Inc. Kevin at FutureQuest.net (work) > Orlando, Florida kmk at sanitarium.net (personal) > Web page: http://www.sanitarium.net/ > PGP public key available on web site. > ~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._., > -----BEGIN PGP SIGNATURE----- > Version: GnuPG v2 > > iEYEARECAAYFAlb3gl4ACgkQVKC1jlbQAQdZ7gCfXzhoaTSU2eW8fFUZQgA/8pjN > JQIAn3fQ6ESTB1gm1LT2AsO9kK4MV4ow > =Y4bU > -----END PGP SIGNATURE----- > > -- > Please use reply-all for most replies to avoid omitting the mailing list. > To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync > Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 You will have an old backup dir and a new backup dir. The new one will contain all the current stuff. The old one will contain what was current the last time you ran rsync. Just rm -rf the old one. Or keep a few. Or a few dozen. On 03/27/2016 02:54 AM, John Long wrote:> Thanks I'll look this up. There is still the issue of how to get > the target box cleaned up since I can no longer run --delete. > > /jl > > On Sun, Mar 27, 2016 at 02:49:02AM -0400, Kevin Korb wrote: You > miss-understand the purpose of --link-dest. Yes, it gives you > multiple complete backups, but each only consumes the disk space > needed to store files that are unique to that backup. Files that > are the same in 2 backup runs are actually the same file in > multiple directories requiring only 1 to actually be stored. > > On 03/27/2016 02:39 AM, John Long wrote: >>>> Hi, >>>> >>>> On Fri, Mar 25, 2016 at 11:16:47AM -0400, Kevin Korb wrote: >>>> >>>>> If you were using --link-dest to make multiple backups you >>>>> wouldn't need --delete because the target is always a new >>>>> empty directory (with - --link-dest pointing to the >>>>> previous backup run). >>>> >>>> The source is around 200G and the target box only has 500G >>>> total and some of it is used for other data. What I want to >>>> do is mirror the source on the target and be able to prune >>>> the files that get deleted from the source from the target >>>> also. I don't have enough space to back up the whole thing >>>> and that is very time consuming anyway over 100M/b link which >>>> is why I was using --delete. For a long time it was ok, but >>>> now I don't have enough RAM. >>>> >>>> There is one giant directory that is probably problematic >>>> because it has a huge number of files. I suspect this is the >>>> one that's causing me problems but it is relatively static. I >>>> suppose it could be backed up and cleaned up separately. >>>> >>>> Is there any way to reduce RAM consumption on the target box >>>> while still getting the benefit of the --delete function? I >>>> am thinking of trying to back up everything but the gigantic >>>> directory with a large number of files, and then backing up >>>> only that directory. Is this a reasonable strategy? I just >>>> couldn't understand if --delete with --exclude would delete >>>> files from the target outside the --exclude path. I guess the >>>> answer is no but it would be a very time consuming mistake. >>>> I'm trying to make sure before I try it. >>>> >>>> Thanks for your help and I'm sorry for my poorly worded >>>> post(s). >>>> >>>> /jl >>>> > >> >> -- Please use reply-all for most replies to avoid omitting the >> mailing list. To unsubscribe or change options: >> https://lists.samba.org/mailman/listinfo/rsync Before posting, >> read: http://www.catb.org/~esr/faqs/smart-questions.html >- -- ~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._., Kevin Korb Phone: (407) 252-6853 Systems Administrator Internet: FutureQuest, Inc. Kevin at FutureQuest.net (work) Orlando, Florida kmk at sanitarium.net (personal) Web page: http://www.sanitarium.net/ PGP public key available on web site. ~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._., -----BEGIN PGP SIGNATURE----- Version: GnuPG v2 iEYEARECAAYFAlb3hKgACgkQVKC1jlbQAQdqCgCdGPKy5BJGKP5oqwHFIt+I6zvw dgcAoJGkHyaai+LWPIWXiCDwTxz8V21+ =Gpd0 -----END PGP SIGNATURE-----
Thank you. On Sun, Mar 27, 2016 at 02:58:49AM -0400, Kevin Korb wrote:> -----BEGIN PGP SIGNED MESSAGE----- > Hash: SHA1 > > You will have an old backup dir and a new backup dir. The new one > will contain all the current stuff. The old one will contain what was > current the last time you ran rsync. Just rm -rf the old one. Or > keep a few. Or a few dozen. > > On 03/27/2016 02:54 AM, John Long wrote: > > Thanks I'll look this up. There is still the issue of how to get > > the target box cleaned up since I can no longer run --delete. > >