rsync version 3.1.2 protocol version 31
I've run into an issue using rsync on my QNAP NAS. I've installed
Entware-ng
on the NAS so that I can install better versions of programs, rsync being
one of them.
But, I've run into an issue wqith using the --delete option, as it has
problems using wildcards.
Initially a backup script looked like:
#!/bin/sh
for d in /share/Public/videos/[Gg]*
do
rsync -av --delete $d /share/Backup-HDD-03
done
I've discovered that any directory that starts with "A", or
"a" that is on
the backup disk that is no longer on the source disk is not getting deleted.
In order to only back up directories/files that start with "G", or
"g",
required a script that looks like:
#!/bin/sh
pushd /share/Public/videos
ls -d [0-9A-FH-Za-fh-z]* > /share/homes/admin/bin/backup_exclude_list
echo "lost+found" >> /share/homes/admin/bin/backup_exclude_list
for d in .
do
rsync -av --delete --exclude-from=/share/homes/admin/bin/backup_exclude_list \
$d /share/Backup-HDD-03
done
popd
There has to be a much simplier script, or is this really it?
Thanks for any tips.
MB
--
e-mail: vidiot at vidiot.com | vidiot at vidiot.net /~\ The ASCII
6082066843 at email.uscc.net (140 char limit) \ / Ribbon Campaign
Visit - URL: http://vidiot.com/ X Against
http://vidiot.net/ / \ HTML Email
"What do you say Beckett. Wanna have a baby?" - Castle to Det. Beckett
"How long have I been gone?" Alexis after seeing Castle and Beckett w/
baby
- Castle - 11/25/13
--delete only works when you sync a dir not individual files. So... rsync -vai --delete --include='g*' --include='G*' --exclude='*' /share/Public/videos/ /share/Backup-HDD-03 On 05/03/2018 12:08 AM, Mike Brown via rsync wrote:> rsync version 3.1.2 protocol version 31 > > I've run into an issue using rsync on my QNAP NAS. I've installed Entware-ng > on the NAS so that I can install better versions of programs, rsync being > one of them. > > But, I've run into an issue wqith using the --delete option, as it has > problems using wildcards. > > Initially a backup script looked like: > > #!/bin/sh > for d in /share/Public/videos/[Gg]* > do > rsync -av --delete $d /share/Backup-HDD-03 > done > > I've discovered that any directory that starts with "A", or "a" that is on > the backup disk that is no longer on the source disk is not getting deleted. > > In order to only back up directories/files that start with "G", or "g", > required a script that looks like: > > #!/bin/sh > pushd /share/Public/videos > ls -d [0-9A-FH-Za-fh-z]* > /share/homes/admin/bin/backup_exclude_list > echo "lost+found" >> /share/homes/admin/bin/backup_exclude_list > for d in . > do > rsync -av --delete --exclude-from=/share/homes/admin/bin/backup_exclude_list \ > $d /share/Backup-HDD-03 > done > popd > > There has to be a much simplier script, or is this really it? > > Thanks for any tips. > > MB >-- ~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._., Kevin Korb Phone: (407) 252-6853 Systems Administrator Internet: FutureQuest, Inc. Kevin at FutureQuest.net (work) Orlando, Florida kmk at sanitarium.net (personal) Web page: https://sanitarium.net/ PGP public key available on web site. ~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._., -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 195 bytes Desc: OpenPGP digital signature URL: <http://lists.samba.org/pipermail/rsync/attachments/20180503/5bf35f4d/signature.sig>
On Thu, May 03, 2018 at 01:09:30AM -0400, Kevin Korb via rsync wrote:> --delete only works when you sync a dir not individual files. So... > rsync -vai --delete --include='g*' --include='G*' --exclude='*' > /share/Public/videos/ /share/Backup-HDD-03That kinda didn't work: rsync -vai --delete --include='S[A-Z]*' --include='S[a-h]*' --exclude='*' \ /share/Public/videos/ /share/Backup-HDD-04 I deleted, manually, a directory on the backup HDD to test this out and got the following result: NASD30354.ZADMIN <795> ./Backup-HDD-04.list.sh sending incremental file list .d..t...... ./ cd+++++++++ Sense8/ cd+++++++++ Sense8/Season-1/ cd+++++++++ Sense8/Season-2/ sent 25,683 bytes received 82 bytes 17,176.67 bytes/sec total size is 1,666,354,406,916 speedup is 64,675,117.68 None of the files in those two directories were copied to the backup HDD after the directories were created. I then modified the script so that I could include directories that start with "s": rsync -vain --delete --include='S[A-Z]*' --include='S[a-h]*' \ --include='s*' --exclude='*' \ /share/Public/videos/ /share/Backup-HDD-04 I then got the following result (yes, in dry-run mode): NASD30354.ZADMIN <802> ./Backup-HDD-04.list.sh sending incremental file list>f+++++++++ Sense8/Season-1/sense8.s01e01.1080p.webrip.x264-2hd.mkv >f+++++++++ Sense8/Season-1/sense8.s01e02.1080p.webrip.x264-2hd.mkv >f+++++++++ Sense8/Season-1/sense8.s01e03.1080p.webrip.x264-2hd.mkv >f+++++++++ Sense8/Season-1/sense8.s01e04.1080p.webrip.x264-2hd.mkv >f+++++++++ Sense8/Season-1/sense8.s01e05.1080p.webrip.x264-2hd.mkv >f+++++++++ Sense8/Season-1/sense8.s01e06.1080p.webrip.x264-2hd.mkv >f+++++++++ Sense8/Season-1/sense8.s01e07.1080p.webrip.x264-2hd.mkv >f+++++++++ Sense8/Season-1/sense8.s01e08.1080p.webrip.x264-2hd.mkv >f+++++++++ Sense8/Season-1/sense8.s01e09.1080p.webrip.x264-2hd.mkv >f+++++++++ Sense8/Season-1/sense8.s01e10.1080p.webrip.x264-2hd.mkv >f+++++++++ Sense8/Season-1/sense8.s01e11.1080p.webrip.x264-2hd.mkv >f+++++++++ Sense8/Season-1/sense8.s01e12.1080p.webrip.x264-2hd.mkv >f+++++++++ Sense8/Season-2/sense8.s02e01.1080p.webrip.x264-skgtv.mkv >f+++++++++ Sense8/Season-2/sense8.s02e02.1080p.webrip.x264-skgtv.mkv >f+++++++++ Sense8/Season-2/sense8.s02e03.1080p.webrip.x264-skgtv.mkv >f+++++++++ Sense8/Season-2/sense8.s02e04.1080p.webrip.x264-skgtv.mkv >f+++++++++ Sense8/Season-2/sense8.s02e05.1080p.webrip.x264-skgtv.mkv >f+++++++++ Sense8/Season-2/sense8.s02e06.1080p.webrip.x264-morose.mkv >f+++++++++ Sense8/Season-2/sense8.s02e07.1080p.webrip.x264-morose.mkv >f+++++++++ Sense8/Season-2/sense8.s02e08.1080p.webrip.x264-morose.mkv >f+++++++++ Sense8/Season-2/sense8.s02e09.1080p.webrip.x264-morose.mkv >f+++++++++ Sense8/Season-2/sense8.s02e10.1080p.webrip.x264-morose.mkvsent 26,729 bytes received 132 bytes 53,722.00 bytes/sec total size is 1,749,617,318,885 speedup is 65,135,971.07 (DRY RUN) I kinda see what is going on, based upon the man page and filter rules. I was worried about getting stuff that starts with "s", so I renamed a file so that the frst letter was now a "s" and it was listed for copying. Since a majority of the files start with all-caps, I don't think I'll run into an issue of copying more files that I really wanted. Thanks for the tip, as I now have something to work with. MB -- e-mail: vidiot at vidiot.com | vidiot at vidiot.net /~\ The ASCII 6082066843 at email.uscc.net (140 char limit) \ / Ribbon Campaign Visit - URL: http://vidiot.com/ X Against http://vidiot.net/ / \ HTML Email "What do you say Beckett. Wanna have a baby?" - Castle to Det. Beckett "How long have I been gone?" Alexis after seeing Castle and Beckett w/ baby - Castle - 11/25/13