rsync - Jun 2008 - link-dest storage saving on backup server not on usb hard drive

I have setup rsync to backup another linux computer with the link-dest option
and realized storage savings.  1st backup is 31gb, daily backups only take
approx 4gb. But when I rsync with link-dest to usb external drive all
backups take up 31gb.  Following is 1st the one that works and 2nd with no
storage savings.  Any ideas?  Thanks, Frank

date>/aeprodbk/bkupdate
d=`date +%d`
date > $d.log
root@aebkup:/aeprodbk/$d >>$d.log
rsync --exclude-from=/root/bkup_excludes -avz --delete -e "ssh -i
/root/cron/aebkup-rsync-key" --link-dest=/aeprodbk/current root@aeprod:/
/aeprodbk/$d >>$d.logdate > /aeprodbk/$d/bkupdate
rm -f /aeprodbk/current
ln -s /aeprodbk/$d /aeprodbk/current

2nd script with no storage saving
d=`date +%d`
dsk=/media/disk
cd $dsk
date > /usb$d.log
rsync --exclude-from=/root/bkup_excludes -av --delete
--link-dest=$dsk/current /aeprodbk/$d $dsk >> /usb$d.log
date>$dsk/$d/bkupdate
date>$dsk/bkupdate
rm -f $dsk/current
ln -s $dsk/$d $dsk/current


-- 
View this message in context:
http://www.nabble.com/link-dest-storage-saving-on-backup-server-not-on-usb-hard-drive-tp18116450p18116450.html
Sent from the Samba - rsync mailing list archive at Nabble.com.

Hi,

On 26/06/2008, fglos <feglos@gmail.com> wrote:
>
>  I have setup rsync to backup another linux computer with the link-dest
option
>  and realized storage savings.  1st backup is 31gb, daily backups only take
>  approx 4gb. But when I rsync with link-dest to usb external drive all
>  backups take up 31gb.  Following is 1st the one that works and 2nd with no
>  storage savings.  Any ideas?  Thanks, Frank
Is it possible that the external disk is formatted with a file system
that doesn't support hard links?  If it is formatted with a Linux/Unix
fs such as ext3 it should be ok.  I think NTFS should work too.  But if
it is formatted for FAT32 or some variant then you cannot create hard
links so there can be no saving from --link-dest.

David

On Wed, 2008-06-25 at 12:50 -0700, fglos wrote:
> I have setup rsync to backup another linux computer with the link-dest
option
> and realized storage savings.  1st backup is 31gb, daily backups only take
> approx 4gb. But when I rsync with link-dest to usb external drive all
> backups take up 31gb.  Following is 1st the one that works and 2nd with no
> storage savings.  Any ideas?  Thanks, Frank
> rsync --exclude-from=/root/bkup_excludes -avz --delete -e "ssh -i
/root/cron/aebkup-rsync-key" --link-dest=/aeprodbk/current root@aeprod:/
/aeprodbk/$d >>$d.log
> rsync --exclude-from=/root/bkup_excludes -av --delete
--link-dest=$dsk/current /aeprodbk/$d $dsk >> /usb$d.log
The trouble is that on the second run, the file-list paths of the files
begin with $d (since the source lacks a trailing slash), so the
--link-dest option is looking for previous files under $dsk/current/$d .
To fix this, add a trailing slash and adjust the destination
correspondingly:

?rsync --exclude-from=/root/bkup_excludes -av --delete --link-dest=$dsk/current
/aeprodbk/$d/ $dsk/$d >> /usb$d.log

Matt
-------------- next part --------------
A non-text attachment was scrubbed...
Name: not available
Type: application/pgp-signature
Size: 197 bytes
Desc: This is a digitally signed message part
Url :
http://lists.samba.org/archive/rsync/attachments/20080625/2561962c/attachment.bin

Matt, You hit it dead on.  Thanks so much.  This was making me crazy.  Bye,
Frank


Matt McCutchen-7 wrote:
> 
> On Wed, 2008-06-25 at 12:50 -0700, fglos wrote:
>> I have setup rsync to backup another linux computer with the link-dest
>> option
>> and realized storage savings.  1st backup is 31gb, daily backups only
>> take
>> approx 4gb. But when I rsync with link-dest to usb external drive all
>> backups take up 31gb.  Following is 1st the one that works and 2nd with
>> no
>> storage savings.  Any ideas?  Thanks, Frank
> 
>> rsync --exclude-from=/root/bkup_excludes -avz --delete -e "ssh -i
>> /root/cron/aebkup-rsync-key" --link-dest=/aeprodbk/current
root@aeprod:/
>> /aeprodbk/$d >>$d.log
> 
>> rsync --exclude-from=/root/bkup_excludes -av --delete
>> --link-dest=$dsk/current /aeprodbk/$d $dsk >> /usb$d.log
> 
> The trouble is that on the second run, the file-list paths of the files
> begin with $d (since the source lacks a trailing slash), so the
> --link-dest option is looking for previous files under $dsk/current/$d .
> To fix this, add a trailing slash and adjust the destination
> correspondingly:
> 
> ?rsync --exclude-from=/root/bkup_excludes -av --delete
> --link-dest=$dsk/current /aeprodbk/$d/ $dsk/$d >> /usb$d.log
> 
> Matt
> 
>  
> -- 
> Please use reply-all for most replies to avoid omitting the mailing list.
> To unsubscribe or change options:
> https://lists.samba.org/mailman/listinfo/rsync
> Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
> 
-- 
View this message in context:
http://www.nabble.com/link-dest-storage-saving-on-backup-server-not-on-usb-hard-drive-tp18116450p18141787.html
Sent from the Samba - rsync mailing list archive at Nabble.com.