rsync - Apr 2008 - DO NOT REPLY [Bug 5365] New: --backup and --xattrs are not compatible

https://bugzilla.samba.org/show_bug.cgi?id=5365

           Summary: --backup and --xattrs are not compatible
           Product: rsync
           Version: 3.0.0
          Platform: x86
        OS/Version: Other
            Status: NEW
          Severity: normal
          Priority: P3
         Component: core
        AssignedTo: wayned@samba.org
        ReportedBy: fauthier@free.fr
         QAContact: rsync-qa@samba.org


system on both server :
os x server 10.4.11

rsync version is 3.0.1pre3 (no patch)

rsync syntaxe :
/usr/local/bin/rsync  --rsync-path=/usr/local/bin/rsync -avW --acls --xattrs
--del --force --backup --backup-dir=/`date +%Y%m%d-%Hh%M`   /Source
Server2:/Dest/

Sometimes I have this error :

Missing abbreviated xattr value, com.apple.ResourceFork, for
"/Volumes/Data/Sauvegardes/DESC1_VOL1/20080401-15h54/DESCMDL/BASE-Studio.DF1"
Missing abbreviated xattr value, com.apple.ResourceFork, for
"/Partages/DESC1_VOL1/DESCMDL/.BASE-Studio.DF1.nVN4cq"
rsync: writefd_unbuffered failed to write 4 bytes [sender]: Broken pipe (32)
rsync: connection unexpectedly closed (737 bytes received so far) [sender]
rsync error: error in rsync protocol data stream (code 12) at io.c(635)
[sender=3.0.1pre3]

and sometimes this error :
No matching processes were found
Missing abbreviated xattr value, com.apple.ResourceFork, for
"/Volumes/Data/Sauvegardes/DESC1_VOL1/20080401-18h03/DESCMDL/BASE-Studio.DF1"
Missing abbreviated xattr value, com.apple.ResourceFork, for
"/Partages/DESC1_VOL1/DESCMDL/.BASE-Studio.DF1.UU9irt"

The resource forks are not copied ont the destination server in the directory
backup (incremental) (it's ok for the destination directory), but the script
continue.

With the xattr patch, this the same.
without --backup and --backup-dir, they are no problem

I think (a little ;-)) that the move (binary mv) between the destination
directory and the backup directory not preserve the metadata (contrary with the
binary MvMac or CpMac)
Thank you
F.A.


-- 
Configure bugmail: https://bugzilla.samba.org/userprefs.cgi?tab=email
------- You are receiving this mail because: -------
You are the QA contact for the bug, or are watching the QA contact.

https://bugzilla.samba.org/show_bug.cgi?id=5365


wayned@samba.org changed:

           What    |Removed                     |Added
----------------------------------------------------------------------------
             Status|NEW                         |ASSIGNED




------- Comment #1 from wayned@samba.org  2008-04-01 21:31 CST -------
Thanks for the report.  It sounds like I need to make the code on the generator
side never use an abbreviated value when it is copying the data (unlike the
data coming from the sender, which will abbreviate long values and compare
checksums).  I'll look into this for the release after 3.0.1.

For now, you may be able to apply the acls.diff and xattrs.diff
backward-compatibility patches, and then try using --protocol=29 for an xattr
copy with --backup.  That combination avoids abbreviated long values since the
older protocol did not suppor them.


-- 
Configure bugmail: https://bugzilla.samba.org/userprefs.cgi?tab=email
------- You are receiving this mail because: -------
You are the QA contact for the bug, or are watching the QA contact.

https://bugzilla.samba.org/show_bug.cgi?id=5365





------- Comment #2 from fauthier@free.fr  2008-04-10 11:30 CST -------
now rsync version : 
3.0.2 (no patch)
option :
 --rsync-path=/usr/local/bin/rsync -avWAX --del --force --backup
--backup-dir=`date`  

3 errors :
1:
[sender] internal abbrev error!
rsync error: error in rsync protocol data stream (code 12) at xattrs.c(548)
[sender=3.0.2]
rsync: writefd_unbuffered failed to write 4 bytes [generator]: Broken pipe (32)
rsync error: error in rsync protocol data stream (code 12) at io.c(1543)
[generator=3.0.2]
rsync error: received SIGUSR1 (code 19) at main.c(1277) [receiver=3.0.2]

2:
Missing abbreviated xattr value, com.apple.ResourceFork, for
"/Volumes/Data/Sauvegardes/DESC1_VOL1/20080410-16h14/DESCMDL/BASE-Studio.DF1"
Missing abbreviated xattr value, com.apple.ResourceFork, for
"/Partages/DESC1_VOL1/DESCMDL/.BASE-Studio.DF1.yaEeuH"

3:
rsync: writefd_unbuffered failed to write 4 bytes [sender]: Broken pipe (32)
rsync: connection unexpectedly closed (913 bytes received so far) [sender]
rsync error: error in rsync protocol data stream (code 12) at io.c(635)
[sender=3.0.2]


There are the sames error with rsync 3.0.2 and the acls.diff and xattr.diff
patches. (with --protocol=29 no run too)
Thanks


-- 
Configure bugmail: https://bugzilla.samba.org/userprefs.cgi?tab=email
------- You are receiving this mail because: -------
You are the QA contact for the bug, or are watching the QA contact.

https://bugzilla.samba.org/show_bug.cgi?id=5365





------- Comment #3 from wayned@samba.org  2008-04-10 13:57 CST -------
Yes, that's why this bug is marked as assigned and not fixed.


-- 
Configure bugmail: https://bugzilla.samba.org/userprefs.cgi?tab=email
------- You are receiving this mail because: -------
You are the QA contact for the bug, or are watching the QA contact.

https://bugzilla.samba.org/show_bug.cgi?id=5365


rsync-bugzilla@leos.cz changed:

           What    |Removed                     |Added
----------------------------------------------------------------------------
                 CC|                            |rsync-bugzilla@leos.cz




------- Comment #4 from rsync-bugzilla@leos.cz  2008-05-12 04:24 CST -------
I would like to let you know that the crash with "rsync error: error in
rsync
protocol data stream (code 12) at io.c(635)" happens on Linux CentOS 5.1
(x86),
too. Checked versions 3.0.0, 3.0.1, 3.0.2 and 3.0.3pre1. Command line is
"rsync
-v -v -a --exclude-from=/etc/backup.exclude --link-dest="$CMPDIR" /
"$DSTDIR"
--xattrs"


-- 
Configure bugmail: https://bugzilla.samba.org/userprefs.cgi?tab=email
------- You are receiving this mail because: -------
You are the QA contact for the bug, or are watching the QA contact.

https://bugzilla.samba.org/show_bug.cgi?id=5365


wayned@samba.org changed:

           What    |Removed                     |Added
----------------------------------------------------------------------------
             Status|ASSIGNED                    |RESOLVED
         Resolution|                            |FIXED




------- Comment #5 from wayned@samba.org  2008-05-17 11:40 CST -------
I have checked in a fix for this into the git repository, and it is also in the
latest nightly tar file.  (And will soon be released in 3.0.3pre2.)

Sorry for the delay!


-- 
Configure bugmail: https://bugzilla.samba.org/userprefs.cgi?tab=email
------- You are receiving this mail because: -------
You are the QA contact for the bug, or are watching the QA contact.

https://bugzilla.samba.org/show_bug.cgi?id=5365





------- Comment #6 from rsync-bugzilla@leos.cz  2008-05-18 06:23 CST -------
Unfortunately 3.0.3pre2 still does not fix my problem:

[receiver] internal abbrev error!
rsync: connection unexpectedly closed (106084 bytes received so far) [sender]
rsync error: error in rsync protocol data stream (code 12) at io.c(635)
[sender=3.0.3pre2]


-- 
Configure bugmail: https://bugzilla.samba.org/userprefs.cgi?tab=email
------- You are receiving this mail because: -------
You are the QA contact for the bug, or are watching the QA contact.

https://bugzilla.samba.org/show_bug.cgi?id=5365





------- Comment #7 from wayned@samba.org  2008-05-22 09:37 CST -------
Leoš: The latest nightly tar file (and git repository) have a couple more
fixes for when --link-dest is also in effect.  I was not able to reproduce the
error condition you saw, though.  If it is still failing with the latest code,
please start your own bug report (one about --backup, --xattrs, and
--link-dest) and supply a little more information on what kind of an update is
being done when it fails.


-- 
Configure bugmail: https://bugzilla.samba.org/userprefs.cgi?tab=email
------- You are receiving this mail because: -------
You are the QA contact for the bug, or are watching the QA contact.

https://bugzilla.samba.org/show_bug.cgi?id=5365





------- Comment #8 from fauthier@free.fr  2008-05-26 04:24 CST -------
system on both server :
os x server 10.4.11
rsync version is 3.0.3pre3 (no patch)

rsync syntaxe :
/usr/local/bin/rsync  --rsync-path=/usr/local/bin/rsync -avWAX --del --force
--backup --backup-dir=/`date +%Y%m%d-%Hh%M`   /Source
Server2:/Dest/

I have always this error :

Missing abbreviated xattr value, com.apple.ResourceFork, for
"/Partages/DESC1_VOL1/DESCMDL/logo/sf0/.02646700.eps.V991PH"
[sender] could not find xattr #2 for DESCMDL/logo/sf14/00319304.tif
rsync error: error in rsync protocol data stream (code 12) at xattrs.c(587)
[sender=3.0.3pre2]

without --backup (--rsync-path=/usr/local/bin/rsync -avWAX --del --force)
they have no error.
Thank's


-- 
Configure bugmail: https://bugzilla.samba.org/userprefs.cgi?tab=email
------- You are receiving this mail because: -------
You are the QA contact for the bug, or are watching the QA contact.

https://bugzilla.samba.org/show_bug.cgi?id=5365


wayned@samba.org changed:

           What    |Removed                     |Added
----------------------------------------------------------------------------
            Version|3.0.0                       |3.0.3




------- Comment #9 from wayned@samba.org  2008-07-26 10:44 CST -------
If you are still seeing this bug, please help me to be able to reproduce it.  I
have been trying, and have not seen any failures.


-- 
Configure bugmail: https://bugzilla.samba.org/userprefs.cgi?tab=email
------- You are receiving this mail because: -------
You are the QA contact for the bug, or are watching the QA contact.

https://bugzilla.samba.org/show_bug.cgi?id=5365





------- Comment #10 from fauthier@free.fr  2008-10-31 12:05 CST -------
(In reply to comment #9)
> If you are still seeing this bug, please help me to be able to reproduce
it.  I
> have been trying, and have not seen any failures.
> 
i'm sorry, my english is not very good.

My system is os x server 10.4.11 with last update.
Now i use rsync version 3.05pre1
With a terminal, to obtain a binary rsync i do :
>./configure
>make
>make install
I have no error during compilation.
I have tow server (same config) on the same vlan network.
I use ssh with private key for the authentification.

the server contain 500000 files about.
they are 10 folder on the first depth of the tree, and one contain a folder
with 100 subfolder with 3500 files each. (i specify it because this folder
reduce the performance of rsync).

I test several option to rsync, and this is similar) the more use option is :

 OPTION="--rsync-path=/usr/local/bin/rsync -avAX --del --ignore-errors
--backup
--backup-dir=$backup_dir"

the command is  
/usr/local/bin/rsync $OPTION $PATH $SERVER2:$PATH

with no problem the rsync run 2 hours about (1/2h without option -X)
sometimes (3times on 5) i've this errors :

rsync: writefd_unbuffered failed to write 4 bytes [sender]: Broken pipe (32)
[receiver] internal abbrev error on DESCMDL/logo/sf36/02669436.eps
(com.apple.ResourceFork, len=138449)!
rsync: connection unexpectedly closed (129644 bytes received so far) [sender]
rsync error: error in rsync protocol data stream (code 12) at io.c(595)
[sender=3.0.5pre1]

I pointed that this error is systematics (each time) when a lot of file is
delete on the destination.

for info : with a os x client 10.5.5 I have this error :
[sender] internal abbrev error on Desktop/Gravé n°1 à 100/04 Le canal du
bonheur (com.apple.FinderInfo, len=32)!
rsync error: error in rsync protocol data stream (code 12) at xattrs.c(596)
[sender=3.0.5pre1]

in all case without --backup option, I have not error

if I help you more...

thank's a lot
F.A.


-- 
Configure bugmail: https://bugzilla.samba.org/userprefs.cgi?tab=email
------- You are receiving this mail because: -------
You are the QA contact for the bug, or are watching the QA contact.

https://bugzilla.samba.org/show_bug.cgi?id=5365


matt@mattmccutchen.net changed:

           What    |Removed                     |Added
----------------------------------------------------------------------------
             Status|RESOLVED                    |REOPENED
         Resolution|FIXED                       |




------- Comment #11 from matt@mattmccutchen.net  2008-10-31 17:02 CST -------
Fabrice, perhaps try the latest development version of rsync.  I don't know
if
it will fix the problem, but it may be a better starting point for further
investigation.  You could also try to reduce the set of files to the minimum
that exhibits the error.

Wayne, are there any --debug flags that would yield useful information?  If
not, you could add some.  :)


-- 
Configure bugmail: https://bugzilla.samba.org/userprefs.cgi?tab=email
------- You are receiving this mail because: -------
You are the QA contact for the bug, or are watching the QA contact.

https://bugzilla.samba.org/show_bug.cgi?id=5365





------- Comment #12 from wayned@samba.org  2009-04-12 15:14 CST -------
I just fixed an issue where --only-write-batch was not putting the xattr
information into the batch file (as opposed to --write-batch, which was OK). 
Were you using --only-write-batch to create the batch file?


-- 
Configure bugmail: https://bugzilla.samba.org/userprefs.cgi?tab=email
------- You are receiving this mail because: -------
You are the QA contact for the bug, or are watching the QA contact.