rsync - Jun 2004 - problems with --read-batch and --write-batch with --files-from

Hello,

I want to use the --read/write-batch options, but i have problems to do so.
The shell script [1] leads to the following error:

[sender] expand file_list to 131072 bytes, did move
delta-transmission disabled for local transfer or --whole-file
file1
rsync: writefd_unbuffered failed to write 64 bytes: phase "unknown":
Daten?bergabe unterbrochen (broken pipe)
rsync error: error in rsync protocol data stream (code 12) at io.c(836)

--[1]--
#!/bin/bash

DIR="testdir-$(date '+%Y%m%d%H%M%S')"
mkdir "$DIR" &&
cd "$DIR" &&
mkdir src dest &&
(cd src && dd if=/dev/zero of=file1 bs=1024 count=1024) &&
(cd dest && dd if=/dev/zero of=file1 bs=1024 count=512) &&
tar -c -z -f data.tar.gz src dest &&
rsync --write-batch=data -a -v src/ dest/ &&
find . &&
rm -rf src dest &&
tar -x -z -f data.tar.gz &&
echo --- &&
rsync --read-batch=data -a -v -v dest/
-------

Additionally if i use the --files-from option with --write-batch and the given
prefix is relative 3 of 4 files will be written to the src/ dir. The find in
the shell script [2] gives the following:

.
./src
./src/file1
./src/data.rsync_flist
./src/data.rsync_csums
./src/data.rsync_delta
./dest
./dest/file1
./data.tar.gz
./data.rsync_argvs

--[2]--
#!/bin/bash

DIR="testdir-$(date '+%Y%m%d%H%M%S')"
mkdir "$DIR" &&
cd "$DIR" &&
mkdir src dest &&
(cd src && dd if=/dev/zero of=file1 bs=1024 count=1024) &&
(cd dest && dd if=/dev/zero of=file1 bs=1024 count=512) &&
tar -c -z -f data.tar.gz src dest &&
echo file1 | rsync --write-batch=data --files-from=- -a -v -v src/ dest/
&&
find . &&
rm -rf src dest &&
tar -x -z -f data.tar.gz &&
echo --- &&
rsync --read-batch=data -a -v -v dest/
-------


Thanks,

karsten

On Mon, Jun 21, 2004 at 09:57:13PM +0200, Karsten Scheibler
wrote:
> Hello,
> 
> I want to use the --read/write-batch options, but i have problems to do so.
> The shell script [1] leads to the following error:
> 
> [sender] expand file_list to 131072 bytes, did move
> delta-transmission disabled for local transfer or --whole-file
> file1
> rsync: writefd_unbuffered failed to write 64 bytes: phase
"unknown":
> Daten?bergabe unterbrochen (broken pipe)
> rsync error: error in rsync protocol data stream (code 12) at io.c(836)
I've verified this behavior in ver 2.6.2.  I have an idea what it might
be.  Let me take a look.
-chris
> 
> --[1]--
> #!/bin/bash
> 
> DIR="testdir-$(date '+%Y%m%d%H%M%S')"
> mkdir "$DIR" &&
> cd "$DIR" &&
> mkdir src dest &&
> (cd src && dd if=/dev/zero of=file1 bs=1024 count=1024) &&
> (cd dest && dd if=/dev/zero of=file1 bs=1024 count=512) &&
> tar -c -z -f data.tar.gz src dest &&
> rsync --write-batch=data -a -v src/ dest/ &&
> find . &&
> rm -rf src dest &&
> tar -x -z -f data.tar.gz &&
> echo --- &&
> rsync --read-batch=data -a -v -v dest/
> -------
> 
> Additionally if i use the --files-from option with --write-batch and the
given
> prefix is relative 3 of 4 files will be written to the src/ dir. The find
in
> the shell script [2] gives the following:
> 
> .
> ./src
> ./src/file1
> ./src/data.rsync_flist
> ./src/data.rsync_csums
> ./src/data.rsync_delta
> ./dest
> ./dest/file1
> ./data.tar.gz
> ./data.rsync_argvs
> 
> --[2]--
> #!/bin/bash
> 
> DIR="testdir-$(date '+%Y%m%d%H%M%S')"
> mkdir "$DIR" &&
> cd "$DIR" &&
> mkdir src dest &&
> (cd src && dd if=/dev/zero of=file1 bs=1024 count=1024) &&
> (cd dest && dd if=/dev/zero of=file1 bs=1024 count=512) &&
> tar -c -z -f data.tar.gz src dest &&
> echo file1 | rsync --write-batch=data --files-from=- -a -v -v src/ dest/
&&
> find . &&
> rm -rf src dest &&
> tar -x -z -f data.tar.gz &&
> echo --- &&
> rsync --read-batch=data -a -v -v dest/
> -------
> 
> 
> Thanks,
> 
> karsten
> -- 
> To unsubscribe or change options:
http://lists.samba.org/mailman/listinfo/rsync
> Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html

On Mon, Jun 21, 2004 at 09:57:13PM +0200, Karsten Scheibler
wrote:
> delta-transmission disabled for local transfer or --whole-file
That's because of a long-standing bug in batch mode.  Specify
--no-whole-file to work around it when reading a batch.

..wayne..