Heiko Schlittermann
2021-Oct-20 08:56 UTC
deflate on token returned 0 - rsync error: error in protocol data stream
Hello, we're using rsync on SLES 12 SP 5 on both sides (for detailed version info see below) and we're experiencing the following issue on the sender's side: ``` etc/test/windows2019_x86_64_20210929.gz deflate on token returned 0 (22199 bytes left) rsync error: error in rsync protocol data stream (code 12) at token.c(427) [sender=3.1.3] ``` This happens with 1 out of about 4'000'000 files. Transfer w/o compression works without any issues. Question: Bug or feature? The options we're using are: ``` rsync', --rsh' => "ssh -q -i $arg{privatekey} -l $arg{user}", --rsync-path' => "sudo $arg{user}", # content '--archive', # implies --links (-l), --recursive (-r) '--hard-links', (map { ('--exclude' => $_) } @{ $arg{exclude} }), $arg{delete} eq 'yes' ? '--delete' : (), # transfer '--compress', '--partial', '--bwlimit' => $arg{bwlimit}, # logging '--stats', '--verbose', '--log-file' => $arg{rsynclogfile}, '--log-file-format' => 'Modified %i %n%L', ``` Detailed version information: ``` rsync version 3.1.3 protocol version 31 Copyright (C) 1996-2018 by Andrew Tridgell, Wayne Davison, and others. Web site: http://rsync.samba.org/ Capabilities: 64-bit files, 64-bit inums, 64-bit timestamps, 64-bit long ints, socketpairs, hardlinks, symlinks, IPv6, batchfiles, inplace, append, ACLs, xattrs, iconv, symtimes, prealloc, SLP rsync comes with ABSOLUTELY NO WARRANTY. This is free software, and you are welcome to redistribute it under certain conditions. See the GNU General Public Licence for details. ``` Best regards from Dresden/Germany Viele Gr??e aus Dresden Heiko Schlittermann -- SCHLITTERMANN.de ---------------------------- internet & unix support - Heiko Schlittermann, Dipl.-Ing. (TU) - {fon,fax}: +49.351.802998{1,3} - gnupg encrypted messages are welcome --------------- key ID: F69376CE - -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 488 bytes Desc: not available URL: <http://lists.samba.org/pipermail/rsync/attachments/20211020/71c5d36c/signature.sig>
Heiko Schlittermann
2021-Oct-22 10:24 UTC
deflate on token returned 0 - rsync error: error in protocol data stream
Hi, Heiko Schlittermann via rsync <rsync at lists.samba.org> (Mi 20 Okt 2021 10:56:51 CEST):> Hello, > > we're using rsync on SLES 12 SP 5 on both sides (for detailed version > info see below) and we're experiencing the following issue on the > sender's side:?> deflate on token returned 0 (22199 bytes left) > rsync error: error in rsync protocol data stream (code 12) at token.c(427) [sender=3.1.3]I manged to create a reproducer: https://code.schlittermann.de/heiko/rsync-bug/src/commit/d8176333f8ef08b7dbf7957c83055677cddcc080/bug Several times in a row if successfully reproduced the issue on SLES12SP5, using Rsync 3.1.3 (connection to localhost, so identical rsyncs on both sides of the connection) If you can confirm that this is a bug that is fixed already, then it would be enough for us for pushing the Distro maintainer to backport the fix or whatever their policy allows. ======8<------------------ #!/bin/bash set -eu size=1029 cd ${1:?Usage $0 DIR} echo --------------------- echo rsync: $(rsync --version | grep version) hostnamectl | grep 'Operating System' | sed 's/^\s*//' echo ---------------------- echo Creating src file ${size}MiB dd status=progress if=/dev/urandom of=fail-src bs=1M count=$size iflag=fullblock echo Local copy to avoid initial transfer cp -a fail-{src,dst} echo Touch source touch fail-src echo Trigger the bug now rsync -Pv -z fail-src localhost:$PWD/fail-dst ======8<------------------ Best regards from Dresden/Germany Viele Gr??e aus Dresden Heiko Schlittermann -- SCHLITTERMANN.de ---------------------------- internet & unix support - Heiko Schlittermann, Dipl.-Ing. (TU) - {fon,fax}: +49.351.802998{1,3} - gnupg encrypted messages are welcome --------------- key ID: F69376CE - -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 488 bytes Desc: not available URL: <http://lists.samba.org/pipermail/rsync/attachments/20211022/d71da770/signature.sig>