I'm transferring 1.1 Mb files over very poor GSM EDGE connection. My rsync command is: rsync --partial --remove-source-files --timeout=120 --append --progress --rsh=ssh -z LOCAL_FILE root at SERVER:REMOTE_PATH File on remote server "grows" in size in steps of 262144 bytes. That is a lot, because system needs to transfer at least 262144 (before compression) every time connection is established. When I use scp --C chunk size is about 32Kb. Is there a way to change chunk size for rsync? I use rsync 3.0.7. -- Regards, Marcin Polkowski Zak?ad Fizyki Litosfery IGF UW mobile: +48 607561871 mail:marcin at marcinpolkowski.com <mailto:marcin at marcinpolkowski.com> -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://lists.samba.org/pipermail/rsync/attachments/20130903/518271eb/attachment.html>
I must say i've tried everything to change this 262144 byte size incrementation with no luck. Is this value hardcoded in rsync or it's system dependent? Hope someone will know - it's really important for me to change it to smaller value. -- Regards, Marcin Polkowski Zak?ad Fizyki Litosfery IGF UW mobile: +48 607561871 mail:marcin at marcinpolkowski.com <mailto:marcin at marcinpolkowski.com>> Marcin Polkowski <mailto:marcin at marcinpolkowski.com> > 3 wrzes'nia 2013 10:44 > I'm transferring 1.1 Mb files over very poor GSM EDGE connection. My > rsync command is: > > rsync --partial --remove-source-files --timeout=120 --append > --progress --rsh=ssh -z LOCAL_FILE root at SERVER:REMOTE_PATH > > File on remote server "grows" in size in steps of 262144 bytes. That > is a lot, because system needs to transfer at least 262144 (before > compression) every time connection is established. When I use scp --C > chunk size is about 32Kb. Is there a way to change chunk size for > rsync? I use rsync 3.0.7. >-------------- next part -------------- An HTML attachment was scrubbed... URL: <http://lists.samba.org/pipermail/rsync/attachments/20130928/4747989e/attachment.html> -------------- next part -------------- A non-text attachment was scrubbed... Name: compose-unknown-contact.jpg Type: image/jpeg Size: 770 bytes Desc: not available URL: <http://lists.samba.org/pipermail/rsync/attachments/20130928/4747989e/attachment.jpg>
On Tue, Sep 3, 2013 at 1:44 AM, Marcin Polkowski <marcin at marcinpolkowski.com> wrote:> I?m transferring 1.1 Mb files over very poor GSM EDGE connection. My > rsync command is: >[... using --append ...]> File on remote server ?grows? in size in steps of 262144 bytes. >This is apparently due to the in-place code (which --append uses) not setting any cleanup flags for the transferred files, and thus all the cached data that has accumulated in the file buffer is never flushed. I'm checking in a change that will improve the cleanup code to support in-place files (which will go out with 3.1.0). In the meantime, if you want to just tweak your 3.0.7 version, edit the fileio.c file and change the line "wf_writeBufSize = WRITE_SIZE * 8;" to set just WRITE_SIZE (not * 8). ..wayne.. -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://lists.samba.org/pipermail/rsync/attachments/20130928/3affe385/attachment.html>