hi! I have a problem with rsync (current CVS version), running on a win2k machine (rsync compiled using Cygwin). c:\rsync>rsync --version rsync version 2.4.6dev protocol version 24 Copyright (C) 1996-2001 by Andrew Tridgell, Paul Mackerras and others Capabilities: 64-bit files, socketpairs, hard links, symlinks It can DOWNload >2gb files from my linux box (with rsync reporting negative file sizes during download :), but I want to use rsync to back up the win2k host so I need to UPload my soo-large files which does not work. c:\rsync>rsync -avvv big.file otherhost::whatever building file list ... make_file(3,big.file) done send_file_list done send_files starting send_files(0,big.file) send_files mapped big.file of size -1692471296 calling match_sums big.file big.file sending file_sum false_alarms=0 tag_hits=0 matches=0 sender finished big.file send_files phase=1 send files finished total: matches=0 tag_hits=0 false_alarms=0 data=-1692471296 wrote 173 bytes read 56 bytes 152.67 bytes/sec total size is -1692471296 speedup is -7390704.35 File system is NTFS, the file size is ~2.6Gbs. For small files, everything seems to be OK. Any help would be appreciated. regards Horvath "raas" Andras
This most likely has nothing to do with rsync, but rather is due to the 2.2 linux kernel's 2GB filesize limit. If you are in fact using a 2.2 kernel, you need to move up to the 2.4 kernel. Regards, Carey> -----Original Message----- > From: rsync-admin@lists.samba.org > [mailto:rsync-admin@lists.samba.org]On Behalf Of Horvath Andras > Sent: Thursday, November 08, 2001 4:14 AM > To: rsync@lists.samba.org > Subject: win2k + >2GB files problem > > > hi! > > I have a problem with rsync (current CVS version), running on a win2k > machine (rsync compiled using Cygwin). > > c:\rsync>rsync --version > rsync version 2.4.6dev protocol version 24 > Copyright (C) 1996-2001 by Andrew Tridgell, Paul Mackerras and others > Capabilities: 64-bit files, socketpairs, hard links, symlinks > > It can DOWNload >2gb files from my linux box (with rsync reporting > negative file sizes during download :), but I want to use rsync to back > up the win2k host so I need to UPload my soo-large files which does not > work. > > c:\rsync>rsync -avvv big.file otherhost::whatever > > building file list ... > make_file(3,big.file) > done > send_file_list done > send_files starting > send_files(0,big.file) > send_files mapped big.file of size -1692471296 > calling match_sums big.file > big.file > sending file_sum > false_alarms=0 tag_hits=0 matches=0 > sender finished big.file > send_files phase=1 > send files finished > total: matches=0 tag_hits=0 false_alarms=0 data=-1692471296 > wrote 173 bytes read 56 bytes 152.67 bytes/sec > total size is -1692471296 speedup is -7390704.35 > > File system is NTFS, the file size is ~2.6Gbs. > For small files, everything seems to be OK. > > Any help would be appreciated. > > regards > Horvath "raas" Andras > >
I thought of that too, Carey, but note this part of his post: "> It can DOWNload >2gb files from my linux box (with rsync reporting> negative file sizes during download :), but I want to use rsync to back > up the win2k host so I need to UPload my soo-large files which does not > work."So both systems must support >31bit filesizes. I'm wondering, though: Horvath: are all of these transfers being done from the same side... for instance, are you on the win2k box, pulling from, and pushing to, the linux box, or vice versa? If you're doing them from each end, your path may be making you use different rsyncs... example: user@win2k:>echo $PATH /home/user/bin:/bin:/usr/bin:/usr/local/bin user@win2k:> user@linux>rsh win2k 'echo $PATH' /bin:/usr/bin user@linux> Assume there's an old version of rsync in /usr/bin, and a new version in /home/user/bin, on the win2k box. when you run rsync FROM the win2k box, you have the path given to an interactive shell, which finds your new version, 64-bit enabled, and recieves the files from linux just fine. Now, you go to the linux box and attempt to send a big file to win2k... rsync rshes in, finds the old version (32-bit filesize), and chokes. Might it be something like this? Tim Conway tim.conway@philips.com 303.682.4917 Philips Semiconductor - Longmont TC 1880 Industrial Circle, Suite D Longmont, CO 80501 Available via SameTime Connect within Philips, n9hmg on AIM perl -e 'print pack(nnnnnnnnnnnn, 19061,29556,8289,28271,29800,25970,8304,25970,27680,26721,25451,25970), ".\n" ' "There are some who call me.... Tim?" "Carey Jung" <carey@itfreedom.com> Sent by: rsync-admin@lists.samba.org 11/08/2001 05:10 AM To: "Horvath Andras" <Horvath.Andras@fornax.hu> <rsync@lists.samba.org> cc: (bcc: Tim Conway/LMT/SC/PHILIPS) Subject: RE: win2k + >2GB files problem Classification: This most likely has nothing to do with rsync, but rather is due to the 2.2 linux kernel's 2GB filesize limit. If you are in fact using a 2.2 kernel, you need to move up to the 2.4 kernel. Regards, Carey> -----Original Message----- > From: rsync-admin@lists.samba.org > [mailto:rsync-admin@lists.samba.org]On Behalf Of Horvath Andras > Sent: Thursday, November 08, 2001 4:14 AM > To: rsync@lists.samba.org > Subject: win2k + >2GB files problem > > > hi! > > I have a problem with rsync (current CVS version), running on a win2k > machine (rsync compiled using Cygwin). > > c:\rsync>rsync --version > rsync version 2.4.6dev protocol version 24 > Copyright (C) 1996-2001 by Andrew Tridgell, Paul Mackerras and others > Capabilities: 64-bit files, socketpairs, hard links, symlinks > > It can DOWNload >2gb files from my linux box (with rsync reporting > negative file sizes during download :), but I want to use rsync to back > up the win2k host so I need to UPload my soo-large files which does not > work. > > c:\rsync>rsync -avvv big.file otherhost::whatever > > building file list ... > make_file(3,big.file) > done > send_file_list done > send_files starting > send_files(0,big.file) > send_files mapped big.file of size -1692471296 > calling match_sums big.file > big.file > sending file_sum > false_alarms=0 tag_hits=0 matches=0 > sender finished big.file > send_files phase=1 > send files finished > total: matches=0 tag_hits=0 false_alarms=0 data=-1692471296 > wrote 173 bytes read 56 bytes 152.67 bytes/sec > total size is -1692471296 speedup is -7390704.35 > > File system is NTFS, the file size is ~2.6Gbs. > For small files, everything seems to be OK. > > Any help would be appreciated. > > regards > Horvath "raas" Andras > >
There's what's probably your problem. Writing to a daemon is not well
supported. Dave, Martin, Wayne, Tridge::: that's still true, isn't it?
Tim Conway
tim.conway@philips.com
303.682.4917
Philips Semiconductor - Longmont TC
1880 Industrial Circle, Suite D
Longmont, CO 80501
Available via SameTime Connect within Philips, n9hmg on AIM
perl -e 'print pack(nnnnnnnnnnnn,
19061,29556,8289,28271,29800,25970,8304,25970,27680,26721,25451,25970),
".\n" '
"There are some who call me.... Tim?"
Horvath Andras <Horvath.Andras@fornax.hu>
Sent by: rsync-admin@lists.samba.org
11/08/2001 08:49 AM
To: rsync@lists.samba.org
cc: (bcc: Tim Conway/LMT/SC/PHILIPS)
Subject: Re: win2k + >2GB files problem
Classification:
hi,
Thank you all for the replies. I'm using 2.4 stock of kernels of course,
and I don't use rsh or cygwin on the win2k side, only the compiled
rsync.exe and a cygwin1.dll copied into the rsync directory.
Also, rsync works between any Linux boxes with any size of files, so I
suppose the Linux side must be OK.
I don't use rsh; I tried (mostly) to use the rsync client on the w2k
side w/ rsync --daemon running on the linux.
(I have also tried to start the rsync daemon on the win2k box but had
problems with giving paths and so I gave up doing that.)
rsync'ing locally on the win2k does not work either. ;-(
any more ideas?
Andras
Horvath Andras [Horvath.Andras@fornax.hu] writes:> Thank you all for the replies. I'm using 2.4 stock of kernels of course, > and I don't use rsh or cygwin on the win2k side, only the compiled > rsync.exe and a cygwin1.dll copied into the rsync directory.Just for the record, using the rsync.exe compiled for Cygwin is "using cygwin". The cygwin1.dll provides the Unix/Posix emulation layer that rsync is compiled against, and thus all system functions (including file I/O) go through it. -- David /-----------------------------------------------------------------------\ \ David Bolen \ E-mail: db3l@fitlinxx.com / | FitLinxx, Inc. \ Phone: (203) 708-5192 | / 860 Canal Street, Stamford, CT 06902 \ Fax: (203) 316-5150 \ \-----------------------------------------------------------------------/