Hello,
I'm running HP-UX 11i on an rp74xx. It's 64-bit.
C compiler is as follows:
B3901BA B.11.11.03 HP C/ANSI C Developer's Bundle for HP-UX 11.i (S800)
B3913DB C.03.30.02 HP aC++ Compiler (S800)
/usr/bin/cc:
LINT B.11.11.02 CXREF B.11.11.02
HP92453-01 B.11.11.02 HP C Compiler
$ Sep 8 2000 23:13:51 $
I have successfully compiled rsync 2.6.2 and it runs properly.
>From various partial threads, I have tried --enable-largefile (which seems
not to be referenced in 2.6.2)
>From the list as well, the following output from the configure suggests that
largefiles are supported:
checking for broken largefile support... no
checking for special C compiler options needed for large files... no
checking for _FILE_OFFSET_BITS value needed for large files... 64
checking for _LARGE_FILES value needed for large files... no
Both source and destination filesystems are set to handle largefiles and
both scp and rcp have worked to transfer the files being tested. I have also
tried rsync'ing between two local filesystems (both with largefiles
supported) with the same result.
The rsync transfers always fail at the 2GB mark.
The rsync output is as follows:
server1 # /tmp/rsync --rsync-path=/tmp/rsync --stats file1.db
server2:/archive1
rsync: writefd_unbuffered failed to write 32768 bytes: phase
"unknown":
Broken pipe
rsync error: error in rsync protocol data stream (code 12) at io.c(836)
There seem to be some similar questions in the list archives, however the
solutions don't seem to be there, or are partial bits of what I have tried
above.
If anyone has any guidance, please, I need to get this going asap.
Thanks,
Don
_________________________________________________________________
MSN Premium includes powerful parental controls and get 2 months FREE*
http://join.msn.com/?pgmarket=en-ca&page=byoa/prem&xAPID=1994&DI=1034&SU=http://hotmail.com/enca&HL=Market_MSNIS_Taglines
On Wed, 14 Jul 2004, Don Malloy nixuser23-at-hotmail.com |Rsync List| wrote:> The rsync output is as follows: > > server1 # /tmp/rsync --rsync-path=/tmp/rsync --stats file1.db > server2:/archive1 > rsync: writefd_unbuffered failed to write 32768 bytes: phase "unknown":> Broken pipe***********> rsync error: error in rsync protocol data stream (code 12) at io.c(836)The "Broken pipe" message is what the OS is telling you. Normally overflowing a 32 bit offset on write() returns a different error. "Broken pipe" means that a connection to a child process (usually) via a pipe has been suddently severed (usually because the child died before the filehandle was closed.) I suspect what has happened is that rsync built with 64 bit file offsets, but may have used 32-bit offsets for its pipe to the child process. Or the child process is crashing for some reason giving you the "Broken pipe" message. Try boosting the number of "v" arguments you are using and see if any useful information pops up as a result. If you're in a terrible hurry, start an FTP/scp over while debugging the problem. You can always use rsync to finish it off if you get the problem solved (or just wait for FTP if you don't.) -- Steve
Thanks for the suggestion Steve.
Here is the output with -vvv in the local rsync:
------------------
server2 # /usr/local/bin/rsync -avvv --progress --stats file1.db
/var/opt/ignite/test
building file list ...
[sender] make_file(file1.db,*,2)
[sender] expand file_list to 131072 bytes, did move
1 file to consider
send_file_list done
send_files starting
server_recv(2) starting pid=24974
recv_file_name(file1.db)
received 1 names
recv_file_list done
get_local_name count=1 /var/opt/ignite/test
recv_files(1) starting
generator starting pid=24974 count=1
delta-transmission disabled for local transfer or --whole-file
recv_generator(file1.db,0)
send_files(0, file1.db)
send_files mapped file1.db of size 4304863232
calling match_sums file1.db
file1.db
rsync: writefd_unbuffered failed to write 32768 bytes: phase
"unknown":
Broken pipe
rsync error: error in rsync protocol data stream (code 12) at io.c(836)
_exit_cleanup(code=12, file=io.c, line=836): about to call exit(12)
------------------
Just reading another post on the list, an rsync --version shows:
rsync version 2.6.2 protocol version 28
Copyright (C) 1996-2004 by Andrew Tridgell and others
<http://rsync.samba.org/>
Capabilities: 64-bit files, socketpairs, hard links, symlinks, batchfiles,
no IPv6, 32-bit system inums, 64-bit internal inums
rsync comes with ABSOLUTELY NO WARRANTY. This is free software, and you
are welcome to redistribute it under certain conditions. See the GNU
General Public Licence for details.
Is it supposed to show 32-bit system inums? Will this require a re-compile
and how do I force that parameter to 64-bit?
Thanks again,
Don
>From: "Steve Bonds" <knnf6cy7w001@sneakemail.com>
>To: rsync@lists.samba.org
>Subject: Re: HP-UX 11i and largefiles on rsync 2.6.2
>Date: Wed, 14 Jul 2004 14:32:07 -0700 (PDT)
>
>On Wed, 14 Jul 2004, Don Malloy nixuser23-at-hotmail.com |Rsync List|
>wrote:
>
> > The rsync output is as follows:
> >
> > server1 # /tmp/rsync --rsync-path=/tmp/rsync --stats file1.db
> > server2:/archive1
> > rsync: writefd_unbuffered failed to write 32768 bytes: phase
"unknown":
>
> > Broken pipe
> ***********
>
> > rsync error: error in rsync protocol data stream (code 12) at
io.c(836)
>
>The "Broken pipe" message is what the OS is telling you. Normally
>overflowing a 32 bit offset on write() returns a different error.
"Broken
>pipe" means that a connection to a child process (usually) via a pipe
has
>been suddently severed (usually because the child died before the
>filehandle was closed.)
>
>I suspect what has happened is that rsync built with 64 bit file offsets,
>but may have used 32-bit offsets for its pipe to the child process. Or
>the child process is crashing for some reason giving you the "Broken
pipe"
>message.
>
>Try boosting the number of "v" arguments you are using and see if
any
>useful information pops up as a result.
>
>If you're in a terrible hurry, start an FTP/scp over while debugging the
>problem. You can always use rsync to finish it off if you get the problem
>solved (or just wait for FTP if you don't.)
>
> -- Steve
>--
>To unsubscribe or change options:
>http://lists.samba.org/mailman/listinfo/rsync
>Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
_________________________________________________________________
Tired of spam? Get advanced junk mail protection with MSN Premium
http://join.msn.com/?pgmarket=en-ca&page=byoa/prem&xAPID=1994&DI=1034&SU=http://hotmail.com/enca&HL=Market_MSNIS_Taglines
On Wed, Jul 14, 2004 at 04:46:41PM -0400, Don Malloy wrote:> The rsync transfers always fail at the 2GB mark.There is a bug in the large-file support of 2.6.2 that is fixed by the attached patch. Either apply it using "patch" or manually edit the size_t to OFF_T manually, recompile, and give the resulting rsync a try. ..wayne.. -------------- next part -------------- --- generator.c 13 Jul 2004 01:45:51 -0000 1.95 +++ generator.c 14 Jul 2004 16:40:08 -0000 1.96 @@ -205,7 +205,7 @@ * * Generate approximately one checksum every block_len bytes. */ -static void generate_and_send_sums(struct map_struct *buf, size_t len, int f_out) +static void generate_and_send_sums(struct map_struct *buf, OFF_T len, int f_out) { size_t i; struct sum_struct sum;
Interestingly enough, now it stops dead when it hits 2146631680 bytes transferred. I've attached the output as a file. The rsync from /tmp is the patched one (I modified generator.c as noted and recompiled) Any ideas? Thanks again, Don>From: Wayne Davison <wayned@samba.org> >To: Don Malloy <nixuser23@hotmail.com> >CC: rsync@lists.samba.org >Subject: Re: HP-UX 11i and largefiles on rsync 2.6.2 >Date: Thu, 15 Jul 2004 09:28:10 -0700 > >On Wed, Jul 14, 2004 at 04:46:41PM -0400, Don Malloy wrote: > > The rsync transfers always fail at the 2GB mark. > >There is a bug in the large-file support of 2.6.2 that is fixed by the >attached patch. Either apply it using "patch" or manually edit the >size_t to OFF_T manually, recompile, and give the resulting rsync a try. > >..wayne.. ><< large-files.patch >>_________________________________________________________________ STOP MORE SPAM with the MSN Premium and get 2 months FREE* http://join.msn.com/?pgmarket=en-ca&page=byoa/prem&xAPID=1994&DI=1034&SU=http://hotmail.com/enca&HL=Market_MSNIS_Taglines -------------- next part -------------- Patched version: server2 # /tmp/rsync -avvvv -e remsh --rsync-path=/tmp/rsync --progress --stats file1.db server1:/spare opening connection using remsh server1 /tmp/rsync --server -vvvlogDtpr . /spare cmd=remsh machine=server1 user= path=/spare cmd=remsh server1 /tmp/rsync --server -vvvvlogDtpr . /spare opening connection using remsh server1 /tmp/rsync --server -vvvvlogDtpr . /spare (Client) Protocol versions: remote=28, negotiated=28 (Server) Protocol versions: remote=28, negotiated=28 building file list ... [sender] make_file(file1.db,*,2) [sender] expand file_list to 131072 bytes, did move 1 file to consider [sender] i=0 <NULL> <NULL> file1.db mode=0100640 len=4304863232 uid=0 gid=3 send_file_list done file list sent send_files starting server_recv(2) starting pid=10383 recv_file_name(file1.db) received 1 names gid 3(sys) maps to 3 [receiver] i=0 <NULL> <NULL> file1.db mode=0100640 len=4304863232 uid=0 gid=3 recv_file_list done get_local_name count=1 /spare recv_files(1) starting generator starting pid=10383 count=1 delta transmission enabled recv_generator(file1.db,0) send_files(0, file1.db) count=0 n=0 rem=0 send_files mapped file1.db of size 4304863232 calling match_sums file1.db file1.db 2146631680 49% 3.07MB/s 0:11:26 <-- hangs at this point - CTRL-c _exit_cleanup(code=20, file=rsync.c, line=225): entered rsync error: received SIGUSR1 or SIGINT (code 20) at rsync.c(225) _exit_cleanup(code=20, file=rsync.c, line=225): about to call exit(20) server2 # Unpatched version: server2 # /usr/local/bin/rsync -avvv -e remsh --rsync-path=/usr/local/bin/rsync --progress --stats file1.db server1:/spare opening connection using remsh server1 /usr/local/bin/rsync --server -vvvlogDtpr . /spare building file list ... [sender] make_file(file1.db,*,2) [sender] expand file_list to 131072 bytes, did move 1 file to consider send_file_list done send_files starting server_recv(2) starting pid=10278 recv_file_name(file1.db) received 1 names recv_file_list done get_local_name count=1 /spare recv_files(1) starting generator starting pid=10278 count=1 delta transmission enabled recv_generator(file1.db,0) send_files(0, file1.db) send_files mapped file1.db of size 4304863232 calling match_sums file1.db file1.db 2127200256 49% 3.17MB/s 0:11:10 rsync: writefd_unbuffered failed to write 32768 bytes: phase "unknown": Broken pipe rsync error: error in rsync protocol data stream (code 12) at io.c(836) _exit_cleanup(code=12, file=io.c, line=836): about to call exit(12)
Every which way I try, it gets to 2146336768 bytes and stops. I have to
cancel it with CRTL-C - it doesn't matter if it's over a remsh, ssh or
local
filesystem. There is nothing in the syslog regarding this. I have attached
logs for all three (remsh,ssh, local fs - note local fs is much faster after
the patch to generator.c)
I tried running an strace (mentioned in another post), however strace -f
.... doesn't work in HPUX - the syntax is different.
Do you have any suggestions as to how to run the strace?, here is part of
the man page:
strace(1M)
NAME
strace - write STREAMS event trace messages to standard output
SYNOPSIS
strace [ mod sub pri ] ...
DESCRIPTION
strace gets STREAMS event trace messages from STREAMS drivers and
modules via the STREAMS log driver (strlog(7)), and writes these
messages to standard output. By default, strace without arguments
writes all STREAMS trace messages from all drivers and modules.
strace with command-line arguments limits the trace messages received.
The arguments, which must be specified in groups of three, are:
mod Specifies the STREAMS module identification number from the
streamtab entry.
sub Specifies a subidentification number (often corresponding to
a minor device).
pri Specifies a tracing priority level. strace gets messages of
a level equal to or less than the value specified by pri.
Only positive integer values are allowed.
The value all can be used for any argument in the strace command line
to indicate that there are no restrictions for that argument.
Multiple sets of the three arguments can be specified to obtain the
messages from more than one driver or module.
Only one strace process can open the STREAMS log driver at a time.
When strace is invoked, the log driver compares the sets of command
line arguments with actual trace messages, returning only messages
that satisfy the specified criteria.
STREAMS event trace messages have the following format:
seq time tick pri ind mod sub text
----------------------------
Here is the output of the rsync via remsh:
server2 # /tmp/rsync -avvvvv -e remsh --rsync-path=/tmp/rsync --progress
--stats file1.db server1:/spare
cmd=remsh machine=server1 user= path=/spare
cmd=remsh server1 /tmp/rsync --server -vvvvvlogDtpr . /spare
opening connection using remsh server1 /tmp/rsync --server -vvvvvlogDtpr .
/spare
(Client) Protocol versions: remote=28, negotiated=28
(Server) Protocol versions: remote=28, negotiated=28
building file list ...
[sender] make_file(file1.db,*,2)
[sender] expand file_list to 131072 bytes, did move
1 file to consider
[sender] i=0 <NULL> <NULL> file1.db mode=0100640 len=4304863232
uid=0 gid=3
send_file_list done
file list sent
send_files starting
server_recv(2) starting pid=24806
recv_file_name(file1.db)
received 1 names
gid 3(sys) maps to 3
[receiver] i=0 <NULL> <NULL> file1.db mode=0100640 len=4304863232
uid=0
gid=3
recv_file_list done
get_local_name count=1 /spare
recv_files(1) starting
generator starting pid=24806 count=1
delta transmission enabled
recv_generator(file1.db,0)
send_files(0, file1.db)
count=0 n=0 rem=0
send_files mapped file1.db of size 4304863232
calling match_sums file1.db
file1.db
2146336768 49% 3.04MB/s 0:11:32 (Press CTRL-C here)
_exit_cleanup(code=20, file=rsync.c, line=225): entered
rsync error: received SIGUSR1 or SIGINT (code 20) at rsync.c(225)
_exit_cleanup(code=20, file=rsync.c, line=225): about to call exit(20)
Here is the output of rsync via ssh:
server2 # /tmp/rsync -avvvvv -e ssh --rsync-path=/tmp/rsync --progress
--stats file1.db server1:/spare
cmd=ssh machine=server1 user= path=/spare
cmd=ssh server1 /tmp/rsync --server -vvvvvlogDtpr . /spare
opening connection using ssh server1 /tmp/rsync --server -vvvvvlogDtpr .
/spare
Password:
debug1: PAM: reinitializing credentials
debug1: permanently_set_uid: 0/3
Environment:
USER=root
LOGNAME=root
HOME=/root
PATH=/usr/bin:/bin:/usr/sbin:/sbin:/opt/ssh/bin
MAIL=/var/mail/root
SHELL=/sbin/sh
TZ=EST5EDT
SSH_CLIENT=192.168.12.39 58685 22
SSH_CONNECTION=192.168.12.39 58685 192.168.15.232 22
(Client) Protocol versions: remote=28, negotiated=28
building file list ...
[sender] make_file(file1.db,*,2)
[sender] expand file_list to 131072 bytes, did move
1 file to consider
[sender] i=0 <NULL> <NULL> file1.db mode=0100640 len=4304863232
uid=0 gid=3
send_file_list done
file list sent
send_files starting
server_recv(2) starting pid=24873
(Server) Protocol versions: remote=28, negotiated=28
recv_file_name(file1.db)
received 1 names
gid 3(sys) maps to 3
[receiver] i=0 <NULL> <NULL> file1.db mode=0100640 len=4304863232
uid=0
gid=3
recv_file_list done
get_local_name count=1 /spare
recv_files(1) starting
generator starting pid=24873 count=1
delta transmission enabled
recv_generator(file1.db,0)
send_files(0, file1.db)
count=0 n=0 rem=0
send_files mapped file1.db of size 4304863232
calling match_sums file1.db
file1.db
2146861056 49% 1.26MB/s 0:27:49
Killed by signal 2. 1.26MB/s 0:27:49
_exit_cleanup(code=20, file=rsync.c, line=225): entered
rsync error: received SIGUSR1 or SIGINT (code 20) at rsync.c(225)
_exit_cleanup(code=20, file=rsync.c, line=225): about to call exit(20)
2146861056 49% 1.26MB/s 0:27:49
Here is the output for a local filesystem:
server2 # /tmp/rsync -avvvvv --progress --stats file1.db
/var/opt/ignite/test
cmd= machine= user= path=/var/opt/ignite/test
cmd=. /var/opt/ignite/test
(Client) Protocol versions: remote=28, negotiated=28
(Server) Protocol versions: remote=28, negotiated=28
building file list ...
[sender] make_file(file1.db,*,2)
[sender] expand file_list to 131072 bytes, did move
1 file to consider
[sender] i=0 <NULL> <NULL> file1.db mode=0100640 len=4304863232
uid=0 gid=3
send_file_list done
file list sent
send_files starting
server_recv(2) starting pid=17592
recv_file_name(file1.db)
received 1 names
gid 3(sys) maps to 3
[receiver] i=0 <NULL> <NULL> file1.db mode=0100640 len=4304863232
uid=0
gid=3
recv_file_list done
get_local_name count=1 /var/opt/ignite/test
recv_files(1) starting
generator starting pid=17592 count=1
delta-transmission disabled for local transfer or --whole-file
recv_generator(file1.db,0)
send_files(0, file1.db)
count=0 n=0 rem=0
send_files mapped file1.db of size 4304863232
calling match_sums file1.db
file1.db
2142535680 49% 4.27MB/s 0:08:14
_exit_cleanup(code=20, file=rsync.c, line=225): entered
rsync error: received SIGUSR1 or SIGINT (code 20) at rsync.c(225)
_exit_cleanup(code=20, file=rsync.c, line=225): about to call exit(20)
rsync: writefd_unbuffered failed to write 60 bytes: phase "unknown":
Broken
pipe
_exit_cleanup(code=12, file=io.c, line=836): entered
rsync error: error in rsync protocol data stream (code 12) at io.c(836)
_exit_cleanup(code=12, file=io.c, line=836): about to call exit(12)
--------------------------------------------------------------------------------
HP-UX 11i and largefiles on rsync 2.6.2
Don Malloy nixuser23 at hotmail.com
Thu Jul 15 20:30:50 GMT 2004
--------------------------------------------------------------------------------
Interestingly enough, now it stops dead when it hits 2146631680 bytes
transferred.
I've attached the output as a file.
The rsync from /tmp is the patched one (I modified generator.c as noted and
recompiled)
Any ideas?
Thanks again,
Don
>From: Wayne Davison <wayned at samba.org>
>To: Don Malloy <nixuser23 at hotmail.com>
>CC: rsync at lists.samba.org
>Subject: Re: HP-UX 11i and largefiles on rsync 2.6.2
>Date: Thu, 15 Jul 2004 09:28:10 -0700
>
>On Wed, Jul 14, 2004 at 04:46:41PM -0400, Don Malloy wrote:
> > The rsync transfers always fail at the 2GB mark.
>
>There is a bug in the large-file support of 2.6.2 that is fixed by the
>attached patch. Either apply it using "patch" or manually edit
the
>size_t to OFF_T manually, recompile, and give the resulting rsync a try.
>
>..wayne..
><< large-files.patch >>
_________________________________________________________________
STOP MORE SPAM with the MSN Premium and get 2 months FREE*
http://join.msn.com/?pgmarket=en-ca&page=byoa/prem&xAPID=1994&DI=1034&SU=http://hotmail.com/enca&HL=Market_MSNIS_Taglines
-------------- next part --------------
Patched version:
server2 # /tmp/rsync -avvvv -e remsh --rsync-path=/tmp/rsync --progress
--stats file1.db server1:/spare
opening connection using remsh server1 /tmp/rsync --server -vvvlogDtpr .
/spare
cmd=remsh machine=server1 user= path=/spare
cmd=remsh server1 /tmp/rsync --server -vvvvlogDtpr . /spare
opening connection using remsh server1 /tmp/rsync --server -vvvvlogDtpr .
/spare
(Client) Protocol versions: remote=28, negotiated=28
(Server) Protocol versions: remote=28, negotiated=28
building file list ...
[sender] make_file(file1.db,*,2)
[sender] expand file_list to 131072 bytes, did move
1 file to consider
[sender] i=0 <NULL> <NULL> file1.db mode=0100640 len=4304863232
uid=0 gid=3
send_file_list done
file list sent
send_files starting
server_recv(2) starting pid=10383
recv_file_name(file1.db)
received 1 names
gid 3(sys) maps to 3
[receiver] i=0 <NULL> <NULL> file1.db mode=0100640 len=4304863232
uid=0
gid=3
recv_file_list done
get_local_name count=1 /spare
recv_files(1) starting
generator starting pid=10383 count=1
delta transmission enabled
recv_generator(file1.db,0)
send_files(0, file1.db)
count=0 n=0 rem=0
send_files mapped file1.db of size 4304863232
calling match_sums file1.db
file1.db
2146631680 49% 3.07MB/s 0:11:26 <-- hangs at this point - CTRL-c
_exit_cleanup(code=20, file=rsync.c, line=225): entered
rsync error: received SIGUSR1 or SIGINT (code 20) at rsync.c(225)
_exit_cleanup(code=20, file=rsync.c, line=225): about to call exit(20)
server2 #
Unpatched version:
server2 # /usr/local/bin/rsync -avvv -e remsh
--rsync-path=/usr/local/bin/rsync --progress --stats file1.db server1:/spare
opening connection using remsh server1 /usr/local/bin/rsync --server
-vvvlogDtpr . /spare
building file list ...
[sender] make_file(file1.db,*,2)
[sender] expand file_list to 131072 bytes, did move
1 file to consider
send_file_list done
send_files starting
server_recv(2) starting pid=10278
recv_file_name(file1.db)
received 1 names
recv_file_list done
get_local_name count=1 /spare
recv_files(1) starting
generator starting pid=10278 count=1
delta transmission enabled
recv_generator(file1.db,0)
send_files(0, file1.db)
send_files mapped file1.db of size 4304863232
calling match_sums file1.db
file1.db
2127200256 49% 3.17MB/s 0:11:10
rsync: writefd_unbuffered failed to write 32768 bytes: phase
"unknown":
Broken pipe
rsync error: error in rsync protocol data stream (code 12) at io.c(836)
_exit_cleanup(code=12, file=io.c, line=836): about to call exit(12)
_________________________________________________________________
MSN Premium helps eliminate e-mail viruses. Get 2 months FREE*
http://join.msn.com/?pgmarket=en-ca&page=byoa/prem&xAPID=1994&DI=1034&SU=http://hotmail.com/enca&HL=Market_MSNIS_Taglines
Thanks to Steve and Michael for the help on using tusc in HP-UX land instead of strace. I have attached a tail of the output of the tusc (368 lines.) The whole thing is 412MB gzip'ed down to 20, so if someone wants the whole thing, it's yours, but you have to let me know where to send it. Command syntax at run time is: server2 # /usr/local/bin/tusc -T "" -v -f /tmp/rsync -avvvvv file1.db /var/opt/ignite > /tmp/tusc.out 2>&1>From: "Don Malloy" <nixuser23@hotmail.com> >To: rsync@lists.samba.org >Subject: HP-UX 11i and largefiles on rsync 2.6.2 >Date: Mon, 19 Jul 2004 13:13:55 -0400 > >Every which way I try, it gets to 2146336768 bytes and stops. I have to >cancel it with CRTL-C - it doesn't matter if it's over a remsh, ssh or >local filesystem. There is nothing in the syslog regarding this. I have >attached logs for all three (remsh,ssh, local fs - note local fs is much >faster after the patch to generator.c) > >I tried running an strace (mentioned in another post), however strace -f >.... doesn't work in HPUX - the syntax is different. > >Do you have any suggestions as to how to run the strace?, here is part of >the man page: > >strace(1M) > >NAME > strace - write STREAMS event trace messages to standard output > >SYNOPSIS > strace [ mod sub pri ] ... > >DESCRIPTION > strace gets STREAMS event trace messages from STREAMS drivers and > modules via the STREAMS log driver (strlog(7)), and writes these > messages to standard output. By default, strace without arguments > writes all STREAMS trace messages from all drivers and modules. > strace with command-line arguments limits the trace messages >received. > > The arguments, which must be specified in groups of three, are: > > mod Specifies the STREAMS module identification number from the > streamtab entry. > > sub Specifies a subidentification number (often corresponding >to > a minor device). > > pri Specifies a tracing priority level. strace gets messages >of > a level equal to or less than the value specified by pri. > Only positive integer values are allowed. > > The value all can be used for any argument in the strace command line > to indicate that there are no restrictions for that argument. > > Multiple sets of the three arguments can be specified to obtain the > messages from more than one driver or module. > > Only one strace process can open the STREAMS log driver at a time. > > When strace is invoked, the log driver compares the sets of command > line arguments with actual trace messages, returning only messages > that satisfy the specified criteria. > > STREAMS event trace messages have the following format: > > seq time tick pri ind mod sub text > >---------------------------- > >Here is the output of the rsync via remsh: > >server2 # /tmp/rsync -avvvvv -e remsh --rsync-path=/tmp/rsync --progress >--stats file1.db server1:/spare >cmd=remsh machine=server1 user= path=/spare >cmd=remsh server1 /tmp/rsync --server -vvvvvlogDtpr . /spare >opening connection using remsh server1 /tmp/rsync --server -vvvvvlogDtpr . >/spare >(Client) Protocol versions: remote=28, negotiated=28 >(Server) Protocol versions: remote=28, negotiated=28 >building file list ... >[sender] make_file(file1.db,*,2) >[sender] expand file_list to 131072 bytes, did move >1 file to consider >[sender] i=0 <NULL> <NULL> file1.db mode=0100640 len=4304863232 uid=0 gid=3 >send_file_list done >file list sent >send_files starting >server_recv(2) starting pid=24806 >recv_file_name(file1.db) >received 1 names >gid 3(sys) maps to 3 >[receiver] i=0 <NULL> <NULL> file1.db mode=0100640 len=4304863232 uid=0 >gid=3 >recv_file_list done >get_local_name count=1 /spare >recv_files(1) starting >generator starting pid=24806 count=1 >delta transmission enabled >recv_generator(file1.db,0) >send_files(0, file1.db) >count=0 n=0 rem=0 >send_files mapped file1.db of size 4304863232 >calling match_sums file1.db >file1.db >2146336768 49% 3.04MB/s 0:11:32 (Press CTRL-C here) >_exit_cleanup(code=20, file=rsync.c, line=225): entered >rsync error: received SIGUSR1 or SIGINT (code 20) at rsync.c(225) >_exit_cleanup(code=20, file=rsync.c, line=225): about to call exit(20) > >Here is the output of rsync via ssh: > >server2 # /tmp/rsync -avvvvv -e ssh --rsync-path=/tmp/rsync --progress >--stats file1.db server1:/spare >cmd=ssh machine=server1 user= path=/spare >cmd=ssh server1 /tmp/rsync --server -vvvvvlogDtpr . /spare >opening connection using ssh server1 /tmp/rsync --server -vvvvvlogDtpr . >/spare >Password: >debug1: PAM: reinitializing credentials >debug1: permanently_set_uid: 0/3 >Environment: > USER=root > LOGNAME=root > HOME=/root > PATH=/usr/bin:/bin:/usr/sbin:/sbin:/opt/ssh/bin > MAIL=/var/mail/root > SHELL=/sbin/sh > TZ=EST5EDT > SSH_CLIENT=192.168.12.39 58685 22 > SSH_CONNECTION=192.168.12.39 58685 192.168.15.232 22 >(Client) Protocol versions: remote=28, negotiated=28 >building file list ... >[sender] make_file(file1.db,*,2) >[sender] expand file_list to 131072 bytes, did move >1 file to consider >[sender] i=0 <NULL> <NULL> file1.db mode=0100640 len=4304863232 uid=0 gid=3 >send_file_list done >file list sent >send_files starting >server_recv(2) starting pid=24873 >(Server) Protocol versions: remote=28, negotiated=28 >recv_file_name(file1.db) >received 1 names >gid 3(sys) maps to 3 >[receiver] i=0 <NULL> <NULL> file1.db mode=0100640 len=4304863232 uid=0 >gid=3 >recv_file_list done >get_local_name count=1 /spare >recv_files(1) starting >generator starting pid=24873 count=1 >delta transmission enabled >recv_generator(file1.db,0) >send_files(0, file1.db) >count=0 n=0 rem=0 >send_files mapped file1.db of size 4304863232 >calling match_sums file1.db >file1.db >2146861056 49% 1.26MB/s 0:27:49 >Killed by signal 2. 1.26MB/s 0:27:49 >_exit_cleanup(code=20, file=rsync.c, line=225): entered >rsync error: received SIGUSR1 or SIGINT (code 20) at rsync.c(225) >_exit_cleanup(code=20, file=rsync.c, line=225): about to call exit(20) > >2146861056 49% 1.26MB/s 0:27:49 > >Here is the output for a local filesystem: > >server2 # /tmp/rsync -avvvvv --progress --stats file1.db >/var/opt/ignite/test >cmd= machine= user= path=/var/opt/ignite/test >cmd=. /var/opt/ignite/test >(Client) Protocol versions: remote=28, negotiated=28 >(Server) Protocol versions: remote=28, negotiated=28 >building file list ... >[sender] make_file(file1.db,*,2) >[sender] expand file_list to 131072 bytes, did move >1 file to consider >[sender] i=0 <NULL> <NULL> file1.db mode=0100640 len=4304863232 uid=0 gid=3 >send_file_list done >file list sent >send_files starting >server_recv(2) starting pid=17592 >recv_file_name(file1.db) >received 1 names >gid 3(sys) maps to 3 >[receiver] i=0 <NULL> <NULL> file1.db mode=0100640 len=4304863232 uid=0 >gid=3 >recv_file_list done >get_local_name count=1 /var/opt/ignite/test >recv_files(1) starting >generator starting pid=17592 count=1 >delta-transmission disabled for local transfer or --whole-file >recv_generator(file1.db,0) >send_files(0, file1.db) >count=0 n=0 rem=0 >send_files mapped file1.db of size 4304863232 >calling match_sums file1.db >file1.db >2142535680 49% 4.27MB/s 0:08:14 >_exit_cleanup(code=20, file=rsync.c, line=225): entered >rsync error: received SIGUSR1 or SIGINT (code 20) at rsync.c(225) >_exit_cleanup(code=20, file=rsync.c, line=225): about to call exit(20) >rsync: writefd_unbuffered failed to write 60 bytes: phase "unknown": Broken >pipe >_exit_cleanup(code=12, file=io.c, line=836): entered >rsync error: error in rsync protocol data stream (code 12) at io.c(836) >_exit_cleanup(code=12, file=io.c, line=836): about to call exit(12) > > >-------------------------------------------------------------------------------- > > >HP-UX 11i and largefiles on rsync 2.6.2 >Don Malloy nixuser23 at hotmail.com >Thu Jul 15 20:30:50 GMT 2004 > >-------------------------------------------------------------------------------- > >Interestingly enough, now it stops dead when it hits 2146631680 bytes >transferred. > >I've attached the output as a file. > >The rsync from /tmp is the patched one (I modified generator.c as noted and >recompiled) > >Any ideas? > >Thanks again, >Don > >>From: Wayne Davison <wayned at samba.org> >>To: Don Malloy <nixuser23 at hotmail.com> >>CC: rsync at lists.samba.org >>Subject: Re: HP-UX 11i and largefiles on rsync 2.6.2 >>Date: Thu, 15 Jul 2004 09:28:10 -0700 >> >>On Wed, Jul 14, 2004 at 04:46:41PM -0400, Don Malloy wrote: >> > The rsync transfers always fail at the 2GB mark. >> >>There is a bug in the large-file support of 2.6.2 that is fixed by the >>attached patch. Either apply it using "patch" or manually edit the >>size_t to OFF_T manually, recompile, and give the resulting rsync a try. >> >>..wayne.. >><< large-files.patch >> > >_________________________________________________________________ >STOP MORE SPAM with the MSN Premium and get 2 months FREE* >http://join.msn.com/?pgmarket=en-ca&page=byoa/prem&xAPID=1994&DI=1034&SU=http://hotmail.com/enca&HL=Market_MSNIS_Taglines >-------------- next part -------------- >Patched version: > >server2 # /tmp/rsync -avvvv -e remsh --rsync-path=/tmp/rsync --progress >--stats file1.db server1:/spare >opening connection using remsh server1 /tmp/rsync --server -vvvlogDtpr . >/spare >cmd=remsh machine=server1 user= path=/spare >cmd=remsh server1 /tmp/rsync --server -vvvvlogDtpr . /spare >opening connection using remsh server1 /tmp/rsync --server -vvvvlogDtpr . >/spare >(Client) Protocol versions: remote=28, negotiated=28 >(Server) Protocol versions: remote=28, negotiated=28 >building file list ... >[sender] make_file(file1.db,*,2) >[sender] expand file_list to 131072 bytes, did move >1 file to consider >[sender] i=0 <NULL> <NULL> file1.db mode=0100640 len=4304863232 uid=0 gid=3 >send_file_list done >file list sent >send_files starting >server_recv(2) starting pid=10383 >recv_file_name(file1.db) >received 1 names >gid 3(sys) maps to 3 >[receiver] i=0 <NULL> <NULL> file1.db mode=0100640 len=4304863232 uid=0 >gid=3 >recv_file_list done >get_local_name count=1 /spare >recv_files(1) starting >generator starting pid=10383 count=1 >delta transmission enabled >recv_generator(file1.db,0) >send_files(0, file1.db) >count=0 n=0 rem=0 >send_files mapped file1.db of size 4304863232 >calling match_sums file1.db >file1.db >2146631680 49% 3.07MB/s 0:11:26 <-- hangs at this point - CTRL-c >_exit_cleanup(code=20, file=rsync.c, line=225): entered >rsync error: received SIGUSR1 or SIGINT (code 20) at rsync.c(225) >_exit_cleanup(code=20, file=rsync.c, line=225): about to call exit(20) >server2 # > > > >Unpatched version: > >server2 # /usr/local/bin/rsync -avvv -e remsh >--rsync-path=/usr/local/bin/rsync --progress --stats file1.db >server1:/spare >opening connection using remsh server1 /usr/local/bin/rsync --server >-vvvlogDtpr . /spare >building file list ... >[sender] make_file(file1.db,*,2) >[sender] expand file_list to 131072 bytes, did move >1 file to consider >send_file_list done >send_files starting >server_recv(2) starting pid=10278 >recv_file_name(file1.db) >received 1 names >recv_file_list done >get_local_name count=1 /spare >recv_files(1) starting >generator starting pid=10278 count=1 >delta transmission enabled >recv_generator(file1.db,0) >send_files(0, file1.db) >send_files mapped file1.db of size 4304863232 >calling match_sums file1.db >file1.db >2127200256 49% 3.17MB/s 0:11:10 >rsync: writefd_unbuffered failed to write 32768 bytes: phase "unknown": >Broken pipe >rsync error: error in rsync protocol data stream (code 12) at io.c(836) >_exit_cleanup(code=12, file=io.c, line=836): about to call exit(12) > >_________________________________________________________________ >MSN Premium helps eliminate e-mail viruses. Get 2 months FREE* >http://join.msn.com/?pgmarket=en-ca&page=byoa/prem&xAPID=1994&DI=1034&SU=http://hotmail.com/enca&HL=Market_MSNIS_Taglines > >-- >To unsubscribe or change options: >http://lists.samba.org/mailman/listinfo/rsync >Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html_________________________________________________________________ Take charge with a pop-up guard built on patented Microsoft® SmartScreen Technology. http://join.msn.com/?pgmarket=en-ca&page=byoa/prem&xAPID=1994&DI=1034&SU=http://hotmail.com/enca&HL=Market_MSNIS_Taglines Start enjoying all the benefits of MSN® Premium right now and get the first two months FREE*. -------------- next part -------------- ................................................................ [sleeping] nfds: 2 readfds: NULL writefds: 1 errorfds: NULL timeout.tv_sec: 60 timeout.tv_usec: 0 1090344126.395658 select(6, NULL, 0x7f7f8e9c, NULL, 0x7f7f90a4) ................................................................ = 0 nfds: 6 readfds: NULL writefds: EMPTY errorfds: NULL timeout.tv_sec: 60 timeout.tv_usec: 0 1090344126.415635 select(7, NULL, 0x7f7f1d70, NULL, 0x7f7f1d68) ................................................................ = 0 nfds: 7 readfds: NULL writefds: EMPTY errorfds: NULL timeout.tv_sec: 60 timeout.tv_usec: 0 1090344126.415862 write(6, "1c\0\0\td a t a r e c v 3 2 ".., 32) ........................................................... ERR#11 EAGAIN 1090344128.425705 select(7, NULL, 0x7f7f1d70, NULL, 0x7f7f1d68) ................................................................ [sleeping] nfds: 7 readfds: NULL writefds: 6 errorfds: NULL timeout.tv_sec: 60 timeout.tv_usec: 0 1090344135.165555 select(2, NULL, 0x7f7f215c, NULL, 0x7f7f2364) ................................................................ = 0 nfds: 2 readfds: NULL writefds: EMPTY errorfds: NULL timeout.tv_sec: 60 timeout.tv_usec: 0 1090344137.175583 select(2, NULL, 0x7f7f215c, NULL, 0x7f7f2364) ................................................................ [sleeping] nfds: 2 readfds: NULL writefds: 1 errorfds: NULL timeout.tv_sec: 60 timeout.tv_usec: 0 1090344186.394959 select(6, NULL, 0x7f7f8e9c, NULL, 0x7f7f90a4) ................................................................ = 0 nfds: 6 readfds: NULL writefds: EMPTY errorfds: NULL timeout.tv_sec: 60 timeout.tv_usec: 0 1090344186.414918 select(7, NULL, 0x7f7f1d70, NULL, 0x7f7f1d68) ................................................................ = 0 nfds: 7 readfds: NULL writefds: EMPTY errorfds: NULL timeout.tv_sec: 60 timeout.tv_usec: 0 1090344186.415145 write(6, "1c\0\0\td a t a r e c v 3 2 ".., 32) ........................................................... ERR#11 EAGAIN 1090344188.425010 select(7, NULL, 0x7f7f1d70, NULL, 0x7f7f1d68) ................................................................ [sleeping] nfds: 7 readfds: NULL writefds: 6 errorfds: NULL timeout.tv_sec: 60 timeout.tv_usec: 0 1090344195.164843 select(2, NULL, 0x7f7f215c, NULL, 0x7f7f2364) ................................................................ = 0 nfds: 2 readfds: NULL writefds: EMPTY errorfds: NULL timeout.tv_sec: 60 timeout.tv_usec: 0 1090344197.174883 select(2, NULL, 0x7f7f215c, NULL, 0x7f7f2364) ................................................................ [sleeping] nfds: 2 readfds: NULL writefds: 1 errorfds: NULL timeout.tv_sec: 60 timeout.tv_usec: 0 1090344246.394267 select(6, NULL, 0x7f7f8e9c, NULL, 0x7f7f90a4) ................................................................ = 0 nfds: 6 readfds: NULL writefds: EMPTY errorfds: NULL timeout.tv_sec: 60 timeout.tv_usec: 0 1090344246.414219 select(7, NULL, 0x7f7f1d70, NULL, 0x7f7f1d68) ................................................................ = 0 nfds: 7 readfds: NULL writefds: EMPTY errorfds: NULL timeout.tv_sec: 60 timeout.tv_usec: 0 1090344246.414440 write(6, "1c\0\0\td a t a r e c v 3 2 ".., 32) ........................................................... ERR#11 EAGAIN 1090344248.424307 select(7, NULL, 0x7f7f1d70, NULL, 0x7f7f1d68) ................................................................ [sleeping] nfds: 7 readfds: NULL writefds: 6 errorfds: NULL timeout.tv_sec: 60 timeout.tv_usec: 0 1090344255.164151 select(2, NULL, 0x7f7f215c, NULL, 0x7f7f2364) ................................................................ = 0 nfds: 2 readfds: NULL writefds: EMPTY errorfds: NULL timeout.tv_sec: 60 timeout.tv_usec: 0 1090344257.174250 select(2, NULL, 0x7f7f215c, NULL, 0x7f7f2364) ................................................................ [sleeping] nfds: 2 readfds: NULL writefds: 1 errorfds: NULL timeout.tv_sec: 60 timeout.tv_usec: 0 1090344306.395577 select(6, NULL, 0x7f7f8e9c, NULL, 0x7f7f90a4) ................................................................ = 0 nfds: 6 readfds: NULL writefds: EMPTY errorfds: NULL timeout.tv_sec: 60 timeout.tv_usec: 0 1090344306.413524 select(7, NULL, 0x7f7f1d70, NULL, 0x7f7f1d68) ................................................................ = 0 nfds: 7 readfds: NULL writefds: EMPTY errorfds: NULL timeout.tv_sec: 60 timeout.tv_usec: 0 1090344306.413750 write(6, "1c\0\0\td a t a r e c v 3 2 ".., 32) ........................................................... ERR#11 EAGAIN 1090344308.423604 select(7, NULL, 0x7f7f1d70, NULL, 0x7f7f1d68) ................................................................ [sleeping] nfds: 7 readfds: NULL writefds: 6 errorfds: NULL timeout.tv_sec: 60 timeout.tv_usec: 0 1090344315.163463 select(2, NULL, 0x7f7f215c, NULL, 0x7f7f2364) ................................................................ = 0 nfds: 2 readfds: NULL writefds: EMPTY errorfds: NULL timeout.tv_sec: 60 timeout.tv_usec: 0 1090344317.173495 select(2, NULL, 0x7f7f215c, NULL, 0x7f7f2364) ................................................................ [sleeping] nfds: 2 readfds: NULL writefds: 1 errorfds: NULL timeout.tv_sec: 60 timeout.tv_usec: 0 1090344366.394844 select(6, NULL, 0x7f7f8e9c, NULL, 0x7f7f90a4) ................................................................ = 0 nfds: 6 readfds: NULL writefds: EMPTY errorfds: NULL timeout.tv_sec: 60 timeout.tv_usec: 0 1090344366.412828 select(7, NULL, 0x7f7f1d70, NULL, 0x7f7f1d68) ................................................................ = 0 nfds: 7 readfds: NULL writefds: EMPTY errorfds: NULL timeout.tv_sec: 60 timeout.tv_usec: 0 1090344366.413053 write(6, "1c\0\0\td a t a r e c v 3 2 ".., 32) ........................................................... ERR#11 EAGAIN 1090344368.422911 select(7, NULL, 0x7f7f1d70, NULL, 0x7f7f1d68) ................................................................ [sleeping] nfds: 7 readfds: NULL writefds: 6 errorfds: NULL timeout.tv_sec: 60 timeout.tv_usec: 0 1090344375.162759 select(2, NULL, 0x7f7f215c, NULL, 0x7f7f2364) ................................................................ = 0 nfds: 2 readfds: NULL writefds: EMPTY errorfds: NULL timeout.tv_sec: 60 timeout.tv_usec: 0 1090344377.172810 select(2, NULL, 0x7f7f215c, NULL, 0x7f7f2364) ................................................................ [sleeping] nfds: 2 readfds: NULL writefds: 1 errorfds: NULL timeout.tv_sec: 60 timeout.tv_usec: 0 1090344426.392185 select(6, NULL, 0x7f7f8e9c, NULL, 0x7f7f90a4) ................................................................ = 0 nfds: 6 readfds: NULL writefds: EMPTY errorfds: NULL timeout.tv_sec: 60 timeout.tv_usec: 0 1090344426.412131 select(7, NULL, 0x7f7f1d70, NULL, 0x7f7f1d68) ................................................................ = 0 nfds: 7 readfds: NULL writefds: EMPTY errorfds: NULL timeout.tv_sec: 60 timeout.tv_usec: 0 1090344426.412357 write(6, "1c\0\0\td a t a r e c v 3 2 ".., 32) ........................................................... ERR#11 EAGAIN 1090344428.422227 select(7, NULL, 0x7f7f1d70, NULL, 0x7f7f1d68) ................................................................ [sleeping] nfds: 7 readfds: NULL writefds: 6 errorfds: NULL timeout.tv_sec: 60 timeout.tv_usec: 0 1090344435.162076 select(2, NULL, 0x7f7f215c, NULL, 0x7f7f2364) ................................................................ = 0 nfds: 2 readfds: NULL writefds: EMPTY errorfds: NULL timeout.tv_sec: 60 timeout.tv_usec: 0 1090344437.172116 select(2, NULL, 0x7f7f215c, NULL, 0x7f7f2364) ................................................................ [sleeping] nfds: 2 readfds: NULL writefds: 1 errorfds: NULL timeout.tv_sec: 60 timeout.tv_usec: 0 1090344486.391498 select(6, NULL, 0x7f7f8e9c, NULL, 0x7f7f90a4) ................................................................ = 0 nfds: 6 readfds: NULL writefds: EMPTY errorfds: NULL timeout.tv_sec: 60 timeout.tv_usec: 0 1090344486.411439 select(7, NULL, 0x7f7f1d70, NULL, 0x7f7f1d68) ................................................................ = 0 nfds: 7 readfds: NULL writefds: EMPTY errorfds: NULL timeout.tv_sec: 60 timeout.tv_usec: 0 1090344486.411665 write(6, "1c\0\0\td a t a r e c v 3 2 ".., 32) ........................................................... ERR#11 EAGAIN 1090344488.421528 select(7, NULL, 0x7f7f1d70, NULL, 0x7f7f1d68) ................................................................ [sleeping] nfds: 7 readfds: NULL writefds: 6 errorfds: NULL timeout.tv_sec: 60 timeout.tv_usec: 0 1090344495.161373 select(2, NULL, 0x7f7f215c, NULL, 0x7f7f2364) ................................................................ = 0 nfds: 2 readfds: NULL writefds: EMPTY errorfds: NULL timeout.tv_sec: 60 timeout.tv_usec: 0 1090344497.171420 select(2, NULL, 0x7f7f215c, NULL, 0x7f7f2364) ................................................................ [sleeping] nfds: 2 readfds: NULL writefds: 1 errorfds: NULL timeout.tv_sec: 60 timeout.tv_usec: 0 1090344546.390789 select(6, NULL, 0x7f7f8e9c, NULL, 0x7f7f90a4) ................................................................ = 0 nfds: 6 readfds: NULL writefds: EMPTY errorfds: NULL timeout.tv_sec: 60 timeout.tv_usec: 0 1090344546.410748 select(7, NULL, 0x7f7f1d70, NULL, 0x7f7f1d68) ................................................................ = 0 nfds: 7 readfds: NULL writefds: EMPTY errorfds: NULL timeout.tv_sec: 60 timeout.tv_usec: 0 1090344546.410970 write(6, "1c\0\0\td a t a r e c v 3 2 ".., 32) ........................................................... ERR#11 EAGAIN 1090344548.420830 select(7, NULL, 0x7f7f1d70, NULL, 0x7f7f1d68) ................................................................ [sleeping] nfds: 7 readfds: NULL writefds: 6 errorfds: NULL timeout.tv_sec: 60 timeout.tv_usec: 0 1090344555.160680 select(2, NULL, 0x7f7f215c, NULL, 0x7f7f2364) ................................................................ = 0 nfds: 2 readfds: NULL writefds: EMPTY errorfds: NULL timeout.tv_sec: 60 timeout.tv_usec: 0 1090344557.170727 select(2, NULL, 0x7f7f215c, NULL, 0x7f7f2364) ................................................................ [sleeping] nfds: 2 readfds: NULL writefds: 1 errorfds: NULL timeout.tv_sec: 60 timeout.tv_usec: 0 1090344606.390102 select(6, NULL, 0x7f7f8e9c, NULL, 0x7f7f90a4) ................................................................ = 0 nfds: 6 readfds: NULL writefds: EMPTY errorfds: NULL timeout.tv_sec: 60 timeout.tv_usec: 0 1090344606.410051 select(7, NULL, 0x7f7f1d70, NULL, 0x7f7f1d68) ................................................................ = 0 nfds: 7 readfds: NULL writefds: EMPTY errorfds: NULL timeout.tv_sec: 60 timeout.tv_usec: 0 1090344606.410274 write(6, "1c\0\0\td a t a r e c v 3 2 ".., 32) ........................................................... ERR#11 EAGAIN 1090344608.420143 select(7, NULL, 0x7f7f1d70, NULL, 0x7f7f1d68) ................................................................ [sleeping] nfds: 7 readfds: NULL writefds: 6 errorfds: NULL timeout.tv_sec: 60 timeout.tv_usec: 0 1090344615.159976 select(2, NULL, 0x7f7f215c, NULL, 0x7f7f2364) ................................................................ = 0 nfds: 2 readfds: NULL writefds: EMPTY errorfds: NULL timeout.tv_sec: 60 timeout.tv_usec: 0 1090344617.172059 select(2, NULL, 0x7f7f215c, NULL, 0x7f7f2364) ................................................................ [sleeping] nfds: 2 readfds: NULL writefds: 1 errorfds: NULL timeout.tv_sec: 60 timeout.tv_usec: 0 1090344666.389502 select(6, NULL, 0x7f7f8e9c, NULL, 0x7f7f90a4) ................................................................ = 0 nfds: 6 readfds: NULL writefds: EMPTY errorfds: NULL timeout.tv_sec: 60 timeout.tv_usec: 0 1090344666.409359 select(7, NULL, 0x7f7f1d70, NULL, 0x7f7f1d68) ................................................................ = 0 nfds: 7 readfds: NULL writefds: EMPTY errorfds: NULL timeout.tv_sec: 60 timeout.tv_usec: 0 1090344666.409592 write(6, "1c\0\0\td a t a r e c v 3 2 ".., 32) ........................................................... ERR#11 EAGAIN 1090344668.419564 select(7, NULL, 0x7f7f1d70, NULL, 0x7f7f1d68) ................................................................ [sleeping] nfds: 7 readfds: NULL writefds: 6 errorfds: NULL timeout.tv_sec: 60 timeout.tv_usec: 0 1090344675.161341 select(2, NULL, 0x7f7f215c, NULL, 0x7f7f2364) ................................................................ = 0 nfds: 2 readfds: NULL writefds: EMPTY errorfds: NULL timeout.tv_sec: 60 timeout.tv_usec: 0 1090344677.169335 select(2, NULL, 0x7f7f215c, NULL, 0x7f7f2364) ................................................................ [sleeping] nfds: 2 readfds: NULL writefds: 1 errorfds: NULL timeout.tv_sec: 60 timeout.tv_usec: 0 ( Terminating process 14608 ("/tmp/rsync -avvvvv file1.db /var/opt/ignite") )
I just tried the build from the nightly tar file: rsync-HEAD-20040720-1929GMT.tar.gz It failed at 2144075776 bytes each time I tried. I've attached the tail from the tusc again. Here it the output of the rsync: server2 # /tmp/rsync -avvvvv --progress --stats file1.db /var/opt/ignite cmd= machine= user= path=/var/opt/ignite cmd=. /var/opt/ignite (Client) Protocol versions: remote=28, negotiated=28 (Server) Protocol versions: remote=28, negotiated=28 building file list ... [sender] make_file(file1.db,*,2) [sender] expand file_list to 131072 bytes, did move 1 file to consider [sender] i=0 <NULL> <NULL> file1.db mode=0100640 len=4304863232 uid=0 gid=3 send_file_list done file list sent send_files starting server_recv(2) starting pid=18366 recv_file_name(file1.db) received 1 names gid 3(sys) maps to 3 [receiver] i=0 <NULL> <NULL> file1.db mode=0100640 len=4304863232 uid=0 gid=3 recv_file_list done get_local_name count=1 /var/opt/ignite recv_files(1) starting generator starting pid=18366 count=1 delta-transmission disabled for local transfer or --whole-file recv_generator(file1.db,0) send_files(0, file1.db) count=0 n=0 rem=0 send_files mapped file1.db of size 4304863232 calling match_sums file1.db file1.db 2144075776 49% 4.62MB/s 0:07:36 <-- press CTRL-C after it gets stuck here. _exit_cleanup(code=20, file=rsync.c, line=229): entered rsync error: received SIGUSR1 or SIGINT (code 20) at rsync.c(229) _exit_cleanup(code=20, file=rsync.c, line=229): about to call exit(20) rsync: writefd_unbuffered failed to write 60 bytes: phase "unknown": Broken pipe (32) _exit_cleanup(code=12, file=io.c, line=900): entered rsync error: error in rsync protocol data stream (code 12) at io.c(900) _exit_cleanup(code=12, file=io.c, line=900): about to call exit(12) --------------------------------------------------------------------------->From: Wayne Davison <wayned@samba.org> >To: Don Malloy <nixuser23@hotmail.com> >CC: rsync@lists.samba.org >Subject: Re: HP-UX 11i and largefiles on rsync 2.6.2 >Date: Tue, 20 Jul 2004 12:30:27 -0700 > >On Mon, Jul 19, 2004 at 01:13:55PM -0400, Don Malloy wrote: > > Interestingly enough, now it stops dead when it hits 2146631680 bytes > > transferred. [...] Any ideas? > >I haven't been able to duplicate the problem you're seeing using the cvs >version of rsync. I'll try a patched 2.6.2 next. You may wish to try >downloading the latest nightly tar file from the rsync web site and >trying that. > >..wayne.._________________________________________________________________ Designer Mail isn't just fun to send, it's fun to receive. Use special stationery, fonts and colors. http://join.msn.com/?pgmarket=en-ca&page=byoa/prem&xAPID=1994&DI=1034&SU=http://hotmail.com/enca&HL=Market_MSNIS_Taglines Start enjoying all the benefits of MSN® Premium right now and get the first two months FREE*. -------------- next part -------------- 0x7f7f2f88, 0x7f7f3088, NULL, 0x7f7f3188) .......................................................... = 1 nfds: 7 readfds: 0 writefds: EMPTY errorfds: NULL timeout.tv_sec: 60 timeout.tv_usec: 0 1090356167.325390 select(6, NULL, 0x7f7f0e60, NULL, 0x7f7f106c) ................................................................ = 1 nfds: 6 readfds: NULL writefds: 5 errorfds: NULL timeout.tv_sec: 60 timeout.tv_usec: 0 1090356167.325611 write(5, "> c0b c1\0c9\f\0> e7d3R 9be811\0".., 17676) ........................................................ = 8184 1090356167.325906 read(0, "86p 86b1bff5h ad` eee3d3bff406W ".., 8184) .......................................................... = 8184 1090356167.326197 write(6, "1c\0\0\td a t a r e c v 3 2 ".., 32) ........................................................... ERR#11 EAGAIN 1090356167.326356 write(6, "1c\0\0\td a t a r e c v 3 2 ".., 32) ........................................................... ERR#11 EAGAIN 1090356167.326519 select(7, 0x7f7f2f88, 0x7f7f3088, NULL, 0x7f7f3188) .......................................................... = 1 nfds: 7 readfds: 0 writefds: EMPTY errorfds: NULL timeout.tv_sec: 60 timeout.tv_usec: 0 1090356167.326748 select(6, NULL, 0x7f7f0e60, NULL, 0x7f7f106c) ................................................................ = 1 nfds: 6 readfds: NULL writefds: 5 errorfds: NULL timeout.tv_sec: 60 timeout.tv_usec: 0 1090356167.326965 write(5, "5 bb/ 13\0\0\0\0\0\0\0\0\0\0\0\0".., 9492) ......................................................... = 8184 1090356167.327257 read(0, "bfebb2aefb? 8f, bfb4@ 17b4df\a5 ".., 8184) .......................................................... = 8184 1090356167.327541 write(6, "1c\0\0\td a t a r e c v 3 2 ".., 32) ........................................................... ERR#11 EAGAIN 1090356167.327699 write(6, "1c\0\0\td a t a r e c v 3 2 ".., 32) ........................................................... ERR#11 EAGAIN 1090356167.327862 select(7, 0x7f7f2f88, 0x7f7f3088, NULL, 0x7f7f3188) .......................................................... = 1 nfds: 7 readfds: 0 writefds: EMPTY errorfds: NULL timeout.tv_sec: 60 timeout.tv_usec: 0 1090356167.328104 select(6, NULL, 0x7f7f0e60, NULL, 0x7f7f106c) ................................................................ = 1 nfds: 6 readfds: NULL writefds: 5 errorfds: NULL timeout.tv_sec: 60 timeout.tv_usec: 0 1090356167.328300 write(5, "\0\0\0\0\0\0\0\0fffffffe\0\0\0\0".., 1308) ......................................................... = 1308 1090356167.331093 select(6, NULL, 0x7f7f0e60, NULL, 0x7f7f106c) ................................................................ = 1 nfds: 6 readfds: NULL writefds: 5 errorfds: NULL timeout.tv_sec: 60 timeout.tv_usec: 0 1090356167.331297 write(5, "\080\0\0", 4) ...................................................................................... = 4 1090356167.331465 select(6, NULL, 0x7f7f0e60, NULL, 0x7f7f106c) ................................................................ = 1 nfds: 6 readfds: NULL writefds: 5 errorfds: NULL timeout.tv_sec: 60 timeout.tv_usec: 0 1090356167.331667 write(5, "\0\0\0c4\0\0\0\0? ef= 1ed819e310".., 32768) ........................................................ = 6872 1090356167.331961 read(0, "\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0".., 8184) .......................................................... = 8184 1090356167.332272 write(6, "1c\0\0\td a t a r e c v 3 2 ".., 32) ........................................................... ERR#11 EAGAIN 1090356167.334242 write(6, "1c\0\0\td a t a r e c v 3 2 ".., 32) ........................................................... ERR#11 EAGAIN 1090356167.334406 write(6, "1c\0\0\td a t a r e c v 3 2 ".., 32) ........................................................... ERR#11 EAGAIN 1090356167.334601 select(7, 0x7f7f2f88, 0x7f7f3088, NULL, 0x7f7f3188) .......................................................... = 1 nfds: 7 readfds: 0 writefds: EMPTY errorfds: NULL timeout.tv_sec: 60 timeout.tv_usec: 0 1090356167.334832 select(6, NULL, 0x7f7f0e60, NULL, 0x7f7f106c) ................................................................ = 1 nfds: 6 readfds: NULL writefds: 5 errorfds: NULL timeout.tv_sec: 60 timeout.tv_usec: 0 1090356167.335036 write(5, "\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0".., 25896) ........................................................ = 8184 1090356167.335324 read(0, "? d2deY b2849810@ ! 14O L \a1ad6".., 8184) .......................................................... = 8184 1090356167.335614 write(6, "1c\0\0\td a t a r e c v 3 2 ".., 32) ........................................................... ERR#11 EAGAIN 1090356167.335770 write(6, "1c\0\0\td a t a r e c v 3 2 ".., 32) ........................................................... ERR#11 EAGAIN 1090356167.335933 select(7, 0x7f7f2f88, 0x7f7f3088, NULL, 0x7f7f3188) .......................................................... = 1 nfds: 7 readfds: 0 writefds: EMPTY errorfds: NULL timeout.tv_sec: 60 timeout.tv_usec: 0 1090356167.336157 select(6, NULL, 0x7f7f0e60, NULL, 0x7f7f106c) ................................................................ = 1 nfds: 6 readfds: NULL writefds: 5 errorfds: NULL timeout.tv_sec: 60 timeout.tv_usec: 0 1090356167.336364 write(5, "@ M @ e o 94a4p c0\n9d06j 869 y ".., 17712) ........................................................ = 8184 1090356167.336656 read(0, "> e38afa1915b3a0> f9S 1 83" H \0".., 8184) .......................................................... = 8184 1090356167.336941 write(6, "1c\0\0\td a t a r e c v 3 2 ".., 32) ........................................................... ERR#11 EAGAIN 1090356167.337098 write(6, "1c\0\0\td a t a r e c v 3 2 ".., 32) ........................................................... ERR#11 EAGAIN 1090356167.337260 select(7, 0x7f7f2f88, 0x7f7f3088, NULL, 0x7f7f3188) .......................................................... = 1 nfds: 7 readfds: 0 writefds: EMPTY errorfds: NULL timeout.tv_sec: 60 timeout.tv_usec: 0 1090356167.337484 select(6, NULL, 0x7f7f0e60, NULL, 0x7f7f106c) ................................................................ = 1 nfds: 6 readfds: NULL writefds: 5 errorfds: NULL timeout.tv_sec: 60 timeout.tv_usec: 0 1090356167.337690 write(5, "bf\0ab92dcb2\b\0bf\af0ffv N 8 \0".., 9528) ......................................................... = 8184 1090356167.337985 read(0, "\0\0\0\0\0\0\0\0\0\0\0\0c014% c9".., 8184) .......................................................... = 8184 1090356167.338267 write(6, "1c\0\0\td a t a r e c v 3 2 ".., 32) ........................................................... ERR#11 EAGAIN 1090356167.338425 write(6, "1c\0\0\td a t a r e c v 3 2 ".., 32) ........................................................... ERR#11 EAGAIN 1090356167.338588 select(7, 0x7f7f2f88, 0x7f7f3088, NULL, 0x7f7f3188) .......................................................... = 1 nfds: 7 readfds: 0 writefds: EMPTY errorfds: NULL timeout.tv_sec: 60 timeout.tv_usec: 0 1090356167.338812 select(6, NULL, 0x7f7f0e60, NULL, 0x7f7f106c) ................................................................ = 1 nfds: 6 readfds: NULL writefds: 5 errorfds: NULL timeout.tv_sec: 60 timeout.tv_usec: 0 1090356167.339003 write(5, "\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0".., 1344) ......................................................... = 1344 1090356167.340928 select(6, NULL, 0x7f7f0e60, NULL, 0x7f7f106c) ................................................................ = 1 nfds: 6 readfds: NULL writefds: 5 errorfds: NULL timeout.tv_sec: 60 timeout.tv_usec: 0 1090356167.341119 write(5, "\080\0\0", 4) ...................................................................................... = 4 1090356167.341285 select(6, NULL, 0x7f7f0e60, NULL, 0x7f7f106c) ................................................................ = 1 nfds: 6 readfds: NULL writefds: 5 errorfds: NULL timeout.tv_sec: 60 timeout.tv_usec: 0 1090356167.341487 write(5, "? 3 3 0117a2f297bf17bedbee8a) 18".., 32768) ........................................................ = 6836 1090356167.341785 read(0, "@ G d3K | bb06h @ D c3d3V cbbf9c".., 8184) .......................................................... = 8184 1090356167.342084 write(6, "1c\0\0\td a t a r e c v 3 2 ".., 32) ........................................................... ERR#11 EAGAIN 1090356167.345658 write(1, "\0\0\0D \0\0\0\0@ 6 \0\0\0\0\0\0".., 262144) ....................................................... = 262143 1090356167.346003 write(1, "18", 1) ............................................................................................ ERR#27 EFBIG 1090356167.365258 open("/usr/lib/nls/msg/C/strerror.cat", O_RDONLY, 0177777) ................................................... = 5 1090356167.365464 fstat(5, 0x7f7f3f90) ......................................................................................... = 0 st_dev: 64 0x000007 st_ino: 28982 st_mode: S_IFREG|0444 st_nlink: 2 st_rdev: 0 st_size: 7140 st_blksize: 8192 st_blocks: 8 st_uid: 2 st_gid: 2 st_atime: Tue Jul 20 16:22:00 2004 st_mtime: Tue Nov 14 03:00:00 2000 st_ctime: Mon Jun 28 16:35:54 2004 1090356167.365758 fcntl(5, F_SETFD, 1) ......................................................................................... = 0 1090356167.365936 lseek(5, 0, SEEK_SET) ........................................................................................ = 0 1090356167.369995 read(5, "m s g c a t 0 1 \0\0\0f9\001\001".., 1212) .......................................................... = 1212 1090356167.370242 lseek(5, 3443, SEEK_SET) ..................................................................................... = 3443 1090356167.370398 read(5, "F i l e t o o l a r g e ", 14) .................................................................. = 14 1090356167.370592 close(5) ..................................................................................................... = 0 1090356167.370763 brk(0x404f6000) .............................................................................................. = 0 1090356167.371169 write(6, "1c\0\0\td a t a r e c v 3 2 ".., 32) ........................................................... ERR#11 EAGAIN 1090356167.371343 sigvec(SIGUSR1, 0x7f7f2ae0, 0x7f7f2af0) ...................................................................... = 0 vec.sv_handler: 0x1 vec.sv_mask: EMPTY SET vec.sv_flags: SV_RESETHAND ovec.sv_handler: 0x40004dfa ovec.sv_mask: EMPTY SET ovec.sv_flags: SV_RESETHAND 1090356167.371556 sigvec(SIGUSR2, 0x7f7f2ae0, 0x7f7f2af0) ...................................................................... = 0 vec.sv_handler: 0x1 vec.sv_mask: EMPTY SET vec.sv_flags: SV_RESETHAND ovec.sv_handler: 0x40004e02 ovec.sv_mask: EMPTY SET ovec.sv_flags: SV_RESETHAND 1090356167.371770 write(6, "1c\0\0\td a t a r e c v 3 2 ".., 32) ........................................................... ERR#11 EAGAIN 1090356167.371928 write(6, "1c\0\0\td a t a r e c v 3 2 ".., 32) ........................................................... ERR#11 EAGAIN 1090356169.380105 select(7, NULL, 0x7f7f2b30, NULL, 0x7f7f2b28) ................................................................ [sleeping] nfds: 7 readfds: NULL writefds: 6 errorfds: NULL timeout.tv_sec: 60 timeout.tv_usec: 0 1090356219.279374 select(2, NULL, 0x7f7f3e20, NULL, 0x7f7f402c) ................................................................ = 0 nfds: 2 readfds: NULL writefds: EMPTY errorfds: NULL timeout.tv_sec: 60 timeout.tv_usec: 0 1090356221.289416 select(2, NULL, 0x7f7f3e20, NULL, 0x7f7f402c) ................................................................ [sleeping] nfds: 2 readfds: NULL writefds: 1 errorfds: NULL timeout.tv_sec: 60 timeout.tv_usec: 0 1090356227.341296 select(6, NULL, 0x7f7f0e60, NULL, 0x7f7f106c) ................................................................ = 0 nfds: 6 readfds: NULL writefds: EMPTY errorfds: NULL timeout.tv_sec: 60 timeout.tv_usec: 0 1090356227.369226 select(7, NULL, 0x7f7f2b30, NULL, 0x7f7f2b28) ................................................................ = 0 nfds: 7 readfds: NULL writefds: EMPTY errorfds: NULL timeout.tv_sec: 60 timeout.tv_usec: 0 1090356227.369451 write(6, "1c\0\0\td a t a r e c v 3 2 ".., 32) ........................................................... ERR#11 EAGAIN 1090356229.380243 select(7, NULL, 0x7f7f2b30, NULL, 0x7f7f2b28) ................................................................ [sleeping] nfds: 7 readfds: NULL writefds: 6 errorfds: NULL timeout.tv_sec: 60 timeout.tv_usec: 0 1090356279.279880 select(2, NULL, 0x7f7f3e20, NULL, 0x7f7f402c) ................................................................ = 0 nfds: 2 readfds: NULL writefds: EMPTY errorfds: NULL timeout.tv_sec: 60 timeout.tv_usec: 0 1090356281.288756 select(2, NULL, 0x7f7f3e20, NULL, 0x7f7f402c) ................................................................ [sleeping] nfds: 2 readfds: NULL writefds: 1 errorfds: NULL timeout.tv_sec: 60 timeout.tv_usec: 0 1090356287.338591 select(6, NULL, 0x7f7f0e60, NULL, 0x7f7f106c) ................................................................ = 0 nfds: 6 readfds: NULL writefds: EMPTY errorfds: NULL timeout.tv_sec: 60 timeout.tv_usec: 0 1090356287.368558 select(7, NULL, 0x7f7f2b30, NULL, 0x7f7f2b28) ................................................................ = 0 nfds: 7 readfds: NULL writefds: EMPTY errorfds: NULL timeout.tv_sec: 60 timeout.tv_usec: 0 1090356287.368785 write(6, "1c\0\0\td a t a r e c v 3 2 ".., 32) ........................................................... ERR#11 EAGAIN 1090356289.378649 select(7, NULL, 0x7f7f2b30, NULL, 0x7f7f2b28) ................................................................ [sleeping] nfds: 7 readfds: NULL writefds: 6 errorfds: NULL timeout.tv_sec: 60 timeout.tv_usec: 0 1090356339.278047 select(2, NULL, 0x7f7f3e20, NULL, 0x7f7f402c) ................................................................ = 0 nfds: 2 readfds: NULL writefds: EMPTY errorfds: NULL timeout.tv_sec: 60 timeout.tv_usec: 0 1090356341.288098 select(2, NULL, 0x7f7f3e20, NULL, 0x7f7f402c) ................................................................ [sleeping] nfds: 2 readfds: NULL writefds: 1 errorfds: NULL timeout.tv_sec: 60 timeout.tv_usec: 0 1090356347.337933 select(6, NULL, 0x7f7f0e60, NULL, 0x7f7f106c) ................................................................ = 0 nfds: 6 readfds: NULL writefds: EMPTY errorfds: NULL timeout.tv_sec: 60 timeout.tv_usec: 0 1090356347.367891 select(7, NULL, 0x7f7f2b30, NULL, 0x7f7f2b28) ................................................................ = 0 nfds: 7 readfds: NULL writefds: EMPTY errorfds: NULL timeout.tv_sec: 60 timeout.tv_usec: 0 1090356347.368116 write(6, "1c\0\0\td a t a r e c v 3 2 ".., 32) ........................................................... ERR#11 EAGAIN ( Terminating process 18585 ("/tmp/rsync -avvvvv file1.db /var/opt/ignite") )
Sure am... server2 # bdf /var/opt/ignite Filesystem kbytes used avail %used Mounted on /dev/vg00/ignite 61440000 1466128 59533768 2% /var/opt/ignite (60GB) server2 # ll /archive1/file1.db -rw-r----- 1 root sys 4304863232 Jul 14 14:56 /archive1/file1.db (4GB) server2 # fsadm -F vxfs /var/opt/ignite largefiles>From: Craig Barratt <cbarratt@users.sourceforge.net> >To: "Don Malloy" <nixuser23@hotmail.com> >CC: rsync@lists.samba.org >Subject: Re: HP-UX 11i and largefiles on rsync 2.6.2 Date: Tue, 20 Jul 2004 >14:11:56 -0700 > >"Don Malloy" writes: > > > I just tried the build from the nightly tar file: > > rsync-HEAD-20040720-1929GMT.tar.gz > > > > It failed at 2144075776 bytes each time I tried. I've attached the tail >from > > the tusc again. Here it the output of the rsync: > >I haven't been following this thread, so I might be way off base. >Are you sure your destination file system supports large files, >and that the destination file system has enough room? > >Craig_________________________________________________________________ Designer Mail isn't just fun to send, it's fun to receive. Use special stationery, fonts and colors. http://join.msn.com/?pgmarket=en-ca&page=byoa/prem&xAPID=1994&DI=1034&SU=http://hotmail.com/enca&HL=Market_MSNIS_Taglines Start enjoying all the benefits of MSN® Premium right now and get the first two months FREE*.
Just trying a few more things, if you reduce the number of v's, it continues to the same point in the file, but instead of going to sleep, it errors out. Here's an output: server2 # /tmp/rsync -avvv --progress --stats file1.db /var/opt/ignite building file list ... [sender] make_file(file1.db,*,2) [sender] expand file_list to 131072 bytes, did move 1 file to consider send_file_list done send_files starting server_recv(2) starting pid=13374 recv_file_name(file1.db) received 1 names recv_file_list done get_local_name count=1 /var/opt/ignite recv_files(1) starting generator starting pid=13374 count=1 delta-transmission disabled for local transfer or --whole-file recv_generator(file1.db,0) send_files(0, file1.db) send_files mapped file1.db of size 4304863232 calling match_sums file1.db file1.db 2136145920 49% 4.54MB/s 0:07:46 (I missed pressing enter before it hit 214...) rsync: writefd_unbuffered failed to write 32768 bytes: phase "unknown": Broken pipe (32) rsync error: error in rsync protocol data stream (code 12) at io.c(900) _exit_cleanup(code=12, file=io.c, line=900): about to call exit(12) This is from the compile of the nightly for rsync-HEAD-20040720-1929GMT.tar Hopefully this is of more help to you. Don _________________________________________________________________ Take advantage of powerful junk e-mail filters built on patented Microsoft® SmartScreen Technology. http://join.msn.com/?pgmarket=en-ca&page=byoa/prem&xAPID=1994&DI=1034&SU=http://hotmail.com/enca&HL=Market_MSNIS_Taglines Start enjoying all the benefits of MSN® Premium right now and get the first two months FREE*.
I started rsync as follows:
server2 # ./rsync -a --progress --stats file1.db /var/opt/ignite
building file list ...
1 file to consider
file1.db
1951039488 45% 4.40MB/s 0:08:420:14:56
rsync: writefd_unbuffered failed to write 32768 bytes: phase
"unknown":
Broken pipe (32)
rsync error: error in rsync protocol data stream (code 12) at io.c(900)
There are always 3 rsync processes running during a sync.
Attaching to the first one stopped the transfer after a breakpoint was set.
Attaching to the second one yeilded more results.
server2 # ./gdb ./rsync 14039
HP gdb 2.1
Copyright 1986 - 1999 Free Software Foundation, Inc.
Hewlett-Packard Wildebeest 2.1 (based on GDB 5.0-hpwdb-20000630)
Wildebeest is free software, covered by the GNU General Public License, and
you are welcome to change it and/or distribute copies of it under certain
conditions. Type "show copying" to see the conditions. There is
absolutely no warranty for Wildebeest. Type "show warranty" for
details.
Wildebeest was built for PA-RISC 1.1 or 2.0 (narrow), HP-UX 11.00.
..
/archive1/14039: No such file or directory.
Attaching to program: /archive1/./rsync, process 14039
Reading symbols from /usr/lib/libc.2...done.
Reading symbols from /usr/lib/libdld.2...done.
warning: reading `r3' register: No data
0xc020ccd0 in _select_sys () from /usr/lib/libc.2
(gdb) break exit_cleanup
Breakpoint 1 (deferred) at "exit_cleanup" ("exit_cleanup"
was not found).
Breakpoint deferred until a shared library containing "exit_cleanup"
is
loaded.
(gdb) bt
#0 0xc020ccd0 in _select_sys () from /usr/lib/libc.2
#1 0xc0218198 in select () from /usr/lib/libc.2
#2 0x2341c in writefd_unbuffered (fd=4, buf=0x40083238 "", len=32768)
at
io.c:863
#3 0x2398c in writefd (fd=4, buf=0x40083238 "", len=32768) at
io.c:972
#4 0x23d58 in write_buf (f=4, buf=0x40083238 "", len=32768) at
io.c:1034
#5 0x25fb0 in simple_send_token (f=4, token=-2, buf=0x4000af10,
offset=136511488, n=32768) at token.c:104
#6 0x26db4 in send_token (f=4, token=-2, buf=0x4000af10, offset=136511488,
n=32768, toklen=0) at token.c:472
#7 0x152c0 in matched (f=4, s=0x4000aee8, buf=0x4000af10, offset=136544256,
i=-2) at match.c:113
#8 0x16248 in match_sums (f=4, s=0x4000aee8, buf=0x4000af10,
len=4304863232) at match.c:345
#9 0xc280 in send_files (flist=0x4000bef0, f_out=4, f_in=5) at sender.c:232
#10 0x12b10 in client_run (f_in=5, f_out=4, pid=14040, argc=1,
argv=0x4000aa00) at main.c:666
#11 0x136d0 in start_client (argc=1, argv=0x4000aa00) at main.c:924
#12 0x13c74 in main (argc=2, argv=0x4000aa00) at main.c:1110
(gdb) quit
The program is running. Quit anyway (and detach it)? (y or n) y
Detaching from program: /archive1/./rsync, process 14039
server2 # ps -ef | grep rsync
root 14040 14039 0 16:16:10 pts/td 0:00 ./rsync -a --progress
--stats file1.db /var/opt/ignite
root 14041 14040 123 16:16:10 pts/td 0:17 ./rsync -a --progress
--stats file1.db /var/opt/ignite
root 14039 13021 121 16:16:10 pts/td 0:17 ./rsync -a --progress
--stats file1.db /var/opt/ignite
server2 # ./gdb ./rsync 14040
HP gdb 2.1
Copyright 1986 - 1999 Free Software Foundation, Inc.
Hewlett-Packard Wildebeest 2.1 (based on GDB 5.0-hpwdb-20000630)
Wildebeest is free software, covered by the GNU General Public License, and
you are welcome to change it and/or distribute copies of it under certain
conditions. Type "show copying" to see the conditions. There is
absolutely no warranty for Wildebeest. Type "show warranty" for
details.
Wildebeest was built for PA-RISC 1.1 or 2.0 (narrow), HP-UX 11.00.
..
/archive1/14040: No such file or directory.
Attaching to program: /archive1/./rsync, process 14040
Reading symbols from /usr/lib/libc.2...done.
Reading symbols from /usr/lib/libdld.2...done.
warning: reading `r3' register: No data
0xc020ccd0 in _select_sys () from /usr/lib/libc.2
(gdb) break exit_cleanup
Breakpoint 1 (deferred) at "exit_cleanup" ("exit_cleanup"
was not found).
Breakpoint deferred until a shared library containing "exit_cleanup"
is
loaded.
(gdb) bt
#0 0xc020ccd0 in _select_sys () from /usr/lib/libc.2
#1 0xc0218198 in select () from /usr/lib/libc.2
#2 0x2202c in read_timeout (fd=4, buf=0x7f7f1d00 "", len=4) at
io.c:421
#3 0x22984 in read_loop (fd=4, buf=0x7f7f1d00 "", len=4) at io.c:619
#4 0x217f0 in read_msg_fd () at io.c:220
#5 0x21c50 in get_redo_num () at io.c:308
#6 0x8c64 in generate_files (f_out=1, flist=0x4000bef0, local_name=0x0) at
generator.c:588
#7 0x123d8 in do_recv (f_in=0, f_out=1, flist=0x4000bef0, local_name=0x0)
at main.c:502
#8 0x12738 in do_server_recv (f_in=0, f_out=1, argc=1, argv=0x7f7f06d4) at
main.c:578
#9 0x12898 in start_server (f_in=0, f_out=1, argc=2, argv=0x7f7f06d0) at
main.c:609
#10 0x12790 in child_main (argc=2, argv=0x7f7f06d0) at main.c:585
#11 0x2e0c8 in local_child (argc=2, argv=0x7f7f06d0, f_in=0x7f7f0668,
f_out=0x7f7f066c,
child_main=0x40004df2 <child_main>) at pipe.c:153
#12 0x11b7c in do_cmd (cmd=0x0, machine=0x0, user=0x0, path=0x4000aed0
"/var/opt/ignite", f_in=0x7f7f0668,
f_out=0x7f7f066c) at main.c:319
#13 0x13664 in start_client (argc=1, argv=0x4000aa00) at main.c:911
#14 0x13c74 in main (argc=2, argv=0x4000aa00) at main.c:1110
Is that what you were looking for?
Don
-------------------->From: Wayne Davison <wayned@samba.org>
>To: Don Malloy <nixuser23@hotmail.com>
>CC: rsync@lists.samba.org
>Subject: Re: HP-UX 11i and largefiles on rsync 2.6.2
>Date: Thu, 22 Jul 2004 09:17:29 -0700
>
>On Wed, Jul 21, 2004 at 02:21:27PM -0400, Don Malloy wrote:
> > Hopefully this is of more help to you.
>
>Unfortunately I haven't been able to get rsync to fail in the update of
>a large file, and the system call trace you provided didn't tell me
>anything helpful in narrowing down what is going wrong. Could you
>attach a debugger to the halting rsync while it is running, tell it to
>continue, and get a backtrace of where it dies? (e.g. "gdb rsync
1234"
>where the 1234 is the process id, set a breakpoint on
"exit_cleanup",
>tell it to continue and note the output of "bt").
>
>..wayne..
_________________________________________________________________
MSN Premium helps eliminate e-mail viruses. Get 2 months FREE*
http://join.msn.com/?pgmarket=en-ca&page=byoa/prem&xAPID=1994&DI=1034&SU=http://hotmail.com/enca&HL=Market_MSNIS_Taglines
It still shows as bad breakpoint.. server2 # ./gdb /archive1/rsync 6835 HP gdb 2.1 Copyright 1986 - 1999 Free Software Foundation, Inc. Hewlett-Packard Wildebeest 2.1 (based on GDB 5.0-hpwdb-20000630) Wildebeest is free software, covered by the GNU General Public License, and you are welcome to change it and/or distribute copies of it under certain conditions. Type "show copying" to see the conditions. There is absolutely no warranty for Wildebeest. Type "show warranty" for details. Wildebeest was built for PA-RISC 1.1 or 2.0 (narrow), HP-UX 11.00. .. /archive1/6835: No such file or directory. Attaching to program: /archive1/rsync, process 6835 Reading symbols from /archive1/./rsync...done. Reading symbols from /usr/lib/libc.2...done. Reading symbols from /usr/lib/libdld.2...done. warning: reading `r3' register: No data 0xc020ccd0 in _select_sys () from /usr/lib/libc.2 (gdb) enable _exit_cleanup warning: bad breakpoint number at or near '_exit_cleanup' (gdb) enable exit_cleanup warning: bad breakpoint number at or near 'exit_cleanup' (gdb) Do you have any other ideas for the naming of the breakpoint? Don>From: Wayne Davison <wayned@samba.org> >To: Don Malloy <nixuser23@hotmail.com> >CC: rsync@lists.samba.org >Subject: Re: HP-UX 11i and largefiles on rsync 2.6.2 >Date: Thu, 22 Jul 2004 16:29:23 -0700 > >On Thu, Jul 22, 2004 at 04:27:57PM -0400, Don Malloy wrote: > > server2 # ./rsync -a --progress --stats file1.db /var/opt/ignite > >What I want is the backtrace when the rsync that is failing dies so we >can (hopefully) figure out why it is dying. In the above command the >client should be the sender, so it appears to be receiving side that is >dying. Unfortunately that means that there are two processes to choose >from (the two higher-numbered ones). The best thing to do would be to >attach a debugger to both of them (each in a separate window). Set a >break-point at _exit_cleanup (I forgot that the function is really named >with a leading underscore because of some macro shenanigans), and then >tell it to "c"ontinue. You'll be able to get a backtrace of what each >program was doing when it either died from a signal or chose to exit. >You can look around a bit too (e.g. move "up", "l"ook around, and >"p"rint some variables). > >..wayne.._________________________________________________________________ Powerful Parental Controls Let your child discover the best the Internet has to offer. http://join.msn.com/?pgmarket=en-ca&page=byoa/prem&xAPID=1994&DI=1034&SU=http://hotmail.com/enca&HL=Market_MSNIS_Taglines Start enjoying all the benefits of MSN® Premium right now and get the first two months FREE*.
Okay, I was being stupid...
I'm off for vacation for a week, so I'll get back to everyone on the
3rd.
Don
--------
Here it is:
server2 # ./gdb64 /archive1/rsync 11938
Detected 32-bit executable.
Invoking /archive1/gdb32.
HP gdb 2.1
Copyright 1986 - 1999 Free Software Foundation, Inc.
Hewlett-Packard Wildebeest 2.1 (based on GDB 5.0-hpwdb-20000630)
Wildebeest is free software, covered by the GNU General Public License, and
you are welcome to change it and/or distribute copies of it under certain
conditions. Type "show copying" to see the conditions. There is
absolutely no warranty for Wildebeest. Type "show warranty" for
details.
Wildebeest was built for PA-RISC 1.1 or 2.0 (narrow), HP-UX 11.00.
..
/archive1/11938: No such file or directory.
Attaching to program: /archive1/rsync, process 11938
Reading symbols from /archive1/./rsync...done.
Reading symbols from /usr/lib/libc.2...done.
Reading symbols from /usr/lib/libdld.2...done.
warning: reading `r3' register: No data
0xc020ccd0 in _select_sys () from /usr/lib/libc.2
(gdb) b _exit_cleanup
Breakpoint 1 at 0xb02c: file cleanup.c, line 89.
(gdb) c
Continuing.
Breakpoint 1, _exit_cleanup (code=11, file=0x555d0 "receiver.c",
line=237)
at cleanup.c:89
89 cleanup.c: No such file or directory.
(gdb) bt
#0 _exit_cleanup (code=11, file=0x555d0 "receiver.c", line=237)
at cleanup.c:89
#1 0x9b20 in receive_data (f_in=0, mapbuf=0x0, fd=1,
fname=0x7f7f18e0 "file1.db", total_size=4304863232) at
receiver.c:237
#2 0xa8c4 in recv_files (f_in=0, flist=0x4000bf08, local_name=0x0)
at receiver.c:513
#3 0x122f4 in do_recv (f_in=0, f_out=1, flist=0x4000bf08, local_name=0x0)
at main.c:477
#4 0x12738 in do_server_recv (f_in=0, f_out=1, argc=1, argv=0x7f7f06d4)
at main.c:578
#5 0x12898 in start_server (f_in=0, f_out=1, argc=2, argv=0x7f7f06d0)
at main.c:609
#6 0x12790 in child_main (argc=2, argv=0x7f7f06d0) at main.c:585
#7 0x2e0c8 in local_child (argc=2, argv=0x7f7f06d0, f_in=0x7f7f0668,
f_out=0x7f7f066c, child_main=0x40004df2 <child_main>) at pipe.c:153
#8 0x11b7c in do_cmd (cmd=0x0, machine=0x0, user=0x0,
path=0x4000aee8 "/var/opt/ignite", f_in=0x7f7f0668,
f_out=0x7f7f066c)
at main.c:319
#9 0x13664 in start_client (argc=1, argv=0x4000aa00) at main.c:911
#10 0x13c74 in main (argc=2, argv=0x4000aa00) at main.c:1110
(gdb)
--------------------------
>From: "Don Malloy" <nixuser23@hotmail.com>
>To: wayned@samba.org
>CC: rsync@lists.samba.org
>Subject: Re: HP-UX 11i and largefiles on rsync 2.6.2
>Date: Fri, 23 Jul 2004 12:16:02 -0400
>
>It still shows as bad breakpoint..
>
>server2 # ./gdb /archive1/rsync 6835
>HP gdb 2.1
>Copyright 1986 - 1999 Free Software Foundation, Inc.
>Hewlett-Packard Wildebeest 2.1 (based on GDB 5.0-hpwdb-20000630)
>Wildebeest is free software, covered by the GNU General Public License, and
>you are welcome to change it and/or distribute copies of it under certain
>conditions. Type "show copying" to see the conditions. There is
>absolutely no warranty for Wildebeest. Type "show warranty" for
details.
>Wildebeest was built for PA-RISC 1.1 or 2.0 (narrow), HP-UX 11.00.
>..
>/archive1/6835: No such file or directory.
>Attaching to program: /archive1/rsync, process 6835
>Reading symbols from /archive1/./rsync...done.
>Reading symbols from /usr/lib/libc.2...done.
>Reading symbols from /usr/lib/libdld.2...done.
>
>warning: reading `r3' register: No data
>0xc020ccd0 in _select_sys () from /usr/lib/libc.2
>(gdb) enable _exit_cleanup
>warning: bad breakpoint number at or near '_exit_cleanup'
>(gdb) enable exit_cleanup
>warning: bad breakpoint number at or near 'exit_cleanup'
>(gdb)
>
>Do you have any other ideas for the naming of the breakpoint?
>
>Don
>
>>From: Wayne Davison <wayned@samba.org>
>>To: Don Malloy <nixuser23@hotmail.com>
>>CC: rsync@lists.samba.org
>>Subject: Re: HP-UX 11i and largefiles on rsync 2.6.2
>>Date: Thu, 22 Jul 2004 16:29:23 -0700
>>
>>On Thu, Jul 22, 2004 at 04:27:57PM -0400, Don Malloy wrote:
>> > server2 # ./rsync -a --progress --stats file1.db /var/opt/ignite
>>
>>What I want is the backtrace when the rsync that is failing dies so we
>>can (hopefully) figure out why it is dying. In the above command the
>>client should be the sender, so it appears to be receiving side that is
>>dying. Unfortunately that means that there are two processes to choose
>>from (the two higher-numbered ones). The best thing to do would be to
>>attach a debugger to both of them (each in a separate window). Set a
>>break-point at _exit_cleanup (I forgot that the function is really named
>>with a leading underscore because of some macro shenanigans), and then
>>tell it to "c"ontinue. You'll be able to get a backtrace
of what each
>>program was doing when it either died from a signal or chose to exit.
>>You can look around a bit too (e.g. move "up",
"l"ook around, and
>>"p"rint some variables).
>>
>>..wayne..
>
>_________________________________________________________________
>Powerful Parental Controls Let your child discover the best the Internet
>has to offer.
>http://join.msn.com/?pgmarket=en-ca&page=byoa/prem&xAPID=1994&DI=1034&SU=http://hotmail.com/enca&HL=Market_MSNIS_Taglines
> Start enjoying all the benefits of MSN® Premium right now and get the
>first two months FREE*.
>
>--
>To unsubscribe or change options:
>http://lists.samba.org/mailman/listinfo/rsync
>Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
_________________________________________________________________
Scan and help eliminate destructive viruses from your inbound and outbound
e-mail and attachments.
http://join.msn.com/?pgmarket=en-ca&page=byoa/prem&xAPID=1994&DI=1034&SU=http://hotmail.com/enca&HL=Market_MSNIS_Taglines
Start enjoying all the benefits of MSN® Premium right now and get the
first two months FREE*.
Reasonably Related Threads
- [PATCH] mini-os: implement poll(2)
- Re: [PATCH nbdkit 7/9] server: Add hand-written replacement for poll for Windows.
- Also seeing high winbindd CPU usage
- [PATCH] Switch to poll in xenconsoled's io loop.
- [PATCH EXPERIMENTAL nbdkit 0/2] Port to Windows using mingw.