alan bryan
2010-Jan-06 19:30 UTC
Zombie NFS writing from FreeBSD clients to FreeBSD 8.0 server with ZFS
I have a AMD64 FreeBSD 8.0 server with ZFS filesystem being shared via NFS.
These are being accessed by the clients. The clients are a mix of FreeBSD 6.2
32bit and FreeBSD 7.0 64bit. I have seen similar behavior from both versions of
FreeBSD as clients.
The behavior that I'm seeing is that everything is fine for a period of time
and then the client starts "writing" large amounts of data to the NFS
server. "Writing" is in quotes as nothing is actually being written
to disk - this can go on for 12+ hrs or more - until the client is rebooted. It
appears to cap out at around the 10-20Mbps rate and just sit there. Other
clients are fine during this time.
On the server:
# nfsstat -s -w 1
GtAttr Lookup Rdlink Read Write Rename Access Rddir
0 25 2 38 7661 0 48 0
0 16 0 6 7601 0 14 0
0 21 0 13 7541 0 19 0
(client apache is stopped - nfsstat on client shows no activity)
(server writes still continue)
0 13 0 1 7331 0 5 0
0 19 0 25 7479 0 59 0
0 9 0 9 7777 0 23 0
0 14 0 51 7640 0 33 0
0 8 0 40 4476 0 25 0
(Right here is when the bad client is rebooted)
(everything is good again)
4 26 1 66 21 0 31 0
0 6 0 50 19 0 4 0
0 15 0 86 23 0 32 0
On the clients (webservers) I killed apache and it appears that nothing is then
writing any longer. The same nfsstat -c -w 1 then shows zero activity.
However, the high write volume continues at the server until this broken client
machine is rebooted - and then the large drop in writes as you see above. At
that point everything is now normal again.
Looking in /var/log/messages on the client and server in these time periods
hasn't shown any errors.
Client mounts in /etc/fstab look like:
192.168.1.33:/tank/share /usr/local/www/share nfs rw,-b,-i,-U,-3 0 0
Any ideas on what to try, where to look for more insight, etc...??
Thanks,
Alan
Rick Macklem
2010-Jan-06 20:10 UTC
Zombie NFS writing from FreeBSD clients to FreeBSD 8.0 server with ZFS
On Wed, 6 Jan 2010, alan bryan wrote:> I have a AMD64 FreeBSD 8.0 server with ZFS filesystem being shared via NFS. These are being accessed by the clients. The clients are a mix of FreeBSD 6.2 32bit and FreeBSD 7.0 64bit. I have seen similar behavior from both versions of FreeBSD as clients. >[stuff related to lotsa writes being done snipped]> > Any ideas on what to try, where to look for more insight, etc...?? >It might be worth taking a look at the traffic. Wireshark (or a tcpdump packet capture read into wireshark) does a good job of interpreting NFS traffic. "tcpdump -s 0 -w <file> host <client>" run for a short period of time when <client> has the problem and then looking at that in wireshark would at least allow you to see what the writes look like? - Are they the same write being retried over and over? - Is the server replying to them with an error? The above might give some insight into what's happening, rick
Rick Macklem
2010-Jan-06 20:48 UTC
Zombie NFS writing from FreeBSD clients to FreeBSD 8.0 server with ZFS
On Wed, 6 Jan 2010, alan bryan wrote:> I have a AMD64 FreeBSD 8.0 server with ZFS filesystem being shared via NFS. These are being accessed by the clients. The clients are a mix of FreeBSD 6.2 32bit and FreeBSD 7.0 64bit. I have seen similar behavior from both versions of FreeBSD as clients. > > The behavior that I'm seeing is that everything is fine for a period of time and then the client starts "writing" large amounts of data to the NFS server. "Writing" is in quotes as nothing is actually being written to disk - this can go on for 12+ hrs or more - until the client is rebooted. It appears to cap out at around the 10-20Mbps rate and just sit there. Other clients are fine during this time. > > > Client mounts in /etc/fstab look like: > 192.168.1.33:/tank/share /usr/local/www/share nfs rw,-b,-i,-U,-3 0 0 >One other thing you could try is switching to TCP mounts (replace -U with -T). There are a couple of others that have reported NFS server problems (all different symptoms) where the problem went away when they switched to TCP. rick
alan bryan
2010-Feb-02 19:04 UTC
Zombie NFS writing from FreeBSD clients to FreeBSD 8.0 server with ZFS
--- On Wed, 1/6/10, Rick Macklem <rmacklem@uoguelph.ca> wrote:> From: Rick Macklem <rmacklem@uoguelph.ca> > Subject: Re: Zombie NFS writing from FreeBSD clients to FreeBSD 8.0 server with ZFS > To: "alan bryan" <alan.bryan@yahoo.com> > Cc: freebsd-stable@freebsd.org > Date: Wednesday, January 6, 2010, 12:19 PM > > > On Wed, 6 Jan 2010, alan bryan wrote: > > > I have a AMD64 FreeBSD 8.0 server with ZFS filesystem > being shared via NFS.? These are being accessed by the > clients.? The clients are a mix of FreeBSD 6.2 32bit > and FreeBSD 7.0 64bit.? I have seen similar behavior > from both versions of FreeBSD as clients. > > > [stuff related to lotsa writes being done snipped] > > > > Any ideas on what to try, where to look for more > insight, etc...?? > > > It might be worth taking a look at the traffic. Wireshark > (or a tcpdump > packet capture read into wireshark) does a good job of > interpreting NFS > traffic. "tcpdump -s 0 -w <file> host <client>" > run for a > short period of time when <client> has the problem > and then looking at > that in wireshark would at least allow you to see what the > writes > look like? > - Are they the same write being retried over and over?yes - it appears so> - Is the server replying to them with an error?yes> > The above might give some insight into what's happening, > rickAttached is the sequence of the tcpdump exported as a text file. This is a freebsd 7.0 client talking to the above mentioned FreeBSD 8.0 NFS server. I've seen similar behavior from my FreeBSD 6.1 NFS clients too. This will just loop like this forever. At some point after a day or so the FreeBSD 8.0 server will then lose all networking (still can access the console just fine). Rebooting fixes everything for a day or so until a client has problems again. I've tried different network driver igb->em, UDP->TCP for NFS, enabling NFS locking on the server/clients (lockd, statd). I'm out of ideas so hoping this tcpdump sheds light on how it's getting stuck in this loop. Thanks, Alan -------------- next part -------------- No. Time Source Destination Protocol Info 1 0.000000 192.168.2.137 192.168.2.153 RPC Continuation Frame 1 (94 bytes on wire, 94 bytes captured) Arrival Time: Jan 30, 2010 12:41:46.910828000 [Time delta from previous captured frame: 0.000000000 seconds] [Time delta from previous displayed frame: 0.000000000 seconds] [Time since reference or first frame: 0.000000000 seconds] Frame Number: 1 Frame Length: 94 bytes Capture Length: 94 bytes [Frame is marked: False] [Protocols in frame: eth:ip:tcp:rpc] [Coloring Rule Name: TCP] [Coloring Rule String: tcp] Ethernet II, Src: IntelCor_bf:eb:7b (00:15:17:bf:eb:7b), Dst: Supermic_7b:52:34 (00:30:48:7b:52:34) Destination: Supermic_7b:52:34 (00:30:48:7b:52:34) Address: Supermic_7b:52:34 (00:30:48:7b:52:34) .... ...0 .... .... .... .... = IG bit: Individual address (unicast) .... ..0. .... .... .... .... = LG bit: Globally unique address (factory default) Source: IntelCor_bf:eb:7b (00:15:17:bf:eb:7b) Address: IntelCor_bf:eb:7b (00:15:17:bf:eb:7b) .... ...0 .... .... .... .... = IG bit: Individual address (unicast) .... ..0. .... .... .... .... = LG bit: Globally unique address (factory default) Type: IP (0x0800) Internet Protocol, Src: 192.168.2.137 (192.168.2.137), Dst: 192.168.2.153 (192.168.2.153) Version: 4 Header length: 20 bytes Differentiated Services Field: 0x00 (DSCP 0x00: Default; ECN: 0x00) 0000 00.. = Differentiated Services Codepoint: Default (0x00) .... ..0. = ECN-Capable Transport (ECT): 0 .... ...0 = ECN-CE: 0 Total Length: 80 Identification: 0xb8d5 (47317) Flags: 0x04 (Don't Fragment) 0... = Reserved bit: Not set .1.. = Don't fragment: Set ..0. = More fragments: Not set Fragment offset: 0 Time to live: 64 Protocol: TCP (0x06) Header checksum: 0xfb5f [correct] [Good: True] [Bad : False] Source: 192.168.2.137 (192.168.2.137) Destination: 192.168.2.153 (192.168.2.153) Transmission Control Protocol, Src Port: nfs (2049), Dst Port: sshell (614), Seq: 1, Ack: 1, Len: 40 Source port: nfs (2049) Destination port: sshell (614) Sequence number: 1 (relative sequence number) [Next sequence number: 41 (relative sequence number)] Acknowledgement number: 1 (relative ack number) Header length: 20 bytes Flags: 0x18 (PSH, ACK) 0... .... = Congestion Window Reduced (CWR): Not set .0.. .... = ECN-Echo: Not set ..0. .... = Urgent: Not set ...1 .... = Acknowledgment: Set .... 1... = Push: Set .... .0.. = Reset: Not set .... ..0. = Syn: Not set .... ...0 = Fin: Not set Window size: 65535 Checksum: 0x8883 [correct] [Good Checksum: True] [Bad Checksum: False] Remote Procedure Call Continuation data 0000 00 30 48 7b 52 34 00 15 17 bf eb 7b 08 00 45 00 .0H{R4.....{..E. 0010 00 50 b8 d5 40 00 40 06 fb 5f c0 a8 02 89 c0 a8 .P..@.@.._...... 0020 02 99 08 01 02 66 ee c3 be 12 22 dd 19 ae 50 18 .....f...."...P. 0030 ff ff 88 83 00 00 80 00 00 24 57 db d4 df 00 00 .........$W..... 0040 00 01 00 00 00 00 00 00 00 00 00 00 00 00 00 00 ................ 0050 00 00 00 00 00 05 00 00 00 00 00 00 00 00 .............. No. Time Source Destination Protocol Info 2 0.000040 192.168.2.153 192.168.2.137 NFS V3 WRITE Call (Reply In 3), FH:0x810602fc Offset:0 Len:15 UNSTABLE Frame 2 (190 bytes on wire, 190 bytes captured) Arrival Time: Jan 30, 2010 12:41:46.910868000 [Time delta from previous captured frame: 0.000040000 seconds] [Time delta from previous displayed frame: 0.000040000 seconds] [Time since reference or first frame: 0.000040000 seconds] Frame Number: 2 Frame Length: 190 bytes Capture Length: 190 bytes [Frame is marked: False] [Protocols in frame: eth:ip:tcp:rpc:nfs] [Coloring Rule Name: Checksum Errors] [Coloring Rule String: cdp.checksum_bad==1 || edp.checksum_bad==1 || ip.checksum_bad==1 || tcp.checksum_bad==1 || udp.checksum_bad==1] Ethernet II, Src: Supermic_7b:52:34 (00:30:48:7b:52:34), Dst: IntelCor_bf:eb:7b (00:15:17:bf:eb:7b) Destination: IntelCor_bf:eb:7b (00:15:17:bf:eb:7b) Address: IntelCor_bf:eb:7b (00:15:17:bf:eb:7b) .... ...0 .... .... .... .... = IG bit: Individual address (unicast) .... ..0. .... .... .... .... = LG bit: Globally unique address (factory default) Source: Supermic_7b:52:34 (00:30:48:7b:52:34) Address: Supermic_7b:52:34 (00:30:48:7b:52:34) .... ...0 .... .... .... .... = IG bit: Individual address (unicast) .... ..0. .... .... .... .... = LG bit: Globally unique address (factory default) Type: IP (0x0800) Internet Protocol, Src: 192.168.2.153 (192.168.2.153), Dst: 192.168.2.137 (192.168.2.137) Version: 4 Header length: 20 bytes Differentiated Services Field: 0x00 (DSCP 0x00: Default; ECN: 0x00) 0000 00.. = Differentiated Services Codepoint: Default (0x00) .... ..0. = ECN-Capable Transport (ECT): 0 .... ...0 = ECN-CE: 0 Total Length: 176 Identification: 0xf8aa (63658) Flags: 0x04 (Don't Fragment) 0... = Reserved bit: Not set .1.. = Don't fragment: Set ..0. = More fragments: Not set Fragment offset: 0 Time to live: 64 Protocol: TCP (0x06) Header checksum: 0xbb2a [correct] [Good: True] [Bad : False] Source: 192.168.2.153 (192.168.2.153) Destination: 192.168.2.137 (192.168.2.137) Transmission Control Protocol, Src Port: sshell (614), Dst Port: nfs (2049), Seq: 1, Ack: 41, Len: 136 Source port: sshell (614) Destination port: nfs (2049) Sequence number: 1 (relative sequence number) [Next sequence number: 137 (relative sequence number)] Acknowledgement number: 41 (relative ack number) Header length: 20 bytes Flags: 0x18 (PSH, ACK) 0... .... = Congestion Window Reduced (CWR): Not set .0.. .... = ECN-Echo: Not set ..0. .... = Urgent: Not set ...1 .... = Acknowledgment: Set .... 1... = Push: Set .... .0.. = Reset: Not set .... ..0. = Syn: Not set .... ...0 = Fin: Not set Window size: 65535 Checksum: 0x8715 [incorrect, should be 0xefc4 (maybe caused by "TCP checksum offload"?)] [Good Checksum: False] [Bad Checksum: True] [SEQ/ACK analysis] [This is an ACK to the segment in frame: 1] [The RTT to ACK the segment was: 0.000040000 seconds] Remote Procedure Call, Type:Call XID:0x57dbd4e0 Fragment header: Last fragment, 132 bytes 1... .... .... .... .... .... .... .... = Last Fragment: Yes .000 0000 0000 0000 0000 0000 1000 0100 = Fragment Length: 132 XID: 0x57dbd4e0 (1474024672) Message Type: Call (0) RPC Version: 2 Program: NFS (100003) Program Version: 3 Procedure: WRITE (7) [The reply to this request is in frame 3] Credentials Flavor: AUTH_UNIX (1) Length: 24 Stamp: 0x00000000 Machine Name: <EMPTY> length: 0 contents: <EMPTY> UID: 80 GID: 80 Auxiliary GIDs GID: 80 Verifier Flavor: AUTH_NULL (0) Length: 0 Network File System, WRITE Call FH:0x810602fc Offset:0 Len:15 UNSTABLE [Program Version: 3] [V3 Procedure: WRITE (7)] file length: 28 [hash: 0x810602fc] decode type as: unknown filehandle: 8B2696A907BF0ED40A001F8705000000029F040000000000... offset: 0 count: 15 Stable: UNSTABLE (0) Data: <DATA> length: 15 contents: <DATA> fill bytes: opaque data 0000 00 15 17 bf eb 7b 00 30 48 7b 52 34 08 00 45 00 .....{.0H{R4..E. 0010 00 b0 f8 aa 40 00 40 06 bb 2a c0 a8 02 99 c0 a8 ....@.@..*...... 0020 02 89 02 66 08 01 22 dd 19 ae ee c3 be 3a 50 18 ...f.."......:P. 0030 ff ff 87 15 00 00 80 00 00 84 57 db d4 e0 00 00 ..........W..... 0040 00 00 00 00 00 02 00 01 86 a3 00 00 00 03 00 00 ................ 0050 00 07 00 00 00 01 00 00 00 18 00 00 00 00 00 00 ................ 0060 00 00 00 00 00 50 00 00 00 50 00 00 00 01 00 00 .....P...P...... 0070 00 50 00 00 00 00 00 00 00 00 00 00 00 1c 8b 26 .P.............& 0080 96 a9 07 bf 0e d4 0a 00 1f 87 05 00 00 00 02 9f ................ 0090 04 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 ................ 00a0 00 00 00 00 00 0f 00 00 00 00 00 00 00 0f 38 39 ..............89 00b0 39 38 38 20 32 36 32 31 34 34 30 30 30 00 988 262144000. No. Time Source Destination Protocol Info 3 0.000247 192.168.2.137 192.168.2.153 NFS V3 WRITE Reply (Call In 2) Error:NFS3ERR_IO Frame 3 (94 bytes on wire, 94 bytes captured) Arrival Time: Jan 30, 2010 12:41:46.911075000 [Time delta from previous captured frame: 0.000207000 seconds] [Time delta from previous displayed frame: 0.000207000 seconds] [Time since reference or first frame: 0.000247000 seconds] Frame Number: 3 Frame Length: 94 bytes Capture Length: 94 bytes [Frame is marked: False] [Protocols in frame: eth:ip:tcp:rpc] [Coloring Rule Name: TCP] [Coloring Rule String: tcp] Ethernet II, Src: IntelCor_bf:eb:7b (00:15:17:bf:eb:7b), Dst: Supermic_7b:52:34 (00:30:48:7b:52:34) Destination: Supermic_7b:52:34 (00:30:48:7b:52:34) Address: Supermic_7b:52:34 (00:30:48:7b:52:34) .... ...0 .... .... .... .... = IG bit: Individual address (unicast) .... ..0. .... .... .... .... = LG bit: Globally unique address (factory default) Source: IntelCor_bf:eb:7b (00:15:17:bf:eb:7b) Address: IntelCor_bf:eb:7b (00:15:17:bf:eb:7b) .... ...0 .... .... .... .... = IG bit: Individual address (unicast) .... ..0. .... .... .... .... = LG bit: Globally unique address (factory default) Type: IP (0x0800) Internet Protocol, Src: 192.168.2.137 (192.168.2.137), Dst: 192.168.2.153 (192.168.2.153) Version: 4 Header length: 20 bytes Differentiated Services Field: 0x00 (DSCP 0x00: Default; ECN: 0x00) 0000 00.. = Differentiated Services Codepoint: Default (0x00) .... ..0. = ECN-Capable Transport (ECT): 0 .... ...0 = ECN-CE: 0 Total Length: 80 Identification: 0xb8d6 (47318) Flags: 0x04 (Don't Fragment) 0... = Reserved bit: Not set .1.. = Don't fragment: Set ..0. = More fragments: Not set Fragment offset: 0 Time to live: 64 Protocol: TCP (0x06) Header checksum: 0xfb5e [correct] [Good: True] [Bad : False] Source: 192.168.2.137 (192.168.2.137) Destination: 192.168.2.153 (192.168.2.153) Transmission Control Protocol, Src Port: nfs (2049), Dst Port: sshell (614), Seq: 41, Ack: 137, Len: 40 Source port: nfs (2049) Destination port: sshell (614) Sequence number: 41 (relative sequence number) [Next sequence number: 81 (relative sequence number)] Acknowledgement number: 137 (relative ack number) Header length: 20 bytes Flags: 0x18 (PSH, ACK) 0... .... = Congestion Window Reduced (CWR): Not set .0.. .... = ECN-Echo: Not set ..0. .... = Urgent: Not set ...1 .... = Acknowledgment: Set .... 1... = Push: Set .... .0.. = Reset: Not set .... ..0. = Syn: Not set .... ...0 = Fin: Not set Window size: 65535 Checksum: 0x87d2 [correct] [Good Checksum: True] [Bad Checksum: False] [SEQ/ACK analysis] [This is an ACK to the segment in frame: 2] [The RTT to ACK the segment was: 0.000207000 seconds] Remote Procedure Call, Type:Reply XID:0x57dbd4e0 Fragment header: Last fragment, 36 bytes 1... .... .... .... .... .... .... .... = Last Fragment: Yes .000 0000 0000 0000 0000 0000 0010 0100 = Fragment Length: 36 XID: 0x57dbd4e0 (1474024672) Message Type: Reply (1) [Program: NFS (100003)] [Program Version: 3] [Procedure: WRITE (7)] Reply State: accepted (0) [This is a reply to a request in frame 2] [Time from request: 0.000207000 seconds] Verifier Flavor: AUTH_NULL (0) Length: 0 Accept State: RPC executed successfully (0) Network File System, WRITE Reply Error:NFS3ERR_IO [Program Version: 3] [V3 Procedure: WRITE (7)] Status: NFS3ERR_IO (5) file_wcc before attributes_follow: no value (0) after attributes_follow: no value (0) 0000 00 30 48 7b 52 34 00 15 17 bf eb 7b 08 00 45 00 .0H{R4.....{..E. 0010 00 50 b8 d6 40 00 40 06 fb 5e c0 a8 02 89 c0 a8 .P..@.@..^...... 0020 02 99 08 01 02 66 ee c3 be 3a 22 dd 1a 36 50 18 .....f...:"..6P. 0030 ff ff 87 d2 00 00 80 00 00 24 57 db d4 e0 00 00 .........$W..... 0040 00 01 00 00 00 00 00 00 00 00 00 00 00 00 00 00 ................ 0050 00 00 00 00 00 05 00 00 00 00 00 00 00 00 .............. No. Time Source Destination Protocol Info 4 0.000277 192.168.2.153 192.168.2.137 NFS V3 WRITE Call (Reply In 5), FH:0x810602fc Offset:0 Len:15 UNSTABLE Frame 4 (190 bytes on wire, 190 bytes captured) Arrival Time: Jan 30, 2010 12:41:46.911105000 [Time delta from previous captured frame: 0.000030000 seconds] [Time delta from previous displayed frame: 0.000030000 seconds] [Time since reference or first frame: 0.000277000 seconds] Frame Number: 4 Frame Length: 190 bytes Capture Length: 190 bytes [Frame is marked: False] [Protocols in frame: eth:ip:tcp:rpc:nfs] [Coloring Rule Name: Checksum Errors] [Coloring Rule String: cdp.checksum_bad==1 || edp.checksum_bad==1 || ip.checksum_bad==1 || tcp.checksum_bad==1 || udp.checksum_bad==1] Ethernet II, Src: Supermic_7b:52:34 (00:30:48:7b:52:34), Dst: IntelCor_bf:eb:7b (00:15:17:bf:eb:7b) Destination: IntelCor_bf:eb:7b (00:15:17:bf:eb:7b) Address: IntelCor_bf:eb:7b (00:15:17:bf:eb:7b) .... ...0 .... .... .... .... = IG bit: Individual address (unicast) .... ..0. .... .... .... .... = LG bit: Globally unique address (factory default) Source: Supermic_7b:52:34 (00:30:48:7b:52:34) Address: Supermic_7b:52:34 (00:30:48:7b:52:34) .... ...0 .... .... .... .... = IG bit: Individual address (unicast) .... ..0. .... .... .... .... = LG bit: Globally unique address (factory default) Type: IP (0x0800) Internet Protocol, Src: 192.168.2.153 (192.168.2.153), Dst: 192.168.2.137 (192.168.2.137) Version: 4 Header length: 20 bytes Differentiated Services Field: 0x00 (DSCP 0x00: Default; ECN: 0x00) 0000 00.. = Differentiated Services Codepoint: Default (0x00) .... ..0. = ECN-Capable Transport (ECT): 0 .... ...0 = ECN-CE: 0 Total Length: 176 Identification: 0xf8ab (63659) Flags: 0x04 (Don't Fragment) 0... = Reserved bit: Not set .1.. = Don't fragment: Set ..0. = More fragments: Not set Fragment offset: 0 Time to live: 64 Protocol: TCP (0x06) Header checksum: 0xbb29 [correct] [Good: True] [Bad : False] Source: 192.168.2.153 (192.168.2.153) Destination: 192.168.2.137 (192.168.2.137) Transmission Control Protocol, Src Port: sshell (614), Dst Port: nfs (2049), Seq: 137, Ack: 81, Len: 136 Source port: sshell (614) Destination port: nfs (2049) Sequence number: 137 (relative sequence number) [Next sequence number: 273 (relative sequence number)] Acknowledgement number: 81 (relative ack number) Header length: 20 bytes Flags: 0x18 (PSH, ACK) 0... .... = Congestion Window Reduced (CWR): Not set .0.. .... = ECN-Echo: Not set ..0. .... = Urgent: Not set ...1 .... = Acknowledgment: Set .... 1... = Push: Set .... .0.. = Reset: Not set .... ..0. = Syn: Not set .... ...0 = Fin: Not set Window size: 65535 Checksum: 0x8715 [incorrect, should be 0xef13 (maybe caused by "TCP checksum offload"?)] [Good Checksum: False] [Bad Checksum: True] [SEQ/ACK analysis] [This is an ACK to the segment in frame: 3] [The RTT to ACK the segment was: 0.000030000 seconds] Remote Procedure Call, Type:Call XID:0x57dbd4e1 Fragment header: Last fragment, 132 bytes 1... .... .... .... .... .... .... .... = Last Fragment: Yes .000 0000 0000 0000 0000 0000 1000 0100 = Fragment Length: 132 XID: 0x57dbd4e1 (1474024673) Message Type: Call (0) RPC Version: 2 Program: NFS (100003) Program Version: 3 Procedure: WRITE (7) [The reply to this request is in frame 5] Credentials Flavor: AUTH_UNIX (1) Length: 24 Stamp: 0x00000000 Machine Name: <EMPTY> length: 0 contents: <EMPTY> UID: 80 GID: 80 Auxiliary GIDs GID: 80 Verifier Flavor: AUTH_NULL (0) Length: 0 Network File System, WRITE Call FH:0x810602fc Offset:0 Len:15 UNSTABLE [Program Version: 3] [V3 Procedure: WRITE (7)] file length: 28 [hash: 0x810602fc] decode type as: unknown filehandle: 8B2696A907BF0ED40A001F8705000000029F040000000000... offset: 0 count: 15 Stable: UNSTABLE (0) Data: <DATA> length: 15 contents: <DATA> fill bytes: opaque data 0000 00 15 17 bf eb 7b 00 30 48 7b 52 34 08 00 45 00 .....{.0H{R4..E. 0010 00 b0 f8 ab 40 00 40 06 bb 29 c0 a8 02 99 c0 a8 ....@.@..)...... 0020 02 89 02 66 08 01 22 dd 1a 36 ee c3 be 62 50 18 ...f.."..6...bP. 0030 ff ff 87 15 00 00 80 00 00 84 57 db d4 e1 00 00 ..........W..... 0040 00 00 00 00 00 02 00 01 86 a3 00 00 00 03 00 00 ................ 0050 00 07 00 00 00 01 00 00 00 18 00 00 00 00 00 00 ................ 0060 00 00 00 00 00 50 00 00 00 50 00 00 00 01 00 00 .....P...P...... 0070 00 50 00 00 00 00 00 00 00 00 00 00 00 1c 8b 26 .P.............& 0080 96 a9 07 bf 0e d4 0a 00 1f 87 05 00 00 00 02 9f ................ 0090 04 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 ................ 00a0 00 00 00 00 00 0f 00 00 00 00 00 00 00 0f 38 39 ..............89 00b0 39 38 38 20 32 36 32 31 34 34 30 30 30 00 988 262144000. No. Time Source Destination Protocol Info 5 0.000498 192.168.2.137 192.168.2.153 NFS V3 WRITE Reply (Call In 4) Error:NFS3ERR_IO Frame 5 (94 bytes on wire, 94 bytes captured) Arrival Time: Jan 30, 2010 12:41:46.911326000 [Time delta from previous captured frame: 0.000221000 seconds] [Time delta from previous displayed frame: 0.000221000 seconds] [Time since reference or first frame: 0.000498000 seconds] Frame Number: 5 Frame Length: 94 bytes Capture Length: 94 bytes [Frame is marked: False] [Protocols in frame: eth:ip:tcp:rpc] [Coloring Rule Name: TCP] [Coloring Rule String: tcp] Ethernet II, Src: IntelCor_bf:eb:7b (00:15:17:bf:eb:7b), Dst: Supermic_7b:52:34 (00:30:48:7b:52:34) Destination: Supermic_7b:52:34 (00:30:48:7b:52:34) Address: Supermic_7b:52:34 (00:30:48:7b:52:34) .... ...0 .... .... .... .... = IG bit: Individual address (unicast) .... ..0. .... .... .... .... = LG bit: Globally unique address (factory default) Source: IntelCor_bf:eb:7b (00:15:17:bf:eb:7b) Address: IntelCor_bf:eb:7b (00:15:17:bf:eb:7b) .... ...0 .... .... .... .... = IG bit: Individual address (unicast) .... ..0. .... .... .... .... = LG bit: Globally unique address (factory default) Type: IP (0x0800) Internet Protocol, Src: 192.168.2.137 (192.168.2.137), Dst: 192.168.2.153 (192.168.2.153) Version: 4 Header length: 20 bytes Differentiated Services Field: 0x00 (DSCP 0x00: Default; ECN: 0x00) 0000 00.. = Differentiated Services Codepoint: Default (0x00) .... ..0. = ECN-Capable Transport (ECT): 0 .... ...0 = ECN-CE: 0 Total Length: 80 Identification: 0xb8d7 (47319) Flags: 0x04 (Don't Fragment) 0... = Reserved bit: Not set .1.. = Don't fragment: Set ..0. = More fragments: Not set Fragment offset: 0 Time to live: 64 Protocol: TCP (0x06) Header checksum: 0xfb5d [correct] [Good: True] [Bad : False] Source: 192.168.2.137 (192.168.2.137) Destination: 192.168.2.153 (192.168.2.153) Transmission Control Protocol, Src Port: nfs (2049), Dst Port: sshell (614), Seq: 81, Ack: 273, Len: 40 Source port: nfs (2049) Destination port: sshell (614) Sequence number: 81 (relative sequence number) [Next sequence number: 121 (relative sequence number)] Acknowledgement number: 273 (relative ack number) Header length: 20 bytes Flags: 0x18 (PSH, ACK) 0... .... = Congestion Window Reduced (CWR): Not set .0.. .... = ECN-Echo: Not set ..0. .... = Urgent: Not set ...1 .... = Acknowledgment: Set .... 1... = Push: Set .... .0.. = Reset: Not set .... ..0. = Syn: Not set .... ...0 = Fin: Not set Window size: 65535 Checksum: 0x8721 [correct] [Good Checksum: True] [Bad Checksum: False] [SEQ/ACK analysis] [This is an ACK to the segment in frame: 4] [The RTT to ACK the segment was: 0.000221000 seconds] Remote Procedure Call, Type:Reply XID:0x57dbd4e1 Fragment header: Last fragment, 36 bytes 1... .... .... .... .... .... .... .... = Last Fragment: Yes .000 0000 0000 0000 0000 0000 0010 0100 = Fragment Length: 36 XID: 0x57dbd4e1 (1474024673) Message Type: Reply (1) [Program: NFS (100003)] [Program Version: 3] [Procedure: WRITE (7)] Reply State: accepted (0) [This is a reply to a request in frame 4] [Time from request: 0.000221000 seconds] Verifier Flavor: AUTH_NULL (0) Length: 0 Accept State: RPC executed successfully (0) Network File System, WRITE Reply Error:NFS3ERR_IO [Program Version: 3] [V3 Procedure: WRITE (7)] Status: NFS3ERR_IO (5) file_wcc before attributes_follow: no value (0) after attributes_follow: no value (0) 0000 00 30 48 7b 52 34 00 15 17 bf eb 7b 08 00 45 00 .0H{R4.....{..E. 0010 00 50 b8 d7 40 00 40 06 fb 5d c0 a8 02 89 c0 a8 .P..@.@..]...... 0020 02 99 08 01 02 66 ee c3 be 62 22 dd 1a be 50 18 .....f...b"...P. 0030 ff ff 87 21 00 00 80 00 00 24 57 db d4 e1 00 00 ...!.....$W..... 0040 00 01 00 00 00 00 00 00 00 00 00 00 00 00 00 00 ................ 0050 00 00 00 00 00 05 00 00 00 00 00 00 00 00 .............. No. Time Source Destination Protocol Info 6 0.000531 192.168.2.153 192.168.2.137 NFS V3 WRITE Call (Reply In 7), FH:0x810602fc Offset:0 Len:15 UNSTABLE Frame 6 (190 bytes on wire, 190 bytes captured) Arrival Time: Jan 30, 2010 12:41:46.911359000 [Time delta from previous captured frame: 0.000033000 seconds] [Time delta from previous displayed frame: 0.000033000 seconds] [Time since reference or first frame: 0.000531000 seconds] Frame Number: 6 Frame Length: 190 bytes Capture Length: 190 bytes [Frame is marked: False] [Protocols in frame: eth:ip:tcp:rpc:nfs] [Coloring Rule Name: Checksum Errors] [Coloring Rule String: cdp.checksum_bad==1 || edp.checksum_bad==1 || ip.checksum_bad==1 || tcp.checksum_bad==1 || udp.checksum_bad==1] Ethernet II, Src: Supermic_7b:52:34 (00:30:48:7b:52:34), Dst: IntelCor_bf:eb:7b (00:15:17:bf:eb:7b) Destination: IntelCor_bf:eb:7b (00:15:17:bf:eb:7b) Address: IntelCor_bf:eb:7b (00:15:17:bf:eb:7b) .... ...0 .... .... .... .... = IG bit: Individual address (unicast) .... ..0. .... .... .... .... = LG bit: Globally unique address (factory default) Source: Supermic_7b:52:34 (00:30:48:7b:52:34) Address: Supermic_7b:52:34 (00:30:48:7b:52:34) .... ...0 .... .... .... .... = IG bit: Individual address (unicast) .... ..0. .... .... .... .... = LG bit: Globally unique address (factory default) Type: IP (0x0800) Internet Protocol, Src: 192.168.2.153 (192.168.2.153), Dst: 192.168.2.137 (192.168.2.137) Version: 4 Header length: 20 bytes Differentiated Services Field: 0x00 (DSCP 0x00: Default; ECN: 0x00) 0000 00.. = Differentiated Services Codepoint: Default (0x00) .... ..0. = ECN-Capable Transport (ECT): 0 .... ...0 = ECN-CE: 0 Total Length: 176 Identification: 0xf8ac (63660) Flags: 0x04 (Don't Fragment) 0... = Reserved bit: Not set .1.. = Don't fragment: Set ..0. = More fragments: Not set Fragment offset: 0 Time to live: 64 Protocol: TCP (0x06) Header checksum: 0xbb28 [correct] [Good: True] [Bad : False] Source: 192.168.2.153 (192.168.2.153) Destination: 192.168.2.137 (192.168.2.137) Transmission Control Protocol, Src Port: sshell (614), Dst Port: nfs (2049), Seq: 273, Ack: 121, Len: 136 Source port: sshell (614) Destination port: nfs (2049) Sequence number: 273 (relative sequence number) [Next sequence number: 409 (relative sequence number)] Acknowledgement number: 121 (relative ack number) Header length: 20 bytes Flags: 0x18 (PSH, ACK) 0... .... = Congestion Window Reduced (CWR): Not set .0.. .... = ECN-Echo: Not set ..0. .... = Urgent: Not set ...1 .... = Acknowledgment: Set .... 1... = Push: Set .... .0.. = Reset: Not set .... ..0. = Syn: Not set .... ...0 = Fin: Not set Window size: 65535 Checksum: 0x8715 [incorrect, should be 0xee62 (maybe caused by "TCP checksum offload"?)] [Good Checksum: False] [Bad Checksum: True] [SEQ/ACK analysis] [This is an ACK to the segment in frame: 5] [The RTT to ACK the segment was: 0.000033000 seconds] Remote Procedure Call, Type:Call XID:0x57dbd4e2 Fragment header: Last fragment, 132 bytes 1... .... .... .... .... .... .... .... = Last Fragment: Yes .000 0000 0000 0000 0000 0000 1000 0100 = Fragment Length: 132 XID: 0x57dbd4e2 (1474024674) Message Type: Call (0) RPC Version: 2 Program: NFS (100003) Program Version: 3 Procedure: WRITE (7) [The reply to this request is in frame 7] Credentials Flavor: AUTH_UNIX (1) Length: 24 Stamp: 0x00000000 Machine Name: <EMPTY> length: 0 contents: <EMPTY> UID: 80 GID: 80 Auxiliary GIDs GID: 80 Verifier Flavor: AUTH_NULL (0) Length: 0 Network File System, WRITE Call FH:0x810602fc Offset:0 Len:15 UNSTABLE [Program Version: 3] [V3 Procedure: WRITE (7)] file length: 28 [hash: 0x810602fc] decode type as: unknown filehandle: 8B2696A907BF0ED40A001F8705000000029F040000000000... offset: 0 count: 15 Stable: UNSTABLE (0) Data: <DATA> length: 15 contents: <DATA> fill bytes: opaque data 0000 00 15 17 bf eb 7b 00 30 48 7b 52 34 08 00 45 00 .....{.0H{R4..E. 0010 00 b0 f8 ac 40 00 40 06 bb 28 c0 a8 02 99 c0 a8 ....@.@..(...... 0020 02 89 02 66 08 01 22 dd 1a be ee c3 be 8a 50 18 ...f..".......P. 0030 ff ff 87 15 00 00 80 00 00 84 57 db d4 e2 00 00 ..........W..... 0040 00 00 00 00 00 02 00 01 86 a3 00 00 00 03 00 00 ................ 0050 00 07 00 00 00 01 00 00 00 18 00 00 00 00 00 00 ................ 0060 00 00 00 00 00 50 00 00 00 50 00 00 00 01 00 00 .....P...P...... 0070 00 50 00 00 00 00 00 00 00 00 00 00 00 1c 8b 26 .P.............& 0080 96 a9 07 bf 0e d4 0a 00 1f 87 05 00 00 00 02 9f ................ 0090 04 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 ................ 00a0 00 00 00 00 00 0f 00 00 00 00 00 00 00 0f 38 39 ..............89 00b0 39 38 38 20 32 36 32 31 34 34 30 30 30 00 988 262144000. No. Time Source Destination Protocol Info 7 0.000747 192.168.2.137 192.168.2.153 NFS V3 WRITE Reply (Call In 6) Error:NFS3ERR_IO Frame 7 (94 bytes on wire, 94 bytes captured) Arrival Time: Jan 30, 2010 12:41:46.911575000 [Time delta from previous captured frame: 0.000216000 seconds] [Time delta from previous displayed frame: 0.000216000 seconds] [Time since reference or first frame: 0.000747000 seconds] Frame Number: 7 Frame Length: 94 bytes Capture Length: 94 bytes [Frame is marked: False] [Protocols in frame: eth:ip:tcp:rpc] [Coloring Rule Name: TCP] [Coloring Rule String: tcp] Ethernet II, Src: IntelCor_bf:eb:7b (00:15:17:bf:eb:7b), Dst: Supermic_7b:52:34 (00:30:48:7b:52:34) Destination: Supermic_7b:52:34 (00:30:48:7b:52:34) Address: Supermic_7b:52:34 (00:30:48:7b:52:34) .... ...0 .... .... .... .... = IG bit: Individual address (unicast) .... ..0. .... .... .... .... = LG bit: Globally unique address (factory default) Source: IntelCor_bf:eb:7b (00:15:17:bf:eb:7b) Address: IntelCor_bf:eb:7b (00:15:17:bf:eb:7b) .... ...0 .... .... .... .... = IG bit: Individual address (unicast) .... ..0. .... .... .... .... = LG bit: Globally unique address (factory default) Type: IP (0x0800) Internet Protocol, Src: 192.168.2.137 (192.168.2.137), Dst: 192.168.2.153 (192.168.2.153) Version: 4 Header length: 20 bytes Differentiated Services Field: 0x00 (DSCP 0x00: Default; ECN: 0x00) 0000 00.. = Differentiated Services Codepoint: Default (0x00) .... ..0. = ECN-Capable Transport (ECT): 0 .... ...0 = ECN-CE: 0 Total Length: 80 Identification: 0xb8d8 (47320) Flags: 0x04 (Don't Fragment) 0... = Reserved bit: Not set .1.. = Don't fragment: Set ..0. = More fragments: Not set Fragment offset: 0 Time to live: 64 Protocol: TCP (0x06) Header checksum: 0xfb5c [correct] [Good: True] [Bad : False] Source: 192.168.2.137 (192.168.2.137) Destination: 192.168.2.153 (192.168.2.153) Transmission Control Protocol, Src Port: nfs (2049), Dst Port: sshell (614), Seq: 121, Ack: 409, Len: 40 Source port: nfs (2049) Destination port: sshell (614) Sequence number: 121 (relative sequence number) [Next sequence number: 161 (relative sequence number)] Acknowledgement number: 409 (relative ack number) Header length: 20 bytes Flags: 0x18 (PSH, ACK) 0... .... = Congestion Window Reduced (CWR): Not set .0.. .... = ECN-Echo: Not set ..0. .... = Urgent: Not set ...1 .... = Acknowledgment: Set .... 1... = Push: Set .... .0.. = Reset: Not set .... ..0. = Syn: Not set .... ...0 = Fin: Not set Window size: 65535 Checksum: 0x8670 [correct] [Good Checksum: True] [Bad Checksum: False] [SEQ/ACK analysis] [This is an ACK to the segment in frame: 6] [The RTT to ACK the segment was: 0.000216000 seconds] Remote Procedure Call, Type:Reply XID:0x57dbd4e2 Fragment header: Last fragment, 36 bytes 1... .... .... .... .... .... .... .... = Last Fragment: Yes .000 0000 0000 0000 0000 0000 0010 0100 = Fragment Length: 36 XID: 0x57dbd4e2 (1474024674) Message Type: Reply (1) [Program: NFS (100003)] [Program Version: 3] [Procedure: WRITE (7)] Reply State: accepted (0) [This is a reply to a request in frame 6] [Time from request: 0.000216000 seconds] Verifier Flavor: AUTH_NULL (0) Length: 0 Accept State: RPC executed successfully (0) Network File System, WRITE Reply Error:NFS3ERR_IO [Program Version: 3] [V3 Procedure: WRITE (7)] Status: NFS3ERR_IO (5) file_wcc before attributes_follow: no value (0) after attributes_follow: no value (0) 0000 00 30 48 7b 52 34 00 15 17 bf eb 7b 08 00 45 00 .0H{R4.....{..E. 0010 00 50 b8 d8 40 00 40 06 fb 5c c0 a8 02 89 c0 a8 .P..@.@..\...... 0020 02 99 08 01 02 66 ee c3 be 8a 22 dd 1b 46 50 18 .....f...."..FP. 0030 ff ff 86 70 00 00 80 00 00 24 57 db d4 e2 00 00 ...p.....$W..... 0040 00 01 00 00 00 00 00 00 00 00 00 00 00 00 00 00 ................ 0050 00 00 00 00 00 05 00 00 00 00 00 00 00 00 .............. No. Time Source Destination Protocol Info 8 0.000776 192.168.2.153 192.168.2.137 NFS V3 WRITE Call (Reply In 9), FH:0x810602fc Offset:0 Len:15 UNSTABLE Frame 8 (190 bytes on wire, 190 bytes captured) Arrival Time: Jan 30, 2010 12:41:46.911604000 [Time delta from previous captured frame: 0.000029000 seconds] [Time delta from previous displayed frame: 0.000029000 seconds] [Time since reference or first frame: 0.000776000 seconds] Frame Number: 8 Frame Length: 190 bytes Capture Length: 190 bytes [Frame is marked: False] [Protocols in frame: eth:ip:tcp:rpc:nfs] [Coloring Rule Name: Checksum Errors] [Coloring Rule String: cdp.checksum_bad==1 || edp.checksum_bad==1 || ip.checksum_bad==1 || tcp.checksum_bad==1 || udp.checksum_bad==1] Ethernet II, Src: Supermic_7b:52:34 (00:30:48:7b:52:34), Dst: IntelCor_bf:eb:7b (00:15:17:bf:eb:7b) Destination: IntelCor_bf:eb:7b (00:15:17:bf:eb:7b) Address: IntelCor_bf:eb:7b (00:15:17:bf:eb:7b) .... ...0 .... .... .... .... = IG bit: Individual address (unicast) .... ..0. .... .... .... .... = LG bit: Globally unique address (factory default) Source: Supermic_7b:52:34 (00:30:48:7b:52:34) Address: Supermic_7b:52:34 (00:30:48:7b:52:34) .... ...0 .... .... .... .... = IG bit: Individual address (unicast) .... ..0. .... .... .... .... = LG bit: Globally unique address (factory default) Type: IP (0x0800) Internet Protocol, Src: 192.168.2.153 (192.168.2.153), Dst: 192.168.2.137 (192.168.2.137) Version: 4 Header length: 20 bytes Differentiated Services Field: 0x00 (DSCP 0x00: Default; ECN: 0x00) 0000 00.. = Differentiated Services Codepoint: Default (0x00) .... ..0. = ECN-Capable Transport (ECT): 0 .... ...0 = ECN-CE: 0 Total Length: 176 Identification: 0xf8ad (63661) Flags: 0x04 (Don't Fragment) 0... = Reserved bit: Not set .1.. = Don't fragment: Set ..0. = More fragments: Not set Fragment offset: 0 Time to live: 64 Protocol: TCP (0x06) Header checksum: 0xbb27 [correct] [Good: True] [Bad : False] Source: 192.168.2.153 (192.168.2.153) Destination: 192.168.2.137 (192.168.2.137) Transmission Control Protocol, Src Port: sshell (614), Dst Port: nfs (2049), Seq: 409, Ack: 161, Len: 136 Source port: sshell (614) Destination port: nfs (2049) Sequence number: 409 (relative sequence number) [Next sequence number: 545 (relative sequence number)] Acknowledgement number: 161 (relative ack number) Header length: 20 bytes Flags: 0x18 (PSH, ACK) 0... .... = Congestion Window Reduced (CWR): Not set .0.. .... = ECN-Echo: Not set ..0. .... = Urgent: Not set ...1 .... = Acknowledgment: Set .... 1... = Push: Set .... .0.. = Reset: Not set .... ..0. = Syn: Not set .... ...0 = Fin: Not set Window size: 65535 Checksum: 0x8715 [incorrect, should be 0xedb1 (maybe caused by "TCP checksum offload"?)] [Good Checksum: False] [Bad Checksum: True] [SEQ/ACK analysis] [This is an ACK to the segment in frame: 7] [The RTT to ACK the segment was: 0.000029000 seconds] Remote Procedure Call, Type:Call XID:0x57dbd4e3 Fragment header: Last fragment, 132 bytes 1... .... .... .... .... .... .... .... = Last Fragment: Yes .000 0000 0000 0000 0000 0000 1000 0100 = Fragment Length: 132 XID: 0x57dbd4e3 (1474024675) Message Type: Call (0) RPC Version: 2 Program: NFS (100003) Program Version: 3 Procedure: WRITE (7) [The reply to this request is in frame 9] Credentials Flavor: AUTH_UNIX (1) Length: 24 Stamp: 0x00000000 Machine Name: <EMPTY> length: 0 contents: <EMPTY> UID: 80 GID: 80 Auxiliary GIDs GID: 80 Verifier Flavor: AUTH_NULL (0) Length: 0 Network File System, WRITE Call FH:0x810602fc Offset:0 Len:15 UNSTABLE [Program Version: 3] [V3 Procedure: WRITE (7)] file length: 28 [hash: 0x810602fc] decode type as: unknown filehandle: 8B2696A907BF0ED40A001F8705000000029F040000000000... offset: 0 count: 15 Stable: UNSTABLE (0) Data: <DATA> length: 15 contents: <DATA> fill bytes: opaque data 0000 00 15 17 bf eb 7b 00 30 48 7b 52 34 08 00 45 00 .....{.0H{R4..E. 0010 00 b0 f8 ad 40 00 40 06 bb 27 c0 a8 02 99 c0 a8 ....@.@..'...... 0020 02 89 02 66 08 01 22 dd 1b 46 ee c3 be b2 50 18 ...f.."..F....P. 0030 ff ff 87 15 00 00 80 00 00 84 57 db d4 e3 00 00 ..........W..... 0040 00 00 00 00 00 02 00 01 86 a3 00 00 00 03 00 00 ................ 0050 00 07 00 00 00 01 00 00 00 18 00 00 00 00 00 00 ................ 0060 00 00 00 00 00 50 00 00 00 50 00 00 00 01 00 00 .....P...P...... 0070 00 50 00 00 00 00 00 00 00 00 00 00 00 1c 8b 26 .P.............& 0080 96 a9 07 bf 0e d4 0a 00 1f 87 05 00 00 00 02 9f ................ 0090 04 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 ................ 00a0 00 00 00 00 00 0f 00 00 00 00 00 00 00 0f 38 39 ..............89 00b0 39 38 38 20 32 36 32 31 34 34 30 30 30 00 988 262144000. No. Time Source Destination Protocol Info 9 0.000997 192.168.2.137 192.168.2.153 NFS V3 WRITE Reply (Call In 8) Error:NFS3ERR_IO Frame 9 (94 bytes on wire, 94 bytes captured) Arrival Time: Jan 30, 2010 12:41:46.911825000 [Time delta from previous captured frame: 0.000221000 seconds] [Time delta from previous displayed frame: 0.000221000 seconds] [Time since reference or first frame: 0.000997000 seconds] Frame Number: 9 Frame Length: 94 bytes Capture Length: 94 bytes [Frame is marked: False] [Protocols in frame: eth:ip:tcp:rpc] [Coloring Rule Name: TCP] [Coloring Rule String: tcp] Ethernet II, Src: IntelCor_bf:eb:7b (00:15:17:bf:eb:7b), Dst: Supermic_7b:52:34 (00:30:48:7b:52:34) Destination: Supermic_7b:52:34 (00:30:48:7b:52:34) Address: Supermic_7b:52:34 (00:30:48:7b:52:34) .... ...0 .... .... .... .... = IG bit: Individual address (unicast) .... ..0. .... .... .... .... = LG bit: Globally unique address (factory default) Source: IntelCor_bf:eb:7b (00:15:17:bf:eb:7b) Address: IntelCor_bf:eb:7b (00:15:17:bf:eb:7b) .... ...0 .... .... .... .... = IG bit: Individual address (unicast) .... ..0. .... .... .... .... = LG bit: Globally unique address (factory default) Type: IP (0x0800) Internet Protocol, Src: 192.168.2.137 (192.168.2.137), Dst: 192.168.2.153 (192.168.2.153) Version: 4 Header length: 20 bytes Differentiated Services Field: 0x00 (DSCP 0x00: Default; ECN: 0x00) 0000 00.. = Differentiated Services Codepoint: Default (0x00) .... ..0. = ECN-Capable Transport (ECT): 0 .... ...0 = ECN-CE: 0 Total Length: 80 Identification: 0xb8d9 (47321) Flags: 0x04 (Don't Fragment) 0... = Reserved bit: Not set .1.. = Don't fragment: Set ..0. = More fragments: Not set Fragment offset: 0 Time to live: 64 Protocol: TCP (0x06) Header checksum: 0xfb5b [correct] [Good: True] [Bad : False] Source: 192.168.2.137 (192.168.2.137) Destination: 192.168.2.153 (192.168.2.153) Transmission Control Protocol, Src Port: nfs (2049), Dst Port: sshell (614), Seq: 161, Ack: 545, Len: 40 Source port: nfs (2049) Destination port: sshell (614) Sequence number: 161 (relative sequence number) [Next sequence number: 201 (relative sequence number)] Acknowledgement number: 545 (relative ack number) Header length: 20 bytes Flags: 0x18 (PSH, ACK) 0... .... = Congestion Window Reduced (CWR): Not set .0.. .... = ECN-Echo: Not set ..0. .... = Urgent: Not set ...1 .... = Acknowledgment: Set .... 1... = Push: Set .... .0.. = Reset: Not set .... ..0. = Syn: Not set .... ...0 = Fin: Not set Window size: 65535 Checksum: 0x85bf [correct] [Good Checksum: True] [Bad Checksum: False] [SEQ/ACK analysis] [This is an ACK to the segment in frame: 8] [The RTT to ACK the segment was: 0.000221000 seconds] Remote Procedure Call, Type:Reply XID:0x57dbd4e3 Fragment header: Last fragment, 36 bytes 1... .... .... .... .... .... .... .... = Last Fragment: Yes .000 0000 0000 0000 0000 0000 0010 0100 = Fragment Length: 36 XID: 0x57dbd4e3 (1474024675) Message Type: Reply (1) [Program: NFS (100003)] [Program Version: 3] [Procedure: WRITE (7)] Reply State: accepted (0) [This is a reply to a request in frame 8] [Time from request: 0.000221000 seconds] Verifier Flavor: AUTH_NULL (0) Length: 0 Accept State: RPC executed successfully (0) Network File System, WRITE Reply Error:NFS3ERR_IO [Program Version: 3] [V3 Procedure: WRITE (7)] Status: NFS3ERR_IO (5) file_wcc before attributes_follow: no value (0) after attributes_follow: no value (0) 0000 00 30 48 7b 52 34 00 15 17 bf eb 7b 08 00 45 00 .0H{R4.....{..E. 0010 00 50 b8 d9 40 00 40 06 fb 5b c0 a8 02 89 c0 a8 .P..@.@..[...... 0020 02 99 08 01 02 66 ee c3 be b2 22 dd 1b ce 50 18 .....f...."...P. 0030 ff ff 85 bf 00 00 80 00 00 24 57 db d4 e3 00 00 .........$W..... 0040 00 01 00 00 00 00 00 00 00 00 00 00 00 00 00 00 ................ 0050 00 00 00 00 00 05 00 00 00 00 00 00 00 00 .............. No. Time Source Destination Protocol Info 10 0.001026 192.168.2.153 192.168.2.137 NFS V3 WRITE Call (Reply In 11), FH:0x810602fc Offset:0 Len:15 UNSTABLE Frame 10 (190 bytes on wire, 190 bytes captured) Arrival Time: Jan 30, 2010 12:41:46.911854000 [Time delta from previous captured frame: 0.000029000 seconds] [Time delta from previous displayed frame: 0.000029000 seconds] [Time since reference or first frame: 0.001026000 seconds] Frame Number: 10 Frame Length: 190 bytes Capture Length: 190 bytes [Frame is marked: False] [Protocols in frame: eth:ip:tcp:rpc:nfs] [Coloring Rule Name: Checksum Errors] [Coloring Rule String: cdp.checksum_bad==1 || edp.checksum_bad==1 || ip.checksum_bad==1 || tcp.checksum_bad==1 || udp.checksum_bad==1] Ethernet II, Src: Supermic_7b:52:34 (00:30:48:7b:52:34), Dst: IntelCor_bf:eb:7b (00:15:17:bf:eb:7b) Destination: IntelCor_bf:eb:7b (00:15:17:bf:eb:7b) Address: IntelCor_bf:eb:7b (00:15:17:bf:eb:7b) .... ...0 .... .... .... .... = IG bit: Individual address (unicast) .... ..0. .... .... .... .... = LG bit: Globally unique address (factory default) Source: Supermic_7b:52:34 (00:30:48:7b:52:34) Address: Supermic_7b:52:34 (00:30:48:7b:52:34) .... ...0 .... .... .... .... = IG bit: Individual address (unicast) .... ..0. .... .... .... .... = LG bit: Globally unique address (factory default) Type: IP (0x0800) Internet Protocol, Src: 192.168.2.153 (192.168.2.153), Dst: 192.168.2.137 (192.168.2.137) Version: 4 Header length: 20 bytes Differentiated Services Field: 0x00 (DSCP 0x00: Default; ECN: 0x00) 0000 00.. = Differentiated Services Codepoint: Default (0x00) .... ..0. = ECN-Capable Transport (ECT): 0 .... ...0 = ECN-CE: 0 Total Length: 176 Identification: 0xf8ae (63662) Flags: 0x04 (Don't Fragment) 0... = Reserved bit: Not set .1.. = Don't fragment: Set ..0. = More fragments: Not set Fragment offset: 0 Time to live: 64 Protocol: TCP (0x06) Header checksum: 0xbb26 [correct] [Good: True] [Bad : False] Source: 192.168.2.153 (192.168.2.153) Destination: 192.168.2.137 (192.168.2.137) Transmission Control Protocol, Src Port: sshell (614), Dst Port: nfs (2049), Seq: 545, Ack: 201, Len: 136 Source port: sshell (614) Destination port: nfs (2049) Sequence number: 545 (relative sequence number) [Next sequence number: 681 (relative sequence number)] Acknowledgement number: 201 (relative ack number) Header length: 20 bytes Flags: 0x18 (PSH, ACK) 0... .... = Congestion Window Reduced (CWR): Not set .0.. .... = ECN-Echo: Not set ..0. .... = Urgent: Not set ...1 .... = Acknowledgment: Set .... 1... = Push: Set .... .0.. = Reset: Not set .... ..0. = Syn: Not set .... ...0 = Fin: Not set Window size: 65535 Checksum: 0x8715 [incorrect, should be 0xed00 (maybe caused by "TCP checksum offload"?)] [Good Checksum: False] [Bad Checksum: True] [SEQ/ACK analysis] [This is an ACK to the segment in frame: 9] [The RTT to ACK the segment was: 0.000029000 seconds] Remote Procedure Call, Type:Call XID:0x57dbd4e4 Fragment header: Last fragment, 132 bytes 1... .... .... .... .... .... .... .... = Last Fragment: Yes .000 0000 0000 0000 0000 0000 1000 0100 = Fragment Length: 132 XID: 0x57dbd4e4 (1474024676) Message Type: Call (0) RPC Version: 2 Program: NFS (100003) Program Version: 3 Procedure: WRITE (7) [The reply to this request is in frame 11] Credentials Flavor: AUTH_UNIX (1) Length: 24 Stamp: 0x00000000 Machine Name: <EMPTY> length: 0 contents: <EMPTY> UID: 80 GID: 80 Auxiliary GIDs GID: 80 Verifier Flavor: AUTH_NULL (0) Length: 0 Network File System, WRITE Call FH:0x810602fc Offset:0 Len:15 UNSTABLE [Program Version: 3] [V3 Procedure: WRITE (7)] file length: 28 [hash: 0x810602fc] decode type as: unknown filehandle: 8B2696A907BF0ED40A001F8705000000029F040000000000... offset: 0 count: 15 Stable: UNSTABLE (0) Data: <DATA> length: 15 contents: <DATA> fill bytes: opaque data 0000 00 15 17 bf eb 7b 00 30 48 7b 52 34 08 00 45 00 .....{.0H{R4..E. 0010 00 b0 f8 ae 40 00 40 06 bb 26 c0 a8 02 99 c0 a8 ....@.@..&...... 0020 02 89 02 66 08 01 22 dd 1b ce ee c3 be da 50 18 ...f..".......P. 0030 ff ff 87 15 00 00 80 00 00 84 57 db d4 e4 00 00 ..........W..... 0040 00 00 00 00 00 02 00 01 86 a3 00 00 00 03 00 00 ................ 0050 00 07 00 00 00 01 00 00 00 18 00 00 00 00 00 00 ................ 0060 00 00 00 00 00 50 00 00 00 50 00 00 00 01 00 00 .....P...P...... 0070 00 50 00 00 00 00 00 00 00 00 00 00 00 1c 8b 26 .P.............& 0080 96 a9 07 bf 0e d4 0a 00 1f 87 05 00 00 00 02 9f ................ 0090 04 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 ................ 00a0 00 00 00 00 00 0f 00 00 00 00 00 00 00 0f 38 39 ..............89 00b0 39 38 38 20 32 36 32 31 34 34 30 30 30 00 988 262144000. No. Time Source Destination Protocol Info 11 0.001247 192.168.2.137 192.168.2.153 NFS V3 WRITE Reply (Call In 10) Error:NFS3ERR_IO Frame 11 (94 bytes on wire, 94 bytes captured) Arrival Time: Jan 30, 2010 12:41:46.912075000 [Time delta from previous captured frame: 0.000221000 seconds] [Time delta from previous displayed frame: 0.000221000 seconds] [Time since reference or first frame: 0.001247000 seconds] Frame Number: 11 Frame Length: 94 bytes Capture Length: 94 bytes [Frame is marked: False] [Protocols in frame: eth:ip:tcp:rpc] [Coloring Rule Name: TCP] [Coloring Rule String: tcp] Ethernet II, Src: IntelCor_bf:eb:7b (00:15:17:bf:eb:7b), Dst: Supermic_7b:52:34 (00:30:48:7b:52:34) Destination: Supermic_7b:52:34 (00:30:48:7b:52:34) Address: Supermic_7b:52:34 (00:30:48:7b:52:34) .... ...0 .... .... .... .... = IG bit: Individual address (unicast) .... ..0. .... .... .... .... = LG bit: Globally unique address (factory default) Source: IntelCor_bf:eb:7b (00:15:17:bf:eb:7b) Address: IntelCor_bf:eb:7b (00:15:17:bf:eb:7b) .... ...0 .... .... .... .... = IG bit: Individual address (unicast) .... ..0. .... .... .... .... = LG bit: Globally unique address (factory default) Type: IP (0x0800) Internet Protocol, Src: 192.168.2.137 (192.168.2.137), Dst: 192.168.2.153 (192.168.2.153) Version: 4 Header length: 20 bytes Differentiated Services Field: 0x00 (DSCP 0x00: Default; ECN: 0x00) 0000 00.. = Differentiated Services Codepoint: Default (0x00) .... ..0. = ECN-Capable Transport (ECT): 0 .... ...0 = ECN-CE: 0 Total Length: 80 Identification: 0xb8da (47322) Flags: 0x04 (Don't Fragment) 0... = Reserved bit: Not set .1.. = Don't fragment: Set ..0. = More fragments: Not set Fragment offset: 0 Time to live: 64 Protocol: TCP (0x06) Header checksum: 0xfb5a [correct] [Good: True] [Bad : False] Source: 192.168.2.137 (192.168.2.137) Destination: 192.168.2.153 (192.168.2.153) Transmission Control Protocol, Src Port: nfs (2049), Dst Port: sshell (614), Seq: 201, Ack: 681, Len: 40 Source port: nfs (2049) Destination port: sshell (614) Sequence number: 201 (relative sequence number) [Next sequence number: 241 (relative sequence number)] Acknowledgement number: 681 (relative ack number) Header length: 20 bytes Flags: 0x18 (PSH, ACK) 0... .... = Congestion Window Reduced (CWR): Not set .0.. .... = ECN-Echo: Not set ..0. .... = Urgent: Not set ...1 .... = Acknowledgment: Set .... 1... = Push: Set .... .0.. = Reset: Not set .... ..0. = Syn: Not set .... ...0 = Fin: Not set Window size: 65535 Checksum: 0x850e [correct] [Good Checksum: True] [Bad Checksum: False] [SEQ/ACK analysis] [This is an ACK to the segment in frame: 10] [The RTT to ACK the segment was: 0.000221000 seconds] Remote Procedure Call, Type:Reply XID:0x57dbd4e4 Fragment header: Last fragment, 36 bytes 1... .... .... .... .... .... .... .... = Last Fragment: Yes .000 0000 0000 0000 0000 0000 0010 0100 = Fragment Length: 36 XID: 0x57dbd4e4 (1474024676) Message Type: Reply (1) [Program: NFS (100003)] [Program Version: 3] [Procedure: WRITE (7)] Reply State: accepted (0) [This is a reply to a request in frame 10] [Time from request: 0.000221000 seconds] Verifier Flavor: AUTH_NULL (0) Length: 0 Accept State: RPC executed successfully (0) Network File System, WRITE Reply Error:NFS3ERR_IO [Program Version: 3] [V3 Procedure: WRITE (7)] Status: NFS3ERR_IO (5) file_wcc before attributes_follow: no value (0) after attributes_follow: no value (0) 0000 00 30 48 7b 52 34 00 15 17 bf eb 7b 08 00 45 00 .0H{R4.....{..E. 0010 00 50 b8 da 40 00 40 06 fb 5a c0 a8 02 89 c0 a8 .P..@.@..Z...... 0020 02 99 08 01 02 66 ee c3 be da 22 dd 1c 56 50 18 .....f...."..VP. 0030 ff ff 85 0e 00 00 80 00 00 24 57 db d4 e4 00 00 .........$W..... 0040 00 01 00 00 00 00 00 00 00 00 00 00 00 00 00 00 ................ 0050 00 00 00 00 00 05 00 00 00 00 00 00 00 00 .............. No. Time Source Destination Protocol Info 12 0.001276 192.168.2.153 192.168.2.137 NFS V3 WRITE Call (Reply In 13), FH:0x810602fc Offset:0 Len:15 UNSTABLE Frame 12 (190 bytes on wire, 190 bytes captured) Arrival Time: Jan 30, 2010 12:41:46.912104000 [Time delta from previous captured frame: 0.000029000 seconds] [Time delta from previous displayed frame: 0.000029000 seconds] [Time since reference or first frame: 0.001276000 seconds] Frame Number: 12 Frame Length: 190 bytes Capture Length: 190 bytes [Frame is marked: False] [Protocols in frame: eth:ip:tcp:rpc:nfs] [Coloring Rule Name: Checksum Errors] [Coloring Rule String: cdp.checksum_bad==1 || edp.checksum_bad==1 || ip.checksum_bad==1 || tcp.checksum_bad==1 || udp.checksum_bad==1] Ethernet II, Src: Supermic_7b:52:34 (00:30:48:7b:52:34), Dst: IntelCor_bf:eb:7b (00:15:17:bf:eb:7b) Destination: IntelCor_bf:eb:7b (00:15:17:bf:eb:7b) Address: IntelCor_bf:eb:7b (00:15:17:bf:eb:7b) .... ...0 .... .... .... .... = IG bit: Individual address (unicast) .... ..0. .... .... .... .... = LG bit: Globally unique address (factory default) Source: Supermic_7b:52:34 (00:30:48:7b:52:34) Address: Supermic_7b:52:34 (00:30:48:7b:52:34) .... ...0 .... .... .... .... = IG bit: Individual address (unicast) .... ..0. .... .... .... .... = LG bit: Globally unique address (factory default) Type: IP (0x0800) Internet Protocol, Src: 192.168.2.153 (192.168.2.153), Dst: 192.168.2.137 (192.168.2.137) Version: 4 Header length: 20 bytes Differentiated Services Field: 0x00 (DSCP 0x00: Default; ECN: 0x00) 0000 00.. = Differentiated Services Codepoint: Default (0x00) .... ..0. = ECN-Capable Transport (ECT): 0 .... ...0 = ECN-CE: 0 Total Length: 176 Identification: 0xf8af (63663) Flags: 0x04 (Don't Fragment) 0... = Reserved bit: Not set .1.. = Don't fragment: Set ..0. = More fragments: Not set Fragment offset: 0 Time to live: 64 Protocol: TCP (0x06) Header checksum: 0xbb25 [correct] [Good: True] [Bad : False] Source: 192.168.2.153 (192.168.2.153) Destination: 192.168.2.137 (192.168.2.137) Transmission Control Protocol, Src Port: sshell (614), Dst Port: nfs (2049), Seq: 681, Ack: 241, Len: 136 Source port: sshell (614) Destination port: nfs (2049) Sequence number: 681 (relative sequence number) [Next sequence number: 817 (relative sequence number)] Acknowledgement number: 241 (relative ack number) Header length: 20 bytes Flags: 0x18 (PSH, ACK) 0... .... = Congestion Window Reduced (CWR): Not set .0.. .... = ECN-Echo: Not set ..0. .... = Urgent: Not set ...1 .... = Acknowledgment: Set .... 1... = Push: Set .... .0.. = Reset: Not set .... ..0. = Syn: Not set .... ...0 = Fin: Not set Window size: 65535 Checksum: 0x8715 [incorrect, should be 0xec4f (maybe caused by "TCP checksum offload"?)] [Good Checksum: False] [Bad Checksum: True] [SEQ/ACK analysis] [This is an ACK to the segment in frame: 11] [The RTT to ACK the segment was: 0.000029000 seconds] Remote Procedure Call, Type:Call XID:0x57dbd4e5 Fragment header: Last fragment, 132 bytes 1... .... .... .... .... .... .... .... = Last Fragment: Yes .000 0000 0000 0000 0000 0000 1000 0100 = Fragment Length: 132 XID: 0x57dbd4e5 (1474024677) Message Type: Call (0) RPC Version: 2 Program: NFS (100003) Program Version: 3 Procedure: WRITE (7) [The reply to this request is in frame 13] Credentials Flavor: AUTH_UNIX (1) Length: 24 Stamp: 0x00000000 Machine Name: <EMPTY> length: 0 contents: <EMPTY> UID: 80 GID: 80 Auxiliary GIDs GID: 80 Verifier Flavor: AUTH_NULL (0) Length: 0 Network File System, WRITE Call FH:0x810602fc Offset:0 Len:15 UNSTABLE [Program Version: 3] [V3 Procedure: WRITE (7)] file length: 28 [hash: 0x810602fc] decode type as: unknown filehandle: 8B2696A907BF0ED40A001F8705000000029F040000000000... offset: 0 count: 15 Stable: UNSTABLE (0) Data: <DATA> length: 15 contents: <DATA> fill bytes: opaque data 0000 00 15 17 bf eb 7b 00 30 48 7b 52 34 08 00 45 00 .....{.0H{R4..E. 0010 00 b0 f8 af 40 00 40 06 bb 25 c0 a8 02 99 c0 a8 ....@.@..%...... 0020 02 89 02 66 08 01 22 dd 1c 56 ee c3 bf 02 50 18 ...f.."..V....P. 0030 ff ff 87 15 00 00 80 00 00 84 57 db d4 e5 00 00 ..........W..... 0040 00 00 00 00 00 02 00 01 86 a3 00 00 00 03 00 00 ................ 0050 00 07 00 00 00 01 00 00 00 18 00 00 00 00 00 00 ................ 0060 00 00 00 00 00 50 00 00 00 50 00 00 00 01 00 00 .....P...P...... 0070 00 50 00 00 00 00 00 00 00 00 00 00 00 1c 8b 26 .P.............& 0080 96 a9 07 bf 0e d4 0a 00 1f 87 05 00 00 00 02 9f ................ 0090 04 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 ................ 00a0 00 00 00 00 00 0f 00 00 00 00 00 00 00 0f 38 39 ..............89 00b0 39 38 38 20 32 36 32 31 34 34 30 30 30 00 988 262144000. No. Time Source Destination Protocol Info 13 0.001497 192.168.2.137 192.168.2.153 NFS V3 WRITE Reply (Call In 12) Error:NFS3ERR_IO Frame 13 (94 bytes on wire, 94 bytes captured) Arrival Time: Jan 30, 2010 12:41:46.912325000 [Time delta from previous captured frame: 0.000221000 seconds] [Time delta from previous displayed frame: 0.000221000 seconds] [Time since reference or first frame: 0.001497000 seconds] Frame Number: 13 Frame Length: 94 bytes Capture Length: 94 bytes [Frame is marked: False] [Protocols in frame: eth:ip:tcp:rpc] [Coloring Rule Name: TCP] [Coloring Rule String: tcp] Ethernet II, Src: IntelCor_bf:eb:7b (00:15:17:bf:eb:7b), Dst: Supermic_7b:52:34 (00:30:48:7b:52:34) Destination: Supermic_7b:52:34 (00:30:48:7b:52:34) Address: Supermic_7b:52:34 (00:30:48:7b:52:34) .... ...0 .... .... .... .... = IG bit: Individual address (unicast) .... ..0. .... .... .... .... = LG bit: Globally unique address (factory default) Source: IntelCor_bf:eb:7b (00:15:17:bf:eb:7b) Address: IntelCor_bf:eb:7b (00:15:17:bf:eb:7b) .... ...0 .... .... .... .... = IG bit: Individual address (unicast) .... ..0. .... .... .... .... = LG bit: Globally unique address (factory default) Type: IP (0x0800) Internet Protocol, Src: 192.168.2.137 (192.168.2.137), Dst: 192.168.2.153 (192.168.2.153) Version: 4 Header length: 20 bytes Differentiated Services Field: 0x00 (DSCP 0x00: Default; ECN: 0x00) 0000 00.. = Differentiated Services Codepoint: Default (0x00) .... ..0. = ECN-Capable Transport (ECT): 0 .... ...0 = ECN-CE: 0 Total Length: 80 Identification: 0xb8db (47323) Flags: 0x04 (Don't Fragment) 0... = Reserved bit: Not set .1.. = Don't fragment: Set ..0. = More fragments: Not set Fragment offset: 0 Time to live: 64 Protocol: TCP (0x06) Header checksum: 0xfb59 [correct] [Good: True] [Bad : False] Source: 192.168.2.137 (192.168.2.137) Destination: 192.168.2.153 (192.168.2.153) Transmission Control Protocol, Src Port: nfs (2049), Dst Port: sshell (614), Seq: 241, Ack: 817, Len: 40 Source port: nfs (2049) Destination port: sshell (614) Sequence number: 241 (relative sequence number) [Next sequence number: 281 (relative sequence number)] Acknowledgement number: 817 (relative ack number) Header length: 20 bytes Flags: 0x18 (PSH, ACK) 0... .... = Congestion Window Reduced (CWR): Not set .0.. .... = ECN-Echo: Not set ..0. .... = Urgent: Not set ...1 .... = Acknowledgment: Set .... 1... = Push: Set .... .0.. = Reset: Not set .... ..0. = Syn: Not set .... ...0 = Fin: Not set Window size: 65535 Checksum: 0x845d [correct] [Good Checksum: True] [Bad Checksum: False] [SEQ/ACK analysis] [This is an ACK to the segment in frame: 12] [The RTT to ACK the segment was: 0.000221000 seconds] Remote Procedure Call, Type:Reply XID:0x57dbd4e5 Fragment header: Last fragment, 36 bytes 1... .... .... .... .... .... .... .... = Last Fragment: Yes .000 0000 0000 0000 0000 0000 0010 0100 = Fragment Length: 36 XID: 0x57dbd4e5 (1474024677) Message Type: Reply (1) [Program: NFS (100003)] [Program Version: 3] [Procedure: WRITE (7)] Reply State: accepted (0) [This is a reply to a request in frame 12] [Time from request: 0.000221000 seconds] Verifier Flavor: AUTH_NULL (0) Length: 0 Accept State: RPC executed successfully (0) Network File System, WRITE Reply Error:NFS3ERR_IO [Program Version: 3] [V3 Procedure: WRITE (7)] Status: NFS3ERR_IO (5) file_wcc before attributes_follow: no value (0) after attributes_follow: no value (0) 0000 00 30 48 7b 52 34 00 15 17 bf eb 7b 08 00 45 00 .0H{R4.....{..E. 0010 00 50 b8 db 40 00 40 06 fb 59 c0 a8 02 89 c0 a8 .P..@.@..Y...... 0020 02 99 08 01 02 66 ee c3 bf 02 22 dd 1c de 50 18 .....f...."...P. 0030 ff ff 84 5d 00 00 80 00 00 24 57 db d4 e5 00 00 ...].....$W..... 0040 00 01 00 00 00 00 00 00 00 00 00 00 00 00 00 00 ................ 0050 00 00 00 00 00 05 00 00 00 00 00 00 00 00 .............. No. Time Source Destination Protocol Info 14 0.001525 192.168.2.153 192.168.2.137 NFS V3 WRITE Call (Reply In 15), FH:0x810602fc Offset:0 Len:15 UNSTABLE Frame 14 (190 bytes on wire, 190 bytes captured) Arrival Time: Jan 30, 2010 12:41:46.912353000 [Time delta from previous captured frame: 0.000028000 seconds] [Time delta from previous displayed frame: 0.000028000 seconds] [Time since reference or first frame: 0.001525000 seconds] Frame Number: 14 Frame Length: 190 bytes Capture Length: 190 bytes [Frame is marked: False] [Protocols in frame: eth:ip:tcp:rpc:nfs] [Coloring Rule Name: Checksum Errors] [Coloring Rule String: cdp.checksum_bad==1 || edp.checksum_bad==1 || ip.checksum_bad==1 || tcp.checksum_bad==1 || udp.checksum_bad==1] Ethernet II, Src: Supermic_7b:52:34 (00:30:48:7b:52:34), Dst: IntelCor_bf:eb:7b (00:15:17:bf:eb:7b) Destination: IntelCor_bf:eb:7b (00:15:17:bf:eb:7b) Address: IntelCor_bf:eb:7b (00:15:17:bf:eb:7b) .... ...0 .... .... .... .... = IG bit: Individual address (unicast) .... ..0. .... .... .... .... = LG bit: Globally unique address (factory default) Source: Supermic_7b:52:34 (00:30:48:7b:52:34) Address: Supermic_7b:52:34 (00:30:48:7b:52:34) .... ...0 .... .... .... .... = IG bit: Individual address (unicast) .... ..0. .... .... .... .... = LG bit: Globally unique address (factory default) Type: IP (0x0800) Internet Protocol, Src: 192.168.2.153 (192.168.2.153), Dst: 192.168.2.137 (192.168.2.137) Version: 4 Header length: 20 bytes Differentiated Services Field: 0x00 (DSCP 0x00: Default; ECN: 0x00) 0000 00.. = Differentiated Services Codepoint: Default (0x00) .... ..0. = ECN-Capable Transport (ECT): 0 .... ...0 = ECN-CE: 0 Total Length: 176 Identification: 0xf8b0 (63664) Flags: 0x04 (Don't Fragment) 0... = Reserved bit: Not set .1.. = Don't fragment: Set ..0. = More fragments: Not set Fragment offset: 0 Time to live: 64 Protocol: TCP (0x06) Header checksum: 0xbb24 [correct] [Good: True] [Bad : False] Source: 192.168.2.153 (192.168.2.153) Destination: 192.168.2.137 (192.168.2.137) Transmission Control Protocol, Src Port: sshell (614), Dst Port: nfs (2049), Seq: 817, Ack: 281, Len: 136 Source port: sshell (614) Destination port: nfs (2049) Sequence number: 817 (relative sequence number) [Next sequence number: 953 (relative sequence number)] Acknowledgement number: 281 (relative ack number) Header length: 20 bytes Flags: 0x18 (PSH, ACK) 0... .... = Congestion Window Reduced (CWR): Not set .0.. .... = ECN-Echo: Not set ..0. .... = Urgent: Not set ...1 .... = Acknowledgment: Set .... 1... = Push: Set .... .0.. = Reset: Not set .... ..0. = Syn: Not set .... ...0 = Fin: Not set Window size: 65535 Checksum: 0x8715 [incorrect, should be 0xeb9e (maybe caused by "TCP checksum offload"?)] [Good Checksum: False] [Bad Checksum: True] [SEQ/ACK analysis] [This is an ACK to the segment in frame: 13] [The RTT to ACK the segment was: 0.000028000 seconds] Remote Procedure Call, Type:Call XID:0x57dbd4e6 Fragment header: Last fragment, 132 bytes 1... .... .... .... .... .... .... .... = Last Fragment: Yes .000 0000 0000 0000 0000 0000 1000 0100 = Fragment Length: 132 XID: 0x57dbd4e6 (1474024678) Message Type: Call (0) RPC Version: 2 Program: NFS (100003) Program Version: 3 Procedure: WRITE (7) [The reply to this request is in frame 15] Credentials Flavor: AUTH_UNIX (1) Length: 24 Stamp: 0x00000000 Machine Name: <EMPTY> length: 0 contents: <EMPTY> UID: 80 GID: 80 Auxiliary GIDs GID: 80 Verifier Flavor: AUTH_NULL (0) Length: 0 Network File System, WRITE Call FH:0x810602fc Offset:0 Len:15 UNSTABLE [Program Version: 3] [V3 Procedure: WRITE (7)] file length: 28 [hash: 0x810602fc] decode type as: unknown filehandle: 8B2696A907BF0ED40A001F8705000000029F040000000000... offset: 0 count: 15 Stable: UNSTABLE (0) Data: <DATA> length: 15 contents: <DATA> fill bytes: opaque data 0000 00 15 17 bf eb 7b 00 30 48 7b 52 34 08 00 45 00 .....{.0H{R4..E. 0010 00 b0 f8 b0 40 00 40 06 bb 24 c0 a8 02 99 c0 a8 ....@.@..$...... 0020 02 89 02 66 08 01 22 dd 1c de ee c3 bf 2a 50 18 ...f.."......*P. 0030 ff ff 87 15 00 00 80 00 00 84 57 db d4 e6 00 00 ..........W..... 0040 00 00 00 00 00 02 00 01 86 a3 00 00 00 03 00 00 ................ 0050 00 07 00 00 00 01 00 00 00 18 00 00 00 00 00 00 ................ 0060 00 00 00 00 00 50 00 00 00 50 00 00 00 01 00 00 .....P...P...... 0070 00 50 00 00 00 00 00 00 00 00 00 00 00 1c 8b 26 .P.............& 0080 96 a9 07 bf 0e d4 0a 00 1f 87 05 00 00 00 02 9f ................ 0090 04 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 ................ 00a0 00 00 00 00 00 0f 00 00 00 00 00 00 00 0f 38 39 ..............89 00b0 39 38 38 20 32 36 32 31 34 34 30 30 30 00 988 262144000. No. Time Source Destination Protocol Info 15 0.001746 192.168.2.137 192.168.2.153 NFS V3 WRITE Reply (Call In 14) Error:NFS3ERR_IO Frame 15 (94 bytes on wire, 94 bytes captured) Arrival Time: Jan 30, 2010 12:41:46.912574000 [Time delta from previous captured frame: 0.000221000 seconds] [Time delta from previous displayed frame: 0.000221000 seconds] [Time since reference or first frame: 0.001746000 seconds] Frame Number: 15 Frame Length: 94 bytes Capture Length: 94 bytes [Frame is marked: False] [Protocols in frame: eth:ip:tcp:rpc] [Coloring Rule Name: TCP] [Coloring Rule String: tcp] Ethernet II, Src: IntelCor_bf:eb:7b (00:15:17:bf:eb:7b), Dst: Supermic_7b:52:34 (00:30:48:7b:52:34) Destination: Supermic_7b:52:34 (00:30:48:7b:52:34) Address: Supermic_7b:52:34 (00:30:48:7b:52:34) .... ...0 .... .... .... .... = IG bit: Individual address (unicast) .... ..0. .... .... .... .... = LG bit: Globally unique address (factory default) Source: IntelCor_bf:eb:7b (00:15:17:bf:eb:7b) Address: IntelCor_bf:eb:7b (00:15:17:bf:eb:7b) .... ...0 .... .... .... .... = IG bit: Individual address (unicast) .... ..0. .... .... .... .... = LG bit: Globally unique address (factory default) Type: IP (0x0800) Internet Protocol, Src: 192.168.2.137 (192.168.2.137), Dst: 192.168.2.153 (192.168.2.153) Version: 4 Header length: 20 bytes Differentiated Services Field: 0x00 (DSCP 0x00: Default; ECN: 0x00) 0000 00.. = Differentiated Services Codepoint: Default (0x00) .... ..0. = ECN-Capable Transport (ECT): 0 .... ...0 = ECN-CE: 0 Total Length: 80 Identification: 0xb8dc (47324) Flags: 0x04 (Don't Fragment) 0... = Reserved bit: Not set .1.. = Don't fragment: Set ..0. = More fragments: Not set Fragment offset: 0 Time to live: 64 Protocol: TCP (0x06) Header checksum: 0xfb58 [correct] [Good: True] [Bad : False] Source: 192.168.2.137 (192.168.2.137) Destination: 192.168.2.153 (192.168.2.153) Transmission Control Protocol, Src Port: nfs (2049), Dst Port: sshell (614), Seq: 281, Ack: 953, Len: 40 Source port: nfs (2049) Destination port: sshell (614) Sequence number: 281 (relative sequence number) [Next sequence number: 321 (relative sequence number)] Acknowledgement number: 953 (relative ack number) Header length: 20 bytes Flags: 0x18 (PSH, ACK) 0... .... = Congestion Window Reduced (CWR): Not set .0.. .... = ECN-Echo: Not set ..0. .... = Urgent: Not set ...1 .... = Acknowledgment: Set .... 1... = Push: Set .... .0.. = Reset: Not set .... ..0. = Syn: Not set .... ...0 = Fin: Not set Window size: 65535 Checksum: 0x83ac [correct] [Good Checksum: True] [Bad Checksum: False] [SEQ/ACK analysis] [This is an ACK to the segment in frame: 14] [The RTT to ACK the segment was: 0.000221000 seconds] Remote Procedure Call, Type:Reply XID:0x57dbd4e6 Fragment header: Last fragment, 36 bytes 1... .... .... .... .... .... .... .... = Last Fragment: Yes .000 0000 0000 0000 0000 0000 0010 0100 = Fragment Length: 36 XID: 0x57dbd4e6 (1474024678) Message Type: Reply (1) [Program: NFS (100003)] [Program Version: 3] [Procedure: WRITE (7)] Reply State: accepted (0) [This is a reply to a request in frame 14] [Time from request: 0.000221000 seconds] Verifier Flavor: AUTH_NULL (0) Length: 0 Accept State: RPC executed successfully (0) Network File System, WRITE Reply Error:NFS3ERR_IO [Program Version: 3] [V3 Procedure: WRITE (7)] Status: NFS3ERR_IO (5) file_wcc before attributes_follow: no value (0) after attributes_follow: no value (0) 0000 00 30 48 7b 52 34 00 15 17 bf eb 7b 08 00 45 00 .0H{R4.....{..E. 0010 00 50 b8 dc 40 00 40 06 fb 58 c0 a8 02 89 c0 a8 .P..@.@..X...... 0020 02 99 08 01 02 66 ee c3 bf 2a 22 dd 1d 66 50 18 .....f...*"..fP. 0030 ff ff 83 ac 00 00 80 00 00 24 57 db d4 e6 00 00 .........$W..... 0040 00 01 00 00 00 00 00 00 00 00 00 00 00 00 00 00 ................ 0050 00 00 00 00 00 05 00 00 00 00 00 00 00 00 .............. No. Time Source Destination Protocol Info 16 0.001776 192.168.2.153 192.168.2.137 NFS V3 WRITE Call (Reply In 17), FH:0x810602fc Offset:0 Len:15 UNSTABLE Frame 16 (190 bytes on wire, 190 bytes captured) Arrival Time: Jan 30, 2010 12:41:46.912604000 [Time delta from previous captured frame: 0.000030000 seconds] [Time delta from previous displayed frame: 0.000030000 seconds] [Time since reference or first frame: 0.001776000 seconds] Frame Number: 16 Frame Length: 190 bytes Capture Length: 190 bytes [Frame is marked: False] [Protocols in frame: eth:ip:tcp:rpc:nfs] [Coloring Rule Name: Checksum Errors] [Coloring Rule String: cdp.checksum_bad==1 || edp.checksum_bad==1 || ip.checksum_bad==1 || tcp.checksum_bad==1 || udp.checksum_bad==1] Ethernet II, Src: Supermic_7b:52:34 (00:30:48:7b:52:34), Dst: IntelCor_bf:eb:7b (00:15:17:bf:eb:7b) Destination: IntelCor_bf:eb:7b (00:15:17:bf:eb:7b) Address: IntelCor_bf:eb:7b (00:15:17:bf:eb:7b) .... ...0 .... .... .... .... = IG bit: Individual address (unicast) .... ..0. .... .... .... .... = LG bit: Globally unique address (factory default) Source: Supermic_7b:52:34 (00:30:48:7b:52:34) Address: Supermic_7b:52:34 (00:30:48:7b:52:34) .... ...0 .... .... .... .... = IG bit: Individual address (unicast) .... ..0. .... .... .... .... = LG bit: Globally unique address (factory default) Type: IP (0x0800) Internet Protocol, Src: 192.168.2.153 (192.168.2.153), Dst: 192.168.2.137 (192.168.2.137) Version: 4 Header length: 20 bytes Differentiated Services Field: 0x00 (DSCP 0x00: Default; ECN: 0x00) 0000 00.. = Differentiated Services Codepoint: Default (0x00) .... ..0. = ECN-Capable Transport (ECT): 0 .... ...0 = ECN-CE: 0 Total Length: 176 Identification: 0xf8b1 (63665) Flags: 0x04 (Don't Fragment) 0... = Reserved bit: Not set .1.. = Don't fragment: Set ..0. = More fragments: Not set Fragment offset: 0 Time to live: 64 Protocol: TCP (0x06) Header checksum: 0xbb23 [correct] [Good: True] [Bad : False] Source: 192.168.2.153 (192.168.2.153) Destination: 192.168.2.137 (192.168.2.137) Transmission Control Protocol, Src Port: sshell (614), Dst Port: nfs (2049), Seq: 953, Ack: 321, Len: 136 Source port: sshell (614) Destination port: nfs (2049) Sequence number: 953 (relative sequence number) [Next sequence number: 1089 (relative sequence number)] Acknowledgement number: 321 (relative ack number) Header length: 20 bytes Flags: 0x18 (PSH, ACK) 0... .... = Congestion Window Reduced (CWR): Not set .0.. .... = ECN-Echo: Not set ..0. .... = Urgent: Not set ...1 .... = Acknowledgment: Set .... 1... = Push: Set .... .0.. = Reset: Not set .... ..0. = Syn: Not set .... ...0 = Fin: Not set Window size: 65535 Checksum: 0x8715 [incorrect, should be 0xeaed (maybe caused by "TCP checksum offload"?)] [Good Checksum: False] [Bad Checksum: True] [SEQ/ACK analysis] [This is an ACK to the segment in frame: 15] [The RTT to ACK the segment was: 0.000030000 seconds] Remote Procedure Call, Type:Call XID:0x57dbd4e7 Fragment header: Last fragment, 132 bytes 1... .... .... .... .... .... .... .... = Last Fragment: Yes .000 0000 0000 0000 0000 0000 1000 0100 = Fragment Length: 132 XID: 0x57dbd4e7 (1474024679) Message Type: Call (0) RPC Version: 2 Program: NFS (100003) Program Version: 3 Procedure: WRITE (7) [The reply to this request is in frame 17] Credentials Flavor: AUTH_UNIX (1) Length: 24 Stamp: 0x00000000 Machine Name: <EMPTY> length: 0 contents: <EMPTY> UID: 80 GID: 80 Auxiliary GIDs GID: 80 Verifier Flavor: AUTH_NULL (0) Length: 0 Network File System, WRITE Call FH:0x810602fc Offset:0 Len:15 UNSTABLE [Program Version: 3] [V3 Procedure: WRITE (7)] file length: 28 [hash: 0x810602fc] decode type as: unknown filehandle: 8B2696A907BF0ED40A001F8705000000029F040000000000... offset: 0 count: 15 Stable: UNSTABLE (0) Data: <DATA> length: 15 contents: <DATA> fill bytes: opaque data 0000 00 15 17 bf eb 7b 00 30 48 7b 52 34 08 00 45 00 .....{.0H{R4..E. 0010 00 b0 f8 b1 40 00 40 06 bb 23 c0 a8 02 99 c0 a8 ....@.@..#...... 0020 02 89 02 66 08 01 22 dd 1d 66 ee c3 bf 52 50 18 ...f.."..f...RP. 0030 ff ff 87 15 00 00 80 00 00 84 57 db d4 e7 00 00 ..........W..... 0040 00 00 00 00 00 02 00 01 86 a3 00 00 00 03 00 00 ................ 0050 00 07 00 00 00 01 00 00 00 18 00 00 00 00 00 00 ................ 0060 00 00 00 00 00 50 00 00 00 50 00 00 00 01 00 00 .....P...P...... 0070 00 50 00 00 00 00 00 00 00 00 00 00 00 1c 8b 26 .P.............& 0080 96 a9 07 bf 0e d4 0a 00 1f 87 05 00 00 00 02 9f ................ 0090 04 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 ................ 00a0 00 00 00 00 00 0f 00 00 00 00 00 00 00 0f 38 39 ..............89 00b0 39 38 38 20 32 36 32 31 34 34 30 30 30 00 988 262144000. No. Time Source Destination Protocol Info 17 0.001997 192.168.2.137 192.168.2.153 NFS V3 WRITE Reply (Call In 16) Error:NFS3ERR_IO Frame 17 (94 bytes on wire, 94 bytes captured) Arrival Time: Jan 30, 2010 12:41:46.912825000 [Time delta from previous captured frame: 0.000221000 seconds] [Time delta from previous displayed frame: 0.000221000 seconds] [Time since reference or first frame: 0.001997000 seconds] Frame Number: 17 Frame Length: 94 bytes Capture Length: 94 bytes [Frame is marked: False] [Protocols in frame: eth:ip:tcp:rpc] [Coloring Rule Name: TCP] [Coloring Rule String: tcp] Ethernet II, Src: IntelCor_bf:eb:7b (00:15:17:bf:eb:7b), Dst: Supermic_7b:52:34 (00:30:48:7b:52:34) Destination: Supermic_7b:52:34 (00:30:48:7b:52:34) Address: Supermic_7b:52:34 (00:30:48:7b:52:34) .... ...0 .... .... .... .... = IG bit: Individual address (unicast) .... ..0. .... .... .... .... = LG bit: Globally unique address (factory default) Source: IntelCor_bf:eb:7b (00:15:17:bf:eb:7b) Address: IntelCor_bf:eb:7b (00:15:17:bf:eb:7b) .... ...0 .... .... .... .... = IG bit: Individual address (unicast) .... ..0. .... .... .... .... = LG bit: Globally unique address (factory default) Type: IP (0x0800) Internet Protocol, Src: 192.168.2.137 (192.168.2.137), Dst: 192.168.2.153 (192.168.2.153) Version: 4 Header length: 20 bytes Differentiated Services Field: 0x00 (DSCP 0x00: Default; ECN: 0x00) 0000 00.. = Differentiated Services Codepoint: Default (0x00) .... ..0. = ECN-Capable Transport (ECT): 0 .... ...0 = ECN-CE: 0 Total Length: 80 Identification: 0xb8dd (47325) Flags: 0x04 (Don't Fragment) 0... = Reserved bit: Not set .1.. = Don't fragment: Set ..0. = More fragments: Not set Fragment offset: 0 Time to live: 64 Protocol: TCP (0x06) Header checksum: 0xfb57 [correct] [Good: True] [Bad : False] Source: 192.168.2.137 (192.168.2.137) Destination: 192.168.2.153 (192.168.2.153) Transmission Control Protocol, Src Port: nfs (2049), Dst Port: sshell (614), Seq: 321, Ack: 1089, Len: 40 Source port: nfs (2049) Destination port: sshell (614) Sequence number: 321 (relative sequence number) [Next sequence number: 361 (relative sequence number)] Acknowledgement number: 1089 (relative ack number) Header length: 20 bytes Flags: 0x18 (PSH, ACK) 0... .... = Congestion Window Reduced (CWR): Not set .0.. .... = ECN-Echo: Not set ..0. .... = Urgent: Not set ...1 .... = Acknowledgment: Set .... 1... = Push: Set .... .0.. = Reset: Not set .... ..0. = Syn: Not set .... ...0 = Fin: Not set Window size: 65535 Checksum: 0x82fb [correct] [Good Checksum: True] [Bad Checksum: False] [SEQ/ACK analysis] [This is an ACK to the segment in frame: 16] [The RTT to ACK the segment was: 0.000221000 seconds] Remote Procedure Call, Type:Reply XID:0x57dbd4e7 Fragment header: Last fragment, 36 bytes 1... .... .... .... .... .... .... .... = Last Fragment: Yes .000 0000 0000 0000 0000 0000 0010 0100 = Fragment Length: 36 XID: 0x57dbd4e7 (1474024679) Message Type: Reply (1) [Program: NFS (100003)] [Program Version: 3] [Procedure: WRITE (7)] Reply State: accepted (0) [This is a reply to a request in frame 16] [Time from request: 0.000221000 seconds] Verifier Flavor: AUTH_NULL (0) Length: 0 Accept State: RPC executed successfully (0) Network File System, WRITE Reply Error:NFS3ERR_IO [Program Version: 3] [V3 Procedure: WRITE (7)] Status: NFS3ERR_IO (5) file_wcc before attributes_follow: no value (0) after attributes_follow: no value (0) 0000 00 30 48 7b 52 34 00 15 17 bf eb 7b 08 00 45 00 .0H{R4.....{..E. 0010 00 50 b8 dd 40 00 40 06 fb 57 c0 a8 02 89 c0 a8 .P..@.@..W...... 0020 02 99 08 01 02 66 ee c3 bf 52 22 dd 1d ee 50 18 .....f...R"...P. 0030 ff ff 82 fb 00 00 80 00 00 24 57 db d4 e7 00 00 .........$W..... 0040 00 01 00 00 00 00 00 00 00 00 00 00 00 00 00 00 ................ 0050 00 00 00 00 00 05 00 00 00 00 00 00 00 00 .............. No. Time Source Destination Protocol Info 18 0.002026 192.168.2.153 192.168.2.137 NFS V3 WRITE Call (Reply In 19), FH:0x810602fc Offset:0 Len:15 UNSTABLE Frame 18 (190 bytes on wire, 190 bytes captured) Arrival Time: Jan 30, 2010 12:41:46.912854000 [Time delta from previous captured frame: 0.000029000 seconds] [Time delta from previous displayed frame: 0.000029000 seconds] [Time since reference or first frame: 0.002026000 seconds] Frame Number: 18 Frame Length: 190 bytes Capture Length: 190 bytes [Frame is marked: False] [Protocols in frame: eth:ip:tcp:rpc:nfs] [Coloring Rule Name: Checksum Errors] [Coloring Rule String: cdp.checksum_bad==1 || edp.checksum_bad==1 || ip.checksum_bad==1 || tcp.checksum_bad==1 || udp.checksum_bad==1] Ethernet II, Src: Supermic_7b:52:34 (00:30:48:7b:52:34), Dst: IntelCor_bf:eb:7b (00:15:17:bf:eb:7b) Destination: IntelCor_bf:eb:7b (00:15:17:bf:eb:7b) Address: IntelCor_bf:eb:7b (00:15:17:bf:eb:7b) .... ...0 .... .... .... .... = IG bit: Individual address (unicast) .... ..0. .... .... .... .... = LG bit: Globally unique address (factory default) Source: Supermic_7b:52:34 (00:30:48:7b:52:34) Address: Supermic_7b:52:34 (00:30:48:7b:52:34) .... ...0 .... .... .... .... = IG bit: Individual address (unicast) .... ..0. .... .... .... .... = LG bit: Globally unique address (factory default) Type: IP (0x0800) Internet Protocol, Src: 192.168.2.153 (192.168.2.153), Dst: 192.168.2.137 (192.168.2.137) Version: 4 Header length: 20 bytes Differentiated Services Field: 0x00 (DSCP 0x00: Default; ECN: 0x00) 0000 00.. = Differentiated Services Codepoint: Default (0x00) .... ..0. = ECN-Capable Transport (ECT): 0 .... ...0 = ECN-CE: 0 Total Length: 176 Identification: 0xf8b2 (63666) Flags: 0x04 (Don't Fragment) 0... = Reserved bit: Not set .1.. = Don't fragment: Set ..0. = More fragments: Not set Fragment offset: 0 Time to live: 64 Protocol: TCP (0x06) Header checksum: 0xbb22 [correct] [Good: True] [Bad : False] Source: 192.168.2.153 (192.168.2.153) Destination: 192.168.2.137 (192.168.2.137) Transmission Control Protocol, Src Port: sshell (614), Dst Port: nfs (2049), Seq: 1089, Ack: 361, Len: 136 Source port: sshell (614) Destination port: nfs (2049) Sequence number: 1089 (relative sequence number) [Next sequence number: 1225 (relative sequence number)] Acknowledgement number: 361 (relative ack number) Header length: 20 bytes Flags: 0x18 (PSH, ACK) 0... .... = Congestion Window Reduced (CWR): Not set .0.. .... = ECN-Echo: Not set ..0. .... = Urgent: Not set ...1 .... = Acknowledgment: Set .... 1... = Push: Set .... .0.. = Reset: Not set .... ..0. = Syn: Not set .... ...0 = Fin: Not set Window size: 65535 Checksum: 0x8715 [incorrect, should be 0xea3c (maybe caused by "TCP checksum offload"?)] [Good Checksum: False] [Bad Checksum: True] [SEQ/ACK analysis] [This is an ACK to the segment in frame: 17] [The RTT to ACK the segment was: 0.000029000 seconds] Remote Procedure Call, Type:Call XID:0x57dbd4e8 Fragment header: Last fragment, 132 bytes 1... .... .... .... .... .... .... .... = Last Fragment: Yes .000 0000 0000 0000 0000 0000 1000 0100 = Fragment Length: 132 XID: 0x57dbd4e8 (1474024680) Message Type: Call (0) RPC Version: 2 Program: NFS (100003) Program Version: 3 Procedure: WRITE (7) [The reply to this request is in frame 19] Credentials Flavor: AUTH_UNIX (1) Length: 24 Stamp: 0x00000000 Machine Name: <EMPTY> length: 0 contents: <EMPTY> UID: 80 GID: 80 Auxiliary GIDs GID: 80 Verifier Flavor: AUTH_NULL (0) Length: 0 Network File System, WRITE Call FH:0x810602fc Offset:0 Len:15 UNSTABLE [Program Version: 3] [V3 Procedure: WRITE (7)] file length: 28 [hash: 0x810602fc] decode type as: unknown filehandle: 8B2696A907BF0ED40A001F8705000000029F040000000000... offset: 0 count: 15 Stable: UNSTABLE (0) Data: <DATA> length: 15 contents: <DATA> fill bytes: opaque data 0000 00 15 17 bf eb 7b 00 30 48 7b 52 34 08 00 45 00 .....{.0H{R4..E. 0010 00 b0 f8 b2 40 00 40 06 bb 22 c0 a8 02 99 c0 a8 ....@.@.."...... 0020 02 89 02 66 08 01 22 dd 1d ee ee c3 bf 7a 50 18 ...f.."......zP. 0030 ff ff 87 15 00 00 80 00 00 84 57 db d4 e8 00 00 ..........W..... 0040 00 00 00 00 00 02 00 01 86 a3 00 00 00 03 00 00 ................ 0050 00 07 00 00 00 01 00 00 00 18 00 00 00 00 00 00 ................ 0060 00 00 00 00 00 50 00 00 00 50 00 00 00 01 00 00 .....P...P...... 0070 00 50 00 00 00 00 00 00 00 00 00 00 00 1c 8b 26 .P.............& 0080 96 a9 07 bf 0e d4 0a 00 1f 87 05 00 00 00 02 9f ................ 0090 04 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 ................ 00a0 00 00 00 00 00 0f 00 00 00 00 00 00 00 0f 38 39 ..............89 00b0 39 38 38 20 32 36 32 31 34 34 30 30 30 00 988 262144000. No. Time Source Destination Protocol Info 19 0.002246 192.168.2.137 192.168.2.153 NFS V3 WRITE Reply (Call In 18) Error:NFS3ERR_IO Frame 19 (94 bytes on wire, 94 bytes captured) Arrival Time: Jan 30, 2010 12:41:46.913074000 [Time delta from previous captured frame: 0.000220000 seconds] [Time delta from previous displayed frame: 0.000220000 seconds] [Time since reference or first frame: 0.002246000 seconds] Frame Number: 19 Frame Length: 94 bytes Capture Length: 94 bytes [Frame is marked: False] [Protocols in frame: eth:ip:tcp:rpc] [Coloring Rule Name: TCP] [Coloring Rule String: tcp] Ethernet II, Src: IntelCor_bf:eb:7b (00:15:17:bf:eb:7b), Dst: Supermic_7b:52:34 (00:30:48:7b:52:34) Destination: Supermic_7b:52:34 (00:30:48:7b:52:34) Address: Supermic_7b:52:34 (00:30:48:7b:52:34) .... ...0 .... .... .... .... = IG bit: Individual address (unicast) .... ..0. .... .... .... .... = LG bit: Globally unique address (factory default) Source: IntelCor_bf:eb:7b (00:15:17:bf:eb:7b) Address: IntelCor_bf:eb:7b (00:15:17:bf:eb:7b) .... ...0 .... .... .... .... = IG bit: Individual address (unicast) .... ..0. .... .... .... .... = LG bit: Globally unique address (factory default) Type: IP (0x0800) Internet Protocol, Src: 192.168.2.137 (192.168.2.137), Dst: 192.168.2.153 (192.168.2.153) Version: 4 Header length: 20 bytes Differentiated Services Field: 0x00 (DSCP 0x00: Default; ECN: 0x00) 0000 00.. = Differentiated Services Codepoint: Default (0x00) .... ..0. = ECN-Capable Transport (ECT): 0 .... ...0 = ECN-CE: 0 Total Length: 80 Identification: 0xb8de (47326) Flags: 0x04 (Don't Fragment) 0... = Reserved bit: Not set .1.. = Don't fragment: Set ..0. = More fragments: Not set Fragment offset: 0 Time to live: 64 Protocol: TCP (0x06) Header checksum: 0xfb56 [correct] [Good: True] [Bad : False] Source: 192.168.2.137 (192.168.2.137) Destination: 192.168.2.153 (192.168.2.153) Transmission Control Protocol, Src Port: nfs (2049), Dst Port: sshell (614), Seq: 361, Ack: 1225, Len: 40 Source port: nfs (2049) Destination port: sshell (614) Sequence number: 361 (relative sequence number) [Next sequence number: 401 (relative sequence number)] Acknowledgement number: 1225 (relative ack number) Header length: 20 bytes Flags: 0x18 (PSH, ACK) 0... .... = Congestion Window Reduced (CWR): Not set .0.. .... = ECN-Echo: Not set ..0. .... = Urgent: Not set ...1 .... = Acknowledgment: Set .... 1... = Push: Set .... .0.. = Reset: Not set .... ..0. = Syn: Not set .... ...0 = Fin: Not set Window size: 65535 Checksum: 0x824a [correct] [Good Checksum: True] [Bad Checksum: False] [SEQ/ACK analysis] [This is an ACK to the segment in frame: 18] [The RTT to ACK the segment was: 0.000220000 seconds] Remote Procedure Call, Type:Reply XID:0x57dbd4e8 Fragment header: Last fragment, 36 bytes 1... .... .... .... .... .... .... .... = Last Fragment: Yes .000 0000 0000 0000 0000 0000 0010 0100 = Fragment Length: 36 XID: 0x57dbd4e8 (1474024680) Message Type: Reply (1) [Program: NFS (100003)] [Program Version: 3] [Procedure: WRITE (7)] Reply State: accepted (0) [This is a reply to a request in frame 18] [Time from request: 0.000220000 seconds] Verifier Flavor: AUTH_NULL (0) Length: 0 Accept State: RPC executed successfully (0) Network File System, WRITE Reply Error:NFS3ERR_IO [Program Version: 3] [V3 Procedure: WRITE (7)] Status: NFS3ERR_IO (5) file_wcc before attributes_follow: no value (0) after attributes_follow: no value (0) 0000 00 30 48 7b 52 34 00 15 17 bf eb 7b 08 00 45 00 .0H{R4.....{..E. 0010 00 50 b8 de 40 00 40 06 fb 56 c0 a8 02 89 c0 a8 .P..@.@..V...... 0020 02 99 08 01 02 66 ee c3 bf 7a 22 dd 1e 76 50 18 .....f...z"..vP. 0030 ff ff 82 4a 00 00 80 00 00 24 57 db d4 e8 00 00 ...J.....$W..... 0040 00 01 00 00 00 00 00 00 00 00 00 00 00 00 00 00 ................ 0050 00 00 00 00 00 05 00 00 00 00 00 00 00 00 .............. No. Time Source Destination Protocol Info 20 0.002276 192.168.2.153 192.168.2.137 NFS V3 WRITE Call (Reply In 21), FH:0x810602fc Offset:0 Len:15 UNSTABLE Frame 20 (190 bytes on wire, 190 bytes captured) Arrival Time: Jan 30, 2010 12:41:46.913104000 [Time delta from previous captured frame: 0.000030000 seconds] [Time delta from previous displayed frame: 0.000030000 seconds] [Time since reference or first frame: 0.002276000 seconds] Frame Number: 20 Frame Length: 190 bytes Capture Length: 190 bytes [Frame is marked: False] [Protocols in frame: eth:ip:tcp:rpc:nfs] [Coloring Rule Name: Checksum Errors] [Coloring Rule String: cdp.checksum_bad==1 || edp.checksum_bad==1 || ip.checksum_bad==1 || tcp.checksum_bad==1 || udp.checksum_bad==1] Ethernet II, Src: Supermic_7b:52:34 (00:30:48:7b:52:34), Dst: IntelCor_bf:eb:7b (00:15:17:bf:eb:7b) Destination: IntelCor_bf:eb:7b (00:15:17:bf:eb:7b) Address: IntelCor_bf:eb:7b (00:15:17:bf:eb:7b) .... ...0 .... .... .... .... = IG bit: Individual address (unicast) .... ..0. .... .... .... .... = LG bit: Globally unique address (factory default) Source: Supermic_7b:52:34 (00:30:48:7b:52:34) Address: Supermic_7b:52:34 (00:30:48:7b:52:34) .... ...0 .... .... .... .... = IG bit: Individual address (unicast) .... ..0. .... .... .... .... = LG bit: Globally unique address (factory default) Type: IP (0x0800) Internet Protocol, Src: 192.168.2.153 (192.168.2.153), Dst: 192.168.2.137 (192.168.2.137) Version: 4 Header length: 20 bytes Differentiated Services Field: 0x00 (DSCP 0x00: Default; ECN: 0x00) 0000 00.. = Differentiated Services Codepoint: Default (0x00) .... ..0. = ECN-Capable Transport (ECT): 0 .... ...0 = ECN-CE: 0 Total Length: 176 Identification: 0xf8b3 (63667) Flags: 0x04 (Don't Fragment) 0... = Reserved bit: Not set .1.. = Don't fragment: Set ..0. = More fragments: Not set Fragment offset: 0 Time to live: 64 Protocol: TCP (0x06) Header checksum: 0xbb21 [correct] [Good: True] [Bad : False] Source: 192.168.2.153 (192.168.2.153) Destination: 192.168.2.137 (192.168.2.137) Transmission Control Protocol, Src Port: sshell (614), Dst Port: nfs (2049), Seq: 1225, Ack: 401, Len: 136 Source port: sshell (614) Destination port: nfs (2049) Sequence number: 1225 (relative sequence number) [Next sequence number: 1361 (relative sequence number)] Acknowledgement number: 401 (relative ack number) Header length: 20 bytes Flags: 0x18 (PSH, ACK) 0... .... = Congestion Window Reduced (CWR): Not set .0.. .... = ECN-Echo: Not set ..0. .... = Urgent: Not set ...1 .... = Acknowledgment: Set .... 1... = Push: Set .... .0.. = Reset: Not set .... ..0. = Syn: Not set .... ...0 = Fin: Not set Window size: 65535 Checksum: 0x8715 [incorrect, should be 0xe98b (maybe caused by "TCP checksum offload"?)] [Good Checksum: False] [Bad Checksum: True] [SEQ/ACK analysis] [This is an ACK to the segment in frame: 19] [The RTT to ACK the segment was: 0.000030000 seconds] Remote Procedure Call, Type:Call XID:0x57dbd4e9 Fragment header: Last fragment, 132 bytes 1... .... .... .... .... .... .... .... = Last Fragment: Yes .000 0000 0000 0000 0000 0000 1000 0100 = Fragment Length: 132 XID: 0x57dbd4e9 (1474024681) Message Type: Call (0) RPC Version: 2 Program: NFS (100003) Program Version: 3 Procedure: WRITE (7) [The reply to this request is in frame 21] Credentials Flavor: AUTH_UNIX (1) Length: 24 Stamp: 0x00000000 Machine Name: <EMPTY> length: 0 contents: <EMPTY> UID: 80 GID: 80 Auxiliary GIDs GID: 80 Verifier Flavor: AUTH_NULL (0) Length: 0 Network File System, WRITE Call FH:0x810602fc Offset:0 Len:15 UNSTABLE [Program Version: 3] [V3 Procedure: WRITE (7)] file length: 28 [hash: 0x810602fc] decode type as: unknown filehandle: 8B2696A907BF0ED40A001F8705000000029F040000000000... offset: 0 count: 15 Stable: UNSTABLE (0) Data: <DATA> length: 15 contents: <DATA> fill bytes: opaque data 0000 00 15 17 bf eb 7b 00 30 48 7b 52 34 08 00 45 00 .....{.0H{R4..E. 0010 00 b0 f8 b3 40 00 40 06 bb 21 c0 a8 02 99 c0 a8 ....@.@..!...... 0020 02 89 02 66 08 01 22 dd 1e 76 ee c3 bf a2 50 18 ...f.."..v....P. 0030 ff ff 87 15 00 00 80 00 00 84 57 db d4 e9 00 00 ..........W..... 0040 00 00 00 00 00 02 00 01 86 a3 00 00 00 03 00 00 ................ 0050 00 07 00 00 00 01 00 00 00 18 00 00 00 00 00 00 ................ 0060 00 00 00 00 00 50 00 00 00 50 00 00 00 01 00 00 .....P...P...... 0070 00 50 00 00 00 00 00 00 00 00 00 00 00 1c 8b 26 .P.............& 0080 96 a9 07 bf 0e d4 0a 00 1f 87 05 00 00 00 02 9f ................ 0090 04 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 ................ 00a0 00 00 00 00 00 0f 00 00 00 00 00 00 00 0f 38 39 ..............89 00b0 39 38 38 20 32 36 32 31 34 34 30 30 30 00 988 262144000. No. Time Source Destination Protocol Info 21 0.002497 192.168.2.137 192.168.2.153 NFS V3 WRITE Reply (Call In 20) Error:NFS3ERR_IO Frame 21 (94 bytes on wire, 94 bytes captured) Arrival Time: Jan 30, 2010 12:41:46.913325000 [Time delta from previous captured frame: 0.000221000 seconds] [Time delta from previous displayed frame: 0.000221000 seconds] [Time since reference or first frame: 0.002497000 seconds] Frame Number: 21 Frame Length: 94 bytes Capture Length: 94 bytes [Frame is marked: False] [Protocols in frame: eth:ip:tcp:rpc] [Coloring Rule Name: TCP] [Coloring Rule String: tcp] Ethernet II, Src: IntelCor_bf:eb:7b (00:15:17:bf:eb:7b), Dst: Supermic_7b:52:34 (00:30:48:7b:52:34) Destination: Supermic_7b:52:34 (00:30:48:7b:52:34) Address: Supermic_7b:52:34 (00:30:48:7b:52:34) .... ...0 .... .... .... .... = IG bit: Individual address (unicast) .... ..0. .... .... .... .... = LG bit: Globally unique address (factory default) Source: IntelCor_bf:eb:7b (00:15:17:bf:eb:7b) Address: IntelCor_bf:eb:7b (00:15:17:bf:eb:7b) .... ...0 .... .... .... .... = IG bit: Individual address (unicast) .... ..0. .... .... .... .... = LG bit: Globally unique address (factory default) Type: IP (0x0800) Internet Protocol, Src: 192.168.2.137 (192.168.2.137), Dst: 192.168.2.153 (192.168.2.153) Version: 4 Header length: 20 bytes Differentiated Services Field: 0x00 (DSCP 0x00: Default; ECN: 0x00) 0000 00.. = Differentiated Services Codepoint: Default (0x00) .... ..0. = ECN-Capable Transport (ECT): 0 .... ...0 = ECN-CE: 0 Total Length: 80 Identification: 0xb8df (47327) Flags: 0x04 (Don't Fragment) 0... = Reserved bit: Not set .1.. = Don't fragment: Set ..0. = More fragments: Not set Fragment offset: 0 Time to live: 64 Protocol: TCP (0x06) Header checksum: 0xfb55 [correct] [Good: True] [Bad : False] Source: 192.168.2.137 (192.168.2.137) Destination: 192.168.2.153 (192.168.2.153) Transmission Control Protocol, Src Port: nfs (2049), Dst Port: sshell (614), Seq: 401, Ack: 1361, Len: 40 Source port: nfs (2049) Destination port: sshell (614) Sequence number: 401 (relative sequence number) [Next sequence number: 441 (relative sequence number)] Acknowledgement number: 1361 (relative ack number) Header length: 20 bytes Flags: 0x18 (PSH, ACK) 0... .... = Congestion Window Reduced (CWR): Not set .0.. .... = ECN-Echo: Not set ..0. .... = Urgent: Not set ...1 .... = Acknowledgment: Set .... 1... = Push: Set .... .0.. = Reset: Not set .... ..0. = Syn: Not set .... ...0 = Fin: Not set Window size: 65535 Checksum: 0x8199 [correct] [Good Checksum: True] [Bad Checksum: False] [SEQ/ACK analysis] [This is an ACK to the segment in frame: 20] [The RTT to ACK the segment was: 0.000221000 seconds] Remote Procedure Call, Type:Reply XID:0x57dbd4e9 Fragment header: Last fragment, 36 bytes 1... .... .... .... .... .... .... .... = Last Fragment: Yes .000 0000 0000 0000 0000 0000 0010 0100 = Fragment Length: 36 XID: 0x57dbd4e9 (1474024681) Message Type: Reply (1) [Program: NFS (100003)] [Program Version: 3] [Procedure: WRITE (7)] Reply State: accepted (0) [This is a reply to a request in frame 20] [Time from request: 0.000221000 seconds] Verifier Flavor: AUTH_NULL (0) Length: 0 Accept State: RPC executed successfully (0) Network File System, WRITE Reply Error:NFS3ERR_IO [Program Version: 3] [V3 Procedure: WRITE (7)] Status: NFS3ERR_IO (5) file_wcc before attributes_follow: no value (0) after attributes_follow: no value (0) 0000 00 30 48 7b 52 34 00 15 17 bf eb 7b 08 00 45 00 .0H{R4.....{..E. 0010 00 50 b8 df 40 00 40 06 fb 55 c0 a8 02 89 c0 a8 .P..@.@..U...... 0020 02 99 08 01 02 66 ee c3 bf a2 22 dd 1e fe 50 18 .....f...."...P. 0030 ff ff 81 99 00 00 80 00 00 24 57 db d4 e9 00 00 .........$W..... 0040 00 01 00 00 00 00 00 00 00 00 00 00 00 00 00 00 ................ 0050 00 00 00 00 00 05 00 00 00 00 00 00 00 00 .............. No. Time Source Destination Protocol Info 22 0.002525 192.168.2.153 192.168.2.137 NFS V3 WRITE Call (Reply In 23), FH:0x810602fc Offset:0 Len:15 UNSTABLE Frame 22 (190 bytes on wire, 190 bytes captured) Arrival Time: Jan 30, 2010 12:41:46.913353000 [Time delta from previous captured frame: 0.000028000 seconds] [Time delta from previous displayed frame: 0.000028000 seconds] [Time since reference or first frame: 0.002525000 seconds] Frame Number: 22 Frame Length: 190 bytes Capture Length: 190 bytes [Frame is marked: False] [Protocols in frame: eth:ip:tcp:rpc:nfs] [Coloring Rule Name: Checksum Errors] [Coloring Rule String: cdp.checksum_bad==1 || edp.checksum_bad==1 || ip.checksum_bad==1 || tcp.checksum_bad==1 || udp.checksum_bad==1] Ethernet II, Src: Supermic_7b:52:34 (00:30:48:7b:52:34), Dst: IntelCor_bf:eb:7b (00:15:17:bf:eb:7b) Destination: IntelCor_bf:eb:7b (00:15:17:bf:eb:7b) Address: IntelCor_bf:eb:7b (00:15:17:bf:eb:7b) .... ...0 .... .... .... .... = IG bit: Individual address (unicast) .... ..0. .... .... .... .... = LG bit: Globally unique address (factory default) Source: Supermic_7b:52:34 (00:30:48:7b:52:34) Address: Supermic_7b:52:34 (00:30:48:7b:52:34) .... ...0 .... .... .... .... = IG bit: Individual address (unicast) .... ..0. .... .... .... .... = LG bit: Globally unique address (factory default) Type: IP (0x0800) Internet Protocol, Src: 192.168.2.153 (192.168.2.153), Dst: 192.168.2.137 (192.168.2.137) Version: 4 Header length: 20 bytes Differentiated Services Field: 0x00 (DSCP 0x00: Default; ECN: 0x00) 0000 00.. = Differentiated Services Codepoint: Default (0x00) .... ..0. = ECN-Capable Transport (ECT): 0 .... ...0 = ECN-CE: 0 Total Length: 176 Identification: 0xf8b4 (63668) Flags: 0x04 (Don't Fragment) 0... = Reserved bit: Not set .1.. = Don't fragment: Set ..0. = More fragments: Not set Fragment offset: 0 Time to live: 64 Protocol: TCP (0x06) Header checksum: 0xbb20 [correct] [Good: True] [Bad : False] Source: 192.168.2.153 (192.168.2.153) Destination: 192.168.2.137 (192.168.2.137) Transmission Control Protocol, Src Port: sshell (614), Dst Port: nfs (2049), Seq: 1361, Ack: 441, Len: 136 Source port: sshell (614) Destination port: nfs (2049) Sequence number: 1361 (relative sequence number) [Next sequence number: 1497 (relative sequence number)] Acknowledgement number: 441 (relative ack number) Header length: 20 bytes Flags: 0x18 (PSH, ACK) 0... .... = Congestion Window Reduced (CWR): Not set .0.. .... = ECN-Echo: Not set ..0. .... = Urgent: Not set ...1 .... = Acknowledgment: Set .... 1... = Push: Set .... .0.. = Reset: Not set .... ..0. = Syn: Not set .... ...0 = Fin: Not set Window size: 65535 Checksum: 0x8715 [incorrect, should be 0xe8da (maybe caused by "TCP checksum offload"?)] [Good Checksum: False] [Bad Checksum: True] [SEQ/ACK analysis] [This is an ACK to the segment in frame: 21] [The RTT to ACK the segment was: 0.000028000 seconds] Remote Procedure Call, Type:Call XID:0x57dbd4ea Fragment header: Last fragment, 132 bytes 1... .... .... .... .... .... .... .... = Last Fragment: Yes .000 0000 0000 0000 0000 0000 1000 0100 = Fragment Length: 132 XID: 0x57dbd4ea (1474024682) Message Type: Call (0) RPC Version: 2 Program: NFS (100003) Program Version: 3 Procedure: WRITE (7) [The reply to this request is in frame 23] Credentials Flavor: AUTH_UNIX (1) Length: 24 Stamp: 0x00000000 Machine Name: <EMPTY> length: 0 contents: <EMPTY> UID: 80 GID: 80 Auxiliary GIDs GID: 80 Verifier Flavor: AUTH_NULL (0) Length: 0 Network File System, WRITE Call FH:0x810602fc Offset:0 Len:15 UNSTABLE [Program Version: 3] [V3 Procedure: WRITE (7)] file length: 28 [hash: 0x810602fc] decode type as: unknown filehandle: 8B2696A907BF0ED40A001F8705000000029F040000000000... offset: 0 count: 15 Stable: UNSTABLE (0) Data: <DATA> length: 15 contents: <DATA> fill bytes: opaque data 0000 00 15 17 bf eb 7b 00 30 48 7b 52 34 08 00 45 00 .....{.0H{R4..E. 0010 00 b0 f8 b4 40 00 40 06 bb 20 c0 a8 02 99 c0 a8 ....@.@.. ...... 0020 02 89 02 66 08 01 22 dd 1e fe ee c3 bf ca 50 18 ...f..".......P. 0030 ff ff 87 15 00 00 80 00 00 84 57 db d4 ea 00 00 ..........W..... 0040 00 00 00 00 00 02 00 01 86 a3 00 00 00 03 00 00 ................ 0050 00 07 00 00 00 01 00 00 00 18 00 00 00 00 00 00 ................ 0060 00 00 00 00 00 50 00 00 00 50 00 00 00 01 00 00 .....P...P...... 0070 00 50 00 00 00 00 00 00 00 00 00 00 00 1c 8b 26 .P.............& 0080 96 a9 07 bf 0e d4 0a 00 1f 87 05 00 00 00 02 9f ................ 0090 04 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 ................ 00a0 00 00 00 00 00 0f 00 00 00 00 00 00 00 0f 38 39 ..............89 00b0 39 38 38 20 32 36 32 31 34 34 30 30 30 00 988 262144000. No. Time Source Destination Protocol Info 23 0.002747 192.168.2.137 192.168.2.153 NFS V3 WRITE Reply (Call In 22) Error:NFS3ERR_IO Frame 23 (94 bytes on wire, 94 bytes captured) Arrival Time: Jan 30, 2010 12:41:46.913575000 [Time delta from previous captured frame: 0.000222000 seconds] [Time delta from previous displayed frame: 0.000222000 seconds] [Time since reference or first frame: 0.002747000 seconds] Frame Number: 23 Frame Length: 94 bytes Capture Length: 94 bytes [Frame is marked: False] [Protocols in frame: eth:ip:tcp:rpc] [Coloring Rule Name: TCP] [Coloring Rule String: tcp] Ethernet II, Src: IntelCor_bf:eb:7b (00:15:17:bf:eb:7b), Dst: Supermic_7b:52:34 (00:30:48:7b:52:34) Destination: Supermic_7b:52:34 (00:30:48:7b:52:34) Address: Supermic_7b:52:34 (00:30:48:7b:52:34) .... ...0 .... .... .... .... = IG bit: Individual address (unicast) .... ..0. .... .... .... .... = LG bit: Globally unique address (factory default) Source: IntelCor_bf:eb:7b (00:15:17:bf:eb:7b) Address: IntelCor_bf:eb:7b (00:15:17:bf:eb:7b) .... ...0 .... .... .... .... = IG bit: Individual address (unicast) .... ..0. .... .... .... .... = LG bit: Globally unique address (factory default) Type: IP (0x0800) Internet Protocol, Src: 192.168.2.137 (192.168.2.137), Dst: 192.168.2.153 (192.168.2.153) Version: 4 Header length: 20 bytes Differentiated Services Field: 0x00 (DSCP 0x00: Default; ECN: 0x00) 0000 00.. = Differentiated Services Codepoint: Default (0x00) .... ..0. = ECN-Capable Transport (ECT): 0 .... ...0 = ECN-CE: 0 Total Length: 80 Identification: 0xb8e0 (47328) Flags: 0x04 (Don't Fragment) 0... = Reserved bit: Not set .1.. = Don't fragment: Set ..0. = More fragments: Not set Fragment offset: 0 Time to live: 64 Protocol: TCP (0x06) Header checksum: 0xfb54 [correct] [Good: True] [Bad : False] Source: 192.168.2.137 (192.168.2.137) Destination: 192.168.2.153 (192.168.2.153) Transmission Control Protocol, Src Port: nfs (2049), Dst Port: sshell (614), Seq: 441, Ack: 1497, Len: 40 Source port: nfs (2049) Destination port: sshell (614) Sequence number: 441 (relative sequence number) [Next sequence number: 481 (relative sequence number)] Acknowledgement number: 1497 (relative ack number) Header length: 20 bytes Flags: 0x18 (PSH, ACK) 0... .... = Congestion Window Reduced (CWR): Not set .0.. .... = ECN-Echo: Not set ..0. .... = Urgent: Not set ...1 .... = Acknowledgment: Set .... 1... = Push: Set .... .0.. = Reset: Not set .... ..0. = Syn: Not set .... ...0 = Fin: Not set Window size: 65535 Checksum: 0x80e8 [correct] [Good Checksum: True] [Bad Checksum: False] [SEQ/ACK analysis] [This is an ACK to the segment in frame: 22] [The RTT to ACK the segment was: 0.000222000 seconds] Remote Procedure Call, Type:Reply XID:0x57dbd4ea Fragment header: Last fragment, 36 bytes 1... .... .... .... .... .... .... .... = Last Fragment: Yes .000 0000 0000 0000 0000 0000 0010 0100 = Fragment Length: 36 XID: 0x57dbd4ea (1474024682) Message Type: Reply (1) [Program: NFS (100003)] [Program Version: 3] [Procedure: WRITE (7)] Reply State: accepted (0) [This is a reply to a request in frame 22] [Time from request: 0.000222000 seconds] Verifier Flavor: AUTH_NULL (0) Length: 0 Accept State: RPC executed successfully (0) Network File System, WRITE Reply Error:NFS3ERR_IO [Program Version: 3] [V3 Procedure: WRITE (7)] Status: NFS3ERR_IO (5) file_wcc before attributes_follow: no value (0) after attributes_follow: no value (0) 0000 00 30 48 7b 52 34 00 15 17 bf eb 7b 08 00 45 00 .0H{R4.....{..E. 0010 00 50 b8 e0 40 00 40 06 fb 54 c0 a8 02 89 c0 a8 .P..@.@..T...... 0020 02 99 08 01 02 66 ee c3 bf ca 22 dd 1f 86 50 18 .....f...."...P. 0030 ff ff 80 e8 00 00 80 00 00 24 57 db d4 ea 00 00 .........$W..... 0040 00 01 00 00 00 00 00 00 00 00 00 00 00 00 00 00 ................ 0050 00 00 00 00 00 05 00 00 00 00 00 00 00 00 .............. No. Time Source Destination Protocol Info 24 0.002775 192.168.2.153 192.168.2.137 NFS V3 WRITE Call (Reply In 25), FH:0x810602fc Offset:0 Len:15 UNSTABLE Frame 24 (190 bytes on wire, 190 bytes captured) Arrival Time: Jan 30, 2010 12:41:46.913603000 [Time delta from previous captured frame: 0.000028000 seconds] [Time delta from previous displayed frame: 0.000028000 seconds] [Time since reference or first frame: 0.002775000 seconds] Frame Number: 24 Frame Length: 190 bytes Capture Length: 190 bytes [Frame is marked: False] [Protocols in frame: eth:ip:tcp:rpc:nfs] [Coloring Rule Name: Checksum Errors] [Coloring Rule String: cdp.checksum_bad==1 || edp.checksum_bad==1 || ip.checksum_bad==1 || tcp.checksum_bad==1 || udp.checksum_bad==1] Ethernet II, Src: Supermic_7b:52:34 (00:30:48:7b:52:34), Dst: IntelCor_bf:eb:7b (00:15:17:bf:eb:7b) Destination: IntelCor_bf:eb:7b (00:15:17:bf:eb:7b) Address: IntelCor_bf:eb:7b (00:15:17:bf:eb:7b) .... ...0 .... .... .... .... = IG bit: Individual address (unicast) .... ..0. .... .... .... .... = LG bit: Globally unique address (factory default) Source: Supermic_7b:52:34 (00:30:48:7b:52:34) Address: Supermic_7b:52:34 (00:30:48:7b:52:34) .... ...0 .... .... .... .... = IG bit: Individual address (unicast) .... ..0. .... .... .... .... = LG bit: Globally unique address (factory default) Type: IP (0x0800) Internet Protocol, Src: 192.168.2.153 (192.168.2.153), Dst: 192.168.2.137 (192.168.2.137) Version: 4 Header length: 20 bytes Differentiated Services Field: 0x00 (DSCP 0x00: Default; ECN: 0x00) 0000 00.. = Differentiated Services Codepoint: Default (0x00) .... ..0. = ECN-Capable Transport (ECT): 0 .... ...0 = ECN-CE: 0 Total Length: 176 Identification: 0xf8b5 (63669) Flags: 0x04 (Don't Fragment) 0... = Reserved bit: Not set .1.. = Don't fragment: Set ..0. = More fragments: Not set Fragment offset: 0 Time to live: 64 Protocol: TCP (0x06) Header checksum: 0xbb1f [correct] [Good: True] [Bad : False] Source: 192.168.2.153 (192.168.2.153) Destination: 192.168.2.137 (192.168.2.137) Transmission Control Protocol, Src Port: sshell (614), Dst Port: nfs (2049), Seq: 1497, Ack: 481, Len: 136 Source port: sshell (614) Destination port: nfs (2049) Sequence number: 1497 (relative sequence number) [Next sequence number: 1633 (relative sequence number)] Acknowledgement number: 481 (relative ack number) Header length: 20 bytes Flags: 0x18 (PSH, ACK) 0... .... = Congestion Window Reduced (CWR): Not set .0.. .... = ECN-Echo: Not set ..0. .... = Urgent: Not set ...1 .... = Acknowledgment: Set .... 1... = Push: Set .... .0.. = Reset: Not set .... ..0. = Syn: Not set .... ...0 = Fin: Not set Window size: 65535 Checksum: 0x8715 [incorrect, should be 0xe829 (maybe caused by "TCP checksum offload"?)] [Good Checksum: False] [Bad Checksum: True] [SEQ/ACK analysis] [This is an ACK to the segment in frame: 23] [The RTT to ACK the segment was: 0.000028000 seconds] Remote Procedure Call, Type:Call XID:0x57dbd4eb Fragment header: Last fragment, 132 bytes 1... .... .... .... .... .... .... .... = Last Fragment: Yes .000 0000 0000 0000 0000 0000 1000 0100 = Fragment Length: 132 XID: 0x57dbd4eb (1474024683) Message Type: Call (0) RPC Version: 2 Program: NFS (100003) Program Version: 3 Procedure: WRITE (7) [The reply to this request is in frame 25] Credentials Flavor: AUTH_UNIX (1) Length: 24 Stamp: 0x00000000 Machine Name: <EMPTY> length: 0 contents: <EMPTY> UID: 80 GID: 80 Auxiliary GIDs GID: 80 Verifier Flavor: AUTH_NULL (0) Length: 0 Network File System, WRITE Call FH:0x810602fc Offset:0 Len:15 UNSTABLE [Program Version: 3] [V3 Procedure: WRITE (7)] file length: 28 [hash: 0x810602fc] decode type as: unknown filehandle: 8B2696A907BF0ED40A001F8705000000029F040000000000... offset: 0 count: 15 Stable: UNSTABLE (0) Data: <DATA> length: 15 contents: <DATA> fill bytes: opaque data 0000 00 15 17 bf eb 7b 00 30 48 7b 52 34 08 00 45 00 .....{.0H{R4..E. 0010 00 b0 f8 b5 40 00 40 06 bb 1f c0 a8 02 99 c0 a8 ....@.@......... 0020 02 89 02 66 08 01 22 dd 1f 86 ee c3 bf f2 50 18 ...f..".......P. 0030 ff ff 87 15 00 00 80 00 00 84 57 db d4 eb 00 00 ..........W..... 0040 00 00 00 00 00 02 00 01 86 a3 00 00 00 03 00 00 ................ 0050 00 07 00 00 00 01 00 00 00 18 00 00 00 00 00 00 ................ 0060 00 00 00 00 00 50 00 00 00 50 00 00 00 01 00 00 .....P...P...... 0070 00 50 00 00 00 00 00 00 00 00 00 00 00 1c 8b 26 .P.............& 0080 96 a9 07 bf 0e d4 0a 00 1f 87 05 00 00 00 02 9f ................ 0090 04 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 ................ 00a0 00 00 00 00 00 0f 00 00 00 00 00 00 00 0f 38 39 ..............89 00b0 39 38 38 20 32 36 32 31 34 34 30 30 30 00 988 262144000. No. Time Source Destination Protocol Info 25 0.002996 192.168.2.137 192.168.2.153 NFS V3 WRITE Reply (Call In 24) Error:NFS3ERR_IO Frame 25 (94 bytes on wire, 94 bytes captured) Arrival Time: Jan 30, 2010 12:41:46.913824000 [Time delta from previous captured frame: 0.000221000 seconds] [Time delta from previous displayed frame: 0.000221000 seconds] [Time since reference or first frame: 0.002996000 seconds] Frame Number: 25 Frame Length: 94 bytes Capture Length: 94 bytes [Frame is marked: False] [Protocols in frame: eth:ip:tcp:rpc] [Coloring Rule Name: TCP] [Coloring Rule String: tcp] Ethernet II, Src: IntelCor_bf:eb:7b (00:15:17:bf:eb:7b), Dst: Supermic_7b:52:34 (00:30:48:7b:52:34) Destination: Supermic_7b:52:34 (00:30:48:7b:52:34) Address: Supermic_7b:52:34 (00:30:48:7b:52:34) .... ...0 .... .... .... .... = IG bit: Individual address (unicast) .... ..0. .... .... .... .... = LG bit: Globally unique address (factory default) Source: IntelCor_bf:eb:7b (00:15:17:bf:eb:7b) Address: IntelCor_bf:eb:7b (00:15:17:bf:eb:7b) .... ...0 .... .... .... .... = IG bit: Individual address (unicast) .... ..0. .... .... .... .... = LG bit: Globally unique address (factory default) Type: IP (0x0800) Internet Protocol, Src: 192.168.2.137 (192.168.2.137), Dst: 192.168.2.153 (192.168.2.153) Version: 4 Header length: 20 bytes Differentiated Services Field: 0x00 (DSCP 0x00: Default; ECN: 0x00) 0000 00.. = Differentiated Services Codepoint: Default (0x00) .... ..0. = ECN-Capable Transport (ECT): 0 .... ...0 = ECN-CE: 0 Total Length: 80 Identification: 0xb8e1 (47329) Flags: 0x04 (Don't Fragment) 0... = Reserved bit: Not set .1.. = Don't fragment: Set ..0. = More fragments: Not set Fragment offset: 0 Time to live: 64 Protocol: TCP (0x06) Header checksum: 0xfb53 [correct] [Good: True] [Bad : False] Source: 192.168.2.137 (192.168.2.137) Destination: 192.168.2.153 (192.168.2.153) Transmission Control Protocol, Src Port: nfs (2049), Dst Port: sshell (614), Seq: 481, Ack: 1633, Len: 40 Source port: nfs (2049) Destination port: sshell (614) Sequence number: 481 (relative sequence number) [Next sequence number: 521 (relative sequence number)] Acknowledgement number: 1633 (relative ack number) Header length: 20 bytes Flags: 0x18 (PSH, ACK) 0... .... = Congestion Window Reduced (CWR): Not set .0.. .... = ECN-Echo: Not set ..0. .... = Urgent: Not set ...1 .... = Acknowledgment: Set .... 1... = Push: Set .... .0.. = Reset: Not set .... ..0. = Syn: Not set .... ...0 = Fin: Not set Window size: 65535 Checksum: 0x8037 [correct] [Good Checksum: True] [Bad Checksum: False] [SEQ/ACK analysis] [This is an ACK to the segment in frame: 24] [The RTT to ACK the segment was: 0.000221000 seconds] Remote Procedure Call, Type:Reply XID:0x57dbd4eb Fragment header: Last fragment, 36 bytes 1... .... .... .... .... .... .... .... = Last Fragment: Yes .000 0000 0000 0000 0000 0000 0010 0100 = Fragment Length: 36 XID: 0x57dbd4eb (1474024683) Message Type: Reply (1) [Program: NFS (100003)] [Program Version: 3] [Procedure: WRITE (7)] Reply State: accepted (0) [This is a reply to a request in frame 24] [Time from request: 0.000221000 seconds] Verifier Flavor: AUTH_NULL (0) Length: 0 Accept State: RPC executed successfully (0) Network File System, WRITE Reply Error:NFS3ERR_IO [Program Version: 3] [V3 Procedure: WRITE (7)] Status: NFS3ERR_IO (5) file_wcc before attributes_follow: no value (0) after attributes_follow: no value (0) 0000 00 30 48 7b 52 34 00 15 17 bf eb 7b 08 00 45 00 .0H{R4.....{..E. 0010 00 50 b8 e1 40 00 40 06 fb 53 c0 a8 02 89 c0 a8 .P..@.@..S...... 0020 02 99 08 01 02 66 ee c3 bf f2 22 dd 20 0e 50 18 .....f....". .P. 0030 ff ff 80 37 00 00 80 00 00 24 57 db d4 eb 00 00 ...7.....$W..... 0040 00 01 00 00 00 00 00 00 00 00 00 00 00 00 00 00 ................ 0050 00 00 00 00 00 05 00 00 00 00 00 00 00 00 .............. No. Time Source Destination Protocol Info 26 0.003025 192.168.2.153 192.168.2.137 NFS V3 WRITE Call (Reply In 27), FH:0x810602fc Offset:0 Len:15 UNSTABLE Frame 26 (190 bytes on wire, 190 bytes captured) Arrival Time: Jan 30, 2010 12:41:46.913853000 [Time delta from previous captured frame: 0.000029000 seconds] [Time delta from previous displayed frame: 0.000029000 seconds] [Time since reference or first frame: 0.003025000 seconds] Frame Number: 26 Frame Length: 190 bytes Capture Length: 190 bytes [Frame is marked: False] [Protocols in frame: eth:ip:tcp:rpc:nfs] [Coloring Rule Name: Checksum Errors] [Coloring Rule String: cdp.checksum_bad==1 || edp.checksum_bad==1 || ip.checksum_bad==1 || tcp.checksum_bad==1 || udp.checksum_bad==1] Ethernet II, Src: Supermic_7b:52:34 (00:30:48:7b:52:34), Dst: IntelCor_bf:eb:7b (00:15:17:bf:eb:7b) Destination: IntelCor_bf:eb:7b (00:15:17:bf:eb:7b) Address: IntelCor_bf:eb:7b (00:15:17:bf:eb:7b) .... ...0 .... .... .... .... = IG bit: Individual address (unicast) .... ..0. .... .... .... .... = LG bit: Globally unique address (factory default) Source: Supermic_7b:52:34 (00:30:48:7b:52:34) Address: Supermic_7b:52:34 (00:30:48:7b:52:34) .... ...0 .... .... .... .... = IG bit: Individual address (unicast) .... ..0. .... .... .... .... = LG bit: Globally unique address (factory default) Type: IP (0x0800) Internet Protocol, Src: 192.168.2.153 (192.168.2.153), Dst: 192.168.2.137 (192.168.2.137) Version: 4 Header length: 20 bytes Differentiated Services Field: 0x00 (DSCP 0x00: Default; ECN: 0x00) 0000 00.. = Differentiated Services Codepoint: Default (0x00) .... ..0. = ECN-Capable Transport (ECT): 0 .... ...0 = ECN-CE: 0 Total Length: 176 Identification: 0xf8b6 (63670) Flags: 0x04 (Don't Fragment) 0... = Reserved bit: Not set .1.. = Don't fragment: Set ..0. = More fragments: Not set Fragment offset: 0 Time to live: 64 Protocol: TCP (0x06) Header checksum: 0xbb1e [correct] [Good: True] [Bad : False] Source: 192.168.2.153 (192.168.2.153) Destination: 192.168.2.137 (192.168.2.137) Transmission Control Protocol, Src Port: sshell (614), Dst Port: nfs (2049), Seq: 1633, Ack: 521, Len: 136 Source port: sshell (614) Destination port: nfs (2049) Sequence number: 1633 (relative sequence number) [Next sequence number: 1769 (relative sequence number)] Acknowledgement number: 521 (relative ack number) Header length: 20 bytes Flags: 0x18 (PSH, ACK) 0... .... = Congestion Window Reduced (CWR): Not set .0.. .... = ECN-Echo: Not set ..0. .... = Urgent: Not set ...1 .... = Acknowledgment: Set .... 1... = Push: Set .... .0.. = Reset: Not set .... ..0. = Syn: Not set .... ...0 = Fin: Not set Window size: 65535 Checksum: 0x8715 [incorrect, should be 0xe778 (maybe caused by "TCP checksum offload"?)] [Good Checksum: False] [Bad Checksum: True] [SEQ/ACK analysis] [This is an ACK to the segment in frame: 25] [The RTT to ACK the segment was: 0.000029000 seconds] Remote Procedure Call, Type:Call XID:0x57dbd4ec Fragment header: Last fragment, 132 bytes 1... .... .... .... .... .... .... .... = Last Fragment: Yes .000 0000 0000 0000 0000 0000 1000 0100 = Fragment Length: 132 XID: 0x57dbd4ec (1474024684) Message Type: Call (0) RPC Version: 2 Program: NFS (100003) Program Version: 3 Procedure: WRITE (7) [The reply to this request is in frame 27] Credentials Flavor: AUTH_UNIX (1) Length: 24 Stamp: 0x00000000 Machine Name: <EMPTY> length: 0 contents: <EMPTY> UID: 80 GID: 80 Auxiliary GIDs GID: 80 Verifier Flavor: AUTH_NULL (0) Length: 0 Network File System, WRITE Call FH:0x810602fc Offset:0 Len:15 UNSTABLE [Program Version: 3] [V3 Procedure: WRITE (7)] file length: 28 [hash: 0x810602fc] decode type as: unknown filehandle: 8B2696A907BF0ED40A001F8705000000029F040000000000... offset: 0 count: 15 Stable: UNSTABLE (0) Data: <DATA> length: 15 contents: <DATA> fill bytes: opaque data 0000 00 15 17 bf eb 7b 00 30 48 7b 52 34 08 00 45 00 .....{.0H{R4..E. 0010 00 b0 f8 b6 40 00 40 06 bb 1e c0 a8 02 99 c0 a8 ....@.@......... 0020 02 89 02 66 08 01 22 dd 20 0e ee c3 c0 1a 50 18 ...f..". .....P. 0030 ff ff 87 15 00 00 80 00 00 84 57 db d4 ec 00 00 ..........W..... 0040 00 00 00 00 00 02 00 01 86 a3 00 00 00 03 00 00 ................ 0050 00 07 00 00 00 01 00 00 00 18 00 00 00 00 00 00 ................ 0060 00 00 00 00 00 50 00 00 00 50 00 00 00 01 00 00 .....P...P...... 0070 00 50 00 00 00 00 00 00 00 00 00 00 00 1c 8b 26 .P.............& 0080 96 a9 07 bf 0e d4 0a 00 1f 87 05 00 00 00 02 9f ................ 0090 04 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 ................ 00a0 00 00 00 00 00 0f 00 00 00 00 00 00 00 0f 38 39 ..............89 00b0 39 38 38 20 32 36 32 31 34 34 30 30 30 00 988 262144000. No. Time Source Destination Protocol Info 27 0.003246 192.168.2.137 192.168.2.153 NFS V3 WRITE Reply (Call In 26) Error:NFS3ERR_IO Frame 27 (94 bytes on wire, 94 bytes captured) Arrival Time: Jan 30, 2010 12:41:46.914074000 [Time delta from previous captured frame: 0.000221000 seconds] [Time delta from previous displayed frame: 0.000221000 seconds] [Time since reference or first frame: 0.003246000 seconds] Frame Number: 27 Frame Length: 94 bytes Capture Length: 94 bytes [Frame is marked: False] [Protocols in frame: eth:ip:tcp:rpc] [Coloring Rule Name: TCP] [Coloring Rule String: tcp] Ethernet II, Src: IntelCor_bf:eb:7b (00:15:17:bf:eb:7b), Dst: Supermic_7b:52:34 (00:30:48:7b:52:34) Destination: Supermic_7b:52:34 (00:30:48:7b:52:34) Address: Supermic_7b:52:34 (00:30:48:7b:52:34) .... ...0 .... .... .... .... = IG bit: Individual address (unicast) .... ..0. .... .... .... .... = LG bit: Globally unique address (factory default) Source: IntelCor_bf:eb:7b (00:15:17:bf:eb:7b) Address: IntelCor_bf:eb:7b (00:15:17:bf:eb:7b) .... ...0 .... .... .... .... = IG bit: Individual address (unicast) .... ..0. .... .... .... .... = LG bit: Globally unique address (factory default) Type: IP (0x0800) Internet Protocol, Src: 192.168.2.137 (192.168.2.137), Dst: 192.168.2.153 (192.168.2.153) Version: 4 Header length: 20 bytes Differentiated Services Field: 0x00 (DSCP 0x00: Default; ECN: 0x00) 0000 00.. = Differentiated Services Codepoint: Default (0x00) .... ..0. = ECN-Capable Transport (ECT): 0 .... ...0 = ECN-CE: 0 Total Length: 80 Identification: 0xb8e2 (47330) Flags: 0x04 (Don't Fragment) 0... = Reserved bit: Not set .1.. = Don't fragment: Set ..0. = More fragments: Not set Fragment offset: 0 Time to live: 64 Protocol: TCP (0x06) Header checksum: 0xfb52 [correct] [Good: True] [Bad : False] Source: 192.168.2.137 (192.168.2.137) Destination: 192.168.2.153 (192.168.2.153) Transmission Control Protocol, Src Port: nfs (2049), Dst Port: sshell (614), Seq: 521, Ack: 1769, Len: 40 Source port: nfs (2049) Destination port: sshell (614) Sequence number: 521 (relative sequence number) [Next sequence number: 561 (relative sequence number)] Acknowledgement number: 1769 (relative ack number) Header length: 20 bytes Flags: 0x18 (PSH, ACK) 0... .... = Congestion Window Reduced (CWR): Not set .0.. .... = ECN-Echo: Not set ..0. .... = Urgent: Not set ...1 .... = Acknowledgment: Set .... 1... = Push: Set .... .0.. = Reset: Not set .... ..0. = Syn: Not set .... ...0 = Fin: Not set Window size: 65535 Checksum: 0x7f86 [correct] [Good Checksum: True] [Bad Checksum: False] [SEQ/ACK analysis] [This is an ACK to the segment in frame: 26] [The RTT to ACK the segment was: 0.000221000 seconds] Remote Procedure Call, Type:Reply XID:0x57dbd4ec Fragment header: Last fragment, 36 bytes 1... .... .... .... .... .... .... .... = Last Fragment: Yes .000 0000 0000 0000 0000 0000 0010 0100 = Fragment Length: 36 XID: 0x57dbd4ec (1474024684) Message Type: Reply (1) [Program: NFS (100003)] [Program Version: 3] [Procedure: WRITE (7)] Reply State: accepted (0) [This is a reply to a request in frame 26] [Time from request: 0.000221000 seconds] Verifier Flavor: AUTH_NULL (0) Length: 0 Accept State: RPC executed successfully (0) Network File System, WRITE Reply Error:NFS3ERR_IO [Program Version: 3] [V3 Procedure: WRITE (7)] Status: NFS3ERR_IO (5) file_wcc before attributes_follow: no value (0) after attributes_follow: no value (0) 0000 00 30 48 7b 52 34 00 15 17 bf eb 7b 08 00 45 00 .0H{R4.....{..E. 0010 00 50 b8 e2 40 00 40 06 fb 52 c0 a8 02 89 c0 a8 .P..@.@..R...... 0020 02 99 08 01 02 66 ee c3 c0 1a 22 dd 20 96 50 18 .....f....". .P. 0030 ff ff 7f 86 00 00 80 00 00 24 57 db d4 ec 00 00 .........$W..... 0040 00 01 00 00 00 00 00 00 00 00 00 00 00 00 00 00 ................ 0050 00 00 00 00 00 05 00 00 00 00 00 00 00 00 .............. No. Time Source Destination Protocol Info 28 0.003275 192.168.2.153 192.168.2.137 NFS V3 WRITE Call (Reply In 29), FH:0x810602fc Offset:0 Len:15 UNSTABLE Frame 28 (190 bytes on wire, 190 bytes captured) Arrival Time: Jan 30, 2010 12:41:46.914103000 [Time delta from previous captured frame: 0.000029000 seconds] [Time delta from previous displayed frame: 0.000029000 seconds] [Time since reference or first frame: 0.003275000 seconds] Frame Number: 28 Frame Length: 190 bytes Capture Length: 190 bytes [Frame is marked: False] [Protocols in frame: eth:ip:tcp:rpc:nfs] [Coloring Rule Name: Checksum Errors] [Coloring Rule String: cdp.checksum_bad==1 || edp.checksum_bad==1 || ip.checksum_bad==1 || tcp.checksum_bad==1 || udp.checksum_bad==1] Ethernet II, Src: Supermic_7b:52:34 (00:30:48:7b:52:34), Dst: IntelCor_bf:eb:7b (00:15:17:bf:eb:7b) Destination: IntelCor_bf:eb:7b (00:15:17:bf:eb:7b) Address: IntelCor_bf:eb:7b (00:15:17:bf:eb:7b) .... ...0 .... .... .... .... = IG bit: Individual address (unicast) .... ..0. .... .... .... .... = LG bit: Globally unique address (factory default) Source: Supermic_7b:52:34 (00:30:48:7b:52:34) Address: Supermic_7b:52:34 (00:30:48:7b:52:34) .... ...0 .... .... .... .... = IG bit: Individual address (unicast) .... ..0. .... .... .... .... = LG bit: Globally unique address (factory default) Type: IP (0x0800) Internet Protocol, Src: 192.168.2.153 (192.168.2.153), Dst: 192.168.2.137 (192.168.2.137) Version: 4 Header length: 20 bytes Differentiated Services Field: 0x00 (DSCP 0x00: Default; ECN: 0x00) 0000 00.. = Differentiated Services Codepoint: Default (0x00) .... ..0. = ECN-Capable Transport (ECT): 0 .... ...0 = ECN-CE: 0 Total Length: 176 Identification: 0xf8b7 (63671) Flags: 0x04 (Don't Fragment) 0... = Reserved bit: Not set .1.. = Don't fragment: Set ..0. = More fragments: Not set Fragment offset: 0 Time to live: 64 Protocol: TCP (0x06) Header checksum: 0xbb1d [correct] [Good: True] [Bad : False] Source: 192.168.2.153 (192.168.2.153) Destination: 192.168.2.137 (192.168.2.137) Transmission Control Protocol, Src Port: sshell (614), Dst Port: nfs (2049), Seq: 1769, Ack: 561, Len: 136 Source port: sshell (614) Destination port: nfs (2049) Sequence number: 1769 (relative sequence number) [Next sequence number: 1905 (relative sequence number)] Acknowledgement number: 561 (relative ack number) Header length: 20 bytes Flags: 0x18 (PSH, ACK) 0... .... = Congestion Window Reduced (CWR): Not set .0.. .... = ECN-Echo: Not set ..0. .... = Urgent: Not set ...1 .... = Acknowledgment: Set .... 1... = Push: Set .... .0.. = Reset: Not set .... ..0. = Syn: Not set .... ...0 = Fin: Not set Window size: 65535 Checksum: 0x8715 [incorrect, should be 0xe6c7 (maybe caused by "TCP checksum offload"?)] [Good Checksum: False] [Bad Checksum: True] [SEQ/ACK analysis] [This is an ACK to the segment in frame: 27] [The RTT to ACK the segment was: 0.000029000 seconds] Remote Procedure Call, Type:Call XID:0x57dbd4ed Fragment header: Last fragment, 132 bytes 1... .... .... .... .... .... .... .... = Last Fragment: Yes .000 0000 0000 0000 0000 0000 1000 0100 = Fragment Length: 132 XID: 0x57dbd4ed (1474024685) Message Type: Call (0) RPC Version: 2 Program: NFS (100003) Program Version: 3 Procedure: WRITE (7) [The reply to this request is in frame 29] Credentials Flavor: AUTH_UNIX (1) Length: 24 Stamp: 0x00000000 Machine Name: <EMPTY> length: 0 contents: <EMPTY> UID: 80 GID: 80 Auxiliary GIDs GID: 80 Verifier Flavor: AUTH_NULL (0) Length: 0 Network File System, WRITE Call FH:0x810602fc Offset:0 Len:15 UNSTABLE [Program Version: 3] [V3 Procedure: WRITE (7)] file length: 28 [hash: 0x810602fc] decode type as: unknown filehandle: 8B2696A907BF0ED40A001F8705000000029F040000000000... offset: 0 count: 15 Stable: UNSTABLE (0) Data: <DATA> length: 15 contents: <DATA> fill bytes: opaque data 0000 00 15 17 bf eb 7b 00 30 48 7b 52 34 08 00 45 00 .....{.0H{R4..E. 0010 00 b0 f8 b7 40 00 40 06 bb 1d c0 a8 02 99 c0 a8 ....@.@......... 0020 02 89 02 66 08 01 22 dd 20 96 ee c3 c0 42 50 18 ...f..". ....BP. 0030 ff ff 87 15 00 00 80 00 00 84 57 db d4 ed 00 00 ..........W..... 0040 00 00 00 00 00 02 00 01 86 a3 00 00 00 03 00 00 ................ 0050 00 07 00 00 00 01 00 00 00 18 00 00 00 00 00 00 ................ 0060 00 00 00 00 00 50 00 00 00 50 00 00 00 01 00 00 .....P...P...... 0070 00 50 00 00 00 00 00 00 00 00 00 00 00 1c 8b 26 .P.............& 0080 96 a9 07 bf 0e d4 0a 00 1f 87 05 00 00 00 02 9f ................ 0090 04 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 ................ 00a0 00 00 00 00 00 0f 00 00 00 00 00 00 00 0f 38 39 ..............89 00b0 39 38 38 20 32 36 32 31 34 34 30 30 30 00 988 262144000. No. Time Source Destination Protocol Info 29 0.003496 192.168.2.137 192.168.2.153 NFS V3 WRITE Reply (Call In 28) Error:NFS3ERR_IO Frame 29 (94 bytes on wire, 94 bytes captured) Arrival Time: Jan 30, 2010 12:41:46.914324000 [Time delta from previous captured frame: 0.000221000 seconds] [Time delta from previous displayed frame: 0.000221000 seconds] [Time since reference or first frame: 0.003496000 seconds] Frame Number: 29 Frame Length: 94 bytes Capture Length: 94 bytes [Frame is marked: False] [Protocols in frame: eth:ip:tcp:rpc] [Coloring Rule Name: TCP] [Coloring Rule String: tcp] Ethernet II, Src: IntelCor_bf:eb:7b (00:15:17:bf:eb:7b), Dst: Supermic_7b:52:34 (00:30:48:7b:52:34) Destination: Supermic_7b:52:34 (00:30:48:7b:52:34) Address: Supermic_7b:52:34 (00:30:48:7b:52:34) .... ...0 .... .... .... .... = IG bit: Individual address (unicast) .... ..0. .... .... .... .... = LG bit: Globally unique address (factory default) Source: IntelCor_bf:eb:7b (00:15:17:bf:eb:7b) Address: IntelCor_bf:eb:7b (00:15:17:bf:eb:7b) .... ...0 .... .... .... .... = IG bit: Individual address (unicast) .... ..0. .... .... .... .... = LG bit: Globally unique address (factory default) Type: IP (0x0800) Internet Protocol, Src: 192.168.2.137 (192.168.2.137), Dst: 192.168.2.153 (192.168.2.153) Version: 4 Header length: 20 bytes Differentiated Services Field: 0x00 (DSCP 0x00: Default; ECN: 0x00) 0000 00.. = Differentiated Services Codepoint: Default (0x00) .... ..0. = ECN-Capable Transport (ECT): 0 .... ...0 = ECN-CE: 0 Total Length: 80 Identification: 0xb8e3 (47331) Flags: 0x04 (Don't Fragment) 0... = Reserved bit: Not set .1.. = Don't fragment: Set ..0. = More fragments: Not set Fragment offset: 0 Time to live: 64 Protocol: TCP (0x06) Header checksum: 0xfb51 [correct] [Good: True] [Bad : False] Source: 192.168.2.137 (192.168.2.137) Destination: 192.168.2.153 (192.168.2.153) Transmission Control Protocol, Src Port: nfs (2049), Dst Port: sshell (614), Seq: 561, Ack: 1905, Len: 40 Source port: nfs (2049) Destination port: sshell (614) Sequence number: 561 (relative sequence number) [Next sequence number: 601 (relative sequence number)] Acknowledgement number: 1905 (relative ack number) Header length: 20 bytes Flags: 0x18 (PSH, ACK) 0... .... = Congestion Window Reduced (CWR): Not set .0.. .... = ECN-Echo: Not set ..0. .... = Urgent: Not set ...1 .... = Acknowledgment: Set .... 1... = Push: Set .... .0.. = Reset: Not set .... ..0. = Syn: Not set .... ...0 = Fin: Not set Window size: 65535 Checksum: 0x7ed5 [correct] [Good Checksum: True] [Bad Checksum: False] [SEQ/ACK analysis] [This is an ACK to the segment in frame: 28] [The RTT to ACK the segment was: 0.000221000 seconds] Remote Procedure Call, Type:Reply XID:0x57dbd4ed Fragment header: Last fragment, 36 bytes 1... .... .... .... .... .... .... .... = Last Fragment: Yes .000 0000 0000 0000 0000 0000 0010 0100 = Fragment Length: 36 XID: 0x57dbd4ed (1474024685) Message Type: Reply (1) [Program: NFS (100003)] [Program Version: 3] [Procedure: WRITE (7)] Reply State: accepted (0) [This is a reply to a request in frame 28] [Time from request: 0.000221000 seconds] Verifier Flavor: AUTH_NULL (0) Length: 0 Accept State: RPC executed successfully (0) Network File System, WRITE Reply Error:NFS3ERR_IO [Program Version: 3] [V3 Procedure: WRITE (7)] Status: NFS3ERR_IO (5) file_wcc before attributes_follow: no value (0) after attributes_follow: no value (0) 0000 00 30 48 7b 52 34 00 15 17 bf eb 7b 08 00 45 00 .0H{R4.....{..E. 0010 00 50 b8 e3 40 00 40 06 fb 51 c0 a8 02 89 c0 a8 .P..@.@..Q...... 0020 02 99 08 01 02 66 ee c3 c0 42 22 dd 21 1e 50 18 .....f...B".!.P. 0030 ff ff 7e d5 00 00 80 00 00 24 57 db d4 ed 00 00 ..~......$W..... 0040 00 01 00 00 00 00 00 00 00 00 00 00 00 00 00 00 ................ 0050 00 00 00 00 00 05 00 00 00 00 00 00 00 00 .............. No. Time Source Destination Protocol Info 30 0.003524 192.168.2.153 192.168.2.137 NFS V3 WRITE Call (Reply In 31), FH:0x810602fc Offset:0 Len:15 UNSTABLE Frame 30 (190 bytes on wire, 190 bytes captured) Arrival Time: Jan 30, 2010 12:41:46.914352000 [Time delta from previous captured frame: 0.000028000 seconds] [Time delta from previous displayed frame: 0.000028000 seconds] [Time since reference or first frame: 0.003524000 seconds] Frame Number: 30 Frame Length: 190 bytes Capture Length: 190 bytes [Frame is marked: False] [Protocols in frame: eth:ip:tcp:rpc:nfs] [Coloring Rule Name: Checksum Errors] [Coloring Rule String: cdp.checksum_bad==1 || edp.checksum_bad==1 || ip.checksum_bad==1 || tcp.checksum_bad==1 || udp.checksum_bad==1] Ethernet II, Src: Supermic_7b:52:34 (00:30:48:7b:52:34), Dst: IntelCor_bf:eb:7b (00:15:17:bf:eb:7b) Destination: IntelCor_bf:eb:7b (00:15:17:bf:eb:7b) Address: IntelCor_bf:eb:7b (00:15:17:bf:eb:7b) .... ...0 .... .... .... .... = IG bit: Individual address (unicast) .... ..0. .... .... .... .... = LG bit: Globally unique address (factory default) Source: Supermic_7b:52:34 (00:30:48:7b:52:34) Address: Supermic_7b:52:34 (00:30:48:7b:52:34) .... ...0 .... .... .... .... = IG bit: Individual address (unicast) .... ..0. .... .... .... .... = LG bit: Globally unique address (factory default) Type: IP (0x0800) Internet Protocol, Src: 192.168.2.153 (192.168.2.153), Dst: 192.168.2.137 (192.168.2.137) Version: 4 Header length: 20 bytes Differentiated Services Field: 0x00 (DSCP 0x00: Default; ECN: 0x00) 0000 00.. = Differentiated Services Codepoint: Default (0x00) .... ..0. = ECN-Capable Transport (ECT): 0 .... ...0 = ECN-CE: 0 Total Length: 176 Identification: 0xf8b8 (63672) Flags: 0x04 (Don't Fragment) 0... = Reserved bit: Not set .1.. = Don't fragment: Set ..0. = More fragments: Not set Fragment offset: 0 Time to live: 64 Protocol: TCP (0x06) Header checksum: 0xbb1c [correct] [Good: True] [Bad : False] Source: 192.168.2.153 (192.168.2.153) Destination: 192.168.2.137 (192.168.2.137) Transmission Control Protocol, Src Port: sshell (614), Dst Port: nfs (2049), Seq: 1905, Ack: 601, Len: 136 Source port: sshell (614) Destination port: nfs (2049) Sequence number: 1905 (relative sequence number) [Next sequence number: 2041 (relative sequence number)] Acknowledgement number: 601 (relative ack number) Header length: 20 bytes Flags: 0x18 (PSH, ACK) 0... .... = Congestion Window Reduced (CWR): Not set .0.. .... = ECN-Echo: Not set ..0. .... = Urgent: Not set ...1 .... = Acknowledgment: Set .... 1... = Push: Set .... .0.. = Reset: Not set .... ..0. = Syn: Not set .... ...0 = Fin: Not set Window size: 65535 Checksum: 0x8715 [incorrect, should be 0xe616 (maybe caused by "TCP checksum offload"?)] [Good Checksum: False] [Bad Checksum: True] [SEQ/ACK analysis] [This is an ACK to the segment in frame: 29] [The RTT to ACK the segment was: 0.000028000 seconds] Remote Procedure Call, Type:Call XID:0x57dbd4ee Fragment header: Last fragment, 132 bytes 1... .... .... .... .... .... .... .... = Last Fragment: Yes .000 0000 0000 0000 0000 0000 1000 0100 = Fragment Length: 132 XID: 0x57dbd4ee (1474024686) Message Type: Call (0) RPC Version: 2 Program: NFS (100003) Program Version: 3 Procedure: WRITE (7) [The reply to this request is in frame 31] Credentials Flavor: AUTH_UNIX (1) Length: 24 Stamp: 0x00000000 Machine Name: <EMPTY> length: 0 contents: <EMPTY> UID: 80 GID: 80 Auxiliary GIDs GID: 80 Verifier Flavor: AUTH_NULL (0) Length: 0 Network File System, WRITE Call FH:0x810602fc Offset:0 Len:15 UNSTABLE [Program Version: 3] [V3 Procedure: WRITE (7)] file length: 28 [hash: 0x810602fc] decode type as: unknown filehandle: 8B2696A907BF0ED40A001F8705000000029F040000000000... offset: 0 count: 15 Stable: UNSTABLE (0) Data: <DATA> length: 15 contents: <DATA> fill bytes: opaque data 0000 00 15 17 bf eb 7b 00 30 48 7b 52 34 08 00 45 00 .....{.0H{R4..E. 0010 00 b0 f8 b8 40 00 40 06 bb 1c c0 a8 02 99 c0 a8 ....@.@......... 0020 02 89 02 66 08 01 22 dd 21 1e ee c3 c0 6a 50 18 ...f..".!....jP. 0030 ff ff 87 15 00 00 80 00 00 84 57 db d4 ee 00 00 ..........W..... 0040 00 00 00 00 00 02 00 01 86 a3 00 00 00 03 00 00 ................ 0050 00 07 00 00 00 01 00 00 00 18 00 00 00 00 00 00 ................ 0060 00 00 00 00 00 50 00 00 00 50 00 00 00 01 00 00 .....P...P...... 0070 00 50 00 00 00 00 00 00 00 00 00 00 00 1c 8b 26 .P.............& 0080 96 a9 07 bf 0e d4 0a 00 1f 87 05 00 00 00 02 9f ................ 0090 04 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 ................ 00a0 00 00 00 00 00 0f 00 00 00 00 00 00 00 0f 38 39 ..............89 00b0 39 38 38 20 32 36 32 31 34 34 30 30 30 00 988 262144000.