Krzys
2007-Apr-15 02:53 UTC
[zfs-discuss] crashed remote system trying to do zfs send / receive
Strange thing, I did try to do zfs send/receive using zfs. On the from host I did the following: bash-3.00# zfs send mypool/zones/wilfred2 at migrate | ssh 10.0.2.79 zfs receive mypool/zones/wilfred2 at migrate Password: ^CKilled by signal 2. 1 or 2 minutes later I did break this command and I wanted to time it so I did change command and reissued it. bash-3.00# time zfs send mypool/zones/wilfred2 at migrate | ssh 10.0.2.79 zfs receive mypool/zones/wilfred2 at migrate Password: ^CKilled by signal 2. real 0m7.346s user 0m0.220s sys 0m0.036s bash-3.00# Right after this I got on remote server kernel panic and here is the output: [22:35:30] @zglobix1: /root > panic[cpu1]/thread=30001334380: dangling dbufs (dn=6000a13eba0, dbuf=60007d927e8) 000002a1004f9030 zfs:dnode_evict_dbufs+19c (6000a13eba0, 1, 7b64e800, 6000a9e34b0, 1, 2a1004f90e8) %l0-3: 000006000a13edb0 0000000000000000 0000000000000000 000006000a13edb8 %l4-7: 000002a1004f90e8 0000060007be3910 0000000000000003 0000000000000001 000002a1004f9230 zfs:dmu_objset_evict_dbufs+d8 (21, 0, 0, 7b648400, 6000a9e32c0, 6000a9e32c0) %l0-3: 0000060002738f89 000000000000000f 0000060007fef8f0 000006000a9e34a0 %l4-7: 000006000a13eba0 000006000a9e3398 0000000000000001 000000007b6485e7 000002a1004f92e0 zfs:dmu_objset_evict+b4 (60007138900, 6000a9e32c0, 180e580, 7b60a800, 7b64e400, 7b64e400) %l0-3: ffffffffffffffff 000000000180c000 0000000000000005 0000000000000000 %l4-7: 0000060007b9f600 000000007b60a800 000000007b64e400 0000000000000000 000002a1004f93a0 zfs:dsl_dataset_evict+34 (60007138900, 7b60af7c, 18364c0, 60001ac90c0, 6000a9e32c0, 60007b9f600) %l0-3: 0000000000000000 0000000000000000 000002a10001fcc0 000002a10001fcc0 %l4-7: 00000300000b1b80 0000000000000000 0000000001ac8d1a 00000000018a8400 000002a1004f9450 zfs:dbuf_evict_user+48 (60007138908, 60007b9f600, 60008666cd0, 0, 0, 60008666be8) %l0-3: 0000000000000000 0000060007138900 0000000000000013 0000000000000000 %l4-7: 000003000107c000 00000000018ade70 0000000000000bc0 000000007b612fa4 000002a1004f9500 zfs:zfsctl_ops_root+b184ac4 (60008666c40, 60008666be8, 70478000, 3, 3, 0) %l0-3: 0000060001ac90c0 000000000000000f 00000600071389a0 0000000000000000 %l4-7: 0000000000000000 0000000000000000 0000000000000001 0000000070478018 000002a1004f95b0 zfs:dmu_recvbackup+8e8 (60006f32d00, 60006f32fd8, 60006f32e30, 1, 60006ad5fa8, 0) %l0-3: 0000060006f32d15 0000060007138900 000000007b607c00 000000007b648000 %l4-7: 0000000000000040 0000000000000354 0000000000000001 0000000000000138 000002a1004f9780 zfs:zfs_ioc_recvbackup+38 (60006f32000, 0, 0, 0, 9, 0) %l0-3: 0000000000000004 0000000000000000 000000000000006d 0000000000000000 %l4-7: 0000000000000000 0000060006f3200c 0000000000000000 0000000000000073 000002a1004f9830 zfs:zfsdev_ioctl+160 (70478c00, 5d, ffbfebc8, 1f, 7c, 1000) %l0-3: 0000060006f32000 0000000000000000 0000000000000000 000000000000007c %l4-7: 000000007b63b688 0000000070479248 00000000000002e8 0000000070478f60 000002a1004f98e0 genunix:fop_ioctl+20 (60006c8fd00, 5a1f, ffbfebc8, 100003, 600067d34b0, 12066d4) %l0-3: 00000600064da200 00000600064da200 0000000000000003 0000060006cc6fd8 %l4-7: 00000000ff342036 00000000ff345c7c 0000000000000000 00000000018a9400 000002a1004f9990 genunix:ioctl+184 (3, 60006c03688, ffbfebc8, 6500, ff000000, 5a1f) %l0-3: 0000000000000000 0000000000000000 0000000000000004 000000000000c1ac %l4-7: 0000000000000001 0000000000000000 0000000000000000 0000000000000000 syncing file systems... 2 1 done dumping to /dev/dsk/c1t1d0s1, offset 3436642304, content: kernel 94% done SC Alert: Failed to send email alert to the primary mailserver. SC Alert: Failed to send email alert for recent event. 100% done: 71483 pages dumped, compression ratio 5.34, dump succeeded rebooting... SC Alert: Host System has Reset Probing system devices Probing memory Probing I/O buses Sun Fire V240, No Keyboard Copyright 1998-2004 Sun Microsystems, Inc. All rights reserved. OpenBoot 4.16.2, 16384 MB memory installed, Serial #63395381. Ethernet address 0:3:ba:c7:56:35, Host ID: 83c75635. Initializing 2048MB of memory at addr 1000000000 \ SC Alert: Failed to send email alert for recent event. Rebooting with command: boot Boot device: disk1 File and args: SunOS Release 5.10 Version Generic_118833-36 64-bit Copyright 1983-2006 Sun Microsystems, Inc. All rights reserved. Use is subject to license terms. / SC Alert: Failed to send email alert for recent event. Hardware watchdog enabled Hostname: zglobix1 checking ufs filesystems /dev/rdsk/c1t1d0s7: is logging. Failed to send email alert for recent event. SC Alert: Failed to send email alert for recent event. zglobix1 console login: Any idea why this happend? Is there a bug? or did I do something wrong? Regards, Chris
Robert Milkowski
2007-Apr-16 22:37 UTC
[zfs-discuss] crashed remote system trying to do zfs send / receive
Hello Krzys,
Sunday, April 15, 2007, 4:53:43 AM, you wrote:
K> Strange thing, I did try to do zfs send/receive using zfs.
K> On the from host I did the following:
K> bash-3.00# zfs send mypool/zones/wilfred2 at migrate | ssh 10.0.2.79 zfs
receive
K> mypool/zones/wilfred2 at migrate
K> Password:
K> ^CKilled by signal 2.
K> 1 or 2 minutes later I did break this command and I wanted to time it so I
did
K> change command and reissued it.
K> bash-3.00# time zfs send mypool/zones/wilfred2 at migrate | ssh 10.0.2.79
zfs
K> receive mypool/zones/wilfred2 at migrate
K> Password:
K> ^CKilled by signal 2.
K> real 0m7.346s
K> user 0m0.220s
K> sys 0m0.036s
K> bash-3.00#
K> Right after this I got on remote server kernel panic and here is the
output:
K> [22:35:30] @zglobix1: /root >
K> panic[cpu1]/thread=30001334380: dangling dbufs (dn=6000a13eba0,
K> dbuf=60007d927e8)
K> 000002a1004f9030 zfs:dnode_evict_dbufs+19c (6000a13eba0, 1, 7b64e800,
K> 6000a9e34b0, 1, 2a1004f90e8)
K> %l0-3: 000006000a13edb0 0000000000000000 0000000000000000
000006000a13edb8
K> %l4-7: 000002a1004f90e8 0000060007be3910 0000000000000003
0000000000000001
K> 000002a1004f9230 zfs:dmu_objset_evict_dbufs+d8 (21, 0, 0, 7b648400,
6000a9e32c0,
K> 6000a9e32c0)
K> %l0-3: 0000060002738f89 000000000000000f 0000060007fef8f0
000006000a9e34a0
K> %l4-7: 000006000a13eba0 000006000a9e3398 0000000000000001
000000007b6485e7
K> 000002a1004f92e0 zfs:dmu_objset_evict+b4 (60007138900, 6000a9e32c0,
180e580,
K> 7b60a800, 7b64e400, 7b64e400)
K> %l0-3: ffffffffffffffff 000000000180c000 0000000000000005
0000000000000000
K> %l4-7: 0000060007b9f600 000000007b60a800 000000007b64e400
0000000000000000
K> 000002a1004f93a0 zfs:dsl_dataset_evict+34 (60007138900, 7b60af7c, 18364c0,
K> 60001ac90c0, 6000a9e32c0, 60007b9f600)
K> %l0-3: 0000000000000000 0000000000000000 000002a10001fcc0
000002a10001fcc0
K> %l4-7: 00000300000b1b80 0000000000000000 0000000001ac8d1a
00000000018a8400
K> 000002a1004f9450 zfs:dbuf_evict_user+48 (60007138908, 60007b9f600,
60008666cd0,
K> 0, 0, 60008666be8)
K> %l0-3: 0000000000000000 0000060007138900 0000000000000013
0000000000000000
K> %l4-7: 000003000107c000 00000000018ade70 0000000000000bc0
000000007b612fa4
K> 000002a1004f9500 zfs:zfsctl_ops_root+b184ac4 (60008666c40, 60008666be8,
K> 70478000, 3, 3, 0)
K> %l0-3: 0000060001ac90c0 000000000000000f 00000600071389a0
0000000000000000
K> %l4-7: 0000000000000000 0000000000000000 0000000000000001
0000000070478018
K> 000002a1004f95b0 zfs:dmu_recvbackup+8e8 (60006f32d00, 60006f32fd8,
60006f32e30,
K> 1, 60006ad5fa8, 0)
K> %l0-3: 0000060006f32d15 0000060007138900 000000007b607c00
000000007b648000
K> %l4-7: 0000000000000040 0000000000000354 0000000000000001
0000000000000138
K> 000002a1004f9780 zfs:zfs_ioc_recvbackup+38 (60006f32000, 0, 0, 0, 9, 0)
K> %l0-3: 0000000000000004 0000000000000000 000000000000006d
0000000000000000
K> %l4-7: 0000000000000000 0000060006f3200c 0000000000000000
0000000000000073
K> 000002a1004f9830 zfs:zfsdev_ioctl+160 (70478c00, 5d, ffbfebc8, 1f, 7c,
1000)
K> %l0-3: 0000060006f32000 0000000000000000 0000000000000000
000000000000007c
K> %l4-7: 000000007b63b688 0000000070479248 00000000000002e8
0000000070478f60
K> 000002a1004f98e0 genunix:fop_ioctl+20 (60006c8fd00, 5a1f, ffbfebc8,
100003,
K> 600067d34b0, 12066d4)
K> %l0-3: 00000600064da200 00000600064da200 0000000000000003
0000060006cc6fd8
K> %l4-7: 00000000ff342036 00000000ff345c7c 0000000000000000
00000000018a9400
K> 000002a1004f9990 genunix:ioctl+184 (3, 60006c03688, ffbfebc8, 6500,
ff000000,
K> 5a1f)
K> %l0-3: 0000000000000000 0000000000000000 0000000000000004
000000000000c1ac
K> %l4-7: 0000000000000001 0000000000000000 0000000000000000
0000000000000000
K> syncing file systems... 2 1 done
K> dumping to /dev/dsk/c1t1d0s1, offset 3436642304, content: kernel
K> 94% done
K> SC Alert: Failed to send email alert to the primary mailserver.
K> SC Alert: Failed to send email alert for recent event.
K> 100% done: 71483 pages dumped, compression ratio 5.34, dump succeeded
K> rebooting...
K> SC Alert: Host System has Reset
K> Probing system devices
K> Probing memory
K> Probing I/O buses
K> Sun Fire V240, No Keyboard
K> Copyright 1998-2004 Sun Microsystems, Inc. All rights reserved.
K> OpenBoot 4.16.2, 16384 MB memory installed, Serial #63395381.
K> Ethernet address 0:3:ba:c7:56:35, Host ID: 83c75635.
K> Initializing 2048MB of memory at addr 1000000000 \
K> SC Alert: Failed to send email alert for recent event.
K> Rebooting with command: boot
K> Boot device: disk1 File and args:
K> SunOS Release 5.10 Version Generic_118833-36 64-bit
K> Copyright 1983-2006 Sun Microsystems, Inc. All rights reserved.
K> Use is subject to license terms.
K> /
K> SC Alert: Failed to send email alert for recent event.
K> Hardware watchdog enabled
K> Hostname: zglobix1
K> checking ufs filesystems
K> /dev/rdsk/c1t1d0s7: is logging.
K> Failed to send email alert for recent event.
K> SC Alert: Failed to send email alert for recent event.
K> zglobix1 console login:
K> Any idea why this happend? Is there a bug? or did I do something wrong?
There''s a bug for it and IIRC it''s fixed in snv.
--
Best regards,
Robert mailto:rmilkowski at task.gda.pl
http://milek.blogspot.com
Krzys
2007-Apr-16 22:56 UTC
[zfs-discuss] crashed remote system trying to do zfs send / receive
Ah, perfect then... Thank you so much for letting me know... Regards, Chris On Tue, 17 Apr 2007, Robert Milkowski wrote:> Hello Krzys, > > Sunday, April 15, 2007, 4:53:43 AM, you wrote: > > K> Strange thing, I did try to do zfs send/receive using zfs. > > K> On the from host I did the following: > > > K> bash-3.00# zfs send mypool/zones/wilfred2 at migrate | ssh 10.0.2.79 zfs receive > K> mypool/zones/wilfred2 at migrate > K> Password: > K> ^CKilled by signal 2. > > K> 1 or 2 minutes later I did break this command and I wanted to time it so I did > K> change command and reissued it. > > K> bash-3.00# time zfs send mypool/zones/wilfred2 at migrate | ssh 10.0.2.79 zfs > K> receive mypool/zones/wilfred2 at migrate > K> Password: > K> ^CKilled by signal 2. > > > K> real 0m7.346s > K> user 0m0.220s > K> sys 0m0.036s > K> bash-3.00# > > K> Right after this I got on remote server kernel panic and here is the output: > > K> [22:35:30] @zglobix1: /root > > K> panic[cpu1]/thread=30001334380: dangling dbufs (dn=6000a13eba0, > K> dbuf=60007d927e8) > > > K> 000002a1004f9030 zfs:dnode_evict_dbufs+19c (6000a13eba0, 1, 7b64e800, > K> 6000a9e34b0, 1, 2a1004f90e8) > K> %l0-3: 000006000a13edb0 0000000000000000 0000000000000000 000006000a13edb8 > K> %l4-7: 000002a1004f90e8 0000060007be3910 0000000000000003 0000000000000001 > K> 000002a1004f9230 zfs:dmu_objset_evict_dbufs+d8 (21, 0, 0, 7b648400, 6000a9e32c0, > K> 6000a9e32c0) > K> %l0-3: 0000060002738f89 000000000000000f 0000060007fef8f0 000006000a9e34a0 > K> %l4-7: 000006000a13eba0 000006000a9e3398 0000000000000001 000000007b6485e7 > K> 000002a1004f92e0 zfs:dmu_objset_evict+b4 (60007138900, 6000a9e32c0, 180e580, > K> 7b60a800, 7b64e400, 7b64e400) > K> %l0-3: ffffffffffffffff 000000000180c000 0000000000000005 0000000000000000 > K> %l4-7: 0000060007b9f600 000000007b60a800 000000007b64e400 0000000000000000 > K> 000002a1004f93a0 zfs:dsl_dataset_evict+34 (60007138900, 7b60af7c, 18364c0, > K> 60001ac90c0, 6000a9e32c0, 60007b9f600) > K> %l0-3: 0000000000000000 0000000000000000 000002a10001fcc0 000002a10001fcc0 > K> %l4-7: 00000300000b1b80 0000000000000000 0000000001ac8d1a 00000000018a8400 > K> 000002a1004f9450 zfs:dbuf_evict_user+48 (60007138908, 60007b9f600, 60008666cd0, > K> 0, 0, 60008666be8) > K> %l0-3: 0000000000000000 0000060007138900 0000000000000013 0000000000000000 > K> %l4-7: 000003000107c000 00000000018ade70 0000000000000bc0 000000007b612fa4 > K> 000002a1004f9500 zfs:zfsctl_ops_root+b184ac4 (60008666c40, 60008666be8, > K> 70478000, 3, 3, 0) > K> %l0-3: 0000060001ac90c0 000000000000000f 00000600071389a0 0000000000000000 > K> %l4-7: 0000000000000000 0000000000000000 0000000000000001 0000000070478018 > K> 000002a1004f95b0 zfs:dmu_recvbackup+8e8 (60006f32d00, 60006f32fd8, 60006f32e30, > K> 1, 60006ad5fa8, 0) > K> %l0-3: 0000060006f32d15 0000060007138900 000000007b607c00 000000007b648000 > K> %l4-7: 0000000000000040 0000000000000354 0000000000000001 0000000000000138 > K> 000002a1004f9780 zfs:zfs_ioc_recvbackup+38 (60006f32000, 0, 0, 0, 9, 0) > K> %l0-3: 0000000000000004 0000000000000000 000000000000006d 0000000000000000 > K> %l4-7: 0000000000000000 0000060006f3200c 0000000000000000 0000000000000073 > K> 000002a1004f9830 zfs:zfsdev_ioctl+160 (70478c00, 5d, ffbfebc8, 1f, 7c, 1000) > K> %l0-3: 0000060006f32000 0000000000000000 0000000000000000 000000000000007c > K> %l4-7: 000000007b63b688 0000000070479248 00000000000002e8 0000000070478f60 > K> 000002a1004f98e0 genunix:fop_ioctl+20 (60006c8fd00, 5a1f, ffbfebc8, 100003, > K> 600067d34b0, 12066d4) > K> %l0-3: 00000600064da200 00000600064da200 0000000000000003 0000060006cc6fd8 > K> %l4-7: 00000000ff342036 00000000ff345c7c 0000000000000000 00000000018a9400 > K> 000002a1004f9990 genunix:ioctl+184 (3, 60006c03688, ffbfebc8, 6500, ff000000, > K> 5a1f) > K> %l0-3: 0000000000000000 0000000000000000 0000000000000004 000000000000c1ac > K> %l4-7: 0000000000000001 0000000000000000 0000000000000000 0000000000000000 > > K> syncing file systems... 2 1 done > K> dumping to /dev/dsk/c1t1d0s1, offset 3436642304, content: kernel > K> 94% done > K> SC Alert: Failed to send email alert to the primary mailserver. > > K> SC Alert: Failed to send email alert for recent event. > K> 100% done: 71483 pages dumped, compression ratio 5.34, dump succeeded > K> rebooting... > > K> SC Alert: Host System has Reset > K> Probing system devices > K> Probing memory > K> Probing I/O buses > > K> Sun Fire V240, No Keyboard > K> Copyright 1998-2004 Sun Microsystems, Inc. All rights reserved. > K> OpenBoot 4.16.2, 16384 MB memory installed, Serial #63395381. > K> Ethernet address 0:3:ba:c7:56:35, Host ID: 83c75635. > > > > K> Initializing 2048MB of memory at addr 1000000000 \ > K> SC Alert: Failed to send email alert for recent event. > K> Rebooting with command: boot > K> Boot device: disk1 File and args: > K> SunOS Release 5.10 Version Generic_118833-36 64-bit > K> Copyright 1983-2006 Sun Microsystems, Inc. All rights reserved. > K> Use is subject to license terms. > K> / > K> SC Alert: Failed to send email alert for recent event. > K> Hardware watchdog enabled > K> Hostname: zglobix1 > K> checking ufs filesystems > K> /dev/rdsk/c1t1d0s7: is logging. > K> Failed to send email alert for recent event. > > K> SC Alert: Failed to send email alert for recent event. > > K> zglobix1 console login: > > > > > K> Any idea why this happend? Is there a bug? or did I do something wrong? > > There''s a bug for it and IIRC it''s fixed in snv. > > -- > Best regards, > Robert mailto:rmilkowski at task.gda.pl > http://milek.blogspot.com > > > !DSPAM:122,4623fad918321185627164! >