Amos Deering
2009-Dec-06 21:17 UTC
[zfs-discuss] OpenSolaris 2009.06 ZFS - COMSTAR iSCSI - NFS Reboot Issue
I have recently become aware of the capabilities of OpenSolaris, and am attempting to setup a Storage Box to give a combination of CIFS and iSCSI and/or NFS. I have seemingly succsessfully been able to configure a zfs iscsi share via iscsitgt, yet the performance is just not up to par, so I decided to move on to trying out comstar without to much testing of the configuration. I setup comstar with tpg to limit iscsi traffic to my dedicated storage network nics. I initally was attempting connection with my Citrix Xenserver 5 server. When I would attempt to write data to the LUN it would reboot my OpenSolaris storage server. Then I removed the tpg from the target and was able to transfer 30GB or so of a VM to the LUN with great performance. I ran that VM for 2 days, then decided to transfer another VM to the LUN. It started to transfer then it rebooted my OpenSolaris storage server again. I disconnected the Xenserver and destroyed the Xenserver SR. I then connected my MS initiator on my windows box, and attempted to transfer 40GB of data and it also rebooted my OpenSolaris storage server. Under the assumption that maybe comstar was the issue, I decided to try NFS. I setup a small 5GB NFS vol. I was not able to establish a connection. So I anon=0 the NFS vol. Then I was able to attach it to my Xenserver. I attempted to copy a VM and it started to write then the OpenSolaris storage server rebooted. Does anyone have any insight, knowledge of a useful system log. As of now I have not had the OpenSolaris server reboot when transferring data to the CIFS share. here is the info from Kdmesg Sat Dec 5 09:53:48 PST 2009 Dec 4 22:57:18 oss scsi: [ID 583861 kern.info] sd11 at marvell88sx0: target 7 lun 0 Dec 4 22:57:18 oss genunix: [ID 936769 kern.info] sd11 is /pci at 0,0/pci10de,376 at a/pci1033,125 at 0/pci11ab,11ab at 4/disk at 7,0 Dec 4 22:57:18 oss genunix: [ID 408114 kern.info] /pci at 0,0/pci10de,376 at a/pci1033,125 at 0/pci11ab,11ab at 4/disk at 7,0 (sd11) online Dec 4 22:57:19 oss genunix: [ID 308332 kern.info] root on rpool/ROOT/opensolaris-3 fstype zfs Dec 4 22:57:20 oss unix: [ID 190185 kern.info] SMBIOS v2.4 loaded (3583 bytes) Dec 4 22:57:20 oss unix: [ID 517869 kern.info] NOTICE: cpu_acpi: _PSS package not found. Dec 4 22:57:20 oss unix: [ID 388705 kern.warning] WARNING: cpu_acpi: error parsing _PSS for CPU 0 Dec 4 22:57:20 oss unix: [ID 196753 kern.warning] WARNING: cpupm_init: processor 0: unable to initialize P-state support Dec 4 22:57:20 oss genunix: [ID 408114 kern.info] /cpus (cpunex0) online Dec 4 22:57:20 oss pseudo: [ID 129642 kern.info] pseudo-device: dld0 Dec 4 22:57:20 oss genunix: [ID 936769 kern.info] dld0 is /pseudo/dld at 0 Dec 4 22:57:20 oss npe: [ID 236367 kern.info] PCI Express-device: pci10de,370 at 6, pci_pci0 Dec 4 22:57:20 oss genunix: [ID 936769 kern.info] pci_pci0 is /pci at 0,0/pci10de,370 at 6 Dec 4 22:57:20 oss unix: [ID 954099 kern.info] NOTICE: IRQ21 is being shared by drivers with different interrupt levels. Dec 4 22:57:20 oss This may result in reduced system performance. Dec 4 22:57:22 oss npe: [ID 236367 kern.info] PCI Express-device: pci10de,cb84 at 2,1, ehci0 Dec 4 22:57:22 oss genunix: [ID 936769 kern.info] ehci0 is /pci at 0,0/pci10de,cb84 at 2,1 Dec 4 22:57:22 oss unix: [ID 954099 kern.info] NOTICE: IRQ22 is being shared by drivers with different interrupt levels. Dec 4 22:57:22 oss This may result in reduced system performance. Dec 4 22:57:22 oss npe: [ID 236367 kern.info] PCI Express-device: pci15d9,1611 at 2, ohci0 Dec 4 22:57:22 oss genunix: [ID 936769 kern.info] ohci0 is /pci at 0,0/pci15d9,1611 at 2 Dec 4 22:57:22 oss unix: [ID 950921 kern.info] cpu0: x86 (chipid 0x0 AuthenticAMD 100F42 family 16 model 4 step 2 clock 2211 MHz) Dec 4 22:57:22 oss unix: [ID 950921 kern.info] cpu0: Quad-Core AMD Opteron(tm) Processor 2374 HE Dec 4 22:57:22 oss unix: [ID 950921 kern.info] cpu1: x86 (chipid 0x0 AuthenticAMD 100F42 family 16 model 4 step 2 clock 2211 MHz) Dec 4 22:57:22 oss unix: [ID 950921 kern.info] cpu1: Quad-Core AMD Opteron(tm) Processor 2374 HE Dec 4 22:57:23 oss unix: [ID 517869 kern.info] NOTICE: cpu_acpi: _PSS package not found. Dec 4 22:57:23 oss unix: [ID 388705 kern.warning] WARNING: cpu_acpi: error parsing _PSS for CPU 1 Dec 4 22:57:23 oss unix: [ID 196753 kern.warning] WARNING: cpupm_init: processor 1: unable to initialize P-state support Dec 4 22:57:23 oss unix: [ID 557827 kern.info] cpu1 initialization complete - online Dec 4 22:57:23 oss unix: [ID 950921 kern.info] cpu2: x86 (chipid 0x0 AuthenticAMD 100F42 family 16 model 4 step 2 clock 2211 MHz) Dec 4 22:57:23 oss unix: [ID 950921 kern.info] cpu2: Quad-Core AMD Opteron(tm) Processor 2374 HE Dec 4 22:57:23 oss unix: [ID 517869 kern.info] NOTICE: cpu_acpi: _PSS package not found. Dec 4 22:57:23 oss unix: [ID 388705 kern.warning] WARNING: cpu_acpi: error parsing _PSS for CPU 2 Dec 4 22:57:23 oss unix: [ID 196753 kern.warning] WARNING: cpupm_init: processor 2: unable to initialize P-state support Dec 4 22:57:23 oss unix: [ID 557827 kern.info] cpu2 initialization complete - online Dec 4 22:57:23 oss unix: [ID 950921 kern.info] cpu3: x86 (chipid 0x0 AuthenticAMD 100F42 family 16 model 4 step 2 clock 2211 MHz) Dec 4 22:57:23 oss unix: [ID 950921 kern.info] cpu3: Quad-Core AMD Opteron(tm) Processor 2374 HE Dec 4 22:57:23 oss unix: [ID 517869 kern.info] NOTICE: cpu_acpi: _PSS package not found. Dec 4 22:57:23 oss unix: [ID 388705 kern.warning] WARNING: cpu_acpi: error parsing _PSS for CPU 3 Dec 4 22:57:23 oss unix: [ID 196753 kern.warning] WARNING: cpupm_init: processor 3: unable to initialize P-state support Dec 4 22:57:23 oss unix: [ID 557827 kern.info] cpu3 initialization complete - online Dec 4 22:57:23 oss unix: [ID 950921 kern.info] cpu4: x86 (chipid 0x1 AuthenticAMD 100F42 family 16 model 4 step 2 clock 2211 MHz) Dec 4 22:57:23 oss unix: [ID 950921 kern.info] cpu4: Quad-Core AMD Opteron(tm) Processor 2374 HE Dec 4 22:57:23 oss unix: [ID 517869 kern.info] NOTICE: cpu_acpi: _PSS package not found. Dec 4 22:57:23 oss unix: [ID 388705 kern.warning] WARNING: cpu_acpi: error parsing _PSS for CPU 4 Dec 4 22:57:23 oss unix: [ID 196753 kern.warning] WARNING: cpupm_init: processor 4: unable to initialize P-state support Dec 4 22:57:23 oss unix: [ID 557827 kern.info] cpu4 initialization complete - online Dec 4 22:57:23 oss unix: [ID 950921 kern.info] cpu5: x86 (chipid 0x1 AuthenticAMD 100F42 family 16 model 4 step 2 clock 2211 MHz) Dec 4 22:57:23 oss unix: [ID 950921 kern.info] cpu5: Quad-Core AMD Opteron(tm) Processor 2374 HE Dec 4 22:57:23 oss unix: [ID 517869 kern.info] NOTICE: cpu_acpi: _PSS package not found. Dec 4 22:57:23 oss unix: [ID 388705 kern.warning] WARNING: cpu_acpi: error parsing _PSS for CPU 5 Dec 4 22:57:23 oss unix: [ID 196753 kern.warning] WARNING: cpupm_init: processor 5: unable to initialize P-state support Dec 4 22:57:23 oss unix: [ID 557827 kern.info] cpu5 initialization complete - online Dec 4 22:57:23 oss unix: [ID 950921 kern.info] cpu6: x86 (chipid 0x1 AuthenticAMD 100F42 family 16 model 4 step 2 clock 2211 MHz) Dec 4 22:57:23 oss unix: [ID 950921 kern.info] cpu6: Quad-Core AMD Opteron(tm) Processor 2374 HE Dec 4 22:57:23 oss unix: [ID 517869 kern.info] NOTICE: cpu_acpi: _PSS package not found. Dec 4 22:57:23 oss unix: [ID 388705 kern.warning] WARNING: cpu_acpi: error parsing _PSS for CPU 6 Dec 4 22:57:23 oss unix: [ID 196753 kern.warning] WARNING: cpupm_init: processor 6: unable to initialize P-state support Dec 4 22:57:23 oss unix: [ID 557827 kern.info] cpu6 initialization complete - online Dec 4 22:57:23 oss unix: [ID 950921 kern.info] cpu7: x86 (chipid 0x1 AuthenticAMD 100F42 family 16 model 4 step 2 clock 2211 MHz) Dec 4 22:57:23 oss unix: [ID 950921 kern.info] cpu7: Quad-Core AMD Opteron(tm) Processor 2374 HE Dec 4 22:57:23 oss unix: [ID 517869 kern.info] NOTICE: cpu_acpi: _PSS package not found. Dec 4 22:57:23 oss unix: [ID 388705 kern.warning] WARNING: cpu_acpi: error parsing _PSS for CPU 7 Dec 4 22:57:23 oss unix: [ID 196753 kern.warning] WARNING: cpupm_init: processor 7: unable to initialize P-state support Dec 4 22:57:23 oss unix: [ID 557827 kern.info] cpu7 initialization complete - online Dec 4 22:57:24 oss pcie_pci: [ID 586369 kern.info] PCIE-device: pci1033,125 at 0,1, pcie_pci5 Dec 4 22:57:24 oss genunix: [ID 936769 kern.info] pcie_pci5 is /pci at 0,0/pci10de,376 at a/pci1033,125 at 0,1 Dec 4 22:57:24 oss usba: [ID 912658 kern.info] USB 1.10 device (usb4b3,3025) operating at low speed (USB 1.x) on USB 1.10 root hub: keyboard at 1, hid2 at bus address 2 Dec 4 22:57:24 oss usba: [ID 349649 kern.info] CHICONY USB NetVista Full Width Keyboard Dec 4 22:57:24 oss genunix: [ID 936769 kern.info] hid2 is /pci at 0,0/pci15d9,1611 at 2/keyboard at 1 Dec 4 22:57:24 oss genunix: [ID 408114 kern.info] /pci at 0,0/pci15d9,1611 at 2/keyboard at 1 (hid2) online Dec 4 22:57:24 oss usba: [ID 912658 kern.info] USB 2.0 device (usb4b3,310d) operating at low speed (USB 1.x) on USB 1.10 root hub: mouse at 2, hid3 at bus address 3 Dec 4 22:57:24 oss genunix: [ID 936769 kern.info] hid3 is /pci at 0,0/pci15d9,1611 at 2/mouse at 2 Dec 4 22:57:24 oss genunix: [ID 408114 kern.info] /pci at 0,0/pci15d9,1611 at 2/mouse at 2 (hid3) online Dec 4 22:57:24 oss pseudo: [ID 129642 kern.info] pseudo-device: stmf_sbd0 Dec 4 22:57:24 oss genunix: [ID 936769 kern.info] stmf_sbd0 is /pseudo/stmf_sbd at 0 Dec 4 22:57:28 oss mac: [ID 469746 kern.info] NOTICE: e1000g0 registered Dec 4 22:57:28 oss pcplusmp: [ID 805372 kern.info] pcplusmp: pci8086,1079 (e1000g) instance 0 irq 0x10 vector 0x60 ioapic 0x8 intin 0x10 is bound to cpu 1 Dec 4 22:57:28 oss e1000g: [ID 766679 kern.info] Intel(R) PRO/1000 Network Connection, Driver Ver. 5.3.8 Dec 4 22:57:28 oss nge: [ID 801725 kern.info] NOTICE: nge0: Using FIXED interrupt type Dec 4 22:57:29 oss pcplusmp: [ID 805372 kern.info] pcplusmp: pci10de,373 (nge) instance 0 irq 0x14 vector 0x61 ioapic 0x8 intin 0x14 is bound to cpu 2 Dec 4 22:57:29 oss mac: [ID 469746 kern.info] NOTICE: nge0 registered Dec 4 22:57:30 oss mac: [ID 469746 kern.info] NOTICE: aggr1000 registered Dec 4 22:57:30 oss mac: [ID 469746 kern.info] NOTICE: e1000g1 registered Dec 4 22:57:30 oss pcplusmp: [ID 805372 kern.info] pcplusmp: pci8086,1079 (e1000g) instance 1 irq 0x11 vector 0x62 ioapic 0x8 intin 0x11 is bound to cpu 3 Dec 4 22:57:30 oss e1000g: [ID 766679 kern.info] Intel(R) PRO/1000 Network Connection, Driver Ver. 5.3.8 Dec 4 22:57:31 oss mac: [ID 435574 kern.info] NOTICE: e1000g0 link up, 1000 Mbps, full duplex Dec 4 22:57:31 oss mac: [ID 435574 kern.info] NOTICE: aggr1000 link up, 1000 Mbps, full duplex Dec 4 22:57:31 oss mac: [ID 469746 kern.info] NOTICE: e1000g2 registered Dec 4 22:57:31 oss e1000g: [ID 766679 kern.info] Intel(R) PRO/1000 Network Connection, Driver Ver. 5.3.8 Dec 4 22:57:31 oss mac: [ID 469746 kern.info] NOTICE: e1000g3 registered Dec 4 22:57:31 oss pcplusmp: [ID 805372 kern.info] pcplusmp: pci8086,1079 (e1000g) instance 3 irq 0x12 vector 0x63 ioapic 0x8 intin 0x12 is bound to cpu 4 Dec 4 22:57:31 oss e1000g: [ID 766679 kern.info] Intel(R) PRO/1000 Network Connection, Driver Ver. 5.3.8 Dec 4 22:57:31 oss nge: [ID 801725 kern.info] NOTICE: nge1: Using FIXED interrupt type Dec 4 22:57:32 oss mac: [ID 435574 kern.info] NOTICE: nge0 link up, 1000 Mbps, full duplex Dec 4 22:57:32 oss mac: [ID 469746 kern.info] NOTICE: nge1 registered Dec 4 22:57:33 oss pseudo: [ID 129642 kern.info] pseudo-device: devinfo0 Dec 4 22:57:33 oss genunix: [ID 936769 kern.info] devinfo0 is /pseudo/devinfo at 0 Dec 4 22:57:33 oss pseudo: [ID 129642 kern.info] pseudo-device: pseudo1 Dec 4 22:57:33 oss genunix: [ID 936769 kern.info] pseudo1 is /pseudo/zconsnex at 1 Dec 4 22:57:33 oss mac: [ID 435574 kern.info] NOTICE: e1000g1 link up, 1000 Mbps, full duplex Dec 4 22:57:34 oss pseudo: [ID 129642 kern.info] pseudo-device: zfs0 Dec 4 22:57:34 oss genunix: [ID 936769 kern.info] zfs0 is /pseudo/zfs at 0 Dec 4 22:57:34 oss mac: [ID 435574 kern.info] NOTICE: e1000g2 link up, 1000 Mbps, full duplex Dec 4 22:57:34 oss mac: [ID 435574 kern.info] NOTICE: e1000g3 link up, 1000 Mbps, full duplex Dec 4 22:57:35 oss mac: [ID 435574 kern.info] NOTICE: nge1 link up, 1000 Mbps, full duplex Dec 4 22:57:38 oss rootnex: [ID 349649 kern.info] iscsi0 at root Dec 4 22:57:38 oss genunix: [ID 936769 kern.info] iscsi0 is /iscsi Dec 4 22:57:38 oss rootnex: [ID 349649 kern.info] xsvc0 at root: space 0 offset 0 Dec 4 22:57:38 oss genunix: [ID 936769 kern.info] xsvc0 is /xsvc at 0,0 Dec 4 22:57:38 oss pcplusmp: [ID 805372 kern.info] pcplusmp: ide (ata) instance 1 irq 0xf vector 0x40 ioapic 0x8 intin 0xf is bound to cpu 5 Dec 4 22:57:38 oss isa: [ID 202937 kern.info] ISA-device: pit_beep0 Dec 4 22:57:38 oss genunix: [ID 936769 kern.info] pit_beep0 is /isa/pit_beep Dec 4 22:57:38 oss pseudo: [ID 129642 kern.info] pseudo-device: llc10 Dec 4 22:57:38 oss genunix: [ID 936769 kern.info] llc10 is /pseudo/llc1 at 0 Dec 4 22:57:39 oss pseudo: [ID 129642 kern.info] pseudo-device: fcp0 Dec 4 22:57:39 oss genunix: [ID 936769 kern.info] fcp0 is /pseudo/fcp at 0 Dec 4 22:57:39 oss pseudo: [ID 129642 kern.info] pseudo-device: ramdisk1024 Dec 4 22:57:39 oss genunix: [ID 936769 kern.info] ramdisk1024 is /pseudo/ramdisk at 1024 Dec 4 22:57:39 oss pseudo: [ID 129642 kern.info] pseudo-device: fcsm0 Dec 4 22:57:39 oss genunix: [ID 936769 kern.info] fcsm0 is /pseudo/fcsm at 0 Dec 4 22:57:39 oss pseudo: [ID 129642 kern.info] pseudo-device: lockstat0 Dec 4 22:57:39 oss genunix: [ID 936769 kern.info] lockstat0 is /pseudo/lockstat at 0 Dec 4 22:57:39 oss pseudo: [ID 129642 kern.info] pseudo-device: lofi0 Dec 4 22:57:39 oss genunix: [ID 936769 kern.info] lofi0 is /pseudo/lofi at 0 Dec 4 22:57:39 oss pseudo: [ID 129642 kern.info] pseudo-device: profile0 Dec 4 22:57:39 oss genunix: [ID 936769 kern.info] profile0 is /pseudo/profile at 0 Dec 4 22:57:39 oss pseudo: [ID 129642 kern.info] pseudo-device: systrace0 Dec 4 22:57:39 oss genunix: [ID 936769 kern.info] systrace0 is /pseudo/systrace at 0 Dec 4 22:57:39 oss pseudo: [ID 129642 kern.info] pseudo-device: fbt0 Dec 4 22:57:39 oss genunix: [ID 936769 kern.info] fbt0 is /pseudo/fbt at 0 Dec 4 22:57:39 oss pseudo: [ID 129642 kern.info] pseudo-device: sdt0 Dec 4 22:57:39 oss genunix: [ID 936769 kern.info] sdt0 is /pseudo/sdt at 0 Dec 4 22:57:39 oss pseudo: [ID 129642 kern.info] pseudo-device: fasttrap0 Dec 4 22:57:39 oss genunix: [ID 936769 kern.info] fasttrap0 is /pseudo/fasttrap at 0 Dec 4 22:57:39 oss pseudo: [ID 129642 kern.info] pseudo-device: power0 Dec 4 22:57:39 oss genunix: [ID 936769 kern.info] power0 is /pseudo/power at 0 Dec 4 22:57:39 oss pseudo: [ID 129642 kern.info] pseudo-device: srn0 Dec 4 22:57:39 oss genunix: [ID 936769 kern.info] srn0 is /pseudo/srn at 0 Dec 4 22:57:39 oss pseudo: [ID 129642 kern.info] pseudo-device: dcpc0 Dec 4 22:57:39 oss genunix: [ID 936769 kern.info] dcpc0 is /pseudo/dcpc at 0 Dec 4 22:57:39 oss pseudo: [ID 129642 kern.info] pseudo-device: ucode0 Dec 4 22:57:39 oss genunix: [ID 936769 kern.info] ucode0 is /pseudo/ucode at 0 Dec 4 22:57:39 oss pseudo: [ID 129642 kern.info] pseudo-device: nvidia255 Dec 4 22:57:39 oss genunix: [ID 936769 kern.info] nvidia255 is /pseudo/nvidia at 255 Dec 4 22:57:39 oss pseudo: [ID 129642 kern.info] pseudo-device: fssnap0 Dec 4 22:57:39 oss genunix: [ID 936769 kern.info] fssnap0 is /pseudo/fssnap at 0 Dec 4 22:57:39 oss pseudo: [ID 129642 kern.info] pseudo-device: winlock0 Dec 4 22:57:39 oss genunix: [ID 936769 kern.info] winlock0 is /pseudo/winlock at 0 Dec 4 22:57:39 oss pseudo: [ID 129642 kern.info] pseudo-device: pm0 Dec 4 22:57:39 oss genunix: [ID 936769 kern.info] pm0 is /pseudo/pm at 0 Dec 4 22:57:39 oss pseudo: [ID 129642 kern.info] pseudo-device: nsmb0 Dec 4 22:57:39 oss genunix: [ID 936769 kern.info] nsmb0 is /pseudo/nsmb at 0 Dec 4 22:57:40 oss pseudo: [ID 129642 kern.info] pseudo-device: pool0 Dec 4 22:57:40 oss genunix: [ID 936769 kern.info] pool0 is /pseudo/pool at 0 Dec 4 22:57:40 oss ipf: [ID 774698 kern.info] IP Filter: v4.1.9, running. Dec 4 22:57:40 oss pseudo: [ID 129642 kern.info] pseudo-device: lx_systrace0 Dec 4 22:57:40 oss genunix: [ID 936769 kern.info] lx_systrace0 is /pseudo/lx_systrace at 0 Dec 4 22:57:40 oss pseudo: [ID 129642 kern.info] pseudo-device: ii0 Dec 4 22:57:40 oss genunix: [ID 936769 kern.info] ii0 is /pseudo/ii at 0 Dec 4 22:57:40 oss pseudo: [ID 129642 kern.info] pseudo-device: sdbc0 Dec 4 22:57:40 oss genunix: [ID 936769 kern.info] sdbc0 is /pseudo/sdbc at 0 Dec 4 22:57:40 oss sv: [ID 443358 kern.info] sv Apr 8 2009 16:56:35 (revision 11.11, SunOS 5.11, None) Dec 4 22:57:40 oss pseudo: [ID 129642 kern.info] pseudo-device: sv0 Dec 4 22:57:40 oss genunix: [ID 936769 kern.info] sv0 is /pseudo/sv at 0 Dec 4 22:57:40 oss rdc: [ID 517869 kern.info] @(#) rdc: built 16:56:45 Apr 8 2009 Dec 4 22:57:40 oss pseudo: [ID 129642 kern.info] pseudo-device: rdc0 Dec 4 22:57:40 oss genunix: [ID 936769 kern.info] rdc0 is /pseudo/rdc at 0 Dec 4 22:57:40 oss pcplusmp: [ID 805372 kern.info] pcplusmp: ide (ata) instance 1 irq 0xf vector 0x40 ioapic 0x8 intin 0xf is bound to cpu 6 Dec 4 22:57:43 oss pcplusmp: [ID 805372 kern.info] pcplusmp: ide (ata) instance 1 irq 0xf vector 0x40 ioapic 0x8 intin 0xf is bound to cpu 7 Dec 4 22:57:43 oss pcplusmp: [ID 805372 kern.info] pcplusmp: ide (ata) instance 1 irq 0xf vector 0x40 ioapic 0x8 intin 0xf is bound to cpu 0 Dec 4 22:57:43 oss genunix: [ID 454863 kern.info] dump on /dev/zvol/dsk/rpool/dump size 8191 MB Dec 4 22:57:45 oss genunix: [ID 314293 kern.info] device pciclass,030000 at 5(display#0) keeps up device sd at 1,0(sd#3), but the latter is not power managed Dec 4 22:57:45 oss /usr/lib/power/powerd: [ID 387247 daemon.error] Able to open /dev/srn Dec 4 22:57:47 oss picld[181]: [ID 537930 daemon.error] SUNW_piclmemcfg init mc failed! Dec 4 22:57:47 oss ntpdate[217]: [ID 558275 daemon.notice] adjust time server 192.168.1.4 offset -0.073290 sec Dec 4 22:57:47 oss xntpd[228]: [ID 702911 daemon.notice] xntpd 3-5.93e+sun 03/08/29 16:23:05 (1.4) Dec 4 22:57:47 oss xntpd[228]: [ID 301315 daemon.notice] tickadj = 5, tick = 10000, tvu_maxslew = 495, est. hz = 100 Dec 4 22:57:47 oss xntpd[228]: [ID 266339 daemon.notice] using kernel phase-lock loop 0041, drift correction 0.00000 Dec 4 22:57:51 oss pseudo: [ID 129642 kern.info] pseudo-device: stmf0 Dec 4 22:57:51 oss genunix: [ID 936769 kern.info] stmf0 is /pseudo/stmf at 0 Dec 4 22:57:53 oss pcplusmp: [ID 805372 kern.info] pcplusmp: asy (asy) instance 0 irq 0x4 vector 0xb0 ioapic 0x8 intin 0x4 is bound to cpu 1 Dec 4 22:57:53 oss isa: [ID 202937 kern.info] ISA-device: asy0 Dec 4 22:57:53 oss genunix: [ID 936769 kern.info] asy0 is /isa/asy at 1,3f8 Dec 4 22:57:53 oss pcplusmp: [ID 805372 kern.info] pcplusmp: asy (asy) instance 1 irq 0x3 vector 0xb1 ioapic 0x8 intin 0x3 is bound to cpu 2 Dec 4 22:57:53 oss isa: [ID 202937 kern.info] ISA-device: asy1 Dec 4 22:57:53 oss genunix: [ID 936769 kern.info] asy1 is /isa/asy at 1,2f8 Dec 4 22:57:54 oss pcplusmp: [ID 805372 kern.info] pcplusmp: ide (ata) instance 1 irq 0xf vector 0x40 ioapic 0x8 intin 0xf is bound to cpu 3 Dec 4 22:57:54 oss pseudo: [ID 129642 kern.info] pseudo-device: dtrace0 Dec 4 22:57:54 oss genunix: [ID 936769 kern.info] dtrace0 is /pseudo/dtrace at 0 Dec 4 22:57:54 oss pseudo: [ID 129642 kern.info] pseudo-device: fct0 Dec 4 22:57:54 oss genunix: [ID 936769 kern.info] fct0 is /pseudo/fct at 0 Dec 4 22:57:54 oss pseudo: [ID 129642 kern.info] pseudo-device: ncall0 Dec 4 22:57:54 oss genunix: [ID 936769 kern.info] ncall0 is /pseudo/ncall at 0 Dec 4 22:57:54 oss pseudo: [ID 129642 kern.info] pseudo-device: nsctl0 Dec 4 22:57:54 oss genunix: [ID 936769 kern.info] nsctl0 is /pseudo/nsctl at 0 Dec 4 22:57:54 oss pseudo: [ID 129642 kern.info] pseudo-device: nsctl0 Dec 4 22:57:54 oss genunix: [ID 936769 kern.info] nsctl0 is /pseudo/nsctl at 0 Dec 4 22:58:01 oss pseudo: [ID 129642 kern.info] pseudo-device: devinfo0 Dec 4 22:58:01 oss genunix: [ID 936769 kern.info] devinfo0 is /pseudo/devinfo at 0 -- This message posted from opensolaris.org
Richard Elling
2009-Dec-07 01:24 UTC
[zfs-discuss] OpenSolaris 2009.06 ZFS - COMSTAR iSCSI - NFS Reboot Issue
On Dec 6, 2009, at 1:17 PM, Amos Deering wrote:> I have recently become aware of the capabilities of OpenSolaris, and > am attempting to setup a Storage Box to give a combination of CIFS > and iSCSI and/or NFS. > > I have seemingly succsessfully been able to configure a zfs iscsi > share via iscsitgt, yet the performance is just not up to par, so I > decided to move on to trying out comstar without to much testing of > the configuration. > > I setup comstar with tpg to limit iscsi traffic to my dedicated > storage network nics. I initally was attempting connection with my > Citrix Xenserver 5 server. When I would attempt to write data to the > LUN it would reboot my OpenSolaris storage server. > > Then I removed the tpg from the target and was able to transfer 30GB > or so of a VM to the LUN with great performance. I ran that VM for 2 > days, then decided to transfer another VM to the LUN. It started to > transfer then it rebooted my OpenSolaris storage server again. I > disconnected the Xenserver and destroyed the Xenserver SR. I then > connected my MS initiator on my windows box, and attempted to > transfer 40GB of data and it also rebooted my OpenSolaris storage > server. > > Under the assumption that maybe comstar was the issue, I decided to > try NFS. I setup a small 5GB NFS vol. I was not able to establish a > connection. So I anon=0 the NFS vol. Then I was able to attach it to > my Xenserver. I attempted to copy a VM and it started to write then > the OpenSolaris storage server rebooted. > > Does anyone have any insight, knowledge of a useful system log. As > of now I have not had the OpenSolaris server reboot when > transferring data to the CIFS share.Look for the panic string in /var/adm/messages* Hint: these messages are written by syslogd, so when you go to a machine that uses syslogd, you can discern the location of the log files by looking at the /etc/syslog.conf file. Look for a matching bug at http://bugs.opensolaris.org Others have reported that COMSTAR is kinda flaky prior to b114. If you do not want to upgrade to the dev builds, then be aware that good iSCSI performance for 2009.06 is predicated by the client enabling the write cache. -- richard