CentOS 5.6 Linux 2.6.18-238.9.1.el5xen xen.x86_64 xen 3.0.3-120.el5_6.1 I have storage server connected to the xen host server via infini band iscsi iser. InfiniBand: Mellanox Technologies MT26428 [ConnectX VPI PCIe 2.0 5GT/s - IB QDR / 10GigE] (rev b0) I use openib.noarch 1.4.1-5.el5 line from lsmod: ib_core 105157 15 ib_iser,ib_srp,rds,ib_sdp,ib_ipoib,rdma_ucm,rdma_cm,ib_ucm,ib_uverbs,ib_umad,ib_cm,iw_cm,ib_sa,mlx4_ib,ib_mad some lines from dmsg: ib_srp: ASYNC event= 17 on device= mlx4_0 ib_srp: ASYNC event= 11 on device= mlx4_0 ib_srp: ASYNC event= 9 on device= mlx4_0 scsi4 : iSCSI Initiator over TCP/IP Vendor: IET Model: Controller Rev: 0001 Type: RAID ANSI SCSI revision: 05 scsi 4:0:0:0: Attached scsi generic sg2 type 12 Vendor: IET Model: VIRTUAL-DISK Rev: 0001 Type: Direct-Access ANSI SCSI revision: 05 SCSI device sdc: 20971520 512-byte hdwr sectors (10737 MB) sdc: Write Protect is off sdc: Mode Sense: 49 00 00 08 SCSI device sdc: drive cache: write back SCSI device sdc: 20971520 512-byte hdwr sectors (10737 MB) sdc: Write Protect is off sdc: Mode Sense: 49 00 00 08 SCSI device sdc: drive cache: write back sdc: sdc1 sdc2 sd 4:0:0:1: Attached scsi disk sdc sd 4:0:0:1: Attached scsi generic sg3 type 0 Vendor: IET Model: VIRTUAL-DISK Rev: 0001 Type: Direct-Access ANSI SCSI revision: 05 SCSI device sdd: 1048576000 512-byte hdwr sectors (536871 MB) sdd: Write Protect is off sdd: Mode Sense: 49 00 00 08 SCSI device sdd: drive cache: write back SCSI device sdd: 1048576000 512-byte hdwr sectors (536871 MB) sdd: Write Protect is off sdd: Mode Sense: 49 00 00 08 SCSI device sdd: drive cache: write back sdd: sdd1 sdd2 sdd3 sdd4 < sdd5 > sd 4:0:0:2: Attached scsi disk sdd sd 4:0:0:2: Attached scsi generic sg4 type 0 sdc and sdd are devices from storage server. I got several times xen host server pernel panic. RIP [<ffff885d5f04>] :ib_ser: iser_reg_rdma_mem+0x111/0x77a ... Kernel panic - no syncing: Fatal exception Here is a screen shot I took: http://margus.roo.ee/wp-content/uploads/2011/04/xen_host_crash.png -- with Margus Roo http://www.okia.ee _______________________________________________ Xen-users mailing list Xen-users@lists.xensource.com http://lists.xensource.com/xen-users
I set up xen server again. Mounted iscsi target without iser suport and the system is stable. No more kernel panics. But without iser supert iscsi target access much slower :( Tervitades, Margus (Margusja) Roo +372 51 48 780 http://margus.roo.ee msn: margusja@kodila.ee skype: margusja On 4/30/11 9:47 PM, Margus Roo wrote:> CentOS 5.6 > Linux 2.6.18-238.9.1.el5xen xen.x86_64 > xen 3.0.3-120.el5_6.1 > > I have storage server connected to the xen host server via infini band > iscsi iser. > InfiniBand: Mellanox Technologies MT26428 [ConnectX VPI PCIe 2.0 5GT/s > - IB QDR / 10GigE] (rev b0) > > I use openib.noarch 1.4.1-5.el5 > > line from lsmod: > ib_core 105157 15 > ib_iser,ib_srp,rds,ib_sdp,ib_ipoib,rdma_ucm,rdma_cm,ib_ucm,ib_uverbs,ib_umad,ib_cm,iw_cm,ib_sa,mlx4_ib,ib_mad > > some lines from dmsg: > ib_srp: ASYNC event= 17 on device= mlx4_0 > ib_srp: ASYNC event= 11 on device= mlx4_0 > ib_srp: ASYNC event= 9 on device= mlx4_0 > scsi4 : iSCSI Initiator over TCP/IP > Vendor: IET Model: Controller Rev: 0001 > Type: RAID ANSI SCSI revision: 05 > scsi 4:0:0:0: Attached scsi generic sg2 type 12 > Vendor: IET Model: VIRTUAL-DISK Rev: 0001 > Type: Direct-Access ANSI SCSI revision: 05 > SCSI device sdc: 20971520 512-byte hdwr sectors (10737 MB) > sdc: Write Protect is off > sdc: Mode Sense: 49 00 00 08 > SCSI device sdc: drive cache: write back > SCSI device sdc: 20971520 512-byte hdwr sectors (10737 MB) > sdc: Write Protect is off > sdc: Mode Sense: 49 00 00 08 > SCSI device sdc: drive cache: write back > sdc: sdc1 sdc2 > sd 4:0:0:1: Attached scsi disk sdc > sd 4:0:0:1: Attached scsi generic sg3 type 0 > Vendor: IET Model: VIRTUAL-DISK Rev: 0001 > Type: Direct-Access ANSI SCSI revision: 05 > SCSI device sdd: 1048576000 512-byte hdwr sectors (536871 MB) > sdd: Write Protect is off > sdd: Mode Sense: 49 00 00 08 > SCSI device sdd: drive cache: write back > SCSI device sdd: 1048576000 512-byte hdwr sectors (536871 MB) > sdd: Write Protect is off > sdd: Mode Sense: 49 00 00 08 > SCSI device sdd: drive cache: write back > sdd: sdd1 sdd2 sdd3 sdd4 < sdd5 > > sd 4:0:0:2: Attached scsi disk sdd > sd 4:0:0:2: Attached scsi generic sg4 type 0 > > sdc and sdd are devices from storage server. > > I got several times xen host server pernel panic. > RIP [<ffff885d5f04>] :ib_ser: iser_reg_rdma_mem+0x111/0x77a > ... > Kernel panic - no syncing: Fatal exception > > Here is a screen shot I took: > http://margus.roo.ee/wp-content/uploads/2011/04/xen_host_crash.png > > -- with > Margus Roo > http://www.okia.ee > > > _______________________________________________ > Xen-users mailing list > Xen-users@lists.xensource.com > http://lists.xensource.com/xen-users_______________________________________________ Xen-users mailing list Xen-users@lists.xensource.com http://lists.xensource.com/xen-users
Hi Margus, Have you tried upgrading to a more recent version of OFED/OpenIB? Also which initiator are you using? I suspect open-iscsi? Kind regards, Joseph. On 1 May 2011 20:25, Margusja <margus@roo.ee> wrote:> I set up xen server again. Mounted iscsi target without iser suport and the > system is stable. No more kernel panics. > But without iser supert iscsi target access much slower :( > > Tervitades, Margus (Margusja) Roo > +372 51 48 780 > http://margus.roo.ee > msn: margusja@kodila.ee > skype: margusja > > > On 4/30/11 9:47 PM, Margus Roo wrote: >> >> CentOS 5.6 >> Linux 2.6.18-238.9.1.el5xen xen.x86_64 >> xen 3.0.3-120.el5_6.1 >> >> I have storage server connected to the xen host server via infini band >> iscsi iser. >> InfiniBand: Mellanox Technologies MT26428 [ConnectX VPI PCIe 2.0 5GT/s - >> IB QDR / 10GigE] (rev b0) >> >> I use openib.noarch 1.4.1-5.el5 >> >> line from lsmod: >> ib_core 105157 15 >> ib_iser,ib_srp,rds,ib_sdp,ib_ipoib,rdma_ucm,rdma_cm,ib_ucm,ib_uverbs,ib_umad,ib_cm,iw_cm,ib_sa,mlx4_ib,ib_mad >> >> some lines from dmsg: >> ib_srp: ASYNC event= 17 on device= mlx4_0 >> ib_srp: ASYNC event= 11 on device= mlx4_0 >> ib_srp: ASYNC event= 9 on device= mlx4_0 >> scsi4 : iSCSI Initiator over TCP/IP >> Vendor: IET Model: Controller Rev: 0001 >> Type: RAID ANSI SCSI revision: 05 >> scsi 4:0:0:0: Attached scsi generic sg2 type 12 >> Vendor: IET Model: VIRTUAL-DISK Rev: 0001 >> Type: Direct-Access ANSI SCSI revision: 05 >> SCSI device sdc: 20971520 512-byte hdwr sectors (10737 MB) >> sdc: Write Protect is off >> sdc: Mode Sense: 49 00 00 08 >> SCSI device sdc: drive cache: write back >> SCSI device sdc: 20971520 512-byte hdwr sectors (10737 MB) >> sdc: Write Protect is off >> sdc: Mode Sense: 49 00 00 08 >> SCSI device sdc: drive cache: write back >> sdc: sdc1 sdc2 >> sd 4:0:0:1: Attached scsi disk sdc >> sd 4:0:0:1: Attached scsi generic sg3 type 0 >> Vendor: IET Model: VIRTUAL-DISK Rev: 0001 >> Type: Direct-Access ANSI SCSI revision: 05 >> SCSI device sdd: 1048576000 512-byte hdwr sectors (536871 MB) >> sdd: Write Protect is off >> sdd: Mode Sense: 49 00 00 08 >> SCSI device sdd: drive cache: write back >> SCSI device sdd: 1048576000 512-byte hdwr sectors (536871 MB) >> sdd: Write Protect is off >> sdd: Mode Sense: 49 00 00 08 >> SCSI device sdd: drive cache: write back >> sdd: sdd1 sdd2 sdd3 sdd4 < sdd5 > >> sd 4:0:0:2: Attached scsi disk sdd >> sd 4:0:0:2: Attached scsi generic sg4 type 0 >> >> sdc and sdd are devices from storage server. >> >> I got several times xen host server pernel panic. >> RIP [<ffff885d5f04>] :ib_ser: iser_reg_rdma_mem+0x111/0x77a >> ... >> Kernel panic - no syncing: Fatal exception >> >> Here is a screen shot I took: >> http://margus.roo.ee/wp-content/uploads/2011/04/xen_host_crash.png >> >> -- with >> Margus Roo >> http://www.okia.ee >> >> >> _______________________________________________ >> Xen-users mailing list >> Xen-users@lists.xensource.com >> http://lists.xensource.com/xen-users > > _______________________________________________ > Xen-users mailing list > Xen-users@lists.xensource.com > http://lists.xensource.com/xen-users >-- Kind regards, Joseph. Founder | Director Orion Virtualisation Solutions | www.orionvm.com.au | Phone: 1300 56 99 52 | Mobile: 0428 754 846 _______________________________________________ Xen-users mailing list Xen-users@lists.xensource.com http://lists.xensource.com/xen-users
I found, if I use newer kernel there is no that bug anymore. So I can wait newer xen-kernel form Centos-5.6 or I can compile it my own. Tervitades, Margus (Margusja) Roo +372 51 48 780 http://margus.roo.ee msn: margusja@kodila.ee skype: margusja On 5/3/11 8:29 PM, Joseph Glanville wrote:> Hi Margus, > > Have you tried upgrading to a more recent version of OFED/OpenIB? > Also which initiator are you using? I suspect open-iscsi? > > Kind regards, > Joseph. > > On 1 May 2011 20:25, Margusja<margus@roo.ee> wrote: >> I set up xen server again. Mounted iscsi target without iser suport and the >> system is stable. No more kernel panics. >> But without iser supert iscsi target access much slower :( >> >> Tervitades, Margus (Margusja) Roo >> +372 51 48 780 >> http://margus.roo.ee >> msn: margusja@kodila.ee >> skype: margusja >> >> >> On 4/30/11 9:47 PM, Margus Roo wrote: >>> CentOS 5.6 >>> Linux 2.6.18-238.9.1.el5xen xen.x86_64 >>> xen 3.0.3-120.el5_6.1 >>> >>> I have storage server connected to the xen host server via infini band >>> iscsi iser. >>> InfiniBand: Mellanox Technologies MT26428 [ConnectX VPI PCIe 2.0 5GT/s - >>> IB QDR / 10GigE] (rev b0) >>> >>> I use openib.noarch 1.4.1-5.el5 >>> >>> line from lsmod: >>> ib_core 105157 15 >>> ib_iser,ib_srp,rds,ib_sdp,ib_ipoib,rdma_ucm,rdma_cm,ib_ucm,ib_uverbs,ib_umad,ib_cm,iw_cm,ib_sa,mlx4_ib,ib_mad >>> >>> some lines from dmsg: >>> ib_srp: ASYNC event= 17 on device= mlx4_0 >>> ib_srp: ASYNC event= 11 on device= mlx4_0 >>> ib_srp: ASYNC event= 9 on device= mlx4_0 >>> scsi4 : iSCSI Initiator over TCP/IP >>> Vendor: IET Model: Controller Rev: 0001 >>> Type: RAID ANSI SCSI revision: 05 >>> scsi 4:0:0:0: Attached scsi generic sg2 type 12 >>> Vendor: IET Model: VIRTUAL-DISK Rev: 0001 >>> Type: Direct-Access ANSI SCSI revision: 05 >>> SCSI device sdc: 20971520 512-byte hdwr sectors (10737 MB) >>> sdc: Write Protect is off >>> sdc: Mode Sense: 49 00 00 08 >>> SCSI device sdc: drive cache: write back >>> SCSI device sdc: 20971520 512-byte hdwr sectors (10737 MB) >>> sdc: Write Protect is off >>> sdc: Mode Sense: 49 00 00 08 >>> SCSI device sdc: drive cache: write back >>> sdc: sdc1 sdc2 >>> sd 4:0:0:1: Attached scsi disk sdc >>> sd 4:0:0:1: Attached scsi generic sg3 type 0 >>> Vendor: IET Model: VIRTUAL-DISK Rev: 0001 >>> Type: Direct-Access ANSI SCSI revision: 05 >>> SCSI device sdd: 1048576000 512-byte hdwr sectors (536871 MB) >>> sdd: Write Protect is off >>> sdd: Mode Sense: 49 00 00 08 >>> SCSI device sdd: drive cache: write back >>> SCSI device sdd: 1048576000 512-byte hdwr sectors (536871 MB) >>> sdd: Write Protect is off >>> sdd: Mode Sense: 49 00 00 08 >>> SCSI device sdd: drive cache: write back >>> sdd: sdd1 sdd2 sdd3 sdd4< sdd5> >>> sd 4:0:0:2: Attached scsi disk sdd >>> sd 4:0:0:2: Attached scsi generic sg4 type 0 >>> >>> sdc and sdd are devices from storage server. >>> >>> I got several times xen host server pernel panic. >>> RIP [<ffff885d5f04>] :ib_ser: iser_reg_rdma_mem+0x111/0x77a >>> ... >>> Kernel panic - no syncing: Fatal exception >>> >>> Here is a screen shot I took: >>> http://margus.roo.ee/wp-content/uploads/2011/04/xen_host_crash.png >>> >>> -- with >>> Margus Roo >>> http://www.okia.ee >>> >>> >>> _______________________________________________ >>> Xen-users mailing list >>> Xen-users@lists.xensource.com >>> http://lists.xensource.com/xen-users >> _______________________________________________ >> Xen-users mailing list >> Xen-users@lists.xensource.com >> http://lists.xensource.com/xen-users >> > >_______________________________________________ Xen-users mailing list Xen-users@lists.xensource.com http://lists.xensource.com/xen-users