thr3ads.net - Xen users - [Xen-users] Infiniband with Xen 3.0.3 [Aug 2008]

If this information is useful, please help other people find it:
Share via:

nathan@robotics.net

2008-Aug-03 04:58 UTC

[Xen-users] Infiniband with Xen 3.0.3

Running Centos 5.2 and running into major issues with infiniband. I get 
this crash error below and the card will stop passing traffic. I have 
tried a 10 gig PCI-X card as well as a 20 gig pciExpress card with the 
same problem. I have tried Google, but just found some old stuff back in 
2006, that did not look like it would help. Any ideas


Aug  2 00:28:56 xen0 kernel: ib_mthca 0000:09:00.0: Completion event for 
bogus CQ 00000000
Aug  2 00:28:56 xen0 kernel: ib_mthca 0000:09:00.0: Completion event for 
bogus CQ 00000000
Aug  2 00:28:57 xen0 kernel: irq 21: nobody cared (try booting with the 
"irqpoll" option)
Aug  2 00:28:57 xen0 kernel:
Aug  2 00:28:57 xen0 kernel: Call Trace:
Aug  2 00:28:57 xen0 kernel:  <IRQ>  [<ffffffff802b2359>] 
__report_bad_irq+0x30/0x7d
Aug  2 00:28:57 xen0 kernel:  [<ffffffff802b2590>] 
note_interrupt+0x1ea/0x22b
Aug  2 00:28:57 xen0 kernel:  [<ffffffff802b1a96>] __do_IRQ+0xbd/0x103
Aug  2 00:28:57 xen0 kernel:  [<ffffffff8028fe8f>] 
_local_bh_enable+0x61/0xc5
Aug  2 00:28:57 xen0 kernel:  [<ffffffff8026db3a>] do_IRQ+0xe7/0xf5
Aug  2 00:28:57 xen0 kernel:  [<ffffffff803a082f>] 
evtchn_do_upcall+0x86/0xe0
Aug  2 00:28:57 xen0 kernel:  [<ffffffff802608ce>] 
do_hypervisor_callback+0x1e/0x2c
Aug  2 00:28:57 xen0 kernel:  <EOI>  [<ffffffff802063aa>] 
hypercall_page+0x3aa/0x1000
Aug  2 00:28:57 xen0 kernel:  [<ffffffff802063aa>] 
hypercall_page+0x3aa/0x1000
Aug  2 00:28:57 xen0 kernel:  [<ffffffff8026f12b>] raw_safe_halt+0x84/0xa8
Aug  2 00:28:57 xen0 kernel:  [<ffffffff8026c675>] xen_idle+0x38/0x4a
Aug  2 00:28:57 xen0 kernel:  [<ffffffff8024a9bb>] cpu_idle+0x97/0xba
Aug  2 00:28:57 xen0 kernel:  [<ffffffff805f8b09>] 
start_kernel+0x21f/0x224
Aug  2 00:28:57 xen0 kernel:  [<ffffffff805f81e5>] _sinittext+0x1e5/0x1eb
Aug  2 00:28:57 xen0 kernel:
Aug  2 00:28:57 xen0 kernel: handlers:
Aug  2 00:28:57 xen0 kernel: [<ffffffff88202c7a>] 
(mthca_arbel_interrupt+0x0/0xa2 [ib_mthca])
Aug  2 00:28:57 xen0 kernel: Disabling IRQ #21


><>Nathan Stratton                                CTO, BlinkMind, Inc.
nathan at robotics.net                         nathan at blinkmind.com
http://www.robotics.net                        http://www.blinkmind.com

_______________________________________________
Xen-users mailing list
Xen-users@lists.xensource.com
http://lists.xensource.com/xen-users

Nathan Eisenberg

2008-Aug-03 06:14 UTC

head link

RE: [Xen-users] Infiniband with Xen 3.0.3

Pardon my ignorance if the answer is obvious - but why use such an old version
of the XEN codebase?  Is 3.0.3 really the latest in the Centos repositories
these days?

Thanks,
Nathan

-----Original Message-----
From: xen-users-bounces@lists.xensource.com
[mailto:xen-users-bounces@lists.xensource.com] On Behalf Of nathan@robotics.net
Sent: Saturday, August 02, 2008 9:59 PM
To: xen-users@lists.xensource.com
Subject: [Xen-users] Infiniband with Xen 3.0.3


Running Centos 5.2 and running into major issues with infiniband. I get 
this crash error below and the card will stop passing traffic. I have 
tried a 10 gig PCI-X card as well as a 20 gig pciExpress card with the 
same problem. I have tried Google, but just found some old stuff back in 
2006, that did not look like it would help. Any ideas


Aug  2 00:28:56 xen0 kernel: ib_mthca 0000:09:00.0: Completion event for 
bogus CQ 00000000
Aug  2 00:28:56 xen0 kernel: ib_mthca 0000:09:00.0: Completion event for 
bogus CQ 00000000
Aug  2 00:28:57 xen0 kernel: irq 21: nobody cared (try booting with the 
"irqpoll" option)
Aug  2 00:28:57 xen0 kernel:
Aug  2 00:28:57 xen0 kernel: Call Trace:
Aug  2 00:28:57 xen0 kernel:  <IRQ>  [<ffffffff802b2359>] 
__report_bad_irq+0x30/0x7d
Aug  2 00:28:57 xen0 kernel:  [<ffffffff802b2590>] 
note_interrupt+0x1ea/0x22b
Aug  2 00:28:57 xen0 kernel:  [<ffffffff802b1a96>] __do_IRQ+0xbd/0x103
Aug  2 00:28:57 xen0 kernel:  [<ffffffff8028fe8f>] 
_local_bh_enable+0x61/0xc5
Aug  2 00:28:57 xen0 kernel:  [<ffffffff8026db3a>] do_IRQ+0xe7/0xf5
Aug  2 00:28:57 xen0 kernel:  [<ffffffff803a082f>] 
evtchn_do_upcall+0x86/0xe0
Aug  2 00:28:57 xen0 kernel:  [<ffffffff802608ce>] 
do_hypervisor_callback+0x1e/0x2c
Aug  2 00:28:57 xen0 kernel:  <EOI>  [<ffffffff802063aa>] 
hypercall_page+0x3aa/0x1000
Aug  2 00:28:57 xen0 kernel:  [<ffffffff802063aa>] 
hypercall_page+0x3aa/0x1000
Aug  2 00:28:57 xen0 kernel:  [<ffffffff8026f12b>] raw_safe_halt+0x84/0xa8
Aug  2 00:28:57 xen0 kernel:  [<ffffffff8026c675>] xen_idle+0x38/0x4a
Aug  2 00:28:57 xen0 kernel:  [<ffffffff8024a9bb>] cpu_idle+0x97/0xba
Aug  2 00:28:57 xen0 kernel:  [<ffffffff805f8b09>] 
start_kernel+0x21f/0x224
Aug  2 00:28:57 xen0 kernel:  [<ffffffff805f81e5>] _sinittext+0x1e5/0x1eb
Aug  2 00:28:57 xen0 kernel:
Aug  2 00:28:57 xen0 kernel: handlers:
Aug  2 00:28:57 xen0 kernel: [<ffffffff88202c7a>] 
(mthca_arbel_interrupt+0x0/0xa2 [ib_mthca])
Aug  2 00:28:57 xen0 kernel: Disabling IRQ #21


><>Nathan Stratton                                CTO, BlinkMind, Inc.
nathan at robotics.net                         nathan at blinkmind.com
http://www.robotics.net                        http://www.blinkmind.com

_______________________________________________
Xen-users mailing list
Xen-users@lists.xensource.com
http://lists.xensource.com/xen-users





_______________________________________________
Xen-users mailing list
Xen-users@lists.xensource.com
http://lists.xensource.com/xen-users

nathan@robotics.net

2008-Aug-03 12:39 UTC

head link

RE: [Xen-users] Infiniband with Xen 3.0.3

On Sat, 2 Aug 2008, Nathan Eisenberg wrote:
> Pardon my ignorance if the answer is obvious - but why use such an old
version of the XEN codebase?  Is 3.0.3 really the latest in the Centos
repositories these days?
Got to love RedHat, actually I tried and upgraded to 3.2.1, did not solve 
the problem.
> -----Original Message-----
> From: xen-users-bounces@lists.xensource.com
[mailto:xen-users-bounces@lists.xensource.com] On Behalf Of nathan@robotics.net
> Sent: Saturday, August 02, 2008 9:59 PM
> To: xen-users@lists.xensource.com
> Subject: [Xen-users] Infiniband with Xen 3.0.3
>
>
> Running Centos 5.2 and running into major issues with infiniband. I get
> this crash error below and the card will stop passing traffic. I have
> tried a 10 gig PCI-X card as well as a 20 gig pciExpress card with the
> same problem. I have tried Google, but just found some old stuff back in
> 2006, that did not look like it would help. Any ideas
>
>
> Aug  2 00:28:56 xen0 kernel: ib_mthca 0000:09:00.0: Completion event for
> bogus CQ 00000000
> Aug  2 00:28:56 xen0 kernel: ib_mthca 0000:09:00.0: Completion event for
> bogus CQ 00000000
> Aug  2 00:28:57 xen0 kernel: irq 21: nobody cared (try booting with the
> "irqpoll" option)
> Aug  2 00:28:57 xen0 kernel:
> Aug  2 00:28:57 xen0 kernel: Call Trace:
> Aug  2 00:28:57 xen0 kernel:  <IRQ>  [<ffffffff802b2359>]
> __report_bad_irq+0x30/0x7d
> Aug  2 00:28:57 xen0 kernel:  [<ffffffff802b2590>]
> note_interrupt+0x1ea/0x22b
> Aug  2 00:28:57 xen0 kernel:  [<ffffffff802b1a96>]
__do_IRQ+0xbd/0x103
> Aug  2 00:28:57 xen0 kernel:  [<ffffffff8028fe8f>]
> _local_bh_enable+0x61/0xc5
> Aug  2 00:28:57 xen0 kernel:  [<ffffffff8026db3a>] do_IRQ+0xe7/0xf5
> Aug  2 00:28:57 xen0 kernel:  [<ffffffff803a082f>]
> evtchn_do_upcall+0x86/0xe0
> Aug  2 00:28:57 xen0 kernel:  [<ffffffff802608ce>]
> do_hypervisor_callback+0x1e/0x2c
> Aug  2 00:28:57 xen0 kernel:  <EOI>  [<ffffffff802063aa>]
> hypercall_page+0x3aa/0x1000
> Aug  2 00:28:57 xen0 kernel:  [<ffffffff802063aa>]
> hypercall_page+0x3aa/0x1000
> Aug  2 00:28:57 xen0 kernel:  [<ffffffff8026f12b>]
raw_safe_halt+0x84/0xa8
> Aug  2 00:28:57 xen0 kernel:  [<ffffffff8026c675>] xen_idle+0x38/0x4a
> Aug  2 00:28:57 xen0 kernel:  [<ffffffff8024a9bb>] cpu_idle+0x97/0xba
> Aug  2 00:28:57 xen0 kernel:  [<ffffffff805f8b09>]
> start_kernel+0x21f/0x224
> Aug  2 00:28:57 xen0 kernel:  [<ffffffff805f81e5>]
_sinittext+0x1e5/0x1eb
> Aug  2 00:28:57 xen0 kernel:
> Aug  2 00:28:57 xen0 kernel: handlers:
> Aug  2 00:28:57 xen0 kernel: [<ffffffff88202c7a>]
> (mthca_arbel_interrupt+0x0/0xa2 [ib_mthca])
> Aug  2 00:28:57 xen0 kernel: Disabling IRQ #21
>
>
>
>> <>
> Nathan Stratton                                CTO, BlinkMind, Inc.
> nathan at robotics.net                         nathan at blinkmind.com
> http://www.robotics.net                        http://www.blinkmind.com
>
> _______________________________________________
> Xen-users mailing list
> Xen-users@lists.xensource.com
> http://lists.xensource.com/xen-users
>
>
>
>
>
> _______________________________________________
> Xen-users mailing list
> Xen-users@lists.xensource.com
> http://lists.xensource.com/xen-users
>
_______________________________________________
Xen-users mailing list
Xen-users@lists.xensource.com
http://lists.xensource.com/xen-users

Robert Dunkley

2008-Aug-04 07:07 UTC

head link

RE: [Xen-users] Infiniband with Xen 3.0.3

What version of OFED are you running?

-----Original Message-----
From: xen-users-bounces@lists.xensource.com
[mailto:xen-users-bounces@lists.xensource.com] On Behalf Of
nathan@robotics.net
Sent: 03 August 2008 13:40
To: Nathan Eisenberg
Cc: ''xen-users''
Subject: RE: [Xen-users] Infiniband with Xen 3.0.3

On Sat, 2 Aug 2008, Nathan Eisenberg wrote:
> Pardon my ignorance if the answer is obvious - but why use such an oldversion of the XEN codebase?  Is 3.0.3 really the latest in the Centos
repositories these days?

Got to love RedHat, actually I tried and upgraded to 3.2.1, did not
solve 
the problem.
> -----Original Message-----
> From: xen-users-bounces@lists.xensource.com[mailto:xen-users-bounces@lists.xensource.com] On Behalf Of
nathan@robotics.net> Sent: Saturday, August 02, 2008 9:59 PM
> To: xen-users@lists.xensource.com
> Subject: [Xen-users] Infiniband with Xen 3.0.3
>
>
> Running Centos 5.2 and running into major issues with infiniband. I
get> this crash error below and the card will stop passing traffic. I have
> tried a 10 gig PCI-X card as well as a 20 gig pciExpress card with the
> same problem. I have tried Google, but just found some old stuff back
in> 2006, that did not look like it would help. Any ideas
>
>
> Aug  2 00:28:56 xen0 kernel: ib_mthca 0000:09:00.0: Completion event
for> bogus CQ 00000000
> Aug  2 00:28:56 xen0 kernel: ib_mthca 0000:09:00.0: Completion event
for> bogus CQ 00000000
> Aug  2 00:28:57 xen0 kernel: irq 21: nobody cared (try booting with
the> "irqpoll" option)
> Aug  2 00:28:57 xen0 kernel:
> Aug  2 00:28:57 xen0 kernel: Call Trace:
> Aug  2 00:28:57 xen0 kernel:  <IRQ>  [<ffffffff802b2359>]
> __report_bad_irq+0x30/0x7d
> Aug  2 00:28:57 xen0 kernel:  [<ffffffff802b2590>]
> note_interrupt+0x1ea/0x22b
> Aug  2 00:28:57 xen0 kernel:  [<ffffffff802b1a96>]
__do_IRQ+0xbd/0x103
> Aug  2 00:28:57 xen0 kernel:  [<ffffffff8028fe8f>]
> _local_bh_enable+0x61/0xc5
> Aug  2 00:28:57 xen0 kernel:  [<ffffffff8026db3a>] do_IRQ+0xe7/0xf5
> Aug  2 00:28:57 xen0 kernel:  [<ffffffff803a082f>]
> evtchn_do_upcall+0x86/0xe0
> Aug  2 00:28:57 xen0 kernel:  [<ffffffff802608ce>]
> do_hypervisor_callback+0x1e/0x2c
> Aug  2 00:28:57 xen0 kernel:  <EOI>  [<ffffffff802063aa>]
> hypercall_page+0x3aa/0x1000
> Aug  2 00:28:57 xen0 kernel:  [<ffffffff802063aa>]
> hypercall_page+0x3aa/0x1000
> Aug  2 00:28:57 xen0 kernel:  [<ffffffff8026f12b>]
raw_safe_halt+0x84/0xa8> Aug  2 00:28:57 xen0 kernel:  [<ffffffff8026c675>] xen_idle+0x38/0x4a
> Aug  2 00:28:57 xen0 kernel:  [<ffffffff8024a9bb>] cpu_idle+0x97/0xba
> Aug  2 00:28:57 xen0 kernel:  [<ffffffff805f8b09>]
> start_kernel+0x21f/0x224
> Aug  2 00:28:57 xen0 kernel:  [<ffffffff805f81e5>]
_sinittext+0x1e5/0x1eb> Aug  2 00:28:57 xen0 kernel:
> Aug  2 00:28:57 xen0 kernel: handlers:
> Aug  2 00:28:57 xen0 kernel: [<ffffffff88202c7a>]
> (mthca_arbel_interrupt+0x0/0xa2 [ib_mthca])
> Aug  2 00:28:57 xen0 kernel: Disabling IRQ #21
>
>
>
>> <>
> Nathan Stratton                                CTO, BlinkMind, Inc.
> nathan at robotics.net                         nathan at blinkmind.com
> http://www.robotics.net
http://www.blinkmind.com>
> _______________________________________________
> Xen-users mailing list
> Xen-users@lists.xensource.com
> http://lists.xensource.com/xen-users
>
>
>
>
>
> _______________________________________________
> Xen-users mailing list
> Xen-users@lists.xensource.com
> http://lists.xensource.com/xen-users
>
_______________________________________________
Xen-users mailing list
Xen-users@lists.xensource.com
http://lists.xensource.com/xen-users

The SAQ Group
Registered Office: 18 Chapel Street, Petersfield, Hampshire. GU32 3DZ
SEMTEC Limited trading as SAQ is Registered in England & Wales
Company Number: 06481952

http://www.saqnet.co.uk AS29219
SAQ Group Delivers high quality, honestly priced communication and I.T. services
to UK Business.
DSL : Domains : Email : Hosting : CoLo : Servers : Racks : Transit : Backups :
Managed Networks : Remote Support.

Find us in http://www.thebestof.co.uk/petersfield


_______________________________________________
Xen-users mailing list
Xen-users@lists.xensource.com
http://lists.xensource.com/xen-users

Xen users - Aug 2008 - Infiniband with Xen 3.0.3

[Xen-users] Infiniband with Xen 3.0.3

RE: [Xen-users] Infiniband with Xen 3.0.3

RE: [Xen-users] Infiniband with Xen 3.0.3

RE: [Xen-users] Infiniband with Xen 3.0.3