thr3ads.net - xen discuss - SXCE b129 Dom0 network regularly goes down.HELP ! [Dec 2009]

If this information is useful, please help other people find it:
Share via:

Alxen4

2009-Dec-24 20:59 UTC

SXCE b129 Dom0 network regularly goes down.HELP !

Never had that kind of problem...
Brand new IBM x3650,16G RAM,
Totally fresh installation of Nevada,b129,no modifications done,only enabled XVM
and created couple of DomU

Dom0 network and DomU network sit on dedicated interfaces,
Dom0 network crashes(becomes unresponsive) every 30 min ,the only way to fix it
is to reboot the server.

The funny thing is DomU network stays on,no problem,so I can access all
guests...

/var/adm/messages shows bunch of messages at the very moment of crash,but I
can''t relate any of them to the issue(even after googling)


------------------------------------

Dec 24 13:06:46 storage0 gnome-session[1153]: [ID 702911 daemon.warning]
WARNING: IceListenForConnections returned 2 non-local listeners:
inet/storage0:43894,
inet6/storage0:36702
Dec 24 13:06:46 storage0 gnome-session[1153]: [ID 702911 daemon.warning]
WARNING: Could not connect to ConsoleKit: Could not get owner of name
''org.freedeskto
p.ConsoleKit'': no such name
Dec 24 13:06:46 storage0 last message repeated 1 time
Dec 24 13:06:51 storage0 pseudo: [ID 129642 kern.info] pseudo-device: pm0
Dec 24 13:06:51 storage0 genunix: [ID 936769 kern.info] pm0 is /pseudo/pm@0
Dec 24 13:06:51 storage0 genunix: [ID 127566 kern.info] device
pciclass,030000@0(display#0) keeps up device sd@0,0(sd#0), but the former is not
power managed
Dec 24 13:11:59 storage0 mac: [ID 469746 kern.info] NOTICE: e1000g1 registered
Dec 24 13:11:59 storage0 e1000g: [ID 766679 kern.info] Intel(R) PRO/1000 Network
Connection, Driver Ver. 5.3.18


Please HELP !

Thanks a lot.
-- 
This message posted from opensolaris.org

David Edmondson

2009-Dec-29 11:16 UTC

head link

Re: SXCE b129 Dom0 network regularly goes down.HELP !

On 24 Dec 2009, at 8:59pm, Alxen4 wrote:> Brand new IBM x3650,16G RAM,
> Totally fresh installation of Nevada,b129,no modifications done,only
enabled XVM and created couple of DomU
Did you do any stability testing of the system before enabling xVM?
> Dom0 network and DomU network sit on dedicated interfaces,
Please describe this more. Do you have multiple network interfaces and only one
of them fails?
> Dom0 network crashes(becomes unresponsive) every 30 min ,the only way to
fix it is to reboot the server.
Unresponsive in what way? If you have existing connection (ssh, for example),
does it stop working, or is it only new connections?
> 
> The funny thing is DomU network stays on,no problem,so I can access all
guests...
> 
> /var/adm/messages shows bunch of messages at the very moment of crash,but I
can''t relate any of them to the issue(even after googling)
> 
> 
> ------------------------------------
> 
> Dec 24 13:06:46 storage0 gnome-session[1153]: [ID 702911 daemon.warning]
WARNING: IceListenForConnections returned 2 non-local listeners:
inet/storage0:43894,
> inet6/storage0:36702
> Dec 24 13:06:46 storage0 gnome-session[1153]: [ID 702911 daemon.warning]
WARNING: Could not connect to ConsoleKit: Could not get owner of name
''org.freedeskto
> p.ConsoleKit'': no such name
> Dec 24 13:06:46 storage0 last message repeated 1 time
> Dec 24 13:06:51 storage0 pseudo: [ID 129642 kern.info] pseudo-device: pm0
> Dec 24 13:06:51 storage0 genunix: [ID 936769 kern.info] pm0 is /pseudo/pm@0
> Dec 24 13:06:51 storage0 genunix: [ID 127566 kern.info] device
pciclass,030000@0(display#0) keeps up device sd@0,0(sd#0), but the former is not
power managed
> Dec 24 13:11:59 storage0 mac: [ID 469746 kern.info] NOTICE: e1000g1
registered
> Dec 24 13:11:59 storage0 e1000g: [ID 766679 kern.info] Intel(R) PRO/1000
Network Connection, Driver Ver. 5.3.18
> 
> 
> Please HELP !
> 
> Thanks a lot.
> -- 
> This message posted from opensolaris.org
> _______________________________________________
> xen-discuss mailing list
> xen-discuss@opensolaris.org

Alxen4

2009-Dec-29 16:17 UTC

head link

Re: SXCE b129 Dom0 network regularly goes down.HELP !

>Did you do any stability testing of the system before enabling xVM?
Well,I configured all interfaces,uploaded bunch of iso images,created zfs for
guests,everything was looking greate,no problem.I''m not sure what kind
of stability testing should I perform...
>Please describe this more. Do you have multiple network interfaces and only
one of them fails?
I have two physical interfaces connected to same LAN segment.One of them is
configured for Solaris itself with IP 192.168.81.10 and another one is bridged
with guests(Guest IP is 192.168.30.0/24)
>Unresponsive in what way? If you have existing connection (ssh, for
example), does it stop working, or is it only new connections?
I can''t ping it ,none of the protocols works(ssh,vnc....)

May be some other logs I need to take a look at ?
Thanks a lot.
-- 
This message posted from opensolaris.org

David Edmondson

2009-Dec-29 16:50 UTC

head link

Re: SXCE b129 Dom0 network regularly goes down.HELP !

On 29 Dec 2009, at 4:17pm, Alxen4 wrote:
>> Did you do any stability testing of the system before enabling xVM?
> 
> Well,I configured all interfaces,uploaded bunch of iso images,created zfs
for guests,everything was looking greate,no problem.I''m not sure what
kind of stability testing should I perform...
It was idle curiosity really. If you''d said "yes, I ran our
standard soak test for 6 weeks first" then we could probably have ruled out
any hardware problems.
>> Please describe this more. Do you have multiple network interfaces and
only one of them fails?
> 
> I have two physical interfaces connected to same LAN segment.One of them is
configured for Solaris itself with IP 192.168.81.10 and another one is bridged
with guests(Guest IP is 192.168.30.0/24)
Please provide the output of:
	- dladm show-link
	- prtconf -d
	- echo ::interrupts | mdb -k

The parameters passed to xen and the kernel at boot time (from grub''s
menu.lst) would also be interesting.

Alxen4

2009-Dec-29 17:04 UTC

head link

Re: SXCE b129 Dom0 network regularly goes down.HELP !

-bash-4.0# dladm show-link
LINK        CLASS     MTU    STATE    BRIDGE     OVER
bnx0        phys      1500   up       --         --
e1000g0     phys      1500   unknown  --         --
bnx1        phys      1500   up       --         --
e1000g1     phys      1500   unknown  --         --
xvm2_0      vnic      1500   up       --         bnx1

--------------------------------------------------------------------------------------------
-bash-4.0# prtconf -d
System Configuration:  Sun Microsystems  i86pc
Memory size: 2048 Megabytes
System Peripherals (Software Nodes):

i86xpv
    scsi_vhci, instance #0
    pci, instance #0
        pci1014,7270 (pciex8086,3406) (driver not attached)
        pci8086,3408 (pciex8086,3408), instance #0
            pci1014,3a9 (pciex14e4,1639), instance #0
            pci1014,3a9 (pciex14e4,1639), instance #1
        pci8086,3409 (pciex8086,3409) (driver not attached)
        pci8086,340a (pciex8086,340a) (driver not attached)
        pci8086,340c (pciex8086,340c), instance #3
            pci8086,125e (pciex8086,105e), instance #0
            pci8086,125e (pciex8086,105e), instance #1
        pci8086,340e (pciex8086,340e) (driver not attached)
        pci8086,3410 (pciex8086,3410) (driver not attached)
        pci8086,3425 (pciex8086,3425) (driver not attached)
        pci8086,3426 (pciex8086,3426) (driver not attached)
        pci8086,3427 (pciex8086,3427) (driver not attached)
        pci8086,3428 (pciex8086,3428) (driver not attached)
        pci8086,342e (pciex8086,342e) (driver not attached)
        pci8086,3422 (pciex8086,3422) (driver not attached)
        pci8086,3423 (pciex8086,3423), instance #0
        pci8086,3438 (pciex8086,3438) (driver not attached)
        pci8086,342f (pciex8086,342f) (driver not attached)
        pci1014,3430 (pciex8086,3430) (driver not attached)
        pci1014,3431 (pciex8086,3431) (driver not attached)
        pci1014,3432 (pciex8086,3432) (driver not attached)
        pci1014,3433 (pciex8086,3433) (driver not attached)
        pci1014,3429 (pciex8086,3429) (driver not attached)
        pci1014,342a (pciex8086,342a) (driver not attached)
        pci1014,342b (pciex8086,342b) (driver not attached)
        pci1014,342c (pciex8086,342c) (driver not attached)
        pci1014,3a37 (pciex8086,3a37), instance #0
            keyboard, instance #3
            mouse, instance #2
        pci1014,3a38 (pciex8086,3a38), instance #1
        pci1014,3a3c (pciex8086,3a3c), instance #0
        pci8086,3a40 (pciex8086,3a40), instance #6
            pci1014,394 (pciex1000,58), instance #0
                sd, instance #1
                sd, instance #2
                sd, instance #3
                sd, instance #4
                sd, instance #5
                sd, instance #6
                sd, instance #7
                sd, instance #8
        pci8086,3a48 (pciex8086,3a48), instance #7
            pci101b,452 (pciex101b,452), instance #8
                display (pci102b,530), instance #0
        pci1014,3a34 (pciex8086,3a34), instance #2
            communications, instance #1
                modem, instance #0 (driver not attached)
                data (driver not attached)
        pci1014,3a35 (pciex8086,3a35), instance #3
        pci1014,3a36 (pciex8086,3a36), instance #4
        pci1014,3a3a (pciex8086,3a3a), instance #1
        pci8086,244e (pciex8086,244e), instance #0
        isa (pciex8086,3a18), instance #0
            motherboard (driver not attached)
            asy, instance #0 (driver not attached)
            asy, instance #1 (driver not attached)
            tpm, instance #0 (driver not attached)
            pit_beep, instance #0
        pci-ide (pciex8086,3a20), instance #0
            ide, instance #0
                sd, instance #0
            ide (driver not attached)
        pci1014,3a30 (pciex8086,3a30) (driver not attached)
        pci-ide (pciex8086,3a26), instance #1
            ide (driver not attached)
            ide (driver not attached)
    ioapics (driver not attached)
        ioapic, instance #0 (driver not attached)
    used-resources (driver not attached)
    xpvd, instance #0
        xencons, instance #0 (driver not attached)
        xenbus, instance #0
        domcaps, instance #0 (driver not attached)
        balloon, instance #0
        evtchn, instance #0
        privcmd, instance #0
        xdb, instance #0
        xdb, instance #1
        xdb, instance #2
        xnb, instance #0
    iscsi, instance #0
    fcoe, instance #0
    pseudo, instance #0
    options, instance #0
    agpgart, instance #0 (driver not attached)
    xsvc, instance #0
    cpus, instance #0
        cpu (driver not attached)
        cpu (driver not attached)
        cpu (driver not attached)
        cpu (driver not attached)
        cpu (driver not attached)
        cpu (driver not attached)
        cpu (driver not attached)
        cpu (driver not attached)
-----------------------------------------------------------------------

-bash-4.0# echo ::interrupts | mdb -k
IRQ  Vect Evtchn IPL Bus    Trg Type   CPU Share APIC/INT# ISR(s)
9    0x58 4      9   PCI    Lvl Fixed  0   1     0x0/0x9   acpi_wrapper_isr
14   0x88 48     5   ISA    Edg Fixed  1   1     0x0/0xe   ata_intr
17   0xb8 12     9   PCI    Lvl Fixed  0   3     0x0/0x11  uhci_intr, uhci_intr
, ehci_intr
18   0xc0 13     9   PCI    Lvl Fixed  0   2     0x0/0x12  uhci_intr, uhci_intr
19   0xb0 11     9   PCI    Lvl Fixed  0   2     0x0/0x13  uhci_intr, ehci_intr
28   0xc8 42     6   PCI    Lvl Fixed  5   1     0x1/0x4   bnx_intr_1lvl
40   0xd0 43     6   PCI    Lvl Fixed  1   1     0x1/0x10  bnx_intr_1lvl
251  0x31 49     6   PCI    Edg MSI    0   1     -
e1000g_intr_pciexpress
252  0x29 45     6   PCI    Edg MSI    0   1     -
e1000g_intr_pciexpress
253  0xa8 10     4   PCI    Edg MSI    0   1     -         pcieb_intr_handler
254  0xa0 9      7   PCI    Edg MSI    0   1     -         pcieb_intr_handler
255  0x98 7      5   PCI    Edg MSI    0   1     -         mpt_intr
256  -    I      15  -      Edg ipi    all -     -         xc_serv
257  -    I      11  -      Edg ipi    all -     -         poke_cpu
258  -    1      15  -      Edg virq   all -     -         xen_debug_handler
259  -    T      14  -      Edg virq   all -     -         cbe_fire
260  -    I      14  -      Edg ipi    all -     -         cbe_fire
261  -    16     3   -      Edg virq   all -     -         gcpu_xpv_virq_intr
263  -    44     1   -      Edg evtchn 1   -     -         xenbus_intr
264  -    D      1   xpvd   Edg device 0   -     -         evtchn_device_upcall

---------------------------------------------------------------------------------------------

title Solaris Express Community Edition snv_129 X86
findroot (pool_rpool,0,a)
kernel$ /boot/$ISADIR/xen.gz console=vga dom0_mem=2048M dom0_vcpus_pin=false
watchdog=false
module$ /platform/i86xpv/kernel/$ISADIR/unix
/platform/i86xpv/kernel/$ISADIR/unix -B $ZFS-BOOTFS
module$ /platform/i86pc/$ISADIR/boot_archive
#---------------------END BOOTADM--------------------


Thanks.
-- 
This message posted from opensolaris.org

David Edmondson

2009-Dec-30 09:39 UTC

head link

Re: SXCE b129 Dom0 network regularly goes down.HELP !

On 29 Dec 2009, at 5:04pm, Alxen4 wrote:> -bash-4.0# dladm show-link
> LINK        CLASS     MTU    STATE    BRIDGE     OVER
> bnx0        phys      1500   up       --         --
> e1000g0     phys      1500   unknown  --         --
> bnx1        phys      1500   up       --         --
> e1000g1     phys      1500   unknown  --         --
> xvm2_0      vnic      1500   up       --         bnx1
Is there a reason that you chose to use the bnx interfaces rather than e1000g?

I''ve no experience with bnx (and it''s a closed driver, which
is always an irritation). _Lots_ of people use e1000g, meaning that
it''s both better tested and quicker to get fixed when broken.
> -bash-4.0# echo ::interrupts | mdb -k
> IRQ  Vect Evtchn IPL Bus    Trg Type   CPU Share APIC/INT# ISR(s)
> 28   0xc8 42     6   PCI    Lvl Fixed  5   1     0x1/0x4   bnx_intr_1lvl
> 40   0xd0 43     6   PCI    Lvl Fixed  1   1     0x1/0x10  bnx_intr_1lvl
Hmm - interesting that it doesn''t use MSI.

Alxen4

2009-Dec-30 18:37 UTC

head link

Re: SXCE b129 Dom0 network regularly goes down.HELP !

>Is there a reason that you chose to use the bnx interfaces rather than
e1000g?
I>''ve no experience with bnx (and it''s a closed driver,
which is always an irritation). >_Lots_ of people use e1000g, meaning that
it''s both better tested and quicker to >get fixed when broken.

Because bnx is built-in nics and e1000 is a pci-e card and we planned to take it
out to use on another server.....But if there are issues with bnx then no
problem we could use e1000g....
Do you want me try to switch to e1000g and see if the issue reoccurs ?

Thanks for your help.
-- 
This message posted from opensolaris.org

David Edmondson

2009-Dec-31 07:40 UTC

head link

Re: SXCE b129 Dom0 network regularly goes down.HELP !

On 30 Dec 2009, at 6:37pm, Alxen4 wrote:>> Is there a reason that you chose to use the bnx interfaces rather than
e1000g?
> 
> I>''ve no experience with bnx (and it''s a closed
driver, which is always an irritation). >_Lots_ of people use e1000g, meaning
that it''s both better tested and quicker to >get fixed when broken.
> 
> Because bnx is built-in nics and e1000 is a pci-e card and we planned to
take it out to use on another server.....But if there are issues with bnx then
no problem we could use e1000g....
> Do you want me try to switch to e1000g and see if the issue reoccurs ?
That would be an interesting experiment.

Bruno Sousa

2010-Feb-12 19:18 UTC

head link

Re: SXCE b129 Dom0 network regularly goes down.HELP !

Hi,

Similar problem here, but without xen involved.
My situation is the following :
 
Broken system :
Dell (R710) NOTICE: bnx1: BCM5709 device with F/W Ver5000006 is initialized.

Working systems :

Dell (R710)  NOTICE: bnx1: BCM5709 device with F/W Ver4060004 is initialized.

Dell (R410) NOTICE: bnx1: BCM5709 device with F/W Ver500000b is initialized.

In short, if the F/W of broadcom is higer than Ver500000b , in opensolaris
builds 128a, 130,131 and 132 the system after some time loses connectivity.
Searching in google it seems like the BCM5709 has several problems with
different OS, like FreeBSD, RHEL 5x, Vmware ESX 3, ESX4, so i don''t
expect to be solaris "fault".
I have seen some reports saying the disabling MSI and the managment firmware of
the broadcom helps..
I will try this option next Monday and report it back to here. Meanwhile if
someone needs access to a faulty system , please contact me and i can arrange a
remote access to it.

Bruno
-- 
This message posted from opensolaris.org

Daniel Hermans

2010-May-31 00:53 UTC

head link

Re: SXCE b129 Dom0 network regularly goes down.HELP !

Hi Bruno,
Did you get anywhere with this issue?

I see similar results with a HP Proliant with 4 x onboard BCM 5709 with F/W
Ver4060004. Driver 4.6.2

Servers have no Xen but 4 zones and are not overly busy.

now 2 out of 8 servers have just dropped off the network. symptoms seem similar
to yours:

dladm show-dev is normal
nothing useful logged (in fact nothing logged)
link lights active
switch still sees a link and has no errors
pulling cable on primary ipmp adapter (link based detection) is not
''noticed''

no ping, ssh, etc.. reboot seems the only answer
-- 
This message posted from opensolaris.org

Paul Pasika

2011-Feb-17 17:57 UTC

head link

Re: SXCE b129 Dom0 network regularly goes down.HELP !

I, too, have this same issue.  It happens about every 4-6 weeks.  Is there any
other way to pinpoint this?  This is affecting our production network!

-Paul Pasika

Sunfire X4140
~# dladm show-link
LINK        CLASS     MTU    STATE    BRIDGE     OVER
nge0        phys      1500   up       --         --
nge1        phys      1500   up       --         --
nge2        phys      1500   down     --         --
nge3        phys      1500   down     --         --
xvm1_3      vnic      1500   up       --         nge3
xvm1_0      vnic      1500   up       --         nge0
xvm1_1      vnic      1500   up       --         nge1
xvm1_2      vnic      1500   up       --         nge2
xvm6_1      vnic      1500   up       --         nge1
xvm6_3      vnic      1500   up       --         nge3
xvm6_0      vnic      1500   up       --         nge0
xvm6_2      vnic      1500   up       --         nge2
~# prtconf -d
System Configuration:  Sun Microsystems  i86pc
Memory size: 2048 Megabytes
System Peripherals (Software Nodes):

i86xpv
    scsi_vhci, instance #0
    pci, instance #0
        pci10de,cb84 (pciex10de,369) (driver not attached)
        isa (pciex10de,364), instance #1
            asy, instance #1 (driver not attached)
            motherboard (driver not attached)
            pit_beep, instance #1
        pci10de,cb84 (pciex10de,368) (driver not attached)
        pci10de,cb84 (pciex10de,36c), instance #0
            device, instance #1
                keyboard, instance #3
                mouse, instance #4
        pci10de,cb84 (pciex10de,36d), instance #0
            storage, instance #0
                disk, instance #0 (driver not attached)
            hub, instance #0
        pci10de,cb84 (pciex10de,37f), instance #0
        pci10de,cb84 (pciex10de,37f), instance #1
        pci10de,cb84 (pciex10de,37f), instance #2
        pci10de,370 (pciex10de,370), instance #0
            display (pci1a03,2000), instance #0
        pci10de,cb84 (pciex10de,373), instance #0
        pci10de,cb84 (pciex10de,373), instance #1
        pci10de,377 (pciex10de,377) (driver not attached)
        pci10de,376 (pciex10de,376) (driver not attached)
        pci10de,375 (pciex10de,375), instance #0
            pci1000,3150 (pciex1000,58), instance #0
                sd, instance #1
                sd, instance #2
                sd, instance #3
                sd, instance #4
                sd, instance #5
        pci1022,1200 (pciex1022,1200) (driver not attached)
        pci1022,1201 (pciex1022,1201) (driver not attached)
        pci1022,1202 (pciex1022,1202) (driver not attached)
        pci1022,1203 (pciex1022,1203) (driver not attached)
        pci1022,1204 (pciex1022,1204) (driver not attached)
        pci1022,1200 (pciex1022,1200) (driver not attached)
        pci1022,1201 (pciex1022,1201) (driver not attached)
        pci1022,1202 (pciex1022,1202) (driver not attached)
        pci1022,1203 (pciex1022,1203) (driver not attached)
        pci1022,1204 (pciex1022,1204) (driver not attached)
    pci, instance #1
        pci10de,cb84 (pciex10de,369) (driver not attached)
        pci10de,cb84 (pciex10de,361) (driver not attached)
        pci10de,368 (pciex10de,368) (driver not attached)
        pci10de,cb84 (pciex10de,37f), instance #3
        pci10de,cb84 (pciex10de,37f), instance #4
        pci10de,cb84 (pciex10de,37f), instance #5
        pci10de,cb84 (pciex10de,373), instance #2
        pci10de,cb84 (pciex10de,373), instance #3
        pci10de,378 (pciex10de,378) (driver not attached)
        pci10de,376 (pciex10de,376) (driver not attached)
        pci10de,377 (pciex10de,377) (driver not attached)
    used-resources (driver not attached)
    xpvd, instance #0
        xencons, instance #0 (driver not attached)
        xenbus, instance #0
        domcaps, instance #0
        balloon, instance #0
        evtchn, instance #0
        privcmd, instance #0
        xpvtap, instance #0
        xpvtap, instance #1
        xnb, instance #0
        xnb, instance #1
        xnb, instance #2
        xnb, instance #3
        xnb, instance #4
        xnb, instance #5
        xnb, instance #6
        xnb, instance #7
        xnb, instance #8
        xnb, instance #9
        xnb, instance #10
        xnb, instance #11
        xnb, instance #12
        xnb, instance #13
        xnb, instance #14
        xnb, instance #15
        xnb, instance #16
        xnb, instance #17
        xnb, instance #18
        xnb, instance #19
        xpvtap, instance #2
        xpvtap, instance #3
        xnb, instance #20
        xnb, instance #21
        xnb, instance #22
        xnb, instance #23
    pseudo, instance #0
    xsvc, instance #0
    options, instance #0
    agpgart, instance #0 (driver not attached)
    cpus, instance #0
        cpu (driver not attached)
        cpu (driver not attached)
        cpu (driver not attached)
        cpu (driver not attached)
        cpu (driver not attached)
        cpu (driver not attached)
        cpu (driver not attached)
        cpu (driver not attached)
        cpu (driver not attached)
        cpu (driver not attached)
        cpu (driver not attached)
        cpu (driver not attached)
~# echo ::interrupts | mdb -k
IRQ  Vect Evtchn IPL Bus    Trg Type   CPU Share APIC/INT# ISR(s) 
9    0x58 4      9   PCI    Lvl Fixed  0   1     0x0/0x9   acpi_wrapper_isr
20   0xa0 11     9   PCI    Lvl Fixed  0   2     0x0/0x14  mcp5x_intr, ehci_intr
21   0xa8 12     9   PCI    Lvl Fixed  0   2     0x0/0x15  mcp5x_intr, ohci_intr
22   0xb0 57     6   PCI    Lvl Fixed  4   2     0x0/0x16  mcp5x_intr, 
nge_chip_intr
23   0xb8 58     6   PCI    Lvl Fixed  5   1     0x0/0x17  nge_chip_intr
44   0xc0 65     6   PCI    Lvl Fixed  11  2     0x1/0x14  nge_chip_intr, 
nge_chip_intr
45   0xc8 62     5   PCI    Lvl Fixed  7   1     0x1/0x15  mcp5x_intr
46   0xd0 63     5   PCI    Lvl Fixed  8   1     0x1/0x16  mcp5x_intr
47   0xd8 64     5   PCI    Lvl Fixed  9   1     0x1/0x17  mcp5x_intr
253  0x98 9      5   PCI    Edg MSI    0   1     -         mpt_intr
254  0x23 8      7   PCI    Edg MSI    0   1     -         pcieb_intr_handler
255  0x22 7      7   PCI    Edg MSI    0   1     -         pcieb_intr_handler
256  -    I      15  -      Edg ipi    all -     -         xc_serv
257  -    I      11  -      Edg ipi    all -     -         poke_cpu
258  -    1      15  -      Edg virq   all -     -         xen_debug_handler
259  -    T      14  -      Edg virq   all -     -         cbe_fire
260  -    I      14  -      Edg ipi    all -     -         cbe_fire
261  -    16     3   -      Edg virq   all -     -         gcpu_xpv_virq_intr
262  -    68     5   xpvd   Edg evtchn 3   -     -         blk_intr
263  -    60     1   -      Edg evtchn 1   -     -         xenbus_intr
264  -    D      1   xpvd   Edg device 0   -     -         evtchn_device_upcall
265  -    71     6   xpvd   Edg evtchn 4   -     -         xnb_intr
266  -    72     6   xpvd   Edg evtchn 5   -     -         xnb_intr
267  -    73     5   xpvd   Edg evtchn 9   -     -         blk_intr
268  -    74     5   xpvd   Edg evtchn 10  -     -         blk_intr
269  -    75     6   xpvd   Edg evtchn 8   -     -         xnb_intr
270  -    76     6   xpvd   Edg evtchn 9   -     -         xnb_intr
271  -    77     6   xpvd   Edg evtchn 11  -     -         xnb_intr
272  -    78     6   xpvd   Edg evtchn 0   -     -         xnb_intr
273  -    79     6   xpvd   Edg evtchn 1   -     -         xnb_intr
274  -    80     6   xpvd   Edg evtchn 2   -     -         xnb_intr
275  -    81     5   xpvd   Edg evtchn 2   -     -         blk_intr
-- 
This message posted from opensolaris.org

Dustin Marquess

2011-Feb-18 16:42 UTC

head link

Re: SXCE b129 Dom0 network regularly goes down.HELP !

I believe xVM was EOL''d to be replaced by Oracle VM, so the chances of
anything in it getting fixed is slim to none.

-Dustin

On Thu, Feb 17, 2011 at 9:57 AM, Paul Pasika <no-reply@opensolaris.org>
wrote:> I, too, have this same issue.  It happens about every 4-6 weeks.  Is there
any other way to pinpoint this?  This is affecting our production network!
>
> -Paul Pasika
>
> Sunfire X4140
> ~# dladm show-link
> LINK        CLASS     MTU    STATE    BRIDGE     OVER
> nge0        phys      1500   up       --         --
> nge1        phys      1500   up       --         --
> nge2        phys      1500   down     --         --
> nge3        phys      1500   down     --         --
> xvm1_3      vnic      1500   up       --         nge3
> xvm1_0      vnic      1500   up       --         nge0
> xvm1_1      vnic      1500   up       --         nge1
> xvm1_2      vnic      1500   up       --         nge2
> xvm6_1      vnic      1500   up       --         nge1
> xvm6_3      vnic      1500   up       --         nge3
> xvm6_0      vnic      1500   up       --         nge0
> xvm6_2      vnic      1500   up       --         nge2
> ~# prtconf -d
> System Configuration:  Sun Microsystems  i86pc
> Memory size: 2048 Megabytes
> System Peripherals (Software Nodes):
>
> i86xpv
>    scsi_vhci, instance #0
>    pci, instance #0
>        pci10de,cb84 (pciex10de,369) (driver not attached)
>        isa (pciex10de,364), instance #1
>            asy, instance #1 (driver not attached)
>            motherboard (driver not attached)
>            pit_beep, instance #1
>        pci10de,cb84 (pciex10de,368) (driver not attached)
>        pci10de,cb84 (pciex10de,36c), instance #0
>            device, instance #1
>                keyboard, instance #3
>                mouse, instance #4
>        pci10de,cb84 (pciex10de,36d), instance #0
>            storage, instance #0
>                disk, instance #0 (driver not attached)
>            hub, instance #0
>        pci10de,cb84 (pciex10de,37f), instance #0
>        pci10de,cb84 (pciex10de,37f), instance #1
>        pci10de,cb84 (pciex10de,37f), instance #2
>        pci10de,370 (pciex10de,370), instance #0
>            display (pci1a03,2000), instance #0
>        pci10de,cb84 (pciex10de,373), instance #0
>        pci10de,cb84 (pciex10de,373), instance #1
>        pci10de,377 (pciex10de,377) (driver not attached)
>        pci10de,376 (pciex10de,376) (driver not attached)
>        pci10de,375 (pciex10de,375), instance #0
>            pci1000,3150 (pciex1000,58), instance #0
>                sd, instance #1
>                sd, instance #2
>                sd, instance #3
>                sd, instance #4
>                sd, instance #5
>        pci1022,1200 (pciex1022,1200) (driver not attached)
>        pci1022,1201 (pciex1022,1201) (driver not attached)
>        pci1022,1202 (pciex1022,1202) (driver not attached)
>        pci1022,1203 (pciex1022,1203) (driver not attached)
>        pci1022,1204 (pciex1022,1204) (driver not attached)
>        pci1022,1200 (pciex1022,1200) (driver not attached)
>        pci1022,1201 (pciex1022,1201) (driver not attached)
>        pci1022,1202 (pciex1022,1202) (driver not attached)
>        pci1022,1203 (pciex1022,1203) (driver not attached)
>        pci1022,1204 (pciex1022,1204) (driver not attached)
>    pci, instance #1
>        pci10de,cb84 (pciex10de,369) (driver not attached)
>        pci10de,cb84 (pciex10de,361) (driver not attached)
>        pci10de,368 (pciex10de,368) (driver not attached)
>        pci10de,cb84 (pciex10de,37f), instance #3
>        pci10de,cb84 (pciex10de,37f), instance #4
>        pci10de,cb84 (pciex10de,37f), instance #5
>        pci10de,cb84 (pciex10de,373), instance #2
>        pci10de,cb84 (pciex10de,373), instance #3
>        pci10de,378 (pciex10de,378) (driver not attached)
>        pci10de,376 (pciex10de,376) (driver not attached)
>        pci10de,377 (pciex10de,377) (driver not attached)
>    used-resources (driver not attached)
>    xpvd, instance #0
>        xencons, instance #0 (driver not attached)
>        xenbus, instance #0
>        domcaps, instance #0
>        balloon, instance #0
>        evtchn, instance #0
>        privcmd, instance #0
>        xpvtap, instance #0
>        xpvtap, instance #1
>        xnb, instance #0
>        xnb, instance #1
>        xnb, instance #2
>        xnb, instance #3
>        xnb, instance #4
>        xnb, instance #5
>        xnb, instance #6
>        xnb, instance #7
>        xnb, instance #8
>        xnb, instance #9
>        xnb, instance #10
>        xnb, instance #11
>        xnb, instance #12
>        xnb, instance #13
>        xnb, instance #14
>        xnb, instance #15
>        xnb, instance #16
>        xnb, instance #17
>        xnb, instance #18
>        xnb, instance #19
>        xpvtap, instance #2
>        xpvtap, instance #3
>        xnb, instance #20
>        xnb, instance #21
>        xnb, instance #22
>        xnb, instance #23
>    pseudo, instance #0
>    xsvc, instance #0
>    options, instance #0
>    agpgart, instance #0 (driver not attached)
>    cpus, instance #0
>        cpu (driver not attached)
>        cpu (driver not attached)
>        cpu (driver not attached)
>        cpu (driver not attached)
>        cpu (driver not attached)
>        cpu (driver not attached)
>        cpu (driver not attached)
>        cpu (driver not attached)
>        cpu (driver not attached)
>        cpu (driver not attached)
>        cpu (driver not attached)
>        cpu (driver not attached)
> ~# echo ::interrupts | mdb -k
> IRQ  Vect Evtchn IPL Bus    Trg Type   CPU Share APIC/INT# ISR(s)
> 9    0x58 4      9   PCI    Lvl Fixed  0   1     0x0/0x9   acpi_wrapper_isr
> 20   0xa0 11     9   PCI    Lvl Fixed  0   2     0x0/0x14  mcp5x_intr,
ehci_intr
> 21   0xa8 12     9   PCI    Lvl Fixed  0   2     0x0/0x15  mcp5x_intr,
ohci_intr
> 22   0xb0 57     6   PCI    Lvl Fixed  4   2     0x0/0x16  mcp5x_intr,
> nge_chip_intr
> 23   0xb8 58     6   PCI    Lvl Fixed  5   1     0x0/0x17  nge_chip_intr
> 44   0xc0 65     6   PCI    Lvl Fixed  11  2     0x1/0x14  nge_chip_intr,
> nge_chip_intr
> 45   0xc8 62     5   PCI    Lvl Fixed  7   1     0x1/0x15  mcp5x_intr
> 46   0xd0 63     5   PCI    Lvl Fixed  8   1     0x1/0x16  mcp5x_intr
> 47   0xd8 64     5   PCI    Lvl Fixed  9   1     0x1/0x17  mcp5x_intr
> 253  0x98 9      5   PCI    Edg MSI    0   1     -         mpt_intr
> 254  0x23 8      7   PCI    Edg MSI    0   1     -        
pcieb_intr_handler
> 255  0x22 7      7   PCI    Edg MSI    0   1     -        
pcieb_intr_handler
> 256  -    I      15  -      Edg ipi    all -     -         xc_serv
> 257  -    I      11  -      Edg ipi    all -     -         poke_cpu
> 258  -    1      15  -      Edg virq   all -     -        
xen_debug_handler
> 259  -    T      14  -      Edg virq   all -     -         cbe_fire
> 260  -    I      14  -      Edg ipi    all -     -         cbe_fire
> 261  -    16     3   -      Edg virq   all -     -        
gcpu_xpv_virq_intr
> 262  -    68     5   xpvd   Edg evtchn 3   -     -         blk_intr
> 263  -    60     1   -      Edg evtchn 1   -     -         xenbus_intr
> 264  -    D      1   xpvd   Edg device 0   -     -        
evtchn_device_upcall
> 265  -    71     6   xpvd   Edg evtchn 4   -     -         xnb_intr
> 266  -    72     6   xpvd   Edg evtchn 5   -     -         xnb_intr
> 267  -    73     5   xpvd   Edg evtchn 9   -     -         blk_intr
> 268  -    74     5   xpvd   Edg evtchn 10  -     -         blk_intr
> 269  -    75     6   xpvd   Edg evtchn 8   -     -         xnb_intr
> 270  -    76     6   xpvd   Edg evtchn 9   -     -         xnb_intr
> 271  -    77     6   xpvd   Edg evtchn 11  -     -         xnb_intr
> 272  -    78     6   xpvd   Edg evtchn 0   -     -         xnb_intr
> 273  -    79     6   xpvd   Edg evtchn 1   -     -         xnb_intr
> 274  -    80     6   xpvd   Edg evtchn 2   -     -         xnb_intr
> 275  -    81     5   xpvd   Edg evtchn 2   -     -         blk_intr
> --
> This message posted from opensolaris.org
> _______________________________________________
> xen-discuss mailing list
> xen-discuss@opensolaris.org
>

Paul Pasika

2011-Feb-18 17:06 UTC

head link

Re: SXCE b129 Dom0 network regularly goes down.HELP !

That may be true, sadly, but it doesn''t eliminate troubleshooting
efforts to
narrow down the issue.  If even it could be identified, it''d be
helpful.

On Fri, Feb 18, 2011 at 10:42 AM, Dustin Marquess
<dmarquess@gmail.com>wrote:
> I believe xVM was EOL''d to be replaced by Oracle VM, so the
chances of
> anything in it getting fixed is slim to none.
>
> -Dustin
>
> On Thu, Feb 17, 2011 at 9:57 AM, Paul Pasika
<no-reply@opensolaris.org>
> wrote:
> > I, too, have this same issue.  It happens about every 4-6 weeks.  Is
> there any other way to pinpoint this?  This is affecting our production
> network!
> >
> > -Paul Pasika
> >
> > Sunfire X4140
> > ~# dladm show-link
> > LINK        CLASS     MTU    STATE    BRIDGE     OVER
> > nge0        phys      1500   up       --         --
> > nge1        phys      1500   up       --         --
> > nge2        phys      1500   down     --         --
> > nge3        phys      1500   down     --         --
> > xvm1_3      vnic      1500   up       --         nge3
> > xvm1_0      vnic      1500   up       --         nge0
> > xvm1_1      vnic      1500   up       --         nge1
> > xvm1_2      vnic      1500   up       --         nge2
> > xvm6_1      vnic      1500   up       --         nge1
> > xvm6_3      vnic      1500   up       --         nge3
> > xvm6_0      vnic      1500   up       --         nge0
> > xvm6_2      vnic      1500   up       --         nge2
> > ~# prtconf -d
> > System Configuration:  Sun Microsystems  i86pc
> > Memory size: 2048 Megabytes
> > System Peripherals (Software Nodes):
> >
> > i86xpv
> >    scsi_vhci, instance #0
> >    pci, instance #0
> >        pci10de,cb84 (pciex10de,369) (driver not attached)
> >        isa (pciex10de,364), instance #1
> >            asy, instance #1 (driver not attached)
> >            motherboard (driver not attached)
> >            pit_beep, instance #1
> >        pci10de,cb84 (pciex10de,368) (driver not attached)
> >        pci10de,cb84 (pciex10de,36c), instance #0
> >            device, instance #1
> >                keyboard, instance #3
> >                mouse, instance #4
> >        pci10de,cb84 (pciex10de,36d), instance #0
> >            storage, instance #0
> >                disk, instance #0 (driver not attached)
> >            hub, instance #0
> >        pci10de,cb84 (pciex10de,37f), instance #0
> >        pci10de,cb84 (pciex10de,37f), instance #1
> >        pci10de,cb84 (pciex10de,37f), instance #2
> >        pci10de,370 (pciex10de,370), instance #0
> >            display (pci1a03,2000), instance #0
> >        pci10de,cb84 (pciex10de,373), instance #0
> >        pci10de,cb84 (pciex10de,373), instance #1
> >        pci10de,377 (pciex10de,377) (driver not attached)
> >        pci10de,376 (pciex10de,376) (driver not attached)
> >        pci10de,375 (pciex10de,375), instance #0
> >            pci1000,3150 (pciex1000,58), instance #0
> >                sd, instance #1
> >                sd, instance #2
> >                sd, instance #3
> >                sd, instance #4
> >                sd, instance #5
> >        pci1022,1200 (pciex1022,1200) (driver not attached)
> >        pci1022,1201 (pciex1022,1201) (driver not attached)
> >        pci1022,1202 (pciex1022,1202) (driver not attached)
> >        pci1022,1203 (pciex1022,1203) (driver not attached)
> >        pci1022,1204 (pciex1022,1204) (driver not attached)
> >        pci1022,1200 (pciex1022,1200) (driver not attached)
> >        pci1022,1201 (pciex1022,1201) (driver not attached)
> >        pci1022,1202 (pciex1022,1202) (driver not attached)
> >        pci1022,1203 (pciex1022,1203) (driver not attached)
> >        pci1022,1204 (pciex1022,1204) (driver not attached)
> >    pci, instance #1
> >        pci10de,cb84 (pciex10de,369) (driver not attached)
> >        pci10de,cb84 (pciex10de,361) (driver not attached)
> >        pci10de,368 (pciex10de,368) (driver not attached)
> >        pci10de,cb84 (pciex10de,37f), instance #3
> >        pci10de,cb84 (pciex10de,37f), instance #4
> >        pci10de,cb84 (pciex10de,37f), instance #5
> >        pci10de,cb84 (pciex10de,373), instance #2
> >        pci10de,cb84 (pciex10de,373), instance #3
> >        pci10de,378 (pciex10de,378) (driver not attached)
> >        pci10de,376 (pciex10de,376) (driver not attached)
> >        pci10de,377 (pciex10de,377) (driver not attached)
> >    used-resources (driver not attached)
> >    xpvd, instance #0
> >        xencons, instance #0 (driver not attached)
> >        xenbus, instance #0
> >        domcaps, instance #0
> >        balloon, instance #0
> >        evtchn, instance #0
> >        privcmd, instance #0
> >        xpvtap, instance #0
> >        xpvtap, instance #1
> >        xnb, instance #0
> >        xnb, instance #1
> >        xnb, instance #2
> >        xnb, instance #3
> >        xnb, instance #4
> >        xnb, instance #5
> >        xnb, instance #6
> >        xnb, instance #7
> >        xnb, instance #8
> >        xnb, instance #9
> >        xnb, instance #10
> >        xnb, instance #11
> >        xnb, instance #12
> >        xnb, instance #13
> >        xnb, instance #14
> >        xnb, instance #15
> >        xnb, instance #16
> >        xnb, instance #17
> >        xnb, instance #18
> >        xnb, instance #19
> >        xpvtap, instance #2
> >        xpvtap, instance #3
> >        xnb, instance #20
> >        xnb, instance #21
> >        xnb, instance #22
> >        xnb, instance #23
> >    pseudo, instance #0
> >    xsvc, instance #0
> >    options, instance #0
> >    agpgart, instance #0 (driver not attached)
> >    cpus, instance #0
> >        cpu (driver not attached)
> >        cpu (driver not attached)
> >        cpu (driver not attached)
> >        cpu (driver not attached)
> >        cpu (driver not attached)
> >        cpu (driver not attached)
> >        cpu (driver not attached)
> >        cpu (driver not attached)
> >        cpu (driver not attached)
> >        cpu (driver not attached)
> >        cpu (driver not attached)
> >        cpu (driver not attached)
> > ~# echo ::interrupts | mdb -k
> > IRQ  Vect Evtchn IPL Bus    Trg Type   CPU Share APIC/INT# ISR(s)
> > 9    0x58 4      9   PCI    Lvl Fixed  0   1     0x0/0x9
> acpi_wrapper_isr
> > 20   0xa0 11     9   PCI    Lvl Fixed  0   2     0x0/0x14  mcp5x_intr,
> ehci_intr
> > 21   0xa8 12     9   PCI    Lvl Fixed  0   2     0x0/0x15  mcp5x_intr,
> ohci_intr
> > 22   0xb0 57     6   PCI    Lvl Fixed  4   2     0x0/0x16  mcp5x_intr,
> > nge_chip_intr
> > 23   0xb8 58     6   PCI    Lvl Fixed  5   1     0x0/0x17 
nge_chip_intr
> > 44   0xc0 65     6   PCI    Lvl Fixed  11  2     0x1/0x14 
nge_chip_intr,
> > nge_chip_intr
> > 45   0xc8 62     5   PCI    Lvl Fixed  7   1     0x1/0x15  mcp5x_intr
> > 46   0xd0 63     5   PCI    Lvl Fixed  8   1     0x1/0x16  mcp5x_intr
> > 47   0xd8 64     5   PCI    Lvl Fixed  9   1     0x1/0x17  mcp5x_intr
> > 253  0x98 9      5   PCI    Edg MSI    0   1     -         mpt_intr
> > 254  0x23 8      7   PCI    Edg MSI    0   1     -
> pcieb_intr_handler
> > 255  0x22 7      7   PCI    Edg MSI    0   1     -
> pcieb_intr_handler
> > 256  -    I      15  -      Edg ipi    all -     -         xc_serv
> > 257  -    I      11  -      Edg ipi    all -     -         poke_cpu
> > 258  -    1      15  -      Edg virq   all -     -
> xen_debug_handler
> > 259  -    T      14  -      Edg virq   all -     -         cbe_fire
> > 260  -    I      14  -      Edg ipi    all -     -         cbe_fire
> > 261  -    16     3   -      Edg virq   all -     -
> gcpu_xpv_virq_intr
> > 262  -    68     5   xpvd   Edg evtchn 3   -     -         blk_intr
> > 263  -    60     1   -      Edg evtchn 1   -     -         xenbus_intr
> > 264  -    D      1   xpvd   Edg device 0   -     -
> evtchn_device_upcall
> > 265  -    71     6   xpvd   Edg evtchn 4   -     -         xnb_intr
> > 266  -    72     6   xpvd   Edg evtchn 5   -     -         xnb_intr
> > 267  -    73     5   xpvd   Edg evtchn 9   -     -         blk_intr
> > 268  -    74     5   xpvd   Edg evtchn 10  -     -         blk_intr
> > 269  -    75     6   xpvd   Edg evtchn 8   -     -         xnb_intr
> > 270  -    76     6   xpvd   Edg evtchn 9   -     -         xnb_intr
> > 271  -    77     6   xpvd   Edg evtchn 11  -     -         xnb_intr
> > 272  -    78     6   xpvd   Edg evtchn 0   -     -         xnb_intr
> > 273  -    79     6   xpvd   Edg evtchn 1   -     -         xnb_intr
> > 274  -    80     6   xpvd   Edg evtchn 2   -     -         xnb_intr
> > 275  -    81     5   xpvd   Edg evtchn 2   -     -         blk_intr
> > --
> > This message posted from opensolaris.org
> > _______________________________________________
> > xen-discuss mailing list
> > xen-discuss@opensolaris.org
> >
> _______________________________________________
> xen-discuss mailing list
> xen-discuss@opensolaris.org
>


-- 

-Paul Pasika
Catylist Network - System Administrator
312-595-9209

Lasse Osterild

2011-Feb-18 17:16 UTC

head link

Re: SXCE b129 Dom0 network regularly goes down.HELP !

Why bother troubleshooting something which is unlikely to ever see a final
release or update for that matter?  You''re betting all your money on a
dead horse.

 - Lasse

On 18/02/2011, at 18.06, Paul Pasika wrote:
> That may be true, sadly, but it doesn''t eliminate troubleshooting
efforts to narrow down the issue.  If even it could be identified, it''d
be helpful.
> 
> On Fri, Feb 18, 2011 at 10:42 AM, Dustin Marquess
<dmarquess@gmail.com> wrote:
> I believe xVM was EOL''d to be replaced by Oracle VM, so the
chances of
> anything in it getting fixed is slim to none.
> 
> -Dustin
> 
> On Thu, Feb 17, 2011 at 9:57 AM, Paul Pasika
<no-reply@opensolaris.org> wrote:
> > I, too, have this same issue.  It happens about every 4-6 weeks.  Is
there any other way to pinpoint this?  This is affecting our production network!
> >
> > -Paul Pasika
> >
> > Sunfire X4140
> > ~# dladm show-link
> > LINK        CLASS     MTU    STATE    BRIDGE     OVER
> > nge0        phys      1500   up       --         --
> > nge1        phys      1500   up       --         --
> > nge2        phys      1500   down     --         --
> > nge3        phys      1500   down     --         --
> > xvm1_3      vnic      1500   up       --         nge3
> > xvm1_0      vnic      1500   up       --         nge0
> > xvm1_1      vnic      1500   up       --         nge1
> > xvm1_2      vnic      1500   up       --         nge2
> > xvm6_1      vnic      1500   up       --         nge1
> > xvm6_3      vnic      1500   up       --         nge3
> > xvm6_0      vnic      1500   up       --         nge0
> > xvm6_2      vnic      1500   up       --         nge2
> > ~# prtconf -d
> > System Configuration:  Sun Microsystems  i86pc
> > Memory size: 2048 Megabytes
> > System Peripherals (Software Nodes):
> >
> > i86xpv
> >    scsi_vhci, instance #0
> >    pci, instance #0
> >        pci10de,cb84 (pciex10de,369) (driver not attached)
> >        isa (pciex10de,364), instance #1
> >            asy, instance #1 (driver not attached)
> >            motherboard (driver not attached)
> >            pit_beep, instance #1
> >        pci10de,cb84 (pciex10de,368) (driver not attached)
> >        pci10de,cb84 (pciex10de,36c), instance #0
> >            device, instance #1
> >                keyboard, instance #3
> >                mouse, instance #4
> >        pci10de,cb84 (pciex10de,36d), instance #0
> >            storage, instance #0
> >                disk, instance #0 (driver not attached)
> >            hub, instance #0
> >        pci10de,cb84 (pciex10de,37f), instance #0
> >        pci10de,cb84 (pciex10de,37f), instance #1
> >        pci10de,cb84 (pciex10de,37f), instance #2
> >        pci10de,370 (pciex10de,370), instance #0
> >            display (pci1a03,2000), instance #0
> >        pci10de,cb84 (pciex10de,373), instance #0
> >        pci10de,cb84 (pciex10de,373), instance #1
> >        pci10de,377 (pciex10de,377) (driver not attached)
> >        pci10de,376 (pciex10de,376) (driver not attached)
> >        pci10de,375 (pciex10de,375), instance #0
> >            pci1000,3150 (pciex1000,58), instance #0
> >                sd, instance #1
> >                sd, instance #2
> >                sd, instance #3
> >                sd, instance #4
> >                sd, instance #5
> >        pci1022,1200 (pciex1022,1200) (driver not attached)
> >        pci1022,1201 (pciex1022,1201) (driver not attached)
> >        pci1022,1202 (pciex1022,1202) (driver not attached)
> >        pci1022,1203 (pciex1022,1203) (driver not attached)
> >        pci1022,1204 (pciex1022,1204) (driver not attached)
> >        pci1022,1200 (pciex1022,1200) (driver not attached)
> >        pci1022,1201 (pciex1022,1201) (driver not attached)
> >        pci1022,1202 (pciex1022,1202) (driver not attached)
> >        pci1022,1203 (pciex1022,1203) (driver not attached)
> >        pci1022,1204 (pciex1022,1204) (driver not attached)
> >    pci, instance #1
> >        pci10de,cb84 (pciex10de,369) (driver not attached)
> >        pci10de,cb84 (pciex10de,361) (driver not attached)
> >        pci10de,368 (pciex10de,368) (driver not attached)
> >        pci10de,cb84 (pciex10de,37f), instance #3
> >        pci10de,cb84 (pciex10de,37f), instance #4
> >        pci10de,cb84 (pciex10de,37f), instance #5
> >        pci10de,cb84 (pciex10de,373), instance #2
> >        pci10de,cb84 (pciex10de,373), instance #3
> >        pci10de,378 (pciex10de,378) (driver not attached)
> >        pci10de,376 (pciex10de,376) (driver not attached)
> >        pci10de,377 (pciex10de,377) (driver not attached)
> >    used-resources (driver not attached)
> >    xpvd, instance #0
> >        xencons, instance #0 (driver not attached)
> >        xenbus, instance #0
> >        domcaps, instance #0
> >        balloon, instance #0
> >        evtchn, instance #0
> >        privcmd, instance #0
> >        xpvtap, instance #0
> >        xpvtap, instance #1
> >        xnb, instance #0
> >        xnb, instance #1
> >        xnb, instance #2
> >        xnb, instance #3
> >        xnb, instance #4
> >        xnb, instance #5
> >        xnb, instance #6
> >        xnb, instance #7
> >        xnb, instance #8
> >        xnb, instance #9
> >        xnb, instance #10
> >        xnb, instance #11
> >        xnb, instance #12
> >        xnb, instance #13
> >        xnb, instance #14
> >        xnb, instance #15
> >        xnb, instance #16
> >        xnb, instance #17
> >        xnb, instance #18
> >        xnb, instance #19
> >        xpvtap, instance #2
> >        xpvtap, instance #3
> >        xnb, instance #20
> >        xnb, instance #21
> >        xnb, instance #22
> >        xnb, instance #23
> >    pseudo, instance #0
> >    xsvc, instance #0
> >    options, instance #0
> >    agpgart, instance #0 (driver not attached)
> >    cpus, instance #0
> >        cpu (driver not attached)
> >        cpu (driver not attached)
> >        cpu (driver not attached)
> >        cpu (driver not attached)
> >        cpu (driver not attached)
> >        cpu (driver not attached)
> >        cpu (driver not attached)
> >        cpu (driver not attached)
> >        cpu (driver not attached)
> >        cpu (driver not attached)
> >        cpu (driver not attached)
> >        cpu (driver not attached)
> > ~# echo ::interrupts | mdb -k
> > IRQ  Vect Evtchn IPL Bus    Trg Type   CPU Share APIC/INT# ISR(s)
> > 9    0x58 4      9   PCI    Lvl Fixed  0   1     0x0/0x9  
acpi_wrapper_isr
> > 20   0xa0 11     9   PCI    Lvl Fixed  0   2     0x0/0x14  mcp5x_intr,
ehci_intr
> > 21   0xa8 12     9   PCI    Lvl Fixed  0   2     0x0/0x15  mcp5x_intr,
ohci_intr
> > 22   0xb0 57     6   PCI    Lvl Fixed  4   2     0x0/0x16  mcp5x_intr,
> > nge_chip_intr
> > 23   0xb8 58     6   PCI    Lvl Fixed  5   1     0x0/0x17 
nge_chip_intr
> > 44   0xc0 65     6   PCI    Lvl Fixed  11  2     0x1/0x14 
nge_chip_intr,
> > nge_chip_intr
> > 45   0xc8 62     5   PCI    Lvl Fixed  7   1     0x1/0x15  mcp5x_intr
> > 46   0xd0 63     5   PCI    Lvl Fixed  8   1     0x1/0x16  mcp5x_intr
> > 47   0xd8 64     5   PCI    Lvl Fixed  9   1     0x1/0x17  mcp5x_intr
> > 253  0x98 9      5   PCI    Edg MSI    0   1     -         mpt_intr
> > 254  0x23 8      7   PCI    Edg MSI    0   1     -        
pcieb_intr_handler
> > 255  0x22 7      7   PCI    Edg MSI    0   1     -        
pcieb_intr_handler
> > 256  -    I      15  -      Edg ipi    all -     -         xc_serv
> > 257  -    I      11  -      Edg ipi    all -     -         poke_cpu
> > 258  -    1      15  -      Edg virq   all -     -        
xen_debug_handler
> > 259  -    T      14  -      Edg virq   all -     -         cbe_fire
> > 260  -    I      14  -      Edg ipi    all -     -         cbe_fire
> > 261  -    16     3   -      Edg virq   all -     -        
gcpu_xpv_virq_intr
> > 262  -    68     5   xpvd   Edg evtchn 3   -     -         blk_intr
> > 263  -    60     1   -      Edg evtchn 1   -     -         xenbus_intr
> > 264  -    D      1   xpvd   Edg device 0   -     -        
evtchn_device_upcall
> > 265  -    71     6   xpvd   Edg evtchn 4   -     -         xnb_intr
> > 266  -    72     6   xpvd   Edg evtchn 5   -     -         xnb_intr
> > 267  -    73     5   xpvd   Edg evtchn 9   -     -         blk_intr
> > 268  -    74     5   xpvd   Edg evtchn 10  -     -         blk_intr
> > 269  -    75     6   xpvd   Edg evtchn 8   -     -         xnb_intr
> > 270  -    76     6   xpvd   Edg evtchn 9   -     -         xnb_intr
> > 271  -    77     6   xpvd   Edg evtchn 11  -     -         xnb_intr
> > 272  -    78     6   xpvd   Edg evtchn 0   -     -         xnb_intr
> > 273  -    79     6   xpvd   Edg evtchn 1   -     -         xnb_intr
> > 274  -    80     6   xpvd   Edg evtchn 2   -     -         xnb_intr
> > 275  -    81     5   xpvd   Edg evtchn 2   -     -         blk_intr
> > --
> > This message posted from opensolaris.org
> > _______________________________________________
> > xen-discuss mailing list
> > xen-discuss@opensolaris.org
> >
> _______________________________________________
> xen-discuss mailing list
> xen-discuss@opensolaris.org
> 
> 
> 
> -- 
> 
> -Paul Pasika
> Catylist Network - System Administrator
> 312-595-9209
> _______________________________________________
> xen-discuss mailing list
> xen-discuss@opensolaris.org

Paul Pasika

2011-Feb-18 17:25 UTC

head link

Re: SXCE b129 Dom0 network regularly goes down.HELP !

Simply because I''m running production services on this, and I need to
get to
the bottom of it.  Seems reasonable.  I cannot arbitrarily change the OS to
openindiana or another solaris flavor on production with out knowing if it
will resolve anything.

On Fri, Feb 18, 2011 at 11:16 AM, Lasse Osterild
<lasseoe@unixzone.dk>wrote:
> Why bother troubleshooting something which is unlikely to ever see a final
> release or update for that matter?  You''re betting all your money
on a dead
> horse.
>
>  - Lasse
>
> On 18/02/2011, at 18.06, Paul Pasika wrote:
>
> > That may be true, sadly, but it doesn''t eliminate
troubleshooting efforts
> to narrow down the issue.  If even it could be identified, it''d be
helpful.
> >
> > On Fri, Feb 18, 2011 at 10:42 AM, Dustin Marquess
<dmarquess@gmail.com>
> wrote:
> > I believe xVM was EOL''d to be replaced by Oracle VM, so the
chances of
> > anything in it getting fixed is slim to none.
> >
> > -Dustin
> >
> > On Thu, Feb 17, 2011 at 9:57 AM, Paul Pasika
<no-reply@opensolaris.org>
> wrote:
> > > I, too, have this same issue.  It happens about every 4-6 weeks. 
Is
> there any other way to pinpoint this?  This is affecting our production
> network!
> > >
> > > -Paul Pasika
> > >
> > > Sunfire X4140
> > > ~# dladm show-link
> > > LINK        CLASS     MTU    STATE    BRIDGE     OVER
> > > nge0        phys      1500   up       --         --
> > > nge1        phys      1500   up       --         --
> > > nge2        phys      1500   down     --         --
> > > nge3        phys      1500   down     --         --
> > > xvm1_3      vnic      1500   up       --         nge3
> > > xvm1_0      vnic      1500   up       --         nge0
> > > xvm1_1      vnic      1500   up       --         nge1
> > > xvm1_2      vnic      1500   up       --         nge2
> > > xvm6_1      vnic      1500   up       --         nge1
> > > xvm6_3      vnic      1500   up       --         nge3
> > > xvm6_0      vnic      1500   up       --         nge0
> > > xvm6_2      vnic      1500   up       --         nge2
> > > ~# prtconf -d
> > > System Configuration:  Sun Microsystems  i86pc
> > > Memory size: 2048 Megabytes
> > > System Peripherals (Software Nodes):
> > >
> > > i86xpv
> > >    scsi_vhci, instance #0
> > >    pci, instance #0
> > >        pci10de,cb84 (pciex10de,369) (driver not attached)
> > >        isa (pciex10de,364), instance #1
> > >            asy, instance #1 (driver not attached)
> > >            motherboard (driver not attached)
> > >            pit_beep, instance #1
> > >        pci10de,cb84 (pciex10de,368) (driver not attached)
> > >        pci10de,cb84 (pciex10de,36c), instance #0
> > >            device, instance #1
> > >                keyboard, instance #3
> > >                mouse, instance #4
> > >        pci10de,cb84 (pciex10de,36d), instance #0
> > >            storage, instance #0
> > >                disk, instance #0 (driver not attached)
> > >            hub, instance #0
> > >        pci10de,cb84 (pciex10de,37f), instance #0
> > >        pci10de,cb84 (pciex10de,37f), instance #1
> > >        pci10de,cb84 (pciex10de,37f), instance #2
> > >        pci10de,370 (pciex10de,370), instance #0
> > >            display (pci1a03,2000), instance #0
> > >        pci10de,cb84 (pciex10de,373), instance #0
> > >        pci10de,cb84 (pciex10de,373), instance #1
> > >        pci10de,377 (pciex10de,377) (driver not attached)
> > >        pci10de,376 (pciex10de,376) (driver not attached)
> > >        pci10de,375 (pciex10de,375), instance #0
> > >            pci1000,3150 (pciex1000,58), instance #0
> > >                sd, instance #1
> > >                sd, instance #2
> > >                sd, instance #3
> > >                sd, instance #4
> > >                sd, instance #5
> > >        pci1022,1200 (pciex1022,1200) (driver not attached)
> > >        pci1022,1201 (pciex1022,1201) (driver not attached)
> > >        pci1022,1202 (pciex1022,1202) (driver not attached)
> > >        pci1022,1203 (pciex1022,1203) (driver not attached)
> > >        pci1022,1204 (pciex1022,1204) (driver not attached)
> > >        pci1022,1200 (pciex1022,1200) (driver not attached)
> > >        pci1022,1201 (pciex1022,1201) (driver not attached)
> > >        pci1022,1202 (pciex1022,1202) (driver not attached)
> > >        pci1022,1203 (pciex1022,1203) (driver not attached)
> > >        pci1022,1204 (pciex1022,1204) (driver not attached)
> > >    pci, instance #1
> > >        pci10de,cb84 (pciex10de,369) (driver not attached)
> > >        pci10de,cb84 (pciex10de,361) (driver not attached)
> > >        pci10de,368 (pciex10de,368) (driver not attached)
> > >        pci10de,cb84 (pciex10de,37f), instance #3
> > >        pci10de,cb84 (pciex10de,37f), instance #4
> > >        pci10de,cb84 (pciex10de,37f), instance #5
> > >        pci10de,cb84 (pciex10de,373), instance #2
> > >        pci10de,cb84 (pciex10de,373), instance #3
> > >        pci10de,378 (pciex10de,378) (driver not attached)
> > >        pci10de,376 (pciex10de,376) (driver not attached)
> > >        pci10de,377 (pciex10de,377) (driver not attached)
> > >    used-resources (driver not attached)
> > >    xpvd, instance #0
> > >        xencons, instance #0 (driver not attached)
> > >        xenbus, instance #0
> > >        domcaps, instance #0
> > >        balloon, instance #0
> > >        evtchn, instance #0
> > >        privcmd, instance #0
> > >        xpvtap, instance #0
> > >        xpvtap, instance #1
> > >        xnb, instance #0
> > >        xnb, instance #1
> > >        xnb, instance #2
> > >        xnb, instance #3
> > >        xnb, instance #4
> > >        xnb, instance #5
> > >        xnb, instance #6
> > >        xnb, instance #7
> > >        xnb, instance #8
> > >        xnb, instance #9
> > >        xnb, instance #10
> > >        xnb, instance #11
> > >        xnb, instance #12
> > >        xnb, instance #13
> > >        xnb, instance #14
> > >        xnb, instance #15
> > >        xnb, instance #16
> > >        xnb, instance #17
> > >        xnb, instance #18
> > >        xnb, instance #19
> > >        xpvtap, instance #2
> > >        xpvtap, instance #3
> > >        xnb, instance #20
> > >        xnb, instance #21
> > >        xnb, instance #22
> > >        xnb, instance #23
> > >    pseudo, instance #0
> > >    xsvc, instance #0
> > >    options, instance #0
> > >    agpgart, instance #0 (driver not attached)
> > >    cpus, instance #0
> > >        cpu (driver not attached)
> > >        cpu (driver not attached)
> > >        cpu (driver not attached)
> > >        cpu (driver not attached)
> > >        cpu (driver not attached)
> > >        cpu (driver not attached)
> > >        cpu (driver not attached)
> > >        cpu (driver not attached)
> > >        cpu (driver not attached)
> > >        cpu (driver not attached)
> > >        cpu (driver not attached)
> > >        cpu (driver not attached)
> > > ~# echo ::interrupts | mdb -k
> > > IRQ  Vect Evtchn IPL Bus    Trg Type   CPU Share APIC/INT# ISR(s)
> > > 9    0x58 4      9   PCI    Lvl Fixed  0   1     0x0/0x9
> acpi_wrapper_isr
> > > 20   0xa0 11     9   PCI    Lvl Fixed  0   2     0x0/0x14 
mcp5x_intr,
> ehci_intr
> > > 21   0xa8 12     9   PCI    Lvl Fixed  0   2     0x0/0x15 
mcp5x_intr,
> ohci_intr
> > > 22   0xb0 57     6   PCI    Lvl Fixed  4   2     0x0/0x16 
mcp5x_intr,
> > > nge_chip_intr
> > > 23   0xb8 58     6   PCI    Lvl Fixed  5   1     0x0/0x17
>  nge_chip_intr
> > > 44   0xc0 65     6   PCI    Lvl Fixed  11  2     0x1/0x14
>  nge_chip_intr,
> > > nge_chip_intr
> > > 45   0xc8 62     5   PCI    Lvl Fixed  7   1     0x1/0x15 
mcp5x_intr
> > > 46   0xd0 63     5   PCI    Lvl Fixed  8   1     0x1/0x16 
mcp5x_intr
> > > 47   0xd8 64     5   PCI    Lvl Fixed  9   1     0x1/0x17 
mcp5x_intr
> > > 253  0x98 9      5   PCI    Edg MSI    0   1     -        
mpt_intr
> > > 254  0x23 8      7   PCI    Edg MSI    0   1     -
> pcieb_intr_handler
> > > 255  0x22 7      7   PCI    Edg MSI    0   1     -
> pcieb_intr_handler
> > > 256  -    I      15  -      Edg ipi    all -     -        
xc_serv
> > > 257  -    I      11  -      Edg ipi    all -     -        
poke_cpu
> > > 258  -    1      15  -      Edg virq   all -     -
> xen_debug_handler
> > > 259  -    T      14  -      Edg virq   all -     -        
cbe_fire
> > > 260  -    I      14  -      Edg ipi    all -     -        
cbe_fire
> > > 261  -    16     3   -      Edg virq   all -     -
> gcpu_xpv_virq_intr
> > > 262  -    68     5   xpvd   Edg evtchn 3   -     -        
blk_intr
> > > 263  -    60     1   -      Edg evtchn 1   -     -        
xenbus_intr
> > > 264  -    D      1   xpvd   Edg device 0   -     -
> evtchn_device_upcall
> > > 265  -    71     6   xpvd   Edg evtchn 4   -     -        
xnb_intr
> > > 266  -    72     6   xpvd   Edg evtchn 5   -     -        
xnb_intr
> > > 267  -    73     5   xpvd   Edg evtchn 9   -     -        
blk_intr
> > > 268  -    74     5   xpvd   Edg evtchn 10  -     -        
blk_intr
> > > 269  -    75     6   xpvd   Edg evtchn 8   -     -        
xnb_intr
> > > 270  -    76     6   xpvd   Edg evtchn 9   -     -        
xnb_intr
> > > 271  -    77     6   xpvd   Edg evtchn 11  -     -        
xnb_intr
> > > 272  -    78     6   xpvd   Edg evtchn 0   -     -        
xnb_intr
> > > 273  -    79     6   xpvd   Edg evtchn 1   -     -        
xnb_intr
> > > 274  -    80     6   xpvd   Edg evtchn 2   -     -        
xnb_intr
> > > 275  -    81     5   xpvd   Edg evtchn 2   -     -        
blk_intr
> > > --
> > > This message posted from opensolaris.org
> > > _______________________________________________
> > > xen-discuss mailing list
> > > xen-discuss@opensolaris.org
> > >
> > _______________________________________________
> > xen-discuss mailing list
> > xen-discuss@opensolaris.org
> >
> >
> >
> > --
> >
> > -Paul Pasika
> > Catylist Network - System Administrator
> > 312-595-9209
> > _______________________________________________
> > xen-discuss mailing list
> > xen-discuss@opensolaris.org
>
> _______________________________________________
> xen-discuss mailing list
> xen-discuss@opensolaris.org
>


-- 

-Paul Pasika
Catylist Network - System Administrator
312-595-9209

xen discuss - Dec 2009 - SXCE b129 Dom0 network regularly goes down.HELP !

SXCE b129 Dom0 network regularly goes down.HELP !

Re: SXCE b129 Dom0 network regularly goes down.HELP !

Re: SXCE b129 Dom0 network regularly goes down.HELP !

Re: SXCE b129 Dom0 network regularly goes down.HELP !

Re: SXCE b129 Dom0 network regularly goes down.HELP !

Re: SXCE b129 Dom0 network regularly goes down.HELP !

Re: SXCE b129 Dom0 network regularly goes down.HELP !

Re: SXCE b129 Dom0 network regularly goes down.HELP !

Re: SXCE b129 Dom0 network regularly goes down.HELP !

Re: SXCE b129 Dom0 network regularly goes down.HELP !

Re: SXCE b129 Dom0 network regularly goes down.HELP !

Re: SXCE b129 Dom0 network regularly goes down.HELP !

Re: SXCE b129 Dom0 network regularly goes down.HELP !

Re: SXCE b129 Dom0 network regularly goes down.HELP !

Re: SXCE b129 Dom0 network regularly goes down.HELP !