On Wed, Jun 15, 2011 at 03:14:43AM -0400, Joshua Boyd
wrote:> I recently updated my server to the latest 8-STABLE, and upgraded to v28
> ZFS. I have not had these problems on any other version of 8-STABLE or
> 7-STABLE, which this box was upgraded from some time ago.
>
> Now, during my weekly scrub, I get the following messages and em0 is
> unresponsive:
>
> Jun 12 03:07:58 foghornleghorn kernel: em0: Watchdog timeout -- resetting
> Jun 12 03:07:58 foghornleghorn kernel: em0: link state changed to DOWN
> Jun 12 03:08:01 foghornleghorn kernel: em0: link state changed to UP
> Jun 12 03:08:47 foghornleghorn kernel: em0: Watchdog timeout -- resetting
> Jun 12 03:08:47 foghornleghorn kernel: em0: link state changed to DOWN
> Jun 12 03:08:50 foghornleghorn kernel: em0: link state changed to UP
>
> My scrub is scheduled to start at 03:00:00, so it looks like watchdog
> timeouts start occurring pretty quickly once I/O ramps up.
>
> Here's some possibly relevant information, let me know if anything else
> would be helpful to troubleshoot.
>
> FreeBSD foghornleghorn.res.openband.net 8.2-STABLE FreeBSD 8.2-STABLE #17:
> Mon Jun 6 19:40:19 EDT 2011
> root@foghornleghorn.res.openband.net:/usr/obj/usr/src/sys/FOGHORNLEGHORN
> amd64
>
> em0: <Intel(R) PRO/1000 Legacy Network Connection 1.0.3> port
0xe800-0xe83f
> mem 0xfebe0000-0xfebfffff,0xfebc0000-0xfebdffff irq 20 at device 5.0 on
pci7
>
> em0@pci0:7:5:0: class=0x020000 card=0x13768086 chip=0x107c8086 rev=0x05
> hdr=0x00
> vendor = 'Intel Corporation'
> device = 'Gigabit Ethernet Controller (Copper) rev 5
(82541PI)'
> class = network
> subclass = ethernet
>
> And, the SAS cards:
>
> dev.mpt.0.%desc: LSILogic SAS/SATA Adapter
> dev.mpt.0.%driver: mpt
> dev.mpt.0.%location: slot=0 function=0
> dev.mpt.0.%pnpinfo: vendor=0x1000 device=0x0058 subvendor=0x15d9
> subdevice=0xa580 class=0x010000
> dev.mpt.0.%parent: pci1
> dev.mpt.0.debug: 3
> dev.mpt.0.role: 1
> dev.mpt.1.%desc: LSILogic SAS/SATA Adapter
> dev.mpt.1.%driver: mpt
> dev.mpt.1.%location: slot=0 function=0
> dev.mpt.1.%pnpinfo: vendor=0x1000 device=0x0058 subvendor=0x15d9
> subdevice=0xa580 class=0x010000
> dev.mpt.1.%parent: pci2
> dev.mpt.1.debug: 3
> dev.mpt.1.role: 1
> dev.mpt.2.%desc: LSILogic SAS/SATA Adapter
> dev.mpt.2.%driver: mpt
> dev.mpt.2.%location: slot=0 function=0
> dev.mpt.2.%pnpinfo: vendor=0x1000 device=0x0058 subvendor=0x1000
> subdevice=0x30a0 class=0x010000
> dev.mpt.2.%parent: pci6
> dev.mpt.2.debug: 3
> dev.mpt.2.role: 1
Please provide output from the following commands (as root):
# pciconf -lvcb
# vmstat -i
# sysctl -a | grep msi
# dmesg
--
| Jeremy Chadwick jdc@parodius.com |
| Parodius Networking http://www.parodius.com/ |
| UNIX Systems Administrator Mountain View, CA, US |
| Making life hard for others since 1977. PGP 4BD6C0CB |