Hi all, I have had this problem since day 1 on my new server. It has run since November 15th 2008, and serve approx. 10 GB worth of web traffic per month for the main site and then some 40 domains with mail and small web pages. (hence - it's NOT that busy yet) I started with 7.1-RELEASE-pX since I didn't have problems straight off - but it didn't last long. After a few days of running, the interrupt storm on atapci0 starts to show. It slowly builds up and continues. When it reaches 150-200k/sec. I reboot just to be on the safe side. I have also upgraded to 7.1-STABLE to get all the ATA driver changes S.O.S. have been including. Still no visible change. To give you an impression of its impact, I will let the numbers speak for thmeselves: $ uname -v FreeBSD 7.1-STABLE #1: Thu Mar 12 14:22:49 CET 2009 $ uname -m amd64 $ uptime 2:36PM up 4 days, 22:12, 5 users, load averages: 0.28, 0.40, 0.19 $ tail -10 messages Mar 17 13:42:37 box last message repeated 600 times Mar 17 13:52:37 box last message repeated 600 times Mar 17 14:02:37 box last message repeated 600 times Mar 17 14:12:37 box last message repeated 600 times Mar 17 14:22:37 box last message repeated 600 times Mar 17 14:32:22 box last message repeated 585 times Mar 17 14:32:23 box kernel: pid 78195 (try), uid 0: exited on signal 10 (core dumped) Mar 17 14:32:23 box kernel: interrupt storm detected on "irq22:"; throttling interrupt source Mar 17 14:32:54 box last message repeated 31 times Mar 17 14:34:55 box last message repeated 121 times $ vmstat -i interrupt total rate irq1: atkbd0 3 0 irq9: acpi0 1 0 irq16: ohci0 1 0 irq17: ohci1 ohci3 1 0 irq18: ohci2 ohci4 1 0 irq22: atapci0 57317362717 134713 cpu0: timer 850996016 2000 cpu1: timer 850995703 2000 Total 59019354443 138713 [root@box /etc]# atacontrol mode ad4 current mode = SATA300 [root@box /etc]# atacontrol mode ad6 current mode = SATA300 Some relevant lines from dmesg: atapci0: port 0xb000-0xb007,0xa000-0xa003,0x9000-0x9007,0x8000-0x8003,0x7000-0x700f mem 0xfe7ff800-0xfe7ffbff irq 22 at device 18.0 on pci0 atapci0: [ITHREAD] atapci0: AHCI Version 01.10 controller with 4 ports detected ata2: on atapci0 ata2: [ITHREAD] ata3: on atapci0 ata3: [ITHREAD] ata4: on atapci0 ata4: [ITHREAD] ata5: on atapci0 ata5: [ITHREAD] And a few lines from pciconf: atapci0@pci0:0:18:0: class=0x01018f card=0x73271462 chip=0x43801002 rev=0x00 hdr=0x00 vendor = 'ATI Technologies Inc' device = 'IXP SB600 Serial ATA Controller' class = mass storage subclass = ATA ...so - this is where I'm at. Interrupt storm raises through the roof in just 3 days, and continues to raise. Just for kicks I tried disabling AHCI with nextboot, but that made the box not boot. Also - I'm 1000 KM. away from the box - so I'm a little limited to testing fancy boot options - apart from things that can go in nextboot.conf. If anyone have any hints on how to proceed, I would be grateful. Thank you in advance - Nicolai
Also - this was extracted from kenv: LINES="24" acpi_load="YES" bootfile="kernel" comconsole_speed="9600" console="vidconsole" currdev="disk0s1a:" hint.acpi.0.oem="ACPIAM" hint.acpi.0.revision="1" hint.acpi.0.rsdp="0xf98a0" hint.acpi.0.rsdt="0x7dfd0000" hint.atkbd.0.at="atkbdc" hint.atkbd.0.irq="1" hint.atkbdc.0.at="isa" hint.atkbdc.0.port="0x060" hint.fd.0.at="fdc0" hint.fd.0.drive="0" hint.fd.1.at="fdc0" hint.fd.1.drive="1" hint.fdc.0.at="isa" hint.fdc.0.drq="2" hint.fdc.0.irq="6" hint.fdc.0.port="0x3F0" hint.ppc.0.at="isa" hint.ppc.0.irq="7" hint.psm.0.at="atkbdc" hint.psm.0.irq="12" hint.sc.0.at="isa" hint.sc.0.flags="0x100" hint.sio.0.at="isa" hint.sio.0.flags="0x10" hint.sio.0.irq="4" hint.sio.0.port="0x3F8" hint.sio.1.at="isa" hint.sio.1.irq="3" hint.sio.1.port="0x2F8" hint.sio.2.at="isa" hint.sio.2.disabled="1" hint.sio.2.irq="5" hint.sio.2.port="0x3E8" hint.sio.3.at="isa" hint.sio.3.disabled="1" hint.sio.3.irq="9" hint.sio.3.port="0x2E8" hint.vga.0.at="isa" interpret="OK" kernel="kernel" kernel_options="" kernelname="/boot/kernel/kernel" loaddev="disk0s1a:" mac_ifoff="NO" module_path="/boot/kernel;/boot/modules" smbios.bios.reldate="10/31/2007" smbios.bios.vendor="American Megatrends Inc." smbios.bios.version="V1.5B2" smbios.chassis.maker="To Be Filled By O.E.M." smbios.chassis.serial="To Be Filled By O.E.M." smbios.chassis.tag="To Be Filled By O.E.M." smbios.chassis.version="To Be Filled By O.E.M." smbios.planar.maker="MICRO-STAR INTERANTIONAL CO.,LTD" smbios.planar.product="MS-7368" smbios.planar.serial="To be filled by O.E.M." smbios.planar.version="1.0" smbios.socket.enabled="1" smbios.socket.populated="1" smbios.system.maker="MICRO-STAR INTERANTIONAL CO.,LTD" smbios.system.product="MS-7368" smbios.system.serial="To Be Filled By O.E.M." smbios.system.version="1.0" vfs.root.mountfrom="ufs:/dev/mirror/gm0s1a" (sorry for spelling error in subject s/atapic/atapci/) -- View this message in context: http://www.nabble.com/Crazy-%22interrupt-storm-detected%22-on-atapic0-tp22560101p22561413.html Sent from the freebsd-stable mailing list archive at Nabble.com.
Nicolai wrote:> > Hi all, > > I have had this problem since day 1 on my new server. > > It has run since November 15th 2008, and serve approx. 10 GB worth of web > traffic per month for the main site and then some 40 domains with mail and > small web pages. (hence - it's NOT that busy yet) > > I started with 7.1-RELEASE-pX since I didn't have problems straight off - > but it didn't last long. > > After a few days of running, the interrupt storm on atapci0 starts to > show. It slowly builds up and continues. When it reaches 150-200k/sec. I > reboot just to be on the safe side. > > I have also upgraded to 7.1-STABLE to get all the ATA driver changes > S.O.S. have been including. Still no visible change. > > To give you an impression of its impact, I will let the numbers speak for > thmeselves: > > $ uname -v > FreeBSD 7.1-STABLE #1: Thu Mar 12 14:22:49 CET 2009 > > $ uname -m > amd64 > > $ uptime > 2:36PM up 4 days, 22:12, 5 users, load averages: 0.28, 0.40, 0.19 > > $ tail -10 messages > Mar 17 13:42:37 box last message repeated 600 > times > Mar 17 13:52:37 box last message repeated 600 times > Mar 17 14:02:37 box last message repeated 600 times > Mar 17 14:12:37 box last message repeated 600 times > Mar 17 14:22:37 box last message repeated 600 times > Mar 17 14:32:22 box last message repeated 585 times > Mar 17 14:32:23 box kernel: pid 78195 (try), uid 0: exited on signal 10 > (core dumped) > Mar 17 14:32:23 box kernel: interrupt storm detected on "irq22:"; > throttling interrupt source > Mar 17 14:32:54 box last message repeated 31 times > Mar 17 14:34:55 box last message repeated 121 times > > $ vmstat -i > interrupt total rate > irq1: atkbd0 3 0 > irq9: acpi0 1 0 > irq16: ohci0 1 0 > irq17: ohci1 ohci3 1 0 > irq18: ohci2 ohci4 1 0 > irq22: atapci0 57317362717 134713 > cpu0: timer 850996016 2000 > cpu1: timer 850995703 2000 > Total 59019354443 138713 > > [root@box /etc]# atacontrol mode ad4 > current mode = SATA300 > [root@box /etc]# atacontrol mode ad6 > current mode = SATA300 > > Some relevant lines from dmesg: > > atapci0: > port > 0xb000-0xb007,0xa000-0xa003,0x9000-0x9007,0x8000-0x8003,0x7000-0x700f mem > 0xfe7ff800-0xfe7ffbff irq 22 at device 18.0 on pci0 > atapci0: [ITHREAD] > atapci0: AHCI Version 01.10 controller with 4 ports detected > ata2: on atapci0 > ata2: [ITHREAD] > ata3: on atapci0 > ata3: [ITHREAD] > ata4: on atapci0 > ata4: [ITHREAD] > ata5: on atapci0 > ata5: [ITHREAD] > > And a few lines from pciconf: > > atapci0@pci0:0:18:0: class=0x01018f card=0x73271462 chip=0x43801002 > rev=0x00 hdr=0x00 > vendor = 'ATI Technologies Inc' > device = 'IXP SB600 Serial ATA Controller' > class = mass storage > subclass = ATA > > ...so - this is where I'm at. Interrupt storm raises through the roof in > just 3 days, and continues to raise. > > Just for kicks I tried disabling AHCI with nextboot, but that made the box > not boot. Also - I'm 1000 KM. away from the box - so I'm a little limited > to testing fancy boot options - apart from things that can go in > nextboot.conf. > > If anyone have any hints on how to proceed, I would be grateful. > > > Thank you in advance > > - Nicolai > _______________________________________________ > freebsd-stable@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-stable > To unsubscribe, send any mail to "freebsd-stable-unsubscribe@freebsd.org" >take a look of our 'interrupt storm issue' in January, I "resolved" similar case by installing KDB/DDB enabled kernel i suppose that MB is Microstar? -- SY, Marat