I have a strange problem i''m hoping sombody here can help solve. I have a server with a 3ware 9650 card in it. I''ve used these cards with the same hardware configuration using xen 3.0.3 and 3.0.4. I downloaded the latest 2.6 driver from 3ware because 2.6.18 3w-9xxx drivers do not support this card. I replace the 3w-9xxx.c and 3w-9xxx.h files (just as i did with xen 3.0.3 and 3.0.4) and i attempt to build the kernel. The kernel builds fine but when i boot the kernel i see a BUG/OOPS dump to the screen and then i get a kernel panic because it cant load any filesystem. This problem ONLY happens when i apply the xen-3.1 patch to the 2.6.18 source! If i download, extract and copy over the new 3ware drivers for 2.6.18 and built it without xen being patched the system detects and boots the 3ware card fine. Can anybody shed some light on what might be happening here? Below is a bootup log i grabbed via serial... Scroll to the bottom if you want to see the BUG/OOPS. Oh btw, the 3ware drive in the dump below was for 2.6.19 or newer but the same problem existed with the drive for 2.6.18... 3ware apparently likes to name there drivers for specific kernel versions now rather than just naming them after the driver version. ~Shaun __ __ _____ _ ___ \ \/ /___ _ __ |___ / / | / _ \ \ // _ \ ''_ \ |_ \ | || | | | / \ __/ | | | ___) || || |_| | /_/\_\___|_| |_| |____(_)_(_)___/ http://www.cl.cam.ac.uk/netos/xen University of Cambridge Computer Laboratory Xen version 3.1.0 (root@localdomain) (gcc version 4.1.1 20070105 (Red Hat 4.1.1-52)) Tue Sep 11 00:36:30 PDT 2007 Latest ChangeSet: unavailable (XEN) Command line: /xen-2.6.18-xen.15042_1.gz com1=115200,8n1 (XEN) 0000000000000000 - 000000000009d000 (usable) (XEN) 000000000009d400 - 00000000000a0000 (reserved) (XEN) 00000000000e4000 - 0000000000100000 (reserved) (XEN) 0000000000100000 - 00000000cff60000 (usable) (XEN) 00000000cff60000 - 00000000cff69000 (ACPI data) (XEN) 00000000cff69000 - 00000000cff80000 (ACPI NVS) (XEN) 00000000cff80000 - 00000000d0000000 (reserved) (XEN) 00000000e0000000 - 00000000f0000000 (reserved) (XEN) 00000000fec00000 - 00000000fec10000 (reserved) (XEN) 00000000fee00000 - 00000000fee01000 (reserved) (XEN) 00000000ff000000 - 0000000100000000 (reserved) (XEN) 0000000100000000 - 0000000230000000 (usable) (XEN) System RAM: 8190MB (8387572kB) (XEN) Xen heap: 9MB (10020kB) (XEN) Domain heap initialised: DMA width 32 bits (XEN) PAE enabled, limit: 16 GB (XEN) Processor #0 6:15 APIC version 20 (XEN) Processor #6 6:15 APIC version 20 (XEN) Processor #1 6:15 APIC version 20 (XEN) Processor #7 6:15 APIC version 20 (XEN) IOAPIC[0]: apic_id 2, version 32, address 0xfec00000, GSI 0-23 (XEN) IOAPIC[1]: apic_id 3, version 32, address 0xfec80000, GSI 24-47 (XEN) Enabling APIC mode: Flat. Using 2 I/O APICs (XEN) Using scheduler: SMP Credit Scheduler (credit) (XEN) Detected 2000.101 MHz processor. (XEN) VMX disabled by Feature Control MSR. (XEN) CPU0: Intel(R) Xeon(R) CPU 5130 @ 2.00GHz stepping 06 (XEN) Mapping cpu 0 to node 255 (XEN) Booting processor 1/6 eip 90000 (XEN) Mapping cpu 1 to node 255 (XEN) VMX disabled by Feature Control MSR. (XEN) CPU1: Intel(R) Xeon(R) CPU 5130 @ 2.00GHz stepping 06 (XEN) Booting processor 2/1 eip 90000 (XEN) Mapping cpu 2 to node 255 (XEN) VMX disabled by Feature Control MSR. (XEN) CPU2: Intel(R) Xeon(R) CPU 5130 @ 2.00GHz stepping 06 (XEN) Booting processor 3/7 eip 90000 (XEN) Mapping cpu 3 to node 255 (XEN) VMX disabled by Feature Control MSR. (XEN) CPU3: Intel(R) Xeon(R) CPU 5130 @ 2.00GHz stepping 06 (XEN) Total of 4 processors activated. (XEN) ENABLING IO-APIC IRQs (XEN) -> Using new ACK method (XEN) Platform timer is 1.193MHz PIT (XEN) Brought up 4 CPUs (XEN) *** LOADING DOMAIN 0 *** (XEN) Xen kernel: 32-bit, PAE, lsb (XEN) Dom0 kernel: 32-bit, PAE, lsb, paddr 0xc0100000 -> 0xc044153c (XEN) PHYSICAL MEMORY ARRANGEMENT: (XEN) Dom0 alloc.: 000000007e000000->0000000080000000 (2036959 pages to be allocated) (XEN) VIRTUAL MEMORY ARRANGEMENT: (XEN) Loaded kernel: c0100000->c044153c (XEN) Init. ramdisk: c0442000->c0965c00 (XEN) Phys-Mach map: c0966000->c113337c (XEN) Start info: c1134000->c113446c (XEN) Page tables: c1135000->c1144000 (XEN) Boot stack: c1144000->c1145000 (XEN) TOTAL: c0000000->c1400000 (XEN) ENTRY ADDRESS: c0100000 (XEN) Dom0 has maximum 4 VCPUs (XEN) Initrd len 0x523c00, start at 0xc0442000 (XEN) Scrubbing Free RAM: .done. (XEN) Xen trace buffers: disabled (XEN) Std. Loglevel: Errors and warnings (XEN) Guest Loglevel: Nothing (Rate-limited: Errors and warnings) (XEN) Xen is relinquishing VGA console. (XEN) *** Serial input -> DOM0 (type ''CTRL-a'' three times to switch input to Xen). Linux version 2.6.18-xen.15042_1 (root@devhost1.localdomain) (gcc version 4.1.1 20070105 (Red Hat 4.1.1-52)) #1 SMP Tue Sep 11 00:34:59 PDT 2007 BIOS-provided physical RAM map: Xen: 0000000000000000 - 00000001f3cdf000 (usable) 7268MB HIGHMEM available. 727MB LOWMEM available. NX (Execute Disable) protection: active found SMP MP-table at 000f5f00 DMI present. ACPI: LAPIC (acpi_id[0x00] lapic_id[0x00] enabled) ACPI: LAPIC (acpi_id[0x01] lapic_id[0x06] enabled) ACPI: LAPIC (acpi_id[0x02] lapic_id[0x01] enabled) ACPI: LAPIC (acpi_id[0x03] lapic_id[0x07] enabled) ACPI: LAPIC_NMI (acpi_id[0x00] high edge lint[0x1]) ACPI: LAPIC_NMI (acpi_id[0x01] high edge lint[0x1]) ACPI: LAPIC_NMI (acpi_id[0x02] high edge lint[0x1]) ACPI: LAPIC_NMI (acpi_id[0x03] high edge lint[0x1]) ACPI: IOAPIC (id[0x02] address[0xfec00000] gsi_base[0]) IOAPIC[0]: apic_id 2, version 32, address 0xfec00000, GSI 0-23 ACPI: IOAPIC (id[0x03] address[0xfec80000] gsi_base[24]) IOAPIC[1]: apic_id 3, version 32, address 0xfec80000, GSI 24-47 ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 high edge) ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) Enabling APIC mode: Flat. Using 2 I/O APICs Using ACPI (MADT) for SMP configuration information Allocating PCI resources starting at d1000000 (gap: d0000000:10000000) Detected 2000.165 MHz processor. Built 1 zonelists. Total pages: 2047199 Kernel command line: ro root=/dev/VolGroup00/LogVol00 console=ttyS0, 115200 Enabling fast FPU save and restore... done. Enabling unmasked SIMD FPU exception support... done. Initializing CPU#0 PID hash table entries: 4096 (order: 12, 16384 bytes) Xen reported: 2000.100 MHz processor. Console: colour VGA+ 80x50 Dentry cache hash table entries: 131072 (order: 7, 524288 bytes) Inode-cache hash table entries: 65536 (order: 6, 262144 bytes) Software IO TLB enabled: Aperture: 64 megabytes Kernel range: c5810000 - c9810000 Address size: 27 bits vmalloc area: ee000000-f51fe000, maxmem 2d7fe000 Memory: 8030388k/8188796k available (2027k kernel code, 149084k reserved, 697k data, 192k init, 7443332k high mem) Checking if this processor honours the WP bit even in supervisor mode... Ok. Calibrating delay using timer specific routine.. 4002.63 BogoMIPS (lpj=20013150) Security Framework v1.0.0 initialized Capability LSM initialized Mount-cache hash table entries: 512 CPU: L1 I cache: 32K, L1 D cache: 32K CPU: L2 cache: 4096K Checking ''hlt'' instruction... OK. SMP alternatives: switching to UP code ACPI: Core revision 20060707 ENABLING IO-APIC IRQs SMP alternatives: switching to SMP code Initializing CPU#1 Initializing CPU#2 Brought up 4 CPUs Initializing CPU#3 migration_cost=9727 checking if image is initramfs... it is Freeing initrd memory: 5263k freed NET: Registered protocol family 16 ACPI: bus type pci registered PCI: Using MMCONFIG PCI: No mmconfig possible on a:1 Setting up standard PCI resources ACPI: Interpreter enabled ACPI: Using IOAPIC for interrupt routing ACPI: PCI Root Bridge [PCI0] (0000:00) PCI: Ignoring BAR0-3 of IDE controller 0000:00:1f.1 PCI: PXH quirk detected, disabling MSI for SHPC device PCI: Transparent bridge - 0000:00:1e.0 ACPI: PCI Interrupt Link [LNKA] (IRQs 3 4 5 6 *7 10 11 14 15) ACPI: PCI Interrupt Link [LNKB] (IRQs 3 4 *5 6 7 10 11 14 15) ACPI: PCI Interrupt Link [LNKC] (IRQs 3 4 5 6 7 10 *11 14 15) ACPI: PCI Interrupt Link [LNKD] (IRQs 3 4 5 6 7 *10 11 14 15) ACPI: PCI Interrupt Link [LNKE] (IRQs 3 4 5 6 7 10 11 14 15) *0, disabled. ACPI: PCI Interrupt Link [LNKF] (IRQs 4 5 6 7 10 11 14 15) *0, disabled. ACPI: PCI Interrupt Link [LNKG] (IRQs 3 4 5 6 7 10 11 14 15) *0, disabled. ACPI: PCI Interrupt Link [LNKH] (IRQs 4 5 6 7 10 11 14 15) *0, disabled. Linux Plug and Play Support v0.97 (c) Adam Belay pnp: PnP ACPI init (XEN) ioapic_guest_write: apic=0, pin=4, old_irq=4, new_irq=4 (XEN) ioapic_guest_write: old_entry=000009f1, new_entry=000109f1 (XEN) ioapic_guest_write: Attempt to modify IO-APIC pin for in-use IRQ! pnp: PnP ACPI: found 12 devices xen_mem: Initialising balloon driver. PCI: Using ACPI for IRQ routing PCI: If a device doesn''t work, try "pci=routeirq". If it helps, post a report PCI: Bridge: 0000:02:00.0 IO window: disabled. MEM window: disabled. PREFETCH window: disabled. PCI: Bridge: 0000:02:02.0 IO window: 2000-2fff MEM window: da000000-da0fffff PREFETCH window: disabled. PCI: Bridge: 0000:01:00.0 IO window: 2000-2fff MEM window: da000000-da0fffff PREFETCH window: disabled. PCI: Bridge: 0000:01:00.3 IO window: disabled. MEM window: disabled. PREFETCH window: disabled. PCI: Bridge: 0000:00:02.0 IO window: 2000-2fff MEM window: da000000-da1fffff PREFETCH window: disabled. PCI: Bridge: 0000:00:04.0 IO window: 3000-3fff MEM window: da300000-da3fffff PREFETCH window: d8000000-d9ffffff PCI: Bridge: 0000:00:06.0 IO window: disabled. MEM window: disabled. PREFETCH window: disabled. PCI: Bridge: 0000:08:00.0 IO window: disabled. MEM window: disabled. PREFETCH window: disabled. PCI: Bridge: 0000:00:1c.0 IO window: disabled. MEM window: disabled. PREFETCH window: disabled. PCI: Bridge: 0000:00:1e.0 IO window: 4000-4fff MEM window: da200000-da2fffff PREFETCH window: d0000000-d7ffffff ACPI: PCI Interrupt 0000:00:02.0[A] -> GSI 16 (level, low) -> IRQ 16 ACPI: PCI Interrupt 0000:01:00.0[A] -> GSI 16 (level, low) -> IRQ 16 ACPI: PCI Interrupt 0000:02:00.0[A] -> GSI 16 (level, low) -> IRQ 16 ACPI: PCI Interrupt 0000:02:02.0[A] -> GSI 18 (level, low) -> IRQ 17 ACPI: PCI Interrupt 0000:00:04.0[A] -> GSI 16 (level, low) -> IRQ 16 ACPI: PCI Interrupt 0000:00:06.0[A] -> GSI 16 (level, low) -> IRQ 16 ACPI: PCI Interrupt 0000:00:1c.0[A] -> GSI 17 (level, low) -> IRQ 18 NET: Registered protocol family 2 IP route cache hash table entries: 32768 (order: 5, 131072 bytes) TCP established hash table entries: 524288 (order: 10, 4194304 bytes) TCP bind hash table entries: 65536 (order: 7, 524288 bytes) TCP: Hash tables configured (established 524288 bind 65536) TCP reno registered Simple Boot Flag at 0x38 set to 0x1 IA-32 Microcode Update Driver: v1.14a-xen <tigran@veritas.com> audit: initializing netlink socket (disabled) audit(1189523518.370:1): initialized highmem bounce pool size: 64 pages VFS: Disk quotas dquot_6.5.1 Dquot-cache hash table entries: 1024 (order 0, 4096 bytes) Initializing Cryptographic API io scheduler noop registered io scheduler anticipatory registered io scheduler deadline registered io scheduler cfq registered (default) Floppy drive(s): fd0 is 1.44M FDC 0 is a post-1991 82077 RAMDISK driver initialized: 16 RAM disks of 16384K size 1024 blocksize loop: loaded (max 8 devices) Xen virtual console successfully installed as ttyS0 Event-channel device installed. Uniform Multi-Platform E-IDE driver Revision: 7.00alpha2 ide: Assuming 33MHz system bus speed for PIO modes; override with idebus=xx PNP: PS/2 Controller [PNP0303:KBC0,PNP0f13:MSE0] at 0x60,0x64 irq 1,12 serio: i8042 AUX port at 0x60,0x64 irq 12 serio: i8042 KBD port at 0x60,0x64 irq 1 mice: PS/2 mouse device common for all mice md: md driver 0.90.3 MAX_MD_DEVS=256, MD_SB_DISKS=27 md: bitmap version 4.39 NET: Registered protocol family 1 NET: Registered protocol family 17 Using IPI No-Shortcut mode Freeing unused kernel memory: 192k freed Red Hat nash version 5.1.19.6 starting Mounting proc filesystem Mounting sysfs filesystem Creating /dev Creating initial device nodes Setting up hotplug. Creating block device nodes. Loading usbcore.ko module usbcore: registered new driver usbfs usbcore: registered new driver hub Loading uhci-hcd.ko module USB Universal Host Controller Interface driver v3.0 ACPI: PCI Interrupt 0000:00:1d.0[A] -> GSI 17 (level, low) -> IRQ 18 uhci_hcd 0000:00:1d.0: UHCI Host Controller uhci_hcd 0000:00:1d.0: new USB bus registered, assigned bus number 1 uhci_hcd 0000:00:1d.0: irq 18, io base 0x00001800 usb usb1: configuration #1 chosen from 1 choice hub 1-0:1.0: USB hub found hub 1-0:1.0: 2 ports detected ACPI: PCI Interrupt 0000:00:1d.1[B] -> GSI 19 (level, low) -> IRQ 19 uhci_hcd 0000:00:1d.1: UHCI Host Controller uhci_hcd 0000:00:1d.1: new USB bus registered, assigned bus number 2 uhci_hcd 0000:00:1d.1: irq 19, io base 0x00001820 usb usb2: configuration #1 chosen from 1 choice hub 2-0:1.0: USB hub found hub 2-0:1.0: 2 ports detected ACPI: PCI Interrupt 0000:00:1d.2[C] -> GSI 18 (level, low) -> IRQ 17 uhci_hcd 0000:00:1d.2: UHCI Host Controller uhci_hcd 0000:00:1d.2: new USB bus registered, assigned bus number 3 uhci_hcd 0000:00:1d.2: irq 17, io base 0x00001840 usb usb3: configuration #1 chosen from 1 choice hub 3-0:1.0: USB hub found hub 3-0:1.0: 2 ports detected ACPI: PCI Interrupt 0000:00:1d.3[D] -> GSI 16 (level, low) -> IRQ 16 uhci_hcd 0000:00:1d.3: UHCI Host Controller uhci_hcd 0000:00:1d.3: new USB bus registered, assigned bus number 4 uhci_hcd 0000:00:1d.3: irq 16, io base 0x00001860 usb usb4: configuration #1 chosen from 1 choice hub 4-0:1.0: USB hub found hub 4-0:1.0: 2 ports detected usb 1-1: new low speed USB device using uhci_hcd and address 2 Loading ohci-hcd.ko module Loading ehci-hcd.ko module ACPI: PCI Interrupt 0000:00:1d.7[A] -> GSI 17 (level, low) -> IRQ 18 ehci_hcd 0000:00:1d.7: EHCI Host Controller ehci_hcd 0000:00:1d.7: new USB bus registered, assigned bus number 5 ehci_hcd 0000:00:1d.7: debug port 1 ehci_hcd 0000:00:1d.7: irq 18, io mem 0xda600000 ehci_hcd 0000:00:1d.7: USB 2.0 started, EHCI 1.00, driver 10 Dec 2004 usb usb5: configuration #1 chosen from 1 choice hub 5-0:1.0: USB hub found hub 5-0:1.0: 8 ports detected usb 1-1: device not accepting address 2, error -71 usb 1-1: new low speed USB device using uhci_hcd and address 4 usb 1-1: configuration #1 chosen from 1 choice usb 1-2: new low speed USB device using uhci_hcd and address 5 usb 1-2: configuration #1 chosen from 1 choice end_request: I/O error, dev fd0, sector 0 end_request: I/O error, dev fd0, sector 0 Buffer I/O error on device fd0, logical block 0 end_request: I/O error, dev fd0, sector 0 Buffer I/O error on device fd0, logical block 0 Loading jbd.ko module Loading ext3.ko module Loading scsi_mod.ko module SCSI subsystem initialized Loading sd_mod.ko module Loading 3w-9xxx.ko module 3ware 9000 Storage Controller device driver for Linux v2.26.06.002-2.6.19. ACPI: PCI Interrupt 0000:06:00.0[A] -> GSI 16 (level, low) -> IRQ 16 3w-9xxx: scsi0: AEN: INFO (0x04:0x0001): Controller reset occurred:resets=1. scsi0 : 3ware 9000 Storage Controller 3w-9xxx: scsi0: Found a 3ware 9000 Storage Controller at 0xda300000, IRQ: 16. 3w-9xxx: ERROR: (0x03:0x0000): <NULL>:. 3w-9xxx: scsi0: ERROR: (0x06:0x0013): No valid response during get param. BUG: unable to handle kernel NULL pointer dereference at virtual address 00000000 printing eip: ee0fb581 00499000 -> *pde = 00000000:7e49a001 0049a000 -> *pme = 00000000:00000000 Oops: 0000 [#1] SMP Modules linked in: 3w_9xxx sd_mod scsi_mod ext3 jbd ehci_hcd ohci_hcd uhci_hcd usbcore CPU: 2 EIP: 0061:[<ee0fb581>] Not tainted VLI EFLAGS: 00010286 (2.6.18-xen.15042_1 #1) EIP is at twa_probe+0x5c1/0x7c0 [3w_9xxx] eax: 00000000 ebx: 00000000 ecx: 00000402 edx: 00000001 esi: c08f3400 edi: da300000 ebp: ed7502d8 esp: c0555e04 ds: 007b es: 007b ss: 0069 Process insmod (pid: 896, ti=c0554000 task=ece070c0 task.ti=c0554000) Stack: 00000003 00000001 da300000 00000010 ee0ffd2c ed750000 00000000 ee0ffd2c c08f3400 ee0ffd00 c0359620 c01f2ed6 c08f3448 c08f3448 ee0ffd2c c0236d74 c03192b0 c067c8a0 c03192b0 c04d05c0 c08f3448 c08fbc48 ee0ffd2c c0236ef2 Call Trace: [<c01f2ed6>] pci_device_probe+0x56/0x80 [<c0236d74>] driver_probe_device+0x44/0xc0 [<c0236ef2>] __driver_attach+0x82/0x90 [<c02366ea>] bus_for_each_dev+0x3a/0x60 [<c0236cb6>] driver_attach+0x16/0x20 [<c0236e70>] __driver_attach+0x0/0x90 [<c023635c>] bus_add_driver+0x8c/0x140 [<c01f3077>] __pci_register_driver+0x47/0x70 [<c01414ab>] sys_init_module+0x15b/0x1b40 [<c010568f>] syscall_call+0x7/0xb Code: d2 b9 03 04 00 00 ba 02 00 00 00 89 e8 c7 44 24 04 01 00 00 00 c7 04 24 03 00 00 00 e8 49 d5 ff ff b9 0 2 04 00 00 ba 01 00 00 00 <8b> 38 89 e8 c7 44 24 04 10 00 00 00 c7 04 24 04 00 00 00 e8 27 EIP: [<ee0fb581>] twa_probe+0x5c1/0x7c0 [3w_9xxx] SS:ESP 0069:c0555e04 Loading ide-disk.ko module Loading dm-mod.ko module <6>device-mapper: ioctl: 4.7.0-ioctl (2006-06-24) initialised: dm-devel@redhat.com Loading dm-mirror.ko module Loading dm-zero.ko module Loading dm-snapshot.ko module Waiting for driver initialization. Making device-mapper control node Scanning logical volumes Reading all physical volumes. This may take a while... No volume groups found Activating logical volumes Volume group "VolGroup00" not found Creating root device. end_request: I/O error, dev fd0, sector 0 end_request: I/O error, dev fd0, sector 0 Buffer I/O error on device fd0, logical block 0 end_request: I/O error, dev fd0, sector 0 Buffer I/O error on device fd0, logical block 0 Mounting root filesystem. end_request: I/O error, dev fd0, sector 0 end_request: I/O error, dev fd0, sector 0 Buffer I/O error on device fd0, logical block 0 end_request: I/O error, dev fd0, sector 0 Buffer I/O error on device fd0, logical block 0 mount: could not find filesystem ''/dev/root'' Setting up other filesystems. Setting up new root fs setuproot: moving /dev failed: No such file or directory no fstab.sys, mounting internal defaults setuproot: error mounting /proc: No such file or directory setuproot: error mounting /sys: No such file or directory Switching to new root and running init. unmounting old /dev unmounting old /proc unmounting old /sys switchroot: mount failed: No such file or directory Kernel panic - not syncing: Attempted to kill init! (XEN) Domain 0 crashed: rebooting machine in 5 seconds. _______________________________________________ Xen-devel mailing list Xen-devel@lists.xensource.com http://lists.xensource.com/xen-devel
On 11/9/07 08:17, "Shaun R." <mailinglists@unix-scripts.com> wrote:> If i download, > extract and copy over the new 3ware drivers for 2.6.18 and built it without > xen being patched the system detects and boots the 3ware card fine. Can > anybody shed some light on what might be happening here? Below is a bootup > log i grabbed via serial... Scroll to the bottom if you want to see the > BUG/OOPS.Please also provide the dmesg output for your patched native 2.6.18 bootup. -- Keir _______________________________________________ Xen-devel mailing list Xen-devel@lists.xensource.com http://lists.xensource.com/xen-devel
Here''s a snip from the serial of the kernel booting using native 2.6.18 with the only change being that i updated the 3ware drivers. Note; that this kernel was patched with the 2.6.18 3ware driver, not the 2.6.19 and newer... If you want to see this kernel patched with the 2.6.19 driver i can do that... hub 5-0:1.0: USB hub found hub 5-0:1.0: 8 ports detected Loading jbd.ko musb 1-1: USB disconnect, address 2 odule Loading ext3.ko module Loading scsi_mod.ko module SCSI subsystem initialized Loading sd_mod.ko module Loadin3ware 9000 Storage Controller device driver for Linux v2.26.06.002-2.6.18. g 3w-9xxx.ko modACPI: PCI Interrupt 0000:06:00.0[A] -> ule GSI 16 (level, low) -> IRQ 169 scsi0 : 3ware 9000 Storage Controller 3w-9xxx: scsi0: Found a 3ware 9000 Storage Controller at 0xda300000, IRQ: 169. 3w-9xxx: scsi0: Firmware FE9X 3.08.02.005, BIOS BE9X 3.08.00.002, Ports: 4. Vendor: AMCC Model: 9650SE-4LP DISK Rev: 3.08 Type: Direct-Access ANSI SCSI revision: 05 SCSI device sda: 1953083392 512-byte hdwr sectors (999979 MB) sda: Write Protect is off SCSI device sda: drive cache: write back, no read (daft) SCSI device sda: 1953083392 512-byte hdwr sectors (999979 MB) sda: Write Protect is off SCSI device sda: drive cache: write back, no read (daft) sda: sda1 sda2 sda3 sd 0:0:0:0: Attached scsi disk sda Loading dm-mod.ko module device-mapper: ioctl: 4.7.0-ioctl (2006-06-24) initialised: dm-devel@redhat.com Loading dm-mirror.ko module Loading dm-zero.ko module Loading dm-snapshot.ko module Waiting for driver initialization. usb 1-1: new low speed USB device using uhci_hcd and address 3 usb 1-1: configuration #1 chosen from 1 choice input: Logitech USB-PS/2 Optical Mouse as /class/input/input1 input: USB HID v1.10 Mouse [Logitech USB-PS/2 Optical Mouse] on usb-0000:00:1d.0-1 usb 1-2: new low speed USB device using uhci_hcd and address 4 usb 1-2: configuration #1 chosen from 1 choice input: Microsoft Comfort Curve Keyboard 2000 as /class/input/input2 input: USB HID v1.11 Keyboard [Microsoft Comfort Curve Keyboard 2000] on usb-0000:00:1d.0-2 input: Microsoft Comfort Curve Keyboard 2000 as /class/input/input3 input: USB HID v1.11 Device [Microsoft Comfort Curve Keyboard 2000] on usb-0000:00:1d.0-2 Making device-mapper control node Scanning logical volumes Reading all physical volumes. This may take a while... Found volume group "VolGroup00" using metadata type lvm2 Found volume group "VolGroup01" using metadata type lvm2 Activating logical volumes 3 logical volume(s) in volume group "VolGroup00" now active Trying to resume from /dev/VolGroup00/LogVol01 No suspend signature on swap, not resuming. Creating root device. Mounting root filesystem. kjournald starting. Commit interval 5 seconds EXT3-fs: mounted filesystem with ordered data mode. Setting up other filesystems. Setting up new root fs no fstab.sys, mounting internal defaults Switching to new root and running init. unmounting old /dev unmounting old /proc unmounting old /sys SELinux: Disabled at runtime. SELinux: Unregistering netfilter hooks audit(1189571960.209:2): selinux=0 auid=4294967295 INIT: version 2.86 booting Welcome to CentOS release 5 (Final) Press ''I'' to enter interactive startup. Setting clock (utc): Tue Sep 11 21:39:22 PDT 2007 [ OK ] Starting udev: [ OK ] Loading default keymap (us): [ OK ] Setting hostname devhost1.localdomain: [ OK ] Setting up Logical Volume Management: 3 logical volume(s) in volume group "VolGroup00" now active 1 logical volume(s) in volume group "VolGroup01" now active [ OK ] Checking filesystems Checking all file systems. [/sbin/fsck.ext3 (1) -- /] fsck.ext3 -a /dev/VolGroup00/LogVol00 /dev/VolGroup00/LogVol00: clean, 292291/23035904 files, 2127377/23035904 blocks [/sbin/fsck.ext3 (1) -- /boot] fsck.ext3 -a /dev/sda1 /boot: clean, 46/255232 files, 18123/255024 blocks [/sbin/fsck.ext3 (1) -- /data] fsck.ext3 -a /dev/VolGroup01/LogVol00 /dev/VolGroup01/LogVol00: clean, 11/51216384 files, 1651821/51191808 blocks [/sbin/fsck.ext3 (1) -- /tmp] fsck.ext3 -a /dev/VolGroup00/LogVol02 /dev/VolGroup00/LogVol02: clean, 12/1532576 files, 83797/1531904 blocks [ OK ] Remounting root filesystem in read-write mode: [ OK ] Mounting local filesystems: [ OK ] Enabling /etc/fstab swaps: [ OK ] INIT: Entering runlevel: 3 Entering non-interactive startup Starting sysstat: Calling the system activity data collector (sadc): [ OK ] Bringing up loopback interface: [ OK ] Bringing up interface eth0: [ OK ] Starting system logger: [ OK ] Starting kernel logger: [ OK ] Mounting other filesystems: [ OK ] Starting sshd: [ OK ] Starting console mouse services: [ OK ] Starting crond: [ OK ] _______________________________________________ Xen-devel mailing list Xen-devel@lists.xensource.com http://lists.xensource.com/xen-devel
Here is the serial output from a kernel patched with 3.0.4. The xen.gz is 3.1 and the same exact file/version i used to boot 2.6.18 thats having the BUG. Also the 3ware driver in this kernel may be a bit older because i build this kernel a while ago... Kernel Version: 2.6.16.38 Xen Patch Changeset: 13139 __ __ _____ _ ___ \ \/ /___ _ __ |___ / / | / _ \ \ // _ \ ''_ \ |_ \ | || | | | / \ __/ | | | ___) || || |_| | /_/\_\___|_| |_| |____(_)_(_)___/ http://www.cl.cam.ac.uk/netos/xen University of Cambridge Computer Laboratory Xen version 3.1.0 (root@localdomain) (gcc version 4.1.1 20070105 (Red Hat 4.1.1-52)) Tue Sep 11 00:36:30 PDT 2007 Latest ChangeSet: unavailable (XEN) Command line: /xen-2.6.18-xen.15042_1.gz com1=115200,8n1 (XEN) 0000000000000000 - 000000000009d000 (usable) (XEN) 000000000009d400 - 00000000000a0000 (reserved) (XEN) 00000000000e4000 - 0000000000100000 (reserved) (XEN) 0000000000100000 - 00000000cff60000 (usable) (XEN) 00000000cff60000 - 00000000cff69000 (ACPI data) (XEN) 00000000cff69000 - 00000000cff80000 (ACPI NVS) (XEN) 00000000cff80000 - 00000000d0000000 (reserved) (XEN) 00000000e0000000 - 00000000f0000000 (reserved) (XEN) 00000000fec00000 - 00000000fec10000 (reserved) (XEN) 00000000fee00000 - 00000000fee01000 (reserved) (XEN) 00000000ff000000 - 0000000100000000 (reserved) (XEN) 0000000100000000 - 0000000230000000 (usable) (XEN) System RAM: 8190MB (8387572kB) (XEN) Xen heap: 9MB (10020kB) (XEN) Domain heap initialised: DMA width 32 bits (XEN) PAE enabled, limit: 16 GB (XEN) Processor #0 6:15 APIC version 20 (XEN) Processor #6 6:15 APIC version 20 (XEN) Processor #1 6:15 APIC version 20 (XEN) Processor #7 6:15 APIC version 20 (XEN) IOAPIC[0]: apic_id 2, version 32, address 0xfec00000, GSI 0-23 (XEN) IOAPIC[1]: apic_id 3, version 32, address 0xfec80000, GSI 24-47 (XEN) Enabling APIC mode: Flat. Using 2 I/O APICs (XEN) Using scheduler: SMP Credit Scheduler (credit) (XEN) Detected 2000.136 MHz processor. (XEN) VMX disabled by Feature Control MSR. (XEN) CPU0: Intel(R) Xeon(R) CPU 5130 @ 2.00GHz stepping 06 (XEN) Mapping cpu 0 to node 255 (XEN) Booting processor 1/6 eip 90000 (XEN) Mapping cpu 1 to node 255 (XEN) VMX disabled by Feature Control MSR. (XEN) CPU1: Intel(R) Xeon(R) CPU 5130 @ 2.00GHz stepping 06 (XEN) Booting processor 2/1 eip 90000 (XEN) Mapping cpu 2 to node 255 (XEN) VMX disabled by Feature Control MSR. (XEN) CPU2: Intel(R) Xeon(R) CPU 5130 @ 2.00GHz stepping 06 (XEN) Booting processor 3/7 eip 90000 (XEN) Mapping cpu 3 to node 255 (XEN) VMX disabled by Feature Control MSR. (XEN) CPU3: Intel(R) Xeon(R) CPU 5130 @ 2.00GHz stepping 06 (XEN) Total of 4 processors activated. (XEN) ENABLING IO-APIC IRQs (XEN) -> Using new ACK method (XEN) Platform timer is 1.193MHz PIT (XEN) Brought up 4 CPUs (XEN) *** LOADING DOMAIN 0 *** (XEN) Xen kernel: 32-bit, PAE, lsb (XEN) Dom0 kernel: 32-bit, PAE, lsb, paddr 0xc0100000 -> 0xc049e33c (XEN) PHYSICAL MEMORY ARRANGEMENT: (XEN) Dom0 alloc.: 000000007e000000->0000000080000000 (2036959 pages to be allocated) (XEN) VIRTUAL MEMORY ARRANGEMENT: (XEN) Loaded kernel: c0100000->c049e33c (XEN) Init. ramdisk: c049f000->c098e800 (XEN) Phys-Mach map: c098f000->c115c37c (XEN) Start info: c115d000->c115d46c (XEN) Page tables: c115e000->c116d000 (XEN) Boot stack: c116d000->c116e000 (XEN) TOTAL: c0000000->c1400000 (XEN) ENTRY ADDRESS: c0100000 (XEN) Dom0 has maximum 4 VCPUs (XEN) Initrd len 0x4ef800, start at 0xc049f000 (XEN) Scrubbing Free RAM: .done. (XEN) Xen trace buffers: disabled (XEN) Std. Loglevel: Errors and warnings (XEN) Guest Loglevel: Nothing (Rate-limited: Errors and warnings) (XEN) Xen is relinquishing VGA console. (XEN) *** Serial input -> DOM0 (type ''CTRL-a'' three times to switch input to Xen). Linux version 2.6.16.38-xen0.13139_2 (root@host11.servers.provps.com) (gcc version 3.4.6 20060404 (Red Hat 3. 4.6-8)) #1 SMP Sat Jun 2 14:57:49 PDT 2007 BIOS-provided physical RAM map: Xen: 0000000000000000 - 00000001f3cdf000 (usable) 7268MB HIGHMEM available. 727MB LOWMEM available. NX (Execute Disable) protection: active found SMP MP-table at 000f5f00 DMI present. ACPI: LAPIC (acpi_id[0x00] lapic_id[0x00] enabled) ACPI: LAPIC (acpi_id[0x01] lapic_id[0x06] enabled) ACPI: LAPIC (acpi_id[0x02] lapic_id[0x01] enabled) ACPI: LAPIC (acpi_id[0x03] lapic_id[0x07] enabled) ACPI: LAPIC_NMI (acpi_id[0x00] high edge lint[0x1]) ACPI: LAPIC_NMI (acpi_id[0x01] high edge lint[0x1]) ACPI: LAPIC_NMI (acpi_id[0x02] high edge lint[0x1]) ACPI: LAPIC_NMI (acpi_id[0x03] high edge lint[0x1]) ACPI: IOAPIC (id[0x02] address[0xfec00000] gsi_base[0]) IOAPIC[0]: apic_id 2, version 32, address 0xfec00000, GSI 0-23 ACPI: IOAPIC (id[0x03] address[0xfec80000] gsi_base[24]) IOAPIC[1]: apic_id 3, version 32, address 0xfec80000, GSI 24-47 ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 high edge) ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) Enabling APIC mode: Flat. Using 2 I/O APICs Using ACPI (MADT) for SMP configuration information Allocating PCI resources starting at d1000000 (gap: d0000000:10000000) Built 1 zonelists Kernel command line: ro root=/dev/VolGroup00/LogVol00 console=ttyS0,115200 Enabling fast FPU save and restore... done. Enabling unmasked SIMD FPU exception support... done. Initializing CPU#0 PID hash table entries: 4096 (order: 12, 65536 bytes) Xen reported: 2000.136 MHz processor. Console: colour VGA+ 80x50 Dentry cache hash table entries: 131072 (order: 7, 524288 bytes) Inode-cache hash table entries: 65536 (order: 6, 262144 bytes) Software IO TLB enabled: Aperture: 64 megabytes Kernel range: 0x00000000c5902000 - 0x00000000c9902000 Address size: 30 bits vmalloc area: ee000000-f4ffe000, maxmem 2d7fe000 Memory: 8029108k/8188796k available (2107k kernel code, 150232k reserved, 880k data, 192k init, 7443332k high mem) Checking if this processor honours the WP bit even in supervisor mode... Ok. Calibrating delay using timer specific routine.. 5003.27 BogoMIPS (lpj=10006554) Security Framework v1.0.0 initialized SELinux: Initializing. SELinux: Starting in permissive mode selinux_register_security: Registering secondary module capability Capability LSM initialized as secondary Mount-cache hash table entries: 512 CPU: L1 I cache: 32K, L1 D cache: 32K CPU: L2 cache: 4096K CPU: L3 cache: 4096K Checking ''hlt'' instruction... OK. ENABLING IO-APIC IRQs Initializing CPU#1 Initializing CPU#2 Brought up 4 CPUs Initializing CPU#3 migration_cost=7057 checking if image is initramfs... it is Freeing initrd memory: 5054k freed Grant table initialized NET: Registered protocol family 16 ACPI: bus type pci registered PCI: Using MMCONFIG PCI: No mmconfig possible on a:1 ACPI: Subsystem revision 20060127 ACPI: Interpreter enabled ACPI: Using IOAPIC for interrupt routing ACPI: PCI Root Bridge [PCI0] (0000:00) PCI: Ignoring BAR0-3 of IDE controller 0000:00:1f.1 PCI: PXH quirk detected, disabling MSI for SHPC device PCI: Transparent bridge - 0000:00:1e.0 ACPI: PCI Interrupt Link [LNKA] (IRQs 3 4 5 6 *7 10 11 14 15) ACPI: PCI Interrupt Link [LNKB] (IRQs 3 4 *5 6 7 10 11 14 15) ACPI: PCI Interrupt Link [LNKC] (IRQs 3 4 5 6 7 10 *11 14 15) ACPI: PCI Interrupt Link [LNKD] (IRQs 3 4 5 6 7 *10 11 14 15) ACPI: PCI Interrupt Link [LNKE] (IRQs 3 4 5 6 7 10 11 14 15) *0, disabled. ACPI: PCI Interrupt Link [LNKF] (IRQs 4 5 6 7 10 11 14 15) *0, disabled. ACPI: PCI Interrupt Link [LNKG] (IRQs 3 4 5 6 7 10 11 14 15) *0, disabled. ACPI: PCI Interrupt Link [LNKH] (IRQs 4 5 6 7 10 11 14 15) *0, disabled. Linux Plug and Play Support v0.97 (c) Adam Belay pnp: PnP ACPI init (XEN) ioapic_guest_write: apic=0, pin=4, old_irq=4, new_irq=4 (XEN) ioapic_guest_write: old_entry=000009f1, new_entry=000109f1 (XEN) ioapic_guest_write: Attempt to modify IO-APIC pin for in-use IRQ! pnp: PnP ACPI: found 12 devices xen_mem: Initialising balloon driver. usbcore: registered new driver usbfs usbcore: registered new driver hub PCI: Using ACPI for IRQ routing PCI: If a device doesn''t work, try "pci=routeirq". If it helps, post a report PCI: Bridge: 0000:02:00.0 IO window: disabled. MEM window: disabled. PREFETCH window: disabled. PCI: Bridge: 0000:02:02.0 IO window: 2000-2fff MEM window: da000000-da0fffff PREFETCH window: disabled. PCI: Bridge: 0000:01:00.0 IO window: 2000-2fff MEM window: da000000-da0fffff PREFETCH window: disabled. PCI: Bridge: 0000:01:00.3 IO window: disabled. MEM window: disabled. PREFETCH window: disabled. PCI: Bridge: 0000:00:02.0 IO window: 2000-2fff MEM window: da000000-da1fffff PREFETCH window: disabled. PCI: Bridge: 0000:00:04.0 IO window: 3000-3fff MEM window: da300000-da3fffff PREFETCH window: d8000000-d9ffffff PCI: Bridge: 0000:00:06.0 IO window: disabled. MEM window: disabled. PREFETCH window: disabled. PCI: Bridge: 0000:08:00.0 IO window: disabled. MEM window: disabled. PREFETCH window: disabled. PCI: Bridge: 0000:00:1c.0 IO window: disabled. MEM window: disabled. PREFETCH window: disabled. PCI: Bridge: 0000:00:1e.0 IO window: 4000-4fff MEM window: da200000-da2fffff PREFETCH window: d0000000-d7ffffff ACPI: PCI Interrupt 0000:00:02.0[A] -> GSI 16 (level, low) -> IRQ 16 ACPI: PCI Interrupt 0000:01:00.0[A] -> GSI 16 (level, low) -> IRQ 16 ACPI: PCI Interrupt 0000:02:00.0[A] -> GSI 16 (level, low) -> IRQ 16 ACPI: PCI Interrupt 0000:02:02.0[A] -> GSI 18 (level, low) -> IRQ 17 ACPI: PCI Interrupt 0000:00:04.0[A] -> GSI 16 (level, low) -> IRQ 16 ACPI: PCI Interrupt 0000:00:06.0[A] -> GSI 16 (level, low) -> IRQ 16 ACPI: PCI Interrupt 0000:00:1c.0[A] -> GSI 17 (level, low) -> IRQ 18 Simple Boot Flag at 0x38 set to 0x1 IA-32 Microcode Update Driver: v1.14-xen <tigran@veritas.com> audit: initializing netlink socket (disabled) audit(1189582249.120:1): initialized highmem bounce pool size: 64 pages VFS: Disk quotas dquot_6.5.1 Dquot-cache hash table entries: 1024 (order 0, 4096 bytes) SELinux: Registering netfilter hooks Initializing Cryptographic API io scheduler noop registered io scheduler anticipatory registered io scheduler deadline registered io scheduler cfq registered (default) ACPI: PCI Interrupt 0000:00:02.0[A] -> GSI 16 (level, low) -> IRQ 16 assign_interrupt_mode Found MSI capability ACPI: PCI Interrupt 0000:00:04.0[A] -> GSI 16 (level, low) -> IRQ 16 assign_interrupt_mode Found MSI capability ACPI: PCI Interrupt 0000:00:06.0[A] -> GSI 16 (level, low) -> IRQ 16 assign_interrupt_mode Found MSI capability ACPI: PCI Interrupt 0000:00:1c.0[A] -> GSI 17 (level, low) -> IRQ 18 assign_interrupt_mode Found MSI capability ACPI: PCI Interrupt 0000:01:00.0[A] -> GSI 16 (level, low) -> IRQ 16 ACPI: PCI Interrupt 0000:02:00.0[A] -> GSI 16 (level, low) -> IRQ 16 assign_interrupt_mode Found MSI capability ACPI: PCI Interrupt 0000:02:02.0[A] -> GSI 18 (level, low) -> IRQ 17 assign_interrupt_mode Found MSI capability ACPI: Processor [CPU0] (supports 8 throttling states) ACPI: Processor [CPU2] (supports 8 throttling states) Real Time Clock Driver v1.12ac Linux agpgart interface v0.101 (c) Dave Jones PNP: PS/2 Controller [PNP0303:KBC0,PNP0f13:MSE0] at 0x60,0x64 irq 1,12 serio: i8042 AUX port at 0x60,0x64 irq 12 serio: i8042 KBD port at 0x60,0x64 irq 1 RAMDISK driver initialized: 16 RAM disks of 16384K size 1024 blocksize Xen virtual console successfully installed as ttyS0 Event-channel device installed. Uniform Multi-Platform E-IDE driver Revision: 7.00alpha2 ide: Assuming 33MHz system bus speed for PIO modes; override with idebus=xx ESB2: IDE controller at PCI slot 0000:00:1f.1 ACPI: PCI Interrupt 0000:00:1f.1[A] -> GSI 18 (level, low) -> IRQ 17 ESB2: chipset revision 9 ESB2: not 100% native mode: will probe irqs later ide0: BM-DMA at 0x1880-0x1887, BIOS settings: hda:pio, hdb:DMA hdb: MATSHITADVD-ROM SR-8178, ATAPI CD/DVD-ROM drive ide0 at 0x1f0-0x1f7,0x3f6 on irq 14 hdb: ATAPI 24X DVD-ROM drive, 256kB Cache, UDMA(33) Uniform CD-ROM driver Revision: 3.20 ide-floppy driver 0.99.newide usbcore: registered new driver libusual usbcore: registered new driver hiddev usbcore: registered new driver usbhid drivers/usb/input/hid-core.c: v2.6:USB HID core driver mice: PS/2 mouse device common for all mice md: md driver 0.90.3 MAX_MD_DEVS=256, MD_SB_DISKS=27 md: bitmap version 4.39 NET: Registered protocol family 2 IP route cache hash table entries: 32768 (order: 5, 131072 bytes) TCP established hash table entries: 131072 (order: 9, 2621440 bytes) TCP bind hash table entries: 65536 (order: 8, 1310720 bytes) TCP: Hash tables configured (established 131072 bind 65536) TCP reno registered TCP bic registered Initializing IPsec netlink socket NET: Registered protocol family 1 NET: Registered protocol family 17 Using IPI No-Shortcut mode Freeing unused kernel memory: 192k freed Red Hat nash version 5.1.19.6 starting Mounting proc filesystem Mounting sysfs filesystem Creating /dev Creating initial device nodes Setting up hotplug. Creating block device nodes. Loading uhci-hcd.ko module USB Universal Host Controller Interface driver v2.3 ACPI: PCI Interrupt 0000:00:1d.0[A] -> GSI 17 (level, low) -> IRQ 18 uhci_hcd 0000:00:1d.0: UHCI Host Controller uhci_hcd 0000:00:1d.0: new USB bus registered, assigned bus number 1 uhci_hcd 0000:00:1d.0: irq 18, io base 0x00001800 usb usb1: configuration #1 chosen from 1 choice hub 1-0:1.0: USB hub found hub 1-0:1.0: 2 ports detected ACPI: PCI Interrupt 0000:00:1d.1[B] -> GSI 19 (level, low) -> IRQ 19 uhci_hcd 0000:00:1d.1: UHCI Host Controller uhci_hcd 0000:00:1d.1: new USB bus registered, assigned bus number 2 uhci_hcd 0000:00:1d.1: irq 19, io base 0x00001820 usb usb2: configuration #1 chosen from 1 choice hub 2-0:1.0: USB hub found hub 2-0:1.0: 2 ports detected ACPI: PCI Interrupt 0000:00:1d.2[C] -> GSI 18 (level, low) -> IRQ 17 uhci_hcd 0000:00:1d.2: UHCI Host Controller uhci_hcd 0000:00:1d.2: new USB bus registered, assigned bus number 3 uhci_hcd 0000:00:1d.2: irq 17, io base 0x00001840 usb usb3: configuration #1 chosen from 1 choice hub 3-0:1.0: USB hub found hub 3-0:1.0: 2 ports detected ACPI: PCI Interrupt 0000:00:1d.3[D] -> GSI 16 (level, low) -> IRQ 16 uhci_hcd 0000:00:1d.3: UHCI Host Controller uhci_hcd 0000:00:1d.3: new USB bus registered, assigned bus number 4 uhci_hcd 0000:00:1d.3: irq 16, io base 0x00001860 usb usb4: configuration #1 chosen from 1 choice hub 4-0:1.0: USB hub found hub 4-0:1.0: 2 ports detected usb 1-1: new low speed USB device using uhci_hcd and address 2 Loading ohci-hcd.ko module Loading ehci-hcd.ko module ACPI: PCI Interrupt 0000:00:1d.7[A] -> GSI 17 (level, low) -> IRQ 18 ehci_hcd 0000:00:1d.7: EHCI Host Controller ehci_hcd 0000:00:1d.7: debug port 1 ehci_hcd 0000:00:1d.7: new USB bus registered, assigned bus number 5 ehci_hcd 0000:00:1d.7: irq 18, io mem 0xda600000 ehci_hcd 0000:00:1d.7: USB 2.0 started, EHCI 1.00, driver 10 Dec 2004 usb usb5: configuration #1 chosen from 1 choice hub 5-0:1.0: USB hub found hub 5-0:1.0: 8 ports detected Loading jbd.ko module Loading ext3.ko module Loading scsi_mod.ko module SCSI subsystem initialized Loading sd_mod.ko module Loading 3w-9xxx.ko module 3ware 9000 Storage Controller device driver for Linux v2.26.02.008. ACPI: PCI Interrupt 0000:06:00.0[A] -> GSI 16 (level, low) -> IRQ 16 scsi0 : 3ware 9000 Storage Controller 3w-9xxx: scsi0: Found a 3ware 9000 Storage Controller at 0xda300000, IRQ: 16. usb 1-1: device not accepting address 2, error -71 3w-9xxx: scsi0: Firmware FE9X 3.08.02.005, BIOS BE9X 3.08.00.002, Ports: 4. Vendor: AMCC Model: 9650SE-4LP DISK Rev: 3.08 Type: Direct-Access ANSI SCSI revision: 05 SCSI device sda: 1953083392 512-byte hdwr sectors (999979 MB) sda: Write Protect is off SCSI device sda: drive cache: write back, no read (daft) SCSI device sda: 1953083392 512-byte hdwr sectors (999979 MB) sda: Write Protect is off SCSI device sda: drive cache: write back, no read (daft) sda: sda1 sda2 sda3 sd 0:0:0:0: Attached scsi disk sda Loading dm-mod.ko module device-mapper: 4.5.0-ioctl (2005-10-04) initialised: dm-devel@redhat.com Loading dm-mirror.ko module Loading dm-zero.ko module Loading dm-snapshot.ko module Waiting for driver initialization. usb 1-1: new low speed USB device using uhci_hcd and address 4 usb 1-1: configuration #1 chosen from 1 choice input: Logitech USB-PS/2 Optical Mouse as /class/input/input0 input: USB HID v1.10 Mouse [Logitech USB-PS/2 Optical Mouse] on usb-0000:00:1d.0-1 usb 1-2: new low speed USB device using uhci_hcd and address 5 usb 1-2: configuration #1 chosen from 1 choice input: Microsoft Comfort Curve Keyboard 2000 as /class/input/input1 input: USB HID v1.11 Keyboard [Microsoft Comfort Curve Keyboard 2000] on usb-0000:00:1d.0-2 input: Microsoft Comfort Curve Keyboard 2000 as /class/input/input2 input: USB HID v1.11 Device [Microsoft Comfort Curve Keyboard 2000] on usb-0000:00:1d.0-2 Making device-mapper control node Scanning logical volumes Reading all physical volumes. This may take a while... Found volume group "VolGroup00" using metadata type lvm2 Found volume group "VolGroup01" using metadata type lvm2 Activating logical volumes 3 logical volume(s) in volume group "VolGroup00" now active Creating root device. Mounting root filesystem. kjournald starting. Commit interval 5 seconds EXT3-fs: mounted filesystem with ordered data mode. Setting up other filesystems. Setting up new root fs no fstab.sys, mounting internal defaults Switching to new root and running init. unmounting old /dev unmounting old /proc unmounting old /sys SELinux: Disabled at runtime. SELinux: Unregistering netfilter hooks INIT: version 2.86 booting *************************************************************** *************************************************************** ** WARNING: Currently emulating unsupported memory accesses ** ** in /lib/tls glibc libraries. The emulation is ** ** slow. To ensure full performance you should ** ** install a ''xen-friendly'' (nosegneg) version of ** ** the library, or disable tls support by executing ** ** the following as root: ** ** mv /lib/tls /lib/tls.disabled ** ** Offending process: init (pid=983) ** *************************************************************** *************************************************************** Pausing... 5Pausing... 4Pausing... 3Pausing... 2Pausing... 1Continuing... Welcome to CentOS release 5 (Final) Press ''I'' to enter interactive startup. Setting clock (utc): Wed Sep 12 00:31:04 PDT 2007 [ OK ] Starting udev: [ OK ] Loading default keymap (us): [ OK ] Setting hostname devhost1.localdomain: [ OK ] Setting up Logical Volume Management: 3 logical volume(s) in volume group "VolGroup00" now active 1 logical volume(s) in volume group "VolGroup01" now active [ OK ] Checking filesystems Checking all file systems. [/sbin/fsck.ext3 (1) -- /] fsck.ext3 -a /dev/VolGroup00/LogVol00 /dev/VolGroup00/LogVol00: clean, 293801/23035904 files, 2247030/23035904 blocks [/sbin/fsck.ext3 (1) -- /boot] fsck.ext3 -a /dev/sda1 /boot: clean, 50/255232 files, 19310/255024 blocks [/sbin/fsck.ext3 (1) -- /data] fsck.ext3 -a /dev/VolGroup01/LogVol00 /dev/VolGroup01/LogVol00: clean, 11/51216384 files, 1651821/51191808 blocks [/sbin/fsck.ext3 (1) -- /tmp] fsck.ext3 -a /dev/VolGroup00/LogVol02 /dev/VolGroup00/LogVol02: clean, 12/1532576 files, 83797/1531904 blocks [ OK ] Remounting root filesystem in read-write mode: [ OK ] Mounting local filesystems: [ OK ] Enabling /etc/fstab swaps: [ OK ] INIT: Entering runlevel: 3 Entering non-interactive startup Starting sysstat: Calling the system activity data collector (sadc): [ OK ] Bringing up loopback interface: [ OK ] Bringing up interface eth0: [ OK ] Starting system logger: [ OK ] Starting kernel logger: [ OK ] Mounting other filesystems: [ OK ] Starting sshd: [ OK ] Starting console mouse services: [ OK ] Starting crond: [ OK ] _______________________________________________ Xen-devel mailing list Xen-devel@lists.xensource.com http://lists.xensource.com/xen-devel
On 12/9/07 00:33, "Shaun R." <mailinglists@unix-scripts.com> wrote:> Here is the serial output from a kernel patched with 3.0.4. The xen.gz is > 3.1 and the same exact file/version i used to boot 2.6.18 thats having the > BUG. Also the 3ware driver in this kernel may be a bit older because i > build this kernel a while ago...So it''s not a core hypervisor issue, since new Xen works with old kernel and driver, and it doesn''t look like an IRQ routing issue because both working and non-working drivers on Xen work out the same routing. Question is then whether it''s the new driver or the new kernel causing the problem. Can you try new driver with old kernel or vice versa? If it''s not too hard to back- or forward-port. -- Keir _______________________________________________ Xen-devel mailing list Xen-devel@lists.xensource.com http://lists.xensource.com/xen-devel
Well i cant do either, at least not with out making some code changes to the driver. I guess some where between the different versions the driver i used for 2.6.16.38 will not compile for 2.6.18 and the driver for 2.6.18+ wont compile for 2.6.18.38. here''s a quick little snip of the compile error when trying to build the older driver with 2.6.18 include/asm/byteorder.h:5:28: error: linux/compiler.h: No such file or directory LD [M] drivers/scsi/scsi_mod.o CC [M] drivers/scsi/3w-9xxx.o drivers/scsi/3w-9xxx.c:202: warning: initialization from incompatible pointer type drivers/scsi/3w-9xxx.c: In function âtwa_map_scsi_sg_dataâ: drivers/scsi/3w-9xxx.c:1429: error: âstruct scsi_cmndâ has no member named âbufferâ make[2]: *** [drivers/scsi/3w-9xxx.o] Error 1 make[1]: *** [drivers/scsi] Error 2 make[1]: *** Waiting for unfinished jobs.... make: *** [drivers] Error 2 If it would be benifitial for you to have access to the server i could give you logins, this is just a machine i use for development. ~Shaun R. _______________________________________________ Xen-devel mailing list Xen-devel@lists.xensource.com http://lists.xensource.com/xen-devel
Shaun R. schrieb:> Well i cant do either, at least not with out making some code changes to > the driver. I guess some where between the different versions the > driver i used for 2.6.16.38 will not compile for 2.6.18 and the driver > for 2.6.18+ wont compile for 2.6.18.38. > > here''s a quick little snip of the compile error when trying to build the > older driver with 2.6.18Hallo! I have a 9550SX (also 3w-9xxx.c), i have 2ware-Version #define TW_DRIVER_VERSION "2.26.06.002-2.6.18" I got it from the 3ware-homepage. It compiles and works, but the tdm3 (monitoring) don''t like want to work (Email-Notify, tools,..) -- regards Robert Valentan _______________________________________________ Xen-devel mailing list Xen-devel@lists.xensource.com http://lists.xensource.com/xen-devel
Could be a issue with this kernel+driver+card. I may have a 9550 laying around, maybe i''ll try swaping that into the server just to see if it boots... The 3dm utility i gave up on a long time ago, the daemon used to send my host into a panic. I now use the tw_cli utility, much better to use in my opinion anyway. ~Shaun _______________________________________________ Xen-devel mailing list Xen-devel@lists.xensource.com http://lists.xensource.com/xen-devel
I just put a 9550-4LP card into it and same result, BUG pops up when loading the 3ware module and the system panics. Robert Valentan, Are you running Xen 3.1 and have this working, my problem is only with 3.1, the drivers work fine on 3.0.4.. ~Shaun _______________________________________________ Xen-devel mailing list Xen-devel@lists.xensource.com http://lists.xensource.com/xen-devel
ok, i finally got it to boot, i had to do some digging and used the previous 3ware driver version and it works, not here''s the diff of the two... doesnt look like too much was changed so i figured i would paste it and see if you had a idea about if the problem was with 3wares driver or somthing in the xen kernel patch... [root@devhost1 3w-drivers]# diff -dNuar 9.4.0.1 9.4.1.2 diff -dNuar 9.4.0.1/3w-9xxx.c 9.4.1.2/3w-9xxx.c --- 9.4.0.1/3w-9xxx.c 2006-10-20 13:22:02.000000000 -0700 +++ 9.4.1.2/3w-9xxx.c 2007-01-23 16:57:56.000000000 -0800 @@ -4,7 +4,7 @@ Written By: Adam Radford <linuxraid@amcc.com> Modifications By: Tom Couch <linuxraid@amcc.com> - Copyright (C) 2004-2006 Applied Micro Circuits Corporation. + Copyright (C) 2004-2007 Applied Micro Circuits Corporation. This program is free software; you can redistribute it and/or modify it under the terms of the GNU General Public License as published by @@ -66,9 +66,10 @@ 2.26.02.006 - Fix 9550SX pchip reset timeout. Add big endian support. 2.26.02.007 - Disable local interrupts during kmap/unmap_atomic(). - 2.26.02.008 - Free irq handler in __twa_shutdown(). + 2.26.06.001 - Free irq handler in __twa_shutdown(). Serialize reset code. Add support for 9650SE controllers. + 2.26.06.002 - Fix dma mask setting to fallback to 32-bit if 64-bit fails. */ #include <linux/module.h> @@ -92,7 +93,7 @@ #include "3w-9xxx.h" /* Globals */ -#define TW_DRIVER_VERSION "2.26.02.008" +#define TW_DRIVER_VERSION "2.26.06.002-2.6.19" static TW_Device_Extension *twa_device_extension_list[TW_MAX_SLOT]; static unsigned int twa_device_extension_count; static int twa_major = -1; @@ -1196,7 +1197,6 @@ u32 status_reg_value; TW_Response_Queue response_que; TW_Command_Full *full_command_packet; - TW_Command *command_packet; TW_Device_Extension *tw_dev = (TW_Device_Extension *)dev_instance; int handled = 0; @@ -1274,7 +1274,6 @@ request_id = TW_RESID_OUT(response_que.response_id); full_command_packet = tw_dev->command_packet_virt[request_id]; error = 0; - command_packet = &full_command_packet->command.oldcommand; /* Check for command packet errors */ if (full_command_packet->command.newcommand.status != 0) { if (tw_dev->srb[request_id] != 0) { @@ -2063,11 +2062,14 @@ pci_set_master(pdev); - retval = pci_set_dma_mask(pdev, sizeof(dma_addr_t) > 4 ? DMA_64BIT_MASK : DMA_32BIT_MASK); - if (retval) { - TW_PRINTK(host, TW_DRIVER, 0x23, "Failed to set dma mask"); - goto out_disable_device; - } + if (pci_set_dma_mask(pdev, DMA_64BIT_MASK) + || pci_set_consistent_dma_mask(pdev, DMA_64BIT_MASK)) + if (pci_set_dma_mask(pdev, DMA_32BIT_MASK) + || pci_set_consistent_dma_mask(pdev, DMA_32BIT_MASK)) { + TW_PRINTK(host, TW_DRIVER, 0x23, "Failed to set dma mask"); + retval = -ENODEV; + goto out_disable_device; + } host = scsi_host_alloc(&driver_template, sizeof(TW_Device_Extension)); if (!host) { @@ -2147,7 +2149,7 @@ TW_PARAM_PORTCOUNT, TW_PARAM_PORTCOUNT_LENGTH))); /* Now setup the interrupt handler */ - retval = request_irq(pdev->irq, twa_interrupt, SA_SHIRQ, "3w-9xxx", tw_dev); + retval = request_irq(pdev->irq, twa_interrupt, IRQF_SHARED, "3w-9xxx", tw_dev); if (retval) { TW_PRINTK(tw_dev->host, TW_DRIVER, 0x30, "Error requesting IRQ"); goto out_remove_host; @@ -2240,7 +2242,7 @@ { printk(KERN_WARNING "3ware 9000 Storage Controller device driver for Linux v%s.\n", TW_DRIVER_VERSION); - return pci_register_driver(&twa_driver); + return pci_module_init(&twa_driver); } /* End twa_init() */ /* This function is called on driver exit */ _______________________________________________ Xen-devel mailing list Xen-devel@lists.xensource.com http://lists.xensource.com/xen-devel
On 14/9/07 23:41, "Shaun R." <mailinglists@unix-scripts.com> wrote:> ok, i finally got it to boot, i had to do some digging and used the previous > 3ware driver version and it works, not here''s the diff of the two... doesnt > look like too much was changed so i figured i would paste it and see if you > had a idea about if the problem was with 3wares driver or somthing in the > xen kernel patch...Following chunk is the only one that could really have an effect. What happens if you revert it? -- Keir> - retval = pci_set_dma_mask(pdev, sizeof(dma_addr_t) > 4 ? > DMA_64BIT_MASK : DMA_32BIT_MASK); > - if (retval) { > - TW_PRINTK(host, TW_DRIVER, 0x23, "Failed to set dma mask"); > - goto out_disable_device; > - } > + if (pci_set_dma_mask(pdev, DMA_64BIT_MASK) > + || pci_set_consistent_dma_mask(pdev, DMA_64BIT_MASK)) > + if (pci_set_dma_mask(pdev, DMA_32BIT_MASK) > + || pci_set_consistent_dma_mask(pdev, DMA_32BIT_MASK)) { > + TW_PRINTK(host, TW_DRIVER, 0x23, "Failed to set dma > mask"); > + retval = -ENODEV; > + goto out_disable_device; > + }_______________________________________________ Xen-devel mailing list Xen-devel@lists.xensource.com http://lists.xensource.com/xen-devel
Gents, Just FYI, I ran into this 3ware 9650 / Xen 3.1 crash, and eventually saw this thread: http://lists.xensource.com/archives/html/xen-devel/2007-09/msg00330.html I confirm that just applying the small changes outlined by keir in the last mail solves the problem. I other words, it is the following piece of code in the latest 3w-9xxx.c 3ware driver which makes the difference:> if (pci_set_dma_mask(pdev, DMA_64BIT_MASK) > || pci_set_consistent_dma_mask(pdev, DMA_64BIT_MASK)) > if (pci_set_dma_mask(pdev, DMA_32BIT_MASK) > || pci_set_consistent_dma_mask(pdev, DMA_32BIT_MASK)) {Compared to the (older) working bit:> retval = pci_set_dma_mask(pdev, sizeof(dma_addr_t) > 4 ? DMA_64BIT_MASK: DMA_32BIT_MASK); -- Philippe _______________________________________________ Xen-devel mailing list Xen-devel@lists.xensource.com http://lists.xensource.com/xen-devel