thr3ads.net - freebsd stable - Unable to install 8.x on a PowerEdge R810 [Jul 2010]

If this information is useful, please help other people find it:
Share via:

Mahlon E. Smith

2010-Jul-22 21:38 UTC

Unable to install 8.x on a PowerEdge R810

Picked up a couple of these powerhouse machines to be VirtualBox hosts.
24 core, 96G of RAM. Trying to put (amd64) both 8.0-RELEASE and 8.1-RC2
on it with no luck whatsoever so far. Any help provided would be greatly
appreciated, I'm chomping at the bit pretty hard to put this hardware to
use, and was fairly surprised that FreeBSD didn't work on it through the
gate.

I've grabbed some screenshots from the DRAC, and dumped them here:

http://www.dropbox.com/gallery/7234177/1/r810?h=f5fb1d

(sorry, I realize that's not -incredibly- helpful and partially
truncated. I'm currently limited to what I can screenshot, though I
suppose I could boot via console and log it all... come to think of it,
I'll go give that a try to get more comprehensive output.)

If I disable all the CPU options in the BIOS, I can get it to boot, but
it hangs after mounting md0 (I never see the sysinstall screen.) Same
deal if I try booting in safe mode or without ACPI.

Otherwise, it spews errors for about 30 seconds so quickly I can't read
them, then panics with a page fault in swapper.

I'm sure we'd like to get BSD installing reliably on such a beast, and
I'm more than happy to play the guinea pig if someone would be willing
to provide some direction with some things to try. Help! These are
expensive paperweights! :)

--
Mahlon E. Smith
http://www.martini.nu/contact.html
-------------- next part --------------
A non-text attachment was scrubbed...
Name: not available
Type: application/pgp-signature
Size: 155 bytes
Desc: not available
Url :
http://lists.freebsd.org/pipermail/freebsd-stable/attachments/20100722/5715bb23/attachment.pgp

Sean Bruno

2010-Jul-22 22:04 UTC

head link

Unable to install 8.x on a PowerEdge R810

On Thu, 2010-07-22 at 14:38 -0700, Mahlon E. Smith
wrote:> Picked up a couple of these powerhouse machines to be VirtualBox hosts.
> 24 core, 96G of RAM.  Trying to put (amd64) both 8.0-RELEASE and 8.1-RC2
> on it with no luck whatsoever so far. Any help provided would be greatly
> appreciated, I'm chomping at the bit pretty hard to put this hardware
to
> use, and was fairly surprised that FreeBSD didn't work on it through
the
> gate.
> 
> I've grabbed some screenshots from the DRAC, and dumped them here:
> 
>     http://www.dropbox.com/gallery/7234177/1/r810?h=f5fb1d
> 
> (sorry, I realize that's not -incredibly- helpful and partially
> truncated.  I'm currently limited to what I can screenshot, though I
> suppose I could boot via console and log it all... come to think of it,
> I'll go give that a try to get more comprehensive output.)
> 
> If I disable all the CPU options in the BIOS, I can get it to boot, but
> it hangs after mounting md0 (I never see the sysinstall screen.)  Same
> deal if I try booting in safe mode or without ACPI.
> 
> Otherwise, it spews errors for about 30 seconds so quickly I can't read
> them, then panics with a page fault in swapper.
> 
> I'm sure we'd like to get BSD installing reliably on such a beast,
and
> I'm more than happy to play the guinea pig if someone would be willing
> to provide some direction with some things to try.  Help!  These are
> expensive paperweights!  :)
> 
> --
> Mahlon E. Smith  
> http://www.martini.nu/contact.html

Funny you should mention this box.  I've been arm wrestling with this
beastie for a couple of weeks and finally had some amount of success
today.

A couple of things:

1.  Reduce your RAM to 64G (seriously)
2.  Don't use the H200 Dell RAID controller.  It's not supported yet.
 -- Use the 6i or whatever the mfi(4) card is called.
3.  Don't compile in the ipmi(4) when you get the system up.
 -- I know there's an unpatched problem on 7 that is fixed in HEAD, but
    have no idea if its patched in 8
4.  Try doing serial console installs. 
 -- at the Beastie prompt, hit [6]. then at the OK prompt, type "set   
    console=comconsole"

Sean

Mahlon E. Smith

2010-Jul-22 22:08 UTC

head link

Unable to install 8.x on a PowerEdge R810

On Thu, Jul 22, 2010, Mahlon E. Smith wrote:> 
> [...]
> I suppose I could boot via console and log it all... come to think of
> it, I'll go give that a try to get more comprehensive output
Okay, here we go, output below my sig.

"panic: Built bad topology" -- oh, dear.  That's a new one for me.

Clues/suggestions happily accepted.

--
Mahlon E. Smith  
http://www.martini.nu/contact.html

OK boot -v
SMAP type=01 base=0000000000000000 len=00000000000a0000
SMAP type=01 base=0000000000100000 len=000000007f538000
SMAP type=02 base=000000007f638000 len=0000000000016000
SMAP type=03 base=000000007f64e000 len=000000000007f000
SMAP type=02 base=000000007f6cd000 len=0000000000933000
SMAP type=02 base=0000000080000000 len=0000000010000000
SMAP type=02 base=00000000f17f0000 len=0000000000002000
SMAP type=02 base=00000000fe000000 len=0000000002000000
SMAP type=01 base=0000000100000000 len=0000001780000000
Copyright (c) 1992-2010 The FreeBSD Project.
Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994
	The Regents of the University of California. All rights reserved.
FreeBSD is a registered trademark of The FreeBSD Foundation.
FreeBSD 8.1-RC2 #0: Tue Jun 29 20:21:55 UTC 2010
    root@mason.cse.buffalo.edu:/usr/obj/usr/src/sys/GENERIC amd64
Preloaded elf kernel "/boot/kernel/kernel" at 0xffffffff8126c000.
Preloaded mfs_root "/boot/mfsroot" at 0xffffffff8126c1d0.
Timecounter "i8254" frequency 1193182 Hz quality 0
Calibrating TSC clock ... TSC clock: 1995012507 Hz
CPU: Intel(R) Xeon(R) CPU           E7540  @ 2.00GHz (1995.01-MHz K8-class CPU)
  Origin = "GenuineIntel"  Id = 0x206e6  Family = 6  Model = 2e 
Stepping = 6

Features=0xbfebfbff<FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CLFLUSH,DTS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE>

Features2=0xbce3bd<SSE3,DTES64,MON,DS_CPL,VMX,EST,TM2,SSSE3,CX16,xTPR,PDCM,DCA,SSE4.1,SSE4.2,x2APIC,POPCNT>
  AMD Features=0x28100800<SYSCALL,NX,RDTSCP,LM>
  AMD Features2=0x1<LAHF>
  TSC: P-state invariant
real memory  = 103079215104 (98304 MB)
Physical memory chunk(s):
0x0000000000001000 - 0x000000000009bfff, 634880 bytes (155 pages)
0x00000000012f8000 - 0x000000007f637fff, 2117337088 bytes (516928 pages)
0x0000000100000000 - 0x00000017c7d9ffff, 97842233344 bytes (23887264 pages)
avail memory = 99488772096 (94879 MB)
ACPI APIC Table: <DELL   PE_SC3  >
INTR: Adding local APIC 1 as a target
INTR: Adding local APIC 4 as a target
INTR: Adding local APIC 5 as a target
INTR: Adding local APIC 6 as a target
INTR: Adding local APIC 7 as a target
INTR: Adding local APIC 16 as a target
INTR: Adding local APIC 17 as a target
INTR: Adding local APIC 18 as a target
INTR: Adding local APIC 19 as a target
INTR: Adding local APIC 22 as a target
INTR: Adding local APIC 23 as a target
INTR: Adding local APIC 32 as a target
INTR: Adding local APIC 33 as a target
INTR: Adding local APIC 36 as a target
INTR: Adding local APIC 37 as a target
INTR: Adding local APIC 38 as a target
INTR: Adding local APIC 39 as a target
INTR: Adding local APIC 48 as a target
INTR: Adding local APIC 49 as a target
INTR: Adding local APIC 50 as a target
INTR: Adding local APIC 51 as a target
INTR: Adding local APIC 54 as a target
INTR: Adding local APIC 55 as a target
INTR: Adding local APIC 64 as a target
INTR: Adding local APIC 65 as a target
INTR: Adding local APIC 68 as a target
INTR: Adding local APIC 69 as a target
INTR: Adding local APIC 70 as a target
INTR: Adding local APIC 71 as a target
INTR: Adding local APIC 80 as a target
INTR: Adding local APIC 81 as a target
FreeBSD/SMP: Multiprocessor System Detected: 32 CPUs
FreeBSD/SMP: 2 package(s) x 6 core(s) x 2 SMT threads
 cpu0 (BSP): APIC ID:  0
 cpu1 (AP): APIC ID:  1
 cpu2 (AP): APIC ID:  4
 cpu3 (AP): APIC ID:  5
 cpu4 (AP): APIC ID:  6
 cpu5 (AP): APIC ID:  7
 cpu6 (AP): APIC ID: 16
 cpu7 (AP): APIC ID: 17
 cpu8 (AP): APIC ID: 18
 cpu9 (AP): APIC ID: 19
 cpu10 (AP): APIC ID: 22
 cpu11 (AP): APIC ID: 23
 cpu12 (AP): APIC ID: 32
 cpu13 (AP): APIC ID: 33
 cpu14 (AP): APIC ID: 36
 cpu15 (AP): APIC ID: 37
 cpu16 (AP): APIC ID: 38
 cpu17 (AP): APIC ID: 39
 cpu18 (AP): APIC ID: 48
 cpu19 (AP): APIC ID: 49
 cpu20 (AP): APIC ID: 50
 cpu21 (AP): APIC ID: 51
 cpu22 (AP): APIC ID: 54
 cpu23 (AP): APIC ID: 55
 cpu24 (AP): APIC ID: 64
 cpu25 (AP): APIC ID: 65
 cpu26 (AP): APIC ID: 68
 cpu27 (AP): APIC ID: 69
 cpu28 (AP): APIC ID: 70
 cpu29 (AP): APIC ID: 71
 cpu30 (AP): APIC ID: 80
 cpu31 (AP): APIC ID: 81
  cpu (AP): APIC ID: 82 (disabled)
  cpu (AP): APIC ID: 83 (disabled)
  cpu (AP): APIC ID: 86 (disabled)
  cpu (AP): APIC ID: 87 (disabled)
  cpu (AP): APIC ID: 96 (disabled)
  cpu (AP): APIC ID: 97 (disabled)
  cpu (AP): APIC ID: 100 (disabled)
  cpu (AP): APIC ID: 101 (disabled)
  cpu (AP): APIC ID: 102 (disabled)
  cpu (AP): APIC ID: 103 (disabled)
  cpu (AP): APIC ID: 112 (disabled)
  cpu (AP): APIC ID: 113 (disabled)
  cpu (AP): APIC ID: 114 (disabled)
  cpu (AP): APIC ID: 115 (disabled)
  cpu (AP): APIC ID: 118 (disabled)
  cpu (AP): APIC ID: 119 (disabled)
APIC: CPU 0 has ACPI ID 1
APIC: CPU 1 has ACPI ID 25
APIC: CPU 2 has ACPI ID 5
APIC: CPU 3 has ACPI ID 29
APIC: CPU 4 has ACPI ID 9
APIC: CPU 5 has ACPI ID 33
APIC: CPU 6 has ACPI ID 13
APIC: CPU 7 has ACPI ID 37
APIC: CPU 8 has ACPI ID 17
APIC: CPU 9 has ACPI ID 41
APIC: CPU 10 has ACPI ID 21
APIC: CPU 11 has ACPI ID 45
APIC: CPU 12 has ACPI ID 2
APIC: CPU 13 has ACPI ID 26
APIC: CPU 14 has ACPI ID 6
APIC: CPU 15 has ACPI ID 30
APIC: CPU 16 has ACPI ID 10
APIC: CPU 17 has ACPI ID 34
APIC: CPU 18 has ACPI ID 14
APIC: CPU 19 has ACPI ID 38
APIC: CPU 20 has ACPI ID 18
APIC: CPU 21 has ACPI ID 42
APIC: CPU 22 has ACPI ID 22
APIC: CPU 23 has ACPI ID 46
APIC: CPU 24 has ACPI ID 3
APIC: CPU 25 has ACPI ID 27
APIC: CPU 26 has ACPI ID 7
APIC: CPU 27 has ACPI ID 31
APIC: CPU 28 has ACPI ID 11
APIC: CPU 29 has ACPI ID 35
APIC: CPU 30 has ACPI ID 15
APIC: CPU 31 has ACPI ID 39
x86bios:   IVT 0x000000-0x0004ff at 0xffffff0000000000
x86bios:  SSEG 0x010000-0x01ffff at 0xffffff8aa535f000
x86bios:  EBDA 0x09e000-0x09ffff at 0xffffff000009e000
x86bios:   ROM 0x0a0000-0x0effff at 0xffffff00000a0000
WARNING: Non-uniform processors.
WARNING: Using suboptimal topology.
panic: Built bad topology at 0xffffffff80c55e20.  CPU mask 0x0 != 0xFFFFFFFF
cpuid = 0
kernel trap 12 with interrupts disabled

Fatal trap 12: page fault while in kernel mode
cpuid = 0; apic id = 00
fault virtual address	= 0x18
fault code		= supervisor read data, page not present
instruction pointer	= 0x20:0xffffffff80595e68
stack pointer	        = 0x28:0xffffffff81270b20
frame pointer	        = 0x28:0xffffffff81270b60
code segment		= base 0x0, limit 0xfffff, type 0x1b
			= DPL 0, pres 1, long 1, def32 0, gran 1
processor eflags	= resume, IOPL = 0
current process		= 0 (swapper)
trap number		= 12
panic: page fault
cpuid = 0
kernel trap 12 with interrupts disabled

Fatal trap 12: page fault while in kernel mode
cpuid = 0; apic id = 00
fault virtual address	= 0x18
fault code		= supervisor read data, page not present
instruction pointer	= 0x20:0xffffffff80595e68
stack pointer	        = 0x28:0xffffffff81270790
frame pointer	        = 0x28:0xffffffff812707d0
code segment		= base 0x0, limit 0xfffff, type 0x1b
			= DPL 0, pres 1, long 1, def32 0, gran 1
processor eflags	= resume, IOPL = 0
current process		= 0 (swapper)
trap number		= 12
panic: page fault
cpuid = 0
kernel trap 12 with interrupts disabled

(... and so on with the page faults.)

-------------- next part --------------
A non-text attachment was scrubbed...
Name: not available
Type: application/pgp-signature
Size: 155 bytes
Desc: not available
Url :
http://lists.freebsd.org/pipermail/freebsd-stable/attachments/20100722/fd694078/attachment.pgp

freebsd stable - Jul 2010 - Unable to install 8.x on a PowerEdge R810

Unable to install 8.x on a PowerEdge R810

Unable to install 8.x on a PowerEdge R810

Unable to install 8.x on a PowerEdge R810