Hello,
maybe it is worth to say something about running FreeBSD 10.1 RC2 on
Supermicro H8QGi-F with 64 cores (4x16) and 512 GB RAM:
first of all: it runs without troubles so far... I am working in the
area of bioinformatics at University in Muenster - I run some test with
blast, installed VirtualBox which is running Ubuntu 14.04.1...
A look into the dmesg:
Copyright (c) 1992-2014 The FreeBSD Project.
Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994
The Regents of the University of California. All rights reserved.
FreeBSD is a registered trademark of The FreeBSD Foundation.
FreeBSD 10.1-RC1 #0 r272463: Fri Oct 3 01:47:10 UTC 2014
root at releng1.nyi.freebsd.org:/usr/obj/usr/src/sys/GENERIC amd64
FreeBSD clang version 3.4.1 (tags/RELEASE_34/dot1-final 208032) 20140512
CPU: AMD Opteron(tm) Processor 6378 (2400.05-MHz K8-class CPU)
Origin = "AuthenticAMD" Id = 0x600f20 Family = 0x15 Model = 0x2
Stepping = 0
Features=0x178bfbff<FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CLFLUSH,MMX,FXSR,SSE,SSE2,HTT>
Features2=0x3e98320b<SSE3,PCLMULQDQ,MON,SSSE3,FMA,CX16,SSE4.1,SSE4.2,POPCNT,AESNI,XSAVE,OSXSAVE,AVX,F16C>
AMD Features=0x2e500800<SYSCALL,NX,MMX+,FFXSR,Page1GB,RDTSCP,LM>
AMD
Features2=0x1ebbfff<LAHF,CMP,SVM,ExtAPIC,CR8,ABM,SSE4A,MAS,Prefetch,OSVW,IBS,XOP,SKINIT,WDT,LWP,FMA4,TCE,NodeId,TBM,Topology,PCXC,PNXC>
Structured Extended Features=0x8<BMI1>
TSC: P-state invariant, performance statistics
real memory = 549755813888 (524288 MB)
avail memory = 534557609984 (509793 MB)
Event timer "LAPIC" quality 400
ACPI APIC Table: <020113 APIC1548>
FreeBSD/SMP: Multiprocessor System Detected: 64 CPUs
FreeBSD/SMP: 4 package(s) x 16 core(s)
cpu0 (BSP): APIC ID: 32
cpu1 (AP): APIC ID: 33
cpu2 (AP): APIC ID: 34
cpu3 (AP): APIC ID: 35
cpu4 (AP): APIC ID: 36
cpu5 (AP): APIC ID: 37
cpu6 (AP): APIC ID: 38
cpu7 (AP): APIC ID: 39
cpu8 (AP): APIC ID: 40
cpu9 (AP): APIC ID: 41
cpu10 (AP): APIC ID: 42
cpu11 (AP): APIC ID: 43
cpu12 (AP): APIC ID: 44
cpu13 (AP): APIC ID: 45
cpu14 (AP): APIC ID: 46
cpu15 (AP): APIC ID: 47
cpu16 (AP): APIC ID: 64
cpu17 (AP): APIC ID: 65
cpu18 (AP): APIC ID: 66
cpu19 (AP): APIC ID: 67
cpu20 (AP): APIC ID: 68
cpu21 (AP): APIC ID: 69
cpu22 (AP): APIC ID: 70
cpu23 (AP): APIC ID: 71
cpu24 (AP): APIC ID: 72
cpu25 (AP): APIC ID: 73
cpu26 (AP): APIC ID: 74
cpu27 (AP): APIC ID: 75
cpu28 (AP): APIC ID: 76
cpu29 (AP): APIC ID: 77
cpu30 (AP): APIC ID: 78
cpu31 (AP): APIC ID: 79
cpu32 (AP): APIC ID: 96
cpu33 (AP): APIC ID: 97
cpu34 (AP): APIC ID: 98
cpu35 (AP): APIC ID: 99
cpu36 (AP): APIC ID: 100
cpu37 (AP): APIC ID: 101
cpu38 (AP): APIC ID: 102
cpu39 (AP): APIC ID: 103
cpu40 (AP): APIC ID: 104
cpu41 (AP): APIC ID: 105
cpu42 (AP): APIC ID: 106
cpu43 (AP): APIC ID: 107
cpu44 (AP): APIC ID: 108
cpu45 (AP): APIC ID: 109
cpu46 (AP): APIC ID: 110
cpu47 (AP): APIC ID: 111
cpu48 (AP): APIC ID: 128
cpu49 (AP): APIC ID: 129
cpu50 (AP): APIC ID: 130
cpu51 (AP): APIC ID: 131
cpu52 (AP): APIC ID: 132
cpu53 (AP): APIC ID: 133
cpu54 (AP): APIC ID: 134
cpu55 (AP): APIC ID: 135
cpu56 (AP): APIC ID: 136
cpu57 (AP): APIC ID: 137
cpu58 (AP): APIC ID: 138
cpu59 (AP): APIC ID: 139
cpu60 (AP): APIC ID: 140
cpu61 (AP): APIC ID: 141
cpu62 (AP): APIC ID: 142
cpu63 (AP): APIC ID: 143
ioapic0 <Version 2.1> irqs 0-23 on motherboard
ioapic1 <Version 2.1> irqs 24-55 on motherboard
ioapic2 <Version 2.1> irqs 56-87 on motherboard
random: <Software, Yarrow> initialized
kbd1 at kbdmux0
acpi0: <SMCI > on motherboard
acpi0: Power Button (fixed)
acpi0: reservation of fec00000, 1000 (3) failed
acpi0: reservation of fee00000, 1000 (3) failed
acpi0: reservation of ffb80000, 80000 (3) failed
acpi0: reservation of fec10000, 20 (3) failed
acpi0: reservation of 0, a0000 (3) failed
cpu0: <ACPI CPU> on acpi0
cpu1: <ACPI CPU> on acpi0
cpu2: <ACPI CPU> on acpi0
cpu3: <ACPI CPU> on acpi0
cpu4: <ACPI CPU> on acpi0
cpu5: <ACPI CPU> on acpi0
cpu6: <ACPI CPU> on acpi0
cpu7: <ACPI CPU> on acpi0
cpu8: <ACPI CPU> on acpi0
cpu9: <ACPI CPU> on acpi0
cpu10: <ACPI CPU> on acpi0
cpu11: <ACPI CPU> on acpi0
cpu12: <ACPI CPU> on acpi0
cpu13: <ACPI CPU> on acpi0
cpu14: <ACPI CPU> on acpi0
cpu15: <ACPI CPU> on acpi0
cpu16: <ACPI CPU> on acpi0
cpu17: <ACPI CPU> on acpi0
cpu18: <ACPI CPU> on acpi0
cpu19: <ACPI CPU> on acpi0
cpu20: <ACPI CPU> on acpi0
cpu21: <ACPI CPU> on acpi0
cpu22: <ACPI CPU> on acpi0
cpu23: <ACPI CPU> on acpi0
cpu24: <ACPI CPU> on acpi0
cpu25: <ACPI CPU> on acpi0
cpu26: <ACPI CPU> on acpi0
cpu27: <ACPI CPU> on acpi0
cpu28: <ACPI CPU> on acpi0
cpu29: <ACPI CPU> on acpi0
cpu30: <ACPI CPU> on acpi0
cpu31: <ACPI CPU> on acpi0
cpu32: <ACPI CPU> on acpi0
cpu33: <ACPI CPU> on acpi0
cpu34: <ACPI CPU> on acpi0
cpu35: <ACPI CPU> on acpi0
cpu36: <ACPI CPU> on acpi0
cpu37: <ACPI CPU> on acpi0
cpu38: <ACPI CPU> on acpi0
cpu39: <ACPI CPU> on acpi0
cpu40: <ACPI CPU> on acpi0
cpu41: <ACPI CPU> on acpi0
cpu42: <ACPI CPU> on acpi0
cpu43: <ACPI CPU> on acpi0
cpu44: <ACPI CPU> on acpi0
cpu45: <ACPI CPU> on acpi0
cpu46: <ACPI CPU> on acpi0
cpu47: <ACPI CPU> on acpi0
cpu48: <ACPI CPU> on acpi0
cpu49: <ACPI CPU> on acpi0
cpu50: <ACPI CPU> on acpi0
cpu51: <ACPI CPU> on acpi0
cpu52: <ACPI CPU> on acpi0
cpu53: <ACPI CPU> on acpi0
cpu54: <ACPI CPU> on acpi0
cpu55: <ACPI CPU> on acpi0
cpu56: <ACPI CPU> on acpi0
cpu57: <ACPI CPU> on acpi0
cpu58: <ACPI CPU> on acpi0
cpu59: <ACPI CPU> on acpi0
cpu60: <ACPI CPU> on acpi0
cpu61: <ACPI CPU> on acpi0
cpu62: <ACPI CPU> on acpi0
cpu63: <ACPI CPU> on acpi0
attimer0: <AT timer> port 0x40-0x43 irq 0 on acpi0
Timecounter "i8254" frequency 1193182 Hz quality 0
Event timer "i8254" frequency 1193182 Hz quality 100
atrtc0: <AT realtime clock> port 0x70-0x71 irq 8 on acpi0
Event timer "RTC" frequency 32768 Hz quality 0
hpet0: <High Precision Event Timer> iomem 0xfed00000-0xfed003ff on acpi0
Timecounter "HPET" frequency 14318180 Hz quality 950
Timecounter "ACPI-safe" frequency 3579545 Hz quality 850
acpi_timer0: <32-bit timer at 3.579545MHz> port 0x808-0x80b on acpi0
pcib0: <ACPI Host-PCI bridge> port 0xcf8-0xcff on acpi0
pci0: <ACPI PCI bus> on pcib0
pcib1: <ACPI PCI-PCI bridge> irq 54 at device 11.0 on pci0
pci3: <ACPI PCI bus> on pcib1
siis0: <SiI3132 SATA controller> port 0xe800-0xe87f mem
0xdff7bc00-0xdff7bc7f,0xdff7c000-0xdff7ffff irq 32 at device 0.0 on pci3
siisch0: <SIIS channel> at channel 0 on siis0
siisch1: <SIIS channel> at channel 1 on siis0
pcib2: <ACPI PCI-PCI bridge> irq 54 at device 13.0 on pci0
pci2: <ACPI PCI bus> on pcib2
igb0: <Intel(R) PRO/1000 Network Connection version - 2.4.0> port
0xd400-0xd41f mem
0xdfe60000-0xdfe7ffff,0xdfe40000-0xdfe5ffff,0xdfe1c000-0xdfe1ffff irq 40
at device 0.0 on pci2
igb0: Using MSIX interrupts with 9 vectors
igb0: Ethernet address: 00:25:90:5a:0c:18
igb0: Bound queue 0 to cpu 0
igb0: Bound queue 1 to cpu 1
igb0: Bound queue 2 to cpu 2
igb0: Bound queue 3 to cpu 3
igb0: Bound queue 4 to cpu 4
igb0: Bound queue 5 to cpu 5
igb0: Bound queue 6 to cpu 6
igb0: Bound queue 7 to cpu 7
igb1: <Intel(R) PRO/1000 Network Connection version - 2.4.0> port
0xd800-0xd81f mem
0xdfee0000-0xdfefffff,0xdfec0000-0xdfedffff,0xdfe9c000-0xdfe9ffff irq 41
at device 0.1 on pci2
igb1: Using MSIX interrupts with 9 vectors
igb1: Ethernet address: 00:25:90:5a:0c:19
igb1: Bound queue 0 to cpu 8
igb1: Bound queue 1 to cpu 9
igb1: Bound queue 2 to cpu 10
igb1: Bound queue 3 to cpu 11
igb1: Bound queue 4 to cpu 12
igb1: Bound queue 5 to cpu 13
igb1: Bound queue 6 to cpu 14
igb1: Bound queue 7 to cpu 15
ahci0: <AMD SB7x0/SB8x0/SB9x0 AHCI SATA controller> port
0xc000-0xc007,0xb000-0xb003,0xa000-0xa007,0x9000-0x9003,0x8000-0x800f
mem 0xdfdfa400-0xdfdfa7ff irq 22 at device 17.0 on pci0
ahci0: AHCI v1.10 with 4 3Gbps ports, Port Multiplier supported
ahcich0: <AHCI channel> at channel 0 on ahci0
ahcich1: <AHCI channel> at channel 1 on ahci0
ahcich2: <AHCI channel> at channel 2 on ahci0
ahcich3: <AHCI channel> at channel 3 on ahci0
ohci0: <AMD SB7x0/SB8x0/SB9x0 USB controller> mem 0xdfdf6000-0xdfdf6fff
irq 16 at device 18.0 on pci0
usbus0 on ohci0
ohci1: <AMD SB7x0/SB8x0/SB9x0 USB controller> mem 0xdfdf7000-0xdfdf7fff
irq 16 at device 18.1 on pci0
usbus1 on ohci1
ehci0: <AMD SB7x0/SB8x0/SB9x0 USB 2.0 controller> mem
0xdfdfa800-0xdfdfa8ff irq 17 at device 18.2 on pci0
usbus2: EHCI version 1.0
usbus2 on ehci0
ohci2: <AMD SB7x0/SB8x0/SB9x0 USB controller> mem 0xdfdf8000-0xdfdf8fff
irq 18 at device 19.0 on pci0
usbus3 on ohci2
ohci3: <AMD SB7x0/SB8x0/SB9x0 USB controller> mem 0xdfdf9000-0xdfdf9fff
irq 18 at device 19.1 on pci0
usbus4 on ohci3
ehci1: <AMD SB7x0/SB8x0/SB9x0 USB 2.0 controller> mem
0xdfdfac00-0xdfdfacff irq 19 at device 19.2 on pci0
usbus5: EHCI version 1.0
usbus5 on ehci1
atapci0: <ATI IXP700/800 UDMA133 controller> port
0x1f0-0x1f7,0x3f6,0x170-0x177,0x376,0xff00-0xff0f at device 20.1 on pci0
ata1: <ATA channel> at channel 1 on atapci0
isab0: <PCI-ISA bridge> at device 20.3 on pci0
isa0: <ISA bus> on isab0
pcib3: <ACPI PCI-PCI bridge> at device 20.4 on pci0
pci1: <ACPI PCI bus> on pcib3
vgapci0: <VGA-compatible display> mem
0xdc000000-0xdcffffff,0xdeffc000-0xdeffffff,0xdf000000-0xdf7fffff irq 20
at device 4.0 on pci1
vgapci0: Boot video device
ohci4: <AMD SB7x0/SB8x0/SB9x0 USB controller> mem 0xdfdfb000-0xdfdfbfff
irq 18 at device 20.5 on pci0
usbus6 on ohci4
pcib4: <ACPI Host-PCI bridge> on acpi0
pci64: <ACPI PCI bus> on pcib4
acpi_button0: <Power Button> on acpi0
uart0: <16550 or compatible> port 0x3f8-0x3ff irq 4 flags 0x10 on acpi0
uart1: <16550 or compatible> port 0x2f8-0x2ff irq 3 on acpi0
uart2: <16550 or compatible> port 0x3e8-0x3ef irq 5 on acpi0
orm0: <ISA Option ROMs> at iomem
0xc0000-0xc7fff,0xc8000-0xc8fff,0xc9000-0xcd7ff on isa0
sc0: <System console> at flags 0x100 on isa0
sc0: VGA <16 virtual consoles, flags=0x300>
vga0: <Generic ISA VGA> at port 0x3c0-0x3df iomem 0xa0000-0xbffff on isa0
atkbdc0: <Keyboard controller (i8042)> at port 0x60,0x64 on isa0
atkbd0: <AT Keyboard> irq 1 on atkbdc0
kbd0 at atkbd0
atkbd0: [GIANT-LOCKED]
ppc0: cannot reserve I/O port range
acpi_throttle0: <ACPI CPU Throttling> on cpu0
hwpstate0: <Cool`n'Quiet 2.0> on cpu0
(noperiph:siisch1:0:-1:ffffffff): rescan already queued
random: unblocking device.
usbus0: 12Mbps Full Speed USB v1.0
ZFS filesystem version: 5
ZFS storage pool version: features support (5000)
Timecounters tick every 1.000 msec
usbus1: 12Mbps Full Speed USB v1.0
usbus2: 480Mbps High Speed USB v2.0
usbus3: 12Mbps Full Speed USB v1.0
usbus4: 12Mbps Full Speed USB v1.0
usbus5: 480Mbps High Speed USB v2.0
usbus6: 12Mbps Full Speed USB v1.0
ugen0.1: <ATI> at usbus0
uhub0: <ATI OHCI root HUB, class 9/0, rev 1.00/1.00, addr 1> on usbus0
ugen2.1: <ATI> at usbus2
uhub1: <ATI EHCI root HUB, class 9/0, rev 2.00/1.00, addr 1> on usbus2
ugen1.1: <ATI> at usbus1
uhub2: <ATI OHCI root HUB, class 9/0, rev 1.00/1.00, addr 1> on usbus1
ugen3.1: <ATI> at usbus3
uhub3: <ATI OHCI root HUB, class 9/0, rev 1.00/1.00, addr 1> on usbus3
ugen4.1: <ATI> at usbus4
uhub4: <ATI OHCI root HUB, class 9/0, rev 1.00/1.00, addr 1> on usbus4
ugen6.1: <ATI> at usbus6
uhub5: <ATI OHCI root HUB, class 9/0, rev 1.00/1.00, addr 1> on usbus6
ugen5.1: <ATI> at usbus5
uhub6: <ATI EHCI root HUB, class 9/0, rev 2.00/1.00, addr 1> on usbus5
uhub5: 2 ports with 2 removable, self powered
uhub0: 3 ports with 3 removable, self powered
uhub2: 3 ports with 3 removable, self powered
uhub3: 3 ports with 3 removable, self powered
uhub4: 3 ports with 3 removable, self powered
ugen6.2: <American Megatrends Inc.> at usbus6
ukbd0: <Keyboard Interface> on usbus6
kbd2 at ukbd0
ada0 at ahcich0 bus 0 scbus2 target 0 lun 0
ada0: <WDC WD1003FBYZ-010FB0 01.01V03> ATA-8 SATA 3.x device
ada0: Serial Number WD-WCAW37677317
ada0: 300.000MB/s transfers (SATA 2.x, UDMA6, PIO 8192bytes)
ada0: Command Queueing enabled
ada0: 953869MB (1953525168 512 byte sectors: 16H 63S/T 16383C)
ada0: Previously was known as ad8
ada1 at ahcich1 bus 0 scbus3 target 0 lun 0
ada1: <WDC WD1003FBYZ-010FB0 01.01V03> ATA-8 SATA 3.x device
ada1: Serial Number WD-WCAW37674036
ada1: 300.000MB/s transfers (SATA 2.x, UDMA6, PIO 8192bytes)
ada1: Command Queueing enabled
ada1: 953869MB (1953525168 512 byte sectors: 16H 63S/T 16383C)
ada1: Previously was known as ad10
ada2 at ahcich2 bus 0 scbus4 target 0 lun 0
ada2: <WDC WD1003FBYZ-010FB0 01.01V03> ATA-8 SATA 3.x device
ada2: Serial Number WD-WCAW37678151
ada2: 300.000MB/s transfers (SATA 2.x, UDMA6, PIO 8192bytes)
ada2: Command Queueing enabled
ada2: 953869MB (1953525168 512 byte sectors: 16H 63S/T 16383C)
ada2: Previously was known as ad12
ada3 at ahcich3 bus 0 scbus5 target 0 lun 0
ada3: <WDC WD1003FBYZ-010FB0 01.01V03> ATA-8 SATA 3.x device
ada3: Serial Number WD-WCAW37678400
ada3: 300.000MB/s transfers (SATA 2.x, UDMA6, PIO 8192bytes)
ada3: Command Queueing enabled
ada3: 953869MB (1953525168 512 byte sectors: 16H 63S/T 16383C)
ada3: Previously was known as ad14
cd0 at siisch1 bus 0 scbus1 target 0 lun 0
cd0: <TSSTcorp CDDVDW SN-208FB SB00> Removable CD-ROM SCSI-0 device
cd0: Serial Number S1236YBF200V1L
cd0: 150.000MB/s transfers (SATA 1.x, UDMA5, PIO 8192bytes)
cd0: Attempt to query device size failed: NOT READY, Medium not present
- tray closed
SMP: AP CPU #1 Launched!
SMP: AP CPU #12 Launched!
SMP: AP CPU #13 Launched!
SMP: AP CPU #6 Launched!
SMP: AP CPU #5 Launched!
SMP: AP CPU #15 Launched!
SMP: AP CPU #14 Launched!
SMP: AP CPU #2 Launched!
SMP: AP CPU #22 Launched!
SMP: AP CPU #4 Launched!
SMP: AP CPU #10 Launched!
SMP: AP CPU #11 Launched!
SMP: AP CPU #7 Launched!
SMP: AP CPU #9 Launched!
SMP: AP CPU #8 Launched!
SMP: AP CPU #20 Launched!
SMP: AP CPU #28 Launched!
SMP: AP CPU #63 Launched!
SMP: AP CPU #46 Launched!
SMP: AP CPU #37 Launched!
SMP: AP CPU #24 Launched!
SMP: AP CPU #47 Launched!
SMP: AP CPU #30 Launched!
SMP: AP CPU #41 Launched!
SMP: AP CPU #53 Launched!
SMP: AP CPU #25 Launched!
SMP: AP CPU #54 Launched!
SMP: AP CPU #55 Launched!
SMP: AP CPU #21 Launched!
SMP: AP CPU #23 Launched!
SMP: AP CPU #56 Launched!
SMP: AP CPU #31 Launched!
SMP: AP CPU #3 Launched!
SMP: AP CPU #58 Launched!
SMP: AP CPU #51 Launched!
SMP: AP CPU #42 Launched!
SMP: AP CPU #29 Launched!
SMP: AP CPU #40 Launched!
SMP: AP CPU #62 Launched!
SMP: AP CPU #61 Launched!
SMP: AP CPU #18 Launched!
SMP: AP CPU #57 Launched!
SMP: AP CPU #19 Launched!
SMP: AP CPU #44 Launched!
SMP: AP CPU #50 Launched!
SMP: AP CPU #48 Launched!
SMP: AP CPU #32 Launched!
SMP: AP CPU #36 Launched!
SMP: AP CPU #17 Launched!
SMP: AP CPU #35 Launched!
SMP: AP CPU #52 Launched!
SMP: AP CPU #60 Launched!
SMP: AP CPU #38 Launched!
SMP: AP CPU #26 Launched!
SMP: AP CPU #16 Launched!
SMP: AP CPU #49 Launched!
SMP: AP CPU #34 Launched!
SMP: AP CPU #45 Launched!
SMP: AP CPU #59 Launched!
SMP: AP CPU #27 Launched!
SMP: AP CPU #39 Launched!
SMP: AP CPU #33 Launched!
SMP: AP CPU #43 Launched!
Timecounter "TSC-low" frequency 1200026749 Hz quality 800
Root mount waiting for: usbus5 usbus2
uhub1: 6 ports with 6 removable, self powered
uhub6: 6 ports with 6 removable, self powered
Trying to mount root from zfs:zroot []...
ugen0.2: <LITEON Technology> at usbus0
ukbd1: <LITEON Technology USB Multimedia Keyboard, class 0/0, rev
1.10/1.01, addr 2> on usbus0
kbd3 at ukbd1
ums0: <Mouse Interface> on usbus6
Cheers, Norbert