I have a Supermicro with the C7X58 motherboard and an i7 930 cpu, and it is nowhere near the performance it should be. A buildworld just took 22.5 hours! bryce@tahiti[~]>uname -a FreeBSD tahiti.bryce.net 8.1-STABLE FreeBSD 8.1-STABLE #0: Tue Sep 7 22:45:38 CDT 2010 root@tahiti.bryce.net:/usr/obj/usr/src/sys/GENERIC amd64 I have disabled "Legacy USB Support" in the BIOS and that helped, but I'm not finding any other setting that are getting things where they need to be. I have tested the two system drives independently (currently a zfs mirror), so it is not likely to be an hdd issue. Here's the verbose dmesg boot details - http://www.bryce.net/files/dmesg.boot And, the IPMI ASL in case that is of any value - http://www.bryce.net/files/tahiti.asl Currently, I'm not running powerd, performance is not better with it running. root@tahiti[/usr/src]#cat /boot/loader.conf ahci_load="YES" coretemp_load="YES" zfs_load="YES" vfs.root.mountfrom="zfs:system" #vfs.zfs.prefetch_disable=1 kern.maxfiles=16384 # async i/o aio_load="YES" # VirtualBox #vboxdrv_load="YES" # SMB #ichsmb_load="YES" #smb_load="YES" # Power Saving #kern.hz="100" # Disable APIC subsystem - no longer needed when disabling lapic below #hint.apic.0.disabled="1" # Disable local APIC (LAPIC) timer - for C3 state #hint.apic.0.clock="0" # Avoid 128 interrupts/sec per core, at cost of scheduling precision #hint.atrtc.0.clock="0" # Disable throttle control (and rely on EIST) hint.p4tcc.0.disabled="1" hint.acpi_throttle.0.disabled="1" Thanks in advance for your time! ::Bryce::
On Sat, Sep 18, 2010 at 08:32:32AM -0500, Bryce Edwards wrote:> I have a Supermicro with the C7X58 motherboard and an i7 930 cpu, and > it is nowhere near the performance it should be. A buildworld just > took 22.5 hours!I use 5046A-XB with i7-930 as home workstation, running latest RELENG_8, and I do not have the problem you noted. My BIOS is v1.1, USB legacy is enabled. I did noted one issue with hw, built-in firewire controller generated too high interrupt rate, so I usually do not load firewire.ko unless needed.> > bryce@tahiti[~]>uname -a > FreeBSD tahiti.bryce.net 8.1-STABLE FreeBSD 8.1-STABLE #0: Tue Sep 7 > 22:45:38 CDT 2010 > root@tahiti.bryce.net:/usr/obj/usr/src/sys/GENERIC amd64 > > I have disabled "Legacy USB Support" in the BIOS and that helped, but > I'm not finding any other setting that are getting things where they > need to be. > > I have tested the two system drives independently (currently a zfs > mirror), so it is not likely to be an hdd issue. > > Here's the verbose dmesg boot details - http://www.bryce.net/files/dmesg.boot > > And, the IPMI ASL in case that is of any value - > http://www.bryce.net/files/tahiti.asl > > Currently, I'm not running powerd, performance is not better with it running. > > root@tahiti[/usr/src]#cat /boot/loader.conf > ahci_load="YES" > coretemp_load="YES" > > zfs_load="YES" > vfs.root.mountfrom="zfs:system" > #vfs.zfs.prefetch_disable=1 > > kern.maxfiles=16384 > > # async i/o > aio_load="YES" > > # VirtualBox > #vboxdrv_load="YES" > > # SMB > #ichsmb_load="YES" > #smb_load="YES" > > # Power Saving > #kern.hz="100" > > # Disable APIC subsystem - no longer needed when disabling lapic below > #hint.apic.0.disabled="1" > > # Disable local APIC (LAPIC) timer - for C3 state > #hint.apic.0.clock="0" > > # Avoid 128 interrupts/sec per core, at cost of scheduling precision > #hint.atrtc.0.clock="0" > > # Disable throttle control (and rely on EIST) > hint.p4tcc.0.disabled="1" > hint.acpi_throttle.0.disabled="1" > > Thanks in advance for your time! > > ::Bryce:: > _______________________________________________ > freebsd-stable@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-stable > To unsubscribe, send any mail to "freebsd-stable-unsubscribe@freebsd.org"-------------- next part -------------- A non-text attachment was scrubbed... Name: not available Type: application/pgp-signature Size: 196 bytes Desc: not available Url : http://lists.freebsd.org/pipermail/freebsd-stable/attachments/20100918/5cea86ea/attachment.pgp
On 2010-Sep-18 08:32:32 -0500, Bryce Edwards <bryce@bryce.net> wrote:>I have a Supermicro with the C7X58 motherboard and an i7 930 cpu, and >it is nowhere near the performance it should be. A buildworld just >took 22.5 hours!That does sound a bit poor. I presume the system was basically unloaded during the buildworld. Can we see the output of: - vmstat -i - zpool status -v - df -k - mount -v - md5 -t [this will help determine if the problem is lack of CPU] - sysctl vm>I have tested the two system drives independently (currently a zfs >mirror), so it is not likely to be an hdd issue.How did you test them and what were the results? Do you know what revision your /usr/src/sys/cddl/contrib/opensolaris/uts/common/fs/zfs/arc.c is? (Or when/how did you last upgrade your source tree). -- Peter Jeremy -------------- next part -------------- A non-text attachment was scrubbed... Name: not available Type: application/pgp-signature Size: 196 bytes Desc: not available Url : http://lists.freebsd.org/pipermail/freebsd-stable/attachments/20100920/90e200ba/attachment.pgp
On Sep 20, 6:17?am, peterjer...@acm.org (Peter Jeremy) wrote:> On 2010-Sep-18 08:32:32 -0500, Bryce Edwards <br...@bryce.net> wrote: > > >I have a Supermicro with the C7X58 motherboard and an i7 930 cpu, and > >it is nowhere near the performance it should be. ?A buildworld just > >took 22.5 hours! > > That does sound a bit poor. ?I presume the system was basically unloaded > during the buildworld. > > Can we see the output of: > - vmstat -iinterrupt total rate irq1: atkbd0 853 0 irq16: uhci0 mpt0 117706 0 irq17: fwohci0 1 0 irq23: uhci3 ehci1 22 0 cpu0: timer 1046064200 1979 irq256: em0 1861363 3 irq258: ahci0 3922875 7 cpu1: timer 1046058992 1979 cpu4: timer 1046056958 1979 cpu3: timer 1046058951 1979 cpu2: timer 1046055416 1979 cpu6: timer 1046057518 1979 cpu5: timer 1046058850 1979 cpu7: timer 1046058744 1979 Total 8374372449 15850> - zpool status -vpool: data state: ONLINE scrub: none requested config: NAME STATE READ WRITE CKSUM data ONLINE 0 0 0 mirror ONLINE 0 0 0 gpt/hitachi0 ONLINE 0 0 0 gpt/hitachi1 ONLINE 0 0 0 errors: No known data errors pool: ext1 state: ONLINE scrub: none requested config: NAME STATE READ WRITE CKSUM ext1 ONLINE 0 0 0 da2 ONLINE 0 0 0 errors: No known data errors pool: storage state: ONLINE scrub: none requested config: NAME STATE READ WRITE CKSUM storage ONLINE 0 0 0 raidz1 ONLINE 0 0 0 gpt/samsung0 ONLINE 0 0 0 gpt/samsung1 ONLINE 0 0 0 gpt/samsung2 ONLINE 0 0 0 gpt/samsung3 ONLINE 0 0 0 errors: No known data errors pool: system state: ONLINE scrub: none requested config: NAME STATE READ WRITE CKSUM system ONLINE 0 0 0 mirror ONLINE 0 0 0 gpt/disk0 ONLINE 0 0 0 gpt/disk1 ONLINE 0 0 0 errors: No known data errors> - df -kFilesystem 1024-blocks Used Avail Capacity Mounted on system 142091977 611793 141480184 0% / devfs 1 1 0 100% /dev linprocfs 4 4 0 100% / compat/linux/proc storage 2729825067 38 2729825028 0% / storage storage/archive 2959080344 229255316 2729825028 8% / storage/archive storage/backups 2906677465 176852436 2729825028 6% / storage/backups data 1817823312 2487426 1815335886 0% / storage/data data/Pictures 1912868417 97532531 1815335886 5% / storage/data/Pictures storage/files 2794105921 64280893 2729825028 2% / storage/files storage/incoming 3712303044 982478016 2729825028 26% / storage/incoming storage/media 2835215837 105390809 2729825028 4% / storage/media storage/media/Games 2752775684 22950655 2729825028 1% / storage/media/Games storage/media/Movies 3745007442 1015182414 2729825028 27% / storage/media/Movies storage/media/Music 2811591585 81766557 2729825028 3% / storage/media/Music system/usr 142342976 862792 141480184 1% /usr system/usr/home 142105804 625620 141480184 0% /usr/ home system/usr/obj 143296312 1816128 141480184 1% /usr/ obj system/usr/ports 142059536 579352 141480184 0% /usr/ ports system/usr/src 141792965 312781 141480184 0% /usr/ src system/var 141715785 235601 141480184 0% /var /dev/md0 19566 12 19554 0% /tmp ext1 1092323986 25 1092323960 0% /mnt ext1/data 1094811390 2487429 1092323960 0% /mnt/ data ext1/data/Pictures 1189727469 97403509 1092323960 8% /mnt/ data/Pictures ext1/storage 1092323987 27 1092323960 0% /mnt/ storage ext1/storage/backups 1269282867 176958906 1092323960 14% /mnt/ storage/backups ext1/storage/files 1156645316 64321355 1092323960 6% /mnt/ storage/files ext1/system 1092935755 611794 1092323960 0% /mnt/ system ext1/system/usr 1093186866 862905 1092323960 0% /mnt/ system/usr ext1/system/usr/home 1092949651 625691 1092323960 0% /mnt/ system/usr/home ext1/system/var 1092559374 235413 1092323960 0% /mnt/ system/var> - mount -vsystem on / (zfs, local, noatime) devfs on /dev (devfs, local, multilabel) linprocfs on /compat/linux/proc (linprocfs, local) storage on /storage (zfs, local, noatime) storage/archive on /storage/archive (zfs, local, noatime) storage/backups on /storage/backups (zfs, local, noatime) data on /storage/data (zfs, local) data/Pictures on /storage/data/Pictures (zfs, local) storage/files on /storage/files (zfs, local, noatime) storage/incoming on /storage/incoming (zfs, local, noatime) storage/media on /storage/media (zfs, local, noatime) storage/media/Games on /storage/media/Games (zfs, local, noatime) storage/media/Movies on /storage/media/Movies (zfs, local, noatime) storage/media/Music on /storage/media/Music (zfs, local, noatime) system/usr on /usr (zfs, local, noatime) system/usr/home on /usr/home (zfs, local, noatime, nosuid) system/usr/obj on /usr/obj (zfs, local, noatime) system/usr/ports on /usr/ports (zfs, local, noatime, nosuid) system/usr/src on /usr/src (zfs, local, noatime, noexec, nosuid) system/var on /var (zfs, local, noatime) /dev/md0 on /tmp (ufs, asynchronous, local, noatime) ext1 on /mnt (zfs, local) ext1/data on /mnt/data (zfs, local) ext1/data/Pictures on /mnt/data/Pictures (zfs, local) ext1/storage on /mnt/storage (zfs, local) ext1/storage/backups on /mnt/storage/backups (zfs, local) ext1/storage/files on /mnt/storage/files (zfs, local) ext1/system on /mnt/system (zfs, local) ext1/system/usr on /mnt/system/usr (zfs, local) ext1/system/usr/home on /mnt/system/usr/home (zfs, local) ext1/system/var on /mnt/system/var (zfs, local)> - md5 -t ? [this will help determine if the problem is lack of CPU]MD5 time trial. Digesting 100000 10000-byte blocks ... done Digest = 766a2bb5d24bddae466c572bcabca3ee Time = 5.421381 seconds Speed = 184454848.000000 bytes/second> - sysctl vmvm.vmtotal: System wide totals computed every five seconds: (values in kilobytes) ==============================================Processes: (RUNQ: 1 Disk Wait: 0 Page Wait: 0 Sleep: 32) Virtual Memory: (Total: 1074279508K, Active 422412K) Real Memory: (Total: 1252504K Active 28660K) Shared Virtual Memory: (Total: 28792K Active: 13456K) Shared Real Memory: (Total: 8716K Active: 6520K) Free Memory Pages: 3035952K vm.loadavg: { 0.00 0.00 0.00 } vm.v_free_min: 9590 vm.v_free_target: 40381 vm.v_free_reserved: 2021 vm.v_inactive_target: 60571 vm.v_cache_min: 40381 vm.v_cache_max: 80762 vm.v_pageout_free_min: 34 vm.pageout_algorithm: 0 vm.swap_enabled: 1 vm.kmem_size_scale: 3 vm.kmem_size_max: 329853485875 vm.kmem_size_min: 0 vm.kmem_size: 2067320832 vm.nswapdev: 2 vm.dmmax: 32 vm.swap_async_max: 4 vm.overcommit: 0 vm.swap_reserved: 395976704 vm.swap_total: 8589934592 vm.zone_count: 191 vm.swap_idle_threshold2: 10 vm.swap_idle_threshold1: 2 vm.kstacks: 724 vm.kstack_cache_size: 128 vm.exec_map_entries: 16 vm.stats.misc.zero_page_count: 189 vm.stats.misc.cnt_prezero: 0 vm.stats.vm.v_kthreadpages: 0 vm.stats.vm.v_rforkpages: 0 vm.stats.vm.v_vforkpages: 36355379 vm.stats.vm.v_forkpages: 113127423 vm.stats.vm.v_kthreads: 28 vm.stats.vm.v_rforks: 0 vm.stats.vm.v_vforks: 173728 vm.stats.vm.v_forks: 441695 vm.stats.vm.v_interrupt_free_min: 2 vm.stats.vm.v_pageout_free_min: 34 vm.stats.vm.v_cache_max: 80762 vm.stats.vm.v_cache_min: 40381 vm.stats.vm.v_cache_count: 8123 vm.stats.vm.v_inactive_count: 1310 vm.stats.vm.v_inactive_target: 60571 vm.stats.vm.v_active_count: 41328 vm.stats.vm.v_wire_count: 712096 vm.stats.vm.v_free_count: 750836 vm.stats.vm.v_free_min: 9590 vm.stats.vm.v_free_target: 40381 vm.stats.vm.v_free_reserved: 2021 vm.stats.vm.v_page_count: 1514151 vm.stats.vm.v_page_size: 4096 vm.stats.vm.v_tfree: 167732869 vm.stats.vm.v_pfree: 98570493 vm.stats.vm.v_dfree: 0 vm.stats.vm.v_tcached: 103875 vm.stats.vm.v_pdpages: 0 vm.stats.vm.v_pdwakeups: 0 vm.stats.vm.v_reactivated: 72388 vm.stats.vm.v_intrans: 4408 vm.stats.vm.v_vnodepgsout: 12785 vm.stats.vm.v_vnodepgsin: 109922 vm.stats.vm.v_vnodeout: 10042 vm.stats.vm.v_vnodein: 109922 vm.stats.vm.v_swappgsout: 0 vm.stats.vm.v_swappgsin: 0 vm.stats.vm.v_swapout: 0 vm.stats.vm.v_swapin: 0 vm.stats.vm.v_ozfod: 0 vm.stats.vm.v_zfod: 113400918 vm.stats.vm.v_cow_optim: 33371 vm.stats.vm.v_cow_faults: 18233444 vm.stats.vm.v_vm_faults: 147005945 vm.stats.sys.v_soft: 81806059 vm.stats.sys.v_intr: 5903805 vm.stats.sys.v_syscall: 126779283 vm.stats.sys.v_trap: 157285021 vm.stats.sys.v_swtch: 252443163 vm.stats.object.bypasses: 143582 vm.stats.object.collapses: 1817130 vm.v_free_severe: 5805 vm.max_proc_mmap: 172276 vm.old_msync: 0 vm.msync_flush_flags: 3 vm.boot_pages: 48 vm.max_wired: 495315 vm.pageout_lock_miss: 0 vm.disable_swapspace_pageouts: 0 vm.defer_swapspace_pageouts: 0 vm.swap_idle_enabled: 0 vm.pageout_stats_interval: 5 vm.pageout_full_stats_interval: 20 vm.pageout_stats_max: 40381 vm.max_launder: 32 vm.phys_segs: SEGMENT 0: start: 0x1000 end: 0x99000 free list: 0xffffffff80c77e08 SEGMENT 1: start: 0x1073000 end: 0xbea92000 free list: 0xffffffff80c77a60 SEGMENT 2: start: 0x100000000 end: 0x1b3ff0000 free list: 0xffffffff80c77a60 vm.phys_free: FREE LIST 0: ORDER (SIZE) | NUMBER | POOL 0 | POOL 1 | POOL 2 -- -- -- -- -- -- -- -- 12 (016384K) | 000119 | 000000 | 000000 11 (008192K) | 000026 | 000001 | 000000 10 (004096K) | 000058 | 000001 | 000000 09 (002048K) | 000053 | 000001 | 000000 08 (001024K) | 000001 | 000000 | 000000 07 (000512K) | 000002 | 000000 | 000000 06 (000256K) | 000004 | 000000 | 000000 05 (000128K) | 000019 | 000001 | 000004 04 (000064K) | 000078 | 000001 | 000015 03 (000032K) | 000206 | 000004 | 000202 02 (000016K) | 000650 | 000012 | 000434 01 (000008K) | 001112 | 000016 | 001479 00 (000004K) | 000652 | 000005 | 003424 FREE LIST 1: ORDER (SIZE) | NUMBER | POOL 0 | POOL 1 | POOL 2 -- -- -- -- -- -- -- -- 12 (016384K) | 000000 | 000000 | 000000 11 (008192K) | 000000 | 000000 | 000000 10 (004096K) | 000000 | 000000 | 000000 09 (002048K) | 000000 | 000000 | 000000 08 (001024K) | 000000 | 000000 | 000000 07 (000512K) | 000000 | 000000 | 000000 06 (000256K) | 000001 | 000000 | 000000 05 (000128K) | 000001 | 000000 | 000000 04 (000064K) | 000001 | 000000 | 000000 03 (000032K) | 000002 | 000000 | 000000 02 (000016K) | 000000 | 000000 | 000000 01 (000008K) | 000001 | 000000 | 000000 00 (000004K) | 000002 | 000000 | 000000 vm.reserv.reclaimed: 0 vm.reserv.partpopq: LEVEL SIZE NUMBER -00001: 432112K, 000734 vm.reserv.freed: 1850255 vm.reserv.broken: 436 vm.idlezero_enable: 0 vm.kvm_free: 546738008064 vm.kvm_size: 549755809792 vm.pmap.pmap_collect_active: 0 vm.pmap.pmap_collect_inactive: 0 vm.pmap.pv_entry_spare: 3523 vm.pmap.pv_entry_allocs: 490764507 vm.pmap.pv_entry_frees: 490746022 vm.pmap.pc_chunk_tryfail: 0 vm.pmap.pc_chunk_frees: 3217597 vm.pmap.pc_chunk_allocs: 3217728 vm.pmap.pc_chunk_count: 131 vm.pmap.pv_entry_count: 18485 vm.pmap.pdpe.demotions: 0 vm.pmap.pde.promotions: 183512 vm.pmap.pde.p_failures: 3208458 vm.pmap.pde.mappings: 0 vm.pmap.pde.demotions: 135426 vm.pmap.shpgperproc: 200 vm.pmap.pv_entry_max: 2746951 vm.pmap.pg_ps_enabled: 1> > >I have tested the two system drives independently (currently a zfs > >mirror), so it is not likely to be an hdd issue. > > How did you test them and what were the results? > > Do you know what revision your > /usr/src/sys/cddl/contrib/opensolaris/uts/common/fs/zfs/arc.c is? > (Or when/how did you last upgrade your source tree).I did a make update just before the buildworld, the same day as the original message post.> > -- > Peter Jeremy > > ?application_pgp-signature_part > < 1KViewDownloadIn case it helps, here kldstat output: Id Refs Address Size Name 1 32 0xffffffff80100000 d7b280 kernel 2 1 0xffffffff80e7c000 19e1f8 zfs.ko 3 2 0xffffffff8101b000 3860 opensolaris.ko 4 1 0xffffffff8101f000 f090 aio.ko 5 1 0xffffffff81030000 fe68 ahci.ko 6 1 0xffffffff81222000 39f7 linprocfs.ko 7 1 0xffffffff81226000 1cc4d linux.ko 8 1 0xffffffff81243000 216 green_saver.ko 9 1 0xffffffff81244000 86c coretemp.ko
On Sep 22, 11:43?am, smi...@nimnet.asn.au (Ian Smith) wrote:> On Wed, 22 Sep 2010, Tom Evans wrote: > > ?> On Wed, Sep 22, 2010 at 2:50 PM, Ian Smith <smi...@nimnet.asn.au> wrote: > ?> > It seems far more than just CPU performance is awry. ?Adam's data from > ?> > his i7 shows 2.7 times Bryce's speed for the md5 -t, maybe a lower EST > ?> > rate? - but that could no way account for buildworld taking 22.5 hours. > ?> > > ?> > Recent buildworld (albeit i386) on my Thinkpad T23 ran just shy of 3.5 > ?> > hours, without -j on an 1133MHz P3-M, 768MB of 133MHz RAM, 5400rpm UFS > ?> > disk - with X/KDE running meanwhile (~5-7% CPU penalty). > ?> > ?> md5 -t is quite a small benchmark, even with his misfunctioning CPU it > ?> took <6 seconds to complete. > ?> > ?> If his problem is a misapplied heatsink/fan, then his CPU could be > ?> throttling when it gets hot, the hotter it gets the more it throttles, > ?> which could explain his massive buildworld walltime. Perhaps running > ?> something like: > ?> > ?> ? apply -0 "md5 -t" `jot 10` > ?> > ?> would display a notable difference. > ?> > ?> Intel chips are quite good at running without much cooling and not > ?> dieing, using thermal throttling to preserve the CPU. > > I guess you mean on-package, without p4tcc or ACPI throttle support? > > >From Bryce's original message: > > # Disable throttle control (and rely on EIST) > hint.p4tcc.0.disabled="1" > hint.acpi_throttle.0.disabled="1" > > which is sensible, and seems to have been applied to all CPUs, but fromhttp://www.bryce.net/files/dmesg.bootwe see for each of cpu[0-7]: > > est0: <Enhanced SpeedStep Frequency Control> on cpu0 > est0: Invalid id16 (set, cur) = (20, 21) > est0: Can't check freq 2667, it may be invalid > est0: Invalid id16 (set, cur) = (19, 21) > est0: Can't check freq 2533, it may be invalid > est0: Invalid id16 (set, cur) = (18, 21) > est0: Can't check freq 2400, it may be invalid > est0: Invalid id16 (set, cur) = (17, 21) > est0: Can't check freq 2267, it may be invalid > est0: Invalid id16 (set, cur) = (16, 21) > est0: Can't check freq 2133, it may be invalid > est0: Invalid id16 (set, cur) = (15, 21) > est0: Can't check freq 2000, it may be invalid > est0: Invalid id16 (set, cur) = (14, 21) > est0: Can't check freq 1867, it may be invalid > est0: Invalid id16 (set, cur) = (13, 21) > est0: Can't check freq 1733, it may be invalid > est0: Invalid id16 (set, cur) = (12, 21) > est0: Can't check freq 1600, it may be invalid > > which looks a bit ominous? ?What does 'sysctl hw.acpi dev.cpu' say?hw.acpi.supported_sleep_state: S1 S4 S5 hw.acpi.power_button_state: S5 hw.acpi.sleep_button_state: S1 hw.acpi.lid_switch_state: NONE hw.acpi.standby_state: S1 hw.acpi.suspend_state: NONE hw.acpi.sleep_delay: 1 hw.acpi.s4bios: 0 hw.acpi.verbose: 1 hw.acpi.disable_on_reboot: 0 hw.acpi.handle_reboot: 0 hw.acpi.reset_video: 0 hw.acpi.cpu.cx_lowest: C1 dev.cpu.0.%desc: ACPI CPU dev.cpu.0.%driver: cpu dev.cpu.0.%location: handle=\_PR_.P001 dev.cpu.0.%pnpinfo: _HID=none _UID=0 dev.cpu.0.%parent: acpi0 dev.cpu.0.freq: 2801 dev.cpu.0.freq_levels: 2801/143000 2667/114000 2533/100000 2400/87000 2267/76000 2133/68000 2000/59000 1867/51000 1733/44000 1600/40000 dev.cpu.0.cx_supported: C1/32 C2/96 C3/128 dev.cpu.0.cx_lowest: C1 dev.cpu.0.cx_usage: 100.00% 0.00% 0.00% last 372us dev.cpu.0.temperature: 51.0C dev.cpu.1.%desc: ACPI CPU dev.cpu.1.%driver: cpu dev.cpu.1.%location: handle=\_PR_.P002 dev.cpu.1.%pnpinfo: _HID=none _UID=0 dev.cpu.1.%parent: acpi0 dev.cpu.1.cx_supported: C1/32 C2/96 C3/128 dev.cpu.1.cx_lowest: C1 dev.cpu.1.cx_usage: 100.00% 0.00% 0.00% last 178us dev.cpu.1.temperature: 51.0C dev.cpu.2.%desc: ACPI CPU dev.cpu.2.%driver: cpu dev.cpu.2.%location: handle=\_PR_.P003 dev.cpu.2.%pnpinfo: _HID=none _UID=0 dev.cpu.2.%parent: acpi0 dev.cpu.2.cx_supported: C1/32 C2/96 C3/128 dev.cpu.2.cx_lowest: C1 dev.cpu.2.cx_usage: 100.00% 0.00% 0.00% last 386us dev.cpu.2.temperature: 48.0C dev.cpu.3.%desc: ACPI CPU dev.cpu.3.%driver: cpu dev.cpu.3.%location: handle=\_PR_.P004 dev.cpu.3.%pnpinfo: _HID=none _UID=0 dev.cpu.3.%parent: acpi0 dev.cpu.3.cx_supported: C1/32 C2/96 C3/128 dev.cpu.3.cx_lowest: C1 dev.cpu.3.cx_usage: 100.00% 0.00% 0.00% last 391us dev.cpu.3.temperature: 49.0C dev.cpu.4.%desc: ACPI CPU dev.cpu.4.%driver: cpu dev.cpu.4.%location: handle=\_PR_.P005 dev.cpu.4.%pnpinfo: _HID=none _UID=0 dev.cpu.4.%parent: acpi0 dev.cpu.4.cx_supported: C1/32 C2/96 C3/128 dev.cpu.4.cx_lowest: C1 dev.cpu.4.cx_usage: 100.00% 0.00% 0.00% last 413us dev.cpu.4.temperature: 50.0C dev.cpu.5.%desc: ACPI CPU dev.cpu.5.%driver: cpu dev.cpu.5.%location: handle=\_PR_.P006 dev.cpu.5.%pnpinfo: _HID=none _UID=0 dev.cpu.5.%parent: acpi0 dev.cpu.5.cx_supported: C1/32 C2/96 C3/128 dev.cpu.5.cx_lowest: C1 dev.cpu.5.cx_usage: 100.00% 0.00% 0.00% last 381us dev.cpu.5.temperature: 51.0C dev.cpu.6.%desc: ACPI CPU dev.cpu.6.%driver: cpu dev.cpu.6.%location: handle=\_PR_.P007 dev.cpu.6.%pnpinfo: _HID=none _UID=0 dev.cpu.6.%parent: acpi0 dev.cpu.6.cx_supported: C1/32 C2/96 C3/128 dev.cpu.6.cx_lowest: C1 dev.cpu.6.cx_usage: 100.00% 0.00% 0.00% last 411us dev.cpu.6.temperature: 48.0C dev.cpu.7.%desc: ACPI CPU dev.cpu.7.%driver: cpu dev.cpu.7.%location: handle=\_PR_.P008 dev.cpu.7.%pnpinfo: _HID=none _UID=0 dev.cpu.7.%parent: acpi0 dev.cpu.7.cx_supported: C1/32 C2/96 C3/128 dev.cpu.7.cx_lowest: C1 dev.cpu.7.cx_usage: 100.00% 0.00% 0.00% last 330us dev.cpu.7.temperature: 48.0C> > Running multiple md5s or say 'dd if=/dev/random of=/dev/null bs=1M &' > in a short sleep loop echoing "`date` `sysctl -n dev.cpu.0.freq` plus > indicative coretemp sysctls might reveal something as it heats up? ? > Surprisingly (?) the dmesg shows no ACPI thermal zones (detected).I don't think it is temperature, I have never seen temps above the low 60's C and the speed never goes down from 2.8 Ghz. This is what I see when running your dd for a while: bryce@tahiti[~]>sysctl -a | grep temperature dev.cpu.0.temperature: 55.0C dev.cpu.1.temperature: 55.0C dev.cpu.2.temperature: 51.0C dev.cpu.3.temperature: 52.0C dev.cpu.4.temperature: 59.0C dev.cpu.5.temperature: 61.0C dev.cpu.6.temperature: 51.0C dev.cpu.7.temperature: 52.0C bryce@tahiti[~]>sysctl -n dev.cpu.0.freq 2801> > cheers, Ian > > _______________________________________________ > freebsd-sta...@freebsd.org mailing listhttp://lists.freebsd.org/mailman/listinfo/freebsd-stable > To unsubscribe, send any mail to "freebsd-stable-unsubscr...@freebsd.org"
On Sep 22, 3:43?am, free...@jdc.parodius.com (Jeremy Chadwick) wrote:> On Wed, Sep 22, 2010 at 03:30:33AM -0500, Adam Vande More wrote: > > On Wed, Sep 22, 2010 at 3:12 AM, Peter Jeremy <peterjer...@acm.org> wrote: > > > > I think something is badly wrong here. ?That's less than 1/2 the speed > > > of my Athlon 4850e (2.5GHz) and only 60% more than my Atom N270. ?None > > > of the other figures you posted look anomolous. ?Are you sure the CPU > > > is actually running at full speed and you haven't done something like > > > disable the caches in BIOS? > > > FWIW: > > > FreeBSD galacticdominator.com 8.1-PRERELEASE FreeBSD 8.1-PRERELEASE #1: Sun > > Jun 20 21:05:37 CDT 2010 > > a...@galacticdominator.com:/usr/obj/usr/src/sys/GENERIC > > amd64 > > CPU: Intel(R) Core(TM) i7 CPU ? ? ? ? 870 ?@ 2.93GHz (2940.64-MHz K8-class > > CPU) > > > MD5 time trial. Digesting 100000 10000-byte blocks ... done > > Digest = 766a2bb5d24bddae466c572bcabca3ee > > Time = 2.012719 seconds > > Speed = 496840352.000000 bytes/second > > > vmstat > > -i > > > interrupt ? ? ? ? ? ? ? ? ? ? ? ? ?total > > rate > > > irq16: vgapci0+ ? ? ? ? ? ? ? ? 10720642 ? ? ? ? 54 > > irq18: fwohci0 ? ? ? ? ? ? ? ? ? ? ? ? 2 ? ? ? ? ?0 > > irq23: ehci1 ? ? ? ? ? ? ? ? ? ? ?623712 ? ? ? ? ?3 > > cpu0: timer ? ? ? ? ? ? ? ? ? ?393496151 ? ? ? 1996 > > irq256: hdac0 ? ? ? ? ? ? ? ? ? ?8063581 ? ? ? ? 40 > > irq257: re0 ? ? ? ? ? ? ? ? ? ? ?4136265 ? ? ? ? 20 > > irq259: ahci1 ? ? ? ? ? ? ? ? ? ?1925783 ? ? ? ? ?9 > > cpu1: timer ? ? ? ? ? ? ? ? ? ?393494902 ? ? ? 1996 > > cpu6: timer ? ? ? ? ? ? ? ? ? ?393494606 ? ? ? 1996 > > cpu5: timer ? ? ? ? ? ? ? ? ? ?393494653 ? ? ? 1996 > > cpu7: timer ? ? ? ? ? ? ? ? ? ?393494701 ? ? ? 1996 > > cpu4: timer ? ? ? ? ? ? ? ? ? ?393494785 ? ? ? 1996 > > cpu3: timer ? ? ? ? ? ? ? ? ? ?393494732 ? ? ? 1996 > > cpu2: timer ? ? ? ? ? ? ? ? ? ?393494404 ? ? ? 1996 > > Total ? ? ? ? ? ? ? ? ? ? ? ? 3173428919 ? ? ?16102 > > > His interrupts seem high compared to this setup, but I don't what expected > > values should be. > > How are his interrupt rates "higher" than yours? ?If you're focused on > the cpuX entries, don't be. > > To the OP: > > 1) I don't see how/why USB Legacy support would have anything to do with > your problem (meaning: you stated that things "improved a little" if you > disabled USB Legacy support in the BIOS, which makes no sense given what > that option does).The machine runs *MUCH* slower if Legacy BIOS is not disabled. Just booting up is excruciating, and takes forever.> > 2) There's been a discussion on -stable about FreeBSD incorrectly > determining different kinds of CPU characteristics on newer processors > like the i7, with HTT in use. ?I can dig up the thread if you'd like. > It does include a patch.Yes, I'd like that. In case this helps: kern.sched.topology_spec: <groups> <group level="1" cache-level="0"> <cpu count="8" mask="0xff">0, 1, 2, 3, 4, 5, 6, 7</cpu> <children> <group level="3" cache-level="2"> <cpu count="8" mask="0xff">0, 1, 2, 3, 4, 5, 6, 7</cpu> <children> <group level="5" cache-level="1"> <cpu count="2" mask="0x3">0, 1</cpu> <flags><flag name="THREAD">THREAD group</flag><flag name="SMT">SMT group</flag></flags> </group> <group level="5" cache-level="1"> <cpu count="2" mask="0xc">2, 3</cpu> <flags><flag name="THREAD">THREAD group</flag><flag name="SMT">SMT group</flag></flags> </group> <group level="5" cache-level="1"> <cpu count="2" mask="0x30">4, 5</cpu> <flags><flag name="THREAD">THREAD group</flag><flag name="SMT">SMT group</flag></flags> </group> <group level="5" cache-level="1"> <cpu count="2" mask="0xc0">6, 7</cpu> <flags><flag name="THREAD">THREAD group</flag><flag name="SMT">SMT group</flag></flags> </group> </children> </group> </children> </group> </groups>> > 3) Reset the BIOS settings to Factory Defaults ("Load Setup Defaults" > or the like), and then write down whatever you change, then post the > changes here.After resetting BIOS, I make the following changes: - Disable Legacy BIOS - Change drive controller from enhanced mode to AHCI and for your #4, the temp is almost always between 49-60 degrees C and the cpu freq is always 2801.> > -- > | Jeremy Chadwick ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? j...@parodius.com | > | Parodius Networking ? ? ? ? ? ? ? ? ? ? ?http://www.parodius.com/| > | UNIX Systems Administrator ? ? ? ? ? ? ? ? ?Mountain View, CA, USA | > | Making life hard for others since 1977. ? ? ? ? ? ? ?PGP: 4BD6C0CB | > > _______________________________________________ > freebsd-sta...@freebsd.org mailing listhttp://lists.freebsd.org/mailman/listinfo/freebsd-stable > To unsubscribe, send any mail to "freebsd-stable-unsubscr...@freebsd.org"I am not running powerd as I saw odd behavior and wanted to get a know good before introducing other variables. ::Bryce::
Bryce wrote:> I don't think it is temperature, I have never seen temps above the low > 60's C and the speed never goes down from 2.8 Ghz. This is what I see > when running your dd for a while: > > bryce@tahiti[~]>sysctl -a | grep temperature > dev.cpu.0.temperature: 55.0C > dev.cpu.1.temperature: 55.0C > dev.cpu.2.temperature: 51.0C > dev.cpu.3.temperature: 52.0C > dev.cpu.4.temperature: 59.0C > dev.cpu.5.temperature: 61.0C > dev.cpu.6.temperature: 51.0C > dev.cpu.7.temperature: 52.0C > bryce@tahiti[~]>sysctl -n dev.cpu.0.freq > 2801Looks not bad, but I would checked it during good compilation, using all cores. Just to compare, my Core i7-870 with boxed cooler reports: 31C being idle with tuned power management, 53C being idle without any power management, 85C during `make -j16`. That system did `make -j16 universe` in about 3 hours AFAIR. PS: AFAIK dev.cpu.0.freq won't report you if frequency was lowered due to overheating. -- Alexander Motin
On Sep 22, 9:35?am, nickolas...@gmail.com wrote:> > md5 -t is quite a small benchmark, even with his misfunctioning CPU it > > took <6 seconds to complete. > > > If his problem is a misapplied heatsink/fan, then his CPU could be > > throttling when it gets hot, the hotter it gets the more it throttles, > > which could explain his massive buildworld walltime. Perhaps running > > something like: > > > ?apply -0 "md5 -t" `jot 10` > > > would display a notable difference. >I don't think is heat & throttling related. Here's the temps while doing a make -j16 buildworld: dev.cpu.0.temperature: 57.0C dev.cpu.1.temperature: 57.0C dev.cpu.2.temperature: 54.0C dev.cpu.3.temperature: 54.0C dev.cpu.4.temperature: 57.0C dev.cpu.5.temperature: 57.0C dev.cpu.6.temperature: 55.0C dev.cpu.7.temperature: 55.0C IMO, the problem is preventing the system from even loading up the CPU's enough to even get hot - I have never seen it over 61 C. If sit & watch top -P during a buildworld, it rarely get's all 8 CPU's loaded up with idle numbers near 0%. A vast majority of the time one CPU is maxed and the others are mostly idle.> You may also run openssl speed or "linpack" test > (/usr/ports/math/linpack) or hpl (/usr/ports/benchmarks/hpl) to load > your CPU > _______________________________________________ > freebsd-sta...@freebsd.org mailing listhttp://lists.freebsd.org/mailman/listinfo/freebsd-stable > To unsubscribe, send any mail to "freebsd-stable-unsubscr...@freebsd.org"
Just wanted to follow up and show what things looks like in the 'building everything' part of build world. It has been running almost 23 hours... bryce@tahiti[~]>vmstat 1 procs memory page disks faults cpu r b w avm fre flt re pi po fr sr da0 da1 in sy cs us sy id 11 0 0 1201M 2770M 282 0 0 0 318 0 0 0 10 238 475 14 1 85 12 2 0 1185M 2773M 1269 0 0 0 1944 0 0 0 2 279 643 97 3 0 12 0 0 1154M 2811M 1756 0 0 0 11603 0 0 0 6 893 701 95 3 2 12 0 0 1157M 2808M 845 0 0 0 63 0 0 0 2 475 575 96 2 2 11 0 0 1157M 2804M 1917 0 0 0 1077 0 0 0 8 970 737 97 3 0 11 0 0 1158M 2801M 1597 0 0 0 930 0 0 0 10 1213 664 96 4 0 11 0 0 1172M 2796M 1782 0 0 0 467 0 0 0 8 1009 692 97 3 0 11 0 0 1178M 2792M 1128 0 0 0 1 0 0 0 2 205 546 99 1 0 ^C bryce@tahiti[~]>iostat 1 tty da0 da1 da2 cpu tin tout KB/t tps MB/s KB/t tps MB/s KB/t tps MB/s us ni sy in id 0 221 39.75 0 0.00 39.92 0 0.00 36.16 0 0.00 13 1 1 0 85 0 545 0.00 0 0.00 0.00 0 0.00 0.00 0 0.00 97 0 3 0 0 0 295 0.00 0 0.00 0.00 0 0.00 0.00 0 0.00 98 0 2 0 0 0 537 0.00 0 0.00 0.00 0 0.00 0.00 0 0.00 98 0 1 0 0 0 78 0.00 0 0.00 0.00 0 0.00 0.00 0 0.00 99 0 1 0 0 0 78 0.00 0 0.00 0.00 0 0.00 0.00 0 0.00 96 0 4 0 0 0 307 0.00 0 0.00 0.00 0 0.00 0.00 0 0.00 97 0 2 0 1 0 78 0.00 0 0.00 0.00 0 0.00 0.00 0 0.00 98 0 2 0 0 ^C bryce@tahiti[~]>sysctl dev.cpu | grep temperature dev.cpu.0.temperature: 59.0C dev.cpu.1.temperature: 59.0C dev.cpu.2.temperature: 56.0C dev.cpu.3.temperature: 56.0C dev.cpu.4.temperature: 59.0C dev.cpu.5.temperature: 59.0C dev.cpu.6.temperature: 56.0C dev.cpu.7.temperature: 56.0C
Yay! I have solved the problem.... I got a new BIOS from SuperMicro support, and it has resolved the performance issues I was seeing. I also no longer have to disable Legacy USB. Here's the new & improved times for buildworld && buildkernel (with - j12). 19 minutes for world and kernel (with all modules) is not bad at all!>>> World build started on Fri Sep 24 03:26:06 CDT 2010 >>> World build completed on Fri Sep 24 03:38:44 CDT 2010>>> Kernel build for GENERIC started on Fri Sep 24 03:38:44 CDT 2010 >>> Kernel build for GENERIC completed on Fri Sep 24 03:44:47 CDT 2010Thanks everyone for all the help & ideas...