Hello! On the Pentium-D box, kernel detects both CPUs, but it seems like scheduler use only one. (from dmesg) Copyright (c) 1992-2007 The FreeBSD Project. Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 The Regents of the University of California. All rights reserved. FreeBSD is a registered trademark of The FreeBSD Foundation. FreeBSD 6.2-RELEASE-p3 #2: Thu Apr 19 00:19:54 MSD 2007 tarkhil@cluster-one.zinester.com:/usr/obj/usr/src/sys/P4D WARNING: debug.mpsafenet forced to 0 as ipsec requires Giant WARNING: MPSAFE network stack disabled, expect reduced performance. Timecounter "i8254" frequency 1193182 Hz quality 0 CPU: Intel(R) Pentium(R) D CPU 2.80GHz (2808.41-MHz 686-class CPU) Origin = "GenuineIntel" Id = 0xf64 Stepping = 4 Features=0xbfebfbff<FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,C MOV,PAT,PSE36,CLFLUSH,DTS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE> Features2=0xe49d<SSE3,RSVD2,MON,DS_CPL,EST,CNTX-ID,CX16,<b14>,<b15>> AMD Features=0x20100000<NX,LM> AMD Features2=0x1<LAHF> Logical CPUs per core: 2 real memory = 1046757376 (998 MB) avail memory = 1015095296 (968 MB) ACPI APIC Table: <INTEL DG965SS > FreeBSD/SMP: Multiprocessor System Detected: 2 CPUs cpu0 (BSP): APIC ID: 0 cpu1 (AP): APIC ID: 1 .... SMP: AP CPU #1 Launched! (from top) last pid: 12408; load averages: 4.99, 4.91, 4.08 up 0+01:08:02 19:26:23 265 processes: 8 running, 256 sleeping, 1 zombie CPU states: 35.0% user, 0.0% nice, 14.1% system, 0.9% interrupt, 50.0% idle Mem: 267M Active, 503M Inact, 171M Wired, 29M Cache, 109M Buf, 1636K Free Swap: 2006M Total, 2006M Free PID USERNAME THR PRI NICE SIZE RES STATE C TIME WCPU COMMAND 1399 125 1 109 0 4684K 2808K RUN 0 11:20 18.85% qmgr 1819 300 1 4 0 33552K 30824K select 0 8:58 13.57% perl5.8.8 1821 300 1 4 0 33364K 30644K select 0 9:15 6.05% perl5.8.8 12398 125 1 4 0 3588K 2524K select 0 0:00 2.00% cleanup 1394 root 1 104 0 3444K 1596K RUN 0 1:58 1.66% master 10601 125 1 97 0 3580K 1728K select 0 0:18 0.83% trivial-rewri 10051 125 1 97 0 4536K 2688K RUN 0 0:13 0.63% scache All processes runs on CPU0, and I did not see less than 50% idle cpu. What can be wrong? Alex.
Hi, Alex Povolotsky wrote:> Hello! > > On the Pentium-D box, kernel detects both CPUs, but it seems like > scheduler use only one. > > (from dmesg) > > Copyright (c) 1992-2007 The FreeBSD Project. > Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 > The Regents of the University of California. All rights reserved. > FreeBSD is a registered trademark of The FreeBSD Foundation. > FreeBSD 6.2-RELEASE-p3 #2: Thu Apr 19 00:19:54 MSD 2007 > tarkhil@cluster-one.zinester.com:/usr/obj/usr/src/sys/P4D > WARNING: debug.mpsafenet forced to 0 as ipsec requires Giant > WARNING: MPSAFE network stack disabled, expect reduced performance. > Timecounter "i8254" frequency 1193182 Hz quality 0 > CPU: Intel(R) Pentium(R) D CPU 2.80GHz (2808.41-MHz 686-class CPU) > Origin = "GenuineIntel" Id = 0xf64 Stepping = 4 > > Features=0xbfebfbff<FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,C > > MOV,PAT,PSE36,CLFLUSH,DTS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE> > Features2=0xe49d<SSE3,RSVD2,MON,DS_CPL,EST,CNTX-ID,CX16,<b14>,<b15>> > AMD Features=0x20100000<NX,LM> > AMD Features2=0x1<LAHF> > Logical CPUs per core: 2 > real memory = 1046757376 (998 MB) > avail memory = 1015095296 (968 MB) > ACPI APIC Table: <INTEL DG965SS > > FreeBSD/SMP: Multiprocessor System Detected: 2 CPUs > cpu0 (BSP): APIC ID: 0 > cpu1 (AP): APIC ID: 1 >Are you sure it is second CPU ? :) May be it is single processor with HT?> .... > > SMP: AP CPU #1 Launched! > > (from top) > > last pid: 12408; load averages: 4.99, 4.91, 4.08 up 0+01:08:02 > 19:26:23 > 265 processes: 8 running, 256 sleeping, 1 zombie > CPU states: 35.0% user, 0.0% nice, 14.1% system, 0.9% interrupt, > 50.0% idle > Mem: 267M Active, 503M Inact, 171M Wired, 29M Cache, 109M Buf, 1636K Free > Swap: 2006M Total, 2006M Free > > PID USERNAME THR PRI NICE SIZE RES STATE C TIME WCPU COMMAND > 1399 125 1 109 0 4684K 2808K RUN 0 11:20 18.85% qmgr > 1819 300 1 4 0 33552K 30824K select 0 8:58 13.57% > perl5.8.8 > 1821 300 1 4 0 33364K 30644K select 0 9:15 6.05% > perl5.8.8 > 12398 125 1 4 0 3588K 2524K select 0 0:00 2.00% cleanup > 1394 root 1 104 0 3444K 1596K RUN 0 1:58 1.66% master > 10601 125 1 97 0 3580K 1728K select 0 0:18 0.83% > trivial-rewri > 10051 125 1 97 0 4536K 2688K RUN 0 0:13 0.63% scache > > > All processes runs on CPU0, and I did not see less than 50% idle cpu. > > What can be wrong? > > Alex. > > > _______________________________________________ > freebsd-stable@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-stable > To unsubscribe, send any mail to "freebsd-stable-unsubscribe@freebsd.org"-- Best Wishes, Stefan Lambrev ICQ# 24134177
kernel config please and /etc/sysctl.conf 2007/4/19, Alex Povolotsky <tarkhil@webmail.sub.ru>:> > Hello! > > On the Pentium-D box, kernel detects both CPUs, but it seems like > scheduler use only one. > > (from dmesg) > > Copyright (c) 1992-2007 The FreeBSD Project. > Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 > The Regents of the University of California. All rights reserved. > FreeBSD is a registered trademark of The FreeBSD Foundation. > FreeBSD 6.2-RELEASE-p3 #2: Thu Apr 19 00:19:54 MSD 2007 > tarkhil@cluster-one.zinester.com:/usr/obj/usr/src/sys/P4D > WARNING: debug.mpsafenet forced to 0 as ipsec requires Giant > WARNING: MPSAFE network stack disabled, expect reduced performance. > Timecounter "i8254" frequency 1193182 Hz quality 0 > CPU: Intel(R) Pentium(R) D CPU 2.80GHz (2808.41-MHz 686-class CPU) > Origin = "GenuineIntel" Id = 0xf64 Stepping = 4 > > > Features=0xbfebfbff<FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,C > MOV,PAT,PSE36,CLFLUSH,DTS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE> > Features2=0xe49d<SSE3,RSVD2,MON,DS_CPL,EST,CNTX-ID,CX16,<b14>,<b15>> > AMD Features=0x20100000<NX,LM> > AMD Features2=0x1<LAHF> > Logical CPUs per core: 2 > real memory = 1046757376 (998 MB) > avail memory = 1015095296 (968 MB) > ACPI APIC Table: <INTEL DG965SS > > FreeBSD/SMP: Multiprocessor System Detected: 2 CPUs > cpu0 (BSP): APIC ID: 0 > cpu1 (AP): APIC ID: 1 > > .... > > SMP: AP CPU #1 Launched! > > (from top) > > last pid: 12408; load averages: 4.99, 4.91, 4.08 up 0+01:08:02 > 19:26:23 > 265 processes: 8 running, 256 sleeping, 1 zombie > CPU states: 35.0% user, 0.0% nice, 14.1% system, 0.9% interrupt, 50.0% > idle > Mem: 267M Active, 503M Inact, 171M Wired, 29M Cache, 109M Buf, 1636K Free > Swap: 2006M Total, 2006M Free > > PID USERNAME THR PRI NICE SIZE RES STATE C TIME WCPU COMMAND > 1399 125 1 109 0 4684K 2808K RUN 0 11:20 18.85% qmgr > 1819 300 1 4 0 33552K 30824K select 0 8:58 13.57% perl5.8.8 > 1821 300 1 4 0 33364K 30644K select 0 9:15 6.05% perl5.8.8 > 12398 125 1 4 0 3588K 2524K select 0 0:00 2.00% cleanup > 1394 root 1 104 0 3444K 1596K RUN 0 1:58 1.66% master > 10601 125 1 97 0 3580K 1728K select 0 0:18 0.83% > trivial-rewri > 10051 125 1 97 0 4536K 2688K RUN 0 0:13 0.63% scache > > > All processes runs on CPU0, and I did not see less than 50% idle cpu. > > What can be wrong? > > Alex. > > > _______________________________________________ > freebsd-stable@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-stable > To unsubscribe, send any mail to "freebsd-stable-unsubscribe@freebsd.org" >
and what is this, i mean why: WARNING: debug.mpsafenet forced to 0 as ipsec requires Giant WARNING: MPSAFE network stack disabled, expect reduced performance. 2007/4/19, Alex Povolotsky <tarkhil@webmail.sub.ru>:> > Hello! > > On the Pentium-D box, kernel detects both CPUs, but it seems like > scheduler use only one. > > (from dmesg) > > Copyright (c) 1992-2007 The FreeBSD Project. > Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 > The Regents of the University of California. All rights reserved. > FreeBSD is a registered trademark of The FreeBSD Foundation. > FreeBSD 6.2-RELEASE-p3 #2: Thu Apr 19 00:19:54 MSD 2007 > tarkhil@cluster-one.zinester.com:/usr/obj/usr/src/sys/P4D > WARNING: debug.mpsafenet forced to 0 as ipsec requires Giant > WARNING: MPSAFE network stack disabled, expect reduced performance. > Timecounter "i8254" frequency 1193182 Hz quality 0 > CPU: Intel(R) Pentium(R) D CPU 2.80GHz (2808.41-MHz 686-class CPU) > Origin = "GenuineIntel" Id = 0xf64 Stepping = 4 > > > Features=0xbfebfbff<FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,C > MOV,PAT,PSE36,CLFLUSH,DTS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE> > Features2=0xe49d<SSE3,RSVD2,MON,DS_CPL,EST,CNTX-ID,CX16,<b14>,<b15>> > AMD Features=0x20100000<NX,LM> > AMD Features2=0x1<LAHF> > Logical CPUs per core: 2 > real memory = 1046757376 (998 MB) > avail memory = 1015095296 (968 MB) > ACPI APIC Table: <INTEL DG965SS > > FreeBSD/SMP: Multiprocessor System Detected: 2 CPUs > cpu0 (BSP): APIC ID: 0 > cpu1 (AP): APIC ID: 1 > > .... > > SMP: AP CPU #1 Launched! > > (from top) > > last pid: 12408; load averages: 4.99, 4.91, 4.08 up 0+01:08:02 > 19:26:23 > 265 processes: 8 running, 256 sleeping, 1 zombie > CPU states: 35.0% user, 0.0% nice, 14.1% system, 0.9% interrupt, 50.0% > idle > Mem: 267M Active, 503M Inact, 171M Wired, 29M Cache, 109M Buf, 1636K Free > Swap: 2006M Total, 2006M Free > > PID USERNAME THR PRI NICE SIZE RES STATE C TIME WCPU COMMAND > 1399 125 1 109 0 4684K 2808K RUN 0 11:20 18.85% qmgr > 1819 300 1 4 0 33552K 30824K select 0 8:58 13.57% perl5.8.8 > 1821 300 1 4 0 33364K 30644K select 0 9:15 6.05% perl5.8.8 > 12398 125 1 4 0 3588K 2524K select 0 0:00 2.00% cleanup > 1394 root 1 104 0 3444K 1596K RUN 0 1:58 1.66% master > 10601 125 1 97 0 3580K 1728K select 0 0:18 0.83% > trivial-rewri > 10051 125 1 97 0 4536K 2688K RUN 0 0:13 0.63% scache > > > All processes runs on CPU0, and I did not see less than 50% idle cpu. > > What can be wrong? > > Alex. > > > _______________________________________________ > freebsd-stable@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-stable > To unsubscribe, send any mail to "freebsd-stable-unsubscribe@freebsd.org" >
> Date: Fri, 20 Apr 2007 22:54:52 +0400 > From: "Alexey Karagodov" <karagodov@gmail.com> > Sender: owner-freebsd-stable@freebsd.org > > and what is this, i mean why: > WARNING: debug.mpsafenet forced to 0 as ipsec requires Giant > WARNING: MPSAFE network stack disabled, expect reduced performance.I thought it was pretty clear. ipsec is not multi-processor safe and requires the use of GIANT. If you have IPSEC in your kernel the network stack will also be giant locked which will cut performance. -- R. Kevin Oberman, Network Engineer Energy Sciences Network (ESnet) Ernest O. Lawrence Berkeley National Laboratory (Berkeley Lab) E-mail: oberman@es.net Phone: +1 510 486-8634 Key fingerprint:059B 2DDF 031C 9BA3 14A4 EADA 927D EBB3 987B 3751 -------------- next part -------------- A non-text attachment was scrubbed... Name: not available Type: application/pgp-signature Size: 224 bytes Desc: not available Url : http://lists.freebsd.org/pipermail/freebsd-stable/attachments/20070420/c9194ce3/attachment-0001.pgp
On Fri, Apr 20, 2007 at 12:08:57PM -0700, Kevin Oberman wrote:> > Date: Fri, 20 Apr 2007 22:54:52 +0400 > > From: "Alexey Karagodov" <karagodov@gmail.com> > > Sender: owner-freebsd-stable@freebsd.org > > > > and what is this, i mean why: > > WARNING: debug.mpsafenet forced to 0 as ipsec requires Giant > > WARNING: MPSAFE network stack disabled, expect reduced performance. > > I thought it was pretty clear. > > ipsec is not multi-processor safe and requires the use of GIANT. If you > have IPSEC in your kernel the network stack will also be giant locked > which will cut performance.Yep, google for extensive discussion (hint: FAST_IPSEC) Kris> -- > R. Kevin Oberman, Network Engineer > Energy Sciences Network (ESnet) > Ernest O. Lawrence Berkeley National Laboratory (Berkeley Lab) > E-mail: oberman@es.net Phone: +1 510 486-8634 > Key fingerprint:059B 2DDF 031C 9BA3 14A4 EADA 927D EBB3 987B 3751
+1 i'm using IPSec with out such limitations ... fix it. than we will continue conversation about your CPU troubles 2007/4/20, Kris Kennaway <kris@obsecurity.org>: - ?????? ?????????? ????? -> On Fri, Apr 20, 2007 at 12:08:57PM -0700, Kevin Oberman wrote: > > > Date: Fri, 20 Apr 2007 22:54:52 +0400 > > > From: "Alexey Karagodov" <karagodov@gmail.com> > > > Sender: owner-freebsd-stable@freebsd.org > > > > > > and what is this, i mean why: > > > WARNING: debug.mpsafenet forced to 0 as ipsec requires Giant > > > WARNING: MPSAFE network stack disabled, expect reduced performance. > > > > I thought it was pretty clear. > > > > ipsec is not multi-processor safe and requires the use of GIANT. If you > > have IPSEC in your kernel the network stack will also be giant locked > > which will cut performance. > > Yep, google for extensive discussion (hint: FAST_IPSEC) > > Kris >2007/4/19, Alex Povolotsky <tarkhil@webmail.sub.ru>:> > Hello! > > On the Pentium-D box, kernel detects both CPUs, but it seems like > scheduler use only one. > > (from dmesg) > > Copyright (c) 1992-2007 The FreeBSD Project. > Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 > The Regents of the University of California. All rights reserved. > FreeBSD is a registered trademark of The FreeBSD Foundation. > FreeBSD 6.2-RELEASE-p3 #2: Thu Apr 19 00:19:54 MSD 2007 > tarkhil@cluster-one.zinester.com:/usr/obj/usr/src/sys/P4D > WARNING: debug.mpsafenet forced to 0 as ipsec requires Giant > WARNING: MPSAFE network stack disabled, expect reduced performance. > Timecounter "i8254" frequency 1193182 Hz quality 0 > CPU: Intel(R) Pentium(R) D CPU 2.80GHz (2808.41-MHz 686-class CPU) > Origin = "GenuineIntel" Id = 0xf64 Stepping = 4 > > > Features=0xbfebfbff<FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,C > MOV,PAT,PSE36,CLFLUSH,DTS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE> > Features2=0xe49d<SSE3,RSVD2,MON,DS_CPL,EST,CNTX-ID,CX16,<b14>,<b15>> > AMD Features=0x20100000<NX,LM> > AMD Features2=0x1<LAHF> > Logical CPUs per core: 2 > real memory = 1046757376 (998 MB) > avail memory = 1015095296 (968 MB) > ACPI APIC Table: <INTEL DG965SS > > FreeBSD/SMP: Multiprocessor System Detected: 2 CPUs > cpu0 (BSP): APIC ID: 0 > cpu1 (AP): APIC ID: 1 > > .... > > SMP: AP CPU #1 Launched! > > (from top) > > last pid: 12408; load averages: 4.99, 4.91, 4.08 up 0+01:08:02 > 19:26:23 > 265 processes: 8 running, 256 sleeping, 1 zombie > CPU states: 35.0% user, 0.0% nice, 14.1% system, 0.9% interrupt, 50.0% > idle > Mem: 267M Active, 503M Inact, 171M Wired, 29M Cache, 109M Buf, 1636K Free > Swap: 2006M Total, 2006M Free > > PID USERNAME THR PRI NICE SIZE RES STATE C TIME WCPU COMMAND > 1399 125 1 109 0 4684K 2808K RUN 0 11:20 18.85% qmgr > 1819 300 1 4 0 33552K 30824K select 0 8:58 13.57% perl5.8.8 > 1821 300 1 4 0 33364K 30644K select 0 9:15 6.05% perl5.8.8 > 12398 125 1 4 0 3588K 2524K select 0 0:00 2.00% cleanup > 1394 root 1 104 0 3444K 1596K RUN 0 1:58 1.66% master > 10601 125 1 97 0 3580K 1728K select 0 0:18 0.83% > trivial-rewri > 10051 125 1 97 0 4536K 2688K RUN 0 0:13 0.63% scache > > > All processes runs on CPU0, and I did not see less than 50% idle cpu. > > What can be wrong? > > Alex. > > > _______________________________________________ > freebsd-stable@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-stable > To unsubscribe, send any mail to "freebsd-stable-unsubscribe@freebsd.org" >
Kris Kennaway wrote:> On Fri, Apr 20, 2007 at 12:08:57PM -0700, Kevin Oberman wrote: > >>> Date: Fri, 20 Apr 2007 22:54:52 +0400 >>> From: "Alexey Karagodov" <karagodov@gmail.com> >>> Sender: owner-freebsd-stable@freebsd.org >>> >>> and what is this, i mean why: >>> WARNING: debug.mpsafenet forced to 0 as ipsec requires Giant >>> WARNING: MPSAFE network stack disabled, expect reduced performance. >>> >> I thought it was pretty clear. >> >> ipsec is not multi-processor safe and requires the use of GIANT. If you >> have IPSEC in your kernel the network stack will also be giant locked >> which will cut performance. >> > > Yep, google for extensive discussion (hint: FAST_IPSEC) >No visible changes in behaviour with FAST_IPSEC Fast IPsec: Initialized Security Association Processing. mptable still shows ONE CPU Alex.
please, dmesg, mptable -verbose, mptable -grope 2007/4/25, Alex Povolotsky <tarkhil@webmail.sub.ru>:> > Kris Kennaway wrote: > > On Fri, Apr 20, 2007 at 12:08:57PM -0700, Kevin Oberman wrote: > > > >>> Date: Fri, 20 Apr 2007 22:54:52 +0400 > >>> From: "Alexey Karagodov" <karagodov@gmail.com> > >>> Sender: owner-freebsd-stable@freebsd.org > >>> > >>> and what is this, i mean why: > >>> WARNING: debug.mpsafenet forced to 0 as ipsec requires Giant > >>> WARNING: MPSAFE network stack disabled, expect reduced performance. > >>> > >> I thought it was pretty clear. > >> > >> ipsec is not multi-processor safe and requires the use of GIANT. If you > >> have IPSEC in your kernel the network stack will also be giant locked > >> which will cut performance. > >> > > > > Yep, google for extensive discussion (hint: FAST_IPSEC) > > > > No visible changes in behaviour with FAST_IPSEC > > Fast IPsec: Initialized Security Association Processing. > > mptable still shows ONE CPU > > Alex. > > >