thr3ads.net - Xen devel - [Xen-devel] Unable to bring up SMP DomUs on x86

If this information is useful, please help other people find it:
Share via:

Puthiyaparambil, Aravindh

2005-Oct-18 20:45 UTC

[Xen-devel] Unable to bring up SMP DomUs on x86_64 Xen

I was trying to bring up a SMP DomU on Xen x86_64. The DomU dies while
booting processor 1/1. This is in spite of the fact that I have set
vcpus to 4 in the DomU configuration file. I confirmed that the DomU
kernel was compiled with SMP turned on. I am seeing this on the Dell and
ES7000 x86_64 boxes. Is anyone else seeing this issue or am I doing
something wrong?

Aravindh

DomU BOOT OUTPUT
----------------
xenbox:~/xen/vm # xm create dom64_2 -c
Using config file "dom64_2".
Started domain dom64_2
Linux version 2.6.12-xenU (root@xenbox) (gcc version 3.3.3 (SuSE Linux))
#1 SMP Tue Oct 18 16:17:52 EDT 2005
kernel direct mapping tables upto 18000000 @ 474000-536000
Built 1 zonelists
Kernel command line:  root=/dev/sda1 ro 3
Initializing CPU#0
PID hash table entries: 2048 (order: 11, 65536 bytes)
Xen reported: 2992.694 MHz processor.
Dentry cache hash table entries: 65536 (order: 7, 524288 bytes)
Inode-cache hash table entries: 32768 (order: 6, 262144 bytes)
Memory: 381952k/393216k available (1669k kernel code, 10836k reserved,
560k data, 136k init)
Mount-cache hash table entries: 256
CPU: Trace cache: 12K uops, L1 D cache: 16K
CPU: L2 cache: 1024K
CPU: Physical Processor ID: 0
Booting processor 1/1 rip ffffffff80100008 rsp ffff880000575f58

SERIAL OUTPUT
-------------
(XEN) (file=traps.c, line=968) Non-priv domain attempted
RDMSR(00000000c0000080,00018000,00018000).
(XEN) (file=traps.c, line=960) Non-priv domain attempted
WRMSR(00000000c0000100,00000000,00000000).
(XEN) (file=traps.c, line=960) Non-priv domain attempted
WRMSR(00000000c0000102,00000000,00000000).
(XEN) (file=traps.c, line=968) Non-priv domain attempted
RDMSR(00000000c0000080,00000000,00000000).
(XEN) (file=traps.c, line=960) Non-priv domain attempted
WRMSR(00000000c0000100,00000000,00000000).
(XEN) (file=traps.c, line=960) Non-priv domain attempted
WRMSR(00000000c0000102,00000000,00000000).
(XEN) (file=traps.c, line=968) Non-priv domain attempted
RDMSR(00000000c0000080,00000000,00000000).
(XEN) (file=traps.c, line=968) Non-priv domain attempted
RDMSR(00000000c0000100,00000045,ffffffffff5fd000).
(XEN) (file=traps.c, line=968) Non-priv domain attempted
RDMSR(00000000c0000101,00000000,00000000).
(XEN) (file=traps.c, line=968) Non-priv domain attempted
RDMSR(00000000c0000102,80372b00,ffffffff).
stop_this_cpu disable_local_APIC

_______________________________________________
Xen-devel mailing list
Xen-devel@lists.xensource.com
http://lists.xensource.com/xen-devel

David F Barrera

2005-Oct-18 21:09 UTC

head link

Re: [Xen-devel] Unable to bring up SMP DomUs on x86_64 Xen

On Tue, 2005-10-18 at 16:45 -0400, Puthiyaparambil, Aravindh
wrote:> I was trying to bring up a SMP DomU on Xen x86_64. The DomU dies while
> booting processor 1/1. This is in spite of the fact that I have set
> vcpus to 4 in the DomU configuration file. I confirmed that the DomU
> kernel was compiled with SMP turned on. I am seeing this on the Dell and
> ES7000 x86_64 boxes. Is anyone else seeing this issue or am I doing
> something wrong?
I am seeing it, too:
[root@bl2-10 ~]# xm create -c /tmp/xen/test.cfg 
Using config file "/tmp/xen/test.cfg".
Started domain vm1
Linux version 2.6.12-xenU (root@bl2-10) (gcc version 4.0.0 20050405 (Red
Hat 4.0
.0-0.40)) #1 SMP Tue Oct 18 07:05:25 CDT 2005
kernel direct mapping tables upto 20000000 @ 50e000-610000
Built 1 zonelists
Kernel command line:  root=/dev/sdb2 ro
Initializing CPU#0
PID hash table entries: 4096 (order: 12, 131072 bytes)
Xen reported: 3600.124 MHz processor.
Dentry cache hash table entries: 131072 (order: 8, 1048576 bytes)
Inode-cache hash table entries: 65536 (order: 7, 524288 bytes)
Memory: 509440k/524288k available (1921k kernel code, 14336k reserved,
639k data
, 136k init)
Mount-cache hash table entries: 256
CPU: Trace cache: 12K uops, L1 D cache: 16K
CPU: L2 cache: 1024K
CPU: Physical Processor ID: 3
Booting processor 1/1 rip ffffffff80100008 rsp ffff880000655f58
Initializing CPU#1
CPU: Trace cache: 12K uops, L1 D cache: 16K
CPU: L2 cache: 1024K
CPU: Physical Processor ID: 0
                  Intel(R) Xeon(TM) CPU 3.60GHz stepping 01
Booting processor 2/2 rip ffffffff80100008 rsp ffff88000069ff58
Initializing CPU#2
CPU: Trace cache: 12K uops, L1 D cache: 16K
CPU: L2 cache: 1024K
CPU: Physical Processor ID: 0
                  Intel(R) Xeon(TM) CPU 3.60GHz stepping 01
Booting processor 3/3 rip ffffffff80100008 rsp ffff880000089f58
Initializing CPU#3
CPU: Trace cache: 12K uops, L1 D cache: 16K
CPU: L2 cache: 1024K
CPU: Physical Processor ID: 3
                  Intel(R) Xeon(TM) CPU 3.60GHz stepping 01
Brought up 4 CPUs

------------------------------------------------

I am not seeing the stop_this_cpu... message, however. You may want to
write a defect on the Xen bugzilla, or, if you''d like, I can do it.

David
> 
> Aravindh
> 
> DomU BOOT OUTPUT
> ----------------
> xenbox:~/xen/vm # xm create dom64_2 -c
> Using config file "dom64_2".
> Started domain dom64_2
> Linux version 2.6.12-xenU (root@xenbox) (gcc version 3.3.3 (SuSE Linux))
> #1 SMP Tue Oct 18 16:17:52 EDT 2005
> kernel direct mapping tables upto 18000000 @ 474000-536000
> Built 1 zonelists
> Kernel command line:  root=/dev/sda1 ro 3
> Initializing CPU#0
> PID hash table entries: 2048 (order: 11, 65536 bytes)
> Xen reported: 2992.694 MHz processor.
> Dentry cache hash table entries: 65536 (order: 7, 524288 bytes)
> Inode-cache hash table entries: 32768 (order: 6, 262144 bytes)
> Memory: 381952k/393216k available (1669k kernel code, 10836k reserved,
> 560k data, 136k init)
> Mount-cache hash table entries: 256
> CPU: Trace cache: 12K uops, L1 D cache: 16K
> CPU: L2 cache: 1024K
> CPU: Physical Processor ID: 0
> Booting processor 1/1 rip ffffffff80100008 rsp ffff880000575f58
> 
> SERIAL OUTPUT
> -------------
> (XEN) (file=traps.c, line=968) Non-priv domain attempted
> RDMSR(00000000c0000080,00018000,00018000).
> (XEN) (file=traps.c, line=960) Non-priv domain attempted
> WRMSR(00000000c0000100,00000000,00000000).
> (XEN) (file=traps.c, line=960) Non-priv domain attempted
> WRMSR(00000000c0000102,00000000,00000000).
> (XEN) (file=traps.c, line=968) Non-priv domain attempted
> RDMSR(00000000c0000080,00000000,00000000).
> (XEN) (file=traps.c, line=960) Non-priv domain attempted
> WRMSR(00000000c0000100,00000000,00000000).
> (XEN) (file=traps.c, line=960) Non-priv domain attempted
> WRMSR(00000000c0000102,00000000,00000000).
> (XEN) (file=traps.c, line=968) Non-priv domain attempted
> RDMSR(00000000c0000080,00000000,00000000).
> (XEN) (file=traps.c, line=968) Non-priv domain attempted
> RDMSR(00000000c0000100,00000045,ffffffffff5fd000).
> (XEN) (file=traps.c, line=968) Non-priv domain attempted
> RDMSR(00000000c0000101,00000000,00000000).
> (XEN) (file=traps.c, line=968) Non-priv domain attempted
> RDMSR(00000000c0000102,80372b00,ffffffff).
> stop_this_cpu disable_local_APIC
> 
> _______________________________________________
> Xen-devel mailing list
> Xen-devel@lists.xensource.com
> http://lists.xensource.com/xen-devel
> -- 
Regards,

David F Barrera
Linux Technology Center
Systems and Technology Group, IBM

"The wisest men follow their own direction. "
                                                        Euripides


_______________________________________________
Xen-devel mailing list
Xen-devel@lists.xensource.com
http://lists.xensource.com/xen-devel

Puthiyaparambil, Aravindh

2005-Oct-18 21:15 UTC

head link

RE: [Xen-devel] Unable to bring up SMP DomUs on x86_64 Xen

Dave,

Thanks for confirming it. I have opened a Bugzilla report. 

http://bugzilla.xensource.com/bugzilla/show_bug.cgi?id=342

Aravindh
> On Tue, 2005-10-18 at 16:45 -0400, Puthiyaparambil, Aravindh wrote:
> > I was trying to bring up a SMP DomU on Xen x86_64. The DomU dies
while> > booting processor 1/1. This is in spite of the fact that I have set
> > vcpus to 4 in the DomU configuration file. I confirmed that the DomU
> > kernel was compiled with SMP turned on. I am seeing this on the Dell
and> > ES7000 x86_64 boxes. Is anyone else seeing this issue or am I doing
> > something wrong?
> 
> I am seeing it, too:
> [root@bl2-10 ~]# xm create -c /tmp/xen/test.cfg
> Using config file "/tmp/xen/test.cfg".
> Started domain vm1
> Linux version 2.6.12-xenU (root@bl2-10) (gcc version 4.0.0 20050405
(Red> Hat 4.0
> .0-0.40)) #1 SMP Tue Oct 18 07:05:25 CDT 2005
> kernel direct mapping tables upto 20000000 @ 50e000-610000
> Built 1 zonelists
> Kernel command line:  root=/dev/sdb2 ro
> Initializing CPU#0
> PID hash table entries: 4096 (order: 12, 131072 bytes)
> Xen reported: 3600.124 MHz processor.
> Dentry cache hash table entries: 131072 (order: 8, 1048576 bytes)
> Inode-cache hash table entries: 65536 (order: 7, 524288 bytes)
> Memory: 509440k/524288k available (1921k kernel code, 14336k reserved,
> 639k data
> , 136k init)
> Mount-cache hash table entries: 256
> CPU: Trace cache: 12K uops, L1 D cache: 16K
> CPU: L2 cache: 1024K
> CPU: Physical Processor ID: 3
> Booting processor 1/1 rip ffffffff80100008 rsp ffff880000655f58
> Initializing CPU#1
> CPU: Trace cache: 12K uops, L1 D cache: 16K
> CPU: L2 cache: 1024K
> CPU: Physical Processor ID: 0
>                   Intel(R) Xeon(TM) CPU 3.60GHz stepping 01
> Booting processor 2/2 rip ffffffff80100008 rsp ffff88000069ff58
> Initializing CPU#2
> CPU: Trace cache: 12K uops, L1 D cache: 16K
> CPU: L2 cache: 1024K
> CPU: Physical Processor ID: 0
>                   Intel(R) Xeon(TM) CPU 3.60GHz stepping 01
> Booting processor 3/3 rip ffffffff80100008 rsp ffff880000089f58
> Initializing CPU#3
> CPU: Trace cache: 12K uops, L1 D cache: 16K
> CPU: L2 cache: 1024K
> CPU: Physical Processor ID: 3
>                   Intel(R) Xeon(TM) CPU 3.60GHz stepping 01
> Brought up 4 CPUs
> 
> ------------------------------------------------
> 
> I am not seeing the stop_this_cpu... message, however. You may want to
> write a defect on the Xen bugzilla, or, if you''d like, I can do
it.
> 
> David
> 
> >
> > Aravindh
> >
> > DomU BOOT OUTPUT
> > ----------------
> > xenbox:~/xen/vm # xm create dom64_2 -c
> > Using config file "dom64_2".
> > Started domain dom64_2
> > Linux version 2.6.12-xenU (root@xenbox) (gcc version 3.3.3 (SuSE
Linux))> > #1 SMP Tue Oct 18 16:17:52 EDT 2005
> > kernel direct mapping tables upto 18000000 @ 474000-536000
> > Built 1 zonelists
> > Kernel command line:  root=/dev/sda1 ro 3
> > Initializing CPU#0
> > PID hash table entries: 2048 (order: 11, 65536 bytes)
> > Xen reported: 2992.694 MHz processor.
> > Dentry cache hash table entries: 65536 (order: 7, 524288 bytes)
> > Inode-cache hash table entries: 32768 (order: 6, 262144 bytes)
> > Memory: 381952k/393216k available (1669k kernel code, 10836k
reserved,> > 560k data, 136k init)
> > Mount-cache hash table entries: 256
> > CPU: Trace cache: 12K uops, L1 D cache: 16K
> > CPU: L2 cache: 1024K
> > CPU: Physical Processor ID: 0
> > Booting processor 1/1 rip ffffffff80100008 rsp ffff880000575f58
> >
> > SERIAL OUTPUT
> > -------------
> > (XEN) (file=traps.c, line=968) Non-priv domain attempted
> > RDMSR(00000000c0000080,00018000,00018000).
> > (XEN) (file=traps.c, line=960) Non-priv domain attempted
> > WRMSR(00000000c0000100,00000000,00000000).
> > (XEN) (file=traps.c, line=960) Non-priv domain attempted
> > WRMSR(00000000c0000102,00000000,00000000).
> > (XEN) (file=traps.c, line=968) Non-priv domain attempted
> > RDMSR(00000000c0000080,00000000,00000000).
> > (XEN) (file=traps.c, line=960) Non-priv domain attempted
> > WRMSR(00000000c0000100,00000000,00000000).
> > (XEN) (file=traps.c, line=960) Non-priv domain attempted
> > WRMSR(00000000c0000102,00000000,00000000).
> > (XEN) (file=traps.c, line=968) Non-priv domain attempted
> > RDMSR(00000000c0000080,00000000,00000000).
> > (XEN) (file=traps.c, line=968) Non-priv domain attempted
> > RDMSR(00000000c0000100,00000045,ffffffffff5fd000).
> > (XEN) (file=traps.c, line=968) Non-priv domain attempted
> > RDMSR(00000000c0000101,00000000,00000000).
> > (XEN) (file=traps.c, line=968) Non-priv domain attempted
> > RDMSR(00000000c0000102,80372b00,ffffffff).
> > stop_this_cpu disable_local_APIC
> >
> > _______________________________________________
> > Xen-devel mailing list
> > Xen-devel@lists.xensource.com
> > http://lists.xensource.com/xen-devel
> >
> --
> Regards,
> 
> David F Barrera
> Linux Technology Center
> Systems and Technology Group, IBM
> 
> "The wisest men follow their own direction. "
>                                                         Euripides

_______________________________________________
Xen-devel mailing list
Xen-devel@lists.xensource.com
http://lists.xensource.com/xen-devel

David F Barrera

2005-Oct-18 21:19 UTC

head link

RE: [Xen-devel] Unable to bring up SMP DomUs on x86_64 Xen

On the SLES 9 SP2 system, I do see the stop_this_cpu.. message (my
original response was from an FC4 based system):

(XEN) (file=traps.c, line=968) Non-priv domain attempted
RDMSR(00000000c0000100,00000045,ffffffffff5fd000).
(XEN) (file=traps.c, line=968) Non-priv domain attempted
RDMSR(00000000c0000101,00000000,00000000).
(XEN) (file=traps.c, line=968) Non-priv domain attempted
RDMSR(00000000c0000102,803c7b80,ffffffff).
stop_this_cpu disable_local_APIC

On Tue, 2005-10-18 at 17:15 -0400, Puthiyaparambil, Aravindh
wrote:> Dave,
> 
> Thanks for confirming it. I have opened a Bugzilla report. 
> 
> http://bugzilla.xensource.com/bugzilla/show_bug.cgi?id=342
> 
> Aravindh
> 
> > On Tue, 2005-10-18 at 16:45 -0400, Puthiyaparambil, Aravindh wrote:
> > > I was trying to bring up a SMP DomU on Xen x86_64. The DomU dies
> while
> > > booting processor 1/1. This is in spite of the fact that I have
set
> > > vcpus to 4 in the DomU configuration file. I confirmed that the
DomU
> > > kernel was compiled with SMP turned on. I am seeing this on the
Dell
> and
> > > ES7000 x86_64 boxes. Is anyone else seeing this issue or am I
doing
> > > something wrong?
> > 
> > I am seeing it, too:
> > [root@bl2-10 ~]# xm create -c /tmp/xen/test.cfg
> > Using config file "/tmp/xen/test.cfg".
> > Started domain vm1
> > Linux version 2.6.12-xenU (root@bl2-10) (gcc version 4.0.0 20050405
> (Red
> > Hat 4.0
> > .0-0.40)) #1 SMP Tue Oct 18 07:05:25 CDT 2005
> > kernel direct mapping tables upto 20000000 @ 50e000-610000
> > Built 1 zonelists
> > Kernel command line:  root=/dev/sdb2 ro
> > Initializing CPU#0
> > PID hash table entries: 4096 (order: 12, 131072 bytes)
> > Xen reported: 3600.124 MHz processor.
> > Dentry cache hash table entries: 131072 (order: 8, 1048576 bytes)
> > Inode-cache hash table entries: 65536 (order: 7, 524288 bytes)
> > Memory: 509440k/524288k available (1921k kernel code, 14336k reserved,
> > 639k data
> > , 136k init)
> > Mount-cache hash table entries: 256
> > CPU: Trace cache: 12K uops, L1 D cache: 16K
> > CPU: L2 cache: 1024K
> > CPU: Physical Processor ID: 3
> > Booting processor 1/1 rip ffffffff80100008 rsp ffff880000655f58
> > Initializing CPU#1
> > CPU: Trace cache: 12K uops, L1 D cache: 16K
> > CPU: L2 cache: 1024K
> > CPU: Physical Processor ID: 0
> >                   Intel(R) Xeon(TM) CPU 3.60GHz stepping 01
> > Booting processor 2/2 rip ffffffff80100008 rsp ffff88000069ff58
> > Initializing CPU#2
> > CPU: Trace cache: 12K uops, L1 D cache: 16K
> > CPU: L2 cache: 1024K
> > CPU: Physical Processor ID: 0
> >                   Intel(R) Xeon(TM) CPU 3.60GHz stepping 01
> > Booting processor 3/3 rip ffffffff80100008 rsp ffff880000089f58
> > Initializing CPU#3
> > CPU: Trace cache: 12K uops, L1 D cache: 16K
> > CPU: L2 cache: 1024K
> > CPU: Physical Processor ID: 3
> >                   Intel(R) Xeon(TM) CPU 3.60GHz stepping 01
> > Brought up 4 CPUs
> > 
> > ------------------------------------------------
> > 
> > I am not seeing the stop_this_cpu... message, however. You may want to
> > write a defect on the Xen bugzilla, or, if you''d like, I can
do it.
> > 
> > David
> > 
> > >
> > > Aravindh
> > >
> > > DomU BOOT OUTPUT
> > > ----------------
> > > xenbox:~/xen/vm # xm create dom64_2 -c
> > > Using config file "dom64_2".
> > > Started domain dom64_2
> > > Linux version 2.6.12-xenU (root@xenbox) (gcc version 3.3.3 (SuSE
> Linux))
> > > #1 SMP Tue Oct 18 16:17:52 EDT 2005
> > > kernel direct mapping tables upto 18000000 @ 474000-536000
> > > Built 1 zonelists
> > > Kernel command line:  root=/dev/sda1 ro 3
> > > Initializing CPU#0
> > > PID hash table entries: 2048 (order: 11, 65536 bytes)
> > > Xen reported: 2992.694 MHz processor.
> > > Dentry cache hash table entries: 65536 (order: 7, 524288 bytes)
> > > Inode-cache hash table entries: 32768 (order: 6, 262144 bytes)
> > > Memory: 381952k/393216k available (1669k kernel code, 10836k
> reserved,
> > > 560k data, 136k init)
> > > Mount-cache hash table entries: 256
> > > CPU: Trace cache: 12K uops, L1 D cache: 16K
> > > CPU: L2 cache: 1024K
> > > CPU: Physical Processor ID: 0
> > > Booting processor 1/1 rip ffffffff80100008 rsp ffff880000575f58
> > >
> > > SERIAL OUTPUT
> > > -------------
> > > (XEN) (file=traps.c, line=968) Non-priv domain attempted
> > > RDMSR(00000000c0000080,00018000,00018000).
> > > (XEN) (file=traps.c, line=960) Non-priv domain attempted
> > > WRMSR(00000000c0000100,00000000,00000000).
> > > (XEN) (file=traps.c, line=960) Non-priv domain attempted
> > > WRMSR(00000000c0000102,00000000,00000000).
> > > (XEN) (file=traps.c, line=968) Non-priv domain attempted
> > > RDMSR(00000000c0000080,00000000,00000000).
> > > (XEN) (file=traps.c, line=960) Non-priv domain attempted
> > > WRMSR(00000000c0000100,00000000,00000000).
> > > (XEN) (file=traps.c, line=960) Non-priv domain attempted
> > > WRMSR(00000000c0000102,00000000,00000000).
> > > (XEN) (file=traps.c, line=968) Non-priv domain attempted
> > > RDMSR(00000000c0000080,00000000,00000000).
> > > (XEN) (file=traps.c, line=968) Non-priv domain attempted
> > > RDMSR(00000000c0000100,00000045,ffffffffff5fd000).
> > > (XEN) (file=traps.c, line=968) Non-priv domain attempted
> > > RDMSR(00000000c0000101,00000000,00000000).
> > > (XEN) (file=traps.c, line=968) Non-priv domain attempted
> > > RDMSR(00000000c0000102,80372b00,ffffffff).
> > > stop_this_cpu disable_local_APIC
> > >
> > > _______________________________________________
> > > Xen-devel mailing list
> > > Xen-devel@lists.xensource.com
> > > http://lists.xensource.com/xen-devel
> > >
> > --
> > Regards,
> > 
> > David F Barrera
> > Linux Technology Center
> > Systems and Technology Group, IBM
> > 
> > "The wisest men follow their own direction. "
> >                                                         Euripides
> 
> 
> _______________________________________________
> Xen-devel mailing list
> Xen-devel@lists.xensource.com
> http://lists.xensource.com/xen-devel
> 

_______________________________________________
Xen-devel mailing list
Xen-devel@lists.xensource.com
http://lists.xensource.com/xen-devel

Xen devel - Oct 2005 - Unable to bring up SMP DomUs on x86_64 Xen

[Xen-devel] Unable to bring up SMP DomUs on x86_64 Xen

Re: [Xen-devel] Unable to bring up SMP DomUs on x86_64 Xen

RE: [Xen-devel] Unable to bring up SMP DomUs on x86_64 Xen

RE: [Xen-devel] Unable to bring up SMP DomUs on x86_64 Xen