Jan Marquardt
2009-May-27 09:07 UTC
[Xen-users] Xen 3.2 with Ubuntu 8.04 (64-Bit) on Intel Nehalem (i7)
Hallo list, i am testing a Dell M610 with two quadcore Intel Nehalem CPUs at the moment, so with Hyper-Threading 16 cores in total. As mentioned in the subject I am using Ubuntu 8.04 64Bit and Xen 3.2 from Ubuntu package. During these tests I hit on some issues, which are not clear to me. I would be thankful for any comments/hints/thoughts on the following topics: 1. I recognized that CONFIG_NR_CPUS is set to 8 in the Ubuntu Xen kernel. However, the Ubuntu server kernel has a limitation of 64. Is there any specific reason for the limitation of 8 in the Xen kernel? 2. After recompiling the kernel with CONFIG_NR_CPUS=16 /proc/cpuinfo still just shows 8 cores, but xm vcpu-list shows the 16 cores correctly. Does someone know which config options are necessary to get it working correctly? 3. As you may know the Nehalem cpus support Hyper Threading again. Is it recommendable/useful to treat the logical cores like the physical cores? In our case we always assign one core only once to one domu to guarantee the performance to our customers. So the main question is if the performance differs between physical and logical cores noticeable. Kind regards, Jan Marquardt _______________________________________________ Xen-users mailing list Xen-users@lists.xensource.com http://lists.xensource.com/xen-users
Nikita Lebedev
2009-May-27 09:18 UTC
Re: [Xen-users] Xen 3.2 with Ubuntu 8.04 (64-Bit) on Intel Nehalem (i7)
Jan Marquardt пишет:> Hallo list, > > i am testing a Dell M610 with two quadcore Intel Nehalem CPUs at the > moment, so with Hyper-Threading 16 cores in total. As mentioned in the > subject I am using Ubuntu 8.04 64Bit and Xen 3.2 from Ubuntu package. > During these tests I hit on some issues, which are not clear to me. I > would be thankful for any comments/hints/thoughts on the following > topics: > > 1. I recognized that CONFIG_NR_CPUS is set to 8 in the Ubuntu Xen > kernel. However, the Ubuntu server kernel has a limitation of 64. Is > there any specific reason for the limitation of 8 in the Xen kernel? > > 2. After recompiling the kernel with CONFIG_NR_CPUS=16 /proc/cpuinfo > still just shows 8 cores, but xm vcpu-list shows the 16 cores > correctly. Does someone know which config options are necessary to get > it working correctly? > > 3. As you may know the Nehalem cpus support Hyper Threading again. Is > it recommendable/useful to treat the logical cores like the > physical cores? In our case we always assign one core only once to one > domu to guarantee the performance to our customers. So the main > question is if the performance differs between physical and logical > cores noticeable. > > Kind regards, > > Jan Marquardt > > _______________________________________________ > Xen-users mailing list > Xen-users@lists.xensource.com > http://lists.xensource.com/xen-usersAFAIK HT technology decrease VM performance. VMware strongly recommends to disable HT on servers, which runs VMware ESX server, I think that Xen is familar to ESX, so HT will decrease performance on Xen too. _______________________________________________ Xen-users mailing list Xen-users@lists.xensource.com http://lists.xensource.com/xen-users
Nathan Eisenberg
2009-May-27 15:17 UTC
RE: [Xen-users] Xen 3.2 with Ubuntu 8.04 (64-Bit) on Intel Nehalem (i7)
The new Nehalem implementation of HT is significantly improved over the Pentium 4 version of it. Personally, I would lean towards leaving it on. However, it should be pretty trivial for you to do some benchmarks and figure out what gives the best result in your configuration. Thank You, Nathan Eisenberg Sr. Systems Administrator Atlas Networks, LLC Atlas Networks is an Atlas Accelerator Company -----Original Message----- From: xen-users-bounces@lists.xensource.com [mailto:xen-users-bounces@lists.xensource.com] On Behalf Of Nikita Lebedev Sent: Wednesday, May 27, 2009 2:18 AM To: Jan Marquardt Cc: xen-users@lists.xensource.com Subject: Re: [Xen-users] Xen 3.2 with Ubuntu 8.04 (64-Bit) on Intel Nehalem (i7) Jan Marquardt пишет:> Hallo list, > > i am testing a Dell M610 with two quadcore Intel Nehalem CPUs at the > moment, so with Hyper-Threading 16 cores in total. As mentioned in the > subject I am using Ubuntu 8.04 64Bit and Xen 3.2 from Ubuntu package. > During these tests I hit on some issues, which are not clear to me. I > would be thankful for any comments/hints/thoughts on the following > topics: > > 1. I recognized that CONFIG_NR_CPUS is set to 8 in the Ubuntu Xen > kernel. However, the Ubuntu server kernel has a limitation of 64. Is > there any specific reason for the limitation of 8 in the Xen kernel? > > 2. After recompiling the kernel with CONFIG_NR_CPUS=16 /proc/cpuinfo > still just shows 8 cores, but xm vcpu-list shows the 16 cores > correctly. Does someone know which config options are necessary to get > it working correctly? > > 3. As you may know the Nehalem cpus support Hyper Threading again. Is > it recommendable/useful to treat the logical cores like the > physical cores? In our case we always assign one core only once to one > domu to guarantee the performance to our customers. So the main > question is if the performance differs between physical and logical > cores noticeable. > > Kind regards, > > Jan Marquardt > > _______________________________________________ > Xen-users mailing list > Xen-users@lists.xensource.com > http://lists.xensource.com/xen-usersAFAIK HT technology decrease VM performance. VMware strongly recommends to disable HT on servers, which runs VMware ESX server, I think that Xen is familar to ESX, so HT will decrease performance on Xen too. _______________________________________________ Xen-users mailing list Xen-users@lists.xensource.com http://lists.xensource.com/xen-users _______________________________________________ Xen-users mailing list Xen-users@lists.xensource.com http://lists.xensource.com/xen-users
Jan Marquardt
2009-May-28 08:51 UTC
Re: [Xen-users] Xen 3.2 with Ubuntu 8.04 (64-Bit) on Intel Nehalem (i7)
Jan Marquardt wrote:> 2. After recompiling the kernel with CONFIG_NR_CPUS=16 /proc/cpuinfo > still just shows 8 cores, but xm vcpu-list shows the 16 cores correctly. > Does someone know which config options are necessary to get it working > correctly?I am now able to answer this question on my own. Hyper Threading is under Ubuntu disabled on default. You can activate it by setting "ht=on" on the kernel command line. I have got this information from the thread below: http://ubuntuforums.org/showthread.php?p=895077 _______________________________________________ Xen-users mailing list Xen-users@lists.xensource.com http://lists.xensource.com/xen-users