Mr. Teo En Ming (Zhang Enming)
2009-Nov-07 05:10 UTC
[Xen-devel] Low Network Throughput between HVM Guests
Hi, Is it possible to increase network throughput between HVM virtual machines? It is very slow. -- Mr. Teo En Ming (Zhang Enming) Dip(Mechatronics) BEng(Hons)(Mechanical Engineering) Alma Maters: (1) Singapore Polytechnic (2) National University of Singapore My Primary Blog: http://teo-en-ming-aka-zhang-enming.blogspot.com My Secondary Blog: http://enmingteo.wordpress.com My Youtube videos: http://www.youtube.com/user/enmingteo Email: space.time.universe@gmail.com Mobile Phone (Starhub Prepaid): +65-8369-2618 Street: Bedok Reservoir Road Country: Singapore _______________________________________________ Xen-devel mailing list Xen-devel@lists.xensource.com http://lists.xensource.com/xen-devel
Mr. Teo En Ming (Zhang Enming)
2009-Nov-07 09:16 UTC
[Xen-devel] Re: Low Network Throughput between HVM Guests
Hi All, Please refer to the following thread: http://lists.sdsc.edu/pipermail/npaci-rocks-discussion/2009-November/043597.html -- Mr. Teo En Ming (Zhang Enming) Dip(Mechatronics) BEng(Hons)(Mechanical Engineering) Alma Maters: (1) Singapore Polytechnic (2) National University of Singapore My Primary Blog: http://teo-en-ming-aka-zhang-enming.blogspot.com My Secondary Blog: http://enmingteo.wordpress.com My Youtube videos: http://www.youtube.com/user/enmingteo Email: space.time.universe@gmail.com Mobile Phone (Starhub Prepaid): +65-8369-2618 Street: Bedok Reservoir Road Country: Singapore On Sat, Nov 7, 2009 at 1:10 PM, Mr. Teo En Ming (Zhang Enming) < space.time.universe@gmail.com> wrote:> Hi, > > Is it possible to increase network throughput between HVM virtual machines? > It is very slow. > > -- > Mr. Teo En Ming (Zhang Enming) Dip(Mechatronics) BEng(Hons)(Mechanical > Engineering) > Alma Maters: > (1) Singapore Polytechnic > (2) National University of Singapore > My Primary Blog: http://teo-en-ming-aka-zhang-enming.blogspot.com > My Secondary Blog: http://enmingteo.wordpress.com > My Youtube videos: http://www.youtube.com/user/enmingteo > Email: space.time.universe@gmail.com > Mobile Phone (Starhub Prepaid): +65-8369-2618 > Street: Bedok Reservoir Road > Country: Singapore >_______________________________________________ Xen-devel mailing list Xen-devel@lists.xensource.com http://lists.xensource.com/xen-devel
Pasi Kärkkäinen
2009-Nov-07 11:17 UTC
Re: [Xen-devel] Low Network Throughput between HVM Guests
On Sat, Nov 07, 2009 at 01:10:56PM +0800, Mr. Teo En Ming (Zhang Enming) wrote:> Hi, > > Is it possible to increase network throughput between HVM virtual > machines? It is very slow. >Do you have PV drivers installed in the HVM guests? if not, use e1000 NIC. -- Pasi _______________________________________________ Xen-devel mailing list Xen-devel@lists.xensource.com http://lists.xensource.com/xen-devel
Mr. Teo En Ming (Zhang Enming)
2009-Nov-07 11:23 UTC
Re: [Xen-devel] Low Network Throughput between HVM Guests
Hi Pasi, I am not sure whether I can install PV drivers in Rocks HPC Cluster software 5.1 x86-64 (based on CentOS) HVM virtual machines. When I tried to install Rocks 5.1 x86-64 as a PV guest, it complains "invalid kernel" and something about the ELF kernel image. So I guess PV is out for Rocks. To set e1000 (virtualized Intel Gigabit NIC), I have to use the model parameter in vif in HVM config? Will I get gigabit speeds instead of the Fast Ethernet 100Mb/s speed with virtual Realtek NICs? Thank you. -- Mr. Teo En Ming (Zhang Enming) Dip(Mechatronics) BEng(Hons)(Mechanical Engineering) Alma Maters: (1) Singapore Polytechnic (2) National University of Singapore My Primary Blog: http://teo-en-ming-aka-zhang-enming.blogspot.com My Secondary Blog: http://enmingteo.wordpress.com My Youtube videos: http://www.youtube.com/user/enmingteo Email: space.time.universe@gmail.com Mobile Phone (Starhub Prepaid): +65-8369-2618 Street: Bedok Reservoir Road Country: Singapore On Sat, Nov 7, 2009 at 7:17 PM, Pasi Kärkkäinen <pasik@iki.fi> wrote:> On Sat, Nov 07, 2009 at 01:10:56PM +0800, Mr. Teo En Ming (Zhang Enming) > wrote: > > Hi, > > > > Is it possible to increase network throughput between HVM virtual > > machines? It is very slow. > > > > Do you have PV drivers installed in the HVM guests? if not, use e1000 NIC. > > -- Pasi > >_______________________________________________ Xen-devel mailing list Xen-devel@lists.xensource.com http://lists.xensource.com/xen-devel
Mr. Teo En Ming (Zhang Enming)
2009-Nov-07 11:27 UTC
Re: [Xen-devel] Low Network Throughput between HVM Guests
Hi Pasi, With reference to http://download.oracle.com/docs/cd/E11081_01/doc/doc.21/e10898/templates.htm#BABGBGHA, vif = [ ''type=ioemu, mac=00:16:3e:09:bb:c6, bridge=xenbr2, model=e1000''] Can I omit type=ioemu? -- Mr. Teo En Ming (Zhang Enming) Dip(Mechatronics) BEng(Hons)(Mechanical Engineering) Alma Maters: (1) Singapore Polytechnic (2) National University of Singapore My Primary Blog: http://teo-en-ming-aka-zhang-enming.blogspot.com My Secondary Blog: http://enmingteo.wordpress.com My Youtube videos: http://www.youtube.com/user/enmingteo Email: space.time.universe@gmail.com Mobile Phone (Starhub Prepaid): +65-8369-2618 Street: Bedok Reservoir Road Country: Singapore On Sat, Nov 7, 2009 at 7:23 PM, Mr. Teo En Ming (Zhang Enming) < space.time.universe@gmail.com> wrote:> Hi Pasi, > > I am not sure whether I can install PV drivers in Rocks HPC Cluster > software 5.1 x86-64 (based on CentOS) HVM virtual machines. When I tried to > install Rocks 5.1 x86-64 as a PV guest, it complains "invalid kernel" and > something about the ELF kernel image. So I guess PV is out for Rocks. > > To set e1000 (virtualized Intel Gigabit NIC), I have to use the model > parameter in vif in HVM config? Will I get gigabit speeds instead of the > Fast Ethernet 100Mb/s speed with virtual Realtek NICs? > > Thank you. > > > -- > Mr. Teo En Ming (Zhang Enming) Dip(Mechatronics) BEng(Hons)(Mechanical > Engineering) > Alma Maters: > (1) Singapore Polytechnic > (2) National University of Singapore > My Primary Blog: http://teo-en-ming-aka-zhang-enming.blogspot.com > My Secondary Blog: http://enmingteo.wordpress.com > My Youtube videos: http://www.youtube.com/user/enmingteo > Email: space.time.universe@gmail.com > Mobile Phone (Starhub Prepaid): +65-8369-2618 > Street: Bedok Reservoir Road > Country: Singapore > > On Sat, Nov 7, 2009 at 7:17 PM, Pasi Kärkkäinen <pasik@iki.fi> wrote: > >> On Sat, Nov 07, 2009 at 01:10:56PM +0800, Mr. Teo En Ming (Zhang Enming) >> wrote: >> > Hi, >> > >> > Is it possible to increase network throughput between HVM virtual >> > machines? It is very slow. >> > >> >> Do you have PV drivers installed in the HVM guests? if not, use e1000 NIC. >> >> -- Pasi >> >> > > >_______________________________________________ Xen-devel mailing list Xen-devel@lists.xensource.com http://lists.xensource.com/xen-devel
Pasi Kärkkäinen
2009-Nov-07 13:15 UTC
Re: [Xen-devel] Low Network Throughput between HVM Guests
On Sat, Nov 07, 2009 at 07:23:48PM +0800, Mr. Teo En Ming (Zhang Enming) wrote:> Hi Pasi, > > I am not sure whether I can install PV drivers in Rocks HPC Cluster > software 5.1 x86-64 (based on CentOS) HVM virtual machines. When I tried > to install Rocks 5.1 x86-64 as a PV guest, it complains "invalid kernel" > and something about the ELF kernel image. So I guess PV is out for Rocks. >What complains about invalid kernel? I think redhat does ship pv-on-hvm drivers with rhel/centos, so you could enable those and get paravirtualized disk and network for the HVM guest.> To set e1000 (virtualized Intel Gigabit NIC), I have to use the model > parameter in vif in HVM config? Will I get gigabit speeds instead of the > Fast Ethernet 100Mb/s speed with virtual Realtek NICs? >In a virtual guest those reported speeds don''t mean much.. so even when the realtek nic reports 100 Mbit/sec speed, it can go faster. But yeah, model=e1000 and it will be reported as 1Gbit/sec. Qemu e1000 emulation is faster than realtek emulation.. so that should be better. -- Pasi _______________________________________________ Xen-devel mailing list Xen-devel@lists.xensource.com http://lists.xensource.com/xen-devel
Mr. Teo En Ming (Zhang Enming)
2009-Nov-07 15:30 UTC
Re: [Xen-devel] Low Network Throughput between HVM Guests
Hi Pasi, I have added ''type=ioemu'' and ''model=e1000'' to vif in my HVM configuration files. Now the Rocks HPC Cluster 5.1 x86-64 Frontend node detected two Intel 82540 Gigabit Ethernet controllers. Hopefully this will speed up my compute node installation with the upgraded gigabit speed. -- Mr. Teo En Ming (Zhang Enming) Dip(Mechatronics) BEng(Hons)(Mechanical Engineering) Alma Maters: (1) Singapore Polytechnic (2) National University of Singapore My Primary Blog: http://teo-en-ming-aka-zhang-enming.blogspot.com My Secondary Blog: http://enmingteo.wordpress.com My Youtube videos: http://www.youtube.com/user/enmingteo Email: space.time.universe@gmail.com Mobile Phone (Starhub Prepaid): +65-8369-2618 Street: Bedok Reservoir Road Country: Singapore On Sat, Nov 7, 2009 at 9:15 PM, Pasi Kärkkäinen <pasik@iki.fi> wrote:> On Sat, Nov 07, 2009 at 07:23:48PM +0800, Mr. Teo En Ming (Zhang Enming) > wrote: > > Hi Pasi, > > > > I am not sure whether I can install PV drivers in Rocks HPC Cluster > > software 5.1 x86-64 (based on CentOS) HVM virtual machines. When I > tried > > to install Rocks 5.1 x86-64 as a PV guest, it complains "invalid > kernel" > > and something about the ELF kernel image. So I guess PV is out for > Rocks. > > > > What complains about invalid kernel? > > I think redhat does ship pv-on-hvm drivers with rhel/centos, so you > could enable those and get paravirtualized disk and network for the HVM > guest. > > > To set e1000 (virtualized Intel Gigabit NIC), I have to use the model > > parameter in vif in HVM config? Will I get gigabit speeds instead of > the > > Fast Ethernet 100Mb/s speed with virtual Realtek NICs? > > > > In a virtual guest those reported speeds don''t mean much.. so even when the > realtek nic reports 100 Mbit/sec speed, it can go faster. > > But yeah, model=e1000 and it will be reported as 1Gbit/sec. > > Qemu e1000 emulation is faster than realtek emulation.. so that should be > better. > > -- Pasi > >_______________________________________________ Xen-devel mailing list Xen-devel@lists.xensource.com http://lists.xensource.com/xen-devel
Mr. Teo En Ming (Zhang Enming)
2009-Nov-07 15:40 UTC
Re: [Xen-devel] Low Network Throughput between HVM Guests
Hi Pasi, Yay!!!! My Rocks HPC Cluster 5.1 x86-64 first compute node is finally installing!!! The emulated Realtek Fast Ethernet 100 Mb/s network card is really wasting a lot of my time. Thanks for pointing me to e1000!!! Now I get upgraded Gigabit network card speed! Thanks so much Pasi!!! -- Mr. Teo En Ming (Zhang Enming) Dip(Mechatronics) BEng(Hons)(Mechanical Engineering) Alma Maters: (1) Singapore Polytechnic (2) National University of Singapore My Primary Blog: http://teo-en-ming-aka-zhang-enming.blogspot.com My Secondary Blog: http://enmingteo.wordpress.com My Youtube videos: http://www.youtube.com/user/enmingteo Email: space.time.universe@gmail.com Mobile Phone (Starhub Prepaid): +65-8369-2618 Street: Bedok Reservoir Road Country: Singapore On Sat, Nov 7, 2009 at 11:30 PM, Mr. Teo En Ming (Zhang Enming) < space.time.universe@gmail.com> wrote:> Hi Pasi, > > I have added ''type=ioemu'' and ''model=e1000'' to vif in my HVM configuration > files. Now the Rocks HPC Cluster 5.1 x86-64 Frontend node detected two Intel > 82540 Gigabit Ethernet controllers. Hopefully this will speed up my compute > node installation with the upgraded gigabit speed. > > > -- > Mr. Teo En Ming (Zhang Enming) Dip(Mechatronics) BEng(Hons)(Mechanical > Engineering) > Alma Maters: > (1) Singapore Polytechnic > (2) National University of Singapore > My Primary Blog: http://teo-en-ming-aka-zhang-enming.blogspot.com > My Secondary Blog: http://enmingteo.wordpress.com > My Youtube videos: http://www.youtube.com/user/enmingteo > Email: space.time.universe@gmail.com > Mobile Phone (Starhub Prepaid): +65-8369-2618 > Street: Bedok Reservoir Road > Country: Singapore > > On Sat, Nov 7, 2009 at 9:15 PM, Pasi Kärkkäinen <pasik@iki.fi> wrote: > >> On Sat, Nov 07, 2009 at 07:23:48PM +0800, Mr. Teo En Ming (Zhang Enming) >> wrote: >> > Hi Pasi, >> > >> > I am not sure whether I can install PV drivers in Rocks HPC Cluster >> > software 5.1 x86-64 (based on CentOS) HVM virtual machines. When I >> tried >> > to install Rocks 5.1 x86-64 as a PV guest, it complains "invalid >> kernel" >> > and something about the ELF kernel image. So I guess PV is out for >> Rocks. >> > >> >> What complains about invalid kernel? >> >> I think redhat does ship pv-on-hvm drivers with rhel/centos, so you >> could enable those and get paravirtualized disk and network for the HVM >> guest. >> >> > To set e1000 (virtualized Intel Gigabit NIC), I have to use the model >> > parameter in vif in HVM config? Will I get gigabit speeds instead of >> the >> > Fast Ethernet 100Mb/s speed with virtual Realtek NICs? >> > >> >> In a virtual guest those reported speeds don''t mean much.. so even when >> the >> realtek nic reports 100 Mbit/sec speed, it can go faster. >> >> But yeah, model=e1000 and it will be reported as 1Gbit/sec. >> >> Qemu e1000 emulation is faster than realtek emulation.. so that should be >> better. >> >> -- Pasi >> >> > > > >_______________________________________________ Xen-devel mailing list Xen-devel@lists.xensource.com http://lists.xensource.com/xen-devel
Mr. Teo En Ming (Zhang Enming)
2009-Nov-07 15:53 UTC
Re: [Xen-devel] Low Network Throughput between HVM Guests
C.1 e100 And e1000 Network Device Emulators You can use the network device emulators for the Intel 8255x 10/100 Mbps Ethernet controller (the e100 controller) and the Intel 82540EM Gigabit Ethernet controller (the e1000 controller) for hardware virtualized guests. The e1000 controller is a Gigabit Ethernet controller and increases the network throughput when compared to the default Ethernet controller. To use these network device emulators, install the network device driver on the guest, then modify the guest configuration file to specify the controller model type: either e100; or e1000. For example, to use the e1000 controller, set model=e1000 in the vif entry in the guest configuration file: vif = [ ''type=ioemu, mac=00:16:3e:09:bb:c6, bridge=xenbr2, model=e1000''] Create the guest again using the xm create command. The guest now uses the faster e1000 controller. ***************************************************************************** Previously I thought QEMU only supports emulated Realtek Fast Ethernet 100 Mb/s controllers. -- Mr. Teo En Ming (Zhang Enming) Dip(Mechatronics) BEng(Hons)(Mechanical Engineering) Alma Maters: (1) Singapore Polytechnic (2) National University of Singapore My Primary Blog: http://teo-en-ming-aka-zhang-enming.blogspot.com My Secondary Blog: http://enmingteo.wordpress.com My Youtube videos: http://www.youtube.com/user/enmingteo Email: space.time.universe@gmail.com Mobile Phone (Starhub Prepaid): +65-8369-2618 Street: Bedok Reservoir Road Country: Singapore On Sat, Nov 7, 2009 at 11:40 PM, Mr. Teo En Ming (Zhang Enming) < space.time.universe@gmail.com> wrote:> Hi Pasi, > > Yay!!!! My Rocks HPC Cluster 5.1 x86-64 first compute node is finally > installing!!! The emulated Realtek Fast Ethernet 100 Mb/s network card is > really wasting a lot of my time. Thanks for pointing me to e1000!!! Now I > get upgraded Gigabit network card speed! > > Thanks so much Pasi!!! > > > -- > Mr. Teo En Ming (Zhang Enming) Dip(Mechatronics) BEng(Hons)(Mechanical > Engineering) > Alma Maters: > (1) Singapore Polytechnic > (2) National University of Singapore > My Primary Blog: http://teo-en-ming-aka-zhang-enming.blogspot.com > My Secondary Blog: http://enmingteo.wordpress.com > My Youtube videos: http://www.youtube.com/user/enmingteo > Email: space.time.universe@gmail.com > Mobile Phone (Starhub Prepaid): +65-8369-2618 > Street: Bedok Reservoir Road > Country: Singapore > > On Sat, Nov 7, 2009 at 11:30 PM, Mr. Teo En Ming (Zhang Enming) < > space.time.universe@gmail.com> wrote: > >> Hi Pasi, >> >> I have added ''type=ioemu'' and ''model=e1000'' to vif in my HVM configuration >> files. Now the Rocks HPC Cluster 5.1 x86-64 Frontend node detected two Intel >> 82540 Gigabit Ethernet controllers. Hopefully this will speed up my compute >> node installation with the upgraded gigabit speed. >> >> >> -- >> Mr. Teo En Ming (Zhang Enming) Dip(Mechatronics) BEng(Hons)(Mechanical >> Engineering) >> Alma Maters: >> (1) Singapore Polytechnic >> (2) National University of Singapore >> My Primary Blog: http://teo-en-ming-aka-zhang-enming.blogspot.com >> My Secondary Blog: http://enmingteo.wordpress.com >> My Youtube videos: http://www.youtube.com/user/enmingteo >> Email: space.time.universe@gmail.com >> Mobile Phone (Starhub Prepaid): +65-8369-2618 >> Street: Bedok Reservoir Road >> Country: Singapore >> >> On Sat, Nov 7, 2009 at 9:15 PM, Pasi Kärkkäinen <pasik@iki.fi> wrote: >> >>> On Sat, Nov 07, 2009 at 07:23:48PM +0800, Mr. Teo En Ming (Zhang Enming) >>> wrote: >>> > Hi Pasi, >>> > >>> > I am not sure whether I can install PV drivers in Rocks HPC Cluster >>> > software 5.1 x86-64 (based on CentOS) HVM virtual machines. When I >>> tried >>> > to install Rocks 5.1 x86-64 as a PV guest, it complains "invalid >>> kernel" >>> > and something about the ELF kernel image. So I guess PV is out for >>> Rocks. >>> > >>> >>> What complains about invalid kernel? >>> >>> I think redhat does ship pv-on-hvm drivers with rhel/centos, so you >>> could enable those and get paravirtualized disk and network for the HVM >>> guest. >>> >>> > To set e1000 (virtualized Intel Gigabit NIC), I have to use the >>> model >>> > parameter in vif in HVM config? Will I get gigabit speeds instead of >>> the >>> > Fast Ethernet 100Mb/s speed with virtual Realtek NICs? >>> > >>> >>> In a virtual guest those reported speeds don''t mean much.. so even when >>> the >>> realtek nic reports 100 Mbit/sec speed, it can go faster. >>> >>> But yeah, model=e1000 and it will be reported as 1Gbit/sec. >>> >>> Qemu e1000 emulation is faster than realtek emulation.. so that should be >>> better. >>> >>> -- Pasi >>> >>> >> >> >> >> > > > >_______________________________________________ Xen-devel mailing list Xen-devel@lists.xensource.com http://lists.xensource.com/xen-devel