Xen users - Jul 2009 - Xen Networking and bonded interfaces on Debia Lenny

Greetings all. This has been an ongoing issue for me for a few months, and
I''ve been trying to get an answer.

My server has two NICs, and I want to set up the following:

NICs (x2) -> bond (mode 5) -> Xen Bridge -> Doms

...however, trying to configure this doesn''t seem to work:
network-bridge steals eth0 instead of bond0, which breaks the bond AND my
networking. The result is a "pbond0" interface with no IP, and
occasionally a "peth0", also with no IP. In either case neither eth0
(or 1) or bond0 exist and as such I have no networking at all! If I boot without
Xen the bond works fine, so I know that''s not the problem.

If I reconfigure zend-config.sxp to change netdev=bond0, I still have the same
issues, though the specific wording of the error (2 pages on a computer I
can''t connect to, and before logon so I can''t | less) is
different. I''ve also tried messing with the network-bridge script to no
avail.

I''ve read both the manual and the wiki, and while the wiki makes
mention of using a bond, it doesn''t show specifically what is required.
I was wondering if anyone else could shed some light on the issues. I''m
willing to (attempt) to write out those 2 pages of errors, if required, though I
have a feeling this is just a configuration issue.

I have a thread on LinuxQuestions about the issue. URL:
http://www.linuxquestions.org/questions/linux-server-73/using-xen-and-nic-bonding-please-help-736996/

Thank you for your assistance.

_______________________________________________
Xen-users mailing list
Xen-users@lists.xensource.com
http://lists.xensource.com/xen-users

> 
> Greetings all. This has been an ongoing issue for me for a few months,
and
> I''ve been trying to get an answer.
> 
> My server has two NICs, and I want to set up the following:
> 
> NICs (x2) -> bond (mode 5) -> Xen Bridge -> Doms
> 
You don''t need to use Xen to set up the bridge for you. You can just do
it yourself in /etc/network/interfaces the same as you would without xen
and just get rid of the network-script line from the xend-config.sxp
file.

James

_______________________________________________
Xen-users mailing list
Xen-users@lists.xensource.com
http://lists.xensource.com/xen-users

Hi,

On Sun, 2009-07-05 at 19:36 +0000, Joshua Boniface
wrote:
> Greetings all. This has been an ongoing issue for me for a few months,
> and I''ve been trying to get an answer.
> 
> My server has two NICs, and I want to set up the following:
> 
> NICs (x2) -> bond (mode 5) -> Xen Bridge -> Doms
A little background for you, the purpose of network-bridge is to start
bridged networking when xend starts and take it down when xend stops.
Its a creature comfort that allows you to use Xen on your desktop
without going though the hassle of modifying / restoring your system
network configuration every time you want to use Xen.

In a production (server) environment, its much much better to just allow
your operating system to control networking. network-bridge is not smart
enough to deal with complex configurations.

To take network-bridge out of the picture, try this:

cat << EOF > /etc/xen/scripts/network-dummy
#!/bin/sh

exit 0
EOF

chmod +x /etc/xen/network-dummy

Check to be sure that the file is not already there prior to creating
it.

Then, edit /etc/xend-config.sxp , look for:

(network-script network-bridge)

Change it to:

(network-script network-dummy)

At this point, xend will not try to do anything to networking when it
starts. You can then configure the bond / bridge via whatever means is
sensible for your OS.

If you let us know what OS you are using, someone can help you with that
part too.

Cheers,
--Tim



_______________________________________________
Xen-users mailing list
Xen-users@lists.xensource.com
http://lists.xensource.com/xen-users

> 
> If you let us know what OS you are using, someone can help you with
that
> part too.
> 
He''s put ''Debian Lenny'' in the subject so at a guess
it is Debian Lenny
:)

James

_______________________________________________
Xen-users mailing list
Xen-users@lists.xensource.com
http://lists.xensource.com/xen-users

Maybe it works, set the default route to bond0.

Joshua Boniface 写道:
> Greetings all. This has been an ongoing issue for me for a few months, and
I''ve been trying to get an answer.
>
> My server has two NICs, and I want to set up the following:
>
> NICs (x2) -> bond (mode 5) -> Xen Bridge -> Doms
>
> ...however, trying to configure this doesn''t seem to work:
network-bridge steals eth0 instead of bond0, which breaks the bond AND my
networking. The result is a "pbond0" interface with no IP, and
occasionally a "peth0", also with no IP. In either case neither eth0
(or 1) or bond0 exist and as such I have no networking at all! If I boot without
Xen the bond works fine, so I know that''s not the problem.
>
> If I reconfigure zend-config.sxp to change netdev=bond0, I still have the
same issues, though the specific wording of the error (2 pages on a computer I
can''t connect to, and before logon so I can''t | less) is
different. I''ve also tried messing with the network-bridge script to no
avail.
>
> I''ve read both the manual and the wiki, and while the wiki makes
mention of using a bond, it doesn''t show specifically what is required.
I was wondering if anyone else could shed some light on the issues. I''m
willing to (attempt) to write out those 2 pages of errors, if required, though I
have a feeling this is just a configuration issue.
>
> I have a thread on LinuxQuestions about the issue. URL:
http://www.linuxquestions.org/questions/linux-server-73/using-xen-and-nic-bonding-please-help-736996/
>
> Thank you for your assistance.
>
> _______________________________________________
> Xen-users mailing list
> Xen-users@lists.xensource.com
> http://lists.xensource.com/xen-users
>
>   


_______________________________________________
Xen-users mailing list
Xen-users@lists.xensource.com
http://lists.xensource.com/xen-users

On Mon, 2009-07-06 at 13:38 +1000, James Harper wrote:
> > 
> > If you let us know what OS you are using, someone can help you with
> that
> > part too.
> > 
> 
> He''s put ''Debian Lenny'' in the subject so at a
guess it is Debian Lenny
Oh good grief .. if my attention span gets any shorter today I''m going
to be in big trouble.

Cheers,
--Tim




_______________________________________________
Xen-users mailing list
Xen-users@lists.xensource.com
http://lists.xensource.com/xen-users

El dom, 05-07-2009 a las 19:36 +0000, Joshua Boniface
escribió:
> Greetings all. This has been an ongoing issue for me for a few months, and
I''ve been trying to get an answer.
> 
> My server has two NICs, and I want to set up the following:
> 
> NICs (x2) -> bond (mode 5) -> Xen Bridge -> Doms
> 
> ...however, trying to configure this doesn''t seem to work:
network-bridge steals eth0 instead of bond0, which breaks the bond AND my
networking. The result is a "pbond0" interface with no IP, and
occasionally a "peth0", also with no IP. In either case neither eth0
(or 1) or bond0 exist and as such I have no networking at all! If I boot without
Xen the bond works fine, so I know that''s not the problem.
> 
> If I reconfigure zend-config.sxp to change netdev=bond0, I still have the
same issues, though the specific wording of the error (2 pages on a computer I
can''t connect to, and before logon so I can''t | less) is
different. I''ve also tried messing with the network-bridge script to no
avail.
> 
> I''ve read both the manual and the wiki, and while the wiki makes
mention of using a bond, it doesn''t show specifically what is required.
I was wondering if anyone else could shed some light on the issues. I''m
willing to (attempt) to write out those 2 pages of errors, if required, though I
have a feeling this is just a configuration issue.
> 
Hello,

	Don''t use network-bridge to start the bridge. As someone has
recommend,
just use network-dummy and configure the bridge in a debian way. This is
my configuration (I''m using bonding, active-backup, and vlan):

auto bond0
iface bond0 inet static
        address <ip>
        netmask <netmask>
        network <network ip>
        broadcast <broadcast ip>
        gateway <gateway>
        # dns-* options are implemented by the resolvconf package, if
installed
        dns-nameservers <dns>
        slaves eth0 eth3

iface vlan212 inet manual
        pre-up /sbin/ifup bond0
        vlan-raw-device bond0

iface xen-br212 inet manual
        pre-up /sbin/ifup vlan212
        bridge_ports vlan212
        bridge_fd 0

...


-- 
Angel L. Mateo Martínez
Sección de Telemática
Área de Tecnologías de la Información       _o)
y las Comunicaciones Aplicadas (ATICA)      / \\
http://www.um.es/atica                    _(___V
Tfo: 868887590
Fax: 868888337


_______________________________________________
Xen-users mailing list
Xen-users@lists.xensource.com
http://lists.xensource.com/xen-users

This is great info - thanks!  :)

Nathan


-----Original Message-----
From: xen-users-bounces@lists.xensource.com
[mailto:xen-users-bounces@lists.xensource.com] On Behalf Of Angel L. Mateo
Sent: Sunday, July 05, 2009 11:51 PM
To: xen-users@lists.xensource.com
Subject: Re: [Xen-users] Xen Networking and bonded interfaces on Debia Lenny

El dom, 05-07-2009 a las 19:36 +0000, Joshua Boniface
escribió:
> Greetings all. This has been an ongoing issue for me for a few months, and
I've been trying to get an answer.
> 
> My server has two NICs, and I want to set up the following:
> 
> NICs (x2) -> bond (mode 5) -> Xen Bridge -> Doms
> 
> ...however, trying to configure this doesn't seem to work:
network-bridge steals eth0 instead of bond0, which breaks the bond AND my
networking. The result is a "pbond0" interface with no IP, and
occasionally a "peth0", also with no IP. In either case neither eth0
(or 1) or bond0 exist and as such I have no networking at all! If I boot without
Xen the bond works fine, so I know that's not the problem.
> 
> If I reconfigure zend-config.sxp to change netdev=bond0, I still have the
same issues, though the specific wording of the error (2 pages on a computer I
can't connect to, and before logon so I can't | less) is different.
I've also tried messing with the network-bridge script to no avail.
> 
> I've read both the manual and the wiki, and while the wiki makes
mention of using a bond, it doesn't show specifically what is required. I
was wondering if anyone else could shed some light on the issues. I'm
willing to (attempt) to write out those 2 pages of errors, if required, though I
have a feeling this is just a configuration issue.
> 
Hello,

	Don't use network-bridge to start the bridge. As someone has recommend,
just use network-dummy and configure the bridge in a debian way. This is
my configuration (I'm using bonding, active-backup, and vlan):

auto bond0
iface bond0 inet static
        address <ip>
        netmask <netmask>
        network <network ip>
        broadcast <broadcast ip>
        gateway <gateway>
        # dns-* options are implemented by the resolvconf package, if
installed
        dns-nameservers <dns>
        slaves eth0 eth3

iface vlan212 inet manual
        pre-up /sbin/ifup bond0
        vlan-raw-device bond0

iface xen-br212 inet manual
        pre-up /sbin/ifup vlan212
        bridge_ports vlan212
        bridge_fd 0

...


-- 
Angel L. Mateo Martínez
Sección de Telemática
Área de Tecnologías de la Información       _o)
y las Comunicaciones Aplicadas (ATICA)      / \\
http://www.um.es/atica                    _(___V
Tfo: 868887590
Fax: 868888337


_______________________________________________
Xen-users mailing list
Xen-users@lists.xensource.com
http://lists.xensource.com/xen-users




_______________________________________________
Xen-users mailing list
Xen-users@lists.xensource.com
http://lists.xensource.com/xen-users

Thank you for your assistance gentlemen, by using network-dummy I''ve
been able to get networking working in Dom0, however, since I have no bridge,
not in the DomUs. The OS is Debian Lenny, so if anyone knows how to set up such
a bridge manually, I''d definitely appreciate the help! Thanks,

Joshua Boniface

(289) 208 2830

www.elementalpc.net

> Subject: Re: [Xen-users] Xen Networking and bonded interfaces on Debia
Lenny
> From: echo@echoreply.us
> To: joshua.boniface@live.com
> CC: xen-users@lists.xensource.com
> Date: Mon, 6 Jul 2009 11:31:21 +0800
> 
> Hi,
> 
> On Sun, 2009-07-05 at 19:36 +0000, Joshua Boniface wrote:
> > Greetings all. This has been an ongoing issue for me for a few months,
> > and I''ve been trying to get an answer.
> > 
> > My server has two NICs, and I want to set up the following:
> > 
> > NICs (x2) -> bond (mode 5) -> Xen Bridge -> Doms
> 
> A little background for you, the purpose of network-bridge is to start
> bridged networking when xend starts and take it down when xend stops.
> Its a creature comfort that allows you to use Xen on your desktop
> without going though the hassle of modifying / restoring your system
> network configuration every time you want to use Xen.
> 
> In a production (server) environment, its much much better to just allow
> your operating system to control networking. network-bridge is not smart
> enough to deal with complex configurations.
> 
> To take network-bridge out of the picture, try this:
> 
> cat << EOF > /etc/xen/scripts/network-dummy
> #!/bin/sh
> 
> exit 0
> EOF
> 
> chmod +x /etc/xen/network-dummy
> 
> Check to be sure that the file is not already there prior to creating
> it.
> 
> Then, edit /etc/xend-config.sxp , look for:
> 
> (network-script network-bridge)
> 
> Change it to:
> 
> (network-script network-dummy)
> 
> At this point, xend will not try to do anything to networking when it
> starts. You can then configure the bond / bridge via whatever means is
> sensible for your OS.
> 
> If you let us know what OS you are using, someone can help you with that
> part too.
> 
> Cheers,
> --Tim
> 
> 
_________________________________________________________________
Create a cool, new character for your Windows Live™ Messenger. 
http://go.microsoft.com/?linkid=9656621

_______________________________________________
Xen-users mailing list
Xen-users@lists.xensource.com
http://lists.xensource.com/xen-users

2009/7/6 Joshua Boniface <joshua.boniface@live.com>
>  Thank you for your assistance gentlemen, by using network-dummy
I''ve been
> able to get networking working in Dom0, however, since I have no bridge,
not
> in the DomUs. The OS is Debian Lenny, so if anyone knows how to set up such
> a bridge manually, I''d definitely appreciate the help! Thanks,
>
This is what I''ve just done, this is lightly tested so far, a bonded
pair
and bridging on top of it, just bring up the br0 interface (ifup br0) and it
will build the bond automatically itself:

Bonding in a Debian Lenny based Xen Dom0

Add ''bonding'' to /etc/modules, actually the ifenslave script
loads this
module if not already present, but this is untested.

Prepare an interfaces script similar to this:

# The loopback network interface
auto lo br0
iface lo inet loopback

# The primary network interface - this for dom0 access, would probably
be a static address in production.
allow-hotplug eth2
iface eth2 inet dhcp

iface bond0 inet manual
        slaves eth1 eth3
        bond_mode    active-backup (or 802.3ad for LACP)
        bond_primary eth1
        bond_miimon  100
        bond_updelay 400
        bond_downdelay 200
        # see /usr/share/doc/ifenslave-2.6/README.Debian and more usefully
        # /etc/network/if-pre-up.d/ifenslave

iface br0 inet manual
# use the following if a dom0 IP is required for this lan
#iface br0 inet static
#        address 192.168.0.2
#        netmask 255.255.255.0
#        broadcast 192.168.0.255
# you may want gateway 192.168.0.1 etc here also
# if not using an IP then you can choose to add bridge_maxwait 0 but
this is untested
# continue with the following
        bridge_ports bond0
        pre-up /sbin/ifup bond0
        post-down /sbin/ifdown bond0
        # see man bridge-utils-interfaces

for this to work you should first of installed bridge-utils and
ifenslave(-2.6). I see no reason why this cannot be expanded to cover as may
interfaces/bonds as is required, it might be necessary to include options
bonding max_bonds=2 etc if using more than one network bond.

The debian lenny setup already has network-dummy in place and is the
default. Amend the bridge name in the vmx file if required but I believe
(for a non-HVM domain) it will automatically use br0 rather than the old
xenbr0 name. There really isn''t anything else which requires modifing.

cheers dave


_______________________________________________
Xen-users mailing list
Xen-users@lists.xensource.com
http://lists.xensource.com/xen-users