Hello,
I''m trying to play around with crossbow to use with xen VMs but
I''m having
trouble getting this to work properly. Below is a quick overview of what
I''m
trying to do.
--------------- Overview ----------------------
* setup a zone to handle routing
* setup a zone behind the router
* setup a xen VM behind the router
* have all three on the same network and happily communicating
* SunOS virt 5.11 snv_124 i86pc i386 i86xpv Solaris
Currently I have the routing zone (vrouter) and the client zone (serv)
communicating properly. I cannot get xen to play nice with this though. As
you can see below it is using the right etherstub for the bridge.
--------------- Zone: global ------------------
admin at virt:~$ dladm show-link
test0 etherstub 9000 unknown -- --
t0 vnic 9000 up -- test0
t1 vnic 9000 up -- test0
g0 vnic 1500 up -- rge0
xvm17_0 vnic 9000 up -- test0
Here''s my IP scheme:
vrouter t0: 10.50.0.1/16
vrouter g0: 192.168.60/24
serv t1: 10.50.0.2/16
linux eth0: 10.50.0.3/16
To show how everything is setup, here''s some command line output:
--------------- Zone: vrouter ------------------
root at vrouter:~# ifconfig -a
lo0: flags=2001000849<UP,LOOPBACK,RUNNING,MULTICAST,IPv4,VIRTUAL> mtu 8232
index 1
inet 127.0.0.1 netmask ff000000
t0: flags=1100863<UP,BROADCAST,NOTRAILERS,RUNNING,MULTICAST,ROUTER,IPv4>
mtu
9000 index 2
inet 10.50.0.1 netmask ffff0000 broadcast 10.50.255.255
ether 2:8:20:60:8:df
g0: flags=1100863<UP,BROADCAST,NOTRAILERS,RUNNING,MULTICAST,ROUTER,IPv4>
mtu
1500 index 3
inet 192.168.1.60 netmask ffffff00 broadcast 192.168.1.255
ether 2:8:20:8c:26:db
lo0: flags=2002000849<UP,LOOPBACK,RUNNING,MULTICAST,IPv6,VIRTUAL> mtu 8252
index 1
inet6 ::1/128
root at vrouter:~# routeadm
Configuration Current Current
Option Configuration System State
---------------------------------------------------------------
IPv4 routing enabled enabled
IPv6 routing disabled disabled
IPv4 forwarding enabled enabled
IPv6 forwarding disabled disabled
Routing services "route:default ripng:default"
Routing daemons:
STATE FMRI
disabled svc:/network/routing/ripng:default
disabled svc:/network/routing/legacy-routing:ipv6
disabled svc:/network/routing/legacy-routing:ipv4
online svc:/network/routing/ndp:default
online svc:/network/routing/route:default
disabled svc:/network/routing/rdisc:default
root at vrouter:~# netstat -nr
Routing Table: IPv4
Destination Gateway Flags Ref Use Interface
-------------------- -------------------- ----- ----- ---------- ---------
default 192.168.1.1 UG 1 0
10.50.0.0 10.50.0.1 U 1 0 t0
192.168.1.0 192.168.1.60 U 1 1 g0
127.0.0.1 127.0.0.1 UH 1 2 lo0
Routing Table: IPv6
Destination/Mask Gateway Flags Ref Use
If
--------------------------- --------------------------- ----- --- -------
-----
::1 ::1 UH 1 0
lo0
--------------- Zone: serv ------------------
root at serv:~# ifconfig -a
lo0: flags=2001000849<UP,LOOPBACK,RUNNING,MULTICAST,IPv4,VIRTUAL> mtu 8232
index 1
inet 127.0.0.1 netmask ff000000
t1: flags=1000863<UP,BROADCAST,NOTRAILERS,RUNNING,MULTICAST,IPv4> mtu 9000
index 2
inet 10.50.0.2 netmask ffff0000 broadcast 10.50.255.255
ether 2:8:20:71:cd:51
lo0: flags=2002000849<UP,LOOPBACK,RUNNING,MULTICAST,IPv6,VIRTUAL> mtu 8252
index 1
inet6 ::1/128
root at serv:~# netstat -nr
Routing Table: IPv4
Destination Gateway Flags Ref Use Interface
-------------------- -------------------- ----- ----- ---------- ---------
default 10.50.0.1 UG 1 2
10.50.0.0 10.50.0.2 U 1 1 t1
127.0.0.1 127.0.0.1 UH 1 2 lo0
Routing Table: IPv6
Destination/Mask Gateway Flags Ref Use
If
--------------------------- --------------------------- ----- --- -------
-----
::1 ::1 UH 1 0
lo0
root at serv:~# ping 10.50.0.1
10.50.0.1 is alive
root at serv:~# ping 192.168.1.60
192.168.1.60 is alive
--------------- Linux VM ------------------
[root at dev ~]# ifconfig
eth0 Link encap:Ethernet HWaddr 00:16:36:4B:F7:00
inet addr:10.50.0.3 Bcast:10.50.255.255 Mask:255.255.0.0
inet6 addr: fe80::216:36ff:fe4b:f700/64 Scope:Link
UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1
RX packets:0 errors:0 dropped:0 overruns:0 frame:0
TX packets:48 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:1000
RX bytes:0 (0.0 b) TX bytes:7839 (7.6 KiB)
Interrupt:10
lo Link encap:Local Loopback
inet addr:127.0.0.1 Mask:255.0.0.0
inet6 addr: ::1/128 Scope:Host
UP LOOPBACK RUNNING MTU:16436 Metric:1
RX packets:94 errors:0 dropped:0 overruns:0 frame:0
TX packets:94 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:0
RX bytes:8272 (8.0 KiB) TX bytes:8272 (8.0 K
[root at dev ~]# route
Kernel IP routing table
Destination Gateway Genmask Flags Metric Ref Use
Iface
10.50.0.0 * 255.255.0.0 U 0 0 0 eth0
default 10.50.0.1 0.0.0.0 UG 0 0 0 eth0
[root at dev ~]# ping 10.50.0.1
PING 10.50.0.1 (10.50.0.1) 56(84) bytes of data.>From 10.50.0.3 icmp_seq=2 Destination Host Unreachable
>From 10.50.0.3 icmp_seq=3 Destination Host Unreachable
>From 10.50.0.3 icmp_seq=4 Destination Host Unreachable
--- 10.50.0.1 ping statistics ---
5 packets transmitted, 0 received, +3 errors, 100% packet loss, time 4637ms
pipe 3
Any ideas as to why my VM cannot ping anything else on the same etherstub?
Allan Feid
Unix Administrator
B.S. Software Engineering
-------------- next part --------------
An HTML attachment was scrubbed...
URL:
<http://mail.opensolaris.org/pipermail/crossbow-discuss/attachments/20091010/9167563d/attachment.html>
David Edmondson
2009-Oct-10 19:42 UTC
[crossbow-discuss] Xen VMs: broken networking on etherstub
You must set the mtu of the etherstub to 1500 before creating any of the vnics (or domains). On 10 Oct 2009, at 08:16 PM, Allan <cr4z3d at gmail.com> wrote:> Hello, > > I''m trying to play around with crossbow to use with xen VMs but I''m > having trouble getting this to work properly. Below is a quick > overview of what I''m trying to do. > > --------------- Overview ---------------------- > * setup a zone to handle routing > * setup a zone behind the router > * setup a xen VM behind the router > * have all three on the same network and happily communicating > * SunOS virt 5.11 snv_124 i86pc i386 i86xpv Solaris > > > Currently I have the routing zone (vrouter) and the client zone > (serv) communicating properly. I cannot get xen to play nice with > this though. As you can see below it is using the right etherstub > for the bridge. > > --------------- Zone: global ------------------ > admin at virt:~$ dladm show-link > test0 etherstub 9000 unknown -- -- > t0 vnic 9000 up -- test0 > t1 vnic 9000 up -- test0 > g0 vnic 1500 up -- rge0 > xvm17_0 vnic 9000 up -- test0 > > > Here''s my IP scheme: > vrouter t0: 10.50.0.1/16 > vrouter g0: 192.168.60/24 > serv t1: 10.50.0.2/16 > linux eth0: 10.50.0.3/16 > > To show how everything is setup, here''s some command line output: > > --------------- Zone: vrouter ------------------ > root at vrouter:~# ifconfig -a > lo0: flags=2001000849<UP,LOOPBACK,RUNNING,MULTICAST,IPv4,VIRTUAL> > mtu 8232 index 1 > inet 127.0.0.1 netmask ff000000 > t0: > flags=1100863<UP,BROADCAST,NOTRAILERS,RUNNING,MULTICAST,ROUTER,IPv4> > mtu 9000 index 2 > inet 10.50.0.1 netmask ffff0000 broadcast 10.50.255.255 > ether 2:8:20:60:8:df > g0: > flags=1100863<UP,BROADCAST,NOTRAILERS,RUNNING,MULTICAST,ROUTER,IPv4> > mtu 1500 index 3 > inet 192.168.1.60 netmask ffffff00 broadcast 192.168.1.255 > ether 2:8:20:8c:26:db > lo0: flags=2002000849<UP,LOOPBACK,RUNNING,MULTICAST,IPv6,VIRTUAL> > mtu 8252 index 1 > inet6 ::1/128 > > root at vrouter:~# routeadm > Configuration Current Current > Option Configuration System State > --------------------------------------------------------------- > IPv4 routing enabled enabled > IPv6 routing disabled disabled > IPv4 forwarding enabled enabled > IPv6 forwarding disabled disabled > > Routing services "route:default ripng:default" > > Routing daemons: > > STATE FMRI > disabled svc:/network/routing/ripng:default > disabled svc:/network/routing/legacy-routing:ipv6 > disabled svc:/network/routing/legacy-routing:ipv4 > online svc:/network/routing/ndp:default > online svc:/network/routing/route:default > disabled svc:/network/routing/rdisc:default > > root at vrouter:~# netstat -nr > > Routing Table: IPv4 > Destination Gateway Flags Ref Use > Interface > -------------------- -------------------- ----- ----- ---------- > --------- > default 192.168.1.1 UG 1 0 > 10.50.0.0 10.50.0.1 U 1 0 t0 > 192.168.1.0 192.168.1.60 U 1 1 g0 > 127.0.0.1 127.0.0.1 UH 1 2 lo0 > > Routing Table: IPv6 > Destination/Mask Gateway Flags Ref > Use If > --------------------------- --------------------------- ----- --- > ------- ----- > ::1 ::1 UH > 1 0 lo0 > > > > --------------- Zone: serv ------------------ > root at serv:~# ifconfig -a > lo0: flags=2001000849<UP,LOOPBACK,RUNNING,MULTICAST,IPv4,VIRTUAL> > mtu 8232 index 1 > inet 127.0.0.1 netmask ff000000 > t1: flags=1000863<UP,BROADCAST,NOTRAILERS,RUNNING,MULTICAST,IPv4> > mtu 9000 index 2 > inet 10.50.0.2 netmask ffff0000 broadcast 10.50.255.255 > ether 2:8:20:71:cd:51 > lo0: flags=2002000849<UP,LOOPBACK,RUNNING,MULTICAST,IPv6,VIRTUAL> > mtu 8252 index 1 > inet6 ::1/128 > > root at serv:~# netstat -nr > > Routing Table: IPv4 > Destination Gateway Flags Ref Use > Interface > -------------------- -------------------- ----- ----- ---------- > --------- > default 10.50.0.1 UG 1 2 > 10.50.0.0 10.50.0.2 U 1 1 t1 > 127.0.0.1 127.0.0.1 UH 1 2 lo0 > > Routing Table: IPv6 > Destination/Mask Gateway Flags Ref > Use If > --------------------------- --------------------------- ----- --- > ------- ----- > ::1 ::1 UH > 1 0 lo0 > > root at serv:~# ping 10.50.0.1 > 10.50.0.1 is alive > root at serv:~# ping 192.168.1.60 > 192.168.1.60 is alive > > --------------- Linux VM ------------------ > [root at dev ~]# ifconfig > eth0 Link encap:Ethernet HWaddr 00:16:36:4B:F7:00 > inet addr:10.50.0.3 Bcast:10.50.255.255 Mask:255.255.0.0 > inet6 addr: fe80::216:36ff:fe4b:f700/64 Scope:Link > UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1 > RX packets:0 errors:0 dropped:0 overruns:0 frame:0 > TX packets:48 errors:0 dropped:0 overruns:0 carrier:0 > collisions:0 txqueuelen:1000 > RX bytes:0 (0.0 b) TX bytes:7839 (7.6 KiB) > Interrupt:10 > > lo Link encap:Local Loopback > inet addr:127.0.0.1 Mask:255.0.0.0 > inet6 addr: ::1/128 Scope:Host > UP LOOPBACK RUNNING MTU:16436 Metric:1 > RX packets:94 errors:0 dropped:0 overruns:0 frame:0 > TX packets:94 errors:0 dropped:0 overruns:0 carrier:0 > collisions:0 txqueuelen:0 > RX bytes:8272 (8.0 KiB) TX bytes:8272 (8.0 K > > [root at dev ~]# route > Kernel IP routing table > Destination Gateway Genmask Flags Metric Ref > Use Iface > 10.50.0.0 * 255.255.0.0 U 0 > 0 0 eth0 > default 10.50.0.1 0.0.0.0 UG 0 > 0 0 eth0 > > [root at dev ~]# ping 10.50.0.1 > PING 10.50.0.1 (10.50.0.1) 56(84) bytes of data. > From 10.50.0.3 icmp_seq=2 Destination Host Unreachable > From 10.50.0.3 icmp_seq=3 Destination Host Unreachable > From 10.50.0.3 icmp_seq=4 Destination Host Unreachable > > --- 10.50.0.1 ping statistics --- > 5 packets transmitted, 0 received, +3 errors, 100% packet loss, time > 4637ms > pipe 3 > > > Any ideas as to why my VM cannot ping anything else on the same > etherstub? > > Allan Feid > Unix Administrator > B.S. Software Engineering > _______________________________________________ > crossbow-discuss mailing list > crossbow-discuss at opensolaris.org > http://mail.opensolaris.org/mailman/listinfo/crossbow-discuss-------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.opensolaris.org/pipermail/crossbow-discuss/attachments/20091010/b47b8363/attachment-0001.html>