Hi,
I''m running Nevada 75a configured as dom0. I added a domU HVM running
Nevada 75a, on a Sun X4600 with 8 ADM Dual cores. I can get the domU
installed and configured, however, I can not get any network
connectivity. I followed the steps accoding to documents on Open
Solaris. I also followed some of the threads of the list to verify the
configuration, but I can not fix the problem. Here is the configuration
Before installing the domain on dom0
# dladm show-link
e1000g0 type: non-vlan mtu: 1500 device: e1000g0
e1000g1 type: non-vlan mtu: 1500 device: e1000g1
e1000g2 type: non-vlan mtu: 1500 device: e1000g2
e1000g3 type: non-vlan mtu: 1500 device: e1000g3
#svccfg -s xvm/xend listprop | grep nic
config/default-nic astring e1000g0
#/usr/lib/xen/bin/xenstore-read device-misc/vif/default-nic
e1000g0
I configured the domU with the following command:
virt-install -n solarisHVM --hvm --vnc -r 10240 -f
/xvm/solarisHVM/root.img -s 16 -c /iso/sol-os-platform-dvd.iso
After the domain is configured I open a window on the domU, and try to
ping or telnet to the dom0 or other systems, but no reply, here is the
configuration after the domU is installed
#dladm show-link
e1000g0 type: non-vlan mtu: 1500 device: e1000g0
e1000g1 type: non-vlan mtu: 1500 device: e1000g1
e1000g2 type: non-vlan mtu: 1500 device: e1000g2
e1000g3 type: non-vlan mtu: 1500 device: e1000g3
vnic900 type: non-vlan mtu: 1500 device: vnic900
# /usr/lib/vna
900 e1000g0 0:16:3e:35:68:ca
#xm network-list solarisHVM
Idx BE MAC Addr. handle state evt-ch tx-/rx-ring-ref BE-path
0 0 ?? 0 1 -1 -1 /-1
/local/domain/0/backend/vif/4/0
form #vrish dumpxml solarisHVM
<devices>
<emulator>/usr/lib/xen/bin/qemu-dm</emulator>
<interface type=''ethernet''>
<mac address=''00:16:3e:35:68:ca''/>
</interface>
from #xm list solarisHVM -l
(device
(vif
(bridge )
(mac 00:16:3e:35:68:ca)
(type ioemu)
(uuid 35db826b-987a-b4cf-ae98-7d6a197e7650)
)
)
from within the domain
#ifconfig -a
rtls0: flgas-201000843<UP,BROADCAST, RUNNING,MULTICAST,IPv4,CoS> mtu
1500 index 2
inet 10.6.142.179 netmask ffffff00 broadcast 10.6.142.255
ether 0:16:3e:35:68:ca
From the output I can see that the rtls0 mac address in the domU is the
same from xm list and from the dumpxml on dom0. I do not understand why
the mac address does not show on the xm network-list solarisHVM.
I can plumb vnic900 on dom0, configure an IP address and ping it, but I
then unplumb it.
If I create a Solaris PV domU, I do not have any issues, I can connect
to and from other systems to the domU.
It looks like I''m missing a step that links the vnic900 to the rtls0,
but I''m running out of ideas. Any hints on how to link e1000g0 or
vnic900 to my domU, or how to solve the issue are appreciated.
Thanks,
--
+-----------------------------------------------+
Jairo Cardozo H
Benchmark Engineer
Sun Solution Centers
Jairo.Cardozo@sun.com
Ext: 87013
Phone: 650-786-7013
+-----------------------------------------------+
Hi Jairo, How do you create this domain? Can you post your python config file or the virt-install line you used? Jairo.Cardozo@sun.com wrote:> Hi, > > I''m running Nevada 75a configured as dom0. I added a domU HVM running > Nevada 75a, on a Sun X4600 with 8 ADM Dual cores. I can get the domU > installed and configured, however, I can not get any network > connectivity. I followed the steps accoding to documents on Open > Solaris. I also followed some of the threads of the list to verify the > configuration, but I can not fix the problem. Here is the configuration > > Before installing the domain on dom0 > # dladm show-link > e1000g0 type: non-vlan mtu: 1500 device: e1000g0 > e1000g1 type: non-vlan mtu: 1500 device: e1000g1 > e1000g2 type: non-vlan mtu: 1500 device: e1000g2 > e1000g3 type: non-vlan mtu: 1500 device: e1000g3 > > #svccfg -s xvm/xend listprop | grep nic > config/default-nic astring e1000g0 > > #/usr/lib/xen/bin/xenstore-read device-misc/vif/default-nic > e1000g0 > > I configured the domU with the following command: > > virt-install -n solarisHVM --hvm --vnc -r 10240 -f > /xvm/solarisHVM/root.img -s 16 -c /iso/sol-os-platform-dvd.iso > > After the domain is configured I open a window on the domU, and try to > ping or telnet to the dom0 or other systems, but no reply, here is the > configuration after the domU is installed > > #dladm show-link > e1000g0 type: non-vlan mtu: 1500 device: e1000g0 > e1000g1 type: non-vlan mtu: 1500 device: e1000g1 > e1000g2 type: non-vlan mtu: 1500 device: e1000g2 > e1000g3 type: non-vlan mtu: 1500 device: e1000g3 > vnic900 type: non-vlan mtu: 1500 device: vnic900 > > # /usr/lib/vna > 900 e1000g0 0:16:3e:35:68:ca > > #xm network-list solarisHVM > Idx BE MAC Addr. handle state evt-ch tx-/rx-ring-ref BE-path > 0 0 ?? 0 1 -1 -1 /-1 > /local/domain/0/backend/vif/4/0 > > form #vrish dumpxml solarisHVM > <devices> > <emulator>/usr/lib/xen/bin/qemu-dm</emulator> > <interface type=''ethernet''> > <mac address=''00:16:3e:35:68:ca''/> > </interface> > > from #xm list solarisHVM -l > (device > (vif > (bridge ) > (mac 00:16:3e:35:68:ca) > (type ioemu) > (uuid 35db826b-987a-b4cf-ae98-7d6a197e7650) > ) > ) > > from within the domain > > #ifconfig -a > rtls0: flgas-201000843<UP,BROADCAST, RUNNING,MULTICAST,IPv4,CoS> mtu > 1500 index 2 > inet 10.6.142.179 netmask ffffff00 broadcast 10.6.142.255 > ether 0:16:3e:35:68:ca > > From the output I can see that the rtls0 mac address in the domU is the > same from xm list and from the dumpxml on dom0. I do not understand why > the mac address does not show on the xm network-list solarisHVM. > > I can plumb vnic900 on dom0, configure an IP address and ping it, but I > then unplumb it. > > If I create a Solaris PV domU, I do not have any issues, I can connect > to and from other systems to the domU. > > It looks like I''m missing a step that links the vnic900 to the rtls0, > but I''m running out of ideas. Any hints on how to link e1000g0 or > vnic900 to my domU, or how to solve the issue are appreciated. > > Thanks, > >-- ----------------------------------------------------- Russ Blaine | Solaris Kernel | russell.blaine@sun.com
Russ, I just found something really interesting. Instead of using snv_75a to create my HVM domU, I used solaris 10u4 and have network communications. I still get the same output from network-list, but I can telnet/ping/ssh to and from my domU running sol10u4. #xm network-list solHVM1 -l Idx BE MAC Addr. handle state evt-ch tx-/rx-ring-ref BE-path 0 0 ?? 0 1 -1 -1 /-1 /local/domain/0/backend/vif/6/0 Conclusion: Networking works if I configure Sol10u4 as HVM domU on dom0 running snv_75a, but it does not if I configure the HVM domU to run snv_75a on top of a dom0 running snv75a I will try a later version to see if this still happens. Regards, J. Cardozo Russ Blaine wrote:> Sanity check, as we have been seeing this from others: your domU has a > mac address that is different than dom0''s, right? > > Jairo.Cardozo@Sun.COM wrote: >> >> Yep, and also rebooted the domain0, as suggested by somebody in the >> list. >> >> J.C. >> Russ Blaine wrote: >>> Did you do a >>> >>> svcadm refresh xend; svcadm restart xend >>> >>> after updating default-nic? >>> >>> Jairo.Cardozo@Sun.COM wrote: >>>> Russ, >>>> >>>> It was on the original email, here it goes again, I used virt-install >>>> >>>> >>>> #virt-install -n solarisHVM --hvm --vnc -r 10240 -f >>>> /xvm/solarisHVM/root.img -s 16 -c /iso/sol-os-platform-dvd.iso >>>> >>>> Thanks, >>>> >>>> >>>> J. Cardozo >>>> >>>> Russ Blaine wrote: >>>>> Hi Jairo, >>>>> >>>>> How do you create this domain? Can you post your python config >>>>> file or the virt-install line you used? >>>>> >>>>> Jairo.Cardozo@sun.com wrote: >>>>>> Hi, >>>>>> >>>>>> I''m running Nevada 75a configured as dom0. I added a domU HVM >>>>>> running Nevada 75a, on a Sun X4600 with 8 ADM Dual cores. I can >>>>>> get the domU installed and configured, however, I can not get any >>>>>> network connectivity. I followed the steps accoding to documents >>>>>> on Open Solaris. I also followed some of the threads of the list >>>>>> to verify the configuration, but I can not fix the problem. Here >>>>>> is the configuration >>>>>> >>>>>> Before installing the domain on dom0 >>>>>> # dladm show-link >>>>>> e1000g0 type: non-vlan mtu: 1500 device: e1000g0 >>>>>> e1000g1 type: non-vlan mtu: 1500 device: e1000g1 >>>>>> e1000g2 type: non-vlan mtu: 1500 device: e1000g2 >>>>>> e1000g3 type: non-vlan mtu: 1500 device: e1000g3 >>>>>> >>>>>> #svccfg -s xvm/xend listprop | grep nic >>>>>> config/default-nic astring e1000g0 >>>>>> >>>>>> #/usr/lib/xen/bin/xenstore-read device-misc/vif/default-nic >>>>>> e1000g0 >>>>>> >>>>>> I configured the domU with the following command: >>>>>> >>>>>> virt-install -n solarisHVM --hvm --vnc -r 10240 -f >>>>>> /xvm/solarisHVM/root.img -s 16 -c /iso/sol-os-platform-dvd.iso >>>>>> >>>>>> After the domain is configured I open a window on the domU, and >>>>>> try to ping or telnet to the dom0 or other systems, but no reply, >>>>>> here is the configuration after the domU is installed >>>>>> >>>>>> #dladm show-link >>>>>> e1000g0 type: non-vlan mtu: 1500 device: e1000g0 >>>>>> e1000g1 type: non-vlan mtu: 1500 device: e1000g1 >>>>>> e1000g2 type: non-vlan mtu: 1500 device: e1000g2 >>>>>> e1000g3 type: non-vlan mtu: 1500 device: e1000g3 >>>>>> vnic900 type: non-vlan mtu: 1500 device: vnic900 >>>>>> >>>>>> # /usr/lib/vna >>>>>> 900 e1000g0 0:16:3e:35:68:ca >>>>>> >>>>>> #xm network-list solarisHVM >>>>>> Idx BE MAC Addr. handle state evt-ch tx-/rx-ring-ref BE-path >>>>>> 0 0 ?? 0 1 -1 -1 /-1 >>>>>> /local/domain/0/backend/vif/4/0 >>>>>> >>>>>> form #vrish dumpxml solarisHVM >>>>>> <devices> >>>>>> <emulator>/usr/lib/xen/bin/qemu-dm</emulator> >>>>>> <interface type=''ethernet''> >>>>>> <mac address=''00:16:3e:35:68:ca''/> >>>>>> </interface> >>>>>> >>>>>> from #xm list solarisHVM -l >>>>>> (device >>>>>> (vif >>>>>> (bridge ) >>>>>> (mac 00:16:3e:35:68:ca) >>>>>> (type ioemu) >>>>>> (uuid 35db826b-987a-b4cf-ae98-7d6a197e7650) >>>>>> ) >>>>>> ) >>>>>> >>>>>> from within the domain >>>>>> >>>>>> #ifconfig -a >>>>>> rtls0: flgas-201000843<UP,BROADCAST, RUNNING,MULTICAST,IPv4,CoS> >>>>>> mtu 1500 index 2 >>>>>> inet 10.6.142.179 netmask ffffff00 broadcast 10.6.142.255 >>>>>> ether 0:16:3e:35:68:ca >>>>>> >>>>>> From the output I can see that the rtls0 mac address in the domU >>>>>> is the same from xm list and from the dumpxml on dom0. I do not >>>>>> understand why the mac address does not show on the xm >>>>>> network-list solarisHVM. >>>>>> >>>>>> I can plumb vnic900 on dom0, configure an IP address and ping it, >>>>>> but I then unplumb it. >>>>>> >>>>>> If I create a Solaris PV domU, I do not have any issues, I can >>>>>> connect to and from other systems to the domU. >>>>>> >>>>>> It looks like I''m missing a step that links the vnic900 to the >>>>>> rtls0, but I''m running out of ideas. Any hints on how to link >>>>>> e1000g0 or vnic900 to my domU, or how to solve the issue are >>>>>> appreciated. >>>>>> >>>>>> Thanks, >>>>>> >>>>>> >>>>> >>>> >>> >> >-- +-----------------------------------------------+ Jairo Cardozo H Benchmark Engineer Sun Solution Centers Jairo.Cardozo@sun.com Ext: 87013 Phone: 650-786-7013 +-----------------------------------------------+
On Thu, Jan 31, 2008 at 04:53:16PM -0800, Jairo.Cardozo@sun.com wrote:> Networking works if I configure Sol10u4 as HVM domU on dom0 running > snv_75a, but it does not if I configure the HVM domU to run snv_75a on > top of a dom0 running snv75aHmm, I think snv_75a had a broken rtls implementation, if I''m remembering correctly. So a later Nevada or S10 HVM domu would work. regards john
John Levon wrote:> On Thu, Jan 31, 2008 at 04:53:16PM -0800, Jairo.Cardozo@sun.com wrote: > >> Networking works if I configure Sol10u4 as HVM domU on dom0 running >> snv_75a, but it does not if I configure the HVM domU to run snv_75a on >> top of a dom0 running snv75a > > Hmm, I think snv_75a had a broken rtls implementation, if I''m > remembering correctly. So a later Nevada or S10 HVM domu would work.yes. I believe this was fix in b77 or b78 of nevada. MRJ
I''m back again using Nevada 82 this time. All my network issues were solved in this version. Mark Johnson wrote:> > > John Levon wrote: >> On Thu, Jan 31, 2008 at 04:53:16PM -0800, Jairo.Cardozo@sun.com wrote: >> >>> Networking works if I configure Sol10u4 as HVM domU on dom0 running >>> snv_75a, but it does not if I configure the HVM domU to run snv_75a >>> on top of a dom0 running snv75a >> >> Hmm, I think snv_75a had a broken rtls implementation, if I''m >> remembering correctly. So a later Nevada or S10 HVM domu would work. > > yes. I believe this was fix in b77 or b78 of nevada. > > > > MRJ >-- +-----------------------------------------------+ Jairo Cardozo H Benchmark Engineer Sun Solution Centers Jairo.Cardozo@sun.com Ext: 87013 Phone: 650-786-7013 +-----------------------------------------------+