Pradeep, Sorry I have a plane to catch but I am CC''ing crossbow-discuss mailing list where we have lot of bright people. Someone should be able to help you out there. Thanks, Sunay> Hi Sunay, > > I have installed OpenSolaris and have setup an apache zone as well. It''s > quite interesting to work with a non-Linux UNIX in a long time. I just > downloaded the beta release of crossbow and I am trying to use the > bfu.sh script. I get the following error. > > -- > # ./bfu.sh /export/home/ppadala/crossbow/nightly/ > Copying /export/home/ppadala/crossbow/./bfu.sh to /tmp/bfu.9358 > Executing /tmp/bfu.9358 /export/home/ppadala/crossbow/nightly/ > > Loading /export/home/ppadala/crossbow/nightly/ on / > /usr/lib/mps/libnss3.so is not valid. > Run /ws/onnv-gate/public/bin/update_nsspkgs to update the SUNWtls package. > bfu aborting > -- > > I don''t have the update_nsspkgs (or the directory for that matter) > mentioned above. Seems like a version dependency to me. > > Sorry to bother you with this, but I am new to Open Solaris. Please let > me know how I can resolve this. I have the latest Solaris Community > express installed on my machine. If I need to build a particular version > of Open Solaris, let me know how I can do that. > > Thanks, > Pradeep >-- Sunay Tripathi Distinguished Engineer Solaris Core Operating System Sun MicroSystems Inc. Solaris Networking: http://www.opensolaris.org/os/community/networking Project Crossbow: http://www.opensolaris.org/os/project/crossbow
Pradeep, can you provide a little more info? I have installed various version of these bits numerous times on different builds of NV from at least 54 to 56, on both SPARC and x64, and have never seen this error. Most of my testing has been with 54, however. Which version of NV (you say the lastest--is that 59?) and onbld are you using? I don''t know where there is an archive of older builds. Steffen Sunay Tripathi wrote On 03/16/07 16:41,:> Pradeep, > > Sorry I have a plane to catch but I am CC''ing crossbow-discuss mailing > list where we have lot of bright people. Someone should be able to > help you out there. > > Thanks, > Sunay > > >>Hi Sunay, >> >>I have installed OpenSolaris and have setup an apache zone as well. It''s >>quite interesting to work with a non-Linux UNIX in a long time. I just >>downloaded the beta release of crossbow and I am trying to use the >>bfu.sh script. I get the following error. >> >>-- >># ./bfu.sh /export/home/ppadala/crossbow/nightly/ >>Copying /export/home/ppadala/crossbow/./bfu.sh to /tmp/bfu.9358 >>Executing /tmp/bfu.9358 /export/home/ppadala/crossbow/nightly/ >> >>Loading /export/home/ppadala/crossbow/nightly/ on / >>/usr/lib/mps/libnss3.so is not valid. >>Run /ws/onnv-gate/public/bin/update_nsspkgs to update the SUNWtls package. >>bfu aborting >>-- >> >>I don''t have the update_nsspkgs (or the directory for that matter) >>mentioned above. Seems like a version dependency to me. >> >>Sorry to bother you with this, but I am new to Open Solaris. Please let >>me know how I can resolve this. I have the latest Solaris Community >>express installed on my machine. If I need to build a particular version >>of Open Solaris, let me know how I can do that. >> >>Thanks, >>Pradeep >> > > >
Hi Pradeep, Pradeep Padala wrote On 03/18/07 13:59,:>> I have installed various version of these bits numerous times on >> different builds of NV from at least 54 to 56, on both SPARC and x64, >> and have never seen this error. Most of my testing has been with 54, >> however. >> >> Which version of NV (you say the lastest--is that 59?) and onbld are >> you using? > > > Yes, I think I am using 59.That may be the issue. Somehow, in all my crossbow beta testing, I missed the notification that IP Instances was put back into build 57. So I would not try to put the Feb 2007 crossbow BFU on top of anything later than build 56. If you are looking for IP Instances only (no VNICs or flowadm), then build 59 is sufficient. However, you need to have a GLDv3 capable interface, currently bge, e1000g, ixgb, nge, rge, and xge. If ''dladm show-link'' shows legacy, you will not be able to access the interface within an zone with ip-type set to exclusive. Steffen> > # uname -a > SunOS linf1 5.11 snv_59 i86pc i386 i86pc > > I don''t have onbld tools installed. Do I need to install them for > crossbow to work ? Note that I just downloaded the community express CDs > and did a default install. > > Thanks, > Pradeep > >> I don''t know where there is an archive of older builds. >> >> Steffen >> >> Sunay Tripathi wrote On 03/16/07 16:41,: >> >>> Pradeep, >>> >>> Sorry I have a plane to catch but I am CC''ing crossbow-discuss mailing >>> list where we have lot of bright people. Someone should be able to >>> help you out there. >>> >>> Thanks, >>> Sunay >>> >>> >>>> Hi Sunay, >>>> >>>> I have installed OpenSolaris and have setup an apache zone as well. >>>> It''s quite interesting to work with a non-Linux UNIX in a long time. >>>> I just downloaded the beta release of crossbow and I am trying to >>>> use the bfu.sh script. I get the following error. >>>> >>>> -- >>>> # ./bfu.sh /export/home/ppadala/crossbow/nightly/ >>>> Copying /export/home/ppadala/crossbow/./bfu.sh to /tmp/bfu.9358 >>>> Executing /tmp/bfu.9358 /export/home/ppadala/crossbow/nightly/ >>>> >>>> Loading /export/home/ppadala/crossbow/nightly/ on / >>>> /usr/lib/mps/libnss3.so is not valid. >>>> Run /ws/onnv-gate/public/bin/update_nsspkgs to update the SUNWtls >>>> package. >>>> bfu aborting >>>> -- >>>> >>>> I don''t have the update_nsspkgs (or the directory for that matter) >>>> mentioned above. Seems like a version dependency to me. >>>> >>>> Sorry to bother you with this, but I am new to Open Solaris. Please >>>> let me know how I can resolve this. I have the latest Solaris >>>> Community express installed on my machine. If I need to build a >>>> particular version of Open Solaris, let me know how I can do that. >>>> >>>> Thanks, >>>> Pradeep >>>> >>> >>> >>>
Hi Steffen, Thanks for the info. My responses below.>>> I have installed various version of these bits numerous times on >>> different builds of NV from at least 54 to 56, on both SPARC and x64, >>> and have never seen this error. Most of my testing has been with 54, >>> however. >>> >>> Which version of NV (you say the lastest--is that 59?) and onbld are >>> you using? >> >> >> Yes, I think I am using 59. > > That may be the issue. Somehow, in all my crossbow beta testing, I > missed the > notification that IP Instances was put back into build 57. So I would > not try > to put the Feb 2007 crossbow BFU on top of anything later than build 56.How do I get build 56 ?> If you are looking for IP Instances only (no VNICs or flowadm), then build > 59 is sufficient. However, you need to have a GLDv3 capable interface, > currently > bge, e1000g, ixgb, nge, rge, and xge. If ''dladm show-link'' shows legacy, > you will > not be able to access the interface within an zone with ip-type set to > exclusive.Currently, I don''t have a card that has hardware flow classification capability. The plan is to set every thing up and try some of our control algorithms. The features I need are 1. Virtual machines. Zones or Xen based VMs. 2. Traffic shaping for the VMs. At the minimum, dynamic bandwidth settings for VMs. I am not sure about the features you mentioned, but I think I will need both VNICs and flowadm. Some of the details of what we are trying to do is described on our project page at http://kabru.eecs.umich.edu/twiki/bin/view/Main/DynamicControl. Pradeep
Pradeep Padala wrote On 03/19/07 09:40,:> Hi Steffen, > > Thanks for the info. My responses below. > >>>> I have installed various version of these bits numerous times on >>>> different builds of NV from at least 54 to 56, on both SPARC and >>>> x64, and have never seen this error. Most of my testing has been >>>> with 54, however. >>>> >>>> Which version of NV (you say the lastest--is that 59?) and onbld are >>>> you using? >>> >>> >>> >>> Yes, I think I am using 59. >> >> >> That may be the issue. Somehow, in all my crossbow beta testing, I >> missed the >> notification that IP Instances was put back into build 57. So I would >> not try >> to put the Feb 2007 crossbow BFU on top of anything later than build 56. > > > How do I get build 56 ?You can get 55b at http://www.sun.com/software/solaris/solaris-express/get.jsp via developer express. I don''t know where archives are kept, if anywhere. Steffen> >> If you are looking for IP Instances only (no VNICs or flowadm), then >> build >> 59 is sufficient. However, you need to have a GLDv3 capable interface, >> currently >> bge, e1000g, ixgb, nge, rge, and xge. If ''dladm show-link'' shows >> legacy, you will >> not be able to access the interface within an zone with ip-type set to >> exclusive. > > > Currently, I don''t have a card that has hardware flow classification > capability. The plan is to set every thing up and try some of our > control algorithms. The features I need are > > 1. Virtual machines. Zones or Xen based VMs. > 2. Traffic shaping for the VMs. At the minimum, dynamic bandwidth > settings for VMs. > > I am not sure about the features you mentioned, but I think I will need > both VNICs and flowadm. Some of the details of what we are trying to do > is described on our project page at > http://kabru.eecs.umich.edu/twiki/bin/view/Main/DynamicControl. > > Pradeep > > _______________________________________________ > crossbow-discuss mailing list > crossbow-discuss at opensolaris.org > http://opensolaris.org/mailman/listinfo/crossbow-discuss
Hi Steffen, Sorry for the delayed reply. I was traveling to Eurosys. I have a few questions below.> That may be the issue. Somehow, in all my crossbow beta testing, I > missed the > notification that IP Instances was put back into build 57. So I would > not try > to put the Feb 2007 crossbow BFU on top of anything later than build 56.So, if I read correctly, I need to get the Solaris express developer edition, right ? I guess that means downloading the CDs and wiping out my current Solaris installation ?> If you are looking for IP Instances only (no VNICs or flowadm), then build > 59 is sufficient. However, you need to have a GLDv3 capable interface, > currently > bge, e1000g, ixgb, nge, rge, and xge. If ''dladm show-link'' shows legacy, > you will > not be able to access the interface within an zone with ip-type set to > exclusive.Currently, I am using a SMC Ethernet card and It doesn''t have any hardware flow classification capability. I am not familiar with Solaris naming convention for interfaces, so please let me know what cards are supported by GLDv3 interface. Do you know of any cards that support hardware flow-classification other than Sun''s own NICs ? Thanks, Pradeep
Hi Pradeep, Pradeep Padala wrote On 03/26/07 16:34,:> Hi Steffen, > > Sorry for the delayed reply. I was traveling to Eurosys. I have a few > questions below. > >> That may be the issue. Somehow, in all my crossbow beta testing, I >> missed the >> notification that IP Instances was put back into build 57. So I would >> not try >> to put the Feb 2007 crossbow BFU on top of anything later than build 56. > > So, if I read correctly, I need to get the Solaris express developer > edition, right ? I guess that means downloading the CDs and wiping out > my current Solaris installation ?Unfortunately, that would be the case if you don''t have the space to install multiple versions of Solaris.> >> If you are looking for IP Instances only (no VNICs or flowadm), then >> build >> 59 is sufficient. However, you need to have a GLDv3 capable interface, >> currently >> bge, e1000g, ixgb, nge, rge, and xge. If ''dladm show-link'' shows >> legacy, you will >> not be able to access the interface within an zone with ip-type set to >> exclusive. > > Currently, I am using a SMC Ethernet card and It doesn''t have any > hardware flow classification capability. I am not familiar with Solaris > naming convention for interfaces, so please let me know what cards are > supported by GLDv3 interface.The SMC is very unlikely at this time. In the list above, bge is Broadcom, e1000g and ixgb are Intel (I believe), nge is nVidia, rge is Realtek, and xge is Neterion. They are either 1Gps or 10Gbps. If you are asking which Sun NICs you could use, here is a list: X7286A Sun PCI-X GigE MMF Low Profile Intel 1x Fiber PCI-X NIC (PLC 5667) X7285A Sun PCI-X Dual GigE UTP Low Profile Intel 2x UTP PCI-X NIC (PLC 5666) X7281A-2 Dual Gigabit Ethernet MMF Intel 2x Fiber PCIe NIC (Northstar MMF) X7280A-2 Dual Gigabit Ethernet UTP Intel 2x UTP PCIe NIC (Northstar UTP) X9273A Quad Ethernet Controller Intel 4x UTP PCI-X GBE NIC X9271A Single Ethernet Controller Intel 1x UTP PCI-X GBE NIC I don''t think we ever offered the Broadcom chips on a card, only built onto the motherboard. Or you can pick up an Intel Pro Desktop 10/100/1000 Gigabit PCI Network Adapter for about US$30.> > Do you know of any cards that support hardware flow-classification other > than Sun''s own NICs ?The ixgb and xge are both 10Gbps NICs, and I imagine both support that. http://www.sun.com/bigadmin/hcl/data/components/details/1535.html http://www.s2io.com/products/xframe.html Steffen> > Thanks, > Pradeep > > _______________________________________________ > crossbow-discuss mailing list > crossbow-discuss at opensolaris.org > http://opensolaris.org/mailman/listinfo/crossbow-discuss
David Edmondson
2007-Mar-29 15:10 UTC
[crossbow-discuss] Setting up Crossbow (problems still in developer edition)
On Thu, Mar 29, 2007 at 03:09:02PM -0400, Pradeep Padala wrote:> # ./bfu.sh /tmp/crossbow/nightly > Loading /tmp/crossbow/nightly on / > > Creating bfu execution environment ... > ./bfu.sh[2283]: /net/onnv.eng/export/gate/public/bin/i386: not found > cp: cannot access /net/onnv.eng/export/gate/public/bin/i386/fastfs > cannot copy /net/onnv.eng/export/gate/public/bin/i386/fastfsYou need to set the environment variables as described in http://www.opensolaris.org/os/community/on/devref_toc/devref_5/#5_3_using_bfu_to_install_on. That would also seem to require that the SUNWonbld package is installed. dme.
Pradeep Padala
2007-Mar-29 16:59 UTC
[crossbow-discuss] Crossbow supported cards [Was setting up Crossbow]
> The SMC is very unlikely at this time. > > In the list above, bge is Broadcom, e1000g and ixgb are Intel (I > believe), nge > is nVidia, rge is Realtek, and xge is Neterion. They are either 1Gps or > 10Gbps. > > If you are asking which Sun NICs you could use, here is a list: > > X7286A Sun PCI-X GigE MMF Low Profile Intel 1x Fiber PCI-X > NIC (PLC 5667) > X7285A Sun PCI-X Dual GigE UTP Low Profile Intel 2x UTP > PCI-X NIC (PLC 5666) > X7281A-2 Dual Gigabit Ethernet MMF Intel 2x Fiber PCIe NIC > (Northstar MMF) > X7280A-2 Dual Gigabit Ethernet UTP Intel 2x UTP PCIe NIC > (Northstar UTP) > X9273A Quad Ethernet Controller Intel 4x UTP PCI-X GBE NIC > X9271A Single Ethernet Controller Intel 1x UTP PCI-X GBE NIC > > I don''t think we ever offered the Broadcom chips on a card, only built > onto the > motherboard. > > Or you can pick up an Intel Pro Desktop 10/100/1000 Gigabit PCI Network > Adapter for about US$30.It seems like I have to buy a card that is supported by Crossbow. What''s the best card to buy that also has the hardware flow-classification capability ? Is there a webpage describing the HCL ? Thanks, Pradeep
Michael Lim
2007-Mar-29 17:08 UTC
[crossbow-discuss] Setting up Crossbow (problems still in developer edition)
Pradeep Padala wrote:> Hi Steffen, > > I downloaded and installed the developer edition. I am getting a new > error now. Note that I haven''t installed any other packages other than > what''s in the default DVD installation. > > # ./bfu.sh /tmp/crossbow/nightly > Loading /tmp/crossbow/nightly on / > > Creating bfu execution environment ... > ./bfu.sh[2283]: /net/onnv.eng/export/gate/public/bin/i386: not found > cp: cannot access /net/onnv.eng/export/gate/public/bin/i386/fastfs > cannot copy /net/onnv.eng/export/gate/public/bin/i386/fastfs >Pradeep- You need to have fastfs installed and have the FASTFS environment variable set to where it was installed. Check to see if fastfs was installed at /opt/onbld/bin. If not, install SUNWonbld from the DVD or download it from opensolaris.org. Here''s some pages with some more information: http://www.opensolaris.org/os/community/on/devref_toc/devref_5/#5_3_using_bfu_to_install_on http://opensolaris.org/os/project/crossbow/CrossbowRelease08-2006/ Good Luck... -Mike
Pradeep Padala
2007-Mar-29 17:17 UTC
[crossbow-discuss] Setting up Crossbow (problems still in developer edition)
> You need to have fastfs installed and have the FASTFS environment > variable set to where it was installed. Check to see if fastfs was > installed at /opt/onbld/bin. If not, install SUNWonbld from the DVD or > download it from opensolaris.org. > > Here''s some pages with some more information: > > http://www.opensolaris.org/os/community/on/devref_toc/devref_5/#5_3_using_bfu_to_install_on > > http://opensolaris.org/os/project/crossbow/CrossbowRelease08-2006/Thanks, Mike. I have Crossbow setup, but seems like the cards I have are not supported. I am trying to find (or buy) a card that is supported. Any suggestions are welcome. Pradeep
Michael Lim
2007-Mar-29 17:38 UTC
[crossbow-discuss] Setting up Crossbow (problems still in developer edition)
Pradeep Padala wrote:>> You need to have fastfs installed and have the FASTFS environment >> variable set to where it was installed. Check to see if fastfs was >> installed at /opt/onbld/bin. If not, install SUNWonbld from the DVD >> or download it from opensolaris.org. >> >> Here''s some pages with some more information: >> >> http://www.opensolaris.org/os/community/on/devref_toc/devref_5/#5_3_using_bfu_to_install_on >> >> http://opensolaris.org/os/project/crossbow/CrossbowRelease08-2006/ > > Thanks, Mike. I have Crossbow setup, but seems like the cards I have > are not supported. I am trying to find (or buy) a card that is > supported. Any suggestions are welcome.Some broadcom (bge) cards have hardware flow classification w/multiple rx rings. Unfortunately, it''s difficult to tell which ones have 1 rx ring or 16 rx rings until you try it. I looked through some of their literature and they don''t specifically mention rx rings. We have some here so I''ll try to check the product number(s). As for crossbow-support... There are roughly 3 categories of NICs wrt crossbow Not supported - cannot create vnics and flows Supported - can create vnics and flows and uses s/w classification. Supported w/hw assist - can create vnics and flows and programs the h/w for classification All bge cards are supported but not all can be used for h/w classification. -Mike -Mike
Pradeep Padala
2007-Mar-29 17:52 UTC
[crossbow-discuss] Setting up Crossbow (problems still in developer edition)
>> Thanks, Mike. I have Crossbow setup, but seems like the cards I have >> are not supported. I am trying to find (or buy) a card that is >> supported. Any suggestions are welcome. > Some broadcom (bge) cards have hardware flow classification w/multiple > rx rings. Unfortunately, it''s difficult to tell which ones have 1 rx > ring or 16 rx rings until you try it. > I looked through some of their literature and they don''t specifically > mention rx rings. > > We have some here so I''ll try to check the product number(s). > > As for crossbow-support... > > There are roughly 3 categories of NICs wrt crossbow > > Not supported - cannot create vnics and flows > Supported - can create vnics and flows and uses s/w classification. > Supported w/hw assist - can create vnics and flows and programs the h/w > for classification > > All bge cards are supported but not all can be used for h/w classification.Great. Please let me know the Broadcom cards that HAVE support for h/w classification. I will ask my advisor for buying the cards. Pradeep
Pradeep Padala
2007-Mar-29 19:09 UTC
[crossbow-discuss] Setting up Crossbow (problems still in developer edition)
Hi Steffen, I downloaded and installed the developer edition. I am getting a new error now. Note that I haven''t installed any other packages other than what''s in the default DVD installation. # ./bfu.sh /tmp/crossbow/nightly Loading /tmp/crossbow/nightly on / Creating bfu execution environment ... ./bfu.sh[2283]: /net/onnv.eng/export/gate/public/bin/i386: not found cp: cannot access /net/onnv.eng/export/gate/public/bin/i386/fastfs cannot copy /net/onnv.eng/export/gate/public/bin/i386/fastfs Let me know how I can fix this. Pradeep