Xen devel - Jun 2013 - Xen 4.1 compile from source and install on Fedora 17

Hello,

I have asked this question in Xen-users mailing list too. But since it
involves compiling from source, I realised asking this here makes more
sense. Please forgive me for the spam.

I am relatively new to Xen and need help compiling and installing Xen from
source.

Using some tutorials online, I have got Xen working with the ''yum
install
xen'' method.
I used virt-manager and was able to get 2 domUs working ( CentOS 5, and
Fedora 16).
My domUs reside on Logical Volumes in an LVM, on a second hard disk sda2,
while my dom0 is installed on sda1. Everything is working fine in this
configuration.
I want to use Xen 4.1 since I want to continue using
virt-install/virt-manager for domU provisioning.

For my work now, I want to install Xen from source and try to modify some
source code files and test things out.
I have seen some tutorials online, and I am not sure they give the complete
picture.
For ex,
http://wiki.xen.org/wiki/Xen_4.2_Build_From_Source_On_RHEL_CentOS_Fedora
Fedora 17 uses grub 2. When we do a yum install, the grub entries are taken
care of and things just work.
When I install from source, this is not the case. Are there any tutorials
which give a complete picture?
Or if someone has got Xen working from source on Fedora 16, 17 or 18, can
you give me tips on how to edit grub configuration so that xen boots ok.
I have tried and failed once compiling and installing Xen on Fedora 16,
which is when I used yum.


-- 
Ranjith krishnan


_______________________________________________
Xen-devel mailing list
Xen-devel@lists.xen.org
http://lists.xen.org/xen-devel

On Tue, Jun 11, 2013 at 04:44:35PM -0500, ranjith krishnan
wrote:
>    Hello,
>    I have asked this question in Xen-users mailing list too. But since it
>    involves compiling from source, I realised asking this here makes more
>    sense. Please forgive me for the spam.
>    I am relatively new to Xen and need help compiling and installing Xen
from
>    source.
>    Using some tutorials online, I have got Xen working with the
''yum install
>    xen'' method.
>    I used virt-manager and was able to get 2 domUs working ( CentOS 5, and
>    Fedora 16).
>    My domUs reside on Logical Volumes in an LVM, on a second hard disk
sda2,
>    while my dom0 is installed on sda1. Everything is working fine in this
>    configuration.
>    I want to use Xen 4.1 since I want to continue using
>    virt-install/virt-manager for domU provisioning.
>
if you''re installing Xen from source, you probably should install
libvirt/virt-install/virt-manager
from source aswell and compile against your custom version of Xen.
>    For my work now, I want to install Xen from source and try to modify
some
>    source code files and test things out.
>    I have seen some tutorials online, and I am not sure they give the
>    complete picture.
>    For
>    ex,
[1]http://wiki.xen.org/wiki/Xen_4.2_Build_From_Source_On_RHEL_CentOS_Fedora
>    Fedora 17 uses grub 2. When we do a yum install, the grub entries are
>    taken care of and things just work.
>    When I install from source, this is not the case. Are there any
tutorials
>    which give a complete picture?
>    Or if someone has got Xen working from source on Fedora 16, 17 or 18,
can
>    you give me tips on how to edit grub configuration so that xen boots ok.
>    I have tried and failed once compiling and installing Xen on Fedora 16,
>    which is when I used yum.
Why not install Fedora 18 to your dom0? It uses grub2, and you can install Xen
from rpms there,
and check the automatically generated grub2 configuration for correct syntax.

Also you can generate patches against Xen version used in F18,
add those patches to the src.rpm, rebuild the src.rpm, and install the new
binary rpm,
so this way you don''t need to rebuild libvirt because the Xen ABI stays
the same,
assuming you''re patches don''t change the ABI.

-- Pasi

On mar, 2013-06-11 at 16:44 -0500, ranjith krishnan
wrote:
> Hello, 
> 
Hi,
> I want to use Xen 4.1 since I want to continue using
> virt-install/virt-manager for domU provisioning.
> 
You want to use 4.1 instead of what? 4.2? If yes, I don''t see the
reason
for that... Using both virt-install and virt-manager is entirely
possible with Xen 4.2, e.g., on Fedora 18.

Dario

-- 
<<This happens because I choose it to happen!>> (Raistlin Majere)
-----------------------------------------------------------------
Dario Faggioli, Ph.D, http://about.me/dario.faggioli
Senior Software Engineer, Citrix Systems R&D Ltd., Cambridge (UK)



_______________________________________________
Xen-devel mailing list
Xen-devel@lists.xen.org
http://lists.xen.org/xen-devel

Dario,

When you say that using virt-manager is entirely possible with Xen 4.2 on
Fedora 18, with which toolstack, XL or XM, do you mean?

I ask because, in my experience with Ubuntu, virt-manager works with the XM
toolstack, but NOT with the XL toolstack, under Xen 4.2 on Ubuntu 13.04 and
13.10.  See https://bugs.launchpad.net/ubuntu/+source/libvirt/+bug/1180281

And although I haven''t spent as much time testing it, in my experience,
virt-manager doesn''t work with the XL toolstack under Xen 4.2 on Fedora
19
beta.  I haven''t tested virt-manager with Fedora 18.

Regards,
GizmoChicken


On Wed, Jun 12, 2013 at 4:33 AM, Dario Faggioli
<dario.faggioli@citrix.com>wrote:
> On mar, 2013-06-11 at 16:44 -0500, ranjith krishnan wrote:
> > Hello,
> >
> Hi,
>
> > I want to use Xen 4.1 since I want to continue using
> > virt-install/virt-manager for domU provisioning.
> >
> You want to use 4.1 instead of what? 4.2? If yes, I don''t see the
reason
> for that... Using both virt-install and virt-manager is entirely
> possible with Xen 4.2, e.g., on Fedora 18.
>
> Dario
>
> --
> <<This happens because I choose it to happen!>> (Raistlin
Majere)
> -----------------------------------------------------------------
> Dario Faggioli, Ph.D, http://about.me/dario.faggioli
> Senior Software Engineer, Citrix Systems R&D Ltd., Cambridge (UK)
>
>
> _______________________________________________
> Xen-devel mailing list
> Xen-devel@lists.xen.org
> http://lists.xen.org/xen-devel
>
>

_______________________________________________
Xen-devel mailing list
Xen-devel@lists.xen.org
http://lists.xen.org/xen-devel

On mer, 2013-06-12 at 05:02 -0400, Gizmo Chicken wrote:
> Dario,
> 
> When you say that using virt-manager is entirely possible with Xen 4.2
> on Fedora 18, with which toolstack, XL or XM, do you mean?  
> 
Both, actually. libxl driver is definitely less mature, and might still
miss some features, but the basic create-pause-resume-shutdown-destroy
workload works really well for me.
> I ask because, in my experience with Ubuntu, virt-manager works with
> the XM toolstack, but NOT with the XL toolstack, under Xen 4.2 on
> Ubuntu 13.04 and 13.10.  See
> https://bugs.launchpad.net/ubuntu/+source/libvirt/+bug/1180281  
> 
Yeah, I think I remember your bugreport from an e-mail on xen-users. I
don''t know what to say because I know nothing about libvirt on
Debian/Ubuntu, but I guess that depends on the very specific version of
libvirt that they ship.

For me, on Fedora 18 (and ISTR even on Fedora 17, but perhaps I was
using the virt-preview repository), all I have to do is to make sure
xend runs, if I want libvirt (so both virt-manager and virt-install) to
use xend. To stop it (and disable for starting automatically at boot
time), if I want them to use libxl.
> And although I haven''t spent as much time testing it, in my
> experience, virt-manager doesn''t work with the XL toolstack under
Xen
> 4.2 on Fedora 19 beta.  I haven''t tested virt-manager with Fedora
18.
> 
What do you mean with "doesn''t work" ? 

Dario

-- 
<<This happens because I choose it to happen!>> (Raistlin Majere)
-----------------------------------------------------------------
Dario Faggioli, Ph.D, http://about.me/dario.faggioli
Senior Software Engineer, Citrix Systems R&D Ltd., Cambridge (UK)



_______________________________________________
Xen-devel mailing list
Xen-devel@lists.xen.org
http://lists.xen.org/xen-devel

On Wed, Jun 12, 2013 at 5:35 AM, Dario Faggioli
<dario.faggioli@citrix.com> wrote:
> On mer, 2013-06-12 at 05:02 -0400, Gizmo Chicken wrote:
>> Dario,
>>
>> When you say that using virt-manager is entirely possible with Xen 4.2
>> on Fedora 18, with which toolstack, XL or XM, do you mean?
>>
> Both, actually. libxl driver is definitely less mature, and might still
> miss some features, but the basic create-pause-resume-shutdown-destroy
> workload works really well for me.
>
>> I ask because, in my experience with Ubuntu, virt-manager works with
>> the XM toolstack, but NOT with the XL toolstack, under Xen 4.2 on
>> Ubuntu 13.04 and 13.10.  See
>> https://bugs.launchpad.net/ubuntu/+source/libvirt/+bug/1180281
>>
> Yeah, I think I remember your bugreport from an e-mail on xen-users. I
> don''t know what to say because I know nothing about libvirt on
> Debian/Ubuntu, but I guess that depends on the very specific version of
> libvirt that they ship.

Not sure if the comment is correct, but based on Comment #9 to my bug
report, Debian/Ubuntu seems to package Xen in such a way that certain
components (such as libxenlight.so) are installed differently compared
to other distros.  See Comment #9 at
https://bugs.launchpad.net/ubuntu/+source/libvirt/+bug/1180281

>
> For me, on Fedora 18 (and ISTR even on Fedora 17, but perhaps I was
> using the virt-preview repository), all I have to do is to make sure
> xend runs, if I want libvirt (so both virt-manager and virt-install) to
> use xend. To stop it (and disable for starting automatically at boot
> time), if I want them to use libxl.
>
>> And although I haven''t spent as much time testing it, in my
>> experience, virt-manager doesn''t work with the XL toolstack
under Xen
>> 4.2 on Fedora 19 beta.  I haven''t tested virt-manager with
Fedora 18.
>>
> What do you mean with "doesn''t work" ?

I haven''t spent much time with virt-manager on Fedora 19 beta, so I
can''t provide details.  But if I recall correctly, I also got
something like "Unable to connect to libvirt" when attempting to use
virt-manager with Xen and the XL toolstack.  XL was definitely
running, and near as I could tell, XM/xend was not running.  I didn''t
try virt-manager with the XM toolstack.

GizmoChicken
>
> Dario
>
> --
> <<This happens because I choose it to happen!>> (Raistlin
Majere)
> -----------------------------------------------------------------
> Dario Faggioli, Ph.D, http://about.me/dario.faggioli
> Senior Software Engineer, Citrix Systems R&D Ltd., Cambridge (UK)
>

Thanks for your replies!

Pasi, Are you suggesting me to install Fedora 18 and check grub2
configuration and try to build my new grub from that ? Since I have Fedora
17 installed now as Dom0 and have Xen working, can''t I use this grub2
as a
working example.

Dario and Gizmo,
>> Dario,
> >>
> >> When you say that using virt-manager is entirely possible with Xen
4.2
> >> on Fedora 18, with which toolstack, XL or XM, do you mean?
> >>
> > Both, actually. libxl driver is definitely less mature, and might
still
> > miss some features, but the basic create-pause-resume-shutdown-destroy
> > workload works really well for me.
>
>
>  It is just that the machine I am working on is a university machine, and
it has
 fedora 17, hence I am trying to get things working on Fedora 17 first.
Installing
 a new OS means I have to give the machine to the system admins, which
takes
 more time and me trying out things.

 I also remember reading in some forums where libvirt/virt-manager having
 issues running on Xen 4.2 and F18, which was why I started with Fedora 17
 in the first place.

 Dario,
 Did you compile Xen from source and install on F18 ? If yes can you give
me
 some tips on how you got it working, especially the grub entries. When I
first
 tried compiling/installing Xen from source, I was unable to boot Xen.

 Now that I have the grub.cfg file from the F17 (Xen installed using yum),
can I
 use this as an example and edit my grub.cfg after I compile/install Xen?
 Also, grub2 tells us not to manually edit grub.cfg since it is
autogenerated from
/etc/default/grub. So what is the right way to do it ?


-- 
Ranjith krishnan


_______________________________________________
Xen-devel mailing list
Xen-devel@lists.xen.org
http://lists.xen.org/xen-devel

On mer, 2013-06-12 at 09:22 -0400, Gizmo Chicken wrote:
> Not sure if the comment is correct, but based on Comment #9 to my bug
> report, Debian/Ubuntu seems to package Xen in such a way that certain
> components (such as libxenlight.so) are installed differently compared
> to other distros.  See Comment #9 at
> https://bugs.launchpad.net/ubuntu/+source/libvirt/+bug/1180281
> 
That is possible, I guess... I''m sorry, but as I said already, I know
nothing of using both the packaged version of Xen and libvirt on Debian
or Ubuntu. :-(
> I haven''t spent much time with virt-manager on Fedora 19 beta, so
I
> can''t provide details.  But if I recall correctly, I also got
> something like "Unable to connect to libvirt" when attempting to
use
> virt-manager with Xen and the XL toolstack.  XL was definitely
> running, and near as I could tell, XM/xend was not running.  I
didn''t
> try virt-manager with the XM toolstack.
> 
Well, without the details, it''s hard to say anything more than what has
been said already. I do test Xen on Fedora regularly, and that includes
basic libvirt (both virt-install and virt-manager) operations. Both
Fedora 18 and Fedora 19 work pretty well for me, and I haven''t seen any
issues in connecting to libvirtd.

If you get the chance to try it again, feel free to ask for help,
providing all the needed details on what is that your are seeing, either
here, or on xen@lists.fedoraproject.org, or on
virt@lists.fedoraproject.org, or on libvir-list@redhat.com, depending on
where you think the problem could be. :-)

Regards,
Dario

-- 
<<This happens because I choose it to happen!>> (Raistlin Majere)
-----------------------------------------------------------------
Dario Faggioli, Ph.D, http://about.me/dario.faggioli
Senior Software Engineer, Citrix Systems R&D Ltd., Cambridge (UK)



_______________________________________________
Xen-devel mailing list
Xen-devel@lists.xen.org
http://lists.xen.org/xen-devel

Hello,

So I followed the guide
http://wiki.xen.org/wiki/Xen_4.2_Build_From_Source_On_RHEL_CentOS_Fedora
and built/installed Xen from source, using grub2-mkconfig to rebuild grub
and was able to reboot
Dom0 with Xen successfully.

Then I installed packages for virt-manager.
# yum install libvirt-daemon-xen python-virtinst
libvirt-daemon-config-network libvirt-daemon-driver-network virt-manager
virt-viewer
Everything got installed except for one package. Got an error message "No
package libvirt-daemon-driver-network available."

Now when I start virt-manager, it is unable to connect to Xen and fails
with the following error.
# virt-manager
   Unable to connect to libvirt.

  unable to connect to ''localhost:8000'': Connection refused

  Verify that:
   - A Xen host kernel was booted
   - The Xen service has been started

  Libvirt URI is: xen:///

  Traceback (most recent call last):
    File "/usr/share/virt-manager/virtManager/connection.py", line
1027, in
_open_thread
     self.vmm = self._try_open()
    File "/usr/share/virt-manager/virtManager/connection.py", line
1009, in
_try_open
      flags)
    File "/usr/lib64/python2.7/site-packages/libvirt.py", line 102, in
openAuth
      if ret is None:raise libvirtError(''virConnectOpenAuth()
failed'')
  libvirtError: unable to connect to ''localhost:8000'':
Connection refused

# xm list and # xm info work fine. This means xend is running right ?

Did some searching, found an old thread
http://old-list-archives.xenproject.org/xen-users/2010-06/msg00880.html
Added *(xend-unix-server yes)* to xen configuration file xend-config.sxp
and added *export VIRSH_DEFAULT_CONNECT_URI="xen:///"* to
root''s .bashrc.
Still no luck.

This might help, # rpm -qa | grep libvirt
libvirt-daemon-xen-0.9.11.9-1.fc17.x86_64
libvirt-daemon-0.9.11.9-1.fc17.x86_64
libvirt-0.9.11.9-1.fc17.x86_64
libvirt-python-0.9.11.9-1.fc17.x86_64
libvirt-daemon-config-network-0.9.11.9-1.fc17.x86_64
libvirt-daemon-config-nwfilter-0.9.11.9-1.fc17.x86_64
libvirt-client-0.9.11.9-1.fc17.x86_64

So in summary,
Built and installed from source Xen 4.1.5, on Fedora 17.
Can boot into Xen Dom0, xm works, xend running, But virt-manager unable to
connect to Xen!

Please help.
I have tried to give as much info as I could. Do let me know if you need
more info.





On Wed, Jun 12, 2013 at 6:44 PM, Dario Faggioli
<dario.faggioli@citrix.com>wrote:
> On mer, 2013-06-12 at 09:22 -0400, Gizmo Chicken wrote:
> > Not sure if the comment is correct, but based on Comment #9 to my bug
> > report, Debian/Ubuntu seems to package Xen in such a way that certain
> > components (such as libxenlight.so) are installed differently compared
> > to other distros.  See Comment #9 at
> > https://bugs.launchpad.net/ubuntu/+source/libvirt/+bug/1180281
> >
> That is possible, I guess... I''m sorry, but as I said already, I
know
> nothing of using both the packaged version of Xen and libvirt on Debian
> or Ubuntu. :-(
>
> > I haven''t spent much time with virt-manager on Fedora 19
beta, so I
> > can''t provide details.  But if I recall correctly, I also got
> > something like "Unable to connect to libvirt" when
attempting to use
> > virt-manager with Xen and the XL toolstack.  XL was definitely
> > running, and near as I could tell, XM/xend was not running.  I
didn''t
> > try virt-manager with the XM toolstack.
> >
> Well, without the details, it''s hard to say anything more than
what has
> been said already. I do test Xen on Fedora regularly, and that includes
> basic libvirt (both virt-install and virt-manager) operations. Both
> Fedora 18 and Fedora 19 work pretty well for me, and I haven''t
seen any
> issues in connecting to libvirtd.
>
> If you get the chance to try it again, feel free to ask for help,
> providing all the needed details on what is that your are seeing, either
> here, or on xen@lists.fedoraproject.org, or on
> virt@lists.fedoraproject.org, or on libvir-list@redhat.com, depending on
> where you think the problem could be. :-)
>
> Regards,
> Dario
>
> --
> <<This happens because I choose it to happen!>> (Raistlin
Majere)
> -----------------------------------------------------------------
> Dario Faggioli, Ph.D, http://about.me/dario.faggioli
> Senior Software Engineer, Citrix Systems R&D Ltd., Cambridge (UK)
>
>

-- 
Ranjith krishnan


_______________________________________________
Xen-devel mailing list
Xen-devel@lists.xen.org
http://lists.xen.org/xen-devel