Hi guys, I am using blktap for implementing a custom disk device for XEN DomUs. I was using a previous version of Ubuntu that I need to upgrade to version 11.10. If i understood correctly, the blktap kernel module is not present in the mainline kernel 3.x. So my questions are: Can I get blktap/blktap2 working on ubuntu 11.10? If yes, can you point me the procedure? I saw that project Kronos is aiming at a blktap dkms module for debian/ubuntu http://blog.xen.org/index.php/2011/07/22/project-kronos/ . However, i tried it in a AMD64 bit distribution and the module was deployed correctly but blktap is still not working. Is there any other linux distro, or alternative better than Ubuntu 11.10 for my objectives? Finally, is there a better alternative for implementing custom I/O disk drivers for VMs instead of the blktap mechanism? I have not looked deeply to HVM-XEN and Qemu, would this solution be less painful? Thanks for your help, Kind Regards, João Paulo _______________________________________________ Xen-users mailing list Xen-users@lists.xensource.com http://lists.xensource.com/xen-users
I run a debian wheezy (testing) dom0 and it''s 3.0.1 kernel does not have blktap(2) as you said however I did install the blktap dkms and was able to get the kernel module installed and running yet still domU''s with blktap devices would just hang on boot with no error messages ever. I even tried recompiling the kernel and statically linking the blktap driver but it was the same results as using it modularized. Sorry i can''t help but to confirm your issue. I was also unable to get blktap working in centos6 with the 2.6 kernel. I use lvm-backed domU''s but it would be nice to be able to store the swap or something locally with a tap: instead of file: Thanks, DDV On Wed, Nov 2, 2011 at 7:14 AM, João Paulo <jtpaulo@di.uminho.pt> wrote:> Hi guys, > > I am using blktap for implementing a custom disk device for XEN DomUs. I > was using a previous version of Ubuntu that I need to upgrade to version > 11.10. If i understood correctly, the blktap kernel module is not present > in the mainline kernel 3.x. So my questions are: > > Can I get blktap/blktap2 working on ubuntu 11.10? If yes, can you point me > the procedure? > > I saw that project Kronos is aiming at a blktap dkms module for > debian/ubuntu http://blog.xen.org/index.php/2011/07/22/project-kronos/ . > However, i tried it in a AMD64 bit distribution and the module was deployed > correctly but blktap is still not working. > > Is there any other linux distro, or alternative better than Ubuntu 11.10 > for my objectives? > > Finally, is there a better alternative for implementing custom I/O disk > drivers for VMs instead of the blktap mechanism? I have not looked deeply > to HVM-XEN and Qemu, would this solution be less painful? > > Thanks for your help, > > Kind Regards, > > João Paulo > -----BEGIN PGP SIGNATURE----- > > iQEcBAEBAgAGBQJOsSYwAAoJEAY8eTZG4klmvLoIAJYn1YVD+a3ELsqcgM6EUa46 > FORwKuXgOplz1iyXf354v7Qc1BJ9R0SJvNO6Ruf7XKqfiS+fx7SYkeN7GxvGsK9q > lSjKKDvZwnKNxe4BPPQ6JWZaifjgLDLgArhBZdPN204D67Hs6GhGo9g2af0q8h7k > ad/hkuiLkjroo2dDX908Y06WrCIArGTu6TDIezaV/CX4buKJrdb+HCBDezJRoxst > KjIxbZCo7c+uyjDhgKItaO981LxSBXngomctMJZp26QAyW7JcaqQX2y3H++c6DJF > ihlmy0DcRlKK3B7gV/HqZvLS4h04nP0Gm+CBWX7Hd7T2yhQqrxZGDm5gkviJtG8> =22dU > -----END PGP SIGNATURE----- > > _______________________________________________ > Xen-users mailing list > Xen-users@lists.xensource.com > http://lists.xensource.com/xen-users >_______________________________________________ Xen-users mailing list Xen-users@lists.xensource.com http://lists.xensource.com/xen-users
David Della Vecchia
2011-Nov-02 16:57 UTC
[Xen-devel] Re: [Xen-users] Blktap in mainline kernel 3.x
I''ve had it running for about a month now with no issues, i''ve got 35 beta tester domU''s on the box and everything seems to be going swimmingly. A few things to keep in mind: For some reason the debian xen packages do not have pv-grub so you need to acquire that elsewhere, it doesn''t need to be built on your system though, i downloaded mine from a forum post somewhere (i used to download the xen source and compile from scratch to get it). This next one isn''t so much a dom0 problem as a domU one but for some reason debian squeeze (stable) guests are not capable of saving and restoring their state. On restore the console and/or network devices will be locked/frozen. I was able to get it to kinda work by custom compiling a 3.0.4 kernel but even then it was not reliable; however the centos domU''s are able to save/restore flawlessly. This was all on the wheezy dom0. The xen packages in debian, and this might be the default for xen4.1+ now, expect you to setup your own bridge, the network-bridge line of the xend-config.sxp will be commented out or just not there at all. I put it back in, I let the script the handle the bridging since it works fine for my needs; that and my attempts to manually create a bridge following the xen instructions always fail for some reason. Stuff gets put into /usr/lib/xen-4.1 instead of /usr/lib/xen so i had to update a lot of my scripts and config files when i switched to debian. Also as far as i can tell, wheezy uses the stock 3.0.0-1 kernel for xen so no custom kernel required like in squeeze with its 2.6.32-5-xen (its my understanding this is the pvops option?). As far as hvm guests go, as long as you use the hvmloader from the package you''ll be fine, if you custom compile xen there''s a good chance your hvmloader will be corrupted, it has something to do with the newer version of gcc, though this may have been fixed in 4.1.2. Hope that helps, David On Wed, Nov 2, 2011 at 12:44 PM, Steven Wilcoxon <stevew@pcann.com> wrote:> I''ve been thinking of doing a Wheezy install myself. How stable does it > feel to you? > > S.W. > > > On 11/2/2011 10:26 AM, David Della Vecchia wrote: > > I run a debian wheezy (testing) dom0 and it''s 3.0.1 kernel does not have > blktap(2) as you said however I did install the blktap dkms and was able to > get the kernel module installed and running yet still domU''s with blktap > devices would just hang on boot with no error messages ever. I even tried > recompiling the kernel and statically linking the blktap driver but it was > the same results as using it modularized. > > Sorry i can''t help but to confirm your issue. I was also unable to get > blktap working in centos6 with the 2.6 kernel. I use lvm-backed domU''s but > it would be nice to be able to store the swap or something locally with a > tap: instead of file: > > Thanks, > DDV > > On Wed, Nov 2, 2011 at 7:14 AM, João Paulo <jtpaulo@di.uminho.pt> wrote: > >> Hi guys, >> >> I am using blktap for implementing a custom disk device for XEN DomUs. I >> was using a previous version of Ubuntu that I need to upgrade to version >> 11.10. If i understood correctly, the blktap kernel module is not present >> in the mainline kernel 3.x. So my questions are: >> >> Can I get blktap/blktap2 working on ubuntu 11.10? If yes, can you point >> me the procedure? >> >> I saw that project Kronos is aiming at a blktap dkms module for >> debian/ubuntu http://blog.xen.org/index.php/2011/07/22/project-kronos/ . >> However, i tried it in a AMD64 bit distribution and the module was deployed >> correctly but blktap is still not working. >> >> Is there any other linux distro, or alternative better than Ubuntu 11.10 >> for my objectives? >> >> Finally, is there a better alternative for implementing custom I/O disk >> drivers for VMs instead of the blktap mechanism? I have not looked deeply >> to HVM-XEN and Qemu, would this solution be less painful? >> >> Thanks for your help, >> >> Kind Regards, >> >> João Paulo >> -----BEGIN PGP SIGNATURE----- >> >> iQEcBAEBAgAGBQJOsSYwAAoJEAY8eTZG4klmvLoIAJYn1YVD+a3ELsqcgM6EUa46 >> FORwKuXgOplz1iyXf354v7Qc1BJ9R0SJvNO6Ruf7XKqfiS+fx7SYkeN7GxvGsK9q >> lSjKKDvZwnKNxe4BPPQ6JWZaifjgLDLgArhBZdPN204D67Hs6GhGo9g2af0q8h7k >> ad/hkuiLkjroo2dDX908Y06WrCIArGTu6TDIezaV/CX4buKJrdb+HCBDezJRoxst >> KjIxbZCo7c+uyjDhgKItaO981LxSBXngomctMJZp26QAyW7JcaqQX2y3H++c6DJF >> ihlmy0DcRlKK3B7gV/HqZvLS4h04nP0Gm+CBWX7Hd7T2yhQqrxZGDm5gkviJtG8>> =22dU >> -----END PGP SIGNATURE----- >> >> _______________________________________________ >> Xen-users mailing list >> Xen-users@lists.xensource.com >> http://lists.xensource.com/xen-users >> > > > > _______________________________________________ > Xen-users mailing listXen-users@lists.xensource.comhttp://lists.xensource.com/xen-users > > >_______________________________________________ Xen-devel mailing list Xen-devel@lists.xensource.com http://lists.xensource.com/xen-devel
I''ve had it running for about a month now with no issues, i''ve got 35 beta tester domU''s on the box and everything seems to be going swimmingly. A few things to keep in mind: For some reason the debian xen packages do not have pv-grub so you need to acquire that elsewhere, it doesn''t need to be built on your system though, i downloaded mine from a forum post somewhere (i used to download the xen source and compile from scratch to get it). This next one isn''t so much a dom0 problem as a domU one but for some reason debian squeeze (stable) guests are not capable of saving and restoring their state. On restore the console and/or network devices will be locked/frozen. I was able to get it to kinda work by custom compiling a 3.0.4 kernel but even then it was not reliable; however the centos domU''s are able to save/restore flawlessly. This was all on the wheezy dom0. The xen packages in debian, and this might be the default for xen4.1+ now, expect you to setup your own bridge, the network-bridge line of the xend-config.sxp will be commented out or just not there at all. I put it back in, I let the script the handle the bridging since it works fine for my needs; that and my attempts to manually create a bridge following the xen instructions always fail for some reason. Stuff gets put into /usr/lib/xen-4.1 instead of /usr/lib/xen so i had to update a lot of my scripts and config files when i switched to debian. Also as far as i can tell, wheezy uses the stock 3.0.0-1 kernel for xen so no custom kernel required like in squeeze with its 2.6.32-5-xen (its my understanding this is the pvops option?). As far as hvm guests go, as long as you use the hvmloader from the package you''ll be fine, if you custom compile xen there''s a good chance your hvmloader will be corrupted, it has something to do with the newer version of gcc, though this may have been fixed in 4.1.2. Hope that helps, David On Wed, Nov 2, 2011 at 12:44 PM, Steven Wilcoxon <stevew@pcann.com> wrote:> I''ve been thinking of doing a Wheezy install myself. How stable does it > feel to you? > > S.W. > > > On 11/2/2011 10:26 AM, David Della Vecchia wrote: > > I run a debian wheezy (testing) dom0 and it''s 3.0.1 kernel does not have > blktap(2) as you said however I did install the blktap dkms and was able to > get the kernel module installed and running yet still domU''s with blktap > devices would just hang on boot with no error messages ever. I even tried > recompiling the kernel and statically linking the blktap driver but it was > the same results as using it modularized. > > Sorry i can''t help but to confirm your issue. I was also unable to get > blktap working in centos6 with the 2.6 kernel. I use lvm-backed domU''s but > it would be nice to be able to store the swap or something locally with a > tap: instead of file: > > Thanks, > DDV > > On Wed, Nov 2, 2011 at 7:14 AM, João Paulo <jtpaulo@di.uminho.pt> wrote: > >> Hi guys, >> >> I am using blktap for implementing a custom disk device for XEN DomUs. I >> was using a previous version of Ubuntu that I need to upgrade to version >> 11.10. If i understood correctly, the blktap kernel module is not present >> in the mainline kernel 3.x. So my questions are: >> >> Can I get blktap/blktap2 working on ubuntu 11.10? If yes, can you point >> me the procedure? >> >> I saw that project Kronos is aiming at a blktap dkms module for >> debian/ubuntu http://blog.xen.org/index.php/2011/07/22/project-kronos/ . >> However, i tried it in a AMD64 bit distribution and the module was deployed >> correctly but blktap is still not working. >> >> Is there any other linux distro, or alternative better than Ubuntu 11.10 >> for my objectives? >> >> Finally, is there a better alternative for implementing custom I/O disk >> drivers for VMs instead of the blktap mechanism? I have not looked deeply >> to HVM-XEN and Qemu, would this solution be less painful? >> >> Thanks for your help, >> >> Kind Regards, >> >> João Paulo >> -----BEGIN PGP SIGNATURE----- >> >> iQEcBAEBAgAGBQJOsSYwAAoJEAY8eTZG4klmvLoIAJYn1YVD+a3ELsqcgM6EUa46 >> FORwKuXgOplz1iyXf354v7Qc1BJ9R0SJvNO6Ruf7XKqfiS+fx7SYkeN7GxvGsK9q >> lSjKKDvZwnKNxe4BPPQ6JWZaifjgLDLgArhBZdPN204D67Hs6GhGo9g2af0q8h7k >> ad/hkuiLkjroo2dDX908Y06WrCIArGTu6TDIezaV/CX4buKJrdb+HCBDezJRoxst >> KjIxbZCo7c+uyjDhgKItaO981LxSBXngomctMJZp26QAyW7JcaqQX2y3H++c6DJF >> ihlmy0DcRlKK3B7gV/HqZvLS4h04nP0Gm+CBWX7Hd7T2yhQqrxZGDm5gkviJtG8>> =22dU >> -----END PGP SIGNATURE----- >> >> _______________________________________________ >> Xen-users mailing list >> Xen-users@lists.xensource.com >> http://lists.xensource.com/xen-users >> > > > > _______________________________________________ > Xen-users mailing listXen-users@lists.xensource.comhttp://lists.xensource.com/xen-users > > >_______________________________________________ Xen-users mailing list Xen-users@lists.xensource.com http://lists.xensource.com/xen-users
Konrad Rzeszutek Wilk
2011-Nov-02 17:12 UTC
Re: [Xen-devel] Re: [Xen-users] Blktap in mainline kernel 3.x
On Wed, Nov 02, 2011 at 12:57:04PM -0400, David Della Vecchia wrote:> I''ve had it running for about a month now with no issues, i''ve got 35 beta > tester domU''s on the box and everything seems to be going swimmingly. > > A few things to keep in mind: > > For some reason the debian xen packages do not have pv-grub so you need to > acquire that elsewhere, it doesn''t need to be built on your system though, > i downloaded mine from a forum post somewhere (i used to download the xen > source and compile from scratch to get it). > This next one isn''t so much a dom0 problem as a domU one but for some > reason debian squeeze (stable) guests are not capable of saving and > restoring their state. On restore the console and/or network devices willThat is the 2.6.32 kernel? Yeah, there are couple of bug-fixes floating around for that. Ian might know exactly which ones.> be locked/frozen. I was able to get it to kinda work by custom compiling a > 3.0.4 kernel but even then it was not reliable; however the centos domU''s > are able to save/restore flawlessly. This was all on the wheezy dom0. > > The xen packages in debian, and this might be the default for xen4.1+ now, > expect you to setup your own bridge, the network-bridge line of the > xend-config.sxp will be commented out or just not there at all. I put it > back in, I let the script the handle the bridging since it works fine for > my needs; that and my attempts to manually create a bridge following the > xen instructions always fail for some reason. > > Stuff gets put into /usr/lib/xen-4.1 instead of /usr/lib/xen so i had to > update a lot of my scripts and config files when i switched to debian. > > Also as far as i can tell, wheezy uses the stock 3.0.0-1 kernel for xen so > no custom kernel required like in squeeze with its 2.6.32-5-xen (its my > understanding this is the pvops option?).<nods>> > As far as hvm guests go, as long as you use the hvmloader from the package > you''ll be fine, if you custom compile xen there''s a good chance your > hvmloader will be corrupted, it has something to do with the newer version > of gcc, though this may have been fixed in 4.1.2.Yeah, it was something about __main being placed in the wrong offset. I *hope* that has been fixed in 4.1.2. _______________________________________________ Xen-devel mailing list Xen-devel@lists.xensource.com http://lists.xensource.com/xen-devel
Ian Campbell
2011-Nov-08 10:41 UTC
Re: [Xen-devel] Re: [Xen-users] Blktap in mainline kernel 3.x
On Wed, 2011-11-02 at 17:12 +0000, Konrad Rzeszutek Wilk wrote:> On Wed, Nov 02, 2011 at 12:57:04PM -0400, David Della Vecchia wrote: > > I''ve had it running for about a month now with no issues, i''ve got 35 beta > > tester domU''s on the box and everything seems to be going swimmingly. > > > > A few things to keep in mind: > > > > For some reason the debian xen packages do not have pv-grub so you need to > > acquire that elsewhere, it doesn''t need to be built on your system though, > > i downloaded mine from a forum post somewhere (i used to download the xen > > source and compile from scratch to get it). > > This next one isn''t so much a dom0 problem as a domU one but for some > > reason debian squeeze (stable) guests are not capable of saving and > > restoring their state. On restore the console and/or network devices will > > > That is the 2.6.32 kernel? Yeah, there are couple of bug-fixes floating > around for that. Ian might know exactly which ones.Should be fixed in 2.6.32.47, I think.> > > > As far as hvm guests go, as long as you use the hvmloader from the package > > you''ll be fine, if you custom compile xen there''s a good chance your > > hvmloader will be corrupted, it has something to do with the newer version > > of gcc, though this may have been fixed in 4.1.2. > > Yeah, it was something about __main being placed in the wrong offset. > I *hope* that has been fixed in 4.1.2.Correct, 23104:1976adbf2b80 in xen-4.1-testing.hg is in 4.1.2. Ian. _______________________________________________ Xen-devel mailing list Xen-devel@lists.xensource.com http://lists.xensource.com/xen-devel