i'm having difficulty running KVM virtual machines off of a glusterFS volume
mounted using the glusterFS client. i am running centOS 6, 64-bit.
i am using virt-install to create my images but encountering the following
error:
qemu: could not open disk image /mnt/myreplicatestvolume/testvm.img: Invalid
argument
(see below for a more lengthy version of the error)
i have found an example of someone else having this issue as well but no
solution was offered (
http://gluster.org/pipermail/gluster-users/2011-February/006731.html). i
also found the following FAQ entry that states that NFS should be used to
store VM images (
http://www.gluster.org/faq/index.php?sid=36929&lang=en&action=artikel&cat=3&id=5&artlang=en
)
i would prefer to use the glusterFS client for the automatic fail-over that
it offers. is this possible?
i am creating the VM as follows:
sudo virt-install --name testvm --ram 4096 --os-type='linux'
--os-variant=rhel5.4 --disk path=/mnt/myreplicatestvolume/testvm.img,size=50
--network bridge:br0 --accelerate --vnc --mac=54:52:00:A1:B2:C3 --location
http://server/centos/5.4/os/x86_64/ -x
"ks=http://server/kscfg/testvm.cfg"
--uuid=00000000-0000-0000-0000-000000000001 --vcpus=4
full text of error:
Starting install...
Retrieving file
vmlinuz...
| 3.7 MB 00:00 ...
Retrieving file
initrd.img...
| 14 MB 00:00 ...
ERROR internal error process exited while connecting to monitor: char
device redirected to /dev/pts/5
qemu: could not open disk image /mnt/myreplicatestvolume/testvm.img: Invalid
argument
Domain installation does not appear to have been
successful. If it was, you can restart your domain
by running 'virsh start testvm'; otherwise, please
restart your installation.
ERROR internal error process exited while connecting to monitor: char
device redirected to /dev/pts/5
qemu: could not open disk image /mnt/myreplicatestvolume/testvm.img: Invalid
argument
Traceback (most recent call last):
File "/usr/bin/virt-install", line 1054, in <module>
main()
File "/usr/bin/virt-install", line 936, in main
start_time, guest.start_install)
File "/usr/bin/virt-install", line 978, in do_install
dom = install_func(conscb, progresscb, wait=(not wait))
File "/usr/lib/python2.6/site-packages/virtinst/Guest.py", line 973,
in
start_install
return self._do_install(consolecb, meter, removeOld, wait)
File "/usr/lib/python2.6/site-packages/virtinst/Guest.py", line
1038, in
_do_install
"install")
File "/usr/lib/python2.6/site-packages/virtinst/Guest.py", line
1009, in
_create_guest
dom = self.conn.createLinux(start_xml, 0)
File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1270, in
createLinux
if ret is None:raise libvirtError('virDomainCreateLinux() failed',
conn=self)
libvirtError: internal error process exited while connecting to monitor:
char device redirected to /dev/pts/5
qemu: could not open disk image /mnt/myreplicatestvolume/testvm.img: Invalid
argument
-------------- next part --------------
An HTML attachment was scrubbed...
URL:
<http://supercolony.gluster.org/pipermail/gluster-users/attachments/20110729/522ce841/attachment.html>
Whit Blauvelt
2011-Jul-29 23:33 UTC
[Gluster-users] issue with GlusterFS to store KVM guests
On Fri, Jul 29, 2011 at 03:22:23PM -0700, Eric wrote:> i would prefer to use the glusterFS client for the automatic fail-over that it > offers. is this possible?I've built KVM VMs with virt-install writing to img files via the Gluster client. My invocation of virt-install differed from yours in a number of ways, though. I'm not at all an expert on that. But you might try altering your recipe. There are specifications that will work. Reportedly there are improvements coming soon in Gluster that will make it more suitable to using as a backing store VMs - possibly more in terms of efficiency than possibility though, since it's certainly possible now. Whit
this worked, thank you! On Fri, Jul 29, 2011 at 3:47 PM, Michael <michael.auckland at gmail.com> wrote:> try to start kvm disk image with cache=writeback or writethrough. > if cache=none than will get this error. > > Runnig kvm on gluster 3.3beta1 on debian x64 sqeeze. so far so good. live > -migartion, failover works ok. > > On Sat, Jul 30, 2011 at 10:22 AM, Eric <campee at gmail.com> wrote: > >> i'm having difficulty running KVM virtual machines off of a glusterFS >> volume mounted using the glusterFS client. i am running centOS 6, 64-bit. >> >> i am using virt-install to create my images but encountering the following >> error: >> >> qemu: could not open disk image /mnt/myreplicatestvolume/testvm.img: >> Invalid argument >> (see below for a more lengthy version of the error) >> >> i have found an example of someone else having this issue as well but no >> solution was offered ( >> http://gluster.org/pipermail/gluster-users/2011-February/006731.html). i >> also found the following FAQ entry that states that NFS should be used to >> store VM images ( >> http://www.gluster.org/faq/index.php?sid=36929&lang=en&action=artikel&cat=3&id=5&artlang=en >> ) >> >> i would prefer to use the glusterFS client for the automatic fail-over >> that it offers. is this possible? >> >> i am creating the VM as follows: >> >> sudo virt-install --name testvm --ram 4096 --os-type='linux' >> --os-variant=rhel5.4 --disk path=/mnt/myreplicatestvolume/testvm.img,size=50 >> --network bridge:br0 --accelerate --vnc --mac=54:52:00:A1:B2:C3 --location >> http://server/centos/5.4/os/x86_64/ -x "ks=http://server/kscfg/testvm.cfg" >> --uuid=00000000-0000-0000-0000-000000000001 --vcpus=4 >> >> full text of error: >> >> Starting install... >> Retrieving file >> vmlinuz... >> | 3.7 MB 00:00 ... >> Retrieving file >> initrd.img... >> | 14 MB 00:00 ... >> ERROR internal error process exited while connecting to monitor: char >> device redirected to /dev/pts/5 >> qemu: could not open disk image /mnt/myreplicatestvolume/testvm.img: >> Invalid argument >> >> Domain installation does not appear to have been >> successful. If it was, you can restart your domain >> by running 'virsh start testvm'; otherwise, please >> restart your installation. >> ERROR internal error process exited while connecting to monitor: char >> device redirected to /dev/pts/5 >> qemu: could not open disk image /mnt/myreplicatestvolume/testvm.img: >> Invalid argument >> Traceback (most recent call last): >> File "/usr/bin/virt-install", line 1054, in <module> >> main() >> File "/usr/bin/virt-install", line 936, in main >> start_time, guest.start_install) >> File "/usr/bin/virt-install", line 978, in do_install >> dom = install_func(conscb, progresscb, wait=(not wait)) >> File "/usr/lib/python2.6/site-packages/virtinst/Guest.py", line 973, in >> start_install >> return self._do_install(consolecb, meter, removeOld, wait) >> File "/usr/lib/python2.6/site-packages/virtinst/Guest.py", line 1038, in >> _do_install >> "install") >> File "/usr/lib/python2.6/site-packages/virtinst/Guest.py", line 1009, in >> _create_guest >> dom = self.conn.createLinux(start_xml, 0) >> File "/usr/lib64/python2.6/site-packages/libvirt.py", line 1270, in >> createLinux >> if ret is None:raise libvirtError('virDomainCreateLinux() failed', >> conn=self) >> libvirtError: internal error process exited while connecting to monitor: >> char device redirected to /dev/pts/5 >> qemu: could not open disk image /mnt/myreplicatestvolume/testvm.img: >> Invalid argument >> >> >> _______________________________________________ >> Gluster-users mailing list >> Gluster-users at gluster.org >> http://gluster.org/cgi-bin/mailman/listinfo/gluster-users >> >> > > > -- > -- > Michael >-------------- next part -------------- An HTML attachment was scrubbed... URL: <http://supercolony.gluster.org/pipermail/gluster-users/attachments/20110729/79412242/attachment.html>
Anand Avati
2011-Jul-30 11:03 UTC
[Gluster-users] issue with GlusterFS to store KVM guests
On Sat, Jul 30, 2011 at 3:52 AM, Eric <campee at gmail.com> wrote:> i'm having difficulty running KVM virtual machines off of a glusterFS > volume mounted using the glusterFS client. i am running centOS 6, 64-bit. > > i am using virt-install to create my images but encountering the following > error: > > qemu: could not open disk image /mnt/myreplicatestvolume/testvm.img: > Invalid argument > (see below for a more lengthy version of the error) > >Looks like your VM image is being attempted to open with O_DIRECT flag which is not supported in FUSE at the moment. You may try to configure your libvirt/qemu settings to open the VM without O_DIRECT. If not you may find https://github.com/avati/liboindirect useful. Avati -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://supercolony.gluster.org/pipermail/gluster-users/attachments/20110730/f5bd5aba/attachment.html>