search for: durgin

On Jun 7, 2013, at 5:01 PM, Josh Durgin <josh.durgin@inktank.com> wrote: > On 06/07/2013 02:41 PM, John Nielsen wrote: >> I am running some qemu-kvm virtual machines via libvirt using Ceph RBD as the back-end storage. Today I was testing an update to libvirt-1.0.6 on one of my hosts and discovered that it includes this ch...

On 06/07/2013 04:18 PM, John Nielsen wrote: > On Jun 7, 2013, at 5:01 PM, Josh Durgin <josh.durgin@inktank.com> wrote: > >> On 06/07/2013 02:41 PM, John Nielsen wrote: >>> I am running some qemu-kvm virtual machines via libvirt using Ceph RBD as the back-end storage. Today I was testing an update to libvirt-1.0.6 on one of my hosts and discovered that it incl...

Hello, I would like to use RBD Format 2 images so I can take advantage of layering. However, when I use "qemu-img create -f rbd rbd:data/foo 10G", I get format 1 RBD images. (Actually, when I use the "-f rbd" flag, qemu-img core dumps, but it looks like that feature may have been deprecated [1]) Is there any way to have qemu-img create RBD Format 2 images or am I better off

I am running some qemu-kvm virtual machines via libvirt using Ceph RBD as the back-end storage. Today I was testing an update to libvirt-1.0.6 on one of my hosts and discovered that it includes this change: [libvirt] [PATCH] Forbid use of ':' in RBD pool names ...People are known to be abusing the lack of escaping in current libvirt to pass arbitrary args to QEMU. I am one of those

Hi, I'm trying to figure out what controls the number if in-flight virtio block operations when running linux in qemu on top of a linux host. The problem is that we're trying to run as many VMs as possible, using ceph/rbd for the rootfs. We've tripped over the fact the the memory consumption of qemu can spike noticeably when doing I/O (something as simple as "dd" from

Hi, I'm trying to figure out what controls the number if in-flight virtio block operations when running linux in qemu on top of a linux host. The problem is that we're trying to run as many VMs as possible, using ceph/rbd for the rootfs. We've tripped over the fact the the memory consumption of qemu can spike noticeably when doing I/O (something as simple as "dd" from

...th more knowledge of how virtio block works point me in the > right direction? You can use QEMU's I/O throttling as a workaround: qemu -drive ...,iops=64 libvirt has XML syntax for specifying iops limits. Please see <iotune> at http://libvirt.org/formatdomain.html. I have CCed Josh Durgin and Jeff Cody for ideas on reducing block/rbd.c memory consumption. Is it possible to pass a scatter-gather list so I/O can be performed directly on guest memory? This would also improve performance slightly. Stefan

.... What I'd like to see (and may take a stab at implementing) is a cap on either inflight bytes or inflight IOPS. One complication is that this requires hooking into the completion path to update the stats (and possibly unblock the I/O code) when an operation is done. > I have CCed Josh Durgin and Jeff Cody for ideas on reducing > block/rbd.c memory consumption. Is it possible to pass a > scatter-gather list so I/O can be performed directly on guest memory? > This would also improve performance slightly. It's not just rbd. I've seen qemu RSS jump by 110MB when accessi...

.... What I'd like to see (and may take a stab at implementing) is a cap on either inflight bytes or inflight IOPS. One complication is that this requires hooking into the completion path to update the stats (and possibly unblock the I/O code) when an operation is done. > I have CCed Josh Durgin and Jeff Cody for ideas on reducing > block/rbd.c memory consumption. Is it possible to pass a > scatter-gather list so I/O can be performed directly on guest memory? > This would also improve performance slightly. It's not just rbd. I've seen qemu RSS jump by 110MB when accessi...

...linux.vnet.ibm.com> Jia Liu <proljc@gmail.com> Jia Liu <proljc@gmail.com> (for openrisc) Jim Meyering <meyering@redhat.com> John Rigby <john.rigby@linaro.org> John Spencer <maillist-qemu@barfooze.de> Jordan Justen <jordan.l.justen@intel.com> Josh Durgin <josh.durgin@inktank.com> Juan Quintela <quintela@redhat.com> Julien Grall <julien.grall@citrix.com> Julio Guerra <guerr@julio.in> Ján Tomko <jtomko@redhat.com> Jürg Billeter <j@bitron.ch> Kazuya Saito <saito.kazuya@jp.fujitsu.com> Keith Busch...

...linux.vnet.ibm.com> Jia Liu <proljc@gmail.com> Jia Liu <proljc@gmail.com> (for openrisc) Jim Meyering <meyering@redhat.com> John Rigby <john.rigby@linaro.org> John Spencer <maillist-qemu@barfooze.de> Jordan Justen <jordan.l.justen@intel.com> Josh Durgin <josh.durgin@inktank.com> Juan Quintela <quintela@redhat.com> Julien Grall <julien.grall@citrix.com> Julio Guerra <guerr@julio.in> Ján Tomko <jtomko@redhat.com> Jürg Billeter <j@bitron.ch> Kazuya Saito <saito.kazuya@jp.fujitsu.com> Keith Busch...

...linux.vnet.ibm.com> Jia Liu <proljc@gmail.com> Jia Liu <proljc@gmail.com> (for openrisc) Jim Meyering <meyering@redhat.com> John Rigby <john.rigby@linaro.org> John Spencer <maillist-qemu@barfooze.de> Jordan Justen <jordan.l.justen@intel.com> Josh Durgin <josh.durgin@inktank.com> Juan Quintela <quintela@redhat.com> Julien Grall <julien.grall@citrix.com> Julio Guerra <guerr@julio.in> Ján Tomko <jtomko@redhat.com> Jürg Billeter <j@bitron.ch> Kazuya Saito <saito.kazuya@jp.fujitsu.com> Keith Busch...

Hi, I've recently been working on setting up a set of libvirt compute nodes that will be using a ceph rbd pool for storing vm disk image files. I've got a couple of issues I've run into. First, per the standard ceph documentation examples [1], the way to add a disk is to create a block in the VM definition XML that looks something like this: <disk type='network'

After running ceph on XFS for some time, I decided to try btrfs again. Performance with the current "for-linux-min" branch and big metadata is much better. The only problem (?) I''m still seeing is a warning that seems to occur from time to time: [87703.784552] ------------[ cut here ]------------ [87703.789759] WARNING: at fs/btrfs/inode.c:2103

I'm having some trouble creating KVM domains with RBD block devices using virsh. I've managed to get virsh to define the domain, but it gives an error when trying to start the domain: error: Failed to start domain test0 error: internal error process exited while connecting to monitor: char device redirected to /dev/pts/3 kvm: -drive

...Joseph Yasi <joe.yasi@gmail.com> Josh <joshua.taylor0@gmail.com> Josh Boyer <jwboyer@gmail.com> Josh Boyer <jwboyer@redhat.com> Josh Cartwright <josh.cartwright@ni.com> Josh Cartwright <joshc@linux.com> Josh Coombs <josh.coombs@gmail.com> Josh Durgin <josh.durgin@dreamhost.com> Josh Durgin <josh.durgin@inktank.com> Josh Hay <joshua.a.hay@intel.com> Josh Hunt <johunt@akamai.com> Josh Radel <jradel@gmail.com> Josh Stone <jistone@redhat.com> Josh Taylor <joshua.taylor0@gmail.com> Josh Triplet...

...Joseph Yasi <joe.yasi@gmail.com> Josh <joshua.taylor0@gmail.com> Josh Boyer <jwboyer@gmail.com> Josh Boyer <jwboyer@redhat.com> Josh Cartwright <josh.cartwright@ni.com> Josh Cartwright <joshc@linux.com> Josh Coombs <josh.coombs@gmail.com> Josh Durgin <josh.durgin@dreamhost.com> Josh Durgin <josh.durgin@inktank.com> Josh Hay <joshua.a.hay@intel.com> Josh Hunt <johunt@akamai.com> Josh Radel <jradel@gmail.com> Josh Stone <jistone@redhat.com> Josh Taylor <joshua.taylor0@gmail.com> Josh Triplet...

...Joseph Yasi <joe.yasi@gmail.com> Josh <joshua.taylor0@gmail.com> Josh Boyer <jwboyer@gmail.com> Josh Boyer <jwboyer@redhat.com> Josh Cartwright <josh.cartwright@ni.com> Josh Cartwright <joshc@linux.com> Josh Coombs <josh.coombs@gmail.com> Josh Durgin <josh.durgin@dreamhost.com> Josh Durgin <josh.durgin@inktank.com> Josh Hay <joshua.a.hay@intel.com> Josh Hunt <johunt@akamai.com> Josh Radel <jradel@gmail.com> Josh Stone <jistone@redhat.com> Josh Taylor <joshua.taylor0@gmail.com> Josh Triplet...

...Joseph Yasi <joe.yasi@gmail.com> Josh <joshua.taylor0@gmail.com> Josh Boyer <jwboyer@gmail.com> Josh Boyer <jwboyer@redhat.com> Josh Cartwright <josh.cartwright@ni.com> Josh Cartwright <joshc@linux.com> Josh Coombs <josh.coombs@gmail.com> Josh Durgin <josh.durgin@dreamhost.com> Josh Durgin <josh.durgin@inktank.com> Josh Hay <joshua.a.hay@intel.com> Josh Hunt <johunt@akamai.com> Josh Radel <jradel@gmail.com> Josh Stone <jistone@redhat.com> Josh Taylor <joshua.taylor0@gmail.com> Josh Triplet...

...Joseph Yasi <joe.yasi@gmail.com> Josh <joshua.taylor0@gmail.com> Josh Boyer <jwboyer@gmail.com> Josh Boyer <jwboyer@redhat.com> Josh Cartwright <josh.cartwright@ni.com> Josh Cartwright <joshc@linux.com> Josh Coombs <josh.coombs@gmail.com> Josh Durgin <josh.durgin@dreamhost.com> Josh Durgin <josh.durgin@inktank.com> Josh Hay <joshua.a.hay@intel.com> Josh Hunt <johunt@akamai.com> Josh Radel <jradel@gmail.com> Josh Stone <jistone@redhat.com> Josh Taylor <joshua.taylor0@gmail.com> Josh Triplet...