search for: refcount_bit

Hi All I was reading through this: http://kashyapc.com/2011/12/02/little-more-disk-io-perf-improvement-with-fallocateing-a-qcow2-disk/ I was basically searching for pointers on improving disk I/O. I wanted to know the purpose of preallocation=full & preallocation=metadata , What is the difference between them ? and which one would yield a better disk I/O speed ? Appreciate your

...tes qcow2 metadata, and it's still a sparse image. $ qemu-img create -f qcow2 -o preallocation=metadata test1-metadata.qcow2 1G Formatting 'test1-metadata.qcow2', fmt=qcow2 size=1073741824 encryption=off cluster_size=65536 preallocation='metadata' lazy_refcounts=off refcount_bits=16 328K -rw-r--r--. 1 root root 1.1G Jun 3 03:20 copy-test1-metadata.qcow2 (2) 'preallocation=full': allocates zeroes and makes a non-sparse image. $ qemu-img create -f qcow2 -o preallocation=full test2-full.qcow2 1G Formatting 'test2-full.qcow2', fmt=qcow2 size=1073...

...release 7.6.1810 (Core) with libvirt-4.5.0-10.el7_6.4.x86_64 Please let me know if I am missing something. Thanks. # create base file [root@singularity images]# qemu-img create base.qcow2 8G -f qcow2 Formatting 'base.qcow2', fmt=qcow2 size=8589934592 cluster_size=65536 lazy_refcounts=off refcount_bits=16 [root@singularity images]# qemu-img info base.qcow2 image: base.qcow2 file format: qcow2 virtual size: 8.0G (8589934592 bytes) disk size: 17K cluster_size: 65536 Format specific information: compat: 1.1 lazy refcounts: false refcount bits: 16 corrupt: false # create overlay...

2017-11-15 23:55 GMT+01:00 Max Reitz <mreitz@redhat.com>: > https://xanclic.moe/convert-xva.rb -- does this work? > (It seems to works on the two example images I found...) > > An example is in the code, you use it like this: > > $ ./convert-xva.rb ~/Downloads/stats-appliance-2.36.020502.xva Ref:73 It doesn't work on huge images: # time convert-xva.rb

...ibguestfs9gclsg/overlay1.qcow2 Formatting '/root/libguestfs/tmp/libguestfs9gclsg/overlay1.qcow2', fmt=qcow2 size=8589934592 backing_file=rbd:images/CentOS-7-x86_64-GenericCloud-1901:mon_host=[fd00\:\:cefc\:1]\:6789:auth_supported=none backing_fmt=raw cluster_size=65536 lazy_refcounts=off refcount_bits=16 libguestfs: trace: disk_create = 0 libguestfs: trace: add_drive = 0 Welcome to guestfish, the guest filesystem shell for editing virtual machine filesystems and disk images. Type: ‘help’ for help on commands       ‘man’ to read the manual       ‘quit’ to quit the shell ><fs> quit...

...terd/TVE/wer.qcow2,backing_fmt=qcow2 libguestfs: command: run: \ /tmp/libguestfsUIZbDK/overlay1.qcow2 Formatting '/tmp/libguestfsUIZbDK/overlay1.qcow2', fmt=qcow2 size=107374182400 backing_file=/home/peterd/TVE/wer.qcow2 backing_fmt=qcow2 encryption=off cluster_size=65536 lazy_refcounts=off refcount_bits=16 libguestfs: error: command: waitpid: No child processes libguestfs: error: qemu-img: /tmp/libguestfsUIZbDK/overlay1.qcow2: qemu-img exited for an unknown reason (status -1), see debug messages above libguestfs: trace: disk_create = -1 (error) libguestfs: trace: add_drive = -1 (error) libguestfs...

Hello, I am curious why when using virt-sparsify the apparent-size of the file gets reduced to the actual file size? Is there a way to get the apparent-size left as the full size? In the man page for virt-sparsify it has a section on "IMPORTANT NOTE ABOUT SPARSE OUTPUT IMAGES" and its output seems to indicate what I would expect where "ls -lh" shows the full apparent size

Hello, I am curious why when using virt-sparsify the apparent-size of the file gets reduced to the actual file size? Is there a way to get the apparent-size left as the full size? In the man page for virt-sparsify it has a section on "IMPORTANT NOTE ABOUT SPARSE OUTPUT IMAGES" and its output seems to indicate what I would expect where "ls -lh" shows the full apparent size

...it like this: $ ./convert-xva-online.rb ~/Downloads/stats-appliance-2.36.020502.xva Ref:73 81936 M $ qemu-img create -f qcow2 [whatever options you need] disk1.qcow2 \ 81936M Formatting 'disk1.qcow2', fmt=qcow2 size=85916123136 encryption=off cluster_size=65536 lazy_refcounts=off refcount_bits=16 $ ./convert-xva-online.rb ~/Downloads/stats-appliance-2.36.020502.xva \ Ref:73 \ '{"driver":"qcow2", "detect-zeroes":"unmap", "discard":"unmap", "file":{"driver":"file","...

...e code to encryption so I decided to try it out. While attempting to create an image: # qemu-img create -f qcow2 gluster://gluster01/virt0/testing.img 30G Formatting 'gluster://dalpinfglt01/virt0/testing.img', fmt=qcow2 size=32212254720 encryption=off cluster_size=65536 lazy_refcounts=off refcount_bits=16 [2017-06-02 18:30:37.489831] E [mem-pool.c:579:mem_put] (-->/lib64/libglusterfs.so.0(syncop_lookup+0x4e5) [0x7f2abbe66d35] -->/lib64/libglusterfs.so.0(+0x59f02) [0x7f2abbe62f02] -->/lib64/libglusterfs.so.0(mem_put+0x190) [0x7f2abbe54a60] ) 0-mem-pool: mem-pool ptr is NULL [2017-06-02 1...

...acking_fmt=qcow2 > libguestfs: command: run: \ /tmp/libguestfsUIZbDK/overlay1.qcow2 > Formatting '/tmp/libguestfsUIZbDK/overlay1.qcow2', fmt=qcow2 > size=107374182400 backing_file=/home/peterd/TVE/wer.qcow2 backing_fmt=qcow2 > encryption=off cluster_size=65536 lazy_refcounts=off refcount_bits=16 > libguestfs: error: command: waitpid: No child processes > libguestfs: error: qemu-img: /tmp/libguestfsUIZbDK/overlay1.qcow2: qemu-img > exited for an unknown reason (status -1), see debug messages above Obviously waitpid(2) is failing with ECHILD here: https://github.com/libguestfs...

...erything is working as it should. For qcow2 files, the virtual size is not related to the "apparent" size, as you can easily prove: $ qemu-img create -f qcow2 huge.qcow2 1T Formatting 'huge.qcow2', fmt=qcow2 size=1099511627776 encryption=off cluster_size=65536 lazy_refcounts=off refcount_bits=16 $ ls -lh huge.qcow2 -rw-r--r--. 1 rjones rjones 208K Jun 17 09:09 huge.qcow2 If you use raw files, then the file apparent size and virtual size are the same. Rich. -- Richard Jones, Virtualization Group, Red Hat http://people.redhat.com/~rjones Read my programming and virtualization blog: h...

...erything is working as it should. For qcow2 files, the virtual size is not related to the "apparent" size, as you can easily prove: $ qemu-img create -f qcow2 huge.qcow2 1T Formatting 'huge.qcow2', fmt=qcow2 size=1099511627776 encryption=off cluster_size=65536 lazy_refcounts=off refcount_bits=16 $ ls -lh huge.qcow2 -rw-r--r--. 1 rjones rjones 208K Jun 17 09:09 huge.qcow2 If you use raw files, then the file apparent size and virtual size are the same. Rich. -- Richard Jones, Virtualization Group, Red Hat http://people.redhat.com/~rjones Read my programming and virtualization blog: h...

...gt; > For qcow2 files, the virtual size is not related to the "apparent" > size, as you can easily prove: > > $ qemu-img create -f qcow2 huge.qcow2 1T > Formatting 'huge.qcow2', fmt=qcow2 size=1099511627776 encryption=off > cluster_size=65536 lazy_refcounts=off refcount_bits=16 $ ls -lh > huge.qcow2 -rw-r--r--. 1 rjones rjones 208K Jun 17 09:09 huge.qcow2 > > If you use raw files, then the file apparent size and virtual size are > the same. > > Rich. >

...; libguestfs: command: run: \ /tmp/libguestfsUIZbDK/overlay1.qcow2 > > Formatting '/tmp/libguestfsUIZbDK/overlay1.qcow2', fmt=qcow2 > > size=107374182400 backing_file=/home/peterd/TVE/wer.qcow2 > backing_fmt=qcow2 > > encryption=off cluster_size=65536 lazy_refcounts=off refcount_bits=16 > > libguestfs: error: command: waitpid: No child processes > > libguestfs: error: qemu-img: /tmp/libguestfsUIZbDK/overlay1.qcow2: > qemu-img > > exited for an unknown reason (status -1), see debug messages above > > Obviously waitpid(2) is failing with ECHILD here: &...

I believe the bug lies in libguestfs. Taking out the commands being sent to QEMU and using qemu-img info I can recreate the error: # qemu-img info "rbd:images/CentOS-7-x86_64-GenericCloud-1901:mon_host=[fd00::cefc:1]\:6789:auth_supported=none" qemu-img: Could not open 'rbd:images/CentOS-7-x86_64-GenericCloud-1901:mon_host=[fd00::cefc:1]\:6789:auth_supported=none': invalid

...0-0000-0000-602200000000.vhdx libguestfs: command: run: \ /tmp/libguestfsOz0P6y/overlay1.qcow2 Formatting '/tmp/libguestfsOz0P6y/overlay1.qcow2', fmt=qcow2 size=142622064640 backing_file=/home/a17kilzi/Documents/8be29c38-0000-0000-0000-602200000000.vhdx cluster_size=65536 lazy_refcounts=off refcount_bits=16 libguestfs: trace: disk_create = 0 libguestfs: trace: add_drive = 0 libguestfs: trace: launch libguestfs: trace: version libguestfs: trace: version = <struct guestfs_version = major: 1, minor: 36, release: 13, extra: , > libguestfs: trace: get_backend libguestfs: trace: get_backend = &quo...

..._file=/home/zt/centos7_mini.qcow2,backing_fmt=qcow2 libguestfs: command: run: \ /tmp/libguestfso7dtGK/overlay1.qcow2 Formatting '/tmp/libguestfso7dtGK/overlay1.qcow2', fmt=qcow2 size=17179869184 backing_file=/home/zt/centos7_mini.qcow2 backing_fmt=qcow2 cluster_size=65536 lazy_refcounts=off refcount_bits=16 libguestfs: trace: disk_create = 0 libguestfs: trace: get_backend_setting "internal_libvirt_imagelabel" libguestfs: trace: get_backend_setting = NULL (error) libguestfs: trace: add_drive = 0 libguestfs: trace: launch libguestfs: trace: max_disks libguestfs: trace: max_disks = 255 libg...

Hello, I have a simple C program that uses libguestfs to extract info about disk usage from a libvirt domain. It works when ran manually as root, but fails when started as a systemd service. I'm attaching the service file, source code and verbose logs from both the successful manual run and from the service journal. SELinix is disabled. Error messages: libguestfs:

...guestfs-0/appliance.d/root,backing_fmt=raw libguestfs: command: run: \ /tmp/libguestfsu6lY8x/overlay1 Formatting '/tmp/libguestfsu6lY8x/overlay1', fmt=qcow2 size=4294967296 backing_file=/var/tmp/.guestfs-0/appliance.d/root backing_fmt=raw encryption=off cluster_size=65536 lazy_refcounts=off refcount_bits=16 libguestfs: trace: v2v: disk_create = 0 libguestfs: trace: v2v: get_sockdir libguestfs: trace: v2v: get_sockdir = "/tmp" libguestfs: set_socket_create_context: getcon failed: (none): Invalid argument [you can ignore this message if you are not using SELinux + sVirt] libguestfs: clear_...