Libguestfs - Sep 2014 - Re: CoreOS support

Unfortunately this is a prebuilt proxmox server which is running on debian
wheezy and I cannot even install the latest version of libguesfs because of
this.
On Sep 9, 2014, at 10:18 PM, Richard W.M. Jones <rjones@redhat.com> wrote:
> On Tue, Sep 09, 2014 at 08:22:37PM +0300, Keresztes Péter-Zoltán wrote:
> [...]
> 
> The btrfs driver in your kernel is unable to mount one of the
> filesystems in the CoreOS disk image.  This is not particularly
> surprising because you're running a relatively ancient kernel (2.6.32),
> and btrfs always needs the latest kernel it can get.
> 
> You need to use a newer kernel.
> 
> The error is below:
> 
>> mount -o ro /dev/sda9 /sysroot/
>> [    7.591226] TECH PREVIEW: btrfs may not be fully supported.
>> [    7.591229] Please review provided documentation for limitations.
>> [    7.599995] Tainting kernel with flag 0x1d
>> [    7.603207] Pid: 299, comm: modprobe veid: 0 Not tainted
2.6.32-30-pve #1
>> [    7.608315] Call Trace:
>> [    7.610274]  [<ffffffff81072bd9>] ? add_taint+0x69/0x70
>> [    7.614307]  [<ffffffff810a8231>] ?
mark_tech_preview+0x71/0xa0
>> [    7.618818]  [<ffffffffa028f014>] ? init_btrfs_fs+0x14/0xb8
[btrfs]
>> [    7.623787]  [<ffffffff8100204c>] ? do_one_initcall+0x3c/0x1d0
>> [    7.628341]  [<ffffffff810cbab6>] ? sys_init_module+0xd6/0x260
>> [    7.632789]  [<ffffffff8100b182>] ?
system_call_fastpath+0x16/0x1b
>> [    7.638362] Btrfs loaded
>> [    7.641010] device label ROOT devid 1 transid 80 /dev/sda9
>> [    7.646645] btrfs: disk space caching is enabled
>> [    7.650293] BTRFS: couldn't mount because of unsupported
optional features (40).
>> [    7.656337] btrfs: open_ctree failed
>> [    7.659225] ------------[ cut here ]------------
>> [    7.662786] WARNING: at fs/super.c:1219 vfs_kern_mount+0x168/0x180()
(Tainted: G           ---------------  T)
>> [    7.670396] Hardware name: Bochs
>> [    7.672928] Modules linked in: btrfs(T) lzo_compress lzo_decompress
zlib_deflate vfat fat snd_pcsp snd_pcm snd_page_alloc snd_timer snd soundcore
i2c_piix4 i2c_core ext2 ext4 jbd2 virtio_balloon virtio_pci virtio_net
virtio_scsi virtio_blk virtio_console virtio_rng virtio_ring virtio sym53c8xx
scsi_transport_spi ata_piix mbcache crc7 crc_ccitt crc_itu_t
>> [    7.696412] Pid: 297, comm: mount veid: 0 Tainted: G          
---------------  T 2.6.32-30-pve #1
>> [    7.701398] Call Trace:
>> [    7.702810]  [<ffffffff81072d27>] ?
warn_slowpath_common+0x87/0xe0
>> [    7.706304]  [<ffffffff81072d9a>] ?
warn_slowpath_null+0x1a/0x20
>> [    7.709662]  [<ffffffff811a85b8>] ? vfs_kern_mount+0x168/0x180
>> [    7.713087]  [<ffffffff811a8644>] ? do_kern_mount+0x54/0x120
>> [    7.716256]  [<ffffffff811cb928>] ? do_mount+0x3e8/0xb00
>> [    7.719226]  [<ffffffff811564eb>] ? strndup_user+0x4b/0xb0
>> [    7.722237]  [<ffffffff81156501>] ? strndup_user+0x61/0xb0
>> [    7.725305]  [<ffffffff811cc0ce>] ? sys_mount+0x8e/0xe0
>> [    7.728296]  [<ffffffff8100b182>] ?
system_call_fastpath+0x16/0x1b
>> [    7.731679] ---[ end trace e290bd6f960f7e2c ]---
>> [    7.734312] Tainting kernel with flag 0x9
>> [    7.736602] Pid: 297, comm: mount veid: 0 Tainted: G          
---------------  T 2.6.32-30-pve #1
>> [    7.741634] Call Trace:
>> [    7.743097]  [<ffffffff81072bd9>] ? add_taint+0x69/0x70
>> [    7.746039]  [<ffffffff81072d49>] ?
warn_slowpath_common+0xa9/0xe0
>> [    7.749514]  [<ffffffff81072d9a>] ?
warn_slowpath_null+0x1a/0x20
>> [    7.752894]  [<ffffffff811a85b8>] ? vfs_kern_mount+0x168/0x180
>> [    7.756186]  [<ffffffff811a8644>] ? do_kern_mount+0x54/0x120
>> [    7.759292]  [<ffffffff811cb928>] ? do_mount+0x3e8/0xb00
>> [    7.762249]  [<ffffffff811564eb>] ? strndup_user+0x4b/0xb0
>> [    7.765346]  [<ffffffff81156501>] ? strndup_user+0x61/0xb0
>> [    7.768388]  [<ffffffff811cc0ce>] ? sys_mount+0x8e/0xe0
>> [    7.771317]  [<ffffffff8100b182>] ?
system_call_fastpath+0x16/0x1b
>> [    7.774816] BUG: unable to handle kernel paging request at
fffffffffffffffa
>> [    7.775735] IP: [<ffffffff811c9f3d>]
do_add_mount_unlocked+0x5d/0xe0
>> [    7.775735] PGD 1a87067 PUD 1a88067 PMD 0 
>> [    7.775735] Oops: 0000 [#1] SMP 
>> [    7.775735] last sysfs file: /sys/devices/virtual/bdi/btrfs-1/uevent
>> [    7.775735] CPU 0 
>> [    7.775735] Modules linked in: btrfs(T) lzo_compress lzo_decompress
zlib_deflate vfat fat snd_pcsp snd_pcm snd_page_alloc snd_timer snd soundcore
i2c_piix4 i2c_core ext2 ext4 jbd2 virtio_balloon virtio_pci virtio_net
virtio_scsi virtio_blk virtio_console virtio_rng virtio_ring virtio sym53c8xx
scsi_transport_spi ata_piix mbcache crc7 crc_ccitt crc_itu_t
>> [    7.775735] 
>> [    7.775735] Pid: 297, comm: mount veid: 0 Tainted: G        W 
---------------  T 2.6.32-30-pve #1 042stab090_5 Bochs Bochs
>> [    7.775735] RIP: 0010:[<ffffffff811c9f3d>] 
[<ffffffff811c9f3d>] do_add_mount_unlocked+0x5d/0xe0
>> [    7.775735] RSP: 0018:ffff88001ce67e58  EFLAGS: 00010206
>> [    7.775735] RAX: ffffffffffffffea RBX: ffff88001ce67eb8 RCX:
ffff88001ed08ac0
>> [    7.775735] RDX: ffff88001e7df600 RSI: ffffffff81aa6fa0 RDI:
ffff88001daa5898
>> [    7.775735] RBP: ffff88001ce67e78 R08: ffff88001ce66000 R09:
ffffffff81e661c0
>> [    7.775735] R10: 0000000000000000 R11: ffff88001ec2d810 R12:
ffff88001e7df500
>> [    7.775735] R13: 0000000000000060 R14: 0000000000000001 R15:
0000000000000001
>> [    7.775735] FS:  00007f8d9e47a7e0(0000) GS:ffff880002600000(0000)
knlGS:0000000000000000
>> [    7.775735] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
>> [    7.775735] CR2: fffffffffffffffa CR3: 000000001d4a9000 CR4:
00000000000006f0
>> [    7.775735] DR0: 0000000000000000 DR1: 0000000000000000 DR2:
0000000000000000
>> [    7.775735] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7:
0000000000000400
>> [    7.775735] Process mount (pid: 297, veid: 0, threadinfo
ffff88001ce66000, task ffff88001e682f70)
>> [    7.775735] Stack:
>> [    7.775735]  ffff88001ce67e78 ffff88001e7df500 0000000000000060
0000000000000000
>> [    7.775735] <d> ffff88001ce67f18 ffffffff811cb95b
ffff88001ce67eb8 ffffffff811564eb
>> [    7.775735] <d> 0000000000000001 ffff88001ddedc00
000000000000000a 0000000000001000
>> [    7.775735] Call Trace:
>> [    7.775735]  [<ffffffff811cb95b>] do_mount+0x41b/0xb00
>> [    7.775735]  [<ffffffff811564eb>] ? strndup_user+0x4b/0xb0
>> [    7.775735]  [<ffffffff81156501>] ? strndup_user+0x61/0xb0
>> [    7.775735]  [<ffffffff811cc0ce>] sys_mount+0x8e/0xe0
>> [    7.775735]  [<ffffffff8100b182>]
system_call_fastpath+0x16/0x1b
>> [    7.775735] Code: 4f 48 8b 13 41 f7 c5 00 01 00 01 48 8b 8a c0 00 00
00 74 4a 48 85 c9 0f 84 81 00 00 00 41 f7 c5 00 00 00 01 74 58 49 8b 44 24 20
<48> 8b 40 10 0f b7 80 ae 00 00 00 66 25 00 f0 66 3d 00 a0 74 5e
>> [    7.775735] RIP  [<ffffffff811c9f3d>]
do_add_mount_unlocked+0x5d/0xe0
>> [    7.775735]  RSP <ffff88001ce67e58>
>> [    7.775735] CR2: fffffffffffffffa
>> [    7.775735] Tainting kernel with flag 0x7
>> [    7.775735] Pid: 297, comm: mount veid: 0 Tainted: G        W 
---------------  T 2.6.32-30-pve #1
>> [    7.775735] Call Trace:
>> [    7.775735]  [<ffffffff81072bd9>] ? add_taint+0x69/0x70
>> [    7.775735]  [<ffffffff8155c443>] ? oops_end+0x53/0xf0
>> [    7.775735]  [<ffffffff8154f0c7>] ? no_context+0x1eb/0x216
>> [    7.775735]  [<ffffffff810cc22e>] ?
is_module_text_address+0xe/0x20
>> [    7.775735]  [<ffffffff8154f260>] ?
__bad_area_nosemaphore+0x16e/0x18d
>> [    7.775735]  [<ffffffff8154f292>] ?
bad_area_nosemaphore+0x13/0x15
>> [    7.775735]  [<ffffffff81047bee>] ?
__do_page_fault+0x2fe/0x490
>> [    7.775735]  [<ffffffff81056d03>] ?
perf_event_task_sched_out+0x33/0x70
>> [    7.775735]  [<ffffffff810522cf>] ? __dequeue_entity+0x2f/0x50
>> [    7.775735]  [<ffffffff810097ef>] ? __switch_to+0x1df/0x2f0
>> [    7.775735]  [<ffffffff8155e3cb>] ? do_page_fault+0x3b/0xa0
>> [    7.775735]  [<ffffffff8155b7e5>] ? page_fault+0x25/0x30
>> [    7.775735]  [<ffffffff811c9f3d>] ?
do_add_mount_unlocked+0x5d/0xe0
>> [    7.775735]  [<ffffffff811c9f0f>] ?
do_add_mount_unlocked+0x2f/0xe0
>> [    7.775735]  [<ffffffff811cb95b>] ? do_mount+0x41b/0xb00
>> [    7.775735]  [<ffffffff811564eb>] ? strndup_user+0x4b/0xb0
>> [    7.775735]  [<ffffffff81156501>] ? strndup_user+0x61/0xb0
>> [    7.775735]  [<ffffffff811cc0ce>] ? sys_mount+0x8e/0xe0
>> [    7.775735]  [<ffffffff8100b182>] ?
system_call_fastpath+0x16/0x1b
>> [    7.775735] ---[ end trace e290bd6f960f7e2d ]---
>> [    7.775735] Kernel panic - not syncing: Fatal exception
>> [    7.775735] Pid: 297, comm: mount veid: 0 Tainted: G      D W 
---------------  T 2.6.32-30-pve #1
>> [    7.775735] Call Trace:
>> [    7.775735]  [<ffffffff8154f744>] ? panic+0xa7/0x167
>> [    7.775735]  [<ffffffff8155c4c4>] ? oops_end+0xd4/0xf0
>> [    7.775735]  [<ffffffff8154f0c7>] ? no_context+0x1eb/0x216
>> [    7.775735]  [<ffffffff810cc22e>] ?
is_module_text_address+0xe/0x20
>> [    7.775735]  [<ffffffff8154f260>] ?
__bad_area_nosemaphore+0x16e/0x18d
>> [    7.775735]  [<ffffffff8154f292>] ?
bad_area_nosemaphore+0x13/0x15
>> [    7.775735]  [<ffffffff81047bee>] ?
__do_page_fault+0x2fe/0x490
>> [    7.775735]  [<ffffffff81056d03>] ?
perf_event_task_sched_out+0x33/0x70
>> [    7.775735]  [<ffffffff810522cf>] ? __dequeue_entity+0x2f/0x50
>> [    7.775735]  [<ffffffff810097ef>] ? __switch_to+0x1df/0x2f0
>> [    7.775735]  [<ffffffff8155e3cb>] ? do_page_fault+0x3b/0xa0
>> [    7.775735]  [<ffffffff8155b7e5>] ? page_fault+0x25/0x30
>> [    7.775735]  [<ffffffff811c9f3d>] ?
do_add_mount_unlocked+0x5d/0xe0
>> [    7.775735]  [<ffffffff811c9f0f>] ?
do_add_mount_unlocked+0x2f/0xe0
>> [    7.775735]  [<ffffffff811cb95b>] ? do_mount+0x41b/0xb00
>> [    7.775735]  [<ffffffff811564eb>] ? strndup_user+0x4b/0xb0
>> [    7.775735]  [<ffffffff81156501>] ? strndup_user+0x61/0xb0
>> [    7.775735]  [<ffffffff811cc0ce>] ? sys_mount+0x8e/0xe0
>> [    7.775735]  [<ffffffff8100b182>] ?
system_call_fastpath+0x16/0x1b
>> [    7.775735] Rebooting in 1 seconds..libguestfs: child_cleanup:
0x246f780: child process died
> 
> Rich.
> 
> -- 
> Richard Jones, Virtualization Group, Red Hat
http://people.redhat.com/~rjones
> Read my programming and virtualization blog: http://rwmj.wordpress.com
> Fedora Windows cross-compiler. Compile Windows programs, test, and
> build Windows installers. Over 100 libraries supported.
> http://fedoraproject.org/wiki/MinGW

On Tue, Sep 09, 2014 at 10:21:05PM +0300, Keresztes Péter-Zoltán
wrote:
> Unfortunately this is a prebuilt proxmox server which is running on
> debian wheezy and I cannot even install the latest version of
> libguesfs because of this.
That is unfortunate.  However libguestfs works because it uses the
kernel drivers for all these filesystems (we don't implement anything
ourselves), and thus it relies on the kernel drivers working.  If the
kernel doesn't work, libguestfs won't work.

If you are able to compile things on this server then you could
compile supermin 5 & libguestfs on the server, and point it to an
updated kernel image.  This is all possible w/o root:

http://libguestfs.org/guestfs-faq.1.html#how-can-i-compile-and-install-libguestfs-if-my-distro-doesnt-have-new-enough-qemu-supermin-kernel

Note you will need supermin 5 / libguestfs >= 1.26 for this to work,
and the version of libguestfs you were using was too old, and will
*not* work as described in the FAQ.

Rich.

-- 
Richard Jones, Virtualization Group, Red Hat http://people.redhat.com/~rjones
Read my programming and virtualization blog: http://rwmj.wordpress.com
virt-df lists disk usage of guests without needing to install any
software inside the virtual machine.  Supports Linux and Windows.
http://people.redhat.com/~rjones/virt-df/

I have tried to compile the newer libguesfs on these systems but they have
failed because of the version of some package which requires version 1.0 and
debian wheezy has lower then that. And that version of the package was available
on debian siv only. Unfortunately the choice of OS is not up to us we have to
use whatever the proxmox is building their service on.

Anyways thanks for the help

On Sep 9, 2014, at 10:26 PM, Richard W.M. Jones <rjones@redhat.com> wrote:
> On Tue, Sep 09, 2014 at 10:21:05PM +0300, Keresztes Péter-Zoltán wrote:
>> Unfortunately this is a prebuilt proxmox server which is running on
>> debian wheezy and I cannot even install the latest version of
>> libguesfs because of this.
> 
> That is unfortunate.  However libguestfs works because it uses the
> kernel drivers for all these filesystems (we don't implement anything
> ourselves), and thus it relies on the kernel drivers working.  If the
> kernel doesn't work, libguestfs won't work.
> 
> If you are able to compile things on this server then you could
> compile supermin 5 & libguestfs on the server, and point it to an
> updated kernel image.  This is all possible w/o root:
> 
>
http://libguestfs.org/guestfs-faq.1.html#how-can-i-compile-and-install-libguestfs-if-my-distro-doesnt-have-new-enough-qemu-supermin-kernel
> 
> Note you will need supermin 5 / libguestfs >= 1.26 for this to work,
> and the version of libguestfs you were using was too old, and will
> *not* work as described in the FAQ.
> 
> Rich.
> 
> -- 
> Richard Jones, Virtualization Group, Red Hat
http://people.redhat.com/~rjones
> Read my programming and virtualization blog: http://rwmj.wordpress.com
> virt-df lists disk usage of guests without needing to install any
> software inside the virtual machine.  Supports Linux and Windows.
> http://people.redhat.com/~rjones/virt-df/