Ali Shoker
2011-Jun-16 10:35 UTC
[libvirt-users] libvir: QEMU error : cannot set ownership
Hello everybody, I installed eucalyptus on ubuntu10, basic configuration . Everything is ok untill I start the instances, the disk is being created but it terminates soon. Environment: NFS , KVM, ubuntu10 x64, Euca on 2 machines (wc sc cc clc on one machine, and nc on another). libvirtd (libvirt) 0.7.5 QEMU PC emulator version 0.12.3 (qemu-kvm-0.12.3), Copyright (c) 2003-2008 Fabrice Bellard. Logs: /var/log/eucalyptus/nc.log: [Thu Jun 16 03:54:31 2011][003755][EUCADEBUG ] doStartNetwork() invoked [Thu Jun 16 03:54:31 2011][003755][EUCAINFO ] StartNetwork(): SUCCESS return from vnetStartNetwork 0 [Thu Jun 16 03:54:31 2011][003755][EUCAINFO ] StartNetwork(): done [Thu Jun 16 03:54:31 2011][003755][EUCAINFO ] doRunInstance() invoked (id=i-4C9D08C3 cores=2 disk=10 memory=512) [Thu Jun 16 03:54:31 2011][003755][EUCAINFO ] image=emi-DDBD105C at http://10.1.1.2:8773/services/Walrus/image-store-1308215076/image.manifest.xml [Thu Jun 16 03:54:31 2011][003755][EUCAINFO ] krnel=eki-F41F10E3 at http://10.1.1.2:8773/services/Walrus/image-store-1308215076/kernel.manifest.xml [Thu Jun 16 03:54:31 2011][003755][EUCAINFO ] rmdsk=eri-08841148 at http://10.1.1.2:8773/services/Walrus/image-store-1308215076/ramdisk.manifest.xml [Thu Jun 16 03:54:31 2011][003755][EUCAINFO ] vlan=10 priMAC=d0:0d:4C:9D:08:C3 pubMAC=d0:0d:4C:9D:08:C3 [Thu Jun 16 03:54:31 2011][003755][EUCAINFO ] network started for instance i-4C9D08C3 [Thu Jun 16 03:54:31 2011][003755][EUCAINFO ] retrieving images for instance i-4C9D08C3 (disk limit=10240MB)... [Thu Jun 16 03:54:31 2011][003755][EUCAINFO ] verifying cached file in /var/lib/eucalyptus/instances//eucalyptus/cache/eki-F41F10E3/kernel... [Thu Jun 16 03:54:31 2011][003755][EUCAINFO ] walrus_request(): downloading /tmp/walrus-digest-3D4AKY [Thu Jun 16 03:54:31 2011][003755][EUCAINFO ] from http://10.1.1.2:8773/services/Walrus/image-store-1308215076/kernel.manifest.xml [Thu Jun 16 03:54:31 2011][003755][EUCADEBUG ] walrus_request(): writing GET output to /tmp/walrus-digest-3D4AKY [Thu Jun 16 03:54:31 2011][003755][EUCADEBUG ] walrus_request(): wrote 3479 bytes in 3 writes [Thu Jun 16 03:54:31 2011][003755][EUCAINFO ] walrus_request(): saved image in /tmp/walrus-digest-3D4AKY [Thu Jun 16 03:54:31 2011][003755][EUCAINFO ] vrun(): [cp -a /var/lib/eucalyptus/instances//eucalyptus/cache/eki-F41F10E3/kernel /var/lib/eucalyptus/instances//admin/i-4C9D08C3/ker nel] [Thu Jun 16 03:54:31 2011][003755][EUCAINFO ] verifying cached file in /var/lib/eucalyptus/instances//eucalyptus/cache/eri-08841148/ramdisk... [Thu Jun 16 03:54:31 2011][003755][EUCAINFO ] walrus_request(): downloading /tmp/walrus-digest-sVEVa4 [Thu Jun 16 03:54:31 2011][003755][EUCAINFO ] from http://10.1.1.2:8773/services/Walrus/image-store-1308215076/ramdisk.manifest.xml [Thu Jun 16 03:54:31 2011][003755][EUCADEBUG ] walrus_request(): writing GET output to /tmp/walrus-digest-sVEVa4 [Thu Jun 16 03:54:31 2011][003755][EUCADEBUG ] walrus_request(): wrote 3482 bytes in 3 writes [Thu Jun 16 03:54:31 2011][003755][EUCAINFO ] walrus_request(): saved image in /tmp/walrus-digest-sVEVa4 [Thu Jun 16 03:54:31 2011][003755][EUCAINFO ] vrun(): [cp -a /var/lib/eucalyptus/instances//eucalyptus/cache/eri-08841148/ramdisk /var/lib/eucalyptus/instances//admin/i-4C9D08C3/ramdisk] [Thu Jun 16 03:54:31 2011][003755][EUCAINFO ] verifying cached file in /var/lib/eucalyptus/instances//eucalyptus/cache/emi-DDBD105C/disk... [Thu Jun 16 03:54:31 2011][003755][EUCAINFO ] walrus_request(): downloading /tmp/walrus-digest-RQEzI9 [Thu Jun 16 03:54:31 2011][003755][EUCAINFO ] from http://10.1.1.2:8773/services/Walrus/image-store-1308215076/image.manifest.xml [Thu Jun 16 03:54:31 2011][003755][EUCADEBUG ] walrus_request(): writing GET output to /tmp/walrus-digest-RQEzI9 [Thu Jun 16 03:54:31 2011][003755][EUCADEBUG ] walrus_request(): wrote 5887 bytes in 5 writes [Thu Jun 16 03:54:31 2011][003755][EUCAINFO ] walrus_request(): saved image in /tmp/walrus-digest-RQEzI9 [Thu Jun 16 03:54:31 2011][003755][EUCAINFO ] vrun(): [cp -a /var/lib/eucalyptus/instances//eucalyptus/cache/emi-DDBD105C/disk /var/lib/eucalyptus/instances//admin/i-4C9D08C3/disk] [Thu Jun 16 03:54:32 2011][003755][EUCAINFO ] vrun(): [//usr/lib/eucalyptus/euca_rootwrap //usr/share/eucalyptus/partition2disk /var/lib/eucalyptus/instances//admin/i-4C9D08C3/disk 512 8280] [Thu Jun 16 03:54:37 2011][003755][EUCADEBUG ] doDescribeResource() invoked [Thu Jun 16 03:54:37 2011][003755][EUCADEBUG ] doDescribeInstances() invoked [Thu Jun 16 03:54:43 2011][003755][EUCAINFO ] preparing images for instance i-4C9D08C3... [Thu Jun 16 03:54:43 2011][003755][EUCAINFO ] adding key/tmp/sckey.uUHVTI to the root file system at /var/lib/eucalyptus/instances//admin/i-4C9D08C3/disk using (//usr/lib/eucalyptus/euca_rootwrap //usr/share/eucalyptus/add_key.pl//usr/lib/eucalyptus/euca_mountwrap) [Thu Jun 16 03:54:43 2011][003755][EUCAINFO ] vrun(): [//usr/lib/eucalyptus/euca_rootwrap //usr/share/eucalyptus/add_key.pl//usr/lib/eucalyptus/euca_mountwrap 32256 /var/lib/eucalyptus/instances//admin/i-4C9D08C3/disk /tmp/sckey.uUHVTI] [Thu Jun 16 03:54:43 2011][003755][EUCADEBUG ] system_output(): [//usr/lib/eucalyptus/euca_rootwrap //usr/share/eucalyptus/gen_kvm_libvirt_xml --ramdisk --ephemeral] [Thu Jun 16 03:54:43 2011][003755][EUCAINFO ] currently running/booting: i-4C9D08C3 [Thu Jun 16 03:54:43 2011][003755][EUCADEBUG ] doDescribeResource() invoked [Thu Jun 16 03:54:43 2011][003755][EUCADEBUG ] doDescribeInstances() invoked [Thu Jun 16 03:54:49 2011][003755][EUCADEBUG ] doDescribeResource() invoked [Thu Jun 16 03:54:49 2011][003755][EUCADEBUG ] doDescribeInstances() invoked [Thu Jun 16 03:54:55 2011][003755][EUCADEBUG ] doDescribeResource() invoked [Thu Jun 16 03:54:55 2011][003755][EUCADEBUG ] doDescribeInstances() invoked [Thu Jun 16 03:55:01 2011][003755][EUCADEBUG ] doDescribeResource() invoked [Thu Jun 16 03:55:01 2011][003755][EUCADEBUG ] doDescribeInstances() invoked [Thu Jun 16 03:55:07 2011][003755][EUCADEBUG ] doDescribeResource() invoked [Thu Jun 16 03:55:07 2011][003755][EUCADEBUG ] doDescribeInstances() invoked [Thu Jun 16 03:55:13 2011][003755][EUCAERROR ] libvirt: monitor socket did not show up.: No such file or directory (code=38) [Thu Jun 16 03:55:13 2011][003755][EUCAFATAL ] hypervisor failed to start domain [Thu Jun 16 03:55:13 2011][003755][EUCADEBUG ] doDescribeResource() invoked [Thu Jun 16 03:55:13 2011][003755][EUCADEBUG ] doDescribeInstances() invoked [Thu Jun 16 03:55:15 2011][003755][EUCAERROR ] libvirt: Domain not found: no domain with matching name 'i-4C9D08C3' (code=42) [Thu Jun 16 03:55:15 2011][003755][EUCAINFO ] vrun(): [rm -rf /var/lib/eucalyptus/instances//admin/i-4C9D08C3/] [Thu Jun 16 03:55:15 2011][003755][EUCAINFO ] stopping the network (vlan=10) [Thu Jun 16 03:55:19 2011][003755][EUCADEBUG ] doDescribeResource() invoked [Thu Jun 16 03:55:19 2011][003755][EUCADEBUG ] doDescribeInstances() invoked [Thu Jun 16 03:55:25 2011][003755][EUCADEBUG ] doDescribeResource() invoked [Thu Jun 16 03:55:25 2011][003755][EUCADEBUG ] doDescribeInstances() invoked [Thu Jun 16 03:55:26 2011][003755][EUCAINFO ] doTerminateInstance() invoked (id=i-4C9D08C3) [Thu Jun 16 03:55:26 2011][003755][EUCAERROR ] libvirt: Domain not found: no domain with matching name 'i-4C9D08C3' (code=42) [Thu Jun 16 03:55:26 2011][003755][EUCAWARN ] warning: domain i-4C9D08C3 to be terminated not running on hypervisor [Thu Jun 16 03:55:31 2011][003755][EUCADEBUG ] doDescribeResource() invoked [Thu Jun 16 03:55:31 2011][003755][EUCADEBUG ] doDescribeInstances() invoked /var/log/libvirt/qemu/i-4C9D08C3.log: LC_ALL=C PATH=/usr/local/sbin:/usr/local/bin:/usr/bin:/usr/sbin:/sbin:/bin /usr/bin/kvm -S -M pc-0.12 -enable-kvm -m 512 -smp 2 -name i-3D4B085B -uuid 68e17542-66cb-0240-81f5-d71c935e5a5e -nographic -chardev socket,id=monitor,path=/var/lib/libvirt/qemu/i-3D4B085B.monitor,server,nowait -monitor chardev:monitor -boot c -kernel /var/lib/eucalyptus/instances//admin/i-3D4B085B/kernel -initrd /var/lib/eucalyptus/instances//admin/i-3D4B085B/ramdisk -append root=/dev/sda1 console=ttyS0 -drive file=/var/lib/eucalyptus/instances//admin/i-3D4B085B/disk,if=scsi,index=0,boot=on,format=raw -net nic,macaddr=d0:0d:3d:4b:08:5b,vlan=0,model=e1000,name=e1000.0 -net tap,fd=44,vlan=0,name=tap.0 -chardev file,id=serial0,path=/var/lib/eucalyptus/instances//admin/i-3D4B085B/console.log -serial chardev:serial0 -parallel none -usb libvir: QEMU error : cannot set ownership on /var/lib/eucalyptus/instances//admin/i-3D4B085B/kernel: Permission denied more info: qemu user/group is eucalyptus/root I noticed that soem process (libvirt or qemu) is changing the ownership before termination: Before and after: 1. ll /var/lib/eucalyptus/instances//admin/i-3D4B085B/ 2. total 715912K 3. -rw-r--r-- 1 eucalyptus eucalyptus 10767826944 2011-06-16 04:01 disk 4. -rw------- 1 eucalyptus eucalyptus 571064 2011-06-16 04:01 instance-checkpoint 5. -rw-r--r-- 1 eucalyptus eucalyptus 4159008 2011-06-16 03:09 kernel 6. -rw-r--r-- 1 eucalyptus eucalyptus 933 2011-06-16 04:01 libvirt.xml 7. -rw-r--r-- 1 eucalyptus eucalyptus 3899035 2011-06-16 03:09 ramdisk 8. 9. ll /var/lib/eucalyptus/instances//admin/i-3D4B085B/ 10. total 715912K 11. -rw-r--r-- 1 root root 10767826944 2011-06-16 04:01 disk 12. -rw------- 1 eucalyptus eucalyptus 571064 2011-06-16 04:01 instance-checkpoint 13. -rw-r--r-- 1 root root 4159008 2011-06-16 03:09 kernel 14. -rw-r--r-- 1 eucalyptus eucalyptus 933 2011-06-16 04:01 libvirt.xml 15. -rw-r--r-- 1 root root 3899035 2011-06-16 03:09 ramdisk additional info: ls -al /var/lib/eucalyptus total 24K drwxr-xr-x 5 eucalyptus eucalyptus 4096 2011-06-16 03:34 . drwxr-xr-x 43 root root 4096 2011-06-16 02:29 .. -rw------- 1 eucalyptus eucalyptus 16 2011-06-16 03:34 .bash_history drwx------ 2 eucalyptus eucalyptus 4096 2011-06-16 02:52 .cache lrwxrwxrwx 1 eucalyptus eucalyptus 14 2011-06-16 02:49 instances -> /mnt/instances drwx------ 2 eucalyptus eucalyptus 4096 2011-06-16 02:52 keys drwxr-xr-x 2 eucalyptus root 4096 2011-06-16 02:43 .ssh ls -al /mnt/instances total 16K drwxrwxrwx 4 eucalyptus eucalyptus 4096 2011-06-16 03:09 . drwxr-xr-x 5 eucalyptus eucalyptus 4096 2011-06-16 02:25 .. drwxr-xr-x 2 eucalyptus eucalyptus 4096 2011-06-16 04:02 admin drwxr-xr-x 3 eucalyptus eucalyptus 4096 2011-06-16 03:09 eucalyptus Is there any solution to this problem? A workaround also works. Thanks Best, Ali -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://listman.redhat.com/archives/libvirt-users/attachments/20110616/c7937abe/attachment.htm>