Piotr Jasiukajtis
2008-Dec-22 19:36 UTC
xenstored: ERROR Internal error: Could not obtain handle on privileged command interface (13 = Permission denied)
Hi,
I upgraded dom0 from b91 to b104 via LiveUpgrade and now have some
issues with xvm services:
# svcs -xv
svc:/system/xvm/xend:default (Hypervisor Control Daemon)
State: maintenance since Mon Dec 22 20:25:46 2008
Reason: Start method failed repeatedly, last exited with status 1.
See: http://sun.com/msg/SMF-8000-KS
See: man -M /usr/share/man -s 1M xend
See: /var/svc/log/system-xvm-xend:default.log
Impact: 3 dependent services are not running:
svc:/system/xvm/domains:default
svc:/system/xvm/console:default
svc:/system/xvm/virtd:default
svc:/system/xvm/store:default (Hypervisor Store Daemon)
State: maintenance since Mon Dec 22 20:25:49 2008
Reason: Restarting too quickly.
See: http://sun.com/msg/SMF-8000-L5
See: man -M /usr/share/man -s 1M xenstored
See: /var/svc/log/system-xvm-store:default.log
Impact: This service is not running.
[ Dec 22 20:25:49 Executing start method ("/lib/svc/method/xenstored
start"). ]
mkdir: Failed to make directory "/var/run/xend"; File exists
[ Dec 22 20:25:49 Method "start" exited with status 0. ]
ERROR Internal error: Could not obtain handle on privileged command
interface (13 = Permission denied)
FATAL: Failed to open connection to hypervisor: Permission denied
[ Dec 22 20:25:49 Stopping because all processes in service exited. ]
[ Dec 22 20:25:49 Executing stop method (:kill). ]
[ Dec 22 20:25:49 Restarting too quickly, changing state to maintenance. ]
# /usr/lib/xenstored
# ERROR Internal error: Could not obtain handle on privileged command
interface (13 = Permission denied)
FATAL: Failed to open connection to hypervisor: Permission denied
# uname -srv
SunOS 5.11 snv_104
--
Regards,
Piotr Jasiukajtis | estibi | SCA OS0072
http://estseg.blogspot.com
Piotr Jasiukajtis
2008-Dec-22 20:09 UTC
Re: xenstored: ERROR Internal error: Could not obtain handle on privileged command interface (13 = Permission denied)
Piotr Jasiukajtis pisze:> Hi, > > I upgraded dom0 from b91 to b104 via LiveUpgrade and now have some > issues with xvm services: > > # svcs -xv > svc:/system/xvm/xend:default (Hypervisor Control Daemon) > State: maintenance since Mon Dec 22 20:25:46 2008 > Reason: Start method failed repeatedly, last exited with status 1. > See: http://sun.com/msg/SMF-8000-KS > See: man -M /usr/share/man -s 1M xend > See: /var/svc/log/system-xvm-xend:default.log > Impact: 3 dependent services are not running: > svc:/system/xvm/domains:default > svc:/system/xvm/console:default > svc:/system/xvm/virtd:default > > svc:/system/xvm/store:default (Hypervisor Store Daemon) > State: maintenance since Mon Dec 22 20:25:49 2008 > Reason: Restarting too quickly. > See: http://sun.com/msg/SMF-8000-L5 > See: man -M /usr/share/man -s 1M xenstored > See: /var/svc/log/system-xvm-store:default.log > Impact: This service is not running. > > > > [ Dec 22 20:25:49 Executing start method ("/lib/svc/method/xenstored > start"). ] > mkdir: Failed to make directory "/var/run/xend"; File exists > [ Dec 22 20:25:49 Method "start" exited with status 0. ] > ERROR Internal error: Could not obtain handle on privileged command > interface (13 = Permission denied) > FATAL: Failed to open connection to hypervisor: Permission denied > [ Dec 22 20:25:49 Stopping because all processes in service exited. ] > [ Dec 22 20:25:49 Executing stop method (:kill). ] > [ Dec 22 20:25:49 Restarting too quickly, changing state to maintenance. ] > > > > # /usr/lib/xenstored > # ERROR Internal error: Could not obtain handle on privileged command > interface (13 = Permission denied) > FATAL: Failed to open connection to hypervisor: Permission deniedIt is caused by this: 1958: open("/dev/xen/privcmd", O_RDWR) Err#13 EACCES [file_dac_read] 1958: fstat(2, 0x7FFFFFDF9EA0) = 0 ERROR 1958: write(2, " E R R O R ", 6) = 6 Internal error1958: write(2, " I n t e r n a l e r r".., 14) = 14 Is it a known problem? -- Regards, Piotr Jasiukajtis | estibi | SCA OS0072 http://estseg.blogspot.com
Piotr Jasiukajtis
2008-Dec-22 20:12 UTC
Re: xenstored: ERROR Internal error: Could not obtain handle on privileged command interface (13 = Permission denied)
Piotr Jasiukajtis pisze:> Piotr Jasiukajtis pisze: >> Hi, >> >> I upgraded dom0 from b91 to b104 via LiveUpgrade and now have some >> issues with xvm services: >> >> # svcs -xv >> svc:/system/xvm/xend:default (Hypervisor Control Daemon) >> State: maintenance since Mon Dec 22 20:25:46 2008 >> Reason: Start method failed repeatedly, last exited with status 1. >> See: http://sun.com/msg/SMF-8000-KS >> See: man -M /usr/share/man -s 1M xend >> See: /var/svc/log/system-xvm-xend:default.log >> Impact: 3 dependent services are not running: >> svc:/system/xvm/domains:default >> svc:/system/xvm/console:default >> svc:/system/xvm/virtd:default >> >> svc:/system/xvm/store:default (Hypervisor Store Daemon) >> State: maintenance since Mon Dec 22 20:25:49 2008 >> Reason: Restarting too quickly. >> See: http://sun.com/msg/SMF-8000-L5 >> See: man -M /usr/share/man -s 1M xenstored >> See: /var/svc/log/system-xvm-store:default.log >> Impact: This service is not running. >> >> >> >> [ Dec 22 20:25:49 Executing start method ("/lib/svc/method/xenstored >> start"). ] >> mkdir: Failed to make directory "/var/run/xend"; File exists >> [ Dec 22 20:25:49 Method "start" exited with status 0. ] >> ERROR Internal error: Could not obtain handle on privileged command >> interface (13 = Permission denied) >> FATAL: Failed to open connection to hypervisor: Permission denied >> [ Dec 22 20:25:49 Stopping because all processes in service exited. ] >> [ Dec 22 20:25:49 Executing stop method (:kill). ] >> [ Dec 22 20:25:49 Restarting too quickly, changing state to maintenance. ] >> >> >> >> # /usr/lib/xenstored >> # ERROR Internal error: Could not obtain handle on privileged command >> interface (13 = Permission denied) >> FATAL: Failed to open connection to hypervisor: Permission denied > > It is caused by this: > > 1958: open("/dev/xen/privcmd", O_RDWR) Err#13 EACCES > [file_dac_read] > 1958: fstat(2, 0x7FFFFFDF9EA0) = 0 > ERROR 1958: write(2, " E R R O R ", 6) = 6 > Internal error1958: write(2, " I n t e r n a l e r r".., 14) = 14 > > > Is it a known problem?Should I add "start/privileges" properties to the xvm/store service? -- Regards, Piotr Jasiukajtis | estibi | SCA OS0072 http://estseg.blogspot.com
Piotr Jasiukajtis
2009-Jan-06 08:40 UTC
Re: xenstored: ERROR Internal error: Could not obtain handle on privileged command interface (13 = Permission denied)
Hey, Any idea how to solve it? Piotr Jasiukajtis pisze:> Piotr Jasiukajtis pisze: >> Hi, >> >> I upgraded dom0 from b91 to b104 via LiveUpgrade and now have some >> issues with xvm services: >> >> # svcs -xv >> svc:/system/xvm/xend:default (Hypervisor Control Daemon) >> State: maintenance since Mon Dec 22 20:25:46 2008 >> Reason: Start method failed repeatedly, last exited with status 1. >> See: http://sun.com/msg/SMF-8000-KS >> See: man -M /usr/share/man -s 1M xend >> See: /var/svc/log/system-xvm-xend:default.log >> Impact: 3 dependent services are not running: >> svc:/system/xvm/domains:default >> svc:/system/xvm/console:default >> svc:/system/xvm/virtd:default >> >> svc:/system/xvm/store:default (Hypervisor Store Daemon) >> State: maintenance since Mon Dec 22 20:25:49 2008 >> Reason: Restarting too quickly. >> See: http://sun.com/msg/SMF-8000-L5 >> See: man -M /usr/share/man -s 1M xenstored >> See: /var/svc/log/system-xvm-store:default.log >> Impact: This service is not running. >> >> >> >> [ Dec 22 20:25:49 Executing start method ("/lib/svc/method/xenstored >> start"). ] >> mkdir: Failed to make directory "/var/run/xend"; File exists >> [ Dec 22 20:25:49 Method "start" exited with status 0. ] >> ERROR Internal error: Could not obtain handle on privileged command >> interface (13 = Permission denied) >> FATAL: Failed to open connection to hypervisor: Permission denied >> [ Dec 22 20:25:49 Stopping because all processes in service exited. ] >> [ Dec 22 20:25:49 Executing stop method (:kill). ] >> [ Dec 22 20:25:49 Restarting too quickly, changing state to maintenance. ] >> >> >> >> # /usr/lib/xenstored >> # ERROR Internal error: Could not obtain handle on privileged command >> interface (13 = Permission denied) >> FATAL: Failed to open connection to hypervisor: Permission denied > > It is caused by this: > > 1958: open("/dev/xen/privcmd", O_RDWR) Err#13 EACCES > [file_dac_read] > 1958: fstat(2, 0x7FFFFFDF9EA0) = 0 > ERROR 1958: write(2, " E R R O R ", 6) = 6 > Internal error1958: write(2, " I n t e r n a l e r r".., 14) = 14 > > > Is it a known problem?-- Regards, Piotr Jasiukajtis | estibi | SCA OS0072 http://estseg.blogspot.com
David Edmondson
2009-Jan-06 09:12 UTC
Re: xenstored: ERROR Internal error: Could not obtain handle on privileged command interface (13 = Permission denied)
* pjasiukajtis@opensolaris.com.pl [2009-01-06 08:40:32]>>> I upgraded dom0 from b91 to b104 via LiveUpgrade and now have some >>> issues with xvm services:Did newer SUNWxvm packages get installed? (I''ve never tried LU and xVM together.) Do you have an ''xvm'' user in /etc/passwd? dme. -- David Edmondson, Sun Microsystems, http://dme.org
Piotr Jasiukajtis
2009-Jan-06 09:17 UTC
Re: xenstored: ERROR Internal error: Could not obtain handle on privileged command interface (13 = Permission denied)
David Edmondson pisze:> * pjasiukajtis@opensolaris.com.pl [2009-01-06 08:40:32] >>>> I upgraded dom0 from b91 to b104 via LiveUpgrade and now have some >>>> issues with xvm services: > > Did newer SUNWxvm packages get installed? (I''ve never tried LU and xVM > together.)I have tried it before. I always use LU in bare metal mode, since there were some problems with LU on dom0. # lustatus Boot Environment Is Active Active Can Copy Name Complete Now On Reboot Delete Status -------------------------- -------- ------ --------- ------ ---------- be_nv87 yes no no yes - be_nv91_081222_01 yes no no yes - be_nv91 yes no no yes - be_zfs_nv91 yes yes yes no - be_zfs_nv104 yes no no yes -> > Do you have an ''xvm'' user in /etc/passwd?# grep xvm /.alt.be_zfs_nv104/etc/passwd xvm:x:60:60:xVM User:/: -- Regards, Piotr Jasiukajtis | estibi | SCA OS0072 http://estseg.blogspot.com
Piotr Jasiukajtis
2009-Jan-06 09:20 UTC
Re: xenstored: ERROR Internal error: Could not obtain handle on privileged command interface (13 = Permission denied)
Piotr Jasiukajtis pisze:> David Edmondson pisze: >> * pjasiukajtis@opensolaris.com.pl [2009-01-06 08:40:32] >>>>> I upgraded dom0 from b91 to b104 via LiveUpgrade and now have some >>>>> issues with xvm services: >> Did newer SUNWxvm packages get installed? (I''ve never tried LU and xVM >> together.) > I have tried it before. I always use LU in bare metal mode, since there were > some problems with LU on dom0. > > # lustatus > Boot Environment Is Active Active Can Copy > Name Complete Now On Reboot Delete Status > -------------------------- -------- ------ --------- ------ ---------- > be_nv87 yes no no yes - > be_nv91_081222_01 yes no no yes - > be_nv91 yes no no yes - > be_zfs_nv91 yes yes yes no - > be_zfs_nv104 yes no no yes - > >> Do you have an ''xvm'' user in /etc/passwd? > # grep xvm /.alt.be_zfs_nv104/etc/passwd > xvm:x:60:60:xVM User:/: > ># for i in `pkginfo | grep xvm | awk ''{print $2}''` ; do echo ${i} && pkginfo -R /.alt.be_zfs_nv104/ ${i} ; done SUNWxvmdomr system SUNWxvmdomr Hypervisor Domain Tools (Root) SUNWxvmdomu system SUNWxvmdomu Hypervisor Domain Tools (Usr) SUNWxvmh system SUNWxvmh Hypervisor Header Files SUNWxvmhvm system SUNWxvmhvm Hypervisor HVM SUNWxvmpv system SUNWxvmpv xVM Paravirtualized Drivers SUNWxvmr system SUNWxvmr Hypervisor (Root) SUNWxvmu system SUNWxvmu Hypervisor (Usr) -- Regards, Piotr Jasiukajtis | estibi | SCA OS0072 http://estseg.blogspot.com
Mark Johnson
2009-Jan-06 14:13 UTC
Re: xenstored: ERROR Internal error: Could not obtain handle on privileged command interface (13 = Permission denied)
Piotr Jasiukajtis wrote:> Piotr Jasiukajtis pisze: >> David Edmondson pisze: >>> * pjasiukajtis@opensolaris.com.pl [2009-01-06 08:40:32] >>>>>> I upgraded dom0 from b91 to b104 via LiveUpgrade and now have some >>>>>> issues with xvm services: >>> Did newer SUNWxvm packages get installed? (I''ve never tried LU and xVM >>> together.) >> I have tried it before. I always use LU in bare metal mode, since there were >> some problems with LU on dom0. >> >> # lustatus >> Boot Environment Is Active Active Can Copy >> Name Complete Now On Reboot Delete Status >> -------------------------- -------- ------ --------- ------ ---------- >> be_nv87 yes no no yes - >> be_nv91_081222_01 yes no no yes - >> be_nv91 yes no no yes - >> be_zfs_nv91 yes yes yes no - >> be_zfs_nv104 yes no no yes - >> >>> Do you have an ''xvm'' user in /etc/passwd? >> # grep xvm /.alt.be_zfs_nv104/etc/passwd >> xvm:x:60:60:xVM User:/: >> >> > # for i in `pkginfo | grep xvm | awk ''{print $2}''` ; do echo ${i} && pkginfo -R > /.alt.be_zfs_nv104/ ${i} ; done > SUNWxvmdomr > system SUNWxvmdomr Hypervisor Domain Tools (Root) > SUNWxvmdomu > system SUNWxvmdomu Hypervisor Domain Tools (Usr) > SUNWxvmh > system SUNWxvmh Hypervisor Header Files > SUNWxvmhvm > system SUNWxvmhvm Hypervisor HVM > SUNWxvmpv > system SUNWxvmpv xVM Paravirtualized Drivers > SUNWxvmr > system SUNWxvmr Hypervisor (Root) > SUNWxvmu > system SUNWxvmu Hypervisor (Usr)Not a known problem.. I use LU and didn''t see this problem.. Just went from b89 to b105 on one machine. I would suspect it''s something specific to zfs root. BTW, you can now run LU in dom0 (i.e. from you b104 BE). Make sure you run Tools/Installers/liveupgrade20 first. You are running into a problem with the leastprivs putback. It runs the Xen daemons as user xvm. I don''t understand why /var/run/xend exists if this is a fresh boot? try removing it and then restarting the service... MRJ
Piotr Jasiukajtis
2009-Jan-07 12:09 UTC
Re: xenstored: ERROR Internal error: Could not obtain handle on privileged command interface (13 = Permission denied)
Mark Johnson pisze:> > > Piotr Jasiukajtis wrote: >> Piotr Jasiukajtis pisze: >>> David Edmondson pisze: >>>> * pjasiukajtis@opensolaris.com.pl [2009-01-06 08:40:32] >>>>>>> I upgraded dom0 from b91 to b104 via LiveUpgrade and now have some >>>>>>> issues with xvm services: >>>> Did newer SUNWxvm packages get installed? (I''ve never tried LU and xVM >>>> together.) >>> I have tried it before. I always use LU in bare metal mode, since >>> there were some problems with LU on dom0. >>> >>> # lustatus >>> Boot Environment Is Active Active Can Copy >>> Name Complete Now On Reboot Delete Status >>> -------------------------- -------- ------ --------- ------ ---------- >>> be_nv87 yes no no yes - >>> be_nv91_081222_01 yes no no yes - >>> be_nv91 yes no no yes - >>> be_zfs_nv91 yes yes yes no - >>> be_zfs_nv104 yes no no yes - >>> >>>> Do you have an ''xvm'' user in /etc/passwd? >>> # grep xvm /.alt.be_zfs_nv104/etc/passwd >>> xvm:x:60:60:xVM User:/: >>> >>> >> # for i in `pkginfo | grep xvm | awk ''{print $2}''` ; do echo ${i} && >> pkginfo -R /.alt.be_zfs_nv104/ ${i} ; done >> SUNWxvmdomr >> system SUNWxvmdomr Hypervisor Domain Tools (Root) >> SUNWxvmdomu >> system SUNWxvmdomu Hypervisor Domain Tools (Usr) >> SUNWxvmh >> system SUNWxvmh Hypervisor Header Files >> SUNWxvmhvm >> system SUNWxvmhvm Hypervisor HVM >> SUNWxvmpv >> system SUNWxvmpv xVM Paravirtualized Drivers >> SUNWxvmr >> system SUNWxvmr Hypervisor (Root) >> SUNWxvmu >> system SUNWxvmu Hypervisor (Usr) > > Not a known problem.. I use LU and didn''t see this problem.. > Just went from b89 to b105 on one machine. I would suspect > it''s something specific to zfs root.I created another BE (from b91) did LU (from b91 to b104) but now I used UFS insted of ZFS root.> > BTW, you can now run LU in dom0 (i.e. from you b104 BE). > Make sure you run Tools/Installers/liveupgrade20 first. > > You are running into a problem with the leastprivs > putback. It runs the Xen daemons as user xvm. > > I don''t understand why /var/run/xend exists if this > is a fresh boot? try removing it and then restarting > the service...[ Jan 7 12:07:43 Executing start method ("/lib/svc/method/xenstored start"). ] mkdir: Failed to make directory "/var/run/xend"; File exists [ Jan 7 12:07:43 Method "start" exited with status 0. ] ERROR Internal error: Could not obtain handle on privileged command interface (13 = Permission denied) FATAL: Failed to open connection to hypervisor: Permission denied [ Jan 7 12:07:43 Stopping because all processes in service exited. ] [ Jan 7 12:07:43 Executing stop method (:kill). ] [ Jan 7 12:07:43 Executing start method ("/lib/svc/method/xenstored start"). ] mkdir: Failed to make directory "/var/run/xend"; File exists [ Jan 7 12:07:43 Method "start" exited with status 0. ] ERROR Internal error: Could not obtain handle on privileged command interface (13 = Permission denied) FATAL: Failed to open connection to hypervisor: Permission denied [ Jan 7 12:07:43 Stopping because all processes in service exited. ] [ Jan 7 12:07:43 Executing stop method (:kill). ] [ Jan 7 12:07:43 Restarting too quickly, changing state to maintenance. ] -- Regards, Piotr Jasiukajtis | estibi | SCA OS0072 http://estseg.blogspot.com