Eric McClelland
2009-May-18 23:52 UTC
[Xen-users] Running x86_64, but getting a 32-bit hypervisor
Hello, I''ve been running Xen with 32-bit dom0s and domUs for a little over a year now (good stuff!), and have just started moving to x86_64. Starting from an x86_64 non-Xen Gentoo installation, I''ve built the necessary packages using Gentoo''s Portage, but find that the resulting hypervisor is only 32-bit, which I presume to be the underlying reason it won''t boot the 64-bit dom0. I''m trying to figure out what is preventing me from getting a 64-bit hypervisor. Interestingly, the xen-syms-3.3.1 file is 64-bit, so I don''t think it''s a basic mistake in my compilation settings: -------------------- root@Xen1# ls -l xen.gz lrwxrwxrwx 1 root root 12 May 18 02:30 xen.gz -> xen-3.3.1.gz root@Xen1# zcat xen.gz | file - /dev/stdin: ELF 32-bit LSB executable, Intel 80386, version 1 (SYSV), statically linked, stripped root@Xen1# file xen-syms-3.3.1 xen-syms-3.3.1: ELF 64-bit LSB executable, x86-64, version 1 (SYSV), statically linked, stripped -------------------- I''ve been using http://www.gentoo.org/doc/en/xen-guide.xml and http://en.gentoo-wiki.com/wiki/Xen as my primary references. Searching this list and Googling haven''t yielded promising results so far, although my situation sounds very similar (aside from the hardware) to http://lists.xensource.com/archives/html/xen-users/2006-08/msg00018.html . I''ve started digging through the temporary working directories used by Gentoo during installation, as well as the output from ''emerge'' itself (captured with ''script''). However, my eyes have begun to glaze over. Various pieces of system information follow - sorry if it''s overly verbose. I''ve omitted my xen-sources kernel configuration settings for the moment, since I believe the hypervisor compilation to be independent anyway. Have I simply managed to overlook something or to do something stupid? Any pointers would be appreciated. If I''ve overlooked a more appropriate mailing list (something Gentoo-specific, perhaps?), I apologize. Gentoo Portage environment: -------------------- Portage 2.1.6.11 (default/linux/amd64/2008.0, gcc-4.3.2, glibc-2.8_p20080602-r1, 2.6.28-gentoo-r5-ericm x86_64) ================================================================System uname: Linux-2.6.28-gentoo-r5-ericm-x86_64-Intel-R-_Xeon-TM-_CPU_3.00GHz-with-glibc2.2.5 Timestamp of tree: Thu, 07 May 2009 01:45:01 +0000 ccache version 2.4 [enabled] app-shells/bash: 3.2_p39 dev-lang/python: 2.5.4-r2 dev-util/ccache: 2.4-r7 sys-apps/baselayout: 1.12.11.1 sys-apps/sandbox: 1.6-r2 sys-devel/autoconf: 2.63 sys-devel/automake: 1.9.6-r2, 1.10.2 sys-devel/binutils: 2.18-r3 sys-devel/gcc-config: 1.4.0-r4 sys-devel/libtool: 1.5.26 virtual/os-headers: 2.6.27-r2 ACCEPT_KEYWORDS="amd64" CBUILD="x86_64-pc-linux-gnu" CFLAGS="-O2 -march=nocona -pipe" CHOST="x86_64-pc-linux-gnu" CONFIG_PROTECT="/etc" CONFIG_PROTECT_MASK="/etc/ca-certificates.conf /etc/env.d /etc/gconf /etc/revdep-rebuild /etc/sandbox.d /etc/terminfo /etc/udev/rules.d" CXXFLAGS="-O2 -march=nocona -pipe" DISTDIR="/usr/portage/distfiles" EMERGE_DEFAULT_OPTS="--nospinner --ask" [ I removed "--verbose" for this post. --Eric ] FEATURES="buildpkg ccache collision-protect distlocks fixpackages noclean parallel-fetch protect-owned sandbox sfperms strict test test-fail-continue unmerge-orphans userfetch userpriv usersandbox" GENTOO_MIRRORS="ftp://mirror.datapipe.net/gentoo http://distfiles.gentoo.org http://www.ibiblio.org/pub/Linux/distributions/gentoo" LDFLAGS="-Wl,-O1" MAKEOPTS="-j5" PKGDIR="/usr/portage/packages" PORTAGE_CONFIGROOT="/" PORTAGE_RSYNC_OPTS="--recursive --links --safe-links --perms --times --compress --force --whole-file --delete --stats --timeout=180 --exclude=/distfiles --exclude=/local --exclude=/packages" PORTAGE_TMPDIR="/var/tmp" PORTDIR="/usr/portage" SYNC="rsync://rsync.namerica.gentoo.org/gentoo-portage" USE="acl amd64 berkdb bzip2 cli cracklib crypt cups dri examples fortran gdbm gpm iconv ipv6 isdnlog midi mmx mudflap multilib ncurses nls nptl nptlonly openmp pam pcre perl pppd python readline reflection session spl sse sse2 ssl sysfs tcpd unicode xorg zlib" ALSA_CARDS="ali5451 als4000 atiixp atiixp-modem bt87x ca0106 cmipci emu10k1x ens1370 ens1371 es1938 es1968 fm801 hda-intel intel8x0 intel8x0m maestro3 trident usb-audio via82xx via82xx-modem ymfpci" ALSA_PCM_PLUGINS="adpcm alaw asym copy dmix dshare dsnoop empty extplug file hooks iec958 ioplug ladspa lfloat linear meter mmap_emul mulaw multi null plug rate route share shm softvol" APACHE2_MODULES="actions alias auth_basic authn_alias authn_anon authn_dbm authn_default authn_file authz_dbm authz_default authz_groupfile authz_host authz_owner authz_user autoindex cache dav dav_fs dav_lock deflate dir disk_cache env expires ext_filter file_cache filter headers include info log_config logio mem_cache mime mime_magic negotiation rewrite setenvif speling status unique_id userdir usertrack vhost_alias" ELIBC="glibc" INPUT_DEVICES="keyboard mouse evdev" KERNEL="linux" LCD_DEVICES="bayrad cfontz cfontz633 glk hd44780 lb216 lcdm001 mtxorb ncurses text" USERLAND="GNU" VIDEO_CARDS="fbdev glint i810 intel mach64 mga neomagic nv r128 radeon savage sis tdfx trident vesa vga via vmware voodoo" Unset: CPPFLAGS, CTARGET, FFLAGS, INSTALL_MASK, LANG, LC_ALL, LINGUAS, PORTAGE_COMPRESS, PORTAGE_COMPRESS_FLAGS, PORTAGE_RSYNC_EXTRA_OPTS, PORTDIR_OVERLAY ---------- /etc/portage/package.keywords: app-emulation/xen app-emulation/xen-tools sys-kernel/xen-sources ---------- /etc/portage/package.use: net-analyzer/wireshark threads app-emulation/xen-tools hvm -------------------- Installed Xen, Xen-related packages: -------------------- /var/db/pkg/app-emulation/xen-3.3.1-r1 /var/db/pkg/app-emulation/xen-tools-3.3.1 /var/db/pkg/sys-devel/dev86-0.16.17-r5 /var/db/pkg/sys-kernel/xen-sources-2.6.18-r12 -------------------- Regards, --Eric _______________________________________________ Xen-users mailing list Xen-users@lists.xensource.com http://lists.xensource.com/xen-users
Andrew Lyon
2009-May-24 12:34 UTC
Re: [Xen-users] Running x86_64, but getting a 32-bit hypervisor
On Tue, May 19, 2009 at 12:52 AM, Eric McClelland <xen-users@rnkcom.com> wrote:> Hello, > > I''ve been running Xen with 32-bit dom0s and domUs for a little over a year now (good stuff!), and have just started moving to x86_64. Starting from an x86_64 non-Xen Gentoo installation, I''ve built the necessary packages using Gentoo''s Portage, but find that the resulting hypervisor is only 32-bit, which I presume to be the underlying reason it won''t boot the 64-bit dom0. I''m trying to figure out what is preventing me from getting a 64-bit hypervisor. > > Interestingly, the xen-syms-3.3.1 file is 64-bit, so I don''t think it''s a basic mistake in my compilation settings: > > -------------------- > root@Xen1# ls -l xen.gz > lrwxrwxrwx 1 root root 12 May 18 02:30 xen.gz -> xen-3.3.1.gz > > root@Xen1# zcat xen.gz | file - > /dev/stdin: ELF 32-bit LSB executable, Intel 80386, version 1 (SYSV), statically linked, strippedI get the same result on my 64 bit Gentoo system but it is definitely 64 bit as I have 64 bit hvm''s running: zcat xen-3.4.0.gz | file - /dev/stdin: ELF 32-bit LSB executable, Intel 80386, version 1 (SYSV), statically linked, stripped> > root@Xen1# file xen-syms-3.3.1 > xen-syms-3.3.1: ELF 64-bit LSB executable, x86-64, version 1 (SYSV), statically linked, strippedfile xen-syms-3.4.0 xen-syms-3.4.0: ELF 64-bit LSB executable, x86-64, version 1 (SYSV), statically linked, stripped> -------------------- > > I''ve been using http://www.gentoo.org/doc/en/xen-guide.xml and http://en.gentoo-wiki.com/wiki/Xen as my primary references. Searching this list and Googling haven''t yielded promising results so far, although my situation sounds very similar (aside from the hardware) to http://lists.xensource.com/archives/html/xen-users/2006-08/msg00018.html . I''ve started digging through the temporary working directories used by Gentoo during installation, as well as the output from ''emerge'' itself (captured with ''script''). However, my eyes have begun to glaze over. > > Various pieces of system information follow - sorry if it''s overly verbose. I''ve omitted my xen-sources kernel configuration settings for the moment, since I believe the hypervisor compilation to be independent anyway. Have I simply managed to overlook something or to do something stupid? Any pointers would be appreciated. If I''ve overlooked a more appropriate mailing list (something Gentoo-specific, perhaps?), I apologize. > > Gentoo Portage environment: > -------------------- > Portage 2.1.6.11 (default/linux/amd64/2008.0, gcc-4.3.2, glibc-2.8_p20080602-r1, 2.6.28-gentoo-r5-ericm x86_64) > ================================================================> System uname: Linux-2.6.28-gentoo-r5-ericm-x86_64-Intel-R-_Xeon-TM-_CPU_3.00GHz-with-glibc2.2.5 > Timestamp of tree: Thu, 07 May 2009 01:45:01 +0000 > ccache version 2.4 [enabled] > app-shells/bash: 3.2_p39 > dev-lang/python: 2.5.4-r2 > dev-util/ccache: 2.4-r7 > sys-apps/baselayout: 1.12.11.1 > sys-apps/sandbox: 1.6-r2 > sys-devel/autoconf: 2.63 > sys-devel/automake: 1.9.6-r2, 1.10.2 > sys-devel/binutils: 2.18-r3 > sys-devel/gcc-config: 1.4.0-r4 > sys-devel/libtool: 1.5.26 > virtual/os-headers: 2.6.27-r2 > ACCEPT_KEYWORDS="amd64" > CBUILD="x86_64-pc-linux-gnu" > CFLAGS="-O2 -march=nocona -pipe" > CHOST="x86_64-pc-linux-gnu" > CONFIG_PROTECT="/etc" > CONFIG_PROTECT_MASK="/etc/ca-certificates.conf /etc/env.d /etc/gconf /etc/revdep-rebuild /etc/sandbox.d /etc/terminfo /etc/udev/rules.d" > CXXFLAGS="-O2 -march=nocona -pipe" > DISTDIR="/usr/portage/distfiles" > EMERGE_DEFAULT_OPTS="--nospinner --ask" [ I removed "--verbose" for this post. --Eric ] > FEATURES="buildpkg ccache collision-protect distlocks fixpackages noclean parallel-fetch protect-owned sandbox sfperms strict test test-fail-continue unmerge-orphans userfetch userpriv usersandbox" > GENTOO_MIRRORS="ftp://mirror.datapipe.net/gentoo http://distfiles.gentoo.org http://www.ibiblio.org/pub/Linux/distributions/gentoo" > LDFLAGS="-Wl,-O1" > MAKEOPTS="-j5" > PKGDIR="/usr/portage/packages" > PORTAGE_CONFIGROOT="/" > PORTAGE_RSYNC_OPTS="--recursive --links --safe-links --perms --times --compress --force --whole-file --delete --stats --timeout=180 --exclude=/distfiles --exclude=/local --exclude=/packages" > PORTAGE_TMPDIR="/var/tmp" > PORTDIR="/usr/portage" > SYNC="rsync://rsync.namerica.gentoo.org/gentoo-portage" > USE="acl amd64 berkdb bzip2 cli cracklib crypt cups dri examples fortran gdbm gpm iconv ipv6 isdnlog midi mmx mudflap multilib ncurses nls nptl nptlonly openmp pam pcre perl pppd python readline reflection session spl sse sse2 ssl sysfs tcpd unicode xorg zlib" ALSA_CARDS="ali5451 als4000 atiixp atiixp-modem bt87x ca0106 cmipci emu10k1x ens1370 ens1371 es1938 es1968 fm801 hda-intel intel8x0 intel8x0m maestro3 trident usb-audio via82xx via82xx-modem ymfpci" ALSA_PCM_PLUGINS="adpcm alaw asym copy dmix dshare dsnoop empty extplug file hooks iec958 ioplug ladspa lfloat linear meter mmap_emul mulaw multi null plug rate route share shm softvol" APACHE2_MODULES="actions alias auth_basic authn_alias authn_anon authn_dbm authn_default authn_file authz_dbm authz_default authz_groupfile authz_host authz_owner authz_user autoindex cache dav dav_fs dav_lock deflate dir disk_cache env expires ext_filter file_cache filter headers include info log_config logio mem_cache mime mime_magic negotiation rewrite setenvif speling status unique_id userdir usertrack vhost_alias" ELIBC="glibc" INPUT_DEVICES="keyboard mouse evdev" KERNEL="linux" LCD_DEVICES="bayrad cfontz cfontz633 glk hd44780 lb216 lcdm001 mtxorb ncurses text" USERLAND="GNU" VIDEO_CARDS="fbdev glint i810 intel mach64 mga neomagic nv r128 radeon savage sis tdfx trident vesa vga via vmware voodoo" > Unset: CPPFLAGS, CTARGET, FFLAGS, INSTALL_MASK, LANG, LC_ALL, LINGUAS, PORTAGE_COMPRESS, PORTAGE_COMPRESS_FLAGS, PORTAGE_RSYNC_EXTRA_OPTS, PORTDIR_OVERLAY > > ---------- > > /etc/portage/package.keywords: > app-emulation/xen > app-emulation/xen-tools > sys-kernel/xen-sources > > ---------- > > /etc/portage/package.use: > net-analyzer/wireshark threads > app-emulation/xen-tools hvm > -------------------- > > Installed Xen, Xen-related packages: > -------------------- > /var/db/pkg/app-emulation/xen-3.3.1-r1 > /var/db/pkg/app-emulation/xen-tools-3.3.1 > /var/db/pkg/sys-devel/dev86-0.16.17-r5 > /var/db/pkg/sys-kernel/xen-sources-2.6.18-r12 > -------------------- > > Regards, > --Eric > > _______________________________________________ > Xen-users mailing list > Xen-users@lists.xensource.com > http://lists.xensource.com/xen-users >What does "xm info" return? it should list machine type: machine : x86_64 Also xen_caps: xen_caps : xen-3.0-x86_64 xen-3.0-x86_32p hvm-3.0-x86_32 hvm-3.0-x86_32p hvm-3.0-x86_64 Andy _______________________________________________ Xen-users mailing list Xen-users@lists.xensource.com http://lists.xensource.com/xen-users