Abhishek Chandra
2004-May-05 23:06 UTC
[Xen-devel] Creating multiple domains using NFS mounts
I''m trying to create multiple domains in Xen1.2 using NFS mounts from dom0 for the / and /usr. The way I have it set up right now is that I have separate root dirs created for 2 domains (named /nfs/export-root-dom1 and /nfs/export-root-dom2), which are being exported read-write (these 2 dirs are identical), and a single usr dir (/nfs/export-usr) that is being exported read-only to be mounted by both new domains. I''m using nfs mount option for the root and a linuxrc to mount the /usr partition in the new domain as explained in the XenDemoCD howto. This whole setup works fine for the first domain (dom1), but fails when I try to start the second domain. Here;s the error message: [root@obelix51 xc]# xc_dom_create.py -f dom2_nfsroot_nfsusr.config -Dvmid=2 Parsing config file ''dom2_nfsroot_nfsusr.config'' VM image : "/boot/xenolinux.gz" VM ramdisk : "" VM memory (MB) : "64" VM IP address(es) : "192.168.245.53; 169.254.1.2" VM block device(s) : "" VM cmdline : "ip=169.254.1.2:169.254.1.0:169.254.1.0:255.255.0.0::eth0:on root=/dev/nfs ro nfsroot=/nfs/export-root-dom2 init=/linuxrc 4 VMID=2" Error creating domain Here''s the relevant portion of my config file for booting domain1 (the one for dom2 is identical, except for /nfs/export-root-dom2): -------------------------------------------------------------------- #STEP 6. Build the command line for the new domain. Edit as req''d. # You only need the ip= line if you''re NFS booting or the root file system # doesn''t set it later e.g. in ifcfg-eth0 or via DHCP # You can use ''extrabit'' to set the runlevel and custom environment # variables used by custom rc scripts (e.g. VMID=, usr= ) netmask = ''255.255.0.0'' gateway = ''169.254.1.0'' nfsserv = ''169.254.1.0'' cmdline_ip = "ip="+vfr_ipaddr[1]+":"+nfsserv+":"+gateway+":"+netmask+"::eth0:on" cmdline_root = "root=/dev/nfs ro nfsroot=/nfs/export-root-dom1" cmdline_extra = "init=/linuxrc 4 VMID=%d" % vmid -------------------------------------------------------------------- Any ideas/suggestions? Thanks, Abhishek ------------------------------------------------------- This SF.Net email is sponsored by Sleepycat Software Learn developer strategies Cisco, Motorola, Ericsson & Lucent use to deliver higher performing products faster, at low TCO. http://www.sleepycat.com/telcomwpreg.php?From=osdnemail3 _______________________________________________ Xen-devel mailing list Xen-devel@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/xen-devel
Ian Pratt
2004-May-06 00:42 UTC
Re: [Xen-devel] Creating multiple domains using NFS mounts
> I''m using nfs mount option for the root and > a linuxrc to mount the /usr partition in the new domain as > explained in the XenDemoCD howto. This whole setup works fine for the > first domain (dom1), but fails when I try to start the second domain. > Here;s the error message: > > [root@obelix51 xc]# xc_dom_create.py -f dom2_nfsroot_nfsusr.config -Dvmid=2 > Parsing config file ''dom2_nfsroot_nfsusr.config'' > VM image : "/boot/xenolinux.gz" > VM ramdisk : "" > VM memory (MB) : "64" > VM IP address(es) : "192.168.245.53; 169.254.1.2" > VM block device(s) : "" > VM cmdline : "ip=169.254.1.2:169.254.1.0:169.254.1.0:255.255.0.0::eth0:on > root=/dev/nfs ro nfsroot=/nfs/export-root-dom2 init=/linuxrc 4 VMID=2" > Error creating domainI suspect this isn''t a problem with the config of VM 2. Just to check this, please can you start VM 2 first (using the exact same command line above), before starting VM 1. BTW: If the two VMs are similar, you might want to have a single shared config file and use vmid to setup the appropriate IP addresses etc. Unfortunately, xen 1.2 doesn''t give very useful error messages if something goes wrong in domain creation. The 1.3 (unstable) tree is rather better in this respect. One obvious question is how much memory has the machine got? Dom0 will be consuming memory, as will Xen itself. What does xc_physinfo.py show? Ian ------------------------------------------------------- This SF.Net email is sponsored by Sleepycat Software Learn developer strategies Cisco, Motorola, Ericsson & Lucent use to deliver higher performing products faster, at low TCO. http://www.sleepycat.com/telcomwpreg.php?From=osdnemail3 _______________________________________________ Xen-devel mailing list Xen-devel@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/xen-devel
Abhishek Chandra
2004-May-06 02:07 UTC
Re: [Xen-devel] Creating multiple domains using NFS mounts
Hi Ian, Thanks for your pointers. It turned out to be a memory prob. I have a 128M machine, and I had assigned most of it to dom0. Reducing the memory for all the domains seems to work. Thanks, Abhishek On Thu, 6 May 2004, Ian Pratt wrote:> Date: Thu, 06 May 2004 01:42:05 +0100 > From: Ian Pratt <Ian.Pratt@cl.cam.ac.uk> > To: Abhishek Chandra <abhishek@cs.umass.edu> > Cc: xen-devel@lists.sourceforge.net, Ian.Pratt@cl.cam.ac.uk > Subject: Re: [Xen-devel] Creating multiple domains using NFS mounts > > > > I''m using nfs mount option for the root and > > a linuxrc to mount the /usr partition in the new domain as > > explained in the XenDemoCD howto. This whole setup works fine for the > > first domain (dom1), but fails when I try to start the second domain. > > Here;s the error message: > > > > [root@obelix51 xc]# xc_dom_create.py -f dom2_nfsroot_nfsusr.config -Dvmid=2 > > Parsing config file ''dom2_nfsroot_nfsusr.config'' > > VM image : "/boot/xenolinux.gz" > > VM ramdisk : "" > > VM memory (MB) : "64" > > VM IP address(es) : "192.168.245.53; 169.254.1.2" > > VM block device(s) : "" > > VM cmdline : "ip=169.254.1.2:169.254.1.0:169.254.1.0:255.255.0.0::eth0:on > > root=/dev/nfs ro nfsroot=/nfs/export-root-dom2 init=/linuxrc 4 VMID=2" > > Error creating domain > > > I suspect this isn''t a problem with the config of VM 2. Just > to check this, please can you start VM 2 first (using the > exact same command line above), before starting VM 1. BTW: If > the two VMs are similar, you might want to have a single shared > config file and use vmid to setup the appropriate IP addresses > etc. > > Unfortunately, xen 1.2 doesn''t give very useful error messages if > something goes wrong in domain creation. The 1.3 (unstable) tree > is rather better in this respect. One obvious question is how > much memory has the machine got? Dom0 will be consuming memory, > as will Xen itself. What does xc_physinfo.py show? > > Ian > > > ------------------------------------------------------- > This SF.Net email is sponsored by Sleepycat Software > Learn developer strategies Cisco, Motorola, Ericsson & Lucent use to deliver > higher performing products faster, at low TCO. > http://www.sleepycat.com/telcomwpreg.php?From=osdnemail3 > _______________________________________________ > Xen-devel mailing list > Xen-devel@lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/xen-devel >------------------------------------------------------- This SF.Net email is sponsored by Sleepycat Software Learn developer strategies Cisco, Motorola, Ericsson & Lucent use to deliver higher performing products faster, at low TCO. http://www.sleepycat.com/telcomwpreg.php?From=osdnemail3 _______________________________________________ Xen-devel mailing list Xen-devel@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/xen-devel