As promised, here''s what I did to get iSCSI root running under XenU under Debian 3.1 (Sarge): Be running linux 2.6 under XenU. Build XenU with SCSI disk support (I did them as modules) Get linux-iscsi 4.0.1.8 from http://sourceforge.net/projects/linux-iscsi/ Build it according to the instructions there (i found it a bit tricky) and install under your XenU Get iscsi-init 4.0.1 from http://sourceforge.net/projects/iscsi-init/ Built it according to the instructions there (much easier). Make sure the modules from linux-iscsi and iscsi-init are in /lib/modules/... for XenU. Copy the attached script ''iscsi-init'' to /etc/mkinitrd/scripts in XenU. mkinitrd as normal. Add the appropriate bits to your kernel command line for XenU as per the README in iscsi-init. Reboot and enjoy. Sorry if it''s a bit vague, i can fill in any details if anyone is interested. I''m just now trying to get RAID1 working over iscsi so I get high availability, but mkinitrd starts raid before the iscsi script runs so I need to re-jig it a bit. James
Have you tried setting up evms to handle the raid? I just started using it instead of lvm+md on nfs1 when I rebuilt it last week and so far it''s run very nice and reliably on bootup. It''s stacked like this: ide-disks<->bbr_per_disk<->raid5+1spare<->lvm<->snapshots_as_needed As you can see, I really don''t want the array failing on me. ;) Once I get the iSCSI working I had planned on using 1 EVMS volume from nfs1 and nfs2 servers as mirror pairs mounted via domain0 of the hosting xen node then exported to the domain#. It looks quite complex, but it should in theory provide 100% fault tolerance to the individual xenlinux virtual machines. (separate lan per nfs server as well, 3rd lan for regular network traffic). Thank you for the specifics on iscsi. I''ll probably be packaging it somehow after I check out the license and get it to compile reliably. That is unless someone else gets to it before me. ;) On Sat, 2004-08-28 at 07:33, James Harper wrote:> As promised, here''s what I did to get iSCSI root running under XenU > under Debian 3.1 (Sarge): > > Be running linux 2.6 under XenU. > Build XenU with SCSI disk support (I did them as modules) > Get linux-iscsi 4.0.1.8 > from http://sourceforge.net/projects/linux-iscsi/ > Build it according to the instructions there (i found it a bit tricky) > and install under your XenU > Get iscsi-init 4.0.1 from http://sourceforge.net/projects/iscsi-init/ > Built it according to the instructions there (much easier). > Make sure the modules from linux-iscsi and iscsi-init are in > /lib/modules/... for XenU. > Copy the attached script ''iscsi-init'' to /etc/mkinitrd/scripts in > XenU. > mkinitrd as normal. > > Add the appropriate bits to your kernel command line for XenU as per > the README in iscsi-init. > > Reboot and enjoy. Sorry if it''s a bit vague, i can fill in any details > if anyone is interested. > > I''m just now trying to get RAID1 working over iscsi so I get high > availability, but mkinitrd starts raid before the iscsi script runs so > I need to re-jig it a bit. > > James > > > > >------------------------------------------------------- This SF.Net email is sponsored by BEA Weblogic Workshop FREE Java Enterprise J2EE developer tools! Get your free copy of BEA WebLogic Workshop 8.1 today. http://ads.osdn.com/?ad_id=5047&alloc_id=10808&op=click _______________________________________________ Xen-devel mailing list Xen-devel@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/xen-devel
Speaking of compiling, iscsi-init doesn''t seem to compile for me under 2.6.8.1. It tells me this: make -C /lib/modules/2.6.8.1-xenU/build SUBDIRS=/usr/src/iscsi-init-4.0.1 modules make[1]: Entering directory `/usr/src/xeno-unstable.bk/linux-2.6.8.1-xenU'' Building modules, stage 2. MODPOST *** Warning: "close" [/usr/src/iscsi-init-4.0.1/iscsi_init.ko] undefined! *** Warning: "read" [/usr/src/iscsi-init-4.0.1/iscsi_init.ko] undefined! *** Warning: "open" [/usr/src/iscsi-init-4.0.1/iscsi_init.ko] undefined! make[1]: Leaving directory `/usr/src/xeno-unstable.bk/linux-2.6.8.1-xenU'' and then of course close, read, and open are missing symbols. it looks like the definitions from <asm/unistd.h> have been taken away between 2.6.7 and 2.6.8. Any idea''s what should replace them? What should kernel code use for opening, reading, and closing files? James From: Brian Wolfe Sent: Sun 29/08/2004 4:22 AM To: James Harper Cc: xen-devel@lists.sourceforge.net Subject: Re: [Xen-devel] iSCSI root Have you tried setting up evms to handle the raid? I just started using it instead of lvm+md on nfs1 when I rebuilt it last week and so far it''s run very nice and reliably on bootup. It''s stacked like this: ide-disks<->bbr_per_disk<->raid5+1spare<->lvm<->snapshots_as_needed As you can see, I really don''t want the array failing on me. ;) Once I get the iSCSI working I had planned on using 1 EVMS volume from nfs1 and nfs2 servers as mirror pairs mounted via domain0 of the hosting xen node then exported to the domain#. It looks quite complex, but it should in theory provide 100% fault tolerance to the individual xenlinux virtual machines. (separate lan per nfs server as well, 3rd lan for regular network traffic). Thank you for the specifics on iscsi. I''ll probably be packaging it somehow after I check out the license and get it to compile reliably. That is unless someone else gets to it before me. ;) On Sat, 2004-08-28 at 07:33, James Harper wrote:> As promised, here''s what I did to get iSCSI root running under XenU > under Debian 3.1 (Sarge): > > Be running linux 2.6 under XenU. > Build XenU with SCSI disk support (I did them as modules) > Get linux-iscsi 4.0.1.8 > from http://sourceforge.net/projects/linux-iscsi/ > Build it according to the instructions there (i found it a bit tricky) > and install under your XenU > Get iscsi-init 4.0.1 from http://sourceforge.net/projects/iscsi-init/ > Built it according to the instructions there (much easier). > Make sure the modules from linux-iscsi and iscsi-init are in > /lib/modules/... for XenU. > Copy the attached script ''iscsi-init'' to /etc/mkinitrd/scripts in > XenU. > mkinitrd as normal. > > Add the appropriate bits to your kernel command line for XenU as per > the README in iscsi-init. > > Reboot and enjoy. Sorry if it''s a bit vague, i can fill in any details > if anyone is interested. > > I''m just now trying to get RAID1 working over iscsi so I get high > availability, but mkinitrd starts raid before the iscsi script runs so > I need to re-jig it a bit. > > James > > > > >
That''s a rather odd thing to do, as it''s not like there''s a generic EXPORT_SYMBOL''ed way to e.g. open a file. I can''t imagine why they''d have removed all wrappers except execve. Easiest workaround is just to roll your own wrappers around the syscalls using the _syscall* macros. -- Keir> Speaking of compiling, iscsi-init doesn''t seem to compile for me under 2.6.8.1. It tells me this: > > make -C /lib/modules/2.6.8.1-xenU/build SUBDIRS=/usr/src/iscsi-init-4.0.1 modules > make[1]: Entering directory `/usr/src/xeno-unstable.bk/linux-2.6.8.1-xenU'' > Building modules, stage 2. > MODPOST > *** Warning: "close" [/usr/src/iscsi-init-4.0.1/iscsi_init.ko] undefined! > *** Warning: "read" [/usr/src/iscsi-init-4.0.1/iscsi_init.ko] undefined! > *** Warning: "open" [/usr/src/iscsi-init-4.0.1/iscsi_init.ko] undefined! > make[1]: Leaving directory `/usr/src/xeno-unstable.bk/linux-2.6.8.1-xenU'' > > and then of course close, read, and open are missing symbols. > > it looks like the definitions from <asm/unistd.h> have been taken away between 2.6.7 and 2.6.8. Any idea''s what should replace them? What should kernel code use for opening, reading, and closing files?------------------------------------------------------- This SF.Net email is sponsored by BEA Weblogic Workshop FREE Java Enterprise J2EE developer tools! Get your free copy of BEA WebLogic Workshop 8.1 today. http://ads.osdn.com/?ad_id=5047&alloc_id=10808&op=click _______________________________________________ Xen-devel mailing list Xen-devel@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/xen-devel
i cut''n''pasted them out of unistd.h in 2.6.7. appears to compile fine now. thanks James From: Keir Fraser Sent: Sun 29/08/2004 11:04 AM To: James Harper Cc: brianw@terrabox.com; xen-devel@lists.sourceforge.net Subject: Re: [Xen-devel] iSCSI root That''s a rather odd thing to do, as it''s not like there''s a generic EXPORT_SYMBOL''ed way to e.g. open a file. I can''t imagine why they''d have removed all wrappers except execve. Easiest workaround is just to roll your own wrappers around the syscalls using the _syscall* macros. -- Keir> Speaking of compiling, iscsi-init doesn''t seem to compile for me under 2.6.8.1. It tells me this: > > make -C /lib/modules/2.6.8.1-xenU/build SUBDIRS=/usr/src/iscsi-init-4.0.1 modules > make[1]: Entering directory `/usr/src/xeno-unstable.bk/linux-2.6.8.1-xenU'' > Building modules, stage 2. > MODPOST > *** Warning: "close" [/usr/src/iscsi-init-4.0.1/iscsi_init.ko] undefined! > *** Warning: "read" [/usr/src/iscsi-init-4.0.1/iscsi_init.ko] undefined! > *** Warning: "open" [/usr/src/iscsi-init-4.0.1/iscsi_init.ko] undefined! > make[1]: Leaving directory `/usr/src/xeno-unstable.bk/linux-2.6.8.1-xenU'' > > and then of course close, read, and open are missing symbols. > > it looks like the definitions from <asm/unistd.h> have been taken away between 2.6.7 and 2.6.8. Any idea''s what should replace them? What should kernel code use for opening, reading, and closing files?