Stephen Yum
2009-Jan-09 00:27 UTC
[zfs-discuss] Desperate question about MPXIO with ZFS-iSCSI
I''m trying to set up a iscsi connection (with MPXIO) between my Vista64 workstation and a ZFS storage machine running OpenSolaris 10 (forget the exact version). On the ZFS machines, I have two NICS. NIC #1 is 192.168.1.102, and NIC #2 is 192.168.2.102. The NICs are connected to two separate switches serving two separate IP spaces. On my Vista64 machine, I also have two NICs connected in a similar fashion, with NIC #1 assigned with 192.168.1.103, and NIC #2 with 192.168.2.103. Now, I fiddled around with the MS iSCSI intiator seemingly endlessly, and I can''t get it to recognize my ZFS iSCSI volume as being MPIO enabled. It just shows up in the initiator panel simply as ''Disk''. Either I have not configured the ZFS end correctly to do MPXIO, or I''m not able to set the volume up as MPIO volume on the Vista64 end. I Googled endlessly to find some sort of a howto, but I came up virtually with nothing. Can any enlightened guru out there point me to a good howto or explain to me via this mailing list how to set it up correctly? Please??? I''m at my wit''s end here. Thank you so much in advance S
Hi S, sorry, as much as I am Super z, this is beyond me. maybe you can go to china town for a seafood dinner (they are on sale worldwide now), and see if Sun folks would reply? best, z ----- Original Message ----- From: "Stephen Yum" <sosurim at yahoo.com> To: <zfs-discuss at opensolaris.org>; <storage-discuss at opensolaris.org> Sent: Thursday, January 08, 2009 7:27 PM Subject: [zfs-discuss] Desperate question about MPXIO with ZFS-iSCSI> I''m trying to set up a iscsi connection (with MPXIO) between my Vista64 > workstation and a ZFS storage machine running OpenSolaris 10 (forget the > exact version). > > On the ZFS machines, I have two NICS. NIC #1 is 192.168.1.102, and NIC #2 > is 192.168.2.102. The NICs are connected to two separate switches serving > two separate IP spaces. > > On my Vista64 machine, I also have two NICs connected in a similar > fashion, with NIC #1 assigned with 192.168.1.103, and NIC #2 with > 192.168.2.103. > > Now, I fiddled around with the MS iSCSI intiator seemingly endlessly, and > I can''t get it to recognize my ZFS iSCSI volume as being MPIO enabled. It > just shows up in the initiator panel simply as ''Disk''. Either I have not > configured the ZFS end correctly to do MPXIO, or I''m not able to set the > volume up as MPIO volume on the Vista64 end. > > I Googled endlessly to find some sort of a howto, but I came up virtually > with nothing. Can any enlightened guru out there point me to a good howto > or explain to me via this mailing list how to set it up correctly? > Please??? I''m at my wit''s end here. > > Thank you so much in advance > > S > > > > > > _______________________________________________ > zfs-discuss mailing list > zfs-discuss at opensolaris.org > http://mail.opensolaris.org/mailman/listinfo/zfs-discuss
Stephen Yum
2009-Jan-09 01:13 UTC
[zfs-discuss] Desperate question about MPXIO with ZFS-iSCSI
No prob z. When seeing your name, it keeps reminding me of the famous rapper. Which Chinatown are they at? SF? S ----- Original Message ---- From: JZ <jz at excelsioritsolutions.com> To: Stephen Yum <sosurim at yahoo.com>; zfs-discuss at opensolaris.org; storage-discuss at opensolaris.org Sent: Thursday, January 8, 2009 4:31:05 PM Subject: Re: [zfs-discuss] Desperate question about MPXIO with ZFS-iSCSI Hi S, sorry, as much as I am Super z, this is beyond me. maybe you can go to china town for a seafood dinner (they are on sale worldwide now), and see if Sun folks would reply? best, z ----- Original Message ----- From: "Stephen Yum" <sosurim at yahoo.com> To: <zfs-discuss at opensolaris.org>; <storage-discuss at opensolaris.org> Sent: Thursday, January 08, 2009 7:27 PM Subject: [zfs-discuss] Desperate question about MPXIO with ZFS-iSCSI> I''m trying to set up a iscsi connection (with MPXIO) between my Vista64 workstation and a ZFS storage machine running OpenSolaris 10 (forget the exact version). > > On the ZFS machines, I have two NICS. NIC #1 is 192.168.1.102, and NIC #2 is 192.168.2.102. The NICs are connected to two separate switches serving two separate IP spaces. > > On my Vista64 machine, I also have two NICs connected in a similar fashion, with NIC #1 assigned with 192.168.1.103, and NIC #2 with 192.168.2.103. > > Now, I fiddled around with the MS iSCSI intiator seemingly endlessly, and I can''t get it to recognize my ZFS iSCSI volume as being MPIO enabled. It just shows up in the initiator panel simply as ''Disk''. Either I have not configured the ZFS end correctly to do MPXIO, or I''m not able to set the volume up as MPIO volume on the Vista64 end. > > I Googled endlessly to find some sort of a howto, but I came up virtually with nothing. Can any enlightened guru out there point me to a good howto or explain to me via this mailing list how to set it up correctly? Please??? I''m at my wit''s end here. > > Thank you so much in advance > > S > > > > > > _______________________________________________ > zfs-discuss mailing list > zfs-discuss at opensolaris.org > http://mail.opensolaris.org/mailman/listinfo/zfs-discuss
Dear S, that''s a regional question beyond our global chinatown inniatives. in NYC, we have the Old, Original chinatown in the city; we have the newer [but I don''t go much since that one is more Taiwan than PRC] in Flushing Queens; we have the Cantooness chinatowns in Brooklyn 8th Ave, and Ave U, which have really nice seafood, that I think would be suitable for your hongkong taste... And we have some private ones... yours, z ----- Original Message ----- From: "Stephen Yum" <sosurim at yahoo.com> To: "JZ" <jz at excelsioritsolutions.com>; <zfs-discuss at opensolaris.org>; <storage-discuss at opensolaris.org> Sent: Thursday, January 08, 2009 8:13 PM Subject: Re: [zfs-discuss] Desperate question about MPXIO with ZFS-iSCSI> No prob z. When seeing your name, it keeps reminding me of the famous > rapper. > Which Chinatown are they at? SF? > > S > > > > ----- Original Message ---- > From: JZ <jz at excelsioritsolutions.com> > To: Stephen Yum <sosurim at yahoo.com>; zfs-discuss at opensolaris.org; > storage-discuss at opensolaris.org > Sent: Thursday, January 8, 2009 4:31:05 PM > Subject: Re: [zfs-discuss] Desperate question about MPXIO with ZFS-iSCSI > > Hi S, > sorry, as much as I am Super z, > this is beyond me. > maybe you can go to china town for a seafood dinner (they are on sale > worldwide now), and see if Sun folks would reply? > > best, > z > > > > ----- Original Message ----- From: "Stephen Yum" <sosurim at yahoo.com> > To: <zfs-discuss at opensolaris.org>; <storage-discuss at opensolaris.org> > Sent: Thursday, January 08, 2009 7:27 PM > Subject: [zfs-discuss] Desperate question about MPXIO with ZFS-iSCSI > > >> I''m trying to set up a iscsi connection (with MPXIO) between my Vista64 >> workstation and a ZFS storage machine running OpenSolaris 10 (forget the >> exact version). >> >> On the ZFS machines, I have two NICS. NIC #1 is 192.168.1.102, and NIC #2 >> is 192.168.2.102. The NICs are connected to two separate switches serving >> two separate IP spaces. >> >> On my Vista64 machine, I also have two NICs connected in a similar >> fashion, with NIC #1 assigned with 192.168.1.103, and NIC #2 with >> 192.168.2.103. >> >> Now, I fiddled around with the MS iSCSI intiator seemingly endlessly, and >> I can''t get it to recognize my ZFS iSCSI volume as being MPIO enabled. It >> just shows up in the initiator panel simply as ''Disk''. Either I have not >> configured the ZFS end correctly to do MPXIO, or I''m not able to set the >> volume up as MPIO volume on the Vista64 end. >> >> I Googled endlessly to find some sort of a howto, but I came up virtually >> with nothing. Can any enlightened guru out there point me to a good howto >> or explain to me via this mailing list how to set it up correctly? >> Please??? I''m at my wit''s end here. >> >> Thank you so much in advance >> >> S >> >> >> >> >> >> _______________________________________________ >> zfs-discuss mailing list >> zfs-discuss at opensolaris.org >> http://mail.opensolaris.org/mailman/listinfo/zfs-discuss > > > >
Dave Brown
2009-Jan-09 01:29 UTC
[zfs-discuss] Desperate question about MPXIO with ZFS-iSCSI
S, Are you sure you have MPXIO turned on? I haven''t dealt with Solaris for a while (will again soon as I get some virtual servers setup) but in the past you had to manually turn it on. I believe the path was /kernel/drv/scsi_vhci.h (I may be missing some of the path) and you changed the line that said mpxio_disabled = yes to mpxio_disabled = no and rebooted. D JZ wrote:> Hi S, > sorry, as much as I am Super z, > this is beyond me. > maybe you can go to china town for a seafood dinner (they are on sale > worldwide now), and see if Sun folks would reply? > > best, > z > > > > ----- Original Message ----- > From: "Stephen Yum" <sosurim at yahoo.com> > To: <zfs-discuss at opensolaris.org>; <storage-discuss at opensolaris.org> > Sent: Thursday, January 08, 2009 7:27 PM > Subject: [zfs-discuss] Desperate question about MPXIO with ZFS-iSCSI > > > >> I''m trying to set up a iscsi connection (with MPXIO) between my Vista64 >> workstation and a ZFS storage machine running OpenSolaris 10 (forget the >> exact version). >> >> On the ZFS machines, I have two NICS. NIC #1 is 192.168.1.102, and NIC #2 >> is 192.168.2.102. The NICs are connected to two separate switches serving >> two separate IP spaces. >> >> On my Vista64 machine, I also have two NICs connected in a similar >> fashion, with NIC #1 assigned with 192.168.1.103, and NIC #2 with >> 192.168.2.103. >> >> Now, I fiddled around with the MS iSCSI intiator seemingly endlessly, and >> I can''t get it to recognize my ZFS iSCSI volume as being MPIO enabled. It >> just shows up in the initiator panel simply as ''Disk''. Either I have not >> configured the ZFS end correctly to do MPXIO, or I''m not able to set the >> volume up as MPIO volume on the Vista64 end. >> >> I Googled endlessly to find some sort of a howto, but I came up virtually >> with nothing. Can any enlightened guru out there point me to a good howto >> or explain to me via this mailing list how to set it up correctly? >> Please??? I''m at my wit''s end here. >> >> Thank you so much in advance >> >> S >> >> >> >> >> >> _______________________________________________ >> zfs-discuss mailing list >> zfs-discuss at opensolaris.org >> http://mail.opensolaris.org/mailman/listinfo/zfs-discuss >> > > _______________________________________________ > zfs-discuss mailing list > zfs-discuss at opensolaris.org > http://mail.opensolaris.org/mailman/listinfo/zfs-discuss > > >
James C. McPherson
2009-Jan-09 02:26 UTC
[zfs-discuss] Desperate question about MPXIO with ZFS-iSCSI
On Thu, 08 Jan 2009 17:29:10 -0800 Dave Brown <dbrown at csolutions.net> wrote:> S, > Are you sure you have MPXIO turned on? I haven''t dealt with > Solaris for a while (will again soon as I get some virtual servers > setup) but in the past you had to manually turn it on. I believe the > path was /kernel/drv/scsi_vhci.h (I may be missing some of the path) > and you changed the line that said mpxio_disabled = yes to > mpxio_disabled = no and rebooted.That used to be the case prior to Solaris 10 Update 1. Since S10u1 the supported way of turning on MPxIO is to run the command # /usr/sbin/stmsboot -e If you manually edit /kernel/drv/fp.conf or /kernel/drv/fp.conf to change the mpxio-disable property, you *must* also run # /usr/sbin/stmsboot -u Please see stmsboot(1m) for more details. James C. McPherson -- Senior Kernel Software Engineer, Solaris Sun Microsystems http://blogs.sun.com/jmcp http://www.jmcp.homeunix.com/blog
Jim Dunham
2009-Jan-09 21:39 UTC
[zfs-discuss] Desperate question about MPXIO with ZFS-iSCSI
Stephen,> I''m trying to set up a iscsi connection (with MPXIO) between my > Vista64 workstation and a ZFS storage machine running OpenSolaris 10 > (forget the exact version). > > On the ZFS machines, I have two NICS. NIC #1 is 192.168.1.102, and > NIC #2 is 192.168.2.102. The NICs are connected to two separate > switches serving two separate IP spaces. > > On my Vista64 machine, I also have two NICs connected in a similar > fashion, with NIC #1 assigned with 192.168.1.103, and NIC #2 with > 192.168.2.103. > > Now, I fiddled around with the MS iSCSI intiator seemingly > endlessly, and I can''t get it to recognize my ZFS iSCSI volume as > being MPIO enabled. It just shows up in the initiator panel simply > as ''Disk''. Either I have not configured the ZFS end correctly to do > MPXIO, or I''m not able to set the volume up as MPIO volume on the > Vista64 end. > > I Googled endlessly to find some sort of a howto, but I came up > virtually with nothing. Can any enlightened guru out there point me > to a good howto or explain to me via this mailing list how to set it > up correctly? Please??? I''m at my wit''s end here.Just to clear up one misconception first. Solaris MPxIO is SCSI / iSCSI Initiator functionality, and has no data path relevance to the iSCSI Target on your ZFS machines, where you have NICs #1 & #2. MPxIO works with the iSCSI Initiator on Solaris, just like MS MPIO works with the iSCSI Initiator on Windows. The specific thing you are missing in regards to configuring MS MPIO to use multiple paths out of the Windows platform, to multiple paths into the Solaris platform is contained on the "Advanced Settings" iSCSI Dialog box. Using the following URL for reference: http://www.zdnetasia.com/techguide/storage/0,39045058,62030894,00.htm First select "[ ] Enable multi-path", then press the [ Advance ... ] tab. -------------- next part -------------- A non-text attachment was scrubbed... Name: pastedGraphic.tiff Type: image/tiff Size: 324238 bytes Desc: not available URL: <http://mail.opensolaris.org/pipermail/zfs-discuss/attachments/20090109/7f22e28c/attachment.tiff> -------------- next part -------------- This will bring up the following dialog box. -------------- next part -------------- A non-text attachment was scrubbed... Name: pastedGraphic.tiff Type: image/tiff Size: 830718 bytes Desc: not available URL: <http://mail.opensolaris.org/pipermail/zfs-discuss/attachments/20090109/7f22e28c/attachment-0001.tiff> -------------- next part -------------- Under the setting for "Local adapter:", select "Microsoft iSCSI Initiator" Under the setting for "Source IP", select one of your pre-configured IP addresses. Under the setting for "Target Portal", select one of the Solaris IP addresses. Press OK Press the [ Advance ... ] tab for each additional pair of "Source IP" and "Target Portal" IP address you needed to configure. If either the iSCSI Initiator or iSCSI Target has just a single port, you can reuse its IP address in in a subsequent configuration. One each pair has been configured, press OK in the "Log On to Target" dialog box. This brings one back to the "iSCSI Initiator Properties" dialog box, where there is now one or more "Connected" targets. -------------- next part -------------- A non-text attachment was scrubbed... Name: pastedGraphic.tiff Type: image/tiff Size: 763606 bytes Desc: not available URL: <http://mail.opensolaris.org/pipermail/zfs-discuss/attachments/20090109/7f22e28c/attachment-0002.tiff> -------------- next part -------------- Selecting one of these Targets, and pressing [ Details ], will display each of the sessions that have been established. -------------- next part -------------- A non-text attachment was scrubbed... Name: pastedGraphic.tiff Type: image/tiff Size: 137578 bytes Desc: not available URL: <http://mail.opensolaris.org/pipermail/zfs-discuss/attachments/20090109/7f22e28c/attachment-0003.tiff> -------------- next part -------------- By selecting one of the "Identifiers" and pressing the [ Connections ] tab, a "Session Connections" dialog is shown. -------------- next part -------------- A non-text attachment was scrubbed... Name: pastedGraphic.tiff Type: image/tiff Size: 132133 bytes Desc: not available URL: <http://mail.opensolaris.org/pipermail/zfs-discuss/attachments/20090109/7f22e28c/attachment-0004.tiff> -------------- next part -------------- Within this dialog box, MS MPIO properties can be viewed and adjusted if needed. - Jim Dunham> > Thank you so much in advance > > S > > > > > > _______________________________________________ > zfs-discuss mailing list > zfs-discuss at opensolaris.org > http://mail.opensolaris.org/mailman/listinfo/zfs-discuss
Stephen Yum
2009-Jan-10 00:51 UTC
[zfs-discuss] Desperate question about MPXIO with ZFS-iSCSI
Hi James, I set ''mpxio_disable = no'' in the /kernel/drv/iscsi.conf file (not /kernel/drv/scsi_vhci.h) and tried running /usr/bin/stmsboot -e. It then listed the pci ids of the NICs, and I said yes and rebooted. Still no joy. At this point, I''m assuming that my Solaris/ZFS box is enabled for MPXIO. But I''m having a b**** of a time trying to get vista64 to get it to recognize MPIO. Using the MS iSCSI intiator, I tried mounting the iSCSI volume with one login, two logins, but MPIO doesn''t work. Mounted with one login, I tried adding another connection, but it bonks out saying "Too many connections". When I login using both the 192.168.1.102 and 192.168.2.102, they both appear in the identifier section, pointing to the same one volume, but under devices, they appear as two separate devices as "Disk drive" not MPIO. And when I down the main NIC, the volume disappears. When I down the secondary NIC, it keeps working, meaning that it''s not really using the secondary NIC. Am I making any sense? Can you help me? Is there anyone out there using MPXIO successfully with a ZFS machine as the iSCSI target? S ----- Original Message ---- From: James C. McPherson <James.McPherson at Sun.COM> To: Dave Brown <dbrown at csolutions.net> Cc: zfs-discuss at opensolaris.org; storage-discuss at opensolaris.org Sent: Thursday, January 8, 2009 6:26:11 PM Subject: Re: [zfs-discuss] Desperate question about MPXIO with ZFS-iSCSI On Thu, 08 Jan 2009 17:29:10 -0800 Dave Brown <dbrown at csolutions.net> wrote:> S, > Are you sure you have MPXIO turned on? I haven''t dealt with > Solaris for a while (will again soon as I get some virtual servers > setup) but in the past you had to manually turn it on. I believe the > path was /kernel/drv/scsi_vhci.h (I may be missing some of the path) > and you changed the line that said mpxio_disabled = yes to > mpxio_disabled = no and rebooted.That used to be the case prior to Solaris 10 Update 1. Since S10u1 the supported way of turning on MPxIO is to run the command vi # /usr/sbin/stmsboot -e If you manually edit /kernel/drv/fp.conf or /kernel/drv/fp.conf to change the mpxio-disable property, you *must* also run # /usr/sbin/stmsboot -u Please see stmsboot(1m) for more details. James C. McPherson -- Senior Kernel Software Engineer, Solaris Sun Microsystems http://blogs.sun.com/jmcp http://www.jmcp.homeunix.com/blog _______________________________________________ zfs-discuss mailing list zfs-discuss at opensolaris.org http://mail.opensolaris.org/mailman/listinfo/zfs-discuss