Do folks have instructions of how to install Lustre client on Intel Xeon Phi ? I''m on a relatively old MPSS (mpss_gold_update_3, mic-2.1.6720 linux 2.6.18 kernel). Other cluster nodes run Lustre-1.8.8. Thanks, Wendy
The support of Lustre for Intel Xeon Phi with MPSS 2.1 was introduced in Lustre 2.4. Then the support was extended for MPSS 3.x but in Lustre 2.5 only. How to compile Lustre with MPSS 2.1 Got to http://software.intel.com/en-us/articles/intel-manycore-platform-software-stack-mpss and download the SOURCE package. Unpack it and find the package-full_src-k1om.tar.bz2 file. Unpack this archive in any location, for example in "/opt/intel/mic/src", then go to this location and execute the following commands: make defconfig-miclinux make -C card/kernel ARCH=k1om modules_prepare Now the Intel Xeon Phi kernel is ready for Lustre compilation. Go to location with Lustre sources and execute the following commands: # NOTE: You should have "intel-mic-gpl-<version>.x86_64" package installed. export PATH=/usr/linux-k1om-4.7/bin:$PATH sh autogen.sh ./configure --with-linux=/opt/intel/mic/src/card/kernel \ --disable-server --disable-tests --disable-doc --without-o2ib \ --host=x86_64-k1om-linux --build=x86_64-pc-linux make rpms The following RPMs should be installed on Intel Xeon host with Phi card and Lustre will be deployed to Phi card: lustre-client-mic-<version>.x86_64.rpm lustre-client-mic-modules-<version>.x86_64.rpm After MPSS service restart it''s ready to configure and use. Dmitry.> -----Original Message----- > From: lustre-devel-bounces-aLEFhgZF4x6X6Mz3xDxJMA@public.gmane.org [mailto:lustre-devel- > bounces-aLEFhgZF4x6X6Mz3xDxJMA@public.gmane.org] On Behalf Of Wendy Cheng > Sent: Tuesday, October 01, 2013 3:18 AM > To: Lustre-devel-aLEFhgZF4x6X6Mz3xDxJMA@public.gmane.org > Subject: [Lustre-devel] Lustre on Intel Xeon Phi > > Do folks have instructions of how to install Lustre client on Intel Xeon Phi ? > I''m on a relatively old MPSS (mpss_gold_update_3, > mic-2.1.6720 linux 2.6.18 kernel). Other cluster nodes run Lustre-1.8.8. > > Thanks, Wendy > _______________________________________________ > Lustre-devel mailing list > Lustre-devel-aLEFhgZF4x6X6Mz3xDxJMA@public.gmane.org > http://lists.lustre.org/mailman/listinfo/lustre-devel-------------------------------------------------------------------- Closed Joint Stock Company Intel A/O Registered legal address: Krylatsky Hills Business Park, 17 Krylatskaya Str., Bldg 4, Moscow 121614, Russian Federation This e-mail and any attachments may contain confidential material for the sole use of the intended recipient(s). Any review or distribution by others is strictly prohibited. If you are not the intended recipient, please contact the sender and delete all copies.
On Fri, Oct 4, 2013 at 4:53 AM, Eremin, Dmitry <dmitry.eremin-ral2JQCrhuEAvxtiuMwx3w@public.gmane.org> wrote:> The support of Lustre for Intel Xeon Phi with MPSS 2.1 was introduced in Lustre 2.4. Then the support was extended for MPSS 3.x but in Lustre 2.5 only. >Great thanks ! .. So I took mpss_gold_update_3-2.1.6720-19 source, plus the master branch by doing a "git clone git://git.whamcloud.com/fs/lustre-release.git" The "configure" seems to run fine but "make rpms" wants two non-exist files as the following: RPM build errors: File not found: /root/rpmbuild/BUILDROOT/lustre-client-mic-2.4.93-2.6.38.8_g2593b11_g26c55b2.x86_64/opt/lustre/2.4.93/x86_64-k1om-linux/usr/bin/mcreate File not found: /root/rpmbuild/BUILDROOT/lustre-client-mic-2.4.93-2.6.38.8_g2593b11_g26c55b2.x86_64/opt/lustre/2.4.93/x86_64-k1om-linux/usr/bin/munlink Do I have any workaround ? I would prefer the master branch, instead of going back to 2.4, if all possible. Thanks, Wendy> How to compile Lustre with MPSS 2.1 > > Got to http://software.intel.com/en-us/articles/intel-manycore-platform-software-stack-mpss and download the SOURCE package. Unpack it and find the package-full_src-k1om.tar.bz2 file. Unpack this archive in any location, for example in "/opt/intel/mic/src", then go to this location and execute the following commands: > > make defconfig-miclinux > make -C card/kernel ARCH=k1om modules_prepare > > Now the Intel Xeon Phi kernel is ready for Lustre compilation. Go to location with Lustre sources and execute the following commands: > > # NOTE: You should have "intel-mic-gpl-<version>.x86_64" package installed. > export PATH=/usr/linux-k1om-4.7/bin:$PATH > sh autogen.sh > ./configure --with-linux=/opt/intel/mic/src/card/kernel \ > --disable-server --disable-tests --disable-doc --without-o2ib \ > --host=x86_64-k1om-linux --build=x86_64-pc-linux > make rpms > > The following RPMs should be installed on Intel Xeon host with Phi card and Lustre will be deployed to Phi card: > > lustre-client-mic-<version>.x86_64.rpm > lustre-client-mic-modules-<version>.x86_64.rpm > > After MPSS service restart it''s ready to configure and use. > > Dmitry. >> -----Original Message----- >> From: lustre-devel-bounces-aLEFhgZF4x6X6Mz3xDxJMA@public.gmane.org [mailto:lustre-devel- >> bounces-aLEFhgZF4x6X6Mz3xDxJMA@public.gmane.org] On Behalf Of Wendy Cheng >> Sent: Tuesday, October 01, 2013 3:18 AM >> To: Lustre-devel-aLEFhgZF4x6X6Mz3xDxJMA@public.gmane.org >> Subject: [Lustre-devel] Lustre on Intel Xeon Phi >> >> Do folks have instructions of how to install Lustre client on Intel Xeon Phi ? >> I''m on a relatively old MPSS (mpss_gold_update_3, >> mic-2.1.6720 linux 2.6.18 kernel). Other cluster nodes run Lustre-1.8.8. >> >> Thanks, Wendy >> _______________________________________________ >> Lustre-devel mailing list >> Lustre-devel-aLEFhgZF4x6X6Mz3xDxJMA@public.gmane.org >> http://lists.lustre.org/mailman/listinfo/lustre-devel > > -------------------------------------------------------------------- > Closed Joint Stock Company Intel A/O > Registered legal address: Krylatsky Hills Business Park, > 17 Krylatskaya Str., Bldg 4, Moscow 121614, > Russian Federation > > This e-mail and any attachments may contain confidential material for > the sole use of the intended recipient(s). Any review or distribution > by others is strictly prohibited. If you are not the intended > recipient, please contact the sender and delete all copies.
On Sat, Oct 5, 2013 at 3:01 AM, Eremin, Dmitry <dmitry.eremin-ral2JQCrhuEAvxtiuMwx3w@public.gmane.org> wrote:> Sorry, after recent reorganization it was broken. I will fix this. But now you can just remove "--disable-tests" option from configure. The build will be a bit longer but error should gone. Those binaries produced for testing needs. >Thanks for the help ! The Xeon Phi Lustre client is now up and running on top of Infiniband RDMA using * Intel Xeon Phi MPSS 2.1 (mpss_gold_update_3-2.1.6720-16) * Lustre-release from git master branch * A private version of OFED There was a kernel panic at lmv_get_info() during mount time but the problem has been fixed. As the issue seems to be generic (not MPSS specific), will start another thread to discuss it. Again, your responses and help are very appreciated. -- Wendy