thr3ads.net - Lustre discuss - [Lustre-discuss] Which partition to choose for mkfs.lustre [Apr 2009]

If this information is useful, please help other people find it:
Share via:

Gnanasekar Loganathan

2009-Apr-25 11:14 UTC

[Lustre-discuss] Which partition to choose for mkfs.lustre

Hi Brain,
my system environment!

[root at SF_02 ~]# rpm -qa | grep lustre
kernel-ib-1.3-2.6.9_67.0.22.EL_lustre.1.6.7.1smp
lustre-modules-1.6.7.1-2.6.9_67.0.22.EL_lustre.1.6.7.1smp
lustre-ldiskfs-3.0.7.1-2.6.9_67.0.22.EL_lustre.1.6.7.1smp
lustre-1.6.7.1-2.6.9_67.0.22.EL_lustre.1.6.7.1smp
kernel-lustre-smp-2.6.9-67.0.22.EL_lustre.1.6.7.1

[root at SF_02 ~]# rpm -qa | grep e2fs
e2fsprogs-1.35-12.17.el4
e2fsprogs-devel-1.35-12.17.el4
e2fsprogs-1.40.11.sun1-0redhat
e2fsprogs-1.35-12.17.el4

[root at SF_02 ~]# fdisk -l

Disk /dev/sda: 73.4 GB, 73407868928 bytes
255 heads, 63 sectors/track, 8924 cylinders
Units = cylinders of 16065 * 512 = 8225280 bytes

   Device Boot      Start         End      Blocks   Id  System
/dev/sda1   *        2550        5000    19687657+  83  Linux
/dev/sda2            5001        5383     3076447+  82  Linux swap

I have only a 2 partitions on my system.

If i run the command

''mkfs.lustre --mdt --mgs --fsname=large-fs /dev/sda''

the system will crash/corrupt.

can you guide me please, what are all the things i need to do further?


Thanks,
Gnana
-------------- next part --------------
An HTML attachment was scrubbed...
URL:
http://lists.lustre.org/pipermail/lustre-discuss/attachments/20090425/a0b4835f/attachment-0001.html

Brian J. Murrell

2009-Apr-27 12:34 UTC

head link

[Lustre-discuss] Which partition to choose for mkfs.lustre

On Sat, 2009-04-25 at 16:44 +0530, Gnanasekar Loganathan
wrote:> Hi Brain,
Hi,

> [root at SF_02 ~]# rpm -qa | grep e2fs
> e2fsprogs-1.35-12.17.el4
> e2fsprogs-devel-1.35-12.17.el4
> e2fsprogs-1.40.11.sun1-0redhat
> e2fsprogs-1.35-12.17.el4
Why do you have 3 e2fsprogs packages installed?  How did you manage to
do that?  If you used "rpm -i" rpm should have complained that you
already had e2fsprogs installed and if you used "rpm -U" it should
have
installed e2fsprogs-1.40.11.sun1-0redhat and removed
e2fsprogs-1.35-12.17.el4.
>    Device Boot      Start         End      Blocks   Id  System
> /dev/sda1   *        2550        5000    19687657+  83  Linux
> /dev/sda2            5001        5383     3076447+  82  Linux swap
> 
> 
> I have only a 2 partitions on my system.
Yes.  /dev/sda1 and /dev/sda2
> If i run the command
> 
> 
> ''mkfs.lustre --mdt --mgs --fsname=large-fs /dev/sda'' 
> 
> 
> the system will crash/corrupt.
Of course it will.  You are overwriting /dev/sda1 and /dev/sda2 (which
are your system and swap devices) doing this.  If you intend this
machine to be an MDS, you need to format some other
(than /dev/sda, /dev/sda1 or /dev/sda2) device.  I think perhaps you are
not quite understanding the architecture of Lustre.  I think a review of
the manual and probably the wiki will help you understand what the
components of a Lustre system are and how to install them.

b.

-------------- next part --------------
A non-text attachment was scrubbed...
Name: not available
Type: application/pgp-signature
Size: 197 bytes
Desc: This is a digitally signed message part
Url :
http://lists.lustre.org/pipermail/lustre-discuss/attachments/20090427/c69428f3/attachment.bin

Hendelman, Rob

2009-Apr-27 12:50 UTC

head link

[Lustre-discuss] Which partition to choose for mkfs.lustre

Hello,

You do realize you aer trying to format the entire disk, not the
partition correct?

On which partition is your OS installed?

Robert Hendelman Jr
Magnetar Capital LLC
Rob.Hendelman at magnetar.com
1-847-905-4557



The information contained in this message and its attachments 
is intended only for the private and confidential use of the 
intended recipient(s).  If you are not the intended recipient 
(or have received this e-mail in error) please notify the 
sender immediately and destroy this e-mail. Any unauthorized 
copying, disclosure or distribution of the material in this e-
mail is strictly prohibited.

Gnanasekar Loganathan

2009-Apr-28 03:38 UTC

head link

[Lustre-discuss] Which partition to choose for mkfs.lustre

Thanks brain.!I''ll try my best level and come back with good result.


Thanks,
Gnana




On Mon, Apr 27, 2009 at 6:04 PM, Brian J. Murrell <Brian.Murrell at
sun.com>wrote:
> On Sat, 2009-04-25 at 16:44 +0530, Gnanasekar Loganathan wrote:
> > Hi Brain,
>
> Hi,
>
>
> > [root at SF_02 ~]# rpm -qa | grep e2fs
> > e2fsprogs-1.35-12.17.el4
> > e2fsprogs-devel-1.35-12.17.el4
> > e2fsprogs-1.40.11.sun1-0redhat
> > e2fsprogs-1.35-12.17.el4
>
> Why do you have 3 e2fsprogs packages installed?  How did you manage to
> do that?  If you used "rpm -i" rpm should have complained that
you
> already had e2fsprogs installed and if you used "rpm -U" it
should have
> installed e2fsprogs-1.40.11.sun1-0redhat and removed
> e2fsprogs-1.35-12.17.el4.
>
> >    Device Boot      Start         End      Blocks   Id  System
> > /dev/sda1   *        2550        5000    19687657+  83  Linux
> > /dev/sda2            5001        5383     3076447+  82  Linux swap
> >
> >
> > I have only a 2 partitions on my system.
>
> Yes.  /dev/sda1 and /dev/sda2
>
> > If i run the command
> >
> >
> > ''mkfs.lustre --mdt --mgs --fsname=large-fs /dev/sda''
> >
> >
> > the system will crash/corrupt.
>
> Of course it will.  You are overwriting /dev/sda1 and /dev/sda2 (which
> are your system and swap devices) doing this.  If you intend this
> machine to be an MDS, you need to format some other
> (than /dev/sda, /dev/sda1 or /dev/sda2) device.  I think perhaps you are
> not quite understanding the architecture of Lustre.  I think a review of
> the manual and probably the wiki will help you understand what the
> components of a Lustre system are and how to install them.
>
> b.
>
>
> _______________________________________________
> Lustre-discuss mailing list
> Lustre-discuss at lists.lustre.org
> http://lists.lustre.org/mailman/listinfo/lustre-discuss
>
>-------------- next part --------------
An HTML attachment was scrubbed...
URL:
http://lists.lustre.org/pipermail/lustre-discuss/attachments/20090428/0f188564/attachment.html

Gnanasekar Loganathan

2009-Apr-28 03:39 UTC

head link

[Lustre-discuss] Which partition to choose for mkfs.lustre

Hi Rob,

my OS was installed in /dev/sda1 partition.


Thanks,
Gnana



On Mon, Apr 27, 2009 at 6:20 PM, Hendelman, Rob
<Rob.Hendelman at magnetar.com>wrote:
> Hello,
>
> You do realize you aer trying to format the entire disk, not the
> partition correct?
>
> On which partition is your OS installed?
>
> Robert Hendelman Jr
> Magnetar Capital LLC
> Rob.Hendelman at magnetar.com
> 1-847-905-4557
>
>
>
> The information contained in this message and its attachments
> is intended only for the private and confidential use of the
> intended recipient(s).  If you are not the intended recipient
> (or have received this e-mail in error) please notify the
> sender immediately and destroy this e-mail. Any unauthorized
> copying, disclosure or distribution of the material in this e-
> mail is strictly prohibited.
> _______________________________________________
> Lustre-discuss mailing list
> Lustre-discuss at lists.lustre.org
> http://lists.lustre.org/mailman/listinfo/lustre-discuss
>-------------- next part --------------
An HTML attachment was scrubbed...
URL:
http://lists.lustre.org/pipermail/lustre-discuss/attachments/20090428/0b0e0a1a/attachment.html

Gnanasekar Loganathan

2009-May-07 13:25 UTC

head link

[Lustre-discuss] Fwd: Which partition to choose for mkfs.lustre

Hi Brain,

Here the results of the lustre server.

[root at SF_01 mnt]# df -kh
Filesystem            Size  Used Avail Use% Mounted on
/dev/sda3             9.7G  6.1G  3.2G  66% /
none                 1004M     0 1004M   0% /dev/shm
/dev/loop0            342M   17M  306M   6% /mnt/mdt
/dev/loop1            275M   25M  236M  10% /mnt/ost
6.6.212.1 at o2ib:/lustre
                      275M   25M  236M  10% /mnt/lustre
[root at SF_01 mnt]#
[root at SF_01 mnt]# rpm -qa | grep lustre
lustre-modules-1.6.7.1-2.6.9_67.0.22.EL_lustre.1.6.7.1smp
 lustre-ldiskfs-3.0.7.1-2.6.9_67.0.22.EL_lustre.1.6.7.1smp
kernel-lustre-smp-2.6.9-67.0.22.EL_lustre.1.6.7.1
kernel-ib-1.3-2.6.9_67.0.22.EL_lustre.1.6.7.1smp
lustre-1.6.7.1-2.6.9_67.0.22.EL_lustre.1.6.7.1smp
[root at SF_01 mnt]#
[root at SF_01 mnt]# ifconfig ib0
ib0       Link encap:UNSPEC  HWaddr
80-00-04-04-FE-80-00-00-00-00-00-00-00-00-00-00
          inet addr:6.6.212.1  Bcast:6.6.255.255  Mask:255.255.0.0
          inet6 addr: fe80::205:ad00:8000:0/64 Scope:Link
          UP BROADCAST RUNNING MULTICAST  MTU:65520  Metric:1
          RX packets:19 errors:0 dropped:0 overruns:0 frame:0
          TX packets:9 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:256
          RX bytes:1348 (1.3 KiB)  TX bytes:672 (672.0 b)

[root at SF_01 mnt]#


I need help to configure the lustre-client .

Here the client details.

[root at SF_02 ~]# rpm -qa | grep lustre
kernel-ib-1.3-2.6.9_67.0.22.EL_lustre.1.6.7.1smp
lustre-modules-1.6.7.1-2.6.9_67.0.22.EL_lustre.1.6.7.1smp
lustre-ldiskfs-3.0.7.1-2.6.9_67.0.22.EL_lustre.1.6.7.1smp
lustre-1.6.7.1-2.6.9_67.0.22.EL_lustre.1.6.7.1smp
kernel-lustre-smp-2.6.9-67.0.22.EL_lustre.1.6.7.1

[root at SF_02 ~]# ifconfig ib1
ib1       Link encap:UNSPEC  HWaddr
80-00-04-05-FE-80-00-00-00-00-00-00-00-00-00-00
          inet addr:6.6.213.2  Bcast:6.6.255.255  Mask:255.255.0.0
          inet6 addr: fe80::205:ad00:5:7412/64 Scope:Link
          UP BROADCAST RUNNING MULTICAST  MTU:65520  Metric:1
          RX packets:0 errors:0 dropped:0 overruns:0 frame:0
          TX packets:10 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:256
          RX bytes:0 (0.0 b)  TX bytes:752 (752.0 b)

[root at SF_02 ~]# mount -t lustre  6.6.212.1 at o2ib:/lustre /mnt/lustre
mount.lustre: mount 6.6.212.1 at o2ib:/lustre at /mnt/lustre failed: No such
device
Are the lustre modules loaded?
Check /etc/modprobe.conf and /proc/filesystems
Note ''alias lustre llite'' should be removed from modprobe.conf

what are all the things i need to configure in client machine.
can you please guide me further ?!


The steps i followed,

insmod
/lib/modules/2.6.9-67.0.22.EL_lustre.1.6.7.1smp/kernel/net/lustre/libcfs.ko
insmod
/lib/modules/2.6.9-67.0.22.EL_lustre.1.6.7.1smp/kernel/net/lustre/lnet.ko
networks=o2ib
insmod
/lib/modules/2.6.9-67.0.22.EL_lustre.1.6.7.1smp/kernel/net/lustre/ko2iblnd.ko


mkfs.lustre --mgs --mdt --fsname=lustre --device-size=400000 --param
sys.timeout=20 --param lov.stripesize=1048576 --param lov.stripecount=0
--mountfsoptions=acl --backfstype ldiskfs --reformat /tmp/lustre-mdt

mkfs.lustre --ost --fsname=lustre --device-size=300000
--mgsnode=6.6.212.1 at o2ib --param sys.timeout=20 --backfstype ldiskfs
--reformat /tmp/lustre-ost1

tunefs.lustre --writeconf /tmp/lustre-mdt
mount -o loop -t lustre /tmp/lustre-mdt /mnt/mdt

mount -o loop -t lustre /tmp/lustre-ost1 /mnt/ost
e2label /tmp/lustre-mdt

mount.lustre -o user_xattr,acl 6.6.212.1 at o2ib:/lustre /mnt/lustre




Thanks,
Gnana




On Tue, Apr 28, 2009 at 9:08 AM, Gnanasekar Loganathan <
l.gnanasekar at gmail.com> wrote:
> Thanks brain.!I''ll try my best level and come back with good
result.
>
>
> Thanks,
> Gnana
>
>
>
>
> On Mon, Apr 27, 2009 at 6:04 PM, Brian J. Murrell <Brian.Murrell at
sun.com>wrote:
>
>> On Sat, 2009-04-25 at 16:44 +0530, Gnanasekar Loganathan wrote:
>> > Hi Brain,
>>
>> Hi,
>>
>>
>> > [root at SF_02 ~]# rpm -qa | grep e2fs
>> > e2fsprogs-1.35-12.17.el4
>> > e2fsprogs-devel-1.35-12.17.el4
>> > e2fsprogs-1.40.11.sun1-0redhat
>> > e2fsprogs-1.35-12.17.el4
>>
>> Why do you have 3 e2fsprogs packages installed?  How did you manage to
>> do that?  If you used "rpm -i" rpm should have complained
that you
>> already had e2fsprogs installed and if you used "rpm -U" it
should have
>> installed e2fsprogs-1.40.11.sun1-0redhat and removed
>> e2fsprogs-1.35-12.17.el4.
>>
>> >    Device Boot      Start         End      Blocks   Id  System
>> > /dev/sda1   *        2550        5000    19687657+  83  Linux
>> > /dev/sda2            5001        5383     3076447+  82  Linux swap
>> >
>> >
>> > I have only a 2 partitions on my system.
>>
>> Yes.  /dev/sda1 and /dev/sda2
>>
>> > If i run the command
>> >
>> >
>> > ''mkfs.lustre --mdt --mgs --fsname=large-fs
/dev/sda''
>> >
>> >
>> > the system will crash/corrupt.
>>
>> Of course it will.  You are overwriting /dev/sda1 and /dev/sda2 (which
>> are your system and swap devices) doing this.  If you intend this
>> machine to be an MDS, you need to format some other
>> (than /dev/sda, /dev/sda1 or /dev/sda2) device.  I think perhaps you
are
>> not quite understanding the architecture of Lustre.  I think a review
of
>> the manual and probably the wiki will help you understand what the
>> components of a Lustre system are and how to install them.
>>
>> b.
>>
>>
>> _______________________________________________
>> Lustre-discuss mailing list
>> Lustre-discuss at lists.lustre.org
>> http://lists.lustre.org/mailman/listinfo/lustre-discuss
>>
>>
>-------------- next part --------------
An HTML attachment was scrubbed...
URL:
http://lists.lustre.org/pipermail/lustre-discuss/attachments/20090507/0b6842a4/attachment-0001.html

Brian J. Murrell

2009-May-07 13:32 UTC

head link

[Lustre-discuss] Fwd: Which partition to choose for mkfs.lustre

On Thu, 2009-05-07 at 18:55 +0530, Gnanasekar Loganathan wrote:

> [root at SF_02 ~]# mount -t lustre  6.6.212.1 at o2ib:/lustre /mnt/lustre                                            ^^^^^
Have you actually configured lnet to use o2ib on all of your nodes?  See
the lustre manual for details on configuring lnet.
> mount.lustre: mount 6.6.212.1 at o2ib:/lustre at /mnt/lustre failed: No
> such device
Typically after such an error, "dmesg" has useful information in it.
Alternatively, /var/log/messages (depending on how your syslog is
configured) probably has the same info.

b.



-------------- next part --------------
A non-text attachment was scrubbed...
Name: not available
Type: application/pgp-signature
Size: 197 bytes
Desc: This is a digitally signed message part
Url :
http://lists.lustre.org/pipermail/lustre-discuss/attachments/20090507/24c831cb/attachment.bin

Lustre discuss - Apr 2009 - Which partition to choose for mkfs.lustre

[Lustre-discuss] Which partition to choose for mkfs.lustre

[Lustre-discuss] Which partition to choose for mkfs.lustre

[Lustre-discuss] Which partition to choose for mkfs.lustre

[Lustre-discuss] Which partition to choose for mkfs.lustre

[Lustre-discuss] Which partition to choose for mkfs.lustre

[Lustre-discuss] Fwd: Which partition to choose for mkfs.lustre

[Lustre-discuss] Fwd: Which partition to choose for mkfs.lustre