Wojciech Turek
2007-Aug-17 09:11 UTC
[Lustre-discuss] Re: MGS MDS not combined (lustre 1.6.1)
On 17 Aug 2007, at 16:04, Wojciech Turek wrote:> Hi, > > I have two short questions: > 1) Is it better to configure MGS on different partition then MDT? > For example: > I have node01 which has two partitions /dev/sda1 and /dev/sda2 > I am planning to create MGS on /dev/sda1 and MDT on /dev/sda2 > > 2) If above is actually possible? I read in manual follwing: > > 3 Start Lustre on the MGS node. > $ mkfs.lustre --mgs /dev/sda > 4 Make a mount point on MGS for the file system and mount it. > $ mkdir -p /mnt/mgs > $ mount -t lustre /dev/sda1 /mnt/mgs > > It looks like I will have to create mgs on entire device /dev/sda > and then mount it using /dev/sda1 Is that right or typo? > > Regards > > Wojciech Turek >-------------- next part -------------- An HTML attachment was scrubbed... URL: http://mail.clusterfs.com/pipermail/lustre-discuss/attachments/20070817/9bdc727d/attachment.html
Anand Bisen
2007-Aug-17 10:37 UTC
[Lustre-discuss] Re: MGS MDS not combined (lustre 1.6.1)
Wojciech, For question 2: it''s a typo. it should be /dev/sda1 and not /dev/sda (or if you are using the whole device then vice versa, both would work). For question 1: I think either the MGS should be on a separate machine and if MDT and MGS are co-located on a single node, i don''t think it would make a big difference if they are on different partitions (sda1, sda2) or not. Although depending upon the total number of client''s and their frequency of mount''s/umount''s it might help keeping those IO''s on a different block device (sda, sdb). Thanks Anand On Aug 17, 2007, at 8:11 AM, Wojciech Turek wrote:> > On 17 Aug 2007, at 16:04, Wojciech Turek wrote: > >> Hi, >> >> I have two short questions: >> 1) Is it better to configure MGS on different partition then MDT? >> For example: >> I have node01 which has two partitions /dev/sda1 and /dev/sda2 >> I am planning to create MGS on /dev/sda1 and MDT on /dev/sda2 >> >> 2) If above is actually possible? I read in manual follwing: >> >> 3 Start Lustre on the MGS node. >> $ mkfs.lustre --mgs /dev/sda >> 4 Make a mount point on MGS for the file system and mount it. >> $ mkdir -p /mnt/mgs >> $ mount -t lustre /dev/sda1 /mnt/mgs >> >> It looks like I will have to create mgs on entire device /dev/sda >> and then mount it using /dev/sda1 Is that right or typo? >> >> Regards >> >> Wojciech Turek >> > > > > _______________________________________________ > Lustre-discuss mailing list > Lustre-discuss@clusterfs.com > https://mail.clusterfs.com/mailman/listinfo/lustre-discuss-------------- next part -------------- An HTML attachment was scrubbed... URL: http://mail.clusterfs.com/pipermail/lustre-discuss/attachments/20070817/ad676d91/attachment-0001.html
Wojciech Turek
2007-Aug-17 12:05 UTC
[Lustre-discuss] Re: MGS MDS not combined (lustre 1.6.1)
Hi, Thanks for you answers. Please let me ask another questions. 1) Are there any recommendations regarding size of block device for mgs ? 2) Also do I need to have any raid configuration for mgs block device. 3) If I would lost mgs device what are the steps to recreate it and get access to filesystem Thanks You Wojciech On 17 Aug 2007, at 17:37, Anand Bisen wrote:> Wojciech, > > For question 2: it''s a typo. it should be /dev/sda1 and not /dev/ > sda (or if you are using the whole device then vice versa, both > would work). > > For question 1: I think either the MGS should be on a separate > machine and if MDT and MGS are co-located on a single node, i don''t > think it would make a big difference if they are on different > partitions (sda1, sda2) or not. Although depending upon the total > number of client''s and their frequency of mount''s/umount''s it might > help keeping those IO''s on a different block device (sda, sdb). > > Thanks > > Anand > > > > > On Aug 17, 2007, at 8:11 AM, Wojciech Turek wrote: > >> >> On 17 Aug 2007, at 16:04, Wojciech Turek wrote: >> >>> Hi, >>> >>> I have two short questions: >>> 1) Is it better to configure MGS on different partition then MDT? >>> For example: >>> I have node01 which has two partitions /dev/sda1 and /dev/sda2 >>> I am planning to create MGS on /dev/sda1 and MDT on /dev/sda2 >>> >>> 2) If above is actually possible? I read in manual follwing: >>> >>> 3 Start Lustre on the MGS node. >>> $ mkfs.lustre --mgs /dev/sda >>> 4 Make a mount point on MGS for the file system and mount it. >>> $ mkdir -p /mnt/mgs >>> $ mount -t lustre /dev/sda1 /mnt/mgs >>> >>> It looks like I will have to create mgs on entire device /dev/sda >>> and then mount it using /dev/sda1 Is that right or typo? >>> >>> Regards >>> >>> Wojciech Turek >>> >> >> >> >> _______________________________________________ >> Lustre-discuss mailing list >> Lustre-discuss@clusterfs.com >> https://mail.clusterfs.com/mailman/listinfo/lustre-discuss >Mr Wojciech Turek Assistant System Manager University of Cambridge High Performance Computing service email: wjt27@cam.ac.uk tel. +441223763517 -------------- next part -------------- An HTML attachment was scrubbed... URL: http://mail.clusterfs.com/pipermail/lustre-discuss/attachments/20070817/27ced1bf/attachment.html
Anand Bisen
2007-Aug-17 12:35 UTC
[Lustre-discuss] Re: MGS MDS not combined (lustre 1.6.1)
Wojciech, 1. I can''t suggest an optimal size, It really need not be a a really big disk as the only information that is stored on the MGS is the configuration data. So a single smallest disk that you can get should be fine (36G) 2. I always recommend to have a raid 1 for MGS it always helps in keeping those uptime numbers up. Since the lustre servers would cache their configurations once they have been added once, they would work even if the MGS is down. 3. This is something that I will have to try before i can give you the steps, I will mail you the steps once i have tested them. I think this should be possible by just backing up the lustre configuration in a csv file of the configuration and then use it to generate the config (without using the --reformat option, i think). Thanks Anand On Aug 17, 2007, at 11:05 AM, Wojciech Turek wrote:> Hi, > > Thanks for you answers. Please let me ask another questions. > 1) Are there any recommendations regarding size of block device > for mgs ? > 2) Also do I need to have any raid configuration for mgs block device. > 3) If I would lost mgs device what are the steps to recreate it and > get access to filesystem > > Thanks You > > Wojciech > On 17 Aug 2007, at 17:37, Anand Bisen wrote: > >> Wojciech, >> >> For question 2: it''s a typo. it should be /dev/sda1 and not /dev/ >> sda (or if you are using the whole device then vice versa, both >> would work). >> >> For question 1: I think either the MGS should be on a separate >> machine and if MDT and MGS are co-located on a single node, i >> don''t think it would make a big difference if they are on >> different partitions (sda1, sda2) or not. Although depending upon >> the total number of client''s and their frequency of mount''s/ >> umount''s it might help keeping those IO''s on a different block >> device (sda, sdb). >> >> Thanks >> >> Anand >> >> >> >> >> On Aug 17, 2007, at 8:11 AM, Wojciech Turek wrote: >> >>> >>> On 17 Aug 2007, at 16:04, Wojciech Turek wrote: >>> >>>> Hi, >>>> >>>> I have two short questions: >>>> 1) Is it better to configure MGS on different partition then MDT? >>>> For example: >>>> I have node01 which has two partitions /dev/sda1 and /dev/sda2 >>>> I am planning to create MGS on /dev/sda1 and MDT on /dev/sda2 >>>> >>>> 2) If above is actually possible? I read in manual follwing: >>>> >>>> 3 Start Lustre on the MGS node. >>>> $ mkfs.lustre --mgs /dev/sda >>>> 4 Make a mount point on MGS for the file system and mount it. >>>> $ mkdir -p /mnt/mgs >>>> $ mount -t lustre /dev/sda1 /mnt/mgs >>>> >>>> It looks like I will have to create mgs on entire device /dev/ >>>> sda and then mount it using /dev/sda1 Is that right or typo? >>>> >>>> Regards >>>> >>>> Wojciech Turek >>>> >>> >>> >>> >>> _______________________________________________ >>> Lustre-discuss mailing list >>> Lustre-discuss@clusterfs.com >>> https://mail.clusterfs.com/mailman/listinfo/lustre-discuss >> > > Mr Wojciech Turek > Assistant System Manager > University of Cambridge > High Performance Computing service > email: wjt27@cam.ac.uk > tel. +441223763517 > > >--- Anand Bisen Sr. Systems Architect, DataDirect Networks 9351 Deering Avenue, Chatsworth, CA 91311 Tel: 818-700-4053 Fax: 818-700-7665 Cell: 818-723-9752 -------------- next part -------------- An HTML attachment was scrubbed... URL: http://mail.clusterfs.com/pipermail/lustre-discuss/attachments/20070817/658ac99c/attachment-0001.html
Hi, I have two short questions: 1) Is it better to configure MGS on different partition then MDT? For example: I have node01 which has two partitions /dev/sda1 and /dev/sda2 I am planning to create MGS on /dev/sda1 and MDT on /dev/sda2 2) If above is actually possible? I read in manual follwing: 3 Start Lustre on the MGS node. $ mkfs.lustre --mgs /dev/sda 4 Make a mount point on MGS for the file system and mount it. $ mkdir -p /mnt/mgs $ mount -t lustre /dev/sda1 /mnt/mgs It looks like I will have to create mgs on entire device /dev/sda and then mount it using /dev/sda1 Is that right or typo? Regards Wojciech -------------- next part -------------- An HTML attachment was scrubbed... URL: http://mail.clusterfs.com/pipermail/lustre-discuss/attachments/20070817/f3828fb6/attachment.html