search for: mgs

This may be in the documentation. If so, I missed it. If a site has multiple Lustre file systems, the documentation implies that there only needs to be a single MGS for an entire site (regardless of the number of file systems). However, I also know it is fairly common to have a combined MGS/MDT. So here are the questions. 1. If we are going to have several Lustre file systems, is there any reason not to create each one with its own combined MG...

Hi all, Here is the situation: I have 2 nodes MDS1 , MDS2 (10.0.0.22 , 10.0.0.23) I wish to use as failover MGS, active/active MDT with zfs. I have a jbod shelf with 12 disks, seen by both nodes as das (the shelf has 2 sas ports, connected to a sas hba on each node), and I am using lustre 2.4 on centos 6.4 x64 I have created 3 zfs pools: 1. mgs: # zpool create -f -o ashift=12 -O c...

...stead. e.g. conf_param lustre-MDT0000 obd_timeout=50 usage: conf_param obd_timeout=<secs> run <command> after connecting to device <devno> --device <devno> <command [args ...]> [root at storage02 ~]# lctl --device 1 conf_param obd_timeout=600 No device found for name MGS: Invalid argument error: conf_param: No such device It looks like I need to run this command from MGS node so I moved then to MGS server called storage03 [root at storage03 ~]# lctl dl 0 UP mgs MGS MGS 9 1 UP mgc MGC10.143.245.3 at tcp f51a910b-a08e-4be6-5ada-b602a5ca9ab3 5 2 UP mdt M...

Hi, I would like to know what TCP/UDP ports should i keep open in my firewall policies on my MGS server such that I can have my MGS server fire-walled. Also if in a event of loss of MGT would it be possible to recreate the MGT without loosing data or bringing the filesystem down (i.e. by using cached information from MDT''s and OST''s) Thanks Anand

Hi, Our environment is: 2.6.9-55.0.9.EL_lustre.1.6.3smp I am getting following errors from two OSS''s ... Nov 7 10:39:51 storage09.beowulf.cluster kernel: LustreError: 23045:0:(client.c:519:ptlrpc_import_delay_req()) @@@ IMP_INVALID req at 00000100b410be00 x4190687/t0 o101->MGS at MGC10.143.245.201@tcp_0:26 lens 232/240 ref 1 fl Rpc:/0/0 rc 0/0 Nov 7 10:39:51 storage09.beowulf.cluster kernel: LustreError: 23045:0:(client.c:519:ptlrpc_import_delay_req()) Skipped 119 previous similar messages Nov 7 10:50:18 storage10.beowulf.cluster kernel: LustreError: 23337:0:(c...

Hi I used lustre-1.8.3 for Centos5.4. I patched the kernel according to Lustre 1.8 operations manual.pdf. I have a problem when I want to implement quota. My cluster configuration is: 1. one MGS/MDS host (with two devices: sda and sdb,respectively) with the following commands: 1) mkfs.lustre --mgs /dev/sda 2) mount -t lustre /dev/sda /mnt/mgt 3) mkfs.lustre --fsname=lustre --mdt --mgsnode=<mgs IP at net> --param mdt.quota_type=ug /dev/sdb 4) mount -t lustre /...

...get variables. In search for a consistent manner and possibly non-manual manner to identify the significant predictor vars out of the eleven I thought the option "select=T" might do. Example: (here only 4 pedictors) first is vanilla with "select=F" > fit1<-gam(target~s(mgs)+s(gsd)+s(mud)+s(ssCmax),family=quasi(link=log),data=wspe1,select=F) > summary(fit1) Family: quasi Link function: log Formula: target ~ s(mgs) + s(gsd) + s(mud) + s(ssCmax) Parametric coefficients: Estimate Std. Error t value Pr(>|t|) (Intercept) -34.57 20.47 -1.689...

...ollowing error, anyone run into this error before? Thanks, Scott Conflicting types for parameter containers. Expected an instance of Hash, but found an instance of String. This can be caused by passing Array and Hash based paramters qs[]=value&qs[key]=value. /Users/stamosunas/workspaces/ruby/mgs/config/../vendor/rails/ actionpack/lib/action_controller/cgi_ext/cgi_methods.rb:204:in `type_conflict!'' /Users/stamosunas/workspaces/ruby/mgs/config/../vendor/rails/ actionpack/lib/action_controller/cgi_ext/cgi_methods.rb:168:in `container'' /Users/stamosunas/workspaces/ruby/mgs/co...

...out 12.5 MB/sec and I cannot find a reason. Lustre clients all obtain 100+ MB/sec on GigE. Each OST is good for 270 MB/sec. When mounting the client on one of the OSSs I get 230 MB/sec. Seems the speed is there. How can NFS and Lustre be tuned better? Current config for 1.6.4.3 is below: 1. MGS/OSS w/ 4 OSTs - mgs_max_num_threads=32, ost_max_num_threads=64 2. OSS w/ 6 OSTs - ost_max_num_threads=64 3. 20 Lustre clients - all perform well (GREAT Lustre developers!!!! this system is amazing!) 4. NFS server runs from a Lustre client machine for 12 to 15 MB/sec max. 5. NFS server from the...

Greetings! I am working with Lustre-2.1.2 on RHEL 6.2. First I configured it using the standard defaults over TCP/IP. Everything worked very nicely usnig a real, static --mgsnode=a.b.c.x value which was the actual IP of the MGS/MDS system1 node. I am now trying to integrate it with Pacemaker-1.1.7. I believe I have most of the set-up completed with a particular exception. The "lctl ping" command cannot ping the pacemaker IP alias (say a.b.c.d). The generi...

...NULL connection Lustre: cmd=cf003 0:ddnlfs-MDT0000-mdc 1:ddnlfs-MDT0000_UUID 2:36.121.255.201 at tcp LustreError: 15c-8: MGC36.122.255.201 at o2ib: The configuration from log ''ddnlfs-client'' failed (-2). This may be the result of communication errors between this node and the MGS, a bad configuration, or other errors. See the syslog for more information. LustreError: 11043:0:(llite_lib.c:1021:ll_fill_super()) Unable to process log: -2 LustreError: 11043:0:(obd_config.c:392:class_cleanup()) Device 2 not setup Lustre: client 0000010430934400 umount complete LustreError: 11043...

OK, so our old MDS had hardware issues so I configured a new MGS / MDS on a VM (this is a backup lustre filesystem and I wanted to separate the MGS / MDS from OSS of the previous), and then did this: For example: mount -t ldiskfs /dev/old /mnt/ost_old mount -t ldiskfs /dev/new /mnt/ost_new rsync -aSv /mnt/ost_old/ /mnt/ost_new # note trailing slash on ost_old/...

I''m seeing this error message on one of my OSS''s but not the other three. Any idea what is causing it? Oct 25 13:58:56 oss2 kernel: LustreError: 3228:0:(client.c:519:ptlrpc_import_delay_req()) @@@ IMP_INVALID req at f6b13200 x18040/t0 o101->MGS at MGC192.168.0.200@tcp_0:26 lens 176/184 ref 1 fl Rpc:/0/0 rc 0/0 Oct 25 13:58:56 oss2 kernel: LustreError: 3228:0:(client.c:519:ptlrpc_import_delay_req()) Skipped 39 previous similar messages Oct 25 14:09:35 oss2 kernel: LustreError: 3228:0:(client.c:519:ptlrpc_import_delay_req()) @@@ IMP_INVAL...

Any recommendation about the sequence to umount multiple lustre file system with combined MGS/MDT or separate MGS, MDT. Thanks. Ming -------------- next part -------------- An HTML attachment was scrubbed... URL: http://lists.lustre.org/pipermail/lustre-discuss/attachments/20100909/396905b5/attachment.html

In 1.6.0, when creating a MDT, you could specify multiple --mgsnode options and it would failover between them. 1.6.3 only seems to take the last one and --mgsnode=192.168.1.252 at o2ib:192.168.1.253 at o2ib doesn''t seem to failover to the other node. Any ideas how to get around this? Robert Robert LeBlanc College of Life Sciences Computer Support B...

...ib/technoweenie/ attachment_fu.rb:85:in `const_get'' #{RAILS_ROOT}/vendor/plugins/attachment_fu/lib/technoweenie/ attachment_fu.rb:85:in `has_attachment'' #{RAILS_ROOT}/app/models/photo.rb:7 #{RAILS_ROOT}/app/models/product.rb:150:in `photo_filename'' #{RAILS_ROOT}/app/views/mgs/_featured_items.rhtml:20:in `_run_rhtml_47app47views47mgs47_featured_items46rhtml'' #{RAILS_ROOT}/app/views/mgs/_featured_items.rhtml:13:in `each'' #{RAILS_ROOT}/app/views/mgs/_featured_items.rhtml:13:in `_run_rhtml_47app47views47mgs47_featured_items46rhtml'' #{RAILS_ROOT}/a...

I am running on CentOS 5 distribution without adding any updates from CentOS. I am using the lustre 1.6.4.1 kernel and software. I have two NICs that run though different switches. I have the lustre options in my modprobe.conf to look like this: options lnet networks=tcp0(eth1,eth0) My MGS seems to be only listening on the first interface however. When I try and ping the 1st interface (eth1) , it works when I go for the second (eth0) it does not. # lctl ping 192.168.135.81 at tcp<mailto:192.168.135.81 at tcp> 12345-0 at lo<mailto:12345-0 at lo> 12345-192.168.135.81 at t...

Hello, I have been reading http://wiki.lustre.org/images/1/1b/Hadoop_wp_v0.4.2.pdf for setting up Hadoop over lustre. Generally in hadoop setup, we have 1 Namenode and various number of datanodes. If I want to setup the same keeping Lustre as backend, in the document it is mentioned that: ".............Our experiments run on cluster with 8 nodes in total, one is mds/namenode, the rest are

Hi, list: I''m trying configure lustre with: 1 MGS -------------> 192.168.3.100 with mkfs.lustre --mgs /dev/md1 ; mount -t lustre ... 1 MDT ------------> 192.168.3.101 with mkfs.lustre --fsname=datafs00 --mdt --mgsnode=192.168.3.100 /dev/sda3 ; mount -t lustre ... 4 ost -----------> 192.168.3.102-104 with mkfs.lustre --fsname=datafs00 -...

Hi all, we have two servers A, B as a failover MGS/MDT pair, with IPs A=10.12.112.28 and B=10.12.115.120 over tcp. When server B crashes, MGS and MDT are mounted on A. Recovery times out with only one out of 445 clients recovered. Afterwards, the MDT lists all its OSTs as UP and in the logs of the OSTs I see: Lustre: MGC10.12.112.28 at tcp: Co...