Lustre discuss - Jan 2012 - Lustre-2.1, CentOS-6.2: unknown param quota_type=ug

Hello,

I cannot get quota to work on a clean new file system with Lustre-2.1 on
CentOS-6.2.

	# tunefs.lustre --param mdt.quota_type=ug /dev/mapper/mdt1
	# mount /mnt/mdt1
	mount.lustre: mount /dev/mapper/mdt1 at /mnt/mdt1 failed: Function not
implemented

This logs:

	LustreError: 3957:0:(obd_config.c:1140:class_process_proc_param())
carbonfs-MDT0000: unknown param quota_type=ug

Am I missing some component or parameter syntax? I went by
http://build.whamcloud.com/job/lustre-manual/lastSuccessfulBuild/artifact/lustre_manual.html#dbdoclet.50438217_31982
.


I actually got "Function not implemented" already with mkfs.lustre
--param mdt.quota_type=ug2 ...  I decided to defer quota setup until later
because I had a note to this effect from a much earlier install. So, I got
everything up and running without quota, MGS MDS on same node but different
LUNs, 4 OSS with external journals, client.

The system for all nodes (servers and client) is:

	- CentOS-6.2, but with the wc1 kernel for CentOS-6.1 =
2.6.32-131.6.1.el6_lustre.g65156ed.x86_64

		(Is this asking for trouble?  Things worked under 1.8.x with sticking to a
previous minor-version OS kernel.)
	
	- Failover for the MGS/MDS pair and 2 OSS pairs.

I had been using quota with 1.8.6 on CentOS-5.6 without problems. The 2.1 fs is
on new hardware to migrate to.


Best, Michael



[root at mds03 ~]# rpm -qa | grep lustre
kernel-2.6.32-131.6.1.el6_lustre.g65156ed.x86_64
lustre-ldiskfs-3.3.0-2.6.32_131.6.1.el6_lustre.g65156ed.x86_64_g9d71fe8.x86_64
lustre-modules-2.1.0-2.6.32_131.6.1.el6_lustre.g65156ed.x86_64_g9d71fe8.x86_64
lustre-2.1.0-2.6.32_131.6.1.el6_lustre.g65156ed.x86_64_g9d71fe8.x86_64

[root at mds03 ~]# lsmod | grep quota
lquota                198183  5 mdd
ptlrpc               1070449  13
cmm,mdt,mdd,mds,mgs,mgc,lustre,lov,osc,lquota,mdc,fid,fld
obdclass              804693  29
cmm,osd_ldiskfs,mdt,mdd,mds,fsfilt_ldiskfs,mgs,mgc,lustre,lov,osc,lquota,mdc,fid,fld,ptlrpc
lvfs                   28053  18
cmm,osd_ldiskfs,mdt,mdd,mds,fsfilt_ldiskfs,mgs,mgc,lustre,lov,osc,lquota,mdc,fid,fld,ptlrpc,obdclass
libcfs                338203  21
cmm,osd_ldiskfs,mdt,mdd,mds,fsfilt_ldiskfs,mgs,mgc,lustre,lov,osc,lquota,mdc,fid,fld,ksocklnd,ko2iblnd,ptlrpc,obdclass,lnet,lvfs

[root at oss03 ~]# lsmod | grep quota
lquota                198183  5 obdfilter
ptlrpc               1070449  10
obdfilter,ost,mgc,lustre,lov,osc,lquota,mdc,fid,fld
obdclass              804693  24
obdfilter,fsfilt_ldiskfs,ost,mgc,lustre,lov,osc,lquota,mdc,fid,fld,ptlrpc
lvfs                   28053  14
obdfilter,fsfilt_ldiskfs,ost,mgc,lustre,lov,osc,lquota,mdc,fid,fld,ptlrpc,obdclass
libcfs                338203  17
obdfilter,fsfilt_ldiskfs,ost,mgc,lustre,lov,osc,lquota,mdc,fid,fld,ptlrpc,obdclass,lvfs,ksocklnd,ko2iblnd,lnet


Syslog says upon the "mount /mnt/mdt1"

Jan  5 01:04:05 mds03 kernel: LDISKFS-fs warning (device dm-1):
ldiskfs_fill_super: extents feature not enabled on this filesystem, use tune2fs.
Jan  5 01:04:05 mds03 kernel: LDISKFS-fs (dm-1): warning: maximal mount count
reached, running e2fsck is recommended
Jan  5 01:04:05 mds03 kernel: LDISKFS-fs (dm-1): mounted filesystem with ordered
data mode
Jan  5 01:04:05 mds03 kernel: LDISKFS-fs warning (device dm-1):
ldiskfs_fill_super: extents feature not enabled on this filesystem, use tune2fs.
Jan  5 01:04:05 mds03 kernel: LDISKFS-fs (dm-1): warning: maximal mount count
reached, running e2fsck is recommended
Jan  5 01:04:05 mds03 kernel: LDISKFS-fs (dm-1): mounted filesystem with ordered
data mode
Jan  5 01:04:05 mds03 kernel: Lustre: Enabling ACL
Jan  5 01:04:05 mds03 kernel: Lustre: carbonfs-MDT0000: used disk, loading
Jan  5 01:04:05 mds03 kernel: LustreError:
3957:0:(obd_config.c:1140:class_process_proc_param()) carbonfs-MDT0000: unknown
param quota_type=ug
Jan  5 01:04:05 mds03 kernel: LustreError:
3957:0:(obd_config.c:1361:class_config_llog_handler()) Err -38 on cfg command:
Jan  5 01:04:05 mds03 kernel: Lustre:    cmd=cf00f 0:carbonfs-MDT0000 
1:mdt.quota_type=ug
Jan  5 01:04:05 mds03 kernel: LustreError: 15c-8: MGC172.17.120.3 at o2ib: The
configuration from log ''carbonfs-MDT0000'' failed (-38). This
may be the result of communication errors between this node and the MGS, a bad
configuration, or other errors. See the syslog for more information.
Jan  5 01:04:05 mds03 kernel: LustreError:
3901:0:(obd_mount.c:1192:server_start_targets()) failed to start server
carbonfs-MDT0000: -38
Jan  5 01:04:05 mds03 kernel: LustreError:
3901:0:(obd_mount.c:1719:server_fill_super()) Unable to start targets: -38
Jan  5 01:04:05 mds03 kernel: Lustre: Failing over carbonfs-MDT0000
Jan  5 01:04:05 mds03 kernel: Lustre: Skipped 2 previous similar messages
Jan  5 01:04:05 mds03 kernel: Lustre:
3901:0:(quota_master.c:793:close_quota_files()) quota[0] is off already
Jan  5 01:04:05 mds03 kernel: Lustre:
3901:0:(quota_master.c:793:close_quota_files()) Skipped 1 previous similar
message
Jan  5 01:04:05 mds03 kernel: Lustre: mdd_obd-carbonfs-MDT0000: shutting down
for failover; client state will be preserved.
Jan  5 01:04:05 mds03 kernel: Lustre: server umount carbonfs-MDT0000 complete
Jan  5 01:04:05 mds03 kernel: LustreError:
3901:0:(obd_mount.c:2160:lustre_fill_super()) Unable to mount  (-38)

In lustre 2.x, this must be mdd.quota_type (instead of mdt.quota_type). A patch
was landed to master some time ago (will be available in 2.2) to interpret
mdt.quota_type as mdd.quota_type transparently, see
http://review.whamcloud.com/#change,354.

Cheers,
Johann

On Thu, Jan 05, 2012 at 01:35:14AM -0600, Michael Sternberg
wrote:
> I cannot get quota to work on a clean new file system with Lustre-2.1 on
CentOS-6.2.
> 
> 	# tunefs.lustre --param mdt.quota_type=ug /dev/mapper/mdt1
> 	# mount /mnt/mdt1
> 	mount.lustre: mount /dev/mapper/mdt1 at /mnt/mdt1 failed: Function not
implemented
> 
> This logs:
> 
> 	LustreError: 3957:0:(obd_config.c:1140:class_process_proc_param())
carbonfs-MDT0000: unknown param quota_type=ug
> 
> Am I missing some component or parameter syntax? I went by
http://build.whamcloud.com/job/lustre-manual/lastSuccessfulBuild/artifact/lustre_manual.html#dbdoclet.50438217_31982
.
> 
> 
> I actually got "Function not implemented" already with
mkfs.lustre --param mdt.quota_type=ug2 ...  I decided to defer quota setup until
later because I had a note to this effect from a much earlier install. So, I got
everything up and running without quota, MGS MDS on same node but different
LUNs, 4 OSS with external journals, client.
> 
> The system for all nodes (servers and client) is:
> 
> 	- CentOS-6.2, but with the wc1 kernel for CentOS-6.1 =
2.6.32-131.6.1.el6_lustre.g65156ed.x86_64
> 
> 		(Is this asking for trouble?  Things worked under 1.8.x with sticking to
a previous minor-version OS kernel.)
> 	
> 	- Failover for the MGS/MDS pair and 2 OSS pairs.
> 
> I had been using quota with 1.8.6 on CentOS-5.6 without problems. The 2.1
fs is on new hardware to migrate to.
> 
> 
> Best, Michael

Phew!  OK, I found a manual-bug on this already open ??
http://jira.whamcloud.com/browse/LUDOC-26


Thank you very much!
Michael


On Jan 5, 2012, at 3:10 , Johann Lombardi wrote:
> In lustre 2.x, this must be mdd.quota_type (instead of mdt.quota_type). A
patch was landed to master some time ago (will be available in 2.2) to interpret
mdt.quota_type as mdd.quota_type transparently, see
http://review.whamcloud.com/#change,354.
> 
> Cheers,
> Johann
> 
> On Thu, Jan 05, 2012 at 01:35:14AM -0600, Michael Sternberg wrote:
>> I cannot get quota to work on a clean new file system with Lustre-2.1
on CentOS-6.2.
>> 
>> 	# tunefs.lustre --param mdt.quota_type=ug /dev/mapper/mdt1
>> 	# mount /mnt/mdt1
>> 	mount.lustre: mount /dev/mapper/mdt1 at /mnt/mdt1 failed: Function not
implemented
>> 
>> This logs:
>> 
>> 	LustreError: 3957:0:(obd_config.c:1140:class_process_proc_param())
carbonfs-MDT0000: unknown param quota_type=ug
>> 
>> Am I missing some component or parameter syntax? I went by
http://build.whamcloud.com/job/lustre-manual/lastSuccessfulBuild/artifact/lustre_manual.html#dbdoclet.50438217_31982
.
>> 
>> 
>> I actually got "Function not implemented" already with
mkfs.lustre --param mdt.quota_type=ug2 ...  I decided to defer quota setup until
later because I had a note to this effect from a much earlier install. So, I got
everything up and running without quota, MGS MDS on same node but different
LUNs, 4 OSS with external journals, client.
>> 
>> The system for all nodes (servers and client) is:
>> 
>> 	- CentOS-6.2, but with the wc1 kernel for CentOS-6.1 =
2.6.32-131.6.1.el6_lustre.g65156ed.x86_64
>> 
>> 		(Is this asking for trouble?  Things worked under 1.8.x with sticking
to a previous minor-version OS kernel.)
>> 	
>> 	- Failover for the MGS/MDS pair and 2 OSS pairs.
>> 
>> I had been using quota with 1.8.6 on CentOS-5.6 without problems. The
2.1 fs is on new hardware to migrate to.
>> 
>> 	
>> Best, Michael