thr3ads.net - Lustre discuss - [Lustre-discuss] Cannot mount snapshot volume [Nov 2008]

If this information is useful, please help other people find it:
Share via:

Hans-Juergen Schnitzer

2008-Nov-06 17:01 UTC

[Lustre-discuss] Cannot mount snapshot volume

I cannot mount the snapshot volumes of lustre devices
(lustre 1.6.6, Scientific Linux 5.2).
For example for the MDT device:

$ lvcreate -L 10G -s -n s2 /dev/volgroup_mdt/mdt
$ tunefs.lustre --reformat --writeconf --fsname=s2 /dev/volgroup_mdt/s2
$ mount -t lustre /dev/volgroup_mdt/s2 /lustre_s2_mdt
mount.lustre: mount /dev/volgroup_mdt/s2 at /lustre_s2_mdt failed: 
Invalid argument
This may have multiple causes.
Are the mount options correct?
Check the syslog for more info. 


The syslog messages are:

Nov 6 17:36:07 mdsc1 kernel: Lustre: MGS: Logs for fs s2 were removed by 
user request.  All servers must be restarted in order to regenerate the 
logs.
Nov  6 17:36:07 mdsc1 kernel: Lustre: MGS: Logs for fs s2 were removed 
by user request.  All servers must be restarted in order to regenerate 
the logs.
Nov  6 17:36:07 mdsc1 kernel: Lustre: Setting parameter 
s2-MDT0000.mdt.quota_type in log s2-MDT0000
Nov  6 17:36:07 mdsc1 kernel: Lustre: Enabling user_xattr
Nov  6 17:36:07 mdsc1 kernel: LustreError: 157-3: Trying to start OBD 
s2-MDT0000_UUID using the wrong disk lustrev-MDT0000_UUID. Were the 
/dev/ assignments rearranged?
Nov  6 17:36:07 mdsc1 kernel: LustreError: 157-3: Trying to start OBD 
s2-MDT0000_UUID using the wrong disk lustrev-MDT0000_UUID. Were the 
/dev/ assignments rearranged?
Nov  6 17:36:07 mdsc1 kernel: LustreError: 
7266:0:(mds_fs.c:625:mds_fs_setup()) cannot read last_rcvd: rc = -22
Nov  6 17:36:07 mdsc1 kernel: LustreError: 
7266:0:(mds_fs.c:625:mds_fs_setup()) cannot read last_rcvd: rc = -22
Nov  6 17:36:07 mdsc1 kernel: LustreError: 
7266:0:(handler.c:2079:mds_setup()) s2-MDT0000: MDS filesystem method 
init failed: rc = -22
Nov  6 17:36:07 mdsc1 kernel: LustreError: 
7266:0:(handler.c:2079:mds_setup()) s2-MDT0000: MDS filesystem method 
init failed: rc = -22
Nov  6 17:36:07 mdsc1 kernel: LustreError: 
7266:0:(obd_config.c:351:class_setup()) setup s2-MDT0000 failed (-22)
Nov  6 17:36:07 mdsc1 kernel: LustreError: 
7266:0:(obd_config.c:351:class_setup()) setup s2-MDT0000 failed (-22)
Nov  6 17:36:07 mdsc1 kernel: LustreError: 
7266:0:(obd_config.c:1093:class_config_llog_handler()) Err -22 on cfg 
command:
Nov  6 17:36:07 mdsc1 kernel: LustreError: 
7266:0:(obd_config.c:1093:class_config_llog_handler()) Err -22 on cfg 
command:
Nov  6 17:36:07 mdsc1 kernel: Lustre:    cmd=cf003 0:s2-MDT0000  1:dev 
2:type  3:s2-MDT0000
Nov  6 17:36:07 mdsc1 kernel: Lustre:    cmd=cf003 0:s2-MDT0000  1:dev 
2:type  3:s2-MDT0000
Nov  6 17:36:07 mdsc1 kernel: LustreError: 15b-f: 
MGC192.168.220.10 at o2ib: The configuration from log
''s2-MDT0000'' failed
(-22). Ma ke sure this client and the MGS are running compatible 
versions of Lustre.
Nov  6 17:36:07 mdsc1 kernel: LustreError: 15b-f: 
MGC192.168.220.10 at o2ib: The configuration from log
''s2-MDT0000'' failed
(-22). Ma ke sure this client and the MGS are running compatible 
versions of Lustre.
Nov  6 17:36:08 mdsc1 kernel: LustreError: 15c-8: 
MGC192.168.220.10 at o2ib: The configuration from log
''s2-MDT0000'' failed
(-22). Th is may be the result of communication errors between this node 
and the MGS, a bad configuration, or other errors. See the syslog f or 
more information.
Nov  6 17:36:08 mdsc1 kernel: LustreError: 15c-8: 
MGC192.168.220.10 at o2ib: The configuration from log
''s2-MDT0000'' failed
(-22). Th is may be the result of communication errors between this node 
and the MGS, a bad configuration, or other errors. See the syslog f or 
more information.
Nov  6 17:36:08 mdsc1 kernel: LustreError: 
7214:0:(obd_mount.c:1113:server_start_targets()) failed to start server 
s2-MDT0000: -22
Nov  6 17:36:08 mdsc1 kernel: LustreError: 
7214:0:(obd_mount.c:1113:server_start_targets()) failed to start server 
s2-MDT0000: -22
Nov  6 17:36:08 mdsc1 kernel: LustreError: 
7214:0:(obd_mount.c:1623:server_fill_super()) Unable to start targets: -22
Nov  6 17:36:08 mdsc1 kernel: LustreError: 
7214:0:(obd_mount.c:1623:server_fill_super()) Unable to start targets: -22
Nov  6 17:36:08 mdsc1 kernel: LustreError: 
7214:0:(obd_config.c:418:class_cleanup()) Device 12 not setup
Nov  6 17:36:08 mdsc1 kernel: LustreError: 
7214:0:(obd_config.c:418:class_cleanup()) Device 12 not setup
Nov  6 17:36:08 mdsc1 kernel: Lustre: 
7214:0:(obd_mount.c:1443:server_put_super()) Cleaning orphaned obd s2-mdtlov
Nov  6 17:36:08 mdsc1 kernel: Lustre: 
7214:0:(obd_mount.c:1443:server_put_super()) Cleaning orphaned obd s2-mdtlov
Nov  6 17:36:08 mdsc1 kernel: Lustre: server umount s2-MDT0000 complete
Nov  6 17:36:08 mdsc1 kernel: Lustre: server umount s2-MDT0000 complete
Nov  6 17:36:08 mdsc1 kernel: LustreError: 
7214:0:(obd_mount.c:1980:lustre_fill_super()) Unable to mount  (-22)
Nov  6 17:36:08 mdsc1 kernel: LustreError: 
7214:0:(obd_mount.c:1980:lustre_fill_super()) Unable to mount  (-22)

The lustre manual says in section 1.7:
 
     "The Lustre software includes a utility (using LVM snapshot 
technology) to create a snapshot of all volumes and group snapshots 
together in a snapshot file system that can be mounted with Lustre."

Where can I find that tool?

Best regards,
Hans Schnitzer

-------------- next part --------------
A non-text attachment was scrubbed...
Name: smime.p7s
Type: application/x-pkcs7-signature
Size: 5750 bytes
Desc: S/MIME Cryptographic Signature
Url :
http://lists.lustre.org/pipermail/lustre-discuss/attachments/20081106/2255f977/attachment-0001.bin

Daire Byrne

2008-Nov-07 16:53 UTC

head link

[Lustre-discuss] Cannot mount snapshot volume

Hi,

----- "Hans-Juergen Schnitzer" <schnitzer at rz.RWTH-Aachen.DE>
wrote:
> I cannot mount the snapshot volumes of lustre devices
> (lustre 1.6.6, Scientific Linux 5.2).
> For example for the MDT device:
> 
> $ lvcreate -L 10G -s -n s2 /dev/volgroup_mdt/mdt
> $ tunefs.lustre --reformat --writeconf --fsname=s2
> /dev/volgroup_mdt/s2
> $ mount -t lustre /dev/volgroup_mdt/s2 /lustre_s2_mdt
> mount.lustre: mount /dev/volgroup_mdt/s2 at /lustre_s2_mdt failed: 
You should also remove the "last_rcvd" file from the snapshot to avoid
doing recovery. Is your MGS on the same device as your MDT? Maybe it is trying
to start the MGS too as part of the snapshot which is confusing matters? We use
a standalone MGS server/device.
> The lustre manual says in section 1.7:
>  
>      "The Lustre software includes a utility (using LVM snapshot 
> technology) to create a snapshot of all volumes and group snapshots 
> together in a snapshot file system that can be mounted with Lustre."
> 
> Where can I find that tool?
Maybe the developers know what this refers to but we wrote a script to create
and rotate LVM snapshots. I''ve included it in case it is of any
use/interest. Obviously using multiple snapshots will greatly reduce your
performance. Because of this we only use snapshots on a filesystem that is a
complete nightly mirror of our production system.

Maybe this will work one day:

  https://www.redhat.com/archives/dm-devel/2008-August/msg00087.html

Daire
-------------- next part --------------
A non-text attachment was scrubbed...
Name: lustre-snap.tar.gz
Type: application/x-gzip
Size: 4843 bytes
Desc: not available
Url :
http://lists.lustre.org/pipermail/lustre-discuss/attachments/20081107/646da74c/attachment-0001.bin

Hans-Juergen Schnitzer

2008-Nov-12 11:04 UTC

head link

[Lustre-discuss] Cannot mount snapshot volume

Daire Byrne wrote:> Hi,
> 
> ----- "Hans-Juergen Schnitzer" <schnitzer at
rz.RWTH-Aachen.DE> wrote:
> 
>> I cannot mount the snapshot volumes of lustre devices
>> (lustre 1.6.6, Scientific Linux 5.2).
>> For example for the MDT device:
>>
>> $ lvcreate -L 10G -s -n s2 /dev/volgroup_mdt/mdt
>> $ tunefs.lustre --reformat --writeconf --fsname=s2
>> /dev/volgroup_mdt/s2
>> $ mount -t lustre /dev/volgroup_mdt/s2 /lustre_s2_mdt
>> mount.lustre: mount /dev/volgroup_mdt/s2 at /lustre_s2_mdt failed: 
> 
> You should also remove the "last_rcvd" file from the snapshot to
avoid doing recovery. Is your MGS on the same device as your MDT? Maybe it is
trying to start the MGS too as part of the snapshot which is confusing matters?
We use a standalone MGS server/device.
> 
To remove the last_rcvd file did resolve the problem. Thank you for your 
help.

Hans Schnitzer

-------------- next part --------------
A non-text attachment was scrubbed...
Name: smime.p7s
Type: application/x-pkcs7-signature
Size: 5750 bytes
Desc: S/MIME Cryptographic Signature
Url :
http://lists.lustre.org/pipermail/lustre-discuss/attachments/20081112/32630437/attachment.bin

Lustre discuss - Nov 2008 - Cannot mount snapshot volume

[Lustre-discuss] Cannot mount snapshot volume

[Lustre-discuss] Cannot mount snapshot volume

[Lustre-discuss] Cannot mount snapshot volume