Michael Kluge
2010-Sep-22 08:29 UTC
[Lustre-discuss] ls does not work on ram disk for normal user
Hi all, I have a 1.8.3 running on a couple of servers connected via IB to a small cluster. To test the network performance I have one MDS and 14 OST residing in ram disks. One the client it is mounted on /lustre. I have a file in this directory (created as root and then chown''ed to ''mkluge''): mkluge at r2i0n0:~> ls -la /lustre/dfddd/ball -rw-r--r-- 1 mkluge zih 14680064000 2010-09-22 10:14 /lustre/dfddd/ball mkluge at r2i0n0:~> cd /lustre/dfddd/ mkluge at r2i0n0:/lustre/dfddd> ls /bin/ls: .: Identifier removed mkluge at r2i0n0:/lustre/dfddd> ls -la /bin/ls: .: Identifier removed Has anyone an idea what this could be? I can''t event create a directory in /lustre mkluge at r2i0n0:~> mkdir /lustre/ww mkdir: cannot create directory `/lustre/ww'': Identifier removed ''root'' is able to create the directory. Setting permissions to ''777'' or ''1777'' does not help either. The MDS was formated to use mgt and mgs from the same ram device. Regards, Michael -- Michael Kluge, M.Sc. Technische Universit?t Dresden Center for Information Services and High Performance Computing (ZIH) D-01062 Dresden Germany Contact: Willersbau, Room A 208 Phone: (+49) 351 463-34217 Fax: (+49) 351 463-37773 e-mail: michael.kluge at tu-dresden.de WWW: http://www.tu-dresden.de/zih -------------- next part -------------- A non-text attachment was scrubbed... Name: smime.p7s Type: application/x-pkcs7-signature Size: 5997 bytes Desc: not available Url : http://lists.lustre.org/pipermail/lustre-discuss/attachments/20100922/7c0a7429/attachment-0001.bin
Thomas Roth
2010-Sep-22 08:57 UTC
[Lustre-discuss] ls does not work on ram disk for normal user
Hi Michael, "Identifier removed" occured to me when the user data base was not accessible by the MDS - when the MDS didn''t know about any normal user. "root" is of course known there, but what does e.g. "id mkluge" say on your MDS? Regards, Thomas On 09/22/2010 10:29 AM, Michael Kluge wrote:> Hi all, > > I have a 1.8.3 running on a couple of servers connected via IB to a > small cluster. To test the network performance I have one MDS and 14 OST > residing in ram disks. One the client it is mounted on /lustre. > > I have a file in this directory (created as root and then chown''ed to > ''mkluge''): > > mkluge at r2i0n0:~> ls -la /lustre/dfddd/ball > -rw-r--r-- 1 mkluge zih 14680064000 2010-09-22 10:14 /lustre/dfddd/ball > mkluge at r2i0n0:~> cd /lustre/dfddd/ > mkluge at r2i0n0:/lustre/dfddd> ls > /bin/ls: .: Identifier removed > mkluge at r2i0n0:/lustre/dfddd> ls -la > /bin/ls: .: Identifier removed > > Has anyone an idea what this could be? I can''t event create a directory > in /lustre > > mkluge at r2i0n0:~> mkdir /lustre/ww > mkdir: cannot create directory `/lustre/ww'': Identifier removed > > ''root'' is able to create the directory. Setting permissions to ''777'' or > ''1777'' does not help either. > > The MDS was formated to use mgt and mgs from the same ram device. > > > Regards, Michael > > > > > > _______________________________________________ > Lustre-discuss mailing list > Lustre-discuss at lists.lustre.org > http://lists.lustre.org/mailman/listinfo/lustre-discuss-- -------------------------------------------------------------------- Thomas Roth Department: Informationstechnologie Location: SB3 1.262 Phone: +49-6159-71 1453 Fax: +49-6159-71 2986 GSI Helmholtzzentrum f?r Schwerionenforschung GmbH Planckstra?e 1 64291 Darmstadt www.gsi.de Gesellschaft mit beschr?nkter Haftung Sitz der Gesellschaft: Darmstadt Handelsregister: Amtsgericht Darmstadt, HRB 1528 Gesch?ftsf?hrung: Professor Dr. Dr. h.c. Horst St?cker, Dr. Hartmut Eickhoff Vorsitzende des Aufsichtsrates: Dr. Beatrix Vierkorn-Rudolph Stellvertreter: Ministerialdirigent Dr. Rolf Bernhardt
Michael Kluge
2010-Sep-22 09:12 UTC
[Lustre-discuss] ls does not work on ram disk for normal user
Ahh. This user has different UIDs on the clients and the server. Do they actually have to be the same? I thought the MDS and the OSS servers just store files with the uid/gid as reported by the client. I did not assume that the servers need to map these UIDs to a user name. Michael Am 22.09.2010 um 10:57 schrieb Thomas Roth:> Hi Michael, > > "Identifier removed" occured to me when the user data base was not accessible by > the MDS - when the MDS didn''t know about any normal user. "root" is of course known > there, but what does e.g. "id mkluge" say on your MDS? > > Regards, > Thomas > > On 09/22/2010 10:29 AM, Michael Kluge wrote: >> Hi all, >> >> I have a 1.8.3 running on a couple of servers connected via IB to a >> small cluster. To test the network performance I have one MDS and 14 OST >> residing in ram disks. One the client it is mounted on /lustre. >> >> I have a file in this directory (created as root and then chown''ed to >> ''mkluge''): >> >> mkluge at r2i0n0:~> ls -la /lustre/dfddd/ball >> -rw-r--r-- 1 mkluge zih 14680064000 2010-09-22 10:14 /lustre/dfddd/ball >> mkluge at r2i0n0:~> cd /lustre/dfddd/ >> mkluge at r2i0n0:/lustre/dfddd> ls >> /bin/ls: .: Identifier removed >> mkluge at r2i0n0:/lustre/dfddd> ls -la >> /bin/ls: .: Identifier removed >> >> Has anyone an idea what this could be? I can''t event create a directory >> in /lustre >> >> mkluge at r2i0n0:~> mkdir /lustre/ww >> mkdir: cannot create directory `/lustre/ww'': Identifier removed >> >> ''root'' is able to create the directory. Setting permissions to ''777'' or >> ''1777'' does not help either. >> >> The MDS was formated to use mgt and mgs from the same ram device. >> >> >> Regards, Michael >> >> >> >> >> >> _______________________________________________ >> Lustre-discuss mailing list >> Lustre-discuss at lists.lustre.org >> http://lists.lustre.org/mailman/listinfo/lustre-discuss > > -- > -------------------------------------------------------------------- > Thomas Roth > Department: Informationstechnologie > Location: SB3 1.262 > Phone: +49-6159-71 1453 Fax: +49-6159-71 2986 > > GSI Helmholtzzentrum f?r Schwerionenforschung GmbH > Planckstra?e 1 > 64291 Darmstadt > www.gsi.de > > Gesellschaft mit beschr?nkter Haftung > Sitz der Gesellschaft: Darmstadt > Handelsregister: Amtsgericht Darmstadt, HRB 1528 > > Gesch?ftsf?hrung: Professor Dr. Dr. h.c. Horst St?cker, > Dr. Hartmut Eickhoff > > Vorsitzende des Aufsichtsrates: Dr. Beatrix Vierkorn-Rudolph > Stellvertreter: Ministerialdirigent Dr. Rolf Bernhardt >-- Michael Kluge, M.Sc. Technische Universit?t Dresden Center for Information Services and High Performance Computing (ZIH) D-01062 Dresden Germany Contact: Willersbau, Room WIL A 208 Phone: (+49) 351 463-34217 Fax: (+49) 351 463-37773 e-mail: michael.kluge at tu-dresden.de WWW: http://www.tu-dresden.de/zih -------------- next part -------------- An HTML attachment was scrubbed... URL: http://lists.lustre.org/pipermail/lustre-discuss/attachments/20100922/b2cbd388/attachment.html
Brian J. Murrell
2010-Sep-22 11:28 UTC
[Lustre-discuss] ls does not work on ram disk for normal user
On Wed, 2010-09-22 at 11:12 +0200, Michael Kluge wrote:> Ahh. This user has different UIDs on the clients and the server. Do > they actually have to be the same?Yes. b. -------------- next part -------------- A non-text attachment was scrubbed... Name: not available Type: application/pgp-signature Size: 198 bytes Desc: This is a digitally signed message part Url : http://lists.lustre.org/pipermail/lustre-discuss/attachments/20100922/cfe4f777/attachment.bin