It seems only the root user can read/write from our Lustre filesystem. Any user I''ve tried shows question marks next to any file: ?--------- ? ? ? ? ? /lustre/mascot/node0 ?--------- ? ? ? ? ? /lustre/mascot/node1 ?--------- ? ? ? ? ? /lustre/mascot/node2 ?--------- ? ? ? ? ? /lustre/mascot/node3 ?--------- ? ? ? ? ? /lustre/mascot/node4 Our lustre system is mounted like: mount -t lustre 192.168.1.31 at tcp0:/bcffs /lustre How do I fix this? -- Jeremy Mann jeremy at biochem.uthscsa.edu University of Texas Health Science Center Bioinformatics Core Facility http://www.bioinformatics.uthscsa.edu Phone: (210) 567-2672
Answering my own email again.... The problem exists when a user is not on the meta server. I copied over our passwd file to the meta server and no problems now. Jeremy Mann wrote:> It seems only the root user can read/write from our Lustre filesystem. Any > user I''ve tried shows question marks next to any file: > > > ?--------- ? ? ? ? ? /lustre/mascot/node0 > ?--------- ? ? ? ? ? /lustre/mascot/node1 > ?--------- ? ? ? ? ? /lustre/mascot/node2 > ?--------- ? ? ? ? ? /lustre/mascot/node3 > ?--------- ? ? ? ? ? /lustre/mascot/node4 > > Our lustre system is mounted like: > > mount -t lustre 192.168.1.31 at tcp0:/bcffs /lustre > > How do I fix this? > > > -- > Jeremy Mann > jeremy at biochem.uthscsa.edu > > University of Texas Health Science Center > Bioinformatics Core Facility > http://www.bioinformatics.uthscsa.edu > Phone: (210) 567-2672 > > _______________________________________________ > Lustre-discuss mailing list > Lustre-discuss at lists.lustre.org > http://lists.lustre.org/mailman/listinfo/lustre-discuss >-- Jeremy Mann jeremy at biochem.uthscsa.edu University of Texas Health Science Center Bioinformatics Core Facility http://www.bioinformatics.uthscsa.edu Phone: (210) 567-2672
Thanks for the clarification. I too have seen this before too. On Sun, Aug 3, 2008 at 6:09 PM, Jeremy Mann <jeremy at biochem.uthscsa.edu> wrote:> Answering my own email again.... > > The problem exists when a user is not on the meta server. I copied over > our passwd file to the meta server and no problems now. > > Jeremy Mann wrote: >> It seems only the root user can read/write from our Lustre filesystem. Any >> user I''ve tried shows question marks next to any file: >> >> >> ?--------- ? ? ? ? ? /lustre/mascot/node0 >> ?--------- ? ? ? ? ? /lustre/mascot/node1 >> ?--------- ? ? ? ? ? /lustre/mascot/node2 >> ?--------- ? ? ? ? ? /lustre/mascot/node3 >> ?--------- ? ? ? ? ? /lustre/mascot/node4 >> >> Our lustre system is mounted like: >> >> mount -t lustre 192.168.1.31 at tcp0:/bcffs /lustre >> >> How do I fix this? >> >> >> -- >> Jeremy Mann >> jeremy at biochem.uthscsa.edu >> >> University of Texas Health Science Center >> Bioinformatics Core Facility >> http://www.bioinformatics.uthscsa.edu >> Phone: (210) 567-2672 >> >> _______________________________________________ >> Lustre-discuss mailing list >> Lustre-discuss at lists.lustre.org >> http://lists.lustre.org/mailman/listinfo/lustre-discuss >> > > > -- > Jeremy Mann > jeremy at biochem.uthscsa.edu > > University of Texas Health Science Center > Bioinformatics Core Facility > http://www.bioinformatics.uthscsa.edu > Phone: (210) 567-2672 > > _______________________________________________ > Lustre-discuss mailing list > Lustre-discuss at lists.lustre.org > http://lists.lustre.org/mailman/listinfo/lustre-discuss >
Hi Jeremy, I believe that is related to stat/statfs behaviour, and there is a tweak that can be used to adjust this behaviour. Unfortunately, I can''t remember what exactly it''s called, but scanning the list archives might dig something up until Andreas or someone authoritative can weigh in. cheers, Klaus On 8/3/08 3:09 PM, "Jeremy Mann" <jeremy at biochem.uthscsa.edu>did etch on stone tablets:> Answering my own email again.... > > The problem exists when a user is not on the meta server. I copied over > our passwd file to the meta server and no problems now. > > Jeremy Mann wrote: >> It seems only the root user can read/write from our Lustre filesystem. Any >> user I''ve tried shows question marks next to any file: >> >> >> ?--------- ? ? ? ? ? /lustre/mascot/node0 >> ?--------- ? ? ? ? ? /lustre/mascot/node1 >> ?--------- ? ? ? ? ? /lustre/mascot/node2 >> ?--------- ? ? ? ? ? /lustre/mascot/node3 >> ?--------- ? ? ? ? ? /lustre/mascot/node4 >> >> Our lustre system is mounted like: >> >> mount -t lustre 192.168.1.31 at tcp0:/bcffs /lustre >> >> How do I fix this? >> >> >> -- >> Jeremy Mann >> jeremy at biochem.uthscsa.edu >> >> University of Texas Health Science Center >> Bioinformatics Core Facility >> http://www.bioinformatics.uthscsa.edu >> Phone: (210) 567-2672 >> >> _______________________________________________ >> Lustre-discuss mailing list >> Lustre-discuss at lists.lustre.org >> http://lists.lustre.org/mailman/listinfo/lustre-discuss >> >
Hello, It is the supplementary group feature. One can disable it by something like that: lctl conf_param fsname-MDT0000.mdt.group_upcall=NONE Cheers, Bernd On Monday 04 August 2008 21:04:55 Klaus Steden wrote:> Hi Jeremy, > > I believe that is related to stat/statfs behaviour, and there is a tweak > that can be used to adjust this behaviour. Unfortunately, I can''t remember > what exactly it''s called, but scanning the list archives might dig > something up until Andreas or someone authoritative can weigh in. > > cheers, > Klaus > > On 8/3/08 3:09 PM, "Jeremy Mann" <jeremy at biochem.uthscsa.edu>did etch on > > stone tablets: > > Answering my own email again.... > > > > The problem exists when a user is not on the meta server. I copied over > > our passwd file to the meta server and no problems now. > > > > Jeremy Mann wrote: > >> It seems only the root user can read/write from our Lustre filesystem. > >> Any user I''ve tried shows question marks next to any file: > >> > >> > >> ?--------- ? ? ? ? ? /lustre/mascot/node0 > >> ?--------- ? ? ? ? ? /lustre/mascot/node1 > >> ?--------- ? ? ? ? ? /lustre/mascot/node2 > >> ?--------- ? ? ? ? ? /lustre/mascot/node3 > >> ?--------- ? ? ? ? ? /lustre/mascot/node4 > >> > >> Our lustre system is mounted like: > >> > >> mount -t lustre 192.168.1.31 at tcp0:/bcffs /lustre > >> > >> How do I fix this? > >> > >> > >> -- > >> Jeremy Mann > >> jeremy at biochem.uthscsa.edu > >> > >> University of Texas Health Science Center > >> Bioinformatics Core Facility > >> http://www.bioinformatics.uthscsa.edu > >> Phone: (210) 567-2672 > >> > >> _______________________________________________ > >> Lustre-discuss mailing list > >> Lustre-discuss at lists.lustre.org > >> http://lists.lustre.org/mailman/listinfo/lustre-discuss > > _______________________________________________ > Lustre-discuss mailing list > Lustre-discuss at lists.lustre.org > http://lists.lustre.org/mailman/listinfo/lustre-discuss-- Bernd Schubert Q-Leap Networks GmbH