Dear all,
I''ve a problem that I don''t understand.
Disk quotas for user hsco1 (uid 1250):
Filesystem kbytes quota limit grace files quota
limit grace /lustre_homes/ 13204576 30000000 35000000
60309 0 0
spfs-MDT0000_UUID
14760 0 102400 60309 0 0
spfs-OST0000_UUID
3648336 0 3788800
spfs-OST0001_UUID
2050408 0 2150400
spfs-OST0002_UUID
3660516 0 3788800
spfs-OST0003_UUID
3830556* 0 1
For me the user is under the quota (13GB data vs 30GB of quota), but for
the system is out of quota. Where is the problem?
Thanks
--
-------------------------------------------------------------------
(o_
(o_ //\ Coltivate Linux che tanto Windows si pianta da solo.
(/)_ V_/_
+------------------------------------------------------------------+
| ENRICO MORELLI | email: morelli at CERM.UNIFI.IT |
| * * * * | phone: +39 055 4574269 |
| University of Florence | fax : +39 055 4574253 |
| CERM - via Sacconi, 6 - 50019 Sesto Fiorentino (FI) - ITALY |
+------------------------------------------------------------------+
Enrico, what version of Lustre are you using? Andrew. On Wednesday 04 June 2008 12:51:26 Enrico Morelli wrote:> Dear all, > > I''ve a problem that I don''t understand. > > Disk quotas for user hsco1 (uid 1250): > Filesystem kbytes quota limit grace files quota > limit grace /lustre_homes/ 13204576 30000000 35000000 > 60309 0 0 > spfs-MDT0000_UUID > 14760 0 102400 60309 0 0 > spfs-OST0000_UUID > 3648336 0 3788800 > spfs-OST0001_UUID > 2050408 0 2150400 > spfs-OST0002_UUID > 3660516 0 3788800 > spfs-OST0003_UUID > 3830556* 0 1 > > > For me the user is under the quota (13GB data vs 30GB of quota), but for > the system is out of quota. Where is the problem? > > Thanks
On Wed, 04 Jun 2008 14:11:47 +0400 Andrew Perepechko <Andrew.Perepechko at sun.com> wrote:> Enrico, > > what version of Lustre are you using? >1.6.4.3> Andrew. > > On Wednesday 04 June 2008 12:51:26 Enrico Morelli wrote: > > Dear all, > > > > I''ve a problem that I don''t understand. > > > > Disk quotas for user hsco1 (uid 1250): > > Filesystem kbytes quota limit grace files quota > > limit grace /lustre_homes/ 13204576 30000000 35000000 > > 60309 0 0 > > spfs-MDT0000_UUID > > 14760 0 102400 60309 0 0 > > spfs-OST0000_UUID > > 3648336 0 3788800 > > spfs-OST0001_UUID > > 2050408 0 2150400 > > spfs-OST0002_UUID > > 3660516 0 3788800 > > spfs-OST0003_UUID > > 3830556* 0 1 > > > > > > For me the user is under the quota (13GB data vs 30GB of quota), > > but for the system is out of quota. Where is the problem? > > > > Thanks > >-- ------------------------------------------------------------------- (o_ (o_ //\ Coltivate Linux che tanto Windows si pianta da solo. (/)_ V_/_ +------------------------------------------------------------------+ | ENRICO MORELLI | email: morelli at CERM.UNIFI.IT | | * * * * | phone: +39 055 4574269 | | University of Florence | fax : +39 055 4574253 | | CERM - via Sacconi, 6 - 50019 Sesto Fiorentino (FI) - ITALY | +------------------------------------------------------------------+
On Wed, 4 Jun 2008 12:42:47 +0200 Enrico Morelli <morelli at cerm.unifi.it> wrote:> On Wed, 04 Jun 2008 14:11:47 +0400 > Andrew Perepechko <Andrew.Perepechko at sun.com> wrote: > > > Enrico, > > > > what version of Lustre are you using? > > > > 1.6.4.3 > > > Andrew. > > > > On Wednesday 04 June 2008 12:51:26 Enrico Morelli wrote: > > > Dear all, > > > > > > I''ve a problem that I don''t understand. > > > > > > Disk quotas for user hsco1 (uid 1250): > > > Filesystem kbytes quota limit grace files quota > > > limit grace /lustre_homes/ 13204576 30000000 35000000 > > > 60309 0 0 > > > spfs-MDT0000_UUID > > > 14760 0 102400 60309 0 0 > > > spfs-OST0000_UUID > > > 3648336 0 3788800 > > > spfs-OST0001_UUID > > > 2050408 0 2150400 > > > spfs-OST0002_UUID > > > 3660516 0 3788800 > > > spfs-OST0003_UUID > > > 3830556* 0 1 > > > > > > > > > For me the user is under the quota (13GB data vs 30GB of quota), > > > but for the system is out of quota. Where is the problem? > > > > > > Thanks > > > > > >I don''t understand the last row displayed by lfs quota: spfs-OST0003_UUID 3830556* 0 1 This is my df: /dev/data_se/lustre_mgs_mdt 45871740 1515804 41734496 4% /lustre_mgs_mdt /dev/data_se/data_local_a 516061624 237605788 252241436 49% /data_local_a /dev/data_se/data_local_b 516061624 228373408 261473816 47% /data_local_b /dev/data_se/data_local_c 516061624 283749608 206097616 58% /data_local_c /dev/data_se/data_local_d 278673480 167750860 96766844 64% /data_local_d se-enmr.cerm.unifi.it at tcp0:/spfs 1826858352 917479664 816579452 53% /lustre_homes The manual say: Note - Values appended with ?*? show the limit that has been over-used (exceeding the quota), and receives this message Disk quota exceeded. How can I solve this problem? --- ------------------------------------------------------------------- (o_ (o_ //\ Coltivate Linux che tanto Windows si pianta da solo. (/)_ V_/_ +------------------------------------------------------------------+ | ENRICO MORELLI | email: morelli at CERM.UNIFI.IT | | * * * * | phone: +39 055 4574269 | | University of Florence | fax : +39 055 4574253 | | CERM - via Sacconi, 6 - 50019 Sesto Fiorentino (FI) - ITALY | +------------------------------------------------------------------+
On Thu, 5 Jun 2008 09:47:52 +0200 Enrico Morelli <morelli at cerm.unifi.it> wrote:> On Wed, 4 Jun 2008 12:42:47 +0200 > Enrico Morelli <morelli at cerm.unifi.it> wrote: > > > On Wed, 04 Jun 2008 14:11:47 +0400 > > Andrew Perepechko <Andrew.Perepechko at sun.com> wrote: > > > > > Enrico, > > > > > > what version of Lustre are you using? > > > > > > > 1.6.4.3Ok. For now I solved the problem, resetting user quota and set it again.> > > > > Andrew. > > > > > > On Wednesday 04 June 2008 12:51:26 Enrico Morelli wrote: > > > > Dear all, > > > > > > > > I''ve a problem that I don''t understand. > > > > > > > > Disk quotas for user hsco1 (uid 1250): > > > > Filesystem kbytes quota limit grace files quota > > > > limit grace /lustre_homes/ 13204576 30000000 35000000 > > > > 60309 0 0 > > > > spfs-MDT0000_UUID > > > > 14760 0 102400 60309 0 0 > > > > spfs-OST0000_UUID > > > > 3648336 0 3788800 > > > > spfs-OST0001_UUID > > > > 2050408 0 2150400 > > > > spfs-OST0002_UUID > > > > 3660516 0 3788800 > > > > spfs-OST0003_UUID > > > > 3830556* 0 1 > > > > > > > > > > > > For me the user is under the quota (13GB data vs 30GB of quota), > > > > but for the system is out of quota. Where is the problem? > > > > > > > > Thanks > > > > > > > > > > > I don''t understand the last row displayed by lfs quota: > spfs-OST0003_UUID > 3830556* 0 1 > > This is my df: > /dev/data_se/lustre_mgs_mdt > 45871740 1515804 41734496 > 4% /lustre_mgs_mdt /dev/data_se/data_local_a > 516061624 237605788 252241436 49% /data_local_a > /dev/data_se/data_local_b > 516061624 228373408 261473816 47% /data_local_b > /dev/data_se/data_local_c > 516061624 283749608 206097616 58% /data_local_c > /dev/data_se/data_local_d > 278673480 167750860 96766844 64% /data_local_d > se-enmr.cerm.unifi.it at tcp0:/spfs > 1826858352 917479664 816579452 53% /lustre_homes > > > The manual say: > Note - Values appended with ?*? show the limit that has been > over-used (exceeding the quota), and receives this message Disk quota > exceeded. > > How can I solve this problem? > > --- > ------------------------------------------------------------------- > (o_ (o_ //\ Coltivate Linux che tanto Windows si pianta da solo. > (/)_ V_/_ > +------------------------------------------------------------------+ > | ENRICO MORELLI | email: morelli at CERM.UNIFI.IT | | > * * * * | phone: +39 055 4574269 | | > University of Florence | fax : +39 055 4574253 | | > CERM - via Sacconi, 6 - 50019 Sesto Fiorentino (FI) - ITALY | > +------------------------------------------------------------------+ > _______________________________________________ > Lustre-discuss mailing list > Lustre-discuss at lists.lustre.org > http://lists.lustre.org/mailman/listinfo/lustre-discuss-- ------------------------------------------------------------------- (o_ (o_ //\ Coltivate Linux che tanto Windows si pianta da solo. (/)_ V_/_ +------------------------------------------------------------------+ | ENRICO MORELLI | email: morelli at CERM.UNIFI.IT | | * * * * | phone: +39 055 4574269 | | University of Florence | fax : +39 055 4574253 | | CERM - via Sacconi, 6 - 50019 Sesto Fiorentino (FI) - ITALY | +------------------------------------------------------------------+
Quotas doesn''t work very well in Lustre 1.6.4.x Qunit allocation doesn''t work correctly so practically every time you change quota you have to reset it first. There are many bugzilla tickets about this issue. Also after some time of using quotas we experienced LBUG''s thus we decided to turn them off. Apparently lustre 1.6.5 will introduce lots of changes to quota code in order to fix this flows and as well to allow to introduce new features. Regards, Wojciech Turek On 5 Jun 2008, at 09:57, Enrico Morelli wrote:> On Thu, 5 Jun 2008 09:47:52 +0200 > Enrico Morelli <morelli at cerm.unifi.it> wrote: > >> On Wed, 4 Jun 2008 12:42:47 +0200 >> Enrico Morelli <morelli at cerm.unifi.it> wrote: >> >>> On Wed, 04 Jun 2008 14:11:47 +0400 >>> Andrew Perepechko <Andrew.Perepechko at sun.com> wrote: >>> >>>> Enrico, >>>> >>>> what version of Lustre are you using? >>>> >>> >>> 1.6.4.3 > > Ok. For now I solved the problem, resetting user quota and set it > again. > >>> >>>> Andrew. >>>> >>>> On Wednesday 04 June 2008 12:51:26 Enrico Morelli wrote: >>>>> Dear all, >>>>> >>>>> I''ve a problem that I don''t understand. >>>>> >>>>> Disk quotas for user hsco1 (uid 1250): >>>>> Filesystem kbytes quota limit grace files quota >>>>> limit grace /lustre_homes/ 13204576 30000000 35000000 >>>>> 60309 0 0 >>>>> spfs-MDT0000_UUID >>>>> 14760 0 102400 60309 0 0 >>>>> spfs-OST0000_UUID >>>>> 3648336 0 3788800 >>>>> spfs-OST0001_UUID >>>>> 2050408 0 2150400 >>>>> spfs-OST0002_UUID >>>>> 3660516 0 3788800 >>>>> spfs-OST0003_UUID >>>>> 3830556* 0 1 >>>>> >>>>> >>>>> For me the user is under the quota (13GB data vs 30GB of quota), >>>>> but for the system is out of quota. Where is the problem? >>>>> >>>>> Thanks >>>> >>>> >>> >>> >> I don''t understand the last row displayed by lfs quota: >> spfs-OST0003_UUID >> 3830556* 0 1 >> >> This is my df: >> /dev/data_se/lustre_mgs_mdt >> 45871740 1515804 41734496 >> 4% /lustre_mgs_mdt /dev/data_se/data_local_a >> 516061624 237605788 252241436 49% /data_local_a >> /dev/data_se/data_local_b >> 516061624 228373408 261473816 47% /data_local_b >> /dev/data_se/data_local_c >> 516061624 283749608 206097616 58% /data_local_c >> /dev/data_se/data_local_d >> 278673480 167750860 96766844 64% /data_local_d >> se-enmr.cerm.unifi.it at tcp0:/spfs >> 1826858352 917479664 816579452 53% /lustre_homes >> >> >> The manual say: >> Note - Values appended with ?*? show the limit that has been >> over-used (exceeding the quota), and receives this message Disk quota >> exceeded. >> >> How can I solve this problem? >> >> --- >> ------------------------------------------------------------------- >> (o_ (o_ //\ Coltivate Linux che tanto Windows si pianta da solo. >> (/)_ V_/_ >> +------------------------------------------------------------------+ >> | ENRICO MORELLI | email: morelli at CERM.UNIFI.IT >> | | >> * * * * | phone: +39 055 4574269 | | >> University of Florence | fax : +39 055 4574253 | | >> CERM - via Sacconi, 6 - 50019 Sesto Fiorentino (FI) - ITALY | >> +------------------------------------------------------------------+ >> _______________________________________________ >> Lustre-discuss mailing list >> Lustre-discuss at lists.lustre.org >> http://lists.lustre.org/mailman/listinfo/lustre-discuss > > > -- > ------------------------------------------------------------------- > (o_ > (o_ //\ Coltivate Linux che tanto Windows si pianta da solo. > (/)_ V_/_ > +------------------------------------------------------------------+ > | ENRICO MORELLI | email: morelli at CERM.UNIFI.IT | > | * * * * | phone: +39 055 4574269 | > | University of Florence | fax : +39 055 4574253 | > | CERM - via Sacconi, 6 - 50019 Sesto Fiorentino (FI) - ITALY | > +------------------------------------------------------------------+ > _______________________________________________ > Lustre-discuss mailing list > Lustre-discuss at lists.lustre.org > http://lists.lustre.org/mailman/listinfo/lustre-discuss
On Thu, 5 Jun 2008 10:05:52 +0100 Wojciech Turek <wjt27 at cam.ac.uk> wrote:> Quotas doesn''t work very well in Lustre 1.6.4.x > Qunit allocation doesn''t work correctly so practically every time > you change quota you have to reset it first. There are many bugzilla > tickets about this issue. > Also after some time of using quotas we experienced LBUG''s thus we > decided to turn them off. > Apparently lustre 1.6.5 will introduce lots of changes to quota code > in order to fix this flows and as well to allow to introduce new > features. > > Regards, > > Wojciech TurekThanks for the infos> > On 5 Jun 2008, at 09:57, Enrico Morelli wrote: > > > On Thu, 5 Jun 2008 09:47:52 +0200 > > Enrico Morelli <morelli at cerm.unifi.it> wrote: > > > >> On Wed, 4 Jun 2008 12:42:47 +0200 > >> Enrico Morelli <morelli at cerm.unifi.it> wrote: > >> > >>> On Wed, 04 Jun 2008 14:11:47 +0400 > >>> Andrew Perepechko <Andrew.Perepechko at sun.com> wrote: > >>> > >>>> Enrico, > >>>> > >>>> what version of Lustre are you using? > >>>> > >>> > >>> 1.6.4.3 > > > > Ok. For now I solved the problem, resetting user quota and set it > > again. > > > >>> > >>>> Andrew. > >>>> > >>>> On Wednesday 04 June 2008 12:51:26 Enrico Morelli wrote: > >>>>> Dear all, > >>>>> > >>>>> I''ve a problem that I don''t understand. > >>>>> > >>>>> Disk quotas for user hsco1 (uid 1250): > >>>>> Filesystem kbytes quota limit grace files quota > >>>>> limit grace /lustre_homes/ 13204576 30000000 35000000 > >>>>> 60309 0 0 > >>>>> spfs-MDT0000_UUID > >>>>> 14760 0 102400 60309 0 0 > >>>>> spfs-OST0000_UUID > >>>>> 3648336 0 3788800 > >>>>> spfs-OST0001_UUID > >>>>> 2050408 0 2150400 > >>>>> spfs-OST0002_UUID > >>>>> 3660516 0 3788800 > >>>>> spfs-OST0003_UUID > >>>>> 3830556* 0 1 > >>>>> > >>>>> > >>>>> For me the user is under the quota (13GB data vs 30GB of quota), > >>>>> but for the system is out of quota. Where is the problem? > >>>>> > >>>>> Thanks > >>>> > >>>> > >>> > >>> > >> I don''t understand the last row displayed by lfs quota: > >> spfs-OST0003_UUID > >> 3830556* 0 1 > >> > >> This is my df: > >> /dev/data_se/lustre_mgs_mdt > >> 45871740 1515804 41734496 > >> 4% /lustre_mgs_mdt /dev/data_se/data_local_a > >> 516061624 237605788 252241436 > >> 49% /data_local_a /dev/data_se/data_local_b > >> 516061624 228373408 261473816 > >> 47% /data_local_b /dev/data_se/data_local_c > >> 516061624 283749608 206097616 > >> 58% /data_local_c /dev/data_se/data_local_d > >> 278673480 167750860 96766844 > >> 64% /data_local_d se-enmr.cerm.unifi.it at tcp0:/spfs > >> 1826858352 917479664 816579452 > >> 53% /lustre_homes > >> > >> > >> The manual say: > >> Note - Values appended with ?*? show the limit that has been > >> over-used (exceeding the quota), and receives this message Disk > >> quota exceeded. > >> > >> How can I solve this problem? > >> > >> --- > >> ------------------------------------------------------------------- > >> (o_ (o_ //\ Coltivate Linux che tanto Windows si pianta da > >> solo. (/)_ V_/_ > >> +------------------------------------------------------------------+ > >> | ENRICO MORELLI | email: > >> morelli at CERM.UNIFI.IT | | > >> * * * * | phone: +39 055 4574269 | > >> | University of Florence | fax : +39 055 4574253 > >> | | CERM - via Sacconi, 6 - 50019 Sesto Fiorentino (FI) - > >> ITALY | > >> +------------------------------------------------------------------+ > >> _______________________________________________ Lustre-discuss > >> mailing list Lustre-discuss at lists.lustre.org > >> http://lists.lustre.org/mailman/listinfo/lustre-discuss > > > > > > -- > > ------------------------------------------------------------------- > > (o_ > > (o_ //\ Coltivate Linux che tanto Windows si pianta da solo. > > (/)_ V_/_ > > +------------------------------------------------------------------+ > > | ENRICO MORELLI | email: morelli at CERM.UNIFI.IT | > > | * * * * | phone: +39 055 4574269 | > > | University of Florence | fax : +39 055 4574253 | > > | CERM - via Sacconi, 6 - 50019 Sesto Fiorentino (FI) - ITALY | > > +------------------------------------------------------------------+ > > _______________________________________________ > > Lustre-discuss mailing list > > Lustre-discuss at lists.lustre.org > > http://lists.lustre.org/mailman/listinfo/lustre-discuss >-- ------------------------------------------------------------------- (o_ (o_ //\ Coltivate Linux che tanto Windows si pianta da solo. (/)_ V_/_ +------------------------------------------------------------------+ | ENRICO MORELLI | email: morelli at CERM.UNIFI.IT | | * * * * | phone: +39 055 4574269 | | University of Florence | fax : +39 055 4574253 | | CERM - via Sacconi, 6 - 50019 Sesto Fiorentino (FI) - ITALY | +------------------------------------------------------------------+