zfs discuss - May 2007 - Remove files when at quota limit

We have around 1000 users all with quotas set on their ZFS filesystems on
Solaris 10 U3.  We take snapshots daily and rotate out the week old ones.  The
situation is that some users ignore the advice of keeping space used below 80%
and keep creating large temporary files.  They then try to remove files when the
space used is 100% and get over quota messages.  We then need to remove some or
all of their snapshots to free space.  Is there anything being worked on to keep
some space reserved so files can be removed when at the quota limit or some
other solution?  What are other people doing is this situation?  We have also
set up alternate filesystems for users with transient data that we do not take
snapshots on, but we still have this problem on home directories.

thanks,
Ben
 
 
This message posted from opensolaris.org

i have the same problem, the users cant remove there files when the quota is
reached.

workaround is to raise the quota, remove the files and set the original quota.
so you can keep your snapshots.
 
 
This message posted from opensolaris.org

Has anyone else run into this situation?  Does anyone have any solutions other
than removing snapshots or increasing the quota?  I''d like to put in an
RFE to reserve some space so files can be removed when users are at their quota.
Any thoughts from the ZFS team?

Ben
> We have around 1000 users all with quotas set on
> their ZFS filesystems on Solaris 10 U3.  We take
> snapshots daily and rotate out the week old ones.
> The situation is that some users ignore the advice
> of keeping space used below 80% and keep creating
> large temporary files.  They then try to remove
> files when the space used is 100% and get over quota
> messages.  We then need to remove some or all of
> their snapshots to free space.  Is there anything
> being worked on to keep some space reserved so files
> can be removed when at the quota limit or some other
> solution?  What are other people doing is this
> situation?  We have also set up alternate
> filesystems for users with transient data that we do
> not take snapshots on, but we still have this
>  problem on home directories.
> 
> thanks,
> Ben
 
 
This message posted from opensolaris.org

zfs-discuss-bounces at opensolaris.org wrote on 05/15/2007 09:01:00 AM:
> Has anyone else run into this situation?  Does anyone have any
> solutions other than removing snapshots or increasing the quota?
> I''d like to put in an RFE to reserve some space so files can be
> removed when users are at their quota.  Any thoughts from the ZFS team?
>
> Ben
Not from the ZFS team,  but I would like to see user/group quotas and the
ability to flag both types of quotas with the following options:

* Ignore snapshot reservations when calculating quota -- Don''t punish
users
for administratively driven snap policy.
* Ignore COW overhead for quotas (allow unlink anytime) -- from my testing
it appears as though a delete on a quota limit fs fails in some situations
even with no snapshots (where you have to grow the quota unlink then
reset).

-Wade
>
> > We have around 1000 users all with quotas set on
> > their ZFS filesystems on Solaris 10 U3.  We take
> > snapshots daily and rotate out the week old ones.
> > The situation is that some users ignore the advice
> > of keeping space used below 80% and keep creating
> > large temporary files.  They then try to remove
> > files when the space used is 100% and get over quota
> > messages.  We then need to remove some or all of
> > their snapshots to free space.  Is there anything
> > being worked on to keep some space reserved so files
> > can be removed when at the quota limit or some other
> > solution?  What are other people doing is this
> > situation?  We have also set up alternate
> > filesystems for users with transient data that we do
> > not take snapshots on, but we still have this
> >  problem on home directories.
> >
> > thanks,
> > Ben
>
>
> This message posted from opensolaris.org
> _______________________________________________
> zfs-discuss mailing list
> zfs-discuss at opensolaris.org
> http://mail.opensolaris.org/mailman/listinfo/zfs-discuss

On Tue, May 15, 2007 at 09:36:35AM -0500, Wade.Stuart at fallon.com
wrote:
>
> * Ignore snapshot reservations when calculating quota -- Don''t
punish users
> for administratively driven snap policy.
See:

6431277 want filesystem-only quotas
> * Ignore COW overhead for quotas (allow unlink anytime) -- from my testing
> it appears as though a delete on a quota limit fs fails in some situations
> even with no snapshots (where you have to grow the quota unlink then
> reset).
Mark has some related fixes in this area, I don''t know if it addresses
this particular situation.

- Eric

--
Eric Schrock, Solaris Kernel Development       http://blogs.sun.com/eschrock