dovecot - May 2010 - Sieve problem. Timo, is this mbox file size limitation hard coded? If so, why?

I would not have expected this upon implementing sieve.  And I really need
to get around this limitation.  LDA has no problem writing to these large
mbox files.  Why does sieve have a problem with them?  This is very odd.

May 10 17:45:04 greer dovecot: deliver(stan): write() failed with mbox file
/home/stan/mail/1-Debian-Users: File too large
May 10 17:45:04 greer dovecot: deliver(stan): write() failed with mbox file
/home/stan/mail/1-Debian-Users: File too large
May 10 17:45:04 greer dovecot: deliver(stan): sieve:
msgid=<20100510224422.GA4293 at heima.gjk.dk>: failed to store into
mailbox
'1-Debian-Users': Internal error occurred. Refer to server log for more
information. [2010-05-10 17:45:04]
May 10 17:45:04 greer dovecot: deliver(stan): sieve:
msgid=<20100510224422.GA4293 at heima.gjk.dk>: stored mail into mailbox
'INBOX'
May 10 17:45:04 greer dovecot: deliver(stan): sieve: execution of script
/home/stan/.dovecot.sieve failed, but implicit keep was successful

May 10 17:47:41 greer dovecot: deliver(stan): write() failed with mbox file
/home/stan/mail/1-Spam-l: File too large
May 10 17:47:41 greer dovecot: deliver(stan): sieve:
msgid=<AANLkTinOywSh2KzgJhfHEihRSqKQn_Tg9KWnOwazmVmp at mail.gmail.com>:
failed
 store into mailbox '1-Spam-l': Internal error occurred. Refer to server
log
for more information. [2010-05-10 17:47:41]
May 10 17:47:41 greer dovecot: deliver(stan): sieve:
msgid=<AANLkTinOywSh2KzgJhfHEihRSqKQn_Tg9KWnOwazmVmp at mail.gmail.com>:
stored
il into mailbox 'INBOX'
May 10 17:47:41 greer dovecot: deliver(stan): sieve: execution of script
/home/stan/.dovecot.sieve failed, but implicit keep was scessful

[05:52:24][root at greer]/usr/bin$ la /home/stan/mail/
total 301M
drwx------  5 stan stan 4.0K May  7 04:33 .
drwxr-xr-x 10 stan stan 4.0K May 10 16:18 ..
drwx------ 37 stan stan 4.0K May  7 04:33 .imap
-rw-------  1 stan stan  463 May  7 04:33 .subscriptions
-rw-------  1 stan stan  66M May 10 17:45 1-Debian-Users
-rw-------  1 stan stan  14M May 10 17:16 1-Dovecot
-rw-------  1 stan stan 3.6M May 10 16:05 1-Linux-IDE
-rw-------  1 stan stan  30M May 10 17:48 1-Postfix-Users
-rw-------  1 stan stan 1.4M May 10 12:33 1-Roundcube
-rw-------  1 stan stan  17M May 10 15:55 1-Samba
-rw-------  1 stan stan  56M May 10 17:47 1-Spam-l
-rw-------  1 stan stan 6.7M May 10 17:45 1-XFS
-rw-------  1 stan stan  18M May 10 16:32 SpamTrap

Is there any reason we have a fixed ceiling on the size of an mbox sieve
will write to?  Man this is disappointing.  What is the ceiling?  It appears
to be somewhere between 30MB and 56MB as writes to 1-Postfix-Users are
successful but writes to 1-Spam-l fail.

Is there a fix/patch for this?

Thanks.

-- 
Stan

Apologies for pointing the finger at lda/sieve.  After much digging and
Googling I found that the problem actually lies with a Postfix default
setting, specifically:

"mailbox_size_limit (default: 51200000)

    The maximal size of any local(8) individual mailbox or maildir file, or
zero (no limit). In fact, this limits the size of any file that is written
to upon local delivery, including files written by external commands that
are executed by the local(8) delivery agent.

    This limit must not be smaller than the message size limit."


I set it to zero and that fixed the problem.  This is indeed one strange
situation.  The error was reported in the log by dovecot, but the setting
that fixes the problem is actually in Postfix.  It would be nice if there
was a short heads up regarding this in the dovecot wiki postfix LDA and/or
sieve sections.  I'll mention this on postfix-user as well.

-- 
Stan


Stan Hoeppner put forth on 5/10/2010 6:03 PM:
> I would not have expected this upon implementing sieve.  And I really need
> to get around this limitation.  LDA has no problem writing to these large
> mbox files.  Why does sieve have a problem with them?  This is very odd.
> 
> May 10 17:45:04 greer dovecot: deliver(stan): write() failed with mbox file
> /home/stan/mail/1-Debian-Users: File too large
> May 10 17:45:04 greer dovecot: deliver(stan): write() failed with mbox file
> /home/stan/mail/1-Debian-Users: File too large
> May 10 17:45:04 greer dovecot: deliver(stan): sieve:
> msgid=<20100510224422.GA4293 at heima.gjk.dk>: failed to store into
mailbox
> '1-Debian-Users': Internal error occurred. Refer to server log for
more
> information. [2010-05-10 17:45:04]
> May 10 17:45:04 greer dovecot: deliver(stan): sieve:
> msgid=<20100510224422.GA4293 at heima.gjk.dk>: stored mail into
mailbox 'INBOX'
> May 10 17:45:04 greer dovecot: deliver(stan): sieve: execution of script
> /home/stan/.dovecot.sieve failed, but implicit keep was successful
> 
> May 10 17:47:41 greer dovecot: deliver(stan): write() failed with mbox file
> /home/stan/mail/1-Spam-l: File too large
> May 10 17:47:41 greer dovecot: deliver(stan): sieve:
> msgid=<AANLkTinOywSh2KzgJhfHEihRSqKQn_Tg9KWnOwazmVmp at
mail.gmail.com>: failed
>  store into mailbox '1-Spam-l': Internal error occurred. Refer to
server log
> for more information. [2010-05-10 17:47:41]
> May 10 17:47:41 greer dovecot: deliver(stan): sieve:
> msgid=<AANLkTinOywSh2KzgJhfHEihRSqKQn_Tg9KWnOwazmVmp at
mail.gmail.com>: stored
> il into mailbox 'INBOX'
> May 10 17:47:41 greer dovecot: deliver(stan): sieve: execution of script
> /home/stan/.dovecot.sieve failed, but implicit keep was scessful
> 
> [05:52:24][root at greer]/usr/bin$ la /home/stan/mail/
> total 301M
> drwx------  5 stan stan 4.0K May  7 04:33 .
> drwxr-xr-x 10 stan stan 4.0K May 10 16:18 ..
> drwx------ 37 stan stan 4.0K May  7 04:33 .imap
> -rw-------  1 stan stan  463 May  7 04:33 .subscriptions
> -rw-------  1 stan stan  66M May 10 17:45 1-Debian-Users
> -rw-------  1 stan stan  14M May 10 17:16 1-Dovecot
> -rw-------  1 stan stan 3.6M May 10 16:05 1-Linux-IDE
> -rw-------  1 stan stan  30M May 10 17:48 1-Postfix-Users
> -rw-------  1 stan stan 1.4M May 10 12:33 1-Roundcube
> -rw-------  1 stan stan  17M May 10 15:55 1-Samba
> -rw-------  1 stan stan  56M May 10 17:47 1-Spam-l
> -rw-------  1 stan stan 6.7M May 10 17:45 1-XFS
> -rw-------  1 stan stan  18M May 10 16:32 SpamTrap
> 
> Is there any reason we have a fixed ceiling on the size of an mbox sieve
> will write to?  Man this is disappointing.  What is the ceiling?  It
appears
> to be somewhere between 30MB and 56MB as writes to 1-Postfix-Users are
> successful but writes to 1-Spam-l fail.
> 
> Is there a fix/patch for this?
> 
> Thanks.
>

On Mon, 2010-05-10 at 21:06 -0500, Stan Hoeppner wrote:
> 
> > May 10 17:45:04 greer dovecot: deliver(stan): write() failed with
> mbox file
> > /home/stan/mail/1-Debian-Users: File too large 
http://hg.dovecot.org/dovecot-2.0/rev/f7527971fed0 will probably help in
future too.