thr3ads.net - Dovecot news - [Dovecot-news] 1.0.rc26 released [Mar 2007]

If this information is useful, please help other people find it:
Share via:

Timo Sirainen

2007-Mar-07 00:28 UTC

[Dovecot-news] 1.0.rc26 released

http://dovecot.org/releases/dovecot-1.0.rc26.tar.gz
http://dovecot.org/releases/dovecot-1.0.rc26.tar.gz.sig

Most importantly this should fix mbox problems in recent RCs.

	* Changed --with-headers to --enable-header-install
	* If time moves backwards only max. 5 seconds, sleep until we're back
	  in the original present instead of killing ourself. An error is
	  still logged.

	- IMAP: With namespace prefixes LSUB prefix.* listed INBOX.INBOX.
	- deliver: Ignore mbox metadata headers from the message input.
	  X-IMAP header crashed deliver.
	- deliver: If mail_debug=yes, drop out DEBUG environment before
	  calling sendmail binary. Postfix's sendmail didn't really like it.
	- mbox: X-UID brokeness fixes broke rc25 even with valid X-UID headers.
	  Now the code should finally work right.
	- Maildir: When syncing a huge maildir, touch dovecot-uidlist.lock file
	  once in a while to make sure it doesn't get overwritten by another
	  process.
	- Maildir++ quota: We didn't handle NUL bytes in maildirsize files very
	  well. Now the file is rebuilt when they're seen (NFS problem).
	- Index/view handling fix should fix some crashes/errors
	- If index files were moved to a different endianess machine, Dovecot
	  logged all sorts of errors instead of silently rebuilding them.
	- Convert plugin didn't change hierarchy separators in mailbox names.
	- PostgreSQL authentication could have lost requests once in a while
	  with a heavily loaded server.
	- Login processes could have crashed in some situations
	- auth cache crashed with non-plaintext mechanisms

-------------- next part --------------
A non-text attachment was scrubbed...
Name: not available
Type: application/pgp-signature
Size: 189 bytes
Desc: This is a digitally signed message part
Url :
http://dovecot.org/pipermail/dovecot-news/attachments/20070307/5be62269/attachment.pgp

Jim Horner

2007-Mar-07 05:52 UTC

head link

[Dovecot] 1.0.rc26 released

> 	* If time moves backwards only max. 5 seconds, sleep until we're back
> 	  in the original present instead of killing ourself. An error is
> 	  still logged.
This might be a stupid question but this weekend we are about to push our 
clocks ahead one hour. In the fall when the clocks get set back an hour what 
does that do to Dovecot? 

Our servers are using NTP and I'm not entirely sure how that adjusts the 
clock. I'm laughing at myself because whatever it does it's worked for
us for
years. I know I just jinxed myself.

Thanks,

Jim

Dan Price

2007-Mar-08 19:02 UTC

head link

[Dovecot] 1.0.rc26 released

On Wed 07 Mar 2007 at 02:28AM, Timo Sirainen wrote:> http://dovecot.org/releases/dovecot-1.0.rc26.tar.gz
> http://dovecot.org/releases/dovecot-1.0.rc26.tar.gz.sig
> 
> Most importantly this should fix mbox problems in recent RCs.
(Sorry for the long mail)

I've got rc26 up and running on our production box, and we are now
migrating users onto it.  In a few days we'll see higher user load than
we saw in our pilot deployment.  So far things look mixed.  Some
observations:

- I'm seeing a lot more imap-login's around than I am used to.  Usually
  there have been just 3; maybe no big deal...?  Maybe I made a settings
  mistake?

  # pgrep -x imap-login | wc -l
        27
  # pgrep -x imap | wc -l
        30

- I'm seeing a new crash, over and over with one user (I have 580
  core files), although gdb is having a tough time getting a backtrace
  beyond a few frames; I've yet to talk to the user to see what the
  experience looked like for him.

        (gdb) bt full
        #0  0xfee505a7 in _lwp_kill () from /lib/libc.so.1
        No symbol table info available.
        #1  0xfee4d71b in thr_kill () from /lib/libc.so.1
        No symbol table info available.
        #2  0xfee06502 in raise () from /lib/libc.so.1
        No symbol table info available.
        #3  0xfede4b8d in abort () from /lib/libc.so.1
        No symbol table info available.
        #4  0x080b8ec8 in i_internal_panic_handler (fmt=0x0, 
            args=0x8047024 "\217?\f\b\230\001") at failures.c:406
                backtrace = 0x80e9c68 "0x80b8a2f -> 0x8087b2f ->
0x80830f0 -> 0x80850f2 -> 0x8085560 -> 0x80ad0b0 -> 0x8071296 ->
0x806a1bf -> 0x806a334 -> 0x806ba6e -> 0x806ba02 -> 0x806bbbc ->
0x80be0d9 -> 0x80bdb11 -> 0x8072a08 -> 0x806"...
        #5  0x080b8a2f in i_panic (
            format=0x80d23c0 "file %s: line %d (%s): assertion failed:
(%s)")
            at failures.c:195
        No locals.
        #6  0x08087b2f in mbox_sync_rewrite (sync_ctx=0x8047800, mail_ctx=0x0, 
            end_offset=138189881, move_diff=742, extra_space=The value of
variable 'extra_space' is distributed across several
        locations, and GDB cannot access its value.

        )
            at mbox-sync-rewrite.c:566
                mails = (struct mbox_sync_mail *) 0x811dc48
                offset = The value of variable 'offset' is distributed
across several
        locations, and GDB cannot access its value.
        (gdb) 

  Here is a pstack:

        # pstack core.imap.211539.117146
        core 'core.imap.211539.117146' of 211539:       imap
         fee505a7 _lwp_kill (1, 6) + 7
         fee06502 raise    (6) + 22
         fede4b8d abort    (80fe829, 80e9c68, 8047018, 80b8a2f, 80d23c0,
8047024) + cd
         080b8ec8 i_internal_fatal_handler (80d23c0, 8047024, 8047028, 80b7cb6,
80f5568, 8047027)
         080b8a2f ???????? (80d23c0, 80cc28f, 198, 80c71ae, 80d2528, a)
         08087b2f mbox_sync_rewrite (8047800, 0, 83c9c39, 0, 2e6, 0) + 4f
         080830f0 mbox_sync_do (feffcc70, 6799ca3, 98, 1, 29f0cad6, ffffffff) +
a84
         080850f2 mbox_sync (80fca90, 8, 0, 45f05a57, 80f68a0, 80f6b88) + 40e
         08085560 mbox_storage_sync_init (80fca90, 1, 4d3db, 0) + 3c
         080ad0b0 mailbox_sync_init (80fca90, 1, 0, 0, 0, 0) + 10
         08071296 imap_sync_nonselected (80fca90, 1, 0, 0) + 12
         0806a1bf _cmd_select_full (80f6bcc, 0, 22, 8, 806bf90, 22) + 9b
         0806a334 cmd_select (80f6bcc, 80fafe0, 7, 80f6bcc) + 10
         0806ba6e client_handle_input (80f6b88, 80f6bcc, 8047a48, 806bbab, 2,
80f6b88) + fa
         0806ba02 client_handle_input (80bdfdd, 0, 9, 2, 80f5338, 1) + 8e
         0806bbbc _client_input (80f6b88, 3, 8047a88, 80be0ce, 1, 1000000) + 74
         080be0d9 io_loop_handler_run (80f4380, 0, 80f6b88, 8047c3a) + 131
         080bdb11 io_loop_run (80f4380, 1, 80f6498, 32, fee47cd1, fedd63fc) + 21
         08072a08 main     (1, 8047b18, 8047b20) + 408
         08067074 _start   (1, 8047c20, 0, 8047c25, 8047c35, 8047c42) + 80


- Dovecot is still *really* noisy on endianness switchover, and also I think
  it has been crashy, too:
    
    Info: IMAP(foobar): Effective uid=123456, gid=10, home=/home/foobar
    Info: IMAP(foobar): mbox:
data=/home/foobar:INBOX=/var/mail/foobar:INDEX=/home/foobar/Mail/imapd-indices
    Info: IMAP(foobar): mbox: root=/home/foobar,
index=/home/foobar/Mail/imapd-indices, inbox=/var/mail/foobar
    Info: IMAP(foobar): Effective uid=123456, gid=10, home=/home/foobar
    Info: IMAP(foobar): mbox:
data=/home/foobar:INBOX=/var/mail/foobar:INDEX=/home/foobar/Mail/imapd-indices
    Info: IMAP(foobar): mbox: root=/home/foobar,
index=/home/foobar/Mail/imapd-indices, inbox=/var/mail/foobar
    Error: IMAP(foobar): Corrupted index cache file
/home/foobar/Mail/imapd-indices/.imap/INBOX/dovecot.index.cache: field header
points outside file
    Error: IMAP(foobar): Corrupted index cache file
/home/foobar/Mail/imapd-indices/.Mail/Incoming/.imap/BUGS/dovecot.index.cache:
field header points outside file
    Error: IMAP(foobar): Corrupted index cache file
/home/foobar/Mail/imapd-indices/.Mail/Incoming/.imap/KRNL/dovecot.index.cache:
field header points outside file
    Error: IMAP(foobar): Corrupted index cache file
/home/foobar/Mail/imapd-indices/.Mail/Incoming/.imap/OSOL/dovecot.index.cache:
field header points outside file
    Error: IMAP(foobar): Corrupted index cache file
/home/foobar/Mail/imapd-indices/.Mail/Incoming/.imap/CBLT/dovecot.index.cache:
field header points outside file
    Error: IMAP(foobar): Corrupted index cache file
/home/foobar/Mail/imapd-indices/.Mail/Incoming/.imap/SUST/dovecot.index.cache:
field header points outside file
    Error: IMAP(foobar): Corrupted index cache file
/home/foobar/Mail/imapd-indices/.Mail/Incoming/.imap/MISC/dovecot.index.cache:
field header points outside file
    Error: IMAP(foobar): Corrupted index cache file
/home/foobar/Mail/imapd-indices/.Mail/Incoming/.imap/ESCS/dovecot.index.cache:
field header points outside file
    Error: IMAP(foobar): Corrupted index cache file
/home/foobar/Mail/imapd-indices/.Mail/Incoming/.imap/NFST/dovecot.index.cache:
field header points outside file
    Error: IMAP(foobar): Corrupted index cache file
/home/foobar/Mail/imapd-indices/.Mail/Incoming/.imap/FSPT/dovecot.index.cache:
field header points outside file
    Error: IMAP(foobar): Corrupted index cache file
/home/foobar/Mail/imapd-indices/.Mail/Incoming/.imap/ZFST/dovecot.index.cache:
field header points outside file
    Error: IMAP(foobar): Corrupted index cache file
/home/foobar/Mail/imapd-indices/.Mail/Incoming/.imap/JRSC/dovecot.index.cache:
field header points outside file
    Error: IMAP(foobar): Corrupted index cache file
/home/foobar/Mail/imapd-indices/.Mail/Incoming/.imap/SPAM/dovecot.index.cache:
field header points outside file
    Error: IMAP(foobar): Corrupted index cache file
/home/foobar/Mail/imapd-indices/.Mail/Incoming/.imap/UFST/dovecot.index.cache:
field header points outside file
    Error: IMAP(foobar): Corrupted index cache file
/home/foobar/Mail/imapd-indices/.Mail/Incoming/.imap/PCFS/dovecot.index.cache:
field header points outside file
    Error: IMAP(foobar): Corrupted index cache file
/home/foobar/Mail/imapd-indices/.Mail/Incoming/.imap/INBX/dovecot.index.cache:
field header points outside file
    Error: IMAP(foobar): Corrupted transaction log file
/home/foobar/Mail/imapd-indices/.Mail/Incoming/.imap/PBAK/dovecot.index.log:
start_offset (6144) > file size (3400)
    Error: IMAP(foobar): broken sync positions
    Warning: IMAP(foobar): fscking index file
/home/foobar/Mail/imapd-indices/.Mail/Incoming/.imap/PBAK/dovecot.index
    Error: IMAP(foobar): Fixed index file
/home/foobar/Mail/imapd-indices/.Mail/Incoming/.imap/PBAK/dovecot.index: log
file sync pos 0,0 -> 33554432, 6144
    Error: IMAP(foobar): Unexpected transaction log desync with index
/home/foobar/Mail/imapd-indices/.Mail/Incoming/.imap/PBAK/dovecot.index
    Error: IMAP(foobar): Corrupted transaction log file
/home/foobar/Mail/imapd-indices/.Mail/Incoming/.imap/PRTI/dovecot.index.log:
start_offset (6144) > file size (2808)
    Error: IMAP(foobar): Unexpected transaction log desync with index
/home/foobar/Mail/imapd-indices/.Mail/Incoming/.imap/PRTI/dovecot.index
    Error: IMAP(foobar): Corrupted index cache file
/home/foobar/Mail/imapd-indices/.Mail/Incoming/.imap/PBAK/dovecot.index.cache:
indexid changed
    Error: IMAP(foobar): Corrupted index cache file
/home/foobar/Mail/imapd-indices/.Mail/Incoming/.imap/PRTI/dovecot.index.cache:
indexid changed
    Info: imap-login: Disconnected: rip=XXX.9.61.63, lip=XXX.YYY.17.63
    Info: imap-login: Disconnected: rip=XXX.9.61.63, lip=XXX.YYY.17.63
    Error: IMAP(foobar): Corrupted index cache file
/home/foobar/Mail/imapd-indices/.Mail/.imap/Trash/dovecot.index.cache: field
header points outside file
    Error: IMAP(foobar): Corrupted transaction log file
/home/foobar/Mail/imapd-indices/.Mail/Incoming/.imap/OSOL/dovecot.index.log:
unknown record type 0x10
    Warning: IMAP(foobar): fscking index file
/home/foobar/Mail/imapd-indices/.Mail/Incoming/.imap/OSOL/dovecot.index
    Info: IMAP(foobar): Disconnected: Internal error occurred. Refer to server
log for more information. [2007-03-07 06:59:21]
    Info: imap-login: Login: user=<foobar>, method=PLAIN, rip=XXX.9.61.63,
lip=XXX.YYY.17.63, TLS
    Info: IMAP(foobar): Effective uid=123456, gid=10, home=/home/foobar
    Info: IMAP(foobar): mbox:
data=/home/foobar:INBOX=/var/mail/foobar:INDEX=/home/foobar/Mail/imapd-indices
    ...
    Info: imap-login: Login: user=<foobar>, method=PLAIN, rip=XXX.9.61.63,
lip=XXX.YYY.17.63, TLS
    Info: IMAP(foobar): Effective uid=123456, gid=10, home=/home/foobar
    Info: IMAP(foobar): mbox:
data=/home/foobar:INBOX=/var/mail/foobar:INDEX=/home/foobar/Mail/imapd-indices
    Info: IMAP(foobar): mbox: root=/home/foobar,
index=/home/foobar/Mail/imapd-indices, inbox=/var/mail/foobar
    Error: IMAP(foobar): Corrupted index cache file
/home/foobar/Mail/imapd-indices/.Mail/.imap/Sent/dovecot.index.cache: field
header points outside file
    Error: IMAP(foobar): Corrupted transaction log file
/home/foobar/Mail/imapd-indices/.Mail/Incoming/.imap/INBX/dovecot.index.log:
hdr.size too large (133076088)
    Warning: IMAP(foobar): fscking index file
/home/foobar/Mail/imapd-indices/.Mail/Incoming/.imap/INBX/dovecot.index
    Error: IMAP(foobar): Unexpected transaction log desync with index
/home/foobar/Mail/imapd-indices/.Mail/Incoming/.imap/INBX/dovecot.index
    Info: IMAP(foobar): Disconnected: Mailbox is in inconsistent state, please
relogin.
    Error: IMAP(foobar): file client.c: line 412 (_client_input): assertion
failed: (!client->handling_input)
    Error: IMAP(foobar): Raw backtrace: 0x80b8fd3 -> 0x806c1da ->
0x8068f2d -> 0x8069169 -> 0x8069222 -> 0x806935f -> 0x806bfd7 ->
0x806bf5e -> 0x806c140 -> 0x80be67d -> 0x80be0b5 -> 0x8072fac ->
0x806722c
    Error: child 170842 (imap) killed with signal 6
    Info: imap-login: Login: user=<foobar>, method=PLAIN, rip=XXX.9.61.63,
lip=XXX.YYY.17.63, TLS
    Info: IMAP(foobar): Effective uid=123456, gid=10, home=/home/foobar
    Info: IMAP(foobar): mbox:
data=/home/foobar:INBOX=/var/mail/foobar:INDEX=/home/foobar/Mail/imapd-indices
    Info: IMAP(foobar): mbox: root=/home/foobar,
index=/home/foobar/Mail/imapd-indices, inbox=/var/mail/foobar
    Error: IMAP(foobar): Corrupted transaction log file
/home/foobar/Mail/imapd-indices/.Mail/Incoming/.imap/SUST/dovecot.index.log:
unknown record type 0x0
    Warning: IMAP(foobar): fscking index file
/home/foobar/Mail/imapd-indices/.Mail/Incoming/.imap/SUST/dovecot.index
    Info: IMAP(foobar): Disconnected: Internal error occurred. Refer to server
log for more information. [2007-03-07 07:02:32]
    Info: imap-login: Login: user=<foobar>, method=PLAIN, rip=XXX.9.61.63,
lip=XXX.YYY.17.63, TLS
    Info: IMAP(foobar): Effective uid=123456, gid=10, home=/home/foobar
    Info: IMAP(foobar): mbox:
data=/home/foobar:INBOX=/var/mail/foobar:INDEX=/home/foobar/Mail/imapd-indices
    Info: IMAP(foobar): mbox: root=/home/foobar,
index=/home/foobar/Mail/imapd-indices, inbox=/var/mail/foobar

  And on and on.  I can live with it, but it'd be nice to have it be
detected
and dealt with, with perhaps a less alarming message: "{big|little} endian
{index|cache}
file detected on {little|big} endian system; removing."

Thanks as always,

        -dp

-- 
Daniel Price - Solaris Kernel Engineering - dp at eng.sun.com - blogs.sun.com/dp

Matthias Andree

2007-Mar-12 16:36 UTC

head link

[Dovecot] 1.0.rc26 released

Timo Sirainen schrieb:> http://dovecot.org/releases/dovecot-1.0.rc26.tar.gz
> http://dovecot.org/releases/dovecot-1.0.rc26.tar.gz.sig
> 
> 	- Maildir++ quota: We didn't handle NUL bytes in maildirsize files
very
> 	  well. Now the file is rebuilt when they're seen (NFS problem).
These can also happen locally with many of the metadata-only journaling
file systems (reiserfs, XFS, ext3fs in data=writeback mode). It
shouldn't happen with ordered write patches for reiserfs, ext3fs default
mount options, or SOFTDEP or similar file systems.

Possibly Parallel Threads

Search for more reasonably related threads

Dovecot news - Mar 2007 - 1.0.rc26 released

[Dovecot-news] 1.0.rc26 released

[Dovecot] 1.0.rc26 released

[Dovecot] 1.0.rc26 released

[Dovecot] 1.0.rc26 released

Possibly Parallel Threads