I just upgraded our test server from rc6 to rc10...
ISSUE #1
I noticed that we no longer are getting two "From_" lines. However,
the
one that was good (had the original sender e-mail address) is now gone.
The one with "dovecot.deliver" remains.
I attempted to add "-d test" to the mailbox_command line in main.cf as
follows:
mailbox_command = /opt/dovecot/libexec/dovecot/deliver -d test
and things turned ugly and caused Postfix to defer messages:
Oct 17 16:31:50 hostname postfix/local[7230]: D14632C9C: to=<someuser at
somehost>, relay=local, delay=3.6, delays=3/0.02/0/0.62, dsn=4.3.0,
status=deferred (temporary failure)
I removed the "-d test" from the Postfix main.cf and the problem went
away.
So, how do I fix the "From_" lines?
ISSUE #2
After upgrading, messages cannot be moved from the INBOX to a folder.
Thunderbird claims there was an internal error and to consule the server
logs, but I see nothing in the dovecot logs that would indicate what's
going on. For example, I attempted to move a message into my Trash folder
which did not currently have any index files. Here is a Solaris truss
output of that attempt:
poll(0x000B4C98, 2, 999) = 0
poll(0x000B4C98, 2, 0) = 0
poll(0x000B4C98, 2, 999) = 1
read(0, " D O N E\r\n", 3323) = 6
write(1, " 2 8 O K I d l e c".., 23) = 23
read(0, 0x000BC5BB, 3317) Err#11 EAGAIN
poll(0x000B4C98, 2, 675) = 1
read(0, " 3 0 u i d c o p y ".., 3317) = 27
stat64("/home/sfs/Trash", 0xFFBFF5C8) = 0
alarm(120) = 0
fcntl(6, F_SETLKW64, 0xFFBFF308) = 0
alarm(0) = 120
stat64("/home/sfs/Trash", 0xFFBFF640) = 0
mkdir("/home/sfs/.imap/Trash", 0770) Err#17 EEXIST
stat64("/home/sfs/.imap/Trash", 0xFFBFF4C0) = 0
stat64("/home/sfs/Trash", 0xFFBFF4C0) = 0
time() = 1161122396
open64("/home/sfs/.imap/Trash/dovecot.index", O_RDWR) Err#2 ENOENT
open64("/home/sfs/.imap/Trash/dovecot.index", O_RDWR) Err#2 ENOENT
write(1, " 3 0 N O I n t e r n".., 96) = 96
poll(0x000B4C98, 2, 588) = 0
poll(0x000B4C98, 2, 0) = 0
poll(0x000B4C98, 2, 410) = 0
Someone else using a different IMAP client caused these errors to
occur (this is even after I wiped all of their dovecot index files):
Oct 17 16:43:11 earth.tc.umn.edu dovecot: IMAP(kor): Corrupted transaction log
file /home/kor/.imap/INBOX/dovecot.index.log: invalid indexid (1161121145 !=
1156185395)
Oct 17 16:43:11 earth.tc.umn.edu dovecot: IMAP(kor): Corrupted transaction log
file /home/kor/.imap/INBOX/dovecot.index.log: invalid new transaction log
sequence (6 >= 6)
Oct 17 16:47:09 earth.tc.umn.edu dovecot: IMAP(kor): Corrupted transaction log
file /home/kor/.imap/INBOX/dovecot.index.log: invalid indexid (1161121145 !=
1161120959)
Oct 17 16:47:09 earth.tc.umn.edu dovecot: IMAP(kor): Corrupted transaction log
file /home/kor/.imap/INBOX/dovecot.index.log: invalid new transaction log
sequence (2 >= 2)
Oct 17 17:05:59 earth.tc.umn.edu dovecot: IMAP(kor): Corrupted transaction log
file /home/kor/.imap/INBOX/dovecot.index.log: invalid indexid (1161121145 !=
1161120959)
Oct 17 17:05:59 earth.tc.umn.edu dovecot: IMAP(kor): Corrupted transaction log
file /home/kor/.imap/INBOX/dovecot.index.log: invalid new transaction log
sequence (4 >= 4)
Here are our non-standard dovecot.conf items:
protocols = imap imaps pop3 pop3s
shutdown_clients = no
syslog_facility = local6
ssl_cert_file = /etc/opt/openssl/certs/dovecot.pem
ssl_key_file = /etc/opt/openssl/private/dovecot.pem
default_mail_env = mbox:~/:INBOX=/var/mail/%u
# Default namespace
namespace private {
separator = /
prefix location = mbox:~/:INBOX=/var/mail/%u
inbox = yes
hidden = yes
}
mail_full_filesystem_access = yes
first_valid_uid = 100
max_mail_processes = 8192
mbox_min_index_size = 128
imap_client_workarounds = delay-newmail outlook-idle tb-extra-mailbox-sep
pop3_uidl_format = %08Xu%08Xv
protocol lda {
postmaster_address = postmaster at umn.edu
mail_plugins = cmusieve
}
auth_verbose = yes
auth_debug = yes
auth default {
passdb pam {
args = session=yes *
}
}
I am now backing out to rc6 for now... we never saw this behavior on rc6.
--
Steven F. Siirila Office: Lind Hall, Room 130B
Internet Services E-mail: sfs at umn.edu
Office of Information Technology Voice: (612) 626-0244
University of Minnesota Fax: (612) 626-7593
On Tue, Oct 17, 2006 at 05:19:40PM -0500, Steven F Siirila wrote:> I just upgraded our test server from rc6 to rc10.... . .> ISSUE #2 > > After upgrading, messages cannot be moved from the INBOX to a folder. > Thunderbird claims there was an internal error and to consule the server > logs, but I see nothing in the dovecot logs that would indicate what's > going on. For example, I attempted to move a message into my Trash folder > which did not currently have any index files. Here is a Solaris truss > output of that attempt:. . . I believe I have at least found part of the problem. It seems that RC10 makes an assumption in at least parts of the code that the index files exist for a given folder. In my environment, they only get created if they are > 128KB (mbox_min_index_size = 128). When I commented this out, I was able to copy/move messages to alternate folders... At this point I'm not sure if the other problem with corrupted index files is related or not. -- Steven F. Siirila Office: Lind Hall, Room 130B Internet Services E-mail: sfs at umn.edu Office of Information Technology Voice: (612) 626-0244 University of Minnesota Fax: (612) 626-7593
On Tue, Oct 17, 2006 at 05:19:40PM -0500, Steven F Siirila wrote:> I just upgraded our test server from rc6 to rc10... > > ISSUE #1 > > I noticed that we no longer are getting two "From_" lines. However, the > one that was good (had the original sender e-mail address) is now gone. > The one with "dovecot.deliver" remains. > > I attempted to add "-d test" to the mailbox_command line in main.cf as follows: > > mailbox_command = /opt/dovecot/libexec/dovecot/deliver -d test > > and things turned ugly and caused Postfix to defer messages: > > Oct 17 16:31:50 hostname postfix/local[7230]: D14632C9C: to=<someuser at somehost>, relay=local, delay=3.6, delays=3/0.02/0/0.62, dsn=4.3.0, status=deferred (temporary failure) > > I removed the "-d test" from the Postfix main.cf and the problem went away. > So, how do I fix the "From_" lines?. . . I'll now answer my own question. I should be using '-f <from>' instead. I haven't had a chance to test this yet, but I suspect I'll get different results. :) Also, I should note that the "Usage:" message for deliver does not include the -f option, which of course is a recent addition. -- Steven F. Siirila Office: Lind Hall, Room 130B Internet Services E-mail: sfs at umn.edu Office of Information Technology Voice: (612) 626-0244 University of Minnesota Fax: (612) 626-7593
On Tue, Oct 17, 2006 at 05:19:40PM -0500, Steven F Siirila wrote:> I just upgraded our test server from rc6 to rc10... > > ISSUE #1 > > I noticed that we no longer are getting two "From_" lines. However, the > one that was good (had the original sender e-mail address) is now gone. > The one with "dovecot.deliver" remains. > > I attempted to add "-d test" to the mailbox_command line in main.cf as follows: > > mailbox_command = /opt/dovecot/libexec/dovecot/deliver -d test > > and things turned ugly and caused Postfix to defer messages: > > Oct 17 16:31:50 hostname postfix/local[7230]: D14632C9C: to=<someuser at somehost>, relay=local, delay=3.6, delays=3/0.02/0/0.62, dsn=4.3.0, status=deferred (temporary failure) > > I removed the "-d test" from the Postfix main.cf and the problem went away. > So, how do I fix the "From_" lines?The final resolution for #1 was to use this in the Postfix main.cf file: mailbox_command = /opt/dovecot/libexec/dovecot/deliver -f "$SENDER"> ISSUE #2 > > After upgrading, messages cannot be moved from the INBOX to a folder. > Thunderbird claims there was an internal error and to consule the server > logs, but I see nothing in the dovecot logs that would indicate what's > going on. For example, I attempted to move a message into my Trash folder > which did not currently have any index files. Here is a Solaris truss > output of that attempt:The workaround for #2, as mentioned earlier, was to make sure to index ALL mailboxes (using mbox_min_index_size = 0, which is the default). Until this is fixed, please know that you must have mbox_min_index_size set to 0 if you are using mbox format, perhaps others as well, in RC10. The problem did not exist in RC6. I don't know about the ones in between. -- Steven F. Siirila Office: Lind Hall, Room 130B Internet Services E-mail: sfs at umn.edu Office of Information Technology Voice: (612) 626-0244 University of Minnesota Fax: (612) 626-7593
On October 26, 2006 10:54:39 AM -0500 Steven F Siirila <sfs at tc.umn.edu> wrote:> On Tue, Oct 17, 2006 at 05:19:40PM -0500, Steven F Siirila wrote: >> I just upgraded our test server from rc6 to rc10... >> >> ISSUE #1 >> >> I noticed that we no longer are getting two "From_" lines. However, the >> one that was good (had the original sender e-mail address) is now gone. >> The one with "dovecot.deliver" remains. >> >> I attempted to add "-d test" to the mailbox_command line in main.cf as >> follows: >> >> mailbox_command = /opt/dovecot/libexec/dovecot/deliver -d test >> >> and things turned ugly and caused Postfix to defer messages: >> >> Oct 17 16:31:50 hostname postfix/local[7230]: D14632C9C: >> to=<someuser at somehost>, relay=local, delay=3.6, delays=3/0.02/0/0.62, >> dsn=4.3.0, status=deferred (temporary failure) >> >> I removed the "-d test" from the Postfix main.cf and the problem went >> away. So, how do I fix the "From_" lines? > > The final resolution for #1 was to use this in the Postfix main.cf file: > > mailbox_command = /opt/dovecot/libexec/dovecot/deliver -f "$SENDER"If you recall, I replied to this thread earlier saying I had no problems with beta8 -- deliver (lda from cvs, for sieve) wrote a single From line into Maildir files and it was the envelope sender. That was with postfix-2.3.2 and mailbox_command = /path/to/deliver. (no options) I just upgraded to rc15 and deliver (now from dovecot itself but with sieve plugin) with postfix-2.3.3 acts identically -- no problems. -frank