Piotr Rotter
2013-Feb-13  12:57 UTC
[Dovecot] dovecot-uidlist crashing and re retriving messages by pop3 clients
Hello, I have issue with dovecot (v. 2.1.13)configuration after implementation dovecot-lda (I used maildrop earlier). Now i have 9 servers with storage by NFS v3. My problem is frequently dovecot-uidlist crashing. 2013-02-13T13:34:02.447969+01:00 k1 dovecot: imap(user at domain.com): Error: Broken file /path_to_mailbox/dovecot-uidlist line 3170: Invalid data: 2013-02-13T13:34:34.527715+01:00 k1 dovecot: pop3(user at domain.com): Error: Broken file /path_to_mailbox/dovecot-uidlist line 367: Invalid data: It happens few time in minute for diferent users and has effect to re retriving messages by pop3 clients. This my NFS mount options: (rw,tcp,vers=3,actimeo=0) 10-mail.conf options: mmap_disable = yes dotlock_use_excl = yes mail_fsync=always mail_nfs_storage = yes mail_nfs_index = yes lock_method = dotlock I do not know what I did wrong and how solve this issue. Maybe NFS v4 or fcntl locks or migration to pop3_uidl_format = %g will by solution. Please some hint. Please any help for solve this issue and sorry my english.
Timo Sirainen
2013-Feb-13  14:25 UTC
[Dovecot] dovecot-uidlist crashing and re retriving messages by pop3 clients
On 13.2.2013, at 13.57, Piotr Rotter <piotr.rotter at active24.pl> wrote:> I have issue with dovecot (v. 2.1.13)configuration after implementation dovecot-lda (I used maildrop earlier). Now i have 9 servers with storage by NFS v3. My problem is frequently dovecot-uidlist crashing. > > 2013-02-13T13:34:02.447969+01:00 k1 dovecot: imap(user at domain.com): Error: Broken file /path_to_mailbox/dovecot-uidlist line 3170: Invalid data: > 2013-02-13T13:34:34.527715+01:00 k1 dovecot: pop3(user at domain.com): Error: Broken file /path_to_mailbox/dovecot-uidlist line 367: Invalid data: > > It happens few time in minute for diferent users and has effect to re retriving messages by pop3 clients.Use director: http://wiki2.dovecot.org/Director
Piotr Rotter
2013-Feb-13  22:43 UTC
[Dovecot] dovecot-uidlist crashing and re retriving messages by pop3 clients
I configure director temporary in some tricky way because I have to 
serve md5 and ntlm authentication method and I do not want reconfigure 
pop/imap servers.
Can you confirm I done all ok becouse I have that issue:
  # doveadm director map
doveadm(root): Error: User listing returned failure
doveadm(root): Error: user listing failed
user 
                                                  mail server ip expire 
time
<unknown> 
                                                  192.168.111.24 
2013-02-14 00:57:34
<unknown> 
                                                  192.168.111.21 
2013-02-14 00:57:46
yet everything else works ok
My password_query:
password_query = SELECT clear AS password, 'Y' as proxy, '%u' AS
destuser, clear AS pass FROM postfix_users WHERE email = '%u'
My director server config (dovecot -n):
# dovecot -n
# 2.1.13: /etc/dovecot/dovecot.conf
# OS: Linux 3.7.1-hardened-r2 x86_64 Gentoo Base System release 2.1
auth_mechanisms = plain login digest-md5 cram-md5 ntlm apop
auth_verbose = yes
default_client_limit = 10000
default_process_limit = 10000
default_vsz_limit = 512 M
deliver_log_format = from=%f, msgid=%m, psize=%p: %$
director_mail_servers = 192.168.111.21 192.168.111.22 192.168.111.23 
192.168.111.24 192.168.111.25 192.168.111.26
director_servers = 195.78.67.29
director_user_expire = 2 hours
disable_plaintext_auth = no
passdb {
   args = /etc/dovecot/dovecot-sql.conf.ext
   driver = sql
}
plugin {
   mail_log_events = delete undelete expunge copy mailbox_delete 
mailbox_rename
   mail_log_fields = box msgid from size
}
protocols = imap pop3
service auth {
   client_limit = 10000
   unix_listener auth-userdb {
     group = vmail
     mode = 0600
     user = vmail
   }
}
service director {
   inet_listener {
     port = 9090
   }
   unix_listener login/director {
     mode = 0666
   }
}
service imap-login {
   executable = imap-login director
}
service pop3-login {
   executable = pop3-login director
}
ssl_ca = </etc/ssl/dovecot.ca
ssl_cert = </etc/ssl/dovecot.crt
ssl_key = </etc/ssl/dovecot.key