Larry Rosenman
2014-May-27 20:03 UTC
[Dovecot] doveadm fts: mbox/lucene-indexes, and other errors
I turned on fts_autoindex today, and wanted to rescan all my mailboxes.... Ran doveadm -Dv fts rescan, and garnered: thebighonker.lerctr.org /home/ler/mail $ doveadm -Dv fts rescan doveadm(ler): Debug: Loading modules from directory: /usr/local/lib/dovecot doveadm(ler): Debug: Module loaded: /usr/local/lib/dovecot/lib20_fts_plugin.so doveadm(ler): Debug: Module loaded: /usr/local/lib/dovecot/lib21_fts_lucene_plugin.so doveadm(ler): Debug: Module loaded: /usr/local/lib/dovecot/lib90_stats_plugin.so doveadm(ler): Debug: Loading modules from directory: /usr/local/lib/dovecot/doveadm doveadm(ler): Debug: Skipping module doveadm_acl_plugin, because dlopen() failed: /usr/local/lib/dovecot/doveadm/lib10_doveadm_acl_plugin.so: Undefined symbol "acl_user_module" (this is usually intentional, so just ignore this message) doveadm(ler): Debug: Skipping module doveadm_expire_plugin, because dlopen() failed: /usr/local/lib/dovecot/doveadm/lib10_doveadm_expire_plugin.so: Undefined symbol "expire_set_lookup" (this is usually intentional, so just ignore this message) doveadm(ler): Debug: Skipping module doveadm_quota_plugin, because dlopen() failed: /usr/local/lib/dovecot/doveadm/lib10_doveadm_quota_plugin.so: Undefined symbol "quota_user_module" (this is usually intentional, so just ignore this message) doveadm(ler): Debug: Module loaded: /usr/local/lib/dovecot/doveadm/lib10_doveadm_sieve_plugin.so doveadm(ler): Debug: Module loaded: /usr/local/lib/dovecot/doveadm/lib20_doveadm_fts_lucene_plugin.so doveadm(ler): Debug: Module loaded: /usr/local/lib/dovecot/doveadm/lib20_doveadm_fts_plugin.so doveadm(ler): Debug: Effective uid=1002, gid=1002, home=/home/ler doveadm(ler): Debug: Namespace inbox: type=private, prefix=, sep=, inbox=yes, hidden=no, list=yes, subscriptions=yes location=mbox:~/mail:INBOX=~/mail/INBOX doveadm(ler): Debug: fs: root=/home/ler/mail, index=, indexpvt=, control=, inbox=/home/ler/mail/INBOX, alt doveadm(ler): Debug: Namespace archive: type=private, prefix=#ARCHIVE/, sep=/, inbox=no, hidden=no, list=no, subscriptions=yes location=mbox:~/MAILARCHIVE doveadm(ler): Debug: mbox: INBOX defaulted to /home/ler/MAILARCHIVE/inbox doveadm(ler): Debug: fs: root=/home/ler/MAILARCHIVE, index=, indexpvt=, control=, inbox=/home/ler/MAILARCHIVE/inbox, alt doveadm(ler): Error: Couldn't get mailbox lucene-indexes/dovecot-expunges.log GUID: Mailbox isn't a valid mbox file doveadm(ler): Error: Couldn't get mailbox lucene-indexes/_a1.cfs GUID: Mailbox isn't a valid mbox file doveadm(ler): Error: Couldn't get mailbox lucene-indexes/_9t.cfs GUID: Mailbox isn't a valid mbox file doveadm(ler): Error: Couldn't get mailbox lucene-indexes/_9z.cfs GUID: Mailbox isn't a valid mbox file doveadm(ler): Error: Couldn't get mailbox lucene-indexes/_9t_1.del GUID: Mailbox isn't a valid mbox file doveadm(ler): Error: Couldn't get mailbox lucene-indexes/segments.gen GUID: Mailbox isn't a valid mbox file doveadm(ler): Error: Couldn't get mailbox lucene-indexes/_9u.cfs GUID: Mailbox isn't a valid mbox file doveadm(ler): Error: Couldn't get mailbox lucene-indexes/_a0.cfs GUID: Mailbox isn't a valid mbox file doveadm(ler): Error: Couldn't get mailbox lucene-indexes/_9x.cfs GUID: Mailbox isn't a valid mbox file doveadm(ler): Error: Couldn't get mailbox lucene-indexes/_9v.cfs GUID: Mailbox isn't a valid mbox file doveadm(ler): Error: Couldn't get mailbox lucene-indexes/segments_ke GUID: Mailbox isn't a valid mbox file doveadm(ler): Error: Couldn't get mailbox lucene-indexes/_9w.cfs GUID: Mailbox isn't a valid mbox file doveadm(ler): Error: Couldn't get mailbox lucene-indexes/_9y.cfs GUID: Mailbox isn't a valid mbox file doveadm(ler): Error: Couldn't get mailbox lucene-indexes/_5w.cfs GUID: Mailbox isn't a valid mbox file doveadm(ler): Error: Couldn't get mailbox lucene-indexes/_5w_1.del GUID: Mailbox isn't a valid mbox file doveadm(ler): Error: lucene: Couldn't open mailbox (error in mailbox with GUID=21ba3234186a115376580000bbe98eac): Internal error occurred. Refer to server log for more information. [2014-05-27 14:59:45] doveadm(ler): Error: lucene: Couldn't open mailbox (error in mailbox with GUID=77614b1bb0383a530fb30000bbe98eac): Internal error occurred. Refer to server log for more information. [2014-05-27 14:59:45] doveadm(ler): Error: lucene: Couldn't open mailbox (error in mailbox with GUID=c77d8c12ac6b115348590000bbe98eac): Internal error occurred. Refer to server log for more information. [2014-05-27 14:59:45] doveadm(ler): Error: lucene: Couldn't open mailbox (error in mailbox with GUID=d07d8c12ac6b115348590000bbe98eac): Internal error occurred. Refer to server log for more information. [2014-05-27 14:59:45] doveadm(ler): Error: fts rescan failed thebighonker.lerctr.org /home/ler/mail $ 1) why doesn't Dovecot make the lucene-indexes directory \NoSelect or invisible? 2) how can I find the error(s) for the internal errors? (I looked in my debug.maillog and find NOTHING). Dovecot 2.2.13 FreeBSD 10.0 dovecot -n: thebighonker.lerctr.org /home/ler/mail $ dovecot -n # 2.2.13: /usr/local/etc/dovecot/dovecot.conf # OS: FreeBSD 10.0-STABLE amd64 auth_default_realm = lerctr.org auth_mechanisms = plain login auth_realms = lerctr.org thebighonker.lerctr.org tbh.lerctr.org auth_username_format = %Ln disable_plaintext_auth = no lda_mailbox_autocreate = yes lmtp_save_to_detail_mailbox = yes login_access_sockets = tcpwrap mail_debug = yes mail_location = mbox:~/mail:INBOX=~/mail/INBOX mail_plugins = fts fts_lucene stats mail_privileged_group = mail managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave duplicate namespace archive { hidden = no inbox = no list = no location = mbox:~/MAILARCHIVE prefix = "#ARCHIVE/" separator = / } namespace inbox { inbox = yes location mailbox Drafts { special_use = \Drafts } mailbox INBOX { auto = create } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix } passdb { args = failure_show_msg=yes session=yes max_requests=20 driver = pam } plugin { fts = lucene fts_autoindex = yes fts_lucene = whitespace_chars=@. normalize no_snowball sieve = ~/.dovecot.sieve sieve_dir = ~/sieve stats_command_min_time = 1 mins stats_domain_min_time = 12 hours stats_ip_min_time = 12 hours stats_memory_limit = 16 M stats_refresh = 5s stats_session_min_time = 15 mins stats_track_cmds = yes stats_user_min_time = 1 hours } service auth { unix_listener auth-client { mode = 0666 } unix_listener auth-master { mode = 0666 } } service stats { chroot = empty client_limit = 0 drop_priv_before_exec = no executable = stats extra_groups fifo_listener stats-mail { group mode = 0666 user } group idle_kill = 4294967295 secs privileged_group process_limit = 1 process_min_avail = 0 protocol service_count = 0 type unix_listener stats { group mode = 0666 user } user = $default_internal_user vsz_limit = 18446744073709551615 B } service tcpwrap { unix_listener login/tcpwrap { group = $default_login_user mode = 0600 user = $default_login_user } } ssl_cert = </etc/ssl/certs/dovecot.pem ssl_key = </etc/ssl/private/dovecot.pem userdb { driver = passwd } verbose_proctitle = yes protocol imap { imap_client_workarounds = tb-extra-mailbox-sep tb-lsub-flags mail_max_userip_connections = 50 mail_plugins = fts fts_lucene stats imap_stats } thebighonker.lerctr.org /home/ler/mail $ -- Larry Rosenman http://www.lerctr.org/~ler Phone: +1 214-642-9640 (c) E-Mail: larryrtx at gmail.com US Mail: 108 Turvey Cove, Hutto, TX 78634-5688