thr3ads.net - dovecot - fts_autoindex - index-worker problem [Jan 2016]

If this information is useful, please help other people find it:
Share via:

Masaki Nemoto

2016-Jan-30 17:28 UTC

fts_autoindex - index-worker problem

dovecot-2.2.21 ?????

fts_autoindex - index-worker problem

Hello List,

I installed dovecot-2.2.21 on CentOS 6.7.

I use ldap for userdb to separate an e-mail address and the user.
Index to apache solr failed in fts_authindex when I received an email
after setting.
The error message is "indexer-worker: Error: User 0029 at 09.jp lookup
failed: Unknown user"

Is there any solution?

This is current conf
--------------------------------------------
# cat /etc/dovecot/conf.d/auth-ldap.conf.ext
userdb {
  driver = ldap
  default_fields = uid=dovecot gid=dovecot home=/var/dovecot/%Ld/%Ln
  args = /etc/dovecot/dovecot-ldap.conf.ext
}
--------------------------------------------
# cat /etc/dovecot/dovecot-ldap.conf.ext
hosts = ldap01
auth_bind = no
ldap_version = 3
base = ""
user_attrs  = mailRoutingAddress=user, storeQuotaBytes=quota_rule=*:bytes=%$
user_filter = (&(objectClass=inetLocalMailRecipient)(mailLocalAddress=%u))
--------------------------------------------
# cat /etc/dovecot/conf.d/90-plugin.conf
plugin {
  fts = solr
  fts_solr = url=http://10.129.78.21:8983/solr/%Ld/
  fts_autoindex = yes
}
--------------------------------------------

This is test user infomation
--------------------------------------------
# ldapsearch -h ldap01 -x -b "" mailLocalAddress=gk12k_0029 at
08wt09.jp
mailRoutingAddress mailLocalAddress -LLL
dn: uid=gk12k_0029,dc=08wt09,dc=jp
mailRoutingAddress: 0029 at 09.jp
mailLocalAddress: gk12k_0029 at 08wt09.jp
--------------------------------------------

dovecot log of the problem
------------------
Jan 31 01:19:51 store01 dovecot: lmtp(24252): Connect from 10.129.75.77
Jan 31 01:19:51 store01 dovecot: lmtp(0029 at 09.jp): copy from <lmtp
DATA>: box=INBOX, uid=40, msgid=<foobar>, size=377
Jan 31 01:19:51 store01 dovecot: lmtp(0029 at 09.jp):
pdn7JafirFa8XgAAbv3f4A: from=hogehoge at example.jp,
to=gk12k_0029 at 08wt09.jp, vsize=388, msgid=<foobar>, saved mail to INBOX
Jan 31 01:19:51 store01 dovecot: lmtp(24252): Disconnect from
10.129.75.77: Successful quit
Jan 31 01:19:51 store01 dovecot: indexer-worker: Error: User 0029 at 09.jp
lookup failed: Unknown user

openldap log
------------------
Jan 31 01:19:51 ldap01 slapd[21617]: conn=1291 op=1 SRCH base=""
scope=2
deref=0
filter="(&(objectClass=inetLocalMailRecipient)(mailLocalAddress=gk12k_0029
at 08wt09.jp))"
Jan 31 01:19:51 ldap01 slapd[21617]: conn=1291 op=1 SRCH
attr=mailRoutingAddress storeQuotaBytes
Jan 31 01:19:51 ldap01 slapd[21617]: conn=1291 op=1 SEARCH RESULT
tag=101 err=0 nentries=1 textJan 31 01:19:51 ldap01 slapd[21617]: conn=1292
fd=19 ACCEPT from
IP=10.129.78.22:58335 (IP=0.0.0.0:389)
Jan 31 01:19:51 ldap01 slapd[21617]: conn=1292 op=0 BIND dn=""
method=128
Jan 31 01:19:51 ldap01 slapd[21617]: conn=1292 op=0 RESULT tag=97 err=0
textJan 31 01:19:51 ldap01 slapd[21617]: conn=1292 op=1 SRCH base=""
scope=2
deref=0 filter="(mailRoutingAddress=0029 at 09.jp)"
Jan 31 01:19:51 ldap01 slapd[21617]: conn=1292 op=1 SRCH
attr=modifyTimestamp
Jan 31 01:19:51 ldap01 slapd[21617]: conn=1292 op=1 SEARCH RESULT
tag=101 err=0 nentries=1 textJan 31 01:19:51 ldap01 slapd[21617]: conn=1292 op=2
SRCH
base="uid=gk12k_0029,dc=08wt09,dc=jp" scope=0 deref=0
filter="(objectClass=*)"
Jan 31 01:19:51 ldap01 slapd[21617]: conn=1292 op=2 SRCH
attr=storeSieveScript
Jan 31 01:19:51 ldap01 slapd[21617]: conn=1292 op=2 SEARCH RESULT
tag=101 err=0 nentries=1 textJan 31 01:19:51 ldap01 slapd[21617]: conn=1292 op=3
UNBIND
Jan 31 01:19:51 ldap01 slapd[21617]: conn=1292 fd=19 closed
Jan 31 01:19:51 ldap01 slapd[21617]: conn=1291 op=2 SRCH base=""
scope=2
deref=0
filter="(&(objectClass=inetLocalMailRecipient)(mailLocalAddress=0029 at
09.jp))"
Jan 31 01:19:51 ldap01 slapd[21617]: conn=1291 op=2 SRCH
attr=mailRoutingAddress storeQuotaBytes
Jan 31 01:19:51 ldap01 slapd[21617]: conn=1291 op=2 SEARCH RESULT
tag=101 err=0 nentries=0 text-------------------------------------------



Log when I deleted "fts_autoindex = yes"
-------------------------------------------
Jan 31 01:18:12 store01 dovecot: lmtp(24232): Connect from 10.129.75.77
Jan 31 01:18:13 store01 dovecot: lmtp(0029 at 09.jp): copy from <lmtp
DATA>: box=INBOX, uid=39, msgid=<foobar>, size=377
Jan 31 01:18:13 store01 dovecot: lmtp(0029 at 09.jp):
10FxNETirFaoXgAAbv3f4A: from=hogehoge at example.jp,
to=gk12k_0029 at 08wt09.jp, vsize=388, msgid=<foobar>, saved mail to INBOX
Jan 31 01:18:13 store01 dovecot: lmtp(24232): Disconnect from
10.129.75.77: Successful quit
-------------------------------------------
Jan 31 01:18:12 ldap01 slapd[21617]: conn=1289 op=1 SRCH base=""
scope=2
deref=0
filter="(&(objectClass=inetLocalMailRecipient)(mailLocalAddress=gk12k_0029
at 08wt09.jp))"
Jan 31 01:18:12 ldap01 slapd[21617]: conn=1289 op=1 SRCH
attr=mailRoutingAddress storeQuotaBytes
Jan 31 01:18:12 ldap01 slapd[21617]: conn=1289 op=1 SEARCH RESULT
tag=101 err=0 nentries=1 textJan 31 01:18:12 ldap01 slapd[21617]: conn=1290
fd=19 ACCEPT from
IP=10.129.78.22:58332 (IP=0.0.0.0:389)
Jan 31 01:18:12 ldap01 slapd[21617]: conn=1290 op=0 BIND dn=""
method=128
Jan 31 01:18:12 ldap01 slapd[21617]: conn=1290 op=0 RESULT tag=97 err=0
textJan 31 01:18:12 ldap01 slapd[21617]: conn=1290 op=1 SRCH base=""
scope=2
deref=0 filter="(mailRoutingAddress=0029 at 09.jp)"
Jan 31 01:18:12 ldap01 slapd[21617]: conn=1290 op=1 SRCH
attr=modifyTimestamp
Jan 31 01:18:12 ldap01 slapd[21617]: conn=1290 op=1 SEARCH RESULT
tag=101 err=0 nentries=1 textJan 31 01:18:12 ldap01 slapd[21617]: conn=1290 op=2
SRCH
base="uid=gk12k_0029,dc=08wt09,dc=jp" scope=0 deref=0
filter="(objectClass=*)"
Jan 31 01:18:12 ldap01 slapd[21617]: conn=1290 op=2 SRCH
attr=storeSieveScript
Jan 31 01:18:12 ldap01 slapd[21617]: conn=1290 op=2 SEARCH RESULT
tag=101 err=0 nentries=1 textJan 31 01:18:12 ldap01 slapd[21617]: conn=1290 op=3
UNBIND
Jan 31 01:18:12 ldap01 slapd[21617]: conn=1290 fd=19 closed
-------------------------------------------

-- 
Masaki

Timo Sirainen

2016-Jan-30 23:58 UTC

head link

fts_autoindex - index-worker problem

> On 30 Jan 2016, at 19:28, Masaki Nemoto <itml at ma3ki.net> wrote:
> 
> dovecot-2.2.21 ?????
> 
> fts_autoindex - index-worker problem
> 
> Hello List,
> 
> I installed dovecot-2.2.21 on CentOS 6.7.
> 
> I use ldap for userdb to separate an e-mail address and the user.
> Index to apache solr failed in fts_authindex when I received an email
> after setting.
> The error message is "indexer-worker: Error: User 0029 at 09.jp lookup
> failed: Unknown user"
The question is mainly if the lookup of user 0029 at 09.jp should work, or if
that it the wrong user in the first place. If you want the username to be 0029
at 09.jp on Dovecot side, then this command must work:

doveadm user 0029 at 09.jp
> user_attrs  = mailRoutingAddress=user,
storeQuotaBytes=quota_rule=*:bytes=%$
So here mailRoutingAddress=user is changing Dovecot's internal username to
that field's value, which causes it to send that username to indexer-worker.
> # ldapsearch -h ldap01 -x -b "" mailLocalAddress=gk12k_0029 at
08wt09.jp
> mailRoutingAddress mailLocalAddress -LLL
> dn: uid=gk12k_0029,dc=08wt09,dc=jp
> mailRoutingAddress: 0029 at 09.jp
> mailLocalAddress: gk12k_0029 at 08wt09.jp
Here is seems that the username should be gk12k_0029 at 08wt09.jp, not 0029 at
09.jp? So maybe you want mailLocalAddress=user? Or add mailRoutingAddress to
user_filter so that lookup by 0029 at 09.jp works too.

BTW. auth_debug=yes is helpful in showing in Dovecot's logs what it's
doing and why it's not finding something.

Masaki Nemoto

2016-Feb-01 08:42 UTC

head link

fts_autoindex - index-worker problem

I use 0029 at 09.jp like dovecot internal user and use gk12k_0029 at 08wt09.jp 
as an e-mail address.

I executed "doveadm user" command and understood that setting of 
"dovecot-ldap.conf.ext" was wrong.

I changed user_attrs of dovecot-ldap.conf.ext as follows.
----------------------
user_attrs  = mailRoutingAddress=mail=maildir:/var/dovecot/%Ld/%Ln, 
mailRoutingAddress=home=/var/dovecot/%Ld/%Ln, 
storeQuotaBytes=quota_rule=*:bytes=%$
----------------------

Thank you !

On 2016/01/31 8:58, Timo Sirainen wrote:>> On 30 Jan 2016, at 19:28, Masaki Nemoto <itml at ma3ki.net>
wrote:
>>
>> Hello List,
>>
>> I installed dovecot-2.2.21 on CentOS 6.7.
>>
>> I use ldap for userdb to separate an e-mail address and the user.
>> Index to apache solr failed in fts_authindex when I received an email
>> after setting.
>> The error message is "indexer-worker: Error: User 0029 at 09.jp
lookup
>> failed: Unknown user"
> The question is mainly if the lookup of user 0029 at 09.jp should work, or
if that it the wrong user in the first place. If you want the username to be
0029 at 09.jp on Dovecot side, then this command must work:
>
> doveadm user 0029 at 09.jp
>
>> user_attrs  = mailRoutingAddress=user,
storeQuotaBytes=quota_rule=*:bytes=%$
> So here mailRoutingAddress=user is changing Dovecot's internal username
to that field's value, which causes it to send that username to
indexer-worker.
>
>> # ldapsearch -h ldap01 -x -b "" mailLocalAddress=gk12k_0029
at 08wt09.jp
>> mailRoutingAddress mailLocalAddress -LLL
>> dn: uid=gk12k_0029,dc=08wt09,dc=jp
>> mailRoutingAddress: 0029 at 09.jp
>> mailLocalAddress: gk12k_0029 at 08wt09.jp
> Here is seems that the username should be gk12k_0029 at 08wt09.jp, not 0029
at 09.jp? So maybe you want mailLocalAddress=user? Or add mailRoutingAddress to
user_filter so that lookup by 0029 at 09.jp works too.
>
> BTW. auth_debug=yes is helpful in showing in Dovecot's logs what
it's doing and why it's not finding something.

dovecot - Jan 2016 - fts_autoindex - index-worker problem

fts_autoindex - index-worker problem

fts_autoindex - index-worker problem

fts_autoindex - index-worker problem