Hi,
I am finally trying to use an fts engine with dovecot. My version is
2.3.7.2 under Ubuntu 20.04.
I installed solr 7.7.3 and then 8.6.0 to see if this was a
version-related error. I copied the schema from 7.7.0 as many people
said this was fine.
I get the following error when trying to reindex a user's mailbox:
doveadm(francis at francisaugusto.com): Error: fts_solr: Indexing failed:
400 Bad Request
doveadm(francis at francisaugusto.com): Error: Mailbox INBOX: Transaction
commit failed: FTS transaction commit failed: backend deinit
doveadm(francis at francisaugusto.com): Debug: auth-master: conn
unix:/var/run/dovecot/auth-userdb: Disconnected: Connection closed
(fd=10)
On Solr I get this error:
org.apache.solr.common.SolrException: Exception writing document id
210/9fd7941e8297d25d91600000c3fdd3da/francis at francisaugusto.com to the
index; possible analysis error: cannot change field "box" from index
options=DOCS_AND_FREQS_AND_POSITIONS to inconsistent index options=DOCS
at
org.apache.solr.update.DirectUpdateHandler2.addDoc(DirectUpdateHandler2.java:246)
Parallel to this, I got some log messages on Solr before attempting to
reindex the user (sorry for the garbadged text:
TIME (LOCAL)
LEVEL
CORE
LOGGER
MESSAGE
7/21/2020, 6:38:47 PM
WARN false
x:dovecot
SolrResourceLoader
Solr loaded a deprecated plugin/analysis class [solr.TrieLongField].
Please consult documentation how to replace it accordingly.
7/21/2020, 6:38:47 PM
WARN false
x:dovecot
SolrResourceLoader
Solr loaded a deprecated plugin/analysis class
[solr.SynonymFilterFactory]. Please consult documentation how to replace
it accordingly.
7/21/2020, 6:38:47 PM
WARN false
x:dovecot
SolrResourceLoader
Solr loaded a deprecated plugin/analysis class
[solr.WordDelimiterFilterFactory]. Please consult documentation how to
replace it accordingly.
7/22/2020, 6:43:46 PM
ERROR false
x:dovecot
RequestHandlerBase
java.lang.IllegalStateException: Type mismatch: uid was indexed as
SORTED_NUMERIC
7/22/2020, 6:43:46 PM
ERROR false
x:dovecot
HttpSolrCall
null:java.lang.IllegalStateException: Type mismatch: uid was indexed
as SORTED_NUMERIC
7/22/2020, 6:43:49 PM
ERROR false
x:dovecot
RequestHandlerBase
java.lang.IllegalStateException: Type mismatch: uid was indexed as
SORTED_NUMERIC
7/22/2020, 6:43:49 PM
ERROR false
x:dovecot
HttpSolrCall
null:java.lang.IllegalStateException: Type mismatch: uid was indexed
as SORTED_NUMERIC
7/22/2020, 6:43:56 PM
ERROR false
x:dovecot
RequestHandlerBase
java.lang.IllegalStateException: Type mismatch: uid was indexed as
SORTED_NUMERIC
7/22/2020, 6:43:56 PM
ERROR false
x:dovecot
HttpSolrCall
null:java.lang.IllegalSta
Could anyone point me the right direction to make this work?
Best,
-------------- next part --------------
An HTML attachment was scrubbed...
URL:
<https://dovecot.org/pipermail/dovecot/attachments/20200722/e0513262/attachment-0001.html>
Just one thing I forgot to mention: using break-imap-search got me an error: dovecot would say this is an invalid option for ftr_solr. On 22.07.2020 19:13, Francis Augusto Medeiros-Logeay wrote:> Hi, > > I am finally trying to use an fts engine with dovecot. My version is > 2.3.7.2 under Ubuntu 20.04. > > I installed solr 7.7.3 and then 8.6.0 to see if this was a > version-related error. I copied the schema from 7.7.0 as many people > said this was fine. > > I get the following error when trying to reindex a user's mailbox: > > doveadm(francis at francisaugusto.com): Error: fts_solr: Indexing failed: > 400 Bad Request > doveadm(francis at francisaugusto.com): Error: Mailbox INBOX: Transaction > commit failed: FTS transaction commit failed: backend deinit > doveadm(francis at francisaugusto.com): Debug: auth-master: conn > unix:/var/run/dovecot/auth-userdb: Disconnected: Connection closed > (fd=10) > > On Solr I get this error: > > org.apache.solr.common.SolrException: Exception writing document id > 210/9fd7941e8297d25d91600000c3fdd3da/francis at francisaugusto.com to the > index; possible analysis error: cannot change field "box" from index > options=DOCS_AND_FREQS_AND_POSITIONS to inconsistent index > options=DOCS > at > org.apache.solr.update.DirectUpdateHandler2.addDoc(DirectUpdateHandler2.java:246) > > Parallel to this, I got some log messages on Solr before attempting to > reindex the user (sorry for the garbadged text: > > TIME (LOCAL) > LEVEL > CORE > LOGGER > MESSAGE > > 7/21/2020, 6:38:47 PM > WARN false > x:dovecot > SolrResourceLoader > Solr loaded a deprecated plugin/analysis class > [solr.TrieLongField]. Please consult documentation how to replace it > accordingly. > > 7/21/2020, 6:38:47 PM > WARN false > x:dovecot > SolrResourceLoader > Solr loaded a deprecated plugin/analysis class > [solr.SynonymFilterFactory]. Please consult documentation how to > replace it accordingly. > > 7/21/2020, 6:38:47 PM > WARN false > x:dovecot > SolrResourceLoader > Solr loaded a deprecated plugin/analysis class > [solr.WordDelimiterFilterFactory]. Please consult documentation how to > replace it accordingly. > > 7/22/2020, 6:43:46 PM > ERROR false > x:dovecot > RequestHandlerBase > java.lang.IllegalStateException: Type mismatch: uid was indexed as > SORTED_NUMERIC > > 7/22/2020, 6:43:46 PM > ERROR false > x:dovecot > HttpSolrCall > null:java.lang.IllegalStateException: Type mismatch: uid was > indexed as SORTED_NUMERIC > > 7/22/2020, 6:43:49 PM > ERROR false > x:dovecot > RequestHandlerBase > java.lang.IllegalStateException: Type mismatch: uid was indexed as > SORTED_NUMERIC > > 7/22/2020, 6:43:49 PM > ERROR false > x:dovecot > HttpSolrCall > null:java.lang.IllegalStateException: Type mismatch: uid was > indexed as SORTED_NUMERIC > > 7/22/2020, 6:43:56 PM > ERROR false > x:dovecot > RequestHandlerBase > java.lang.IllegalStateException: Type mismatch: uid was indexed as > SORTED_NUMERIC > > 7/22/2020, 6:43:56 PM > ERROR false > x:dovecot > HttpSolrCall > null:java.lang.IllegalSta > > Could anyone point me the right direction to make this work? > > Best,
On 7/22/2020 11:13 AM, Francis Augusto Medeiros-Logeay wrote:> On Solr I get this error: > > org.apache.solr.common.SolrException: Exception writing document id > 210/9fd7941e8297d25d91600000c3fdd3da/francis at francisaugusto.com > <mailto:210/9fd7941e8297d25d91600000c3fdd3da/francis at francisaugusto.com> > to the index; possible analysis error: cannot change field "box" from > index options=DOCS_AND_FREQS_AND_POSITIONS to inconsistent index > options=DOCS<snip>> Parallel to this, I got some log messages on Solr before attempting to > reindex the user (sorry for the garbadged text: > Time (Local) Level Core Logger Message<snip>> 7/22/2020, 6:43:46 PM ERROR false x:dovecot RequestHandlerBase > java.lang.IllegalStateException: Type mismatch: uid was indexed as > SORTED_NUMERICThese errors are a LOT longer than what we see here. It appears that you are showing us what you can see in the logging tab of the admin UI ... you will see far more detail if you find the solr.log file and get information from there. Full detail can be seen on a single log entry in the admin UI by clicking on the little "i" icon, but it will close again *VERY* quickly, so that's not a very reliable option. The full detail is usually required for deciphering log messages. As for the source of the problem ... these look like the kind of errors that can be encountered if you complete some indexing with one schema, then change the schema without deleting the existing index, restart/reload, and try to index more data. Most changes to the schema will require full reindexing, and some changes require actually deleting the index directory entirely and allowing it to be rebuilt. In some rare cases, upgrading Solr *might* result in a change to the schema that requires deleting the index even though the schema config file itself is the same. I do not know if your setup is one that would be affected in this way. https://cwiki.apache.org/confluence/display/solr/HowToReindex Your question is more appropriate for the solr-user mailing list at Apache than this list ... but I did not expect you to know that in advance. I can try to help you. Thanks, Shawn
__ Francis Augusto Medeiros-Logeay francis at francisaugusto.com Mobile: +47 45 17 14 91 Oslo, Norway Sent from a mobile device / Enviado a partir de dispositivo m?vel> On 24 Jul 2020, at 19:34, Shawn Heisey <elyograg at elyograg.org> wrote: > > ?On 7/22/2020 11:13 AM, Francis Augusto Medeiros-Logeay wrote: >> On Solr I get this error: >> org.apache.solr.common.SolrException: Exception writing document id 210/9fd7941e8297d25d91600000c3fdd3da/francis at francisaugusto.com <mailto:210/9fd7941e8297d25d91600000c3fdd3da/francis at francisaugusto.com> to the index; possible analysis error: cannot change field "box" from index options=DOCS_AND_FREQS_AND_POSITIONS to inconsistent index options=DOCS > <snip> >> Parallel to this, I got some log messages on Solr before attempting to reindex the user (sorry for the garbadged text: >> Time (Local) Level Core Logger Message > <snip> >> 7/22/2020, 6:43:46 PM ERROR false x:dovecot RequestHandlerBase java.lang.IllegalStateException: Type mismatch: uid was indexed as SORTED_NUMERIC > > These errors are a LOT longer than what we see here. It appears that you are showing us what you can see in the logging tab of the admin UI ... you will see far more detail if you find the solr.log file and get information from there. Full detail can be seen on a single log entry in the admin UI by clicking on the little "i" icon, but it will close again *VERY* quickly, so that's not a very reliable option. > > The full detail is usually required for deciphering log messages. > > As for the source of the problem ... these look like the kind of errors that can be encountered if you complete some indexing with one schema, then change the schema without deleting the existing index, restart/reload, and try to index more data. Most changes to the schema will require full reindexing, and some changes require actually deleting the index directory entirely and allowing it to be rebuilt. In some rare cases, upgrading Solr *might* result in a change to the schema that requires deleting the index even though the schema config file itself is the same. I do not know if your setup is one that would be affected in this way. > > https://cwiki.apache.org/confluence/display/solr/HowToReindex > > Your question is more appropriate for the solr-user mailing list at Apache than this list ... but I did not expect you to know that in advance. I can try to help you.Thanks a lot Shawn. I will send the full error when I get home a week from now. But this was my first attempt to use solr - is it still subject to those conflicts? Best, Francis -------------- next part -------------- An HTML attachment was scrubbed... URL: <https://dovecot.org/pipermail/dovecot/attachments/20200726/c8ef7a0f/attachment.html>