dovecot - May 2022 - dovecot-fts-solr Solr9 support

On 5/17/22 09:02, PGNet Dev wrote:
> Modifying the config to use CaffeineCache
>
> ????cp solr-config-7.7.0.xml solr-config-9.0.0.xml
> ????perl -pi -e '\
> ???? s|solr.FastLRUCache|solr.CaffeineCache|g; \
> ???? s|solr.LRUCache|solr.CaffeineCache|g; \
> ???? s|solr.search.LRUCache|solr.search.CaffeineCache|g;' \
> ????solr-config-9.0.0.xml
>
> appears to do the trick.
> Atm, indexing & search -- both manually triggered, and on delivery 
> receipt to Dovecot store -- is working with no errors (yet).
Yesterday I upgraded my Solr install for dovecot from 8.11.2-SNAPSHOT to 
10.0.0-SNAPSHOT.? It is still working and the config did not need 
further changes from what I already had.

I have been customizing my solrconfig.xml and managed-schema files ... I 
had made the change to CaffeineCache quite a while back.? I have also 
changed the analyzer chain in the schema to use a contrib component, so 
my config won't be directly usable -- it requires loading some extra 
jars.? When I upgraded, I did need to change the extra jars that were 
loaded.

I can come up with a new config that should work in 8.x, 9.x, and the 
current dev branch by almost anyone.

I should probably see if I can write some end to end instructions for 
installing Solr and configuring dovecot to use it.? Something that is 
missing from the current instructions is how to initiate a FULL reindex 
of all data in the dovecot install.

Thanks,
Shawn

On 5/17/22 12:17 PM, Shawn Heisey wrote:
> I had made the change to CaffeineCache quite a while back.
iiuc, solr8x still has support for *LRUCache classes, as well as CaffeineCache.

in my 8x installs, i'd simply never noticed related search problems ... only
after my 9x install, with the full deprecation of legacy cache(s), did I notice
these

...
/var/log/solr/solr.log.6:2022-05-17 10:08:09.402 ERROR (qtp1165791284-17) [
x:dovecot] o.a.s.s.CacheConfig Error instantiating cache =>
org.apache.solr.common.SolrException:  Error loading class
'solr.search.LRUCache'
/var/log/solr/solr.log.6:org.apache.solr.common.SolrException:  Error loading
class 'solr.search.LRUCache'
/var/log/solr/solr.log.6:Caused by: java.lang.ClassNotFoundException:
solr.search.LRUCache
/var/log/solr/solr.log.6:2022-05-17 10:09:13.534 ERROR (qtp1165791284-23) [
x:dovecot] o.a.s.s.CacheConfig Error instantiating cache =>
org.apache.solr.common.SolrException:  Error loading class
'solr.LRUCache'
/var/log/solr/solr.log.6:org.apache.solr.common.SolrException:  Error loading
class 'solr.LRUCache'
/var/log/solr/solr.log.6:Caused by: java.lang.ClassNotFoundException:
solr.LRUCache
/var/log/solr/solr.log.6:2022-05-17 10:09:13.556 ERROR (qtp1165791284-23) [
x:dovecot] o.a.s.s.CacheConfig Error instantiating cache =>
org.apache.solr.common.SolrException:  Error loading class
'solr.FastLRUCache'
/var/log/solr/solr.log.6:org.apache.solr.common.SolrException:  Error loading
class 'solr.FastLRUCache'
/var/log/solr/solr.log.6:Caused by: java.lang.ClassNotFoundException:
solr.FastLRUCache
...
> I can come up with a new config that should work in 8.x, 9.x, and the
current dev branch by almost anyone.
CaffeineCache  _should_ be a solution for both series.
I'm just starting to do a bit of testing, but so far, indexing/search with
Caffeine seems quicker, at least.
I do not yet know in which case(s) CaffeineCache is _not_ an appropriate
solution.
> I should probably see if I can write some end to end instructions for
installing Solr and configuring dovecot to use it.
Having something well-vetted and doc'd will be useful.

> Something that is missing from the current instructions is how to initiate
a FULL reindex of all data in the dovecot install.
Beyond looping over each $acct

  doveadm fts rescan -u ${acct}
  doveadm index      -u ${acct} -q '*'

?