similar to: FTS solr or xapian and Public Folders

hi, I have a setup using solr as fts, however it seems that when I move messages it does not automatically index the stuff. Also, when using sieve scripts to store messages in different folders I get: dovecot: indexer-worker(user): Indexed 0 messages in testfolder If I get a mail to normal INBOX I get dovecot: indexer-worker(user): Indexed 1 messages in INBOX doveadm index -u user '*'

On 13/11/2020 14:56, PGNet Dev wrote: > I've built a new dovecot + fts-solr instance; I've now picked up & am > running the recently released solr 8.7.0. > > In a test account, I've one message -- in the 'Drafts' folder. > > On exec of fts 'index' > > ????doveadm index -u testuser at example.com -q '*' > > I get a > >

Hi, Sorry for the change of thread, I just signed up to the list so I couldn't reply to the earlier message. Let me clarify the issue that Nikolai was describing. We're running dovecot 1.1.11 and solr 1.4. The issue is quite simple. 1. I run a search. 2. Dovecot sends a list of emails to solr 3. Solr starts indexing them 4. Solr runs into a "bad" email and we get: SEVERE:

I've built a new dovecot + fts-solr instance; I've now picked up & am running the recently released solr 8.7.0. In a test account, I've one message -- in the 'Drafts' folder. On exec of fts 'index' doveadm index -u testuser at example.com -q '*' I get a 401 unauthorized indexing failure, only for the one dir+message in 'Drafts', 2020-11-13

Hi, On 2015-10-12 18:39, Giorgio Paolucci wrote: > Hello, > on my debian wheezy installation, I implemented fts plugin with solr as > indexing system. > I noticed that if a user creates a new folder, that folder it is > ignored by > dovecot indexing until a doveadm fts rescan is performed for that user. > From that time on everything works ok on that folder. > > As a

Hi Christian, may be the issue is related to this other post: http://dovecot.org/pipermail/dovecot/2015-September/102094.html Anyway, what I can tell you is that for every? user account,? for every folders created after the last doveadm fts rescan for that user, dovecot does not invoke indexer. A new rescan fix the problem for all the folders created up to that moment. I was wondering if I was

The Solr FTS engine appends domain names to the "user" and "id" fields inside Solr when indexing. However, when an IMAP search is performed, the domain name is not appended, resulting in 0 results, 100% of the time. You can reproduce this by setting up dovecot to have user names like?"admin", "james", etc (as opposed to admin at example.com). Then import

On 01/11/2020 15:20, PGNet Dev wrote: > On 11/1/20 1:56 AM, John Fawcett wrote: >> At the moment I don't see other corrections needed in dovecot apart from >> command line doveadm fts which is not a show stopper. Via doveadm search >> I confirm - on my simple config - that search for accented or non >> accented characters works correctly as it does via imap

This could easily be me missing something, but I can't seem to get the fts-solr plugin to index message bodies. Tcpdump shows me the following being sent from Dovecot to Solr as a messages is indexed: <add><doc><field name="uid">6549</field><field name="box">fde08816e80d6b4f26650000b5f0b4b2</field><field

> On 01/11/2020 20:35 John Fawcett <john at voipsupport.it> wrote: > > > On 01/11/2020 15:20, PGNet Dev wrote: > > On 11/1/20 1:56 AM, John Fawcett wrote: > >> At the moment I don't see other corrections needed in dovecot apart from > >> command line doveadm fts which is not a show stopper. Via doveadm search > >> I confirm - on my simple

Hi, I am currently testing a 2.1 dovecot setup with fts-solr. Search speed is simply amazing. I decided to try to delete and rebuild the solr indexes, but i can't seem to rebuild them thru dovecot. At first, when telnetting to the imap server, the search initially built the index, and then subsequent searches are blazingly fast. 1- I deleted all the solr indexes with the following query:

On 11/13/20 9:46 AM, John Fawcett wrote: >> (1) Can anyone yet verify Doveoct/fts-solr working with solr 8.7.x?>> (2) What logging config in Dovecot gets me more/detailed output for the fts_solr fail? >> (3) Any obvious clues as to what, specifically, is the source of this prob? >> > (1) I can't, I'm still on an earlier version I'll look for the 8.6.3,

On 11/13/20 11:37 AM, John Fawcett wrote: >> still dunno why the 401. :-/ > > So I just did a quick check of running dovecot with a standalone > solr-8.7.0 instance and I'm not seeing any issues. +1 > I confirm I haven't configured anything for indexer or indexer-worker in > dovecot, just left the defaults. +1 > For 401's returned from your solr server

On 13/11/2020 21:32, PGNet Dev wrote: > On 11/13/20 11:37 AM, John Fawcett wrote: >>> still dunno why the 401. :-/ >> >> So I just did a quick check of running dovecot with a standalone >> solr-8.7.0 instance and I'm not seeing any issues. > > +1 > >> I confirm I haven't configured anything for indexer or indexer-worker in >> dovecot, just

also, for fts_backend_solr_update_set_build_key -> where is the data (of the hdr_name or the body) ? On 2019-01-06 14:10, Joan Moreau wrote: > for the "last uid"-> this is not the last added, but the maximum of the UID in the indexed emails, right ? > > On 2019-01-06 11:53, Joan Moreau via dovecot wrote: > > Thank you > > I still don't get the

On 13/11/2020 22:04, PGNet Dev wrote: >> I guess you didn't need to enclose username and password in quotes, i.e. >> >> fts_solr = >> url=https://myuser:my%40pass at solr.example.com:8984/solr/dovecot/ >> use_libfts soft_commit=yes batch_size=250 > > On 11/13/20 12:56 PM, John Fawcett wrote: > >> I guess you didn't need to enclose username and

> I guess you didn't need to enclose username and password in quotes, i.e. > > fts_solr = > url=https://myuser:my%40pass at solr.example.com:8984/solr/dovecot/ > use_libfts soft_commit=yes batch_size=250 On 11/13/20 12:56 PM, John Fawcett wrote: > I guess you didn't need to enclose username and password in quotes, i.e. > > fts_solr = >

Yes but: 1 - is there a documentation of the main object ? (fts_backend, mail_user, mailbox, etc..) 2 - What are the mandatory functions ? 3 - Search : Supposedly, the FTS shall have several parameters : the keyword(s), the user & mailbox, and the fields (to, from, body, etc..) to be includude in the search. What is the function called in the plugin ? 4 - Indexing : Somehow, what is

for fts_backend_xxx_lookup, where is specidifed in which field (to, cc, subject, body, from, all) to lookup ? On 2019-01-06 16:03, Joan Moreau wrote: > For "rescan " and "optimize", wouldn't it be the dovecot core who indicate which are to be dismissed (expunged), or re-ask for indexing a particular (or all) uid ? WHy would the backend be aware of the transactions on

Hi I turned on fts squat to speed up full text searches over webmail. This works absolutely fantastic once the mailboxes are indexed. But when they are indexed for the first time I'm getting a fastcgi timeout after 30 seconds resulting into a internal server error on the webserver. In the background the indexing job is getting finished after 80 seconds for a 25k emails, ~300MB mailbox. Does