search for: fts

Hi all, I have recently worked on fts plugin for ElasticSearch. https://github.com/filiphanes/fts-elastic It is forked from fts-elasticsearch as you can see in PR https://github.com/atkinsj/fts-elasticsearch/pull/21 with following changes (maybe some more) - no duplicate json keys in indexed documents, so compatible with ES 7.x...

...ogs: Jun 5 06:02:25 bubba dovecot: imap(dmiller at amfes.com)<25877><IjkkJZOKPvKsOk9d>: Opening DB (RO) /var/mail/amfes.com/dmiller/sdbox/xapian-indexes/db_f2857830c70c844e2f1d00003bc41c5f Jun 5 06:02:25 bubba dovecot: imap(dmiller at amfes.com)<25877><IjkkJZOKPvKsOk9d>: FTS Xapian: FLAG=AND Jun 5 06:02:25 bubba dovecot: imap(dmiller at amfes.com)<25877><IjkkJZOKPvKsOk9d>: FTS Xapian: Query= (subject:"dovecot" OR from:"dovecot" OR to:"dovecot" OR cc:"dovecot" OR bcc:"dovecot" OR message-id:"dovecot&q...

...>> imap(dmiller at amfes.com)<25877><IjkkJZOKPvKsOk9d>: Opening DB (RO) >> /var/mail/amfes.com/dmiller/sdbox/xapian-indexes/db_f2857830c70c844e2f1d00003bc41c5f >> Jun 5 06:02:25 bubba dovecot: >> imap(dmiller at amfes.com)<25877><IjkkJZOKPvKsOk9d>: FTS Xapian: FLAG=AND >> Jun 5 06:02:25 bubba dovecot: >> imap(dmiller at amfes.com)<25877><IjkkJZOKPvKsOk9d>: FTS Xapian: Query= >> (subject:"dovecot" OR from:"dovecot" OR to:"dovecot" OR cc:"dovecot" OR >> bcc:"dovecot...

...gt; Jun 5 06:02:25 bubba dovecot: imap(dmiller at amfes.com)<25877><IjkkJZOKPvKsOk9d>: Opening DB (RO) /var/mail/amfes.com/dmiller/sdbox/xapian-indexes/db_f2857830c70c844e2f1d00003bc41c5f > Jun 5 06:02:25 bubba dovecot: imap(dmiller at amfes.com)<25877><IjkkJZOKPvKsOk9d>: FTS Xapian: FLAG=AND > Jun 5 06:02:25 bubba dovecot: imap(dmiller at amfes.com)<25877><IjkkJZOKPvKsOk9d>: FTS Xapian: Query= (subject:"dovecot" OR from:"dovecot" OR to:"dovecot" OR cc:"dovecot" OR bcc:"dovecot" OR message-id:"dovecot...

For my primary namespace this is working fine - thanks to the developers! It also appears to work great for shared folders as well. But my virtual folders aren't returning results - at least not to the client. The logs show FTS Xapian opening several DB files and getting results - but nothing is being returned to client. Is this a config issue on my side or is this a current limitation of the plugin? -- Daniel

In such case, as long as the API is not upgraded, should doveadm index -A -q \* be considered a replacement of doveadm fts rescan On 2019-02-14 16:24, Timo Sirainen via dovecot wrote: > Hi, > > The rescan() function is a bit badly designed. Currently what you could do what fts-lucene does and: > - Get list of UIDs for all mails in each folder > - If Xapian has UID that doesn't exist -> delet...

Hi, THis is a core problem in Dovecot in my understanding. In my opinion, the rescan in dovecot should send to the FTS plugin the list of "supposedly" indexed emails (UID), and the plugin shall purge the redundant UID (i..e UID present in the index but not in the list sent by dovecot) and send back the list of UID not in its indexes to dovecot, so Dovect can send one by one the missing emails WHat do yo...

..., I see frequently > these errors from different users: It looks like this has been around for a while and you just got unlucky and started seeing this now.??Here's a quick & dirty patch that should fix this. If you can try it, let us know how it went. Jeff. diff --git a/src/plugins/fts-solr/solr-connection.c b/src/plugins/fts-solr/solr-connection.c index ae720b5e2870a852c1b6c440939e3c7c0fa72b5c..9d364f93e2cd1b716b9ab61bd39656a6c5b1ea04 100644 --- a/src/plugins/fts-solr/solr-connection.c +++ b/src/plugins/fts-solr/solr-connection.c @@ -103,7 +103,7 @@ int solr_connection_init(cons...

Hi, I'm using Dovecot 2.2.13 with Dovecot Director, Doveadm server and FTS. I want to run doveadm on Director hosts, but Dovecot server on backend hosts reject "fts *" commands. On Dovecot Director hosts: # doveadm fts optimize -u u0001 at example.jp # echo $? 75 # doveadm fts rescan -u u0001 at example.jp # echo $? 75 doveadm index -u u0001 at e...

Am Donnerstag, den 04.07.2019, 12:27 +0300 schrieb Aki Tuomi via dovecot: > On 4.7.2019 12.22, Maciej Milaszewski IQ PL via dovecot wrote: > > Hi > > So you're advised to use a solr or something else? > > > > Using any FTS is advisable, currently suitable ones would be SOLR or > Xapian (see https://github.com/grosjo/fts-xapian) > Hi Aki, I didn't yet think about using FTS either but followed a bit the thread about developing the Xapian plugin. How stable is that now? https://wiki.dovecot.org/Plugins/FTS...

Testing a compile on FreeBSD. gmake[2]: Entering directory '/usr/home/wash/Tools/Dovecot/fts-xapian/src' /bin/sh ../libtool --tag=CXX --mode=compile c++ -DHAVE_CONFIG_H -I. -I.. -I/opt/dovecot2.3/include/dovecot -I/opt/dovecot2.3/include/dovecot -g -O2 -MT fts-backend-xapian.lo -MD -MP -MF .deps/fts-backend-xapian.Tpo -c -o fts-backend-xapian.lo fts-backend-xapian.cpp libtool:...

...he files so one can download (git) it, and type some command (make ?) to compile it and place it in the right forlder (/usr/lib/dovecot/ or whatever is configured in the installed dovecot, which may differ from distribution to distribution) On 2019-01-13 19:47, Aki Tuomi wrote: > You need the fts-xapian.c mostly. All the rest comes from automake (unless you decide to use cmake or something else). > > I have attached you a skeleton plugin, which should work against dovecot master. > > If you experience problems with the skeleton, let us know. > > Aki > > On 13 Jan...

...Timo would not get done. Aki > On 17 February 2019 at 10:56 Joan Moreau via dovecot <dovecot at dovecot.org> wrote: > > > In such case, as long as the API is not upgraded, should > > doveadm index -A -q \* > > be considered a replacement of > > doveadm fts rescan > > On 2019-02-14 16:24, Timo Sirainen via dovecot wrote: > > > Hi, > > > > The rescan() function is a bit badly designed. Currently what you could do what fts-lucene does and: > > - Get list of UIDs for all mails in each folder > > - If Xapian ha...

On 10/18/20 10:28 PM, Aki Tuomi wrote: >> doveadm(myuser at example.com): Panic: file mail-storage.c: line 2112 (mailbox_get_open_status): assertion failed: (box->opened) ... > I can reproduce your problem with the `fts lookup` command. Luckily it's equivalent to running `doveadm search`. I'll open a bug about this. Can you provide any status on the bug/fix? Thanks.

>> A few clients have 25K and more e-mail >> >> I thinking about use solr like: >> ?fts = solr >> ?fts_solr = debug url=http://IP:8983/solr/ (solr in external machine) >> >> Does it make sense ? use dovecot_indexes and fts ? >> What is the difference in performance? >> > Hi! > > Dovecot indexes are not actually related to FTS that much. Using FTS...

Please kindly check https://github.com/grosjo/fts-xapian On 2019-01-13 20:11, Aki Tuomi wrote: > If you had looked at what I sent, you'd seen it's quite different from what you sent. > > Anyways, put the contents of skeleton.tar.gz and > > ./src/plugins/fts-xapian/fts-xapian-plugin.h > ./src/plugins/fts-xapian/fts-b...

On Fri, Apr 05, 2019 at 19:33:57 +0800, Joan Moreau via dovecot wrote: > Hi > > If you plan to fix the FTS part of Dovecot, I will be very gratefull. I'm trying to figure out what is causing the 3rd issue you listed, so we can decide how severe it is and therefore how quickly it needs to be fixed. At the moment we are unable to reproduce it, and therefore we cannot fix it. > Not sure this is r...

...ch that should fix this. > If you can try it, let us know how it went. > > Jeff. Well, maybe not. This patch is only useful when Solr and Tika are used at the same time. Otherwise, this is something else causing the same panic. Regards, Stephan. > > > diff --git a/src/plugins/fts-solr/solr-connection.c b/src/plugins/fts-solr/solr-connection.c > index ae720b5e2870a852c1b6c440939e3c7c0fa72b5c..9d364f93e2cd1b716b9ab61bd39656a6c5b1ea04 100644 > --- a/src/plugins/fts-solr/solr-connection.c > +++ b/src/plugins/fts-solr/solr-connection.c > @@ -103,7 +103,7 @@ int solr_...

Op 14-1-2019 om 13:40 schreef Aki Tuomi: > > Just to remind that now that there is a github repo for fts-xapian, > you could maybe open these issues there instead? > Although README.md currently says: "Please feel free to send your questions, together with the dovecot log file, to jom at grosjo.net <mailto:jom at grosjo.net> or to the dovecot ML dovecot at dovecot.org <mailto:d...

On 11/1/20 1:56 AM, John Fawcett wrote: > At the moment I don't see other corrections needed in dovecot apart from > command line doveadm fts which is not a show stopper. Via doveadm search > I confirm - on my simple config - that search for accented or non > accented characters works correctly as it does via imap connection. thx. hopefully it'll get considered for a next release soon. > Only thing I cannot vouch for is b...