similar to: FTS, multiple virtualmailbox entries for single mailbox

For the point 1, this is not "suboptimal", it is plain wrong (results are damn wrong ! and this is not related to the backend, but the FTS logic in Dovecot core) For the point 2 , this has been discussed already numerous times but without action. The dovecot core shall be the one re-submitting the emails to scan, not the backend to try to figure out where and which are the emails to be

On Sun, Apr 14, 2019 at 21:09:54 +0800, Joan Moreau wrote: ... > THe "loop" part seems the most urgent : It breaks everything (search > timeout 100% of the time) Any luck with git-bisect? Jeff. > > On 2019-04-06 09:56, Joan Moreau via dovecot wrote: > > > For the point 1, this is not "suboptimal", it is plain wrong (results are damn wrong ! and this

Hi If you plan to fix the FTS part of Dovecot, I will be very gratefull. Not sure this is related to any specific commit but rahter the overall design The list of bugs so far 1 - Double call to fts plugins with inconsistent parameter (first call diferent from second call for the same request) 2 - "Rescan" features for now consists of deleting indexes. SHall be resending emails to

On Fri, Apr 05, 2019 at 19:33:57 +0800, Joan Moreau via dovecot wrote: > Hi > > If you plan to fix the FTS part of Dovecot, I will be very gratefull. I'm trying to figure out what is causing the 3rd issue you listed, so we can decide how severe it is and therefore how quickly it needs to be fixed. At the moment we are unable to reproduce it, and therefore we cannot fix it. >

I have tried to spend some time of understanding the logic (if any !) of the fts part Honestly, the one who created this mess shall be the one to fix it, or one shall refactor it totally. Basically, the fts "core" should be able to do - select the backend according to conf file - send new emails/maiblox to backend - send teh ID of the emails to be removed - resend an entire

> On 29 January 2019 at 19:15 Tomasz Nowak <tomek at flup.pl> wrote: > > > Hello, > > I'm trying to experiment with Dovecot and Solr server. > I have >30k email addresses that I want to index to speed up searching > and save IOPS on mail servers. > For now - I'm doing some experiments and I'm testing how it is working. > I'm thinking

On Fri, Apr 05, 2019 at 17:45:36 +0800, Joan Moreau wrote: > I am on master (very latest) > > No clue exactly when this problem appears, but > > 1 - the "request twice the fts plugin instead of once" issue has always > been there (since my first RC release of fts-xapian) Ok, good to know. > 2 - the body/text loop has appeared recently (maybe during the month

Hi all, Has anyone implemented larger Dovecot+Solr clusters and would be willing to give some details about how it works for you? My understanding about it so far is: - SolrCloud isn?t usable with Dovecot. Replication isn?t useful, because nobody wants to pay for double the disk space for indexes that could be regenerated anyway. The autosharding isn?t very useful also, because: I think the

Not really, as the steps outlined by Timo would not get done. Aki > On 17 February 2019 at 10:56 Joan Moreau via dovecot <dovecot at dovecot.org> wrote: > > > In such case, as long as the API is not upgraded, should > > doveadm index -A -q \* > > be considered a replacement of > > doveadm fts rescan > > On 2019-02-14 16:24, Timo Sirainen via

Dear Aki, I switched to "gz" now, since "zstd" also gave some errors on writing to files. I dont know if "xz" compression or "zstd" shreddered my MDBOX Files, but I lost 4 days of mail. (a couple of thousand mails). After restoring the backup (what was made after switching to version 2.3.11.3) I still have some broken mdfiles, but not too many.

In such case, as long as the API is not upgraded, should doveadm index -A -q \* be considered a replacement of doveadm fts rescan On 2019-02-14 16:24, Timo Sirainen via dovecot wrote: > Hi, > > The rescan() function is a bit badly designed. Currently what you could do what fts-lucene does and: > - Get list of UIDs for all mails in each folder > - If Xapian has UID that

Dear Aki, I switched to "gz" now, since "zstd" also gave some errors on writing to files. I dont know if "xz" compression or "zstd" shreddered my MDBOX Files, but I lost 4 days of mail. (a couple of thousand mails). After restoring the backup (what was made after switching to version 2.3.11.3) I still have some broken mdfiles, but not too many. Interestingly

I've had squat running on dovecot 2.0 and have been updating all users mailbox indexes nighty via cron with this command: doveadm -v search -A text xyzzyx I've just updated to 2.1 and I'm migrating to lucene indexes, but reading the documentation I'm having a hard time understanding the semantic differences between indexing and rescanning. If I were to continue to run an

Hi, THis is a core problem in Dovecot in my understanding. In my opinion, the rescan in dovecot should send to the FTS plugin the list of "supposedly" indexed emails (UID), and the plugin shall purge the redundant UID (i..e UID present in the index but not in the list sent by dovecot) and send back the list of UID not in its indexes to dovecot, so Dovect can send one by one the

Hi all, While trying to reindex a large mailbox to take advantage of Apache Tika, dovecot logs the following message: Error: Mailbox INBOX: Transaction commit failed: FTS transaction commit failed: transaction context The message is vague in that a transaction has failed, but nowhere does it say what the transaction boundaries are. Did the transaction affect the indexing of one message, or

Hi Christian, may be the issue is related to this other post: http://dovecot.org/pipermail/dovecot/2015-September/102094.html Anyway, what I can tell you is that for every? user account,? for every folders created after the last doveadm fts rescan for that user, dovecot does not invoke indexer. A new rescan fix the problem for all the folders created up to that moment. I was wondering if I was

Hello, I'm trying to experiment with Dovecot and Solr server. I have >30k email addresses that I want to index to speed up searching and save IOPS on mail servers. For now - I'm doing some experiments and I'm testing how it is working. I'm thinking about adding one additional server with Solr and configure all mail servers to use that server. I have some questions. 1. I have

It always shows the autoindex. And yes built from sources. I'm the FreeBSD port maintainer for mail/docecot. This has been happening for several releases. Get Outlook for Android<https://aka.ms/ghei36> ________________________________ From: dovecot <dovecot-bounces at dovecot.org> on behalf of John Fawcett via dovecot <dovecot at dovecot.org> Sent: Monday, April 15, 2019

Hi, I'm using Dovecot 2.2.13 with Dovecot Director, Doveadm server and FTS. I want to run doveadm on Director hosts, but Dovecot server on backend hosts reject "fts *" commands. On Dovecot Director hosts: # doveadm fts optimize -u u0001 at example.jp # echo $? 75 # doveadm fts rescan -u u0001 at example.jp # echo $? 75 doveadm index -u u0001 at example.jp INBOX #

On 8. Sep 2020, at 12.35, Robert Nowotny <rnowotny1966 at gmail.com> wrote: > > > Dear Aki, > I switched to "gz" now, since "zstd" also gave some errors on writing to files. What kind of errors? > I dont know if "xz" compression or "zstd" shreddered my MDBOX Files, but I lost 4 days of mail. (a couple of thousand mails). > After