similar to: slow squat fts index creation

>From today's maillog: maillog:Dec 28 09:29:40 aurora dovecot: IMAP(doug): msync() failed with index file /home/doug/Maildir/.projects.job591/dovecot.index: Invalid argument maillog:Dec 28 09:30:21 aurora dovecot: IMAP(doug): msync() failed with index file /home/doug/Maildir/dovecot.index: Invalid argument maillog:Dec 28 09:30:22 aurora dovecot: IMAP(doug): msync() failed with index file

Hi Timo, Here is the backtrace for your reference. I have already applied dovecot-97702c9c4111 changes to my 1.1 beta10 code base. I am running dovecot on FC7, gcc 4.1.2, mailbox is on NFS. Whenever I did UID SEARCH body "xxxx" imap crashes. Program terminated with signal 6, Aborted. #0 0x00110402 in __kernel_vsyscall () (gdb) bt full #0 0x00110402 in __kernel_vsyscall () No

Hi Timo and All, after upgrading to 2.1.2 i'm getting a lot of these messages: Error: Corrupted squat uidlist file XXXXXX wrong indexid I did not have them before. Ideas? Luca

It seems, that dovecot-shared ignored by fts squat and dovecot.index.search/dovecot.index.search.uids created with wrong permissions. This makes squat unusable with symlinked shared maildirs. -- WBR, Anton Yuzhaninov

I don't know if this was supposed to have changed with dovecot2, but http://wiki.dovecot.org/Plugins/FTS shows fts = squat solr so, since I have the lucene plugin?"fts = lucene" works by itself?I tried fts = squat lucene but: $ doveadm index '*' doveadm(dave): Error: fts: Failed to initialize backend 'squat lucene': Unknown backend So, is that syntax

Hello, It looks I encoutered a bug or misconfiguration. fts_squat search for subject and body works excellent for English mails. For non-English (in particular, Russian) it works only when query consists of 1 word. Phrases - 2 and more words - always returns nothing. Example: search for "planet" ("???????") returns results, search for "Earth" ("?????") also

Hi Timo, Just tried squat in beta11. I also get the same error in the log: dovecot: Dec 10 14:21:17 Error: IMAP(joewong99:joew.outblaze.com): Corrupted squat uidlist file /mailfs/4/22/3/joewon g99:joew.outblaze.com at joew_outblaze_com/Maildir/dovecot.index.search.uids: Broken uidlists There is not change in my configuration file. # 1.1.beta11: /usr/local/etc/dovecot.conf log_path:

Hi Im using dovecot 1.2.16 with Solr setup for FTS. When searching a single field such as subject Dovecot will use the solr index. When searching multiple fields such as subject and body it does not use the index and uses the standard built in search which takes much longer. Is there any way to get Dovecot to use the solr or squat index when searching multiple fields? -- View this message in

Hi, I'm running Dovecot 2.1.12 on FreeBSD. I configured Dovecot to use the Squat plugin to provide faster full-text searches. The output of 'dovecot -n' is attached to this mail. However, I just noticed that this plugin doesn't seem to kick in. A raw telnet session seems to confirm this: [..] . SEARCH BODY abcdefg * OK Searched 57% of the mailbox, ETA 0:06 * SEARCH 3425 6254

When attempting to save a message from the INBOX to a folder in a collection (like, .projects.dovecot), I get behavior like this (in GDB). Any clue what might be going wrong? Here's where a SIGABRT happens: 280 return array->buffer->used / array->element_size; This is the stack trace: (gdb) where #0 mail_index_map_get_ext_idx (map=0x1200c0db0, ext_id=0,

As described earlier (http://dovecot.org/list/dovecot/2006-December/018055.html), Dovecot nowadays has full text search indexing support in CVS HEAD. Currently there are two backends: Lucene and Squat. Lucene's problem is that standard IMAP SEARCH command can't be used with it without breaking IMAP RFC. So Lucene can be used only with non-standard X-BODY-FAST and X-TEXT-FAST search

I've been reading about using Squat with Dovecot on large mailboxes. I was wondering if some of the memory usage during searching and indexing could be reduced by using a berkeley db? I've used this in the past for something similar and in BTREE mode it was very fast for millions of keys. I havent had time to look at how squat is implemented, but I thought I'd throw it out there...

Thanks for mySql For Squat vs Solr, Solr does not reach Squat by very far in terms of results : If I setup Solr, and search (via the search in Roundbube or Evolution) for a keyword or part of the keyword, the results are complete non sense. The diference between "search in full body" and "search in fields" does not even work. Solr with Dovecot seems very early beta

Hi How to solve this ? So many similar segfaults Thank you On 2018-11-30 06:11, Joan Moreau wrote: > ANother (very very long) example : > > # gdb /usr/libexec/dovecot/indexer-worker core.indexer-worker.0.3a33f56105e043de802a7dfcee265a07.21017.1543533424000000 > GNU gdb (GDB) 8.2 > Copyright (C) 2018 Free Software Foundation, Inc. > License GPLv3+: GNU GPL version 3 or

finally managed to locate the dump here the output: # gdb /usr/libexec/dovecot/auth /var/lib/systemd/coredump/core.auth.0.3a33f56105e043de802a7dfcee265a07.28130.1543516118000000 GNU gdb (GDB) 8.2 Copyright (C) 2018 Free Software Foundation, Inc. License GPLv3+: GNU GPL version 3 or later <http://gnu.org/licenses/gpl.html> This is free software: you are free to change and redistribute it.

Guys, We have a very large maildir for email auditing purposes. It's currently at 600 GB and continues to grow. Can dovecot handle this with squat indexing, or am I out of my mind? Thanks! John

> On December 4, 2018 at 8:18 AM Aki Tuomi <aki.tuomi at open-xchange.com> wrote: > > We don't consider it as "very early beta". We consider it production ready. It is bit more work to set up though. FWIW, Squat has been deprecated since 2.0, so none of this should come as a surprise. https://wiki.dovecot.org/Plugins/FTS > Aki > > > On 04 December

Hi I turned on fts squat to speed up full text searches over webmail. This works absolutely fantastic once the mailboxes are indexed. But when they are indexed for the first time I'm getting a fastcgi timeout after 30 seconds resulting into a internal server error on the webserver. In the background the indexing job is getting finished after 80 seconds for a 25k emails, ~300MB mailbox. Does

Hi! I'm using Dovecot 2.1.7 on Debian Wheezy 32-bit (package version is 1:2.1.7-7+deb7u1) with maildirs. My problem is that the incremental indexing of maildirs with squat takes a very long time... I don't know if it reindexes anything, but it seems it iterates though all messages on each search query and reads them. It works fast only on successive queries within several minutes,

I know that a given search index doesn't get built the first time until you do an actual search on it from an IMAP client. I don't much care about that; I'm the only user, and I don't create new folders too often. At worst, I could create a script to go search every folder once. But what I'm not clear about: Does it then get updated on every delivery by LDA? Or does the