similar to: Squat performance

I was writing this to beta9 announcement, but it grew so huge that I guess a separate mail is better. :) I've spent quite a lot of time this last week redesigning/rewriting Squat indexer. I think the redesign is good enough now that I'll just replace the existing squat with this new one in next release. I don't think many people are using the old squat, and there are also some bugs in

Hello, I tried to upgrade from 2.0.15 to 2.1.rc1 over the weekend but ran into some problems with squat. My two largest mailboxes were corrupted, producing this error: Nov 27 17:38:12 kerio1 dovecot[42860]: imap(bigmailbox): Error: Corrupted squat uidlist file /var/mail/metro-email.com/bigmailbox/mdbox/mailboxes/INBOX/dbox-Mails/dovecot.index.search.uids: wrong indexid There is a good chance

Hi, I'm running Dovecot 2.1.12 on FreeBSD. I configured Dovecot to use the Squat plugin to provide faster full-text searches. The output of 'dovecot -n' is attached to this mail. However, I just noticed that this plugin doesn't seem to kick in. A raw telnet session seems to confirm this: [..] . SEARCH BODY abcdefg * OK Searched 57% of the mailbox, ETA 0:06 * SEARCH 3425 6254

Hi I turned on fts squat to speed up full text searches over webmail. This works absolutely fantastic once the mailboxes are indexed. But when they are indexed for the first time I'm getting a fastcgi timeout after 30 seconds resulting into a internal server error on the webserver. In the background the indexing job is getting finished after 80 seconds for a 25k emails, ~300MB mailbox. Does

We recently upgraded from Dovecot 1.2.15 (on Debian squeeze) to Dovecot 2.1.7 (on Debian wheezy/stable). For now, we continue to use FTS with Squat indexes. We'd like to eventually switch to Lucene but it's not yet supported in Debian stable. Since upgrading to 2.1.7, we've seen some problems with IMAP search results when an FTS Squat index is present (i.e., when the

I don't know if this was supposed to have changed with dovecot2, but http://wiki.dovecot.org/Plugins/FTS shows fts = squat solr so, since I have the lucene plugin?"fts = lucene" works by itself?I tried fts = squat lucene but: $ doveadm index '*' doveadm(dave): Error: fts: Failed to initialize backend 'squat lucene': Unknown backend So, is that syntax

I tried Squat indexing on my very small home system and when I did a body search in Thunderbird, I got a TON, and I mean TON, of these messages in my log file: Mar 6 06:13:31 apple dovecot: child 14142 (imap) killed with signal 6 Mar 6 06:13:31 apple dovecot: IMAP(jeff): file file-lock.c: line 112: unreached Mar 6 06:13:31 apple dovecot: IMAP(jeff): Raw backtrace: imap [0x482771] ->

I've been reading about using Squat with Dovecot on large mailboxes. I was wondering if some of the memory usage during searching and indexing could be reduced by using a berkeley db? I've used this in the past for something similar and in BTREE mode it was very fast for millions of keys. I havent had time to look at how squat is implemented, but I thought I'd throw it out there...

Guys, We have a very large maildir for email auditing purposes. It's currently at 600 GB and continues to grow. Can dovecot handle this with squat indexing, or am I out of my mind? Thanks! John

On RHEL 6.2 + dovecot 2.1.5 with the stats and fts (squat) plugins enabled and each user having their own uid on the system I get the following error in the logs when the indexer-worker process indexes some messages: Apr 25 09:56:19 wardentest3 dovecot: imap-login: Login: user=warden, method=PLAIN, rip=137.238.60.164, lip=137.238.2.240, lport=1993, mpid=19464, encryption=TLS Apr 25 09:56:26

Yes, but the bottom line is that Squat does the job needed for end users, Solr does not On 2018-12-04 16:53, Michael Slusarz wrote: >> On December 4, 2018 at 8:18 AM Aki Tuomi <aki.tuomi at open-xchange.com> wrote: >> >> We don't consider it as "very early beta". We consider it production ready. It is bit more work to set up though. > > FWIW, Squat

Hi Timo, Just tried squat in beta11. I also get the same error in the log: dovecot: Dec 10 14:21:17 Error: IMAP(joewong99:joew.outblaze.com): Corrupted squat uidlist file /mailfs/4/22/3/joewon g99:joew.outblaze.com at joew_outblaze_com/Maildir/dovecot.index.search.uids: Broken uidlists There is not change in my configuration file. # 1.1.beta11: /usr/local/etc/dovecot.conf log_path:

Hello, Recently, we had a file system problem. After fsck we started to get some core dump with imap process. Nov 4 15:15:04 mail_server1 dovecot: imap(user at domain.tld): Panic: file squat-trie.c: line 293 (squat_trie_lock): assertion failed: (trie->fd != -1) Nov 4 15:15:04 mail_server1 dovecot: imap(user at domain.tld): Error: Raw backtrace: /usr/lib/dovecot/libdovecot.so.0(+0x4892a)

Hi, I'm running Dovecot 1.2.17 for serving mail via IMAP as well as for providing access to a mailing list archive. The archive is implemented as a public read-only mailbox with per-user index files (i.e. the \Seen flags are per-user). I recently enbled the Squat plugin to accelerate searches in the message bodies and noticed that every user (I'm using a virtual user setup) gets his

It seems, that dovecot-shared ignored by fts squat and dovecot.index.search/dovecot.index.search.uids created with wrong permissions. This makes squat unusable with symlinked shared maildirs. -- WBR, Anton Yuzhaninov

Hi all, ive been playing with squat indexes. Up to about 300.000 emails in a single mailbox this was working flawlessly. The search index file is about 500MB at that time. Ive now added some more emails, and at 450.000 or so emails im seeing a serious problem with squat index creation. It takes...f o r e v e r . The .tmp file is being so slowly, it will probably take 2-3 hours to create. Upto

Hi Im using dovecot 1.2.16 with Solr setup for FTS. When searching a single field such as subject Dovecot will use the solr index. When searching multiple fields such as subject and body it does not use the index and uses the standard built in search which takes much longer. Is there any way to get Dovecot to use the solr or squat index when searching multiple fields? -- View this message in

While using 1.1.13 and squat with local pine imap on Solaris 9 I had a random core dump today. I was doing a search in a maildir folder with about 2000 emails. Unfortunately, I haven't been able to reproduce it yet, but I wanted to send along the info anyways. Environment: # uname -a SunOS 5.9 Generic_122300-39 sun4u sparc SUNW,Sun-Blade-100 Backtrace: http://pastebin.com/f7aa8bb5 ~#

Hi Timo and All, after upgrading to 2.1.2 i'm getting a lot of these messages: Error: Corrupted squat uidlist file XXXXXX wrong indexid I did not have them before. Ideas? Luca

Hi! I'm using Dovecot 2.1.7 on Debian Wheezy 32-bit (package version is 1:2.1.7-7+deb7u1) with maildirs. My problem is that the incremental indexing of maildirs with squat takes a very long time... I don't know if it reindexes anything, but it seems it iterates though all messages on each search query and reads them. It works fast only on successive queries within several minutes,