Displaying 20 results from an estimated 7000 matches similar to: "Squat full text search indexer redesign"
2007 Apr 05
4
New full text search indexer
As described earlier
(http://dovecot.org/list/dovecot/2006-December/018055.html), Dovecot
nowadays has full text search indexing support in CVS HEAD.
Currently there are two backends: Lucene and Squat. Lucene's problem is
that standard IMAP SEARCH command can't be used with it without breaking
IMAP RFC. So Lucene can be used only with non-standard X-BODY-FAST and
X-TEXT-FAST search
2013 Nov 30
4
Full text search improvements
FTS indexing is something I hear quite often nowadays. I?ve added some hacks to make it work better for some installations, but it?s about time to think about the whole design and how it could be improved for everyone in future. Here are some of my initial thoughts.
Currently Dovecot supports 3 full text search engines: Solr, CLucene and Dovecot Squat. CLucene plugin has various features built
2012 Apr 25
2
stats + fts squat plugins, indexer-worker error on message indexing
On RHEL 6.2 + dovecot 2.1.5 with the stats and fts (squat) plugins enabled and each user having their own uid on the system I get the following error in the logs when the indexer-worker process indexes some messages:
Apr 25 09:56:19 wardentest3 dovecot: imap-login: Login: user=warden, method=PLAIN, rip=137.238.60.164, lip=137.238.2.240, lport=1993, mpid=19464, encryption=TLS
Apr 25 09:56:26
2009 Apr 02
1
Squat memory usage
I've been reading about using Squat with Dovecot on large mailboxes. I
was wondering if some of the memory usage during searching and indexing
could be reduced by using a berkeley db? I've used this in the past for
something similar and in BTREE mode it was very fast for millions of
keys. I havent had time to look at how squat is implemented, but I
thought I'd throw it out there...
2018 Dec 04
0
Squat
Yes, but the bottom line is that Squat does the job needed for end
users, Solr does not
On 2018-12-04 16:53, Michael Slusarz wrote:
>> On December 4, 2018 at 8:18 AM Aki Tuomi <aki.tuomi at open-xchange.com> wrote:
>>
>> We don't consider it as "very early beta". We consider it production ready. It is bit more work to set up though.
>
> FWIW, Squat
2011 Nov 28
0
squat fts not working on 2.1rc1
Hello,
I tried to upgrade from 2.0.15 to 2.1.rc1 over the weekend but ran into
some problems with squat. My two largest mailboxes were corrupted,
producing this error:
Nov 27 17:38:12 kerio1 dovecot[42860]: imap(bigmailbox): Error:
Corrupted squat uidlist file
/var/mail/metro-email.com/bigmailbox/mdbox/mailboxes/INBOX/dbox-Mails/dovecot.index.search.uids:
wrong indexid
There is a good chance
2013 Jan 08
1
Squat FTS plugin not kicking in
Hi,
I'm running Dovecot 2.1.12 on FreeBSD. I configured Dovecot to use the Squat plugin to provide faster full-text searches. The output of 'dovecot -n' is attached to this mail.
However, I just noticed that this plugin doesn't seem to kick in. A raw telnet session seems to confirm this:
[..]
. SEARCH BODY abcdefg
* OK Searched 57% of the mailbox, ETA 0:06
* SEARCH 3425 6254
2006 Dec 10
1
Full text search indexing
There are now two full text search backends in CVS HEAD:
- squat: My own full text search index based on ideas from Cyrus Squat
indexes. Supports substring searches.
- lucene: Uses CLucene library.
It should be pretty easy to add support for more backends.
As I've explained a couple of times already, IMAP RFC says that searches
are done by matching substrings, so the Lucene backend
2013 Jan 11
1
FTS what to use ?
Hi
I'm currently using dovecot 2.0 with squat fts which does a nice
job. However I'm thinking about upgrading to dovecot 2.1 and the wiki
isn't clear about which fts can or should be used with it.
Is squat support dead ? As the wiki mentions that the config syntax is
obsolete, I'm not sure if squat is obsolete also ? If not, what is the
new syntax ?
But in the case squat is
2012 Oct 15
1
fts = squat solr
I don't know if this was supposed to have changed with dovecot2, but
http://wiki.dovecot.org/Plugins/FTS shows
fts = squat solr
so, since I have the lucene plugin?"fts = lucene" works by itself?I
tried
fts = squat lucene
but:
$ doveadm index '*'
doveadm(dave): Error: fts: Failed to initialize backend 'squat lucene': Unknown backend
So, is that syntax
2007 Dec 10
2
squat also not working in beta11
Hi Timo,
Just tried squat in beta11. I also get the same error in the log:
dovecot: Dec 10 14:21:17 Error: IMAP(joewong99:joew.outblaze.com):
Corrupted squat uidlist file /mailfs/4/22/3/joewon
g99:joew.outblaze.com at joew_outblaze_com/Maildir/dovecot.index.search.uids:
Broken uidlists
There is not change in my configuration file.
# 1.1.beta11: /usr/local/etc/dovecot.conf
log_path:
2013 Nov 05
0
squat assertion result core dump with imap process
Hello,
Recently, we had a file system problem. After fsck we started to get some
core dump with imap process.
Nov 4 15:15:04 mail_server1 dovecot: imap(user at domain.tld): Panic: file
squat-trie.c: line 293 (squat_trie_lock): assertion failed: (trie->fd != -1)
Nov 4 15:15:04 mail_server1 dovecot: imap(user at domain.tld): Error: Raw
backtrace: /usr/lib/dovecot/libdovecot.so.0(+0x4892a)
2012 Oct 10
1
Shared Squat index for public mailboxes
Hi,
I'm running Dovecot 1.2.17 for serving mail via IMAP as well as for
providing access to a mailing list archive. The archive is implemented
as a public read-only mailbox with per-user index files (i.e. the \Seen
flags are per-user).
I recently enbled the Squat plugin to accelerate searches in the message
bodies and noticed that every user (I'm using a virtual user setup) gets
his
2008 Sep 19
2
fts squat and dovecot-shared
It seems, that dovecot-shared ignored by fts squat and dovecot.index.search/dovecot.index.search.uids
created with wrong permissions. This makes squat unusable with symlinked shared maildirs.
--
WBR,
Anton Yuzhaninov
2011 May 24
1
slow squat fts index creation
Hi all, ive been playing with squat indexes. Up to about 300.000 emails in a single mailbox this was working flawlessly. The search index file is about 500MB at that time. Ive now added some more emails, and at 450.000 or so emails im seeing a serious problem with squat index creation. It takes...f o r e v e r . The .tmp file is being so slowly, it will probably take 2-3 hours to create. Upto
2011 May 07
1
Dovecot using FTS solr or Squat when searching multiple fields.
Hi
Im using dovecot 1.2.16 with Solr setup for FTS. When searching a single
field such as subject Dovecot will use the solr index. When searching
multiple fields such as subject and body it does not use the index and uses
the standard built in search which takes much longer.
Is there any way to get Dovecot to use the solr or squat index when
searching multiple fields?
--
View this message in
2014 May 27
0
Incorrect IMAP search results when FTS/Squat indexes are present with 2.1.7
We recently upgraded from Dovecot 1.2.15 (on Debian squeeze) to Dovecot
2.1.7 (on Debian wheezy/stable).
For now, we continue to use FTS with Squat indexes. We'd like to
eventually switch to Lucene but it's not yet supported in Debian stable.
Since upgrading to 2.1.7, we've seen some problems with IMAP search
results when an FTS Squat index is present (i.e., when the
2008 Mar 06
2
Squat Indexing
I tried Squat indexing on my very small home system and when I did a
body search in Thunderbird, I got a TON, and I mean TON, of these
messages in my log file:
Mar 6 06:13:31 apple dovecot: child 14142 (imap) killed with signal 6
Mar 6 06:13:31 apple dovecot: IMAP(jeff): file file-lock.c: line 112:
unreached
Mar 6 06:13:31 apple dovecot: IMAP(jeff): Raw backtrace: imap
[0x482771] ->
2009 Apr 21
4
1.1.13 squat core dump
While using 1.1.13 and squat with local pine imap on Solaris 9 I had a
random core dump today. I was doing a search in a maildir folder with
about 2000 emails. Unfortunately, I haven't been able to reproduce it
yet, but I wanted to send along the info anyways.
Environment:
# uname -a
SunOS 5.9 Generic_122300-39 sun4u sparc SUNW,Sun-Blade-100
Backtrace:
http://pastebin.com/f7aa8bb5
~#
2009 Nov 17
4
fts squat non-english search for 2 words
Hello,
It looks I encoutered a bug or misconfiguration. fts_squat search for subject and body works excellent for English mails. For non-English (in particular, Russian) it works only when query consists of 1 word. Phrases - 2 and more words - always returns nothing. Example: search for "planet" ("???????") returns results, search for "Earth" ("?????") also