Displaying 20 results from an estimated 10000 matches similar to: "Background operations"
2019 Apr 21
0
FTS delays
Timo,
A little of logic here :
1 - the mailbox is passed by dovecot to the backend as a mailbox *
pointer , NOT as a search parameter.
-> It works properly when entering a search from roundcube or evolution
for instance.
-> therefore this is a clear bug of the command line
2 - the loop : Actually, the timeout occurs because the dovecot core is
DISCARDING the results of the backend
2019 Apr 21
2
FTS delays
It's because you're misunderstanding how the lookup() function works. It gets ALL the search parameters, including the "mailbox inbox". This is intentional, and not a bug. Two reasons being:
1) The FTS plugin in theory could support indexing/searching any kinds of searches, not just regular word searches. So I didn't want to limit it unnecessarily.
2) Especially with
2019 Apr 03
0
FTS delays
Example from real life
>From Roubdcube, I serach "milan" in full message (body & headers)
Logs :
Apr 3 10:24:01 gjserver dovecot[29778]:
imap(jom at grosjo.net)<30311><4pACp52FfCF/AAAB>: Query : ( bcc:milan OR
body:milan OR cc:milan OR from:milan OR message-id:milan OR
subject:milan OR to:milan OR uid:milan )
Apr 3 10:24:01 gjserver dovecot[29778]:
imap(jom at
2019 Apr 02
3
FTS delays
On 2 Apr 2019, at 6.38, Joan Moreau via dovecot <dovecot at dovecot.org> wrote:
>
> Further on this topic:
>
>
>
> When choosing any headers in the search box, dovecot core calls the plugin TWICE (and returns the results quickly, but not immediatly after getting the IDs from the plugins)
>
> When choosing the BODY search, dovecot core calls the plugin ONCE (and
2019 Jan 08
3
Solr -> Xapian ?
On 7 Jan 2019, at 16.05, Joan Moreau via dovecot <dovecot at dovecot.org> wrote:
>
> Hi
>
> ANyone to answer specifically ?
>
> Q1 : get_last_uid -> Is this the last UID indexed (which may be not the greatest value), or the gratest value (which may not be the latest) (the code of existing plugins is unclear about this, Solr looks for the greatest for insance)
All the
2020 Nov 06
2
vsz_limit
Duh... src/lib/restrict-process-size.h
Should be in the installed include files as well,
/usr/include/dovecot/restrict-process-size.h
Aki
> On 06/11/2020 15:56 Joan Moreau <jom at grosjo.net> wrote:
>
>
> Hello
> I can't find "src/lib/restrict.h" . Is it in dovecot source ?
>
>
> On 2020-11-06 13:20, Aki Tuomi wrote:
> > Seems I had
2019 Apr 21
2
FTS delays
Inbox appears in the list of arguments, because fts_backend_xapian_lookup() is parsing the search args wrong. Not sure about the other issue.
> On 21 Apr 2019, at 19.31, Joan Moreau <jom at grosjo.net> wrote:
>
> For this first point, the problem is that dovecot core sends TWICE the request and "Inbox" appears in the list of arguments ! (inbox shall serve to select teh
2020 Nov 04
2
vsz_limit
You could also add it as setting for the fts_xapian plugin parameters?
Aki
> On 04/11/2020 08:42 Joan Moreau <jom at grosjo.net> wrote:
>
>
> For machines with low memory, I would like to detect how much ram remains available before starting indexing a mail, so I can commit everything on disk before the ram is exhausted (and break the process)
> I tried to put a
2019 Apr 21
3
FTS delays
On 3 Apr 2019, at 20.30, Joan Moreau via dovecot <dovecot at dovecot.org> wrote:
> doveadm search -u jom at grosjo.net mailbox inbox text milan
> output
>
> doveadm(jom at grosjo.net): Info: Query : ( bcc:inbox OR body:inbox OR cc:inbox OR from:inbox OR message-id:inbox OR subject:inbox OR to:inbox OR uid:inbox ) AND ( bcc:milan OR body:milan OR cc:milan OR from:milan OR
2020 Nov 06
1
vsz_limit
Seems I had forgotten that you can use src/lib/restrict.h, in particular, restrict_get_process_size() to figure out the limit. You can combine this with getrusage to find out current usage.
Aki
> On 06/11/2020 13:26 Joan Moreau <jom at grosjo.net> wrote:
>
>
> yes, will do so.
> It would be nice however to be able to access the actual dovecot config from the plugin side
2019 Jan 14
2
[FTS Xapian] Beta release
Op 14-1-2019 om 13:40 schreef Aki Tuomi:
>
> Just to remind that now that there is a github repo for fts-xapian,
> you could maybe open these issues there instead?
>
Although README.md currently says:
"Please feel free to send your questions, together with the dovecot log
file, to jom at grosjo.net <mailto:jom at grosjo.net> or to the dovecot ML
dovecot at dovecot.org
2019 Jan 13
2
[FTS Xapian] Beta release
THis is already what I send earlier (see : dovecot-xapian-1.0b2.tar.gz
[1] )
What I would need is the files so one can download (git) it, and type
some command (make ?) to compile it and place it in the right forlder
(/usr/lib/dovecot/ or whatever is configured in the installed dovecot,
which may differ from distribution to distribution)
On 2019-01-13 19:47, Aki Tuomi wrote:
> You need
2019 Jan 14
3
[FTS Xapian] Beta release
Testing a compile on FreeBSD.
gmake[2]: Entering directory '/usr/home/wash/Tools/Dovecot/fts-xapian/src'
/bin/sh ../libtool --tag=CXX --mode=compile c++ -DHAVE_CONFIG_H -I.
-I.. -I/opt/dovecot2.3/include/dovecot
-I/opt/dovecot2.3/include/dovecot -g -O2 -MT fts-backend-xapian.lo -MD
-MP -MF .deps/fts-backend-xapian.Tpo -c -o fts-backend-xapian.lo
fts-backend-xapian.cpp
libtool:
2020 Nov 06
0
vsz_limit
ok found it,
However, it returns me some random number. Maybe I am missing something
On 2020-11-06 13:57, Aki Tuomi wrote:
> Duh... src/lib/restrict-process-size.h
>
> Should be in the installed include files as well,
>
> /usr/include/dovecot/restrict-process-size.h
>
> Aki
>
> On 06/11/2020 15:56 Joan Moreau <jom at grosjo.net> wrote:
>
> Hello
>
2019 Jan 13
1
[FTS Xapian] Beta release
Please kindly check https://github.com/grosjo/fts-xapian
On 2019-01-13 20:11, Aki Tuomi wrote:
> If you had looked at what I sent, you'd seen it's quite different from what you sent.
>
> Anyways, put the contents of skeleton.tar.gz and
>
> ./src/plugins/fts-xapian/fts-xapian-plugin.h
> ./src/plugins/fts-xapian/fts-backend-xapian.cpp
>
2019 Jan 12
2
[FTS Xapian] Status & Questions
<!doctype html>
<html>
<head>
<meta charset="UTF-8">
</head>
<body>
<div>
Did you remember to load fts first?
</div>
<div>
<br>
</div>
<div>
mail_plugins =$mail_plugins fts fts_xapian
</div>
<div>
<br>
</div>
<div>
Aki
</div>
2019 Apr 21
0
FTS delays
No, the parsing is made by dovecot core, that is nothing the backend can
do about it. The backend shall *never* reveive this. (would it be buggy
or no)
PLease, have a look deeper
And the loop is a very big problem as it times out all the time (and
once again, this is not in any of the backend functions)
On 2019-04-21 10:42, Timo Sirainen via dovecot wrote:
> Inbox appears in the list of
2019 Jan 13
3
[FTS Xapian] Beta release
Op 13/01/2019 om 21:25 schreef Joan Moreau via dovecot:
>
> I tried to combined it, the "autoreconf" errors are solved
>
> Now, when I type "make install", the lib is not pushed into dovecot
> folder, but somewhere in /usr/local/...
>
> How to adjust this to have it arriving in the proper folder ?
>
Depends on your system. It mostly a matter of setting
2019 Jan 14
2
[FTS Xapian] Beta release
In your README.md, perhaps "This project intends to provide a
straightforward and simple *procedure *to configure FTS plugin for Dovecot,
leveraging the efforts by the Xapian.org team." is better??
Also in the part after cloning from git:
./configure --prefix=/usr --with-dovecot=/path/to/dovecot [ This
/path/to/dovecot is not obvious. Is it the dovecot binary or what??]
On Mon, 14 Jan
2019 Jan 14
0
[FTS Xapian] Beta release
Just to remind that now that there is a github repo for fts-xapian, you
could maybe open these issues there instead?
Aki
On 14.1.2019 14.29, Odhiambo Washington wrote:
> Testing a compile on FreeBSD.
>
> gmake[2]: Entering directory '/usr/home/wash/Tools/Dovecot/fts-xapian/src'
> /bin/sh ../libtool? --tag=CXX? ?--mode=compile c++ -DHAVE_CONFIG_H -I.
> -I..?