search for: fts_xapian

...se is created, i found it need like 20 or so minutes to index less than 10GB of mails and while doing this - generate many tens of megabytes/s constant write traffic on it's database files. Excellent way of killing SSD. something must be broken. my config is plugin { plugin = fts fts_xapian fts = xapian fts_xapian = partial=2 full=20 verbose=0 fts_autoindex = yes fts_enforced = yes # fts_autoindex_exclude = \Junk # fts_autoindex_exclude2 = \Trash } any ideas?

Hi Please find attached the beta release of FTS Xapian, with the objective to replace fts_squat that is being deprecated. Configuration is exactly the same as for fts_squat: plugin { plugin = fts fts_xapian (...) fts = xapian fts_autoindex = yes fts_enforced = yes fts_xapian = partial=2 full=20 This is installed on my production server (>120Gb of mailboxes), and I will observe it during the coming days. I will definitely appreciate that this is added in the core git of docevot, in order to have...

...lda_mailbox_autocreate = yes lda_mailbox_autosubscribe = yes mail_attachment_detection_options = add-flags-on-save mail_attribute_dict = file:/var/mail/iwascoding/%n/dovecot-attributes mail_gid = 8 mail_home = /var/mail/iwascoding/%n mail_location = mdbox:~/mdbox mail_plugins = quota listescape fts fts_xapian mail_prefetch_count = 200 mail_uid = 8 managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihave...

...0GB of mails and while doing this - generate many tens of megabytes/s constant write traffic on it's database files. >> >> Excellent way of killing SSD. >> >> something must be broken. >> >> my config is >> >> plugin { >> plugin = fts fts_xapian >> >> fts = xapian >> fts_xapian = partial=2 full=20 verbose=0 >> >> fts_autoindex = yes >> fts_enforced = yes >> >> # fts_autoindex_exclude = \Junk >> # fts_autoindex_exclude2 = \Trash >> } >>...

...> >> Hi >> >> Please find attached the beta release of FTS Xapian, with the objective >> to replace fts_squat that is being deprecated. >> >> Configuration is exactly the same as for fts_squat: >> >> plugin { >> >> plugin = fts fts_xapian (...) >> fts = xapian >> fts_autoindex = yes >> fts_enforced = yes >> fts_xapian = partial=2 full=20 >> >> This is installed on my production server (>120Gb of mailboxes), and I >> will observe it during the coming days. >> >> I will defi...

...t <dovecot at dovecot.org> wrote: > > Hi > > Please find attached the beta release of FTS Xapian, with the objective > to replace fts_squat that is being deprecated. > > Configuration is exactly the same as for fts_squat: > > plugin { > > plugin = fts fts_xapian (...) > fts = xapian > fts_autoindex = yes > fts_enforced = yes > fts_xapian = partial=2 full=20 > > This is installed on my production server (>120Gb of mailboxes), and I > will observe it during the coming days. > > I will definitely appreciate that this is added...

...74be) # OS: Linux 4.15.0-55-generic x86_64 Ubuntu 18.04.2 LTS # Hostname: example.com auth_mechanisms = plain login auth_verbose = yes hostname = smtp.example.com imap_hibernate_timeout = 1 mins mail_attribute_dict = file:%h/metadata mail_gid = vmail mail_location = mdbox:~/mail mail_plugins = fts fts_xapian mail_server_admin = mailto:sysadmin at example.com mail_uid = vmail managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environ...

Hi list, I have both lazy_expunge and fts_autoindex activated (with fts-xapian), as follows: plugin { lazy_expunge = EXPUNGED/ } plugin { fts = xapian fts_xapian = partial=2 full=20 attachments=1 verbose=0 fts_autoindex = yes fts_enforced = yes fts_autoindex_exclude = EXPUNGED fts_autoindex_exclude2 = EXPUNGED/* } However, I still see "indexer-worker...: Info: Indexed 1 messages in EXPUNGED/..." in the dovecot log each time I expunge an email....

<!doctype html> <html> <head> <meta charset="UTF-8"> </head> <body> <div> Did you remember to load fts first? </div> <div> <br> </div> <div> mail_plugins =$mail_plugins fts fts_xapian </div> <div> <br> </div> <div> Aki </div> <blockquote type="cite"> <div> On 12 January 2019 at 10:37 Joan Moreau via dovecot < <a href="mailto:dovecot@dovecot.org">dovecot@dovecot.org</a>...

...vecot <dovecot at dovecot.org> wrote: > > Hi > > Please find attached the beta release of FTS Xapian, with the objective > to replace fts_squat that is being deprecated. > > Configuration is exactly the same as for fts_squat: > > plugin { > > plugin = fts fts_xapian (...) > fts = xapian > fts_autoindex = yes > fts_enforced = yes > fts_xapian = partial=2 full=20 > > This is installed on my production server (>120Gb of mailboxes), and I > will observe it during the coming days. > > I will definitely appreciate that this is added i...

You could also add it as setting for the fts_xapian plugin parameters? Aki > On 04/11/2020 08:42 Joan Moreau <jom at grosjo.net> wrote: > > > For machines with low memory, I would like to detect how much ram remains available before starting indexing a mail, so I can commit everything on disk before the ram is exhausted (and b...

...xample.com> > auth_mechanisms = plain login > auth_verbose = yes > hostname = smtp.example.com <http://smtp.example.com> > imap_hibernate_timeout = 1 mins > mail_attribute_dict = file:%h/metadata > mail_gid = vmail > mail_location = mdbox:~/mail > mail_plugins = fts fts_xapian > mail_server_admin = mailto:sysadmin at example.com > mail_uid = vmail > managesieve_notify_capability = mailto > managesieve_sieve_capability = fileinto reject envelope > encoded-character vacation subaddress comparator-i;ascii-numeric > relational regex imap4flags?copy includ...

Core was generated by `dovecot/indexer-worker'. Program terminated with signal 11, Segmentation fault. #0 0x00007f30f7ad056d in __exchange_and_add (__val=-1, __mem=0xfffffffffffffff8) at /usr/src/debug/gcc-4.8.5-20150702/obj-x86_64-redhat-linux/x86_64-redhat-linux/libstdc++-v3/include/ext/atomicity.h:49 49 { return __atomic_fetch_add(__mem, __val, __ATOMIC_ACQ_REL); } (gdb) bt full #0

...rote: On 13 January 2019 at 17:05 Joan Moreau via dovecot <dovecot at dovecot.org> wrote: Hi Please find attached the beta release of FTS Xapian, with the objective to?replace?fts_squat?that?is?being?deprecated. Configuration?is?exactly?the?same?as?for?fts_squat: plugin?{ plugin?=?fts?fts_xapian?(...) fts?=?xapian fts_autoindex?=?yes fts_enforced?=?yes fts_xapian?=?partial=2?full=20 This is installed on my production server (>120Gb of mailboxes), and I will?observe?it?during?the?coming?days. I?will?definitely?appreciate?that?this?is?added?in?the?core?git?of docevot, in order to have a...

...vecot <dovecot at dovecot.org> wrote: > > Hi > > Please find attached the beta release of FTS Xapian, with the objective > to replace fts_squat that is being deprecated. > > Configuration is exactly the same as for fts_squat: > > plugin { > > plugin = fts fts_xapian (...) > fts = xapian > fts_autoindex = yes > fts_enforced = yes > fts_xapian = partial=2 full=20 > > This is installed on my production server (>120Gb of mailboxes), and I > will observe it during the coming days. > > I will definitely appreciate that this is added i...

Hi Please find attached the beta release of FTS Xapian, with the objective to replace fts_squat that is being deprecated. Configuration is exactly the same as for fts_squat: plugin { plugin = fts fts_xapian (...) fts = xapian fts_autoindex = yes fts_enforced = yes fts_xapian = partial=2 full=20 This is installed on my production server, and I will observe it during the coming days. I will definitely appreciate that this is added in the core git of docevot, in order to have a versionning of it, to...

...dovecot at dovecot.org> wrote: > > > Hi > > Please find attached the beta release of FTS Xapian, with the objective > to replace fts_squat that is being deprecated. > > Configuration is exactly the same as for fts_squat: > > plugin { > > plugin = fts fts_xapian (...) > fts = xapian > fts_autoindex = yes > fts_enforced = yes > fts_xapian = partial=2 full=20 > > This is installed on my production server (>120Gb of mailboxes), and I > will observe it during the coming days. > > I will definitely appreciate that this is added...

...t; Please find attached the beta release of FTS Xapian, with the objective > >> to replace fts_squat that is being deprecated. > >> > >> Configuration is exactly the same as for fts_squat: > >> > >> plugin { > >> > >> plugin = fts fts_xapian (...) > >> fts = xapian > >> fts_autoindex = yes > >> fts_enforced = yes > >> fts_xapian = partial=2 full=20 > >> > >> This is installed on my production server (>120Gb of mailboxes), and I > >> will observe it during the coming da...

Set up fts_xapian over the weekend and re-indexed. https://github.com/grosjo/fts-xapian Tried to search my INBOX and got: > dovecot: indexer-worker: Panic: file charset-iconv.c: line 83 (charset_to_utf8_try): assertion failed: (srcleft <= CHARSET_MAX_PENDING_BUF_SIZE) What could I possibly have lurking in m...

...so minutes to index less than 10GB of mails and while doing this - generate many tens of megabytes/s constant write traffic on it's database files. > > Excellent way of killing SSD. > > something must be broken. > > my config is > > plugin { > plugin = fts fts_xapian > > fts = xapian > fts_xapian = partial=2 full=20 verbose=0 > > fts_autoindex = yes > fts_enforced = yes > > # fts_autoindex_exclude = \Junk > # fts_autoindex_exclude2 = \Trash > } > > > any ideas?