Hi! We found some problems with those patches, and ended up doing slightly different fix: https://github.com/dovecot/core/compare/3e41b3d%5E...cca98b.patch Aki On 24.10.2016 10:17, Aki Tuomi wrote:> Hi! > > Can you try these two patches? > > Aki > > > On 24.10.2016 08:48, Aki Tuomi wrote: >> Ok so that timeval makes no sense. We'll look into it. >> >> Aki >> >>> On October 24, 2016 at 12:22 AM Larry Rosenman <larryrtx at gmail.com> wrote: >>> >>> >>> doveadm(mrm): Debug: http-client: conn 127.0.0.1:9998 [1]: Got 200 response >>> for request [Req38: PUT http://localhost:9998/tika/] (took 296 ms + 8 ms in >>> queue) >>> doveadm(mrm): Panic: kevent(): Invalid argument >>> >>> Program received signal SIGABRT, Aborted. >>> 0x00000008014e6f7a in thr_kill () from /lib/libc.so.7 >>> (gdb) fr 6 >>> #6 0x00000008011a3e49 in io_loop_handler_run_internal (ioloop=0x801c214e0) >>> at ioloop-kqueue.c:131 >>> 131 i_panic("kevent(): %m"); >>> (gdb) p ts >>> $1 = {tv_sec = 34389923520, tv_nsec = 140737488345872000} >>> (gdb) p errno >>> $2 = 22 >>> (gdb) p ret >>> $3 = -1 >>> (gdb) p *ioloop >>> $4 = {prev = 0x801c21080, cur_ctx = 0x0, io_files = 0x801c4f980, >>> next_io_file = 0x0, timeouts = 0x801d17540, timeouts_new = {arr = { >>> buffer = 0x801cd9700, element_size = 8}, v = 0x801cd9700, >>> v_modifiable = 0x801cd9700}, handler_context = 0x801d17560, >>> notify_handler_context = 0x0, max_fd_count = 0, >>> time_moved_callback = 0x800d53bb0 <mail_storage_service_time_moved>, >>> next_max_time = 1477257580, ioloop_wait_usecs = 27148, io_pending_count >>> 1, >>> running = 1, iolooping = 1} >>> (gdb) p* ctx >>> $5 = {kq = 21, deleted_count = 0, events = {arr = {buffer = 0x801cd9740, >>> element_size = 32}, v = 0x801cd9740, v_modifiable = 0x801cd9740}} >>> (gdb) p *events >>> $6 = {ident = 22, filter = -1, flags = 0, fflags = 0, data = 8, >>> udata = 0x801c4f980} >>> (gdb) >>> >>> thebighonker.lerctr.org ~ $ ps auxw|grep doveadm >>> mrm 46965 0.0 0.2 108516 55264 0 I+ 4:19PM 0:02.28 gdb >>> /usr/local/bin/doveadm (gdb7111) >>> mrm 46985 0.0 0.0 81236 15432 0 TX 4:19PM 0:03.51 >>> /usr/local/bin/doveadm -D -vvvvvvv index * >>> ler 47221 0.0 0.0 18856 2360 1 S+ 4:21PM 0:00.00 grep >>> doveadm >>> thebighonker.lerctr.org ~ $ sudo lsof -p 46985 >>> Password: >>> COMMAND PID USER FD TYPE DEVICE SIZE/OFF NODE NAME >>> doveadm 46985 mrm cwd VDIR 22,2669215774 152 4 >>> /home/mrm >>> doveadm 46985 mrm rtd VDIR 19,766509061 28 4 / >>> doveadm 46985 mrm txt VREG 119,3584295129 1714125 182952 >>> /usr/local/bin/doveadm >>> doveadm 46985 mrm txt VREG 19,766509061 132272 14382 >>> /libexec/ld-elf.so.1 >>> doveadm 46985 mrm txt VREG 22,2669215774 6920 10680 >>> /home/mrm/mail/TRAVEL/.imap/hawaiian.airlines/dovecot.index.log >>> doveadm 46985 mrm txt VREG 22,2669215774 7224 10716 >>> /home/mrm/mail/TRAVEL/.imap/priceline/dovecot.index.log >>> doveadm 46985 mrm txt VREG 22,2669215774 11080 10650 >>> /home/mrm/mail/TRAVEL/.imap/alamo/dovecot.index.log >>> doveadm 46985 mrm txt VREG 22,2669215774 2968 10679 >>> /home/mrm/mail/TRAVEL/.imap/hawaiian.airlines/dovecot.index.cache >>> doveadm 46985 mrm txt VREG 22,2669215774 3108 10715 >>> /home/mrm/mail/TRAVEL/.imap/priceline/dovecot.index.cache >>> doveadm 46985 mrm txt VREG 22,2669215774 6520 139902 >>> /home/mrm/mail/.imap/Sent/dovecot.index.log >>> doveadm 46985 mrm txt VREG 22,2669215774 9236 10648 >>> /home/mrm/mail/TRAVEL/.imap/alamo/dovecot.index.cache >>> doveadm 46985 mrm txt VREG 22,2669215774 174892 143343 >>> /home/mrm/mail/.imap/Sent/dovecot.index.cache >>> doveadm 46985 mrm txt VREG 22,2669215774 32656 143058 >>> /home/mrm/mail/.imap/INBOX/dovecot.index.log >>> doveadm 46985 mrm txt VREG 19,766509061 720 30627 >>> /usr/share/i18n/csmapper/CP/CP1251%UCS.mps >>> doveadm 46985 mrm txt VREG 19,766509061 720 30630 >>> /usr/share/i18n/csmapper/CP/CP1252%UCS.mps >>> doveadm 46985 mrm txt VREG 19,766509061 89576 6846 >>> /lib/libz.so.6 >>> doveadm 46985 mrm txt VREG 19,766509061 62008 5994 >>> /lib/libcrypt.so.5 >>> doveadm 46985 mrm txt VREG 119,3584295129 6725689 183611 >>> /usr/local/lib/dovecot/libdovecot-storage.so.0.0.0 >>> doveadm 46985 mrm txt VREG 119,3584295129 3162259 183615 >>> /usr/local/lib/dovecot/libdovecot.so.0.0.0 >>> doveadm 46985 mrm txt VREG 19,766509061 1649944 4782 >>> /lib/libc.so.7 >>> doveadm 46985 mrm txt VREG 119,3584295129 80142 183550 >>> /usr/local/lib/dovecot/lib15_notify_plugin.so >>> doveadm 46985 mrm txt VREG 119,3584295129 652615 183556 >>> /usr/local/lib/dovecot/lib20_fts_plugin.so >>> doveadm 46985 mrm txt VREG 119,3584295129 2730888 268825 >>> /usr/local/lib/libicui18n.so.57.1 >>> doveadm 46985 mrm txt VREG 119,3584295129 1753976 268849 >>> /usr/local/lib/libicuuc.so.57.1 >>> doveadm 46985 mrm txt VREG 119,3584295129 1704 268821 >>> /usr/local/lib/libicudata.so.57.1 >>> doveadm 46985 mrm txt VREG 19,766509061 102560 6745 >>> /lib/libthr.so.3 >>> doveadm 46985 mrm txt VREG 19,766509061 184712 5795 >>> /lib/libm.so.5 >>> doveadm 46985 mrm txt VREG 19,766509061 774000 5642 >>> /usr/lib/libc++.so.1 >>> doveadm 46985 mrm txt VREG 19,766509061 103304 5742 >>> /lib/libcxxrt.so.1 >>> doveadm 46985 mrm txt VREG 19,766509061 56344 7436 >>> /lib/libgcc_s.so.1 >>> doveadm 46985 mrm txt VREG 119,3584295129 349981 183782 >>> /usr/local/lib/dovecot/lib21_fts_lucene_plugin.so >>> doveadm 46985 mrm txt VREG 119,3584295129 1969384 113258 >>> /usr/local/lib/libclucene-core.so.2.3.3.4 >>> doveadm 46985 mrm txt VREG 119,3584295129 128992 113261 >>> /usr/local/lib/libclucene-shared.so.2.3.3.4 >>> doveadm 46985 mrm txt VREG 119,3584295129 143141 183578 >>> /usr/local/lib/dovecot/lib90_stats_plugin.so >>> doveadm 46985 mrm txt VREG 119,3584295129 37368 151926 >>> /usr/local/lib/dovecot/doveadm/lib10_doveadm_sieve_plugin.so >>> doveadm 46985 mrm txt VREG 119,3584295129 693808 151924 >>> /usr/local/lib/dovecot-2.2-pigeonhole/libdovecot-sieve.so.0.0.0 >>> doveadm 46985 mrm txt VREG 119,3584295129 146477 183599 >>> /usr/local/lib/dovecot/libdovecot-lda.so.0.0.0 >>> doveadm 46985 mrm txt VREG 119,3584295129 13823 183780 >>> /usr/local/lib/dovecot/doveadm/lib20_doveadm_fts_lucene_plugin.so >>> doveadm 46985 mrm txt VREG 119,3584295129 88081 183527 >>> /usr/local/lib/dovecot/doveadm/lib20_doveadm_fts_plugin.so >>> doveadm 46985 mrm txt VREG 19,766509061 8304 6330 >>> /usr/lib/i18n/libiconv_std.so.4 >>> doveadm 46985 mrm txt VREG 19,766509061 6744 6318 >>> /usr/lib/i18n/libUTF8.so.4 >>> doveadm 46985 mrm txt VREG 19,766509061 4384 6336 >>> /usr/lib/i18n/libmapper_none.so.4 >>> doveadm 46985 mrm txt VREG 19,766509061 7584 6345 >>> /usr/lib/i18n/libmapper_std.so.4 >>> doveadm 46985 mrm 0u VCHR 0,188 0t390889 188 >>> /dev/pts/0 >>> doveadm 46985 mrm 1u VCHR 0,188 0t390889 188 >>> /dev/pts/0 >>> doveadm 46985 mrm 2u VCHR 0,188 0t390889 188 >>> /dev/pts/0 >>> doveadm 46985 mrm 3u PIPE 0xfffff806fdf505d0 16384 >>> ->0xfffff806fdf50730 >>> doveadm 46985 mrm 4u PIPE 0xfffff806fdf50730 0 >>> ->0xfffff806fdf505d0 >>> doveadm 46985 mrm 5u KQUEUE 0xfffff806350b0600 >>> count=0, state=0 >>> doveadm 46985 mrm 6w FIFO 163,709754999 0t0 29707 >>> /var/run/dovecot/stats-mail >>> doveadm 46985 mrm 7u VREG 22,2669215774 11080 10650 >>> /home/mrm/mail/TRAVEL/.imap/alamo/dovecot.index.log >>> doveadm 46985 mrm 8u VREG 22,2669215774 536 137895 >>> /home/mrm/mail/TRAVEL/.imap/alamo/dovecot.index >>> doveadm 46985 mrm 9u VREG 22,2669215774 6920 10680 >>> /home/mrm/mail/TRAVEL/.imap/hawaiian.airlines/dovecot.index.log >>> doveadm 46985 mrm 10u VREG 22,2669215774 2968 10679 >>> /home/mrm/mail/TRAVEL/.imap/hawaiian.airlines/dovecot.index.cache >>> doveadm 46985 mrm 11u VREG 22,2669215774 6520 139902 >>> /home/mrm/mail/.imap/Sent/dovecot.index.log >>> doveadm 46985 mrm 12u VREG 22,2669215774 9288 139905 >>> /home/mrm/mail/.imap/Sent/dovecot.index >>> doveadm 46985 mrm 13u VREG 22,2669215774 7224 10716 >>> /home/mrm/mail/TRAVEL/.imap/priceline/dovecot.index.log >>> doveadm 46985 mrm 14u VREG 22,2669215774 3108 10715 >>> /home/mrm/mail/TRAVEL/.imap/priceline/dovecot.index.cache >>> doveadm 46985 mrm 15u VREG 22,2669215774 9236 10648 >>> /home/mrm/mail/TRAVEL/.imap/alamo/dovecot.index.cache >>> doveadm 46985 mrm 16u VREG 22,2669215774 174892 143343 >>> /home/mrm/mail/.imap/Sent/dovecot.index.cache >>> doveadm 46985 mrm 17u VREG 22,2669215774 32656 143058 >>> /home/mrm/mail/.imap/INBOX/dovecot.index.log >>> doveadm 46985 mrm 18u VREG 22,2669215774 0 135848 >>> /home/mrm (zroot/home/mrm) >>> doveadm 46985 mrm 19u VREG 22,2669215774 35656 135336 >>> /home/mrm/mail/.imap/INBOX/dovecot.index >>> doveadm 46985 mrm 20u VREG 22,2669215774 0 135849 >>> /home/mrm (zroot/home/mrm) >>> doveadm 46985 mrm 21u KQUEUE 0xfffff80163b1ba00 >>> count=1, state=0 >>> doveadm 46985 mrm 22u IPv4 0xfffff805ea69a000 0t0 TCP >>> localhost:44730->localhost:9998 (ESTABLISHED) >>> doveadm 46985 mrm 25uR VREG 22,2669215774 32997612 4151 >>> /home/mrm/mail/Sent >>> thebighonker.lerctr.org >>> >>> >>> >>> On Sun, Oct 23, 2016 at 12:20 PM, Aki Tuomi <aki.tuomi at dovecot.fi> wrote: >>> >>>> According to man page, the only way it can return EINVAL (22) is either >>>> bad filter, or bad timeout. I can't see how the filter would be bad, so I'm >>>> guessing ts must be bad. Unfortunately I forgot to ask for it, so I am >>>> going to have to ask you run it again and run >>>> >>>> p ts >>>> >>>> if that's valid, then the only thing that can be bad if the file >>>> descriptor 23. >>>> >>>> Aki >>>> >>>>> On October 23, 2016 at 7:42 PM Larry Rosenman <larryrtx at gmail.com> >>>> wrote: >>>>> ok, gdb7 works: >>>>> (gdb) fr 6 >>>>> #6 0x00000008011a3e49 in io_loop_handler_run_internal >>>> (ioloop=0x801c214e0) >>>>> at ioloop-kqueue.c:131 >>>>> 131 i_panic("kevent(): %m"); >>>>> (gdb) p errno >>>>> $1 = 22 >>>>> (gdb) p ret >>>>> $2 = -1 >>>>> (gdb) p *ioloop >>>>> $3 = {prev = 0x801c21080, cur_ctx = 0x0, io_files = 0x801c4f980, >>>>> next_io_file = 0x0, timeouts = 0x801c19e60, timeouts_new = {arr >>>> {buffer >>>>> 0x801c5ac80, element_size = 8}, v = 0x801c5ac80, >>>>> v_modifiable = 0x801c5ac80}, handler_context = 0x801c19e80, >>>>> notify_handler_context = 0x0, max_fd_count = 0, time_moved_callback >>>>> 0x800d53bb0 <mail_storage_service_time_moved>, >>>>> next_max_time = 1477240784, ioloop_wait_usecs = 29863, >>>> io_pending_count >>>>> 1, running = 1, iolooping = 1} >>>>> (gdb) p *ctx >>>>> $4 = {kq = 22, deleted_count = 0, events = {arr = {buffer = 0x801c5acc0, >>>>> element_size = 32}, v = 0x801c5acc0, v_modifiable = 0x801c5acc0}} >>>>> (gdb) p *events >>>>> $5 = {ident = 23, filter = -1, flags = 0, fflags = 0, data = 8, udata >>>>> 0x801c4f980} >>>>> (gdb) >>>>> >>>>> >>>>> >>>>> On Sun, Oct 23, 2016 at 11:27 AM, Larry Rosenman <larryrtx at gmail.com> >>>> wrote: >>>>>> grrr. >>>>>> >>>>>> /home/mrm $ gdb /usr/local/bin/doveadm >>>>>> GNU gdb 6.1.1 [FreeBSD] >>>>>> Copyright 2004 Free Software Foundation, Inc. >>>>>> GDB is free software, covered by the GNU General Public License, and >>>> you >>>>>> are >>>>>> welcome to change it and/or distribute copies of it under certain >>>>>> conditions. >>>>>> Type "show copying" to see the conditions. >>>>>> There is absolutely no warranty for GDB. Type "show warranty" for >>>> details. >>>>>> This GDB was configured as "amd64-marcel-freebsd"... >>>>>> (gdb) run -D -vvvvvv index * >>>>>> Starting program: /usr/local/bin/doveadm -D -vvvvvv index * >>>>>> >>>>>> Program received signal SIGTRAP, Trace/breakpoint trap. >>>>>> Cannot remove breakpoints because program is no longer writable. >>>>>> It might be running in another process. >>>>>> Further execution is probably impossible. >>>>>> 0x0000000800624490 in ?? () >>>>>> (gdb) >>>>>> >>>>>> Ideas? >>>>>> >>>>>> >>>>>> On Sun, Oct 23, 2016 at 11:14 AM, Aki Tuomi <aki.tuomi at dovecot.fi> >>>> wrote: >>>>>>> Hi, >>>>>>> >>>>>>> can you run doveadm in gdb, wait for it to crash, and then go to >>>> frame 6 >>>>>>> ( io_loop_handler_run_internal) and run >>>>>>> >>>>>>> p errno >>>>>>> p ret >>>>>>> p *ioloop >>>>>>> p *ctx >>>>>>> p *events >>>>>>> >>>>>>> Sorry but the crash doesn't make enough sense yet to me, we need to >>>>>>> determine what the invalid parameter is. >>>>>>> >>>>>>>> Larry Rosenman http://www.lerctr.org/~ler >>>>>>>> Phone: +1 214-642-9640 (c) E-Mail: larryrtx at gmail.com >>>>>>>> US Mail: 17716 Limpia Crk, Round Rock, TX 78664-7281 >>>>>> >>>>>> -- >>>>>> Larry Rosenman http://www.lerctr.org/~ler >>>>>> Phone: +1 214-642-9640 (c) E-Mail: larryrtx at gmail.com >>>>>> US Mail: 17716 Limpia Crk, Round Rock, TX 78664-7281 >>>>>> >>>>> >>>>> -- >>>>> Larry Rosenman http://www.lerctr.org/~ler >>>>> Phone: +1 214-642-9640 (c) E-Mail: larryrtx at gmail.com >>>>> US Mail: 17716 Limpia Crk, Round Rock, TX 78664-7281 >>> >>> -- >>> Larry Rosenman http://www.lerctr.org/~ler >>> Phone: +1 214-642-9640 (c) E-Mail: larryrtx at gmail.com >>> US Mail: 17716 Limpia Crk, Round Rock, TX 78664-7281
that seems to fix this kevent() problem, but I got the following lucene
assert. Is that because of previous fails?
Also, while I have your attention, is fts_autoindex supposed to work
accross NAMESPACES?
doveadm(mrm): Debug: Mailbox LISTS/vse-l: Opened mail UID=39483 because:
fts indexing
doveadm(mrm): Debug: Mailbox LISTS/vse-l: Opened mail UID=39484 because:
fts indexing
doveadm(mrm): Debug: Mailbox LISTS/vse-l: Opened mail UID=39485 because:
fts indexing
doveadm(mrm): Debug: Mailbox LISTS/vse-l: Opened mail UID=39486 because:
fts indexing
Assertion failed: (numDocsInStore*8 == directory->fileLength(
(docStoreSegment + "." +
IndexFileNames::FIELDS_INDEX_EXTENSION).c_str()
)), function closeDocStore, file
src/core/CLucene/index/DocumentsWriter.cpp, line 210.
Program received signal SIGABRT, Aborted.
0x00000008014e6f7a in thr_kill () from /lib/libc.so.7
(gdb) bt full
#0 0x00000008014e6f7a in thr_kill () from /lib/libc.so.7
No symbol table info available.
#1 0x00000008014e6f66 in raise () from /lib/libc.so.7
No symbol table info available.
#2 0x00000008014e6ee9 in abort () from /lib/libc.so.7
No symbol table info available.
#3 0x000000080154dee1 in __assert () from /lib/libc.so.7
No symbol table info available.
#4 0x0000000803ea1762 in lucene::index::DocumentsWriter::closeDocStore() ()
from /usr/local/lib/libclucene-core.so.1
No symbol table info available.
#5 0x0000000803ea3d89 in lucene::index::DocumentsWriter::flush(bool) ()
from /usr/local/lib/libclucene-core.so.1
No symbol table info available.
#6 0x0000000803ed26bb in lucene::index::IndexWriter::doFlush(bool) ()
from /usr/local/lib/libclucene-core.so.1
No symbol table info available.
#7 0x0000000803ece25e in lucene::index::IndexWriter::flush(bool, bool) ()
from /usr/local/lib/libclucene-core.so.1
No symbol table info available.
#8 0x0000000803ececbe in
lucene::index::IndexWriter::addDocument(lucene::document::Document*,
lucene::analysis::Analyzer*) ()
from /usr/local/lib/libclucene-core.so.1
No symbol table info available.
---Type <return> to continue, or q <return> to quit---
#9 0x0000000803b8cd55 in lucene_index_build_flush (index=0x801c1b640)
at lucene-wrapper.cc:552
analyzer = 0x801c251c0
ret = 0
err = @0x801cd90d0: {
_awhat = 0x801cd9108 "Return-Path:
<m.ray.mullins+caf_=mrmlerctr.org at gmail.com>\nDelivered-To: mrm at
lerctr.org\n",
_twhat = 0x58 <error: Cannot access memory at address 0x58>,
error_number = 30249224}
#10 0x0000000803b8c42e in lucene_index_build_more (index=0x801c1b640,
uid=39486, part_idx=0,
data=0x806041000 "<m.ray.mullins+caf_=mrm=lerctr.org at
gmail.com>",
size=45,
hdr_name=0x801c1a520 "Return-Path") at lucene-wrapper.cc:572
id
L"\x1cc8c40\b\xffffd970\x7fff\xffffd960\x7fff\x1190eba\b\x1cc0c00\b\x1191739\b\x1cc8c40\b\x1190eba\b\xffffd990\x7fff-\000\000\001-"
namesize = 34378158489
datasize = 140737488345424
dest = 0x801190eba <i_stream_is_buffer_invalid+138>
L"\x45880124\xff458aff\xb60f0124\xc48348c0\xfc35d10\x4855001f\x8348e589\x8d4840ec\x8948e075\x8b48f07d\x8b48f07d\x8948107f\x8b48e87d\x8b48e87d\x140bf\x458b4800\x888b48e8\510\x48f92948\x1488889\x8b480000\xc748e845\x14080"
dest_free = 0x7fffffffd920
L"\xffffd950\x7fff\x1191199\b\x1cc8c40\b\xffffd970\x7fff\xffffd960\x7fff\x1190eba\b\x1cc0c00\b\x1191739\b\x1cc8c40\b\x1190eba\b\xffffd990\x7fff-"
---Type <return> to continue, or q <return> to quit---
token_flag = 0
#11 0x0000000803b8a420 in fts_backend_lucene_update_build_more (
_ctx=0x801c21240,
data=0x806041000 "<m.ray.mullins+caf_=mrm=lerctr.org at
gmail.com>",
size=45)
at fts-backend-lucene.c:432
_data_stack_cur_id = 6
ctx = 0x801c21240
backend = 0x801c3a200
ret = 8
#12 0x000000080220e035 in fts_backend_update_build_more (ctx=0x801c21240,
data=0x806041000 "<m.ray.mullins+caf_=mrm=lerctr.org at
gmail.com>",
size=45)
at fts-api.c:193
No locals.
#13 0x000000080221015b in fts_build_full_words (ctx=0x7fffffffdc98,
data=0x806041000 "<m.ray.mullins+caf_=mrm=lerctr.org at
gmail.com>",
size=45,
last=true) at fts-build-mail.c:402
i = 45
#14 0x000000080220fd45 in fts_build_data (ctx=0x7fffffffdc98,
data=0x806041000 "<m.ray.mullins+caf_=mrm=lerctr.org at
gmail.com>",
size=45,
last=true) at fts-build-mail.c:423
No locals.
#15 0x000000080221067d in fts_build_unstructured_header (ctx=0x7fffffffdc98,
hdr=0x801ccf118) at fts-build-mail.c:104
data = 0x806041000 "<m.ray.mullins+caf_=mrm=lerctr.org at
gmail.com>"
---Type <return> to continue, or q <return> to quit---
buf = 0x0
i = 45
ret = 18164334
#16 0x000000080220fa54 in fts_build_mail_header (ctx=0x7fffffffdc98,
block=0x7fffffffdc40) at fts-build-mail.c:179
hdr = 0x801ccf118
key = {uid = 39486, type = FTS_BACKEND_BUILD_KEY_HDR,
part = 0x801c09c58, hdr_name = 0x801c4ba20 "Return-Path",
body_content_type = 0x0, body_content_disposition = 0x0}
ret = 32767
#17 0x000000080220f292 in fts_build_mail_real (update_ctx=0x801c21240,
mail=0x801c63040) at fts-build-mail.c:548
ctx = {mail = 0x801c63040, update_ctx = 0x801c21240,
content_type = 0x0, content_disposition = 0x0, body_parser = 0x0,
word_buf = 0x0, pending_input = 0x0, cur_user_lang = 0x0}
input = 0x801cc9030
parser = 0x801c2f040
decoder = 0x801ccf100
raw_block = {part = 0x801c09c58, hdr = 0x801c53900, data = 0x0,
size = 0}
block = {part = 0x801c09c58, hdr = 0x801ccf118,
data = 0x7fffffffdc90 "0\220\314\001\b", size = 0}
prev_part = 0x801c09c58
parts = 0x4ffffdca8
---Type <return> to continue, or q <return> to quit---
skip_body = false
body_part = false
body_added = false
binary_body = 255
error = 0x801cc88c0 "\200\212\314\001\b"
ret = 1
#18 0x000000080220ee72 in fts_build_mail (update_ctx=0x801c21240,
mail=0x801c63040) at fts-build-mail.c:594
_data_stack_cur_id = 5
ret = 8
#19 0x000000080221a626 in fts_mail_index (_mail=0x801c63040)
at fts-storage.c:503
ft = 0x801c196e0
flist = 0x801c5dbd8
#20 0x0000000802217d40 in fts_mail_precache (_mail=0x801c63040)
at fts-storage.c:522
_data_stack_cur_id = 4
mail = 0x801c63040
fmail = 0x801c634f0
ft = 0x801c196e0
#21 0x0000000800d3d992 in mail_precache (mail=0x801c63040) at mail.c:420
_data_stack_cur_id = 3
p = 0x801c63040
#22 0x0000000000433b59 in cmd_index_box_precache (box=0x8074edc40)
---Type <return> to continue, or q <return> to quit---
at doveadm-mail-index.c:75
status = {messages = 5342, recent = 0, unseen = 0,
uidvalidity = 1362362144, uidnext = 43009, first_unseen_seq = 0,
first_recent_uid = 43007, last_cached_seq = 0, highest_modseq = 0,
highest_pvt_modseq = 0, keywords = 0x0, permanent_flags = 0,
permanent_keywords = 0, allow_new_keywords = 0,
nonpermanent_modseqs = 0, no_modseq_tracking = 0, have_guids = 1,
have_save_guids = 0, have_only_guid128 = 0}
trans = 0x801c3a800
search_args = 0x0
ctx = 0x801c1c040
mail = 0x801c63040
metadata = {guid = '\000' <repeats 15 times>, virtual_size
= 0,
physical_size = 0, first_save_date = 0, cache_fields = 0x0,
precache_fields = (MAIL_FETCH_STREAM_HEADER |
MAIL_FETCH_STREAM_BODY | MAIL_FETCH_RECEIVED_DATE | MAIL_FETCH_SAVE_DATE |
MAIL_FETCH_PHYSICAL_SIZE | MAIL_FETCH_VIRTUAL_SIZE |
MAIL_FETCH_UIDL_BACKEND | MAIL_FETCH_GUID | MAIL_FETCH_POP3_ORDER),
backend_ns_prefix = 0x0, backend_ns_type = (unknown: 0)}
seq = 1
counter = 1819
max = 5342
ret = 0
#23 0x0000000000433907 in cmd_index_box (ctx=0x801c2ac40, info=0x801c5f0c0)
at doveadm-mail-index.c:130
---Type <return> to continue, or q <return> to quit---
box = 0x8074edc40
status = {messages = 4294958944, recent = 32767, unseen = 14577888,
uidvalidity = 8, uidnext = 4294958944, first_unseen_seq 16809983,
first_recent_uid = 29749440, last_cached_seq = 8,
highest_modseq = 34389277760, highest_pvt_modseq 140737488346996,
keywords = 0x7fffffffdf90, permanent_flags = 18334301,
permanent_keywords = 0, allow_new_keywords = 0,
nonpermanent_modseqs = 0, no_modseq_tracking = 1, have_guids = 0,
have_save_guids = 0, have_only_guid128 = 0}
ret = 0
#24 0x00000000004335ee in cmd_index_run (_ctx=0x801c2ac40, user=0x801c45040)
at doveadm-mail-index.c:201
_data_stack_cur_id = 2
ctx = 0x801c2ac40
iter_flags = (MAILBOX_LIST_ITER_NO_AUTO_BOXES |
MAILBOX_LIST_ITER_STAR_WITHIN_NS | MAILBOX_LIST_ITER_RETURN_NO_FLAGS)
ns_mask = (MAIL_NAMESPACE_TYPE_PRIVATE | MAIL_NAMESPACE_TYPE_SHARED
| MAIL_NAMESPACE_TYPE_PUBLIC)
iter = 0x801c2bc40
info = 0x801c5f0c0
i = 32767
ret = 0
#25 0x000000000042b90a in doveadm_mail_next_user (ctx=0x801c2ac40,
cctx=0x7fffffffe350, error_r=0x7fffffffe0f8) at doveadm-mail.c:404
---Type <return> to continue, or q <return> to quit---
input = {module = 0x0, service = 0x484aa6 "doveadm",
username = 0x7fffffffef58 "mrm", session_id = 0x0,
session_id_prefix = 0x0, session_create_time = 0, local_ip = {
family = 0, u = {ip6 = {__u6_addr = {
__u6_addr8 = '\000' <repeats 15 times>,
__u6_addr16 = {0,
0,
0, 0, 0, 0, 0, 0}, __u6_addr32 = {0, 0, 0, 0}}}, ip4 = {
s_addr = 0}}}, remote_ip = {family = 0, u = {ip6 = {
__u6_addr = {__u6_addr8 = '\000' <repeats 15
times>,
__u6_addr16 = {0, 0, 0, 0, 0, 0, 0, 0}, __u6_addr32 = {0,
0,
0, 0}}}, ip4 = {s_addr = 0}}}, local_port = 0,
remote_port = 0, userdb_fields = 0x0,
flags_override_add = (unknown: 0),
flags_override_remove = (unknown: 0), no_userdb_lookup = 0,
debug = 0}
error = 0x7fffffffe420 "\200\347\377\377\377\177"
ip = 0x8011deee3 ""
ret = 0
#26 0x000000000042b5bc in doveadm_mail_single_user (ctx=0x801c2ac40,
cctx=0x7fffffffe350, error_r=0x7fffffffe0f8) at doveadm-mail.c:435
No locals.
#27 0x000000000042d50a in doveadm_mail_cmd_exec (ctx=0x801c2ac40,
cctx=0x7fffffffe350, wildcard_user=0x0) at doveadm-mail.c:596
ret = 32767
error = 0x801c2ae18 "P\256\302\001\b"
---Type <return> to continue, or q <return> to quit---
#28 0x000000000042d0a5 in doveadm_cmd_ver2_to_mail_cmd_wrapper (
cctx=0x7fffffffe350) at doveadm-mail.c:1061
mctx = 0x801c2ac40
wildcard_user = 0x0
fieldstr = 0x7fffffffe1e0 "\300\342\377\377\377\177"
pargv = {arr = {buffer = 0x801c2ae98, element_size = 8},
v = 0x801c2ae98, v_modifiable = 0x801c2ae98}
full_args = {arr = {buffer = 0x801c2ae18, element_size = 8},
v = 0x801c2ae18, v_modifiable = 0x801c2ae18}
i = 7
mail_cmd = {alloc = 0x433210 <cmd_index_alloc>,
name = 0x48da32 "index",
usage_args = 0x488030 "[-u <user>|-A] [-S
<socket_path>] [-q] [-n
<max recent>] <mailbox mask>"}
args_pos = 0
#29 0x0000000000443cfe in doveadm_cmd_run_ver2 (argc=2, argv=0x7fffffffe438,
cctx=0x7fffffffe350) at doveadm-cmd.c:523
param = 0x801c06ce0
pargv = {arr = {buffer = 0x801c06a38, element_size = 104},
v = 0x801c06a38, v_modifiable = 0x801c06a38}
opts = {arr = {buffer = 0x801c06800, element_size = 32},
v = 0x801c06800, v_modifiable = 0x801c06800}
pargc = 7
c = -1
---Type <return> to continue, or q <return> to quit---
li = 32767
pool = 0x801c06768
optbuf = 0x801c06780
#30 0x00000000004437f4 in doveadm_cmd_try_run_ver2 (
cmd_name=0x7fffffffe7a3 "index", argc=2, argv=0x7fffffffe438,
cctx=0x7fffffffe350) at doveadm-cmd.c:446
cmd = 0x801c4db98
#31 0x0000000000447f51 in main (argc=2, argv=0x7fffffffe438) at
doveadm.c:379
service_flags = (MASTER_SERVICE_FLAG_STANDALONE |
MASTER_SERVICE_FLAG_KEEP_CONFIG_OPEN)
cctx = {cmd = 0x801c4db98, argc = 7, argv = 0x801c06a70,
username = 0x7fffffffef58 "mrm", cli = true, tcp_server =
false,
local_ip = {family = 0, u = {ip6 = {__u6_addr = {
__u6_addr8 = '\000' <repeats 15 times>,
__u6_addr16 = {0,
0,
0, 0, 0, 0, 0, 0}, __u6_addr32 = {0, 0, 0, 0}}}, ip4 = {
s_addr = 0}}}, remote_ip = {family = 0, u = {ip6 = {
__u6_addr = {__u6_addr8 = '\000' <repeats 15
times>,
__u6_addr16 = {0, 0, 0, 0, 0, 0, 0, 0}, __u6_addr32 = {0,
0,
0, 0}}}, ip4 = {s_addr = 0}}}, local_port = 0,
remote_port = 0, conn = 0x0}
cmd_name = 0x7fffffffe7a3 "index"
i = 6
quick_init = false
c = -1
(gdb)
On Mon, Oct 24, 2016 at 4:34 AM, Aki Tuomi <aki.tuomi at dovecot.fi>
wrote:
> Hi!
>
> We found some problems with those patches, and ended up doing slightly
> different fix:
>
> https://github.com/dovecot/core/compare/3e41b3d%5E...cca98b.patch
>
> Aki
>
> On 24.10.2016 10:17, Aki Tuomi wrote:
> > Hi!
> >
> > Can you try these two patches?
> >
> > Aki
> >
> >
> > On 24.10.2016 08:48, Aki Tuomi wrote:
> >> Ok so that timeval makes no sense. We'll look into it.
> >>
> >> Aki
> >>
> >>> On October 24, 2016 at 12:22 AM Larry Rosenman <larryrtx at
gmail.com>
> wrote:
> >>>
> >>>
> >>> doveadm(mrm): Debug: http-client: conn 127.0.0.1:9998 [1]: Got
200
> response
> >>> for request [Req38: PUT http://localhost:9998/tika/] (took 296
ms + 8
> ms in
> >>> queue)
> >>> doveadm(mrm): Panic: kevent(): Invalid argument
> >>>
> >>> Program received signal SIGABRT, Aborted.
> >>> 0x00000008014e6f7a in thr_kill () from /lib/libc.so.7
> >>> (gdb) fr 6
> >>> #6 0x00000008011a3e49 in io_loop_handler_run_internal
> (ioloop=0x801c214e0)
> >>> at ioloop-kqueue.c:131
> >>> 131 i_panic("kevent(): %m");
> >>> (gdb) p ts
> >>> $1 = {tv_sec = 34389923520, tv_nsec = 140737488345872000}
> >>> (gdb) p errno
> >>> $2 = 22
> >>> (gdb) p ret
> >>> $3 = -1
> >>> (gdb) p *ioloop
> >>> $4 = {prev = 0x801c21080, cur_ctx = 0x0, io_files =
0x801c4f980,
> >>> next_io_file = 0x0, timeouts = 0x801d17540, timeouts_new =
{arr = {
> >>> buffer = 0x801cd9700, element_size = 8}, v =
0x801cd9700,
> >>> v_modifiable = 0x801cd9700}, handler_context =
0x801d17560,
> >>> notify_handler_context = 0x0, max_fd_count = 0,
> >>> time_moved_callback = 0x800d53bb0
<mail_storage_service_time_moved>,
> >>> next_max_time = 1477257580, ioloop_wait_usecs = 27148,
> io_pending_count > >>> 1,
> >>> running = 1, iolooping = 1}
> >>> (gdb) p* ctx
> >>> $5 = {kq = 21, deleted_count = 0, events = {arr = {buffer >
0x801cd9740,
> >>> element_size = 32}, v = 0x801cd9740, v_modifiable =
0x801cd9740}}
> >>> (gdb) p *events
> >>> $6 = {ident = 22, filter = -1, flags = 0, fflags = 0, data =
8,
> >>> udata = 0x801c4f980}
> >>> (gdb)
> >>>
> >>> thebighonker.lerctr.org ~ $ ps auxw|grep doveadm
> >>> mrm 46965 0.0 0.2 108516 55264 0 I+ 4:19PM
0:02.28
> gdb
> >>> /usr/local/bin/doveadm (gdb7111)
> >>> mrm 46985 0.0 0.0 81236 15432 0 TX 4:19PM
0:03.51
> >>> /usr/local/bin/doveadm -D -vvvvvvv index *
> >>> ler 47221 0.0 0.0 18856 2360 1 S+ 4:21PM
0:00.00
> grep
> >>> doveadm
> >>> thebighonker.lerctr.org ~ $ sudo lsof -p 46985
> >>> Password:
> >>> COMMAND PID USER FD TYPE DEVICE SIZE/OFF
NODE
> NAME
> >>> doveadm 46985 mrm cwd VDIR 22,2669215774 152
4
> >>> /home/mrm
> >>> doveadm 46985 mrm rtd VDIR 19,766509061 28
4 /
> >>> doveadm 46985 mrm txt VREG 119,3584295129 1714125
182952
> >>> /usr/local/bin/doveadm
> >>> doveadm 46985 mrm txt VREG 19,766509061 132272
14382
> >>> /libexec/ld-elf.so.1
> >>> doveadm 46985 mrm txt VREG 22,2669215774 6920
10680
> >>>
/home/mrm/mail/TRAVEL/.imap/hawaiian.airlines/dovecot.index.log
> >>> doveadm 46985 mrm txt VREG 22,2669215774 7224
10716
> >>> /home/mrm/mail/TRAVEL/.imap/priceline/dovecot.index.log
> >>> doveadm 46985 mrm txt VREG 22,2669215774 11080
10650
> >>> /home/mrm/mail/TRAVEL/.imap/alamo/dovecot.index.log
> >>> doveadm 46985 mrm txt VREG 22,2669215774 2968
10679
> >>>
/home/mrm/mail/TRAVEL/.imap/hawaiian.airlines/dovecot.index.cache
> >>> doveadm 46985 mrm txt VREG 22,2669215774 3108
10715
> >>> /home/mrm/mail/TRAVEL/.imap/priceline/dovecot.index.cache
> >>> doveadm 46985 mrm txt VREG 22,2669215774 6520
139902
> >>> /home/mrm/mail/.imap/Sent/dovecot.index.log
> >>> doveadm 46985 mrm txt VREG 22,2669215774 9236
10648
> >>> /home/mrm/mail/TRAVEL/.imap/alamo/dovecot.index.cache
> >>> doveadm 46985 mrm txt VREG 22,2669215774 174892
143343
> >>> /home/mrm/mail/.imap/Sent/dovecot.index.cache
> >>> doveadm 46985 mrm txt VREG 22,2669215774 32656
143058
> >>> /home/mrm/mail/.imap/INBOX/dovecot.index.log
> >>> doveadm 46985 mrm txt VREG 19,766509061 720
30627
> >>> /usr/share/i18n/csmapper/CP/CP1251%UCS.mps
> >>> doveadm 46985 mrm txt VREG 19,766509061 720
30630
> >>> /usr/share/i18n/csmapper/CP/CP1252%UCS.mps
> >>> doveadm 46985 mrm txt VREG 19,766509061 89576
6846
> >>> /lib/libz.so.6
> >>> doveadm 46985 mrm txt VREG 19,766509061 62008
5994
> >>> /lib/libcrypt.so.5
> >>> doveadm 46985 mrm txt VREG 119,3584295129 6725689
183611
> >>> /usr/local/lib/dovecot/libdovecot-storage.so.0.0.0
> >>> doveadm 46985 mrm txt VREG 119,3584295129 3162259
183615
> >>> /usr/local/lib/dovecot/libdovecot.so.0.0.0
> >>> doveadm 46985 mrm txt VREG 19,766509061 1649944
4782
> >>> /lib/libc.so.7
> >>> doveadm 46985 mrm txt VREG 119,3584295129 80142
183550
> >>> /usr/local/lib/dovecot/lib15_notify_plugin.so
> >>> doveadm 46985 mrm txt VREG 119,3584295129 652615
183556
> >>> /usr/local/lib/dovecot/lib20_fts_plugin.so
> >>> doveadm 46985 mrm txt VREG 119,3584295129 2730888
268825
> >>> /usr/local/lib/libicui18n.so.57.1
> >>> doveadm 46985 mrm txt VREG 119,3584295129 1753976
268849
> >>> /usr/local/lib/libicuuc.so.57.1
> >>> doveadm 46985 mrm txt VREG 119,3584295129 1704
268821
> >>> /usr/local/lib/libicudata.so.57.1
> >>> doveadm 46985 mrm txt VREG 19,766509061 102560
6745
> >>> /lib/libthr.so.3
> >>> doveadm 46985 mrm txt VREG 19,766509061 184712
5795
> >>> /lib/libm.so.5
> >>> doveadm 46985 mrm txt VREG 19,766509061 774000
5642
> >>> /usr/lib/libc++.so.1
> >>> doveadm 46985 mrm txt VREG 19,766509061 103304
5742
> >>> /lib/libcxxrt.so.1
> >>> doveadm 46985 mrm txt VREG 19,766509061 56344
7436
> >>> /lib/libgcc_s.so.1
> >>> doveadm 46985 mrm txt VREG 119,3584295129 349981
183782
> >>> /usr/local/lib/dovecot/lib21_fts_lucene_plugin.so
> >>> doveadm 46985 mrm txt VREG 119,3584295129 1969384
113258
> >>> /usr/local/lib/libclucene-core.so.2.3.3.4
> >>> doveadm 46985 mrm txt VREG 119,3584295129 128992
113261
> >>> /usr/local/lib/libclucene-shared.so.2.3.3.4
> >>> doveadm 46985 mrm txt VREG 119,3584295129 143141
183578
> >>> /usr/local/lib/dovecot/lib90_stats_plugin.so
> >>> doveadm 46985 mrm txt VREG 119,3584295129 37368
151926
> >>> /usr/local/lib/dovecot/doveadm/lib10_doveadm_sieve_plugin.so
> >>> doveadm 46985 mrm txt VREG 119,3584295129 693808
151924
> >>>
/usr/local/lib/dovecot-2.2-pigeonhole/libdovecot-sieve.so.0.0.0
> >>> doveadm 46985 mrm txt VREG 119,3584295129 146477
183599
> >>> /usr/local/lib/dovecot/libdovecot-lda.so.0.0.0
> >>> doveadm 46985 mrm txt VREG 119,3584295129 13823
183780
> >>>
/usr/local/lib/dovecot/doveadm/lib20_doveadm_fts_lucene_plugin.so
> >>> doveadm 46985 mrm txt VREG 119,3584295129 88081
183527
> >>> /usr/local/lib/dovecot/doveadm/lib20_doveadm_fts_plugin.so
> >>> doveadm 46985 mrm txt VREG 19,766509061 8304
6330
> >>> /usr/lib/i18n/libiconv_std.so.4
> >>> doveadm 46985 mrm txt VREG 19,766509061 6744
6318
> >>> /usr/lib/i18n/libUTF8.so.4
> >>> doveadm 46985 mrm txt VREG 19,766509061 4384
6336
> >>> /usr/lib/i18n/libmapper_none.so.4
> >>> doveadm 46985 mrm txt VREG 19,766509061 7584
6345
> >>> /usr/lib/i18n/libmapper_std.so.4
> >>> doveadm 46985 mrm 0u VCHR 0,188 0t390889
188
> >>> /dev/pts/0
> >>> doveadm 46985 mrm 1u VCHR 0,188 0t390889
188
> >>> /dev/pts/0
> >>> doveadm 46985 mrm 2u VCHR 0,188 0t390889
188
> >>> /dev/pts/0
> >>> doveadm 46985 mrm 3u PIPE 0xfffff806fdf505d0 16384
> >>> ->0xfffff806fdf50730
> >>> doveadm 46985 mrm 4u PIPE 0xfffff806fdf50730 0
> >>> ->0xfffff806fdf505d0
> >>> doveadm 46985 mrm 5u KQUEUE 0xfffff806350b0600
> >>> count=0, state=0
> >>> doveadm 46985 mrm 6w FIFO 163,709754999 0t0
29707
> >>> /var/run/dovecot/stats-mail
> >>> doveadm 46985 mrm 7u VREG 22,2669215774 11080
10650
> >>> /home/mrm/mail/TRAVEL/.imap/alamo/dovecot.index.log
> >>> doveadm 46985 mrm 8u VREG 22,2669215774 536
137895
> >>> /home/mrm/mail/TRAVEL/.imap/alamo/dovecot.index
> >>> doveadm 46985 mrm 9u VREG 22,2669215774 6920
10680
> >>>
/home/mrm/mail/TRAVEL/.imap/hawaiian.airlines/dovecot.index.log
> >>> doveadm 46985 mrm 10u VREG 22,2669215774 2968
10679
> >>>
/home/mrm/mail/TRAVEL/.imap/hawaiian.airlines/dovecot.index.cache
> >>> doveadm 46985 mrm 11u VREG 22,2669215774 6520
139902
> >>> /home/mrm/mail/.imap/Sent/dovecot.index.log
> >>> doveadm 46985 mrm 12u VREG 22,2669215774 9288
139905
> >>> /home/mrm/mail/.imap/Sent/dovecot.index
> >>> doveadm 46985 mrm 13u VREG 22,2669215774 7224
10716
> >>> /home/mrm/mail/TRAVEL/.imap/priceline/dovecot.index.log
> >>> doveadm 46985 mrm 14u VREG 22,2669215774 3108
10715
> >>> /home/mrm/mail/TRAVEL/.imap/priceline/dovecot.index.cache
> >>> doveadm 46985 mrm 15u VREG 22,2669215774 9236
10648
> >>> /home/mrm/mail/TRAVEL/.imap/alamo/dovecot.index.cache
> >>> doveadm 46985 mrm 16u VREG 22,2669215774 174892
143343
> >>> /home/mrm/mail/.imap/Sent/dovecot.index.cache
> >>> doveadm 46985 mrm 17u VREG 22,2669215774 32656
143058
> >>> /home/mrm/mail/.imap/INBOX/dovecot.index.log
> >>> doveadm 46985 mrm 18u VREG 22,2669215774 0
135848
> >>> /home/mrm (zroot/home/mrm)
> >>> doveadm 46985 mrm 19u VREG 22,2669215774 35656
135336
> >>> /home/mrm/mail/.imap/INBOX/dovecot.index
> >>> doveadm 46985 mrm 20u VREG 22,2669215774 0
135849
> >>> /home/mrm (zroot/home/mrm)
> >>> doveadm 46985 mrm 21u KQUEUE 0xfffff80163b1ba00
> >>> count=1, state=0
> >>> doveadm 46985 mrm 22u IPv4 0xfffff805ea69a000 0t0
TCP
> >>> localhost:44730->localhost:9998 (ESTABLISHED)
> >>> doveadm 46985 mrm 25uR VREG 22,2669215774 32997612
4151
> >>> /home/mrm/mail/Sent
> >>> thebighonker.lerctr.org
> >>>
> >>>
> >>>
> >>> On Sun, Oct 23, 2016 at 12:20 PM, Aki Tuomi <aki.tuomi at
dovecot.fi>
> wrote:
> >>>
> >>>> According to man page, the only way it can return EINVAL
(22) is
> either
> >>>> bad filter, or bad timeout. I can't see how the filter
would be bad,
> so I'm
> >>>> guessing ts must be bad. Unfortunately I forgot to ask for
it, so I am
> >>>> going to have to ask you run it again and run
> >>>>
> >>>> p ts
> >>>>
> >>>> if that's valid, then the only thing that can be bad
if the file
> >>>> descriptor 23.
> >>>>
> >>>> Aki
> >>>>
> >>>>> On October 23, 2016 at 7:42 PM Larry Rosenman
<larryrtx at gmail.com>
> >>>> wrote:
> >>>>> ok, gdb7 works:
> >>>>> (gdb) fr 6
> >>>>> #6 0x00000008011a3e49 in io_loop_handler_run_internal
> >>>> (ioloop=0x801c214e0)
> >>>>> at ioloop-kqueue.c:131
> >>>>> 131 i_panic("kevent(): %m");
> >>>>> (gdb) p errno
> >>>>> $1 = 22
> >>>>> (gdb) p ret
> >>>>> $2 = -1
> >>>>> (gdb) p *ioloop
> >>>>> $3 = {prev = 0x801c21080, cur_ctx = 0x0, io_files =
0x801c4f980,
> >>>>> next_io_file = 0x0, timeouts = 0x801c19e60,
timeouts_new = {arr > >>>> {buffer > >>>>>
0x801c5ac80, element_size = 8}, v = 0x801c5ac80,
> >>>>> v_modifiable = 0x801c5ac80}, handler_context =
0x801c19e80,
> >>>>> notify_handler_context = 0x0, max_fd_count = 0,
time_moved_callback > >>>>> 0x800d53bb0
<mail_storage_service_time_moved>,
> >>>>> next_max_time = 1477240784, ioloop_wait_usecs =
29863,
> >>>> io_pending_count > >>>>> 1, running = 1,
iolooping = 1}
> >>>>> (gdb) p *ctx
> >>>>> $4 = {kq = 22, deleted_count = 0, events = {arr =
{buffer > 0x801c5acc0,
> >>>>> element_size = 32}, v = 0x801c5acc0, v_modifiable =
0x801c5acc0}}
> >>>>> (gdb) p *events
> >>>>> $5 = {ident = 23, filter = -1, flags = 0, fflags = 0,
data = 8,
> udata > >>>>> 0x801c4f980}
> >>>>> (gdb)
> >>>>>
> >>>>>
> >>>>>
> >>>>> On Sun, Oct 23, 2016 at 11:27 AM, Larry Rosenman
<larryrtx at gmail.com
> >
> >>>> wrote:
> >>>>>> grrr.
> >>>>>>
> >>>>>> /home/mrm $ gdb /usr/local/bin/doveadm
> >>>>>> GNU gdb 6.1.1 [FreeBSD]
> >>>>>> Copyright 2004 Free Software Foundation, Inc.
> >>>>>> GDB is free software, covered by the GNU General
Public License, and
> >>>> you
> >>>>>> are
> >>>>>> welcome to change it and/or distribute copies of
it under certain
> >>>>>> conditions.
> >>>>>> Type "show copying" to see the
conditions.
> >>>>>> There is absolutely no warranty for GDB. Type
"show warranty" for
> >>>> details.
> >>>>>> This GDB was configured as
"amd64-marcel-freebsd"...
> >>>>>> (gdb) run -D -vvvvvv index *
> >>>>>> Starting program: /usr/local/bin/doveadm -D
-vvvvvv index *
> >>>>>>
> >>>>>> Program received signal SIGTRAP, Trace/breakpoint
trap.
> >>>>>> Cannot remove breakpoints because program is no
longer writable.
> >>>>>> It might be running in another process.
> >>>>>> Further execution is probably impossible.
> >>>>>> 0x0000000800624490 in ?? ()
> >>>>>> (gdb)
> >>>>>>
> >>>>>> Ideas?
> >>>>>>
> >>>>>>
> >>>>>> On Sun, Oct 23, 2016 at 11:14 AM, Aki Tuomi
<aki.tuomi at dovecot.fi>
> >>>> wrote:
> >>>>>>> Hi,
> >>>>>>>
> >>>>>>> can you run doveadm in gdb, wait for it to
crash, and then go to
> >>>> frame 6
> >>>>>>> ( io_loop_handler_run_internal) and run
> >>>>>>>
> >>>>>>> p errno
> >>>>>>> p ret
> >>>>>>> p *ioloop
> >>>>>>> p *ctx
> >>>>>>> p *events
> >>>>>>>
> >>>>>>> Sorry but the crash doesn't make enough
sense yet to me, we need to
> >>>>>>> determine what the invalid parameter is.
> >>>>>>>
> >>>>>>>> Larry Rosenman
http://www.lerctr.org/~ler
> >>>>>>>> Phone: +1 214-642-9640 (c) E-Mail:
larryrtx at gmail.com
> >>>>>>>> US Mail: 17716 Limpia Crk, Round Rock, TX
78664-7281
> >>>>>>
> >>>>>> --
> >>>>>> Larry Rosenman
http://www.lerctr.org/~ler
> >>>>>> Phone: +1 214-642-9640 (c) E-Mail: larryrtx at
gmail.com
> >>>>>> US Mail: 17716 Limpia Crk, Round Rock, TX
78664-7281
> >>>>>>
> >>>>>
> >>>>> --
> >>>>> Larry Rosenman
http://www.lerctr.org/~ler
> >>>>> Phone: +1 214-642-9640 (c) E-Mail: larryrtx at
gmail.com
> >>>>> US Mail: 17716 Limpia Crk, Round Rock, TX 78664-7281
> >>>
> >>> --
> >>> Larry Rosenman http://www.lerctr.org/~ler
> >>> Phone: +1 214-642-9640 (c) E-Mail: larryrtx at gmail.com
> >>> US Mail: 17716 Limpia Crk, Round Rock, TX 78664-7281
>
--
Larry Rosenman http://www.lerctr.org/~ler
Phone: +1 214-642-9640 (c) E-Mail: larryrtx at gmail.com
US Mail: 17716 Limpia Crk, Round Rock, TX 78664-7281
This seems to be some kind of clucene internal error. Aki On 24.10.2016 17:21, Larry Rosenman wrote:> that seems to fix this kevent() problem, but I got the following lucene > assert. Is that because of previous fails? > > Also, while I have your attention, is fts_autoindex supposed to work > accross NAMESPACES? > > doveadm(mrm): Debug: Mailbox LISTS/vse-l: Opened mail UID=39483 because: > fts indexing > doveadm(mrm): Debug: Mailbox LISTS/vse-l: Opened mail UID=39484 because: > fts indexing > doveadm(mrm): Debug: Mailbox LISTS/vse-l: Opened mail UID=39485 because: > fts indexing > doveadm(mrm): Debug: Mailbox LISTS/vse-l: Opened mail UID=39486 because: > fts indexing > Assertion failed: (numDocsInStore*8 == directory->fileLength( > (docStoreSegment + "." + IndexFileNames::FIELDS_INDEX_EXTENSION).c_str() > )), function closeDocStore, file > src/core/CLucene/index/DocumentsWriter.cpp, line 210. > > Program received signal SIGABRT, Aborted. > 0x00000008014e6f7a in thr_kill () from /lib/libc.so.7 > (gdb) bt full > #0 0x00000008014e6f7a in thr_kill () from /lib/libc.so.7 > No symbol table info available. > #1 0x00000008014e6f66 in raise () from /lib/libc.so.7 > No symbol table info available. > #2 0x00000008014e6ee9 in abort () from /lib/libc.so.7 > No symbol table info available. > #3 0x000000080154dee1 in __assert () from /lib/libc.so.7 > No symbol table info available. > #4 0x0000000803ea1762 in lucene::index::DocumentsWriter::closeDocStore() () > from /usr/local/lib/libclucene-core.so.1 > No symbol table info available. > #5 0x0000000803ea3d89 in lucene::index::DocumentsWriter::flush(bool) () > from /usr/local/lib/libclucene-core.so.1 > No symbol table info available. > #6 0x0000000803ed26bb in lucene::index::IndexWriter::doFlush(bool) () > from /usr/local/lib/libclucene-core.so.1 > No symbol table info available. > #7 0x0000000803ece25e in lucene::index::IndexWriter::flush(bool, bool) () > from /usr/local/lib/libclucene-core.so.1 > No symbol table info available. > #8 0x0000000803ececbe in > lucene::index::IndexWriter::addDocument(lucene::document::Document*, > lucene::analysis::Analyzer*) () > from /usr/local/lib/libclucene-core.so.1 > No symbol table info available. > ---Type <return> to continue, or q <return> to quit--- > #9 0x0000000803b8cd55 in lucene_index_build_flush (index=0x801c1b640) > at lucene-wrapper.cc:552 > analyzer = 0x801c251c0 > ret = 0 > err = @0x801cd90d0: { > _awhat = 0x801cd9108 "Return-Path: <m.ray.mullins+caf_=mrm> lerctr.org at gmail.com>\nDelivered-To: mrm at lerctr.org\n", > _twhat = 0x58 <error: Cannot access memory at address 0x58>, > error_number = 30249224} > #10 0x0000000803b8c42e in lucene_index_build_more (index=0x801c1b640, > uid=39486, part_idx=0, > data=0x806041000 "<m.ray.mullins+caf_=mrm=lerctr.org at gmail.com>", > size=45, > hdr_name=0x801c1a520 "Return-Path") at lucene-wrapper.cc:572 > id > L"\x1cc8c40\b\xffffd970\x7fff\xffffd960\x7fff\x1190eba\b\x1cc0c00\b\x1191739\b\x1cc8c40\b\x1190eba\b\xffffd990\x7fff-\000\000\001-" > namesize = 34378158489 > datasize = 140737488345424 > dest = 0x801190eba <i_stream_is_buffer_invalid+138> > L"\x45880124\xff458aff\xb60f0124\xc48348c0\xfc35d10\x4855001f\x8348e589\x8d4840ec\x8948e075\x8b48f07d\x8b48f07d\x8948107f\x8b48e87d\x8b48e87d\x140bf\x458b4800\x888b48e8\510\x48f92948\x1488889\x8b480000\xc748e845\x14080" > dest_free = 0x7fffffffd920 > L"\xffffd950\x7fff\x1191199\b\x1cc8c40\b\xffffd970\x7fff\xffffd960\x7fff\x1190eba\b\x1cc0c00\b\x1191739\b\x1cc8c40\b\x1190eba\b\xffffd990\x7fff-" > ---Type <return> to continue, or q <return> to quit--- > token_flag = 0 > #11 0x0000000803b8a420 in fts_backend_lucene_update_build_more ( > _ctx=0x801c21240, > data=0x806041000 "<m.ray.mullins+caf_=mrm=lerctr.org at gmail.com>", > size=45) > at fts-backend-lucene.c:432 > _data_stack_cur_id = 6 > ctx = 0x801c21240 > backend = 0x801c3a200 > ret = 8 > #12 0x000000080220e035 in fts_backend_update_build_more (ctx=0x801c21240, > data=0x806041000 "<m.ray.mullins+caf_=mrm=lerctr.org at gmail.com>", > size=45) > at fts-api.c:193 > No locals. > #13 0x000000080221015b in fts_build_full_words (ctx=0x7fffffffdc98, > data=0x806041000 "<m.ray.mullins+caf_=mrm=lerctr.org at gmail.com>", > size=45, > last=true) at fts-build-mail.c:402 > i = 45 > #14 0x000000080220fd45 in fts_build_data (ctx=0x7fffffffdc98, > data=0x806041000 "<m.ray.mullins+caf_=mrm=lerctr.org at gmail.com>", > size=45, > last=true) at fts-build-mail.c:423 > No locals. > #15 0x000000080221067d in fts_build_unstructured_header (ctx=0x7fffffffdc98, > hdr=0x801ccf118) at fts-build-mail.c:104 > data = 0x806041000 "<m.ray.mullins+caf_=mrm=lerctr.org at gmail.com>" > ---Type <return> to continue, or q <return> to quit--- > buf = 0x0 > i = 45 > ret = 18164334 > #16 0x000000080220fa54 in fts_build_mail_header (ctx=0x7fffffffdc98, > block=0x7fffffffdc40) at fts-build-mail.c:179 > hdr = 0x801ccf118 > key = {uid = 39486, type = FTS_BACKEND_BUILD_KEY_HDR, > part = 0x801c09c58, hdr_name = 0x801c4ba20 "Return-Path", > body_content_type = 0x0, body_content_disposition = 0x0} > ret = 32767 > #17 0x000000080220f292 in fts_build_mail_real (update_ctx=0x801c21240, > mail=0x801c63040) at fts-build-mail.c:548 > ctx = {mail = 0x801c63040, update_ctx = 0x801c21240, > content_type = 0x0, content_disposition = 0x0, body_parser = 0x0, > word_buf = 0x0, pending_input = 0x0, cur_user_lang = 0x0} > input = 0x801cc9030 > parser = 0x801c2f040 > decoder = 0x801ccf100 > raw_block = {part = 0x801c09c58, hdr = 0x801c53900, data = 0x0, > size = 0} > block = {part = 0x801c09c58, hdr = 0x801ccf118, > data = 0x7fffffffdc90 "0\220\314\001\b", size = 0} > prev_part = 0x801c09c58 > parts = 0x4ffffdca8 > ---Type <return> to continue, or q <return> to quit--- > skip_body = false > body_part = false > body_added = false > binary_body = 255 > error = 0x801cc88c0 "\200\212\314\001\b" > ret = 1 > #18 0x000000080220ee72 in fts_build_mail (update_ctx=0x801c21240, > mail=0x801c63040) at fts-build-mail.c:594 > _data_stack_cur_id = 5 > ret = 8 > #19 0x000000080221a626 in fts_mail_index (_mail=0x801c63040) > at fts-storage.c:503 > ft = 0x801c196e0 > flist = 0x801c5dbd8 > #20 0x0000000802217d40 in fts_mail_precache (_mail=0x801c63040) > at fts-storage.c:522 > _data_stack_cur_id = 4 > mail = 0x801c63040 > fmail = 0x801c634f0 > ft = 0x801c196e0 > #21 0x0000000800d3d992 in mail_precache (mail=0x801c63040) at mail.c:420 > _data_stack_cur_id = 3 > p = 0x801c63040 > #22 0x0000000000433b59 in cmd_index_box_precache (box=0x8074edc40) > ---Type <return> to continue, or q <return> to quit--- > at doveadm-mail-index.c:75 > status = {messages = 5342, recent = 0, unseen = 0, > uidvalidity = 1362362144, uidnext = 43009, first_unseen_seq = 0, > first_recent_uid = 43007, last_cached_seq = 0, highest_modseq = 0, > highest_pvt_modseq = 0, keywords = 0x0, permanent_flags = 0, > permanent_keywords = 0, allow_new_keywords = 0, > nonpermanent_modseqs = 0, no_modseq_tracking = 0, have_guids = 1, > have_save_guids = 0, have_only_guid128 = 0} > trans = 0x801c3a800 > search_args = 0x0 > ctx = 0x801c1c040 > mail = 0x801c63040 > metadata = {guid = '\000' <repeats 15 times>, virtual_size = 0, > physical_size = 0, first_save_date = 0, cache_fields = 0x0, > precache_fields = (MAIL_FETCH_STREAM_HEADER | > MAIL_FETCH_STREAM_BODY | MAIL_FETCH_RECEIVED_DATE | MAIL_FETCH_SAVE_DATE | > MAIL_FETCH_PHYSICAL_SIZE | MAIL_FETCH_VIRTUAL_SIZE | > MAIL_FETCH_UIDL_BACKEND | MAIL_FETCH_GUID | MAIL_FETCH_POP3_ORDER), > backend_ns_prefix = 0x0, backend_ns_type = (unknown: 0)} > seq = 1 > counter = 1819 > max = 5342 > ret = 0 > #23 0x0000000000433907 in cmd_index_box (ctx=0x801c2ac40, info=0x801c5f0c0) > at doveadm-mail-index.c:130 > ---Type <return> to continue, or q <return> to quit--- > box = 0x8074edc40 > status = {messages = 4294958944, recent = 32767, unseen = 14577888, > uidvalidity = 8, uidnext = 4294958944, first_unseen_seq > 16809983, > first_recent_uid = 29749440, last_cached_seq = 8, > highest_modseq = 34389277760, highest_pvt_modseq > 140737488346996, > keywords = 0x7fffffffdf90, permanent_flags = 18334301, > permanent_keywords = 0, allow_new_keywords = 0, > nonpermanent_modseqs = 0, no_modseq_tracking = 1, have_guids = 0, > have_save_guids = 0, have_only_guid128 = 0} > ret = 0 > #24 0x00000000004335ee in cmd_index_run (_ctx=0x801c2ac40, user=0x801c45040) > at doveadm-mail-index.c:201 > _data_stack_cur_id = 2 > ctx = 0x801c2ac40 > iter_flags = (MAILBOX_LIST_ITER_NO_AUTO_BOXES | > MAILBOX_LIST_ITER_STAR_WITHIN_NS | MAILBOX_LIST_ITER_RETURN_NO_FLAGS) > ns_mask = (MAIL_NAMESPACE_TYPE_PRIVATE | MAIL_NAMESPACE_TYPE_SHARED > | MAIL_NAMESPACE_TYPE_PUBLIC) > iter = 0x801c2bc40 > info = 0x801c5f0c0 > i = 32767 > ret = 0 > #25 0x000000000042b90a in doveadm_mail_next_user (ctx=0x801c2ac40, > cctx=0x7fffffffe350, error_r=0x7fffffffe0f8) at doveadm-mail.c:404 > ---Type <return> to continue, or q <return> to quit--- > input = {module = 0x0, service = 0x484aa6 "doveadm", > username = 0x7fffffffef58 "mrm", session_id = 0x0, > session_id_prefix = 0x0, session_create_time = 0, local_ip = { > family = 0, u = {ip6 = {__u6_addr = { > __u6_addr8 = '\000' <repeats 15 times>, __u6_addr16 = {0, > 0, > 0, 0, 0, 0, 0, 0}, __u6_addr32 = {0, 0, 0, 0}}}, ip4 = { > s_addr = 0}}}, remote_ip = {family = 0, u = {ip6 = { > __u6_addr = {__u6_addr8 = '\000' <repeats 15 times>, > __u6_addr16 = {0, 0, 0, 0, 0, 0, 0, 0}, __u6_addr32 = {0, > 0, > 0, 0}}}, ip4 = {s_addr = 0}}}, local_port = 0, > remote_port = 0, userdb_fields = 0x0, > flags_override_add = (unknown: 0), > flags_override_remove = (unknown: 0), no_userdb_lookup = 0, > debug = 0} > error = 0x7fffffffe420 "\200\347\377\377\377\177" > ip = 0x8011deee3 "" > ret = 0 > #26 0x000000000042b5bc in doveadm_mail_single_user (ctx=0x801c2ac40, > cctx=0x7fffffffe350, error_r=0x7fffffffe0f8) at doveadm-mail.c:435 > No locals. > #27 0x000000000042d50a in doveadm_mail_cmd_exec (ctx=0x801c2ac40, > cctx=0x7fffffffe350, wildcard_user=0x0) at doveadm-mail.c:596 > ret = 32767 > error = 0x801c2ae18 "P\256\302\001\b" > ---Type <return> to continue, or q <return> to quit--- > #28 0x000000000042d0a5 in doveadm_cmd_ver2_to_mail_cmd_wrapper ( > cctx=0x7fffffffe350) at doveadm-mail.c:1061 > mctx = 0x801c2ac40 > wildcard_user = 0x0 > fieldstr = 0x7fffffffe1e0 "\300\342\377\377\377\177" > pargv = {arr = {buffer = 0x801c2ae98, element_size = 8}, > v = 0x801c2ae98, v_modifiable = 0x801c2ae98} > full_args = {arr = {buffer = 0x801c2ae18, element_size = 8}, > v = 0x801c2ae18, v_modifiable = 0x801c2ae18} > i = 7 > mail_cmd = {alloc = 0x433210 <cmd_index_alloc>, > name = 0x48da32 "index", > usage_args = 0x488030 "[-u <user>|-A] [-S <socket_path>] [-q] [-n > <max recent>] <mailbox mask>"} > args_pos = 0 > #29 0x0000000000443cfe in doveadm_cmd_run_ver2 (argc=2, argv=0x7fffffffe438, > cctx=0x7fffffffe350) at doveadm-cmd.c:523 > param = 0x801c06ce0 > pargv = {arr = {buffer = 0x801c06a38, element_size = 104}, > v = 0x801c06a38, v_modifiable = 0x801c06a38} > opts = {arr = {buffer = 0x801c06800, element_size = 32}, > v = 0x801c06800, v_modifiable = 0x801c06800} > pargc = 7 > c = -1 > ---Type <return> to continue, or q <return> to quit--- > li = 32767 > pool = 0x801c06768 > optbuf = 0x801c06780 > #30 0x00000000004437f4 in doveadm_cmd_try_run_ver2 ( > cmd_name=0x7fffffffe7a3 "index", argc=2, argv=0x7fffffffe438, > cctx=0x7fffffffe350) at doveadm-cmd.c:446 > cmd = 0x801c4db98 > #31 0x0000000000447f51 in main (argc=2, argv=0x7fffffffe438) at > doveadm.c:379 > service_flags = (MASTER_SERVICE_FLAG_STANDALONE | > MASTER_SERVICE_FLAG_KEEP_CONFIG_OPEN) > cctx = {cmd = 0x801c4db98, argc = 7, argv = 0x801c06a70, > username = 0x7fffffffef58 "mrm", cli = true, tcp_server = false, > local_ip = {family = 0, u = {ip6 = {__u6_addr = { > __u6_addr8 = '\000' <repeats 15 times>, __u6_addr16 = {0, > 0, > 0, 0, 0, 0, 0, 0}, __u6_addr32 = {0, 0, 0, 0}}}, ip4 = { > s_addr = 0}}}, remote_ip = {family = 0, u = {ip6 = { > __u6_addr = {__u6_addr8 = '\000' <repeats 15 times>, > __u6_addr16 = {0, 0, 0, 0, 0, 0, 0, 0}, __u6_addr32 = {0, > 0, > 0, 0}}}, ip4 = {s_addr = 0}}}, local_port = 0, > remote_port = 0, conn = 0x0} > cmd_name = 0x7fffffffe7a3 "index" > i = 6 > quick_init = false > c = -1 > (gdb) > > On Mon, Oct 24, 2016 at 4:34 AM, Aki Tuomi <aki.tuomi at dovecot.fi> wrote: > >> Hi! >> >> We found some problems with those patches, and ended up doing slightly >> different fix: >> >> https://github.com/dovecot/core/compare/3e41b3d%5E...cca98b.patch >> >> Aki >> >> On 24.10.2016 10:17, Aki Tuomi wrote: >>> Hi! >>> >>> Can you try these two patches? >>> >>> Aki >>> >>> >>> On 24.10.2016 08:48, Aki Tuomi wrote: >>>> Ok so that timeval makes no sense. We'll look into it. >>>> >>>> Aki >>>> >>>>> On October 24, 2016 at 12:22 AM Larry Rosenman <larryrtx at gmail.com> >> wrote: >>>>> >>>>> doveadm(mrm): Debug: http-client: conn 127.0.0.1:9998 [1]: Got 200 >> response >>>>> for request [Req38: PUT http://localhost:9998/tika/] (took 296 ms + 8 >> ms in >>>>> queue) >>>>> doveadm(mrm): Panic: kevent(): Invalid argument >>>>> >>>>> Program received signal SIGABRT, Aborted. >>>>> 0x00000008014e6f7a in thr_kill () from /lib/libc.so.7 >>>>> (gdb) fr 6 >>>>> #6 0x00000008011a3e49 in io_loop_handler_run_internal >> (ioloop=0x801c214e0) >>>>> at ioloop-kqueue.c:131 >>>>> 131 i_panic("kevent(): %m"); >>>>> (gdb) p ts >>>>> $1 = {tv_sec = 34389923520, tv_nsec = 140737488345872000} >>>>> (gdb) p errno >>>>> $2 = 22 >>>>> (gdb) p ret >>>>> $3 = -1 >>>>> (gdb) p *ioloop >>>>> $4 = {prev = 0x801c21080, cur_ctx = 0x0, io_files = 0x801c4f980, >>>>> next_io_file = 0x0, timeouts = 0x801d17540, timeouts_new = {arr = { >>>>> buffer = 0x801cd9700, element_size = 8}, v = 0x801cd9700, >>>>> v_modifiable = 0x801cd9700}, handler_context = 0x801d17560, >>>>> notify_handler_context = 0x0, max_fd_count = 0, >>>>> time_moved_callback = 0x800d53bb0 <mail_storage_service_time_moved>, >>>>> next_max_time = 1477257580, ioloop_wait_usecs = 27148, >> io_pending_count >>>>> 1, >>>>> running = 1, iolooping = 1} >>>>> (gdb) p* ctx >>>>> $5 = {kq = 21, deleted_count = 0, events = {arr = {buffer >> 0x801cd9740, >>>>> element_size = 32}, v = 0x801cd9740, v_modifiable = 0x801cd9740}} >>>>> (gdb) p *events >>>>> $6 = {ident = 22, filter = -1, flags = 0, fflags = 0, data = 8, >>>>> udata = 0x801c4f980} >>>>> (gdb) >>>>> >>>>> thebighonker.lerctr.org ~ $ ps auxw|grep doveadm >>>>> mrm 46965 0.0 0.2 108516 55264 0 I+ 4:19PM 0:02.28 >> gdb >>>>> /usr/local/bin/doveadm (gdb7111) >>>>> mrm 46985 0.0 0.0 81236 15432 0 TX 4:19PM 0:03.51 >>>>> /usr/local/bin/doveadm -D -vvvvvvv index * >>>>> ler 47221 0.0 0.0 18856 2360 1 S+ 4:21PM 0:00.00 >> grep >>>>> doveadm >>>>> thebighonker.lerctr.org ~ $ sudo lsof -p 46985 >>>>> Password: >>>>> COMMAND PID USER FD TYPE DEVICE SIZE/OFF NODE >> NAME >>>>> doveadm 46985 mrm cwd VDIR 22,2669215774 152 4 >>>>> /home/mrm >>>>> doveadm 46985 mrm rtd VDIR 19,766509061 28 4 / >>>>> doveadm 46985 mrm txt VREG 119,3584295129 1714125 182952 >>>>> /usr/local/bin/doveadm >>>>> doveadm 46985 mrm txt VREG 19,766509061 132272 14382 >>>>> /libexec/ld-elf.so.1 >>>>> doveadm 46985 mrm txt VREG 22,2669215774 6920 10680 >>>>> /home/mrm/mail/TRAVEL/.imap/hawaiian.airlines/dovecot.index.log >>>>> doveadm 46985 mrm txt VREG 22,2669215774 7224 10716 >>>>> /home/mrm/mail/TRAVEL/.imap/priceline/dovecot.index.log >>>>> doveadm 46985 mrm txt VREG 22,2669215774 11080 10650 >>>>> /home/mrm/mail/TRAVEL/.imap/alamo/dovecot.index.log >>>>> doveadm 46985 mrm txt VREG 22,2669215774 2968 10679 >>>>> /home/mrm/mail/TRAVEL/.imap/hawaiian.airlines/dovecot.index.cache >>>>> doveadm 46985 mrm txt VREG 22,2669215774 3108 10715 >>>>> /home/mrm/mail/TRAVEL/.imap/priceline/dovecot.index.cache >>>>> doveadm 46985 mrm txt VREG 22,2669215774 6520 139902 >>>>> /home/mrm/mail/.imap/Sent/dovecot.index.log >>>>> doveadm 46985 mrm txt VREG 22,2669215774 9236 10648 >>>>> /home/mrm/mail/TRAVEL/.imap/alamo/dovecot.index.cache >>>>> doveadm 46985 mrm txt VREG 22,2669215774 174892 143343 >>>>> /home/mrm/mail/.imap/Sent/dovecot.index.cache >>>>> doveadm 46985 mrm txt VREG 22,2669215774 32656 143058 >>>>> /home/mrm/mail/.imap/INBOX/dovecot.index.log >>>>> doveadm 46985 mrm txt VREG 19,766509061 720 30627 >>>>> /usr/share/i18n/csmapper/CP/CP1251%UCS.mps >>>>> doveadm 46985 mrm txt VREG 19,766509061 720 30630 >>>>> /usr/share/i18n/csmapper/CP/CP1252%UCS.mps >>>>> doveadm 46985 mrm txt VREG 19,766509061 89576 6846 >>>>> /lib/libz.so.6 >>>>> doveadm 46985 mrm txt VREG 19,766509061 62008 5994 >>>>> /lib/libcrypt.so.5 >>>>> doveadm 46985 mrm txt VREG 119,3584295129 6725689 183611 >>>>> /usr/local/lib/dovecot/libdovecot-storage.so.0.0.0 >>>>> doveadm 46985 mrm txt VREG 119,3584295129 3162259 183615 >>>>> /usr/local/lib/dovecot/libdovecot.so.0.0.0 >>>>> doveadm 46985 mrm txt VREG 19,766509061 1649944 4782 >>>>> /lib/libc.so.7 >>>>> doveadm 46985 mrm txt VREG 119,3584295129 80142 183550 >>>>> /usr/local/lib/dovecot/lib15_notify_plugin.so >>>>> doveadm 46985 mrm txt VREG 119,3584295129 652615 183556 >>>>> /usr/local/lib/dovecot/lib20_fts_plugin.so >>>>> doveadm 46985 mrm txt VREG 119,3584295129 2730888 268825 >>>>> /usr/local/lib/libicui18n.so.57.1 >>>>> doveadm 46985 mrm txt VREG 119,3584295129 1753976 268849 >>>>> /usr/local/lib/libicuuc.so.57.1 >>>>> doveadm 46985 mrm txt VREG 119,3584295129 1704 268821 >>>>> /usr/local/lib/libicudata.so.57.1 >>>>> doveadm 46985 mrm txt VREG 19,766509061 102560 6745 >>>>> /lib/libthr.so.3 >>>>> doveadm 46985 mrm txt VREG 19,766509061 184712 5795 >>>>> /lib/libm.so.5 >>>>> doveadm 46985 mrm txt VREG 19,766509061 774000 5642 >>>>> /usr/lib/libc++.so.1 >>>>> doveadm 46985 mrm txt VREG 19,766509061 103304 5742 >>>>> /lib/libcxxrt.so.1 >>>>> doveadm 46985 mrm txt VREG 19,766509061 56344 7436 >>>>> /lib/libgcc_s.so.1 >>>>> doveadm 46985 mrm txt VREG 119,3584295129 349981 183782 >>>>> /usr/local/lib/dovecot/lib21_fts_lucene_plugin.so >>>>> doveadm 46985 mrm txt VREG 119,3584295129 1969384 113258 >>>>> /usr/local/lib/libclucene-core.so.2.3.3.4 >>>>> doveadm 46985 mrm txt VREG 119,3584295129 128992 113261 >>>>> /usr/local/lib/libclucene-shared.so.2.3.3.4 >>>>> doveadm 46985 mrm txt VREG 119,3584295129 143141 183578 >>>>> /usr/local/lib/dovecot/lib90_stats_plugin.so >>>>> doveadm 46985 mrm txt VREG 119,3584295129 37368 151926 >>>>> /usr/local/lib/dovecot/doveadm/lib10_doveadm_sieve_plugin.so >>>>> doveadm 46985 mrm txt VREG 119,3584295129 693808 151924 >>>>> /usr/local/lib/dovecot-2.2-pigeonhole/libdovecot-sieve.so.0.0.0 >>>>> doveadm 46985 mrm txt VREG 119,3584295129 146477 183599 >>>>> /usr/local/lib/dovecot/libdovecot-lda.so.0.0.0 >>>>> doveadm 46985 mrm txt VREG 119,3584295129 13823 183780 >>>>> /usr/local/lib/dovecot/doveadm/lib20_doveadm_fts_lucene_plugin.so >>>>> doveadm 46985 mrm txt VREG 119,3584295129 88081 183527 >>>>> /usr/local/lib/dovecot/doveadm/lib20_doveadm_fts_plugin.so >>>>> doveadm 46985 mrm txt VREG 19,766509061 8304 6330 >>>>> /usr/lib/i18n/libiconv_std.so.4 >>>>> doveadm 46985 mrm txt VREG 19,766509061 6744 6318 >>>>> /usr/lib/i18n/libUTF8.so.4 >>>>> doveadm 46985 mrm txt VREG 19,766509061 4384 6336 >>>>> /usr/lib/i18n/libmapper_none.so.4 >>>>> doveadm 46985 mrm txt VREG 19,766509061 7584 6345 >>>>> /usr/lib/i18n/libmapper_std.so.4 >>>>> doveadm 46985 mrm 0u VCHR 0,188 0t390889 188 >>>>> /dev/pts/0 >>>>> doveadm 46985 mrm 1u VCHR 0,188 0t390889 188 >>>>> /dev/pts/0 >>>>> doveadm 46985 mrm 2u VCHR 0,188 0t390889 188 >>>>> /dev/pts/0 >>>>> doveadm 46985 mrm 3u PIPE 0xfffff806fdf505d0 16384 >>>>> ->0xfffff806fdf50730 >>>>> doveadm 46985 mrm 4u PIPE 0xfffff806fdf50730 0 >>>>> ->0xfffff806fdf505d0 >>>>> doveadm 46985 mrm 5u KQUEUE 0xfffff806350b0600 >>>>> count=0, state=0 >>>>> doveadm 46985 mrm 6w FIFO 163,709754999 0t0 29707 >>>>> /var/run/dovecot/stats-mail >>>>> doveadm 46985 mrm 7u VREG 22,2669215774 11080 10650 >>>>> /home/mrm/mail/TRAVEL/.imap/alamo/dovecot.index.log >>>>> doveadm 46985 mrm 8u VREG 22,2669215774 536 137895 >>>>> /home/mrm/mail/TRAVEL/.imap/alamo/dovecot.index >>>>> doveadm 46985 mrm 9u VREG 22,2669215774 6920 10680 >>>>> /home/mrm/mail/TRAVEL/.imap/hawaiian.airlines/dovecot.index.log >>>>> doveadm 46985 mrm 10u VREG 22,2669215774 2968 10679 >>>>> /home/mrm/mail/TRAVEL/.imap/hawaiian.airlines/dovecot.index.cache >>>>> doveadm 46985 mrm 11u VREG 22,2669215774 6520 139902 >>>>> /home/mrm/mail/.imap/Sent/dovecot.index.log >>>>> doveadm 46985 mrm 12u VREG 22,2669215774 9288 139905 >>>>> /home/mrm/mail/.imap/Sent/dovecot.index >>>>> doveadm 46985 mrm 13u VREG 22,2669215774 7224 10716 >>>>> /home/mrm/mail/TRAVEL/.imap/priceline/dovecot.index.log >>>>> doveadm 46985 mrm 14u VREG 22,2669215774 3108 10715 >>>>> /home/mrm/mail/TRAVEL/.imap/priceline/dovecot.index.cache >>>>> doveadm 46985 mrm 15u VREG 22,2669215774 9236 10648 >>>>> /home/mrm/mail/TRAVEL/.imap/alamo/dovecot.index.cache >>>>> doveadm 46985 mrm 16u VREG 22,2669215774 174892 143343 >>>>> /home/mrm/mail/.imap/Sent/dovecot.index.cache >>>>> doveadm 46985 mrm 17u VREG 22,2669215774 32656 143058 >>>>> /home/mrm/mail/.imap/INBOX/dovecot.index.log >>>>> doveadm 46985 mrm 18u VREG 22,2669215774 0 135848 >>>>> /home/mrm (zroot/home/mrm) >>>>> doveadm 46985 mrm 19u VREG 22,2669215774 35656 135336 >>>>> /home/mrm/mail/.imap/INBOX/dovecot.index >>>>> doveadm 46985 mrm 20u VREG 22,2669215774 0 135849 >>>>> /home/mrm (zroot/home/mrm) >>>>> doveadm 46985 mrm 21u KQUEUE 0xfffff80163b1ba00 >>>>> count=1, state=0 >>>>> doveadm 46985 mrm 22u IPv4 0xfffff805ea69a000 0t0 TCP >>>>> localhost:44730->localhost:9998 (ESTABLISHED) >>>>> doveadm 46985 mrm 25uR VREG 22,2669215774 32997612 4151 >>>>> /home/mrm/mail/Sent >>>>> thebighonker.lerctr.org >>>>> >>>>> >>>>> >>>>> On Sun, Oct 23, 2016 at 12:20 PM, Aki Tuomi <aki.tuomi at dovecot.fi> >> wrote: >>>>>> According to man page, the only way it can return EINVAL (22) is >> either >>>>>> bad filter, or bad timeout. I can't see how the filter would be bad, >> so I'm >>>>>> guessing ts must be bad. Unfortunately I forgot to ask for it, so I am >>>>>> going to have to ask you run it again and run >>>>>> >>>>>> p ts >>>>>> >>>>>> if that's valid, then the only thing that can be bad if the file >>>>>> descriptor 23. >>>>>> >>>>>> Aki >>>>>> >>>>>>> On October 23, 2016 at 7:42 PM Larry Rosenman <larryrtx at gmail.com> >>>>>> wrote: >>>>>>> ok, gdb7 works: >>>>>>> (gdb) fr 6 >>>>>>> #6 0x00000008011a3e49 in io_loop_handler_run_internal >>>>>> (ioloop=0x801c214e0) >>>>>>> at ioloop-kqueue.c:131 >>>>>>> 131 i_panic("kevent(): %m"); >>>>>>> (gdb) p errno >>>>>>> $1 = 22 >>>>>>> (gdb) p ret >>>>>>> $2 = -1 >>>>>>> (gdb) p *ioloop >>>>>>> $3 = {prev = 0x801c21080, cur_ctx = 0x0, io_files = 0x801c4f980, >>>>>>> next_io_file = 0x0, timeouts = 0x801c19e60, timeouts_new = {arr >>>>>> {buffer >>>>>>> 0x801c5ac80, element_size = 8}, v = 0x801c5ac80, >>>>>>> v_modifiable = 0x801c5ac80}, handler_context = 0x801c19e80, >>>>>>> notify_handler_context = 0x0, max_fd_count = 0, time_moved_callback >>>>>>> 0x800d53bb0 <mail_storage_service_time_moved>, >>>>>>> next_max_time = 1477240784, ioloop_wait_usecs = 29863, >>>>>> io_pending_count >>>>>>> 1, running = 1, iolooping = 1} >>>>>>> (gdb) p *ctx >>>>>>> $4 = {kq = 22, deleted_count = 0, events = {arr = {buffer >> 0x801c5acc0, >>>>>>> element_size = 32}, v = 0x801c5acc0, v_modifiable = 0x801c5acc0}} >>>>>>> (gdb) p *events >>>>>>> $5 = {ident = 23, filter = -1, flags = 0, fflags = 0, data = 8, >> udata >>>>>>> 0x801c4f980} >>>>>>> (gdb) >>>>>>> >>>>>>> >>>>>>> >>>>>>> On Sun, Oct 23, 2016 at 11:27 AM, Larry Rosenman <larryrtx at gmail.com >>>>>> wrote: >>>>>>>> grrr. >>>>>>>> >>>>>>>> /home/mrm $ gdb /usr/local/bin/doveadm >>>>>>>> GNU gdb 6.1.1 [FreeBSD] >>>>>>>> Copyright 2004 Free Software Foundation, Inc. >>>>>>>> GDB is free software, covered by the GNU General Public License, and >>>>>> you >>>>>>>> are >>>>>>>> welcome to change it and/or distribute copies of it under certain >>>>>>>> conditions. >>>>>>>> Type "show copying" to see the conditions. >>>>>>>> There is absolutely no warranty for GDB. Type "show warranty" for >>>>>> details. >>>>>>>> This GDB was configured as "amd64-marcel-freebsd"... >>>>>>>> (gdb) run -D -vvvvvv index * >>>>>>>> Starting program: /usr/local/bin/doveadm -D -vvvvvv index * >>>>>>>> >>>>>>>> Program received signal SIGTRAP, Trace/breakpoint trap. >>>>>>>> Cannot remove breakpoints because program is no longer writable. >>>>>>>> It might be running in another process. >>>>>>>> Further execution is probably impossible. >>>>>>>> 0x0000000800624490 in ?? () >>>>>>>> (gdb) >>>>>>>> >>>>>>>> Ideas? >>>>>>>> >>>>>>>> >>>>>>>> On Sun, Oct 23, 2016 at 11:14 AM, Aki Tuomi <aki.tuomi at dovecot.fi> >>>>>> wrote: >>>>>>>>> Hi, >>>>>>>>> >>>>>>>>> can you run doveadm in gdb, wait for it to crash, and then go to >>>>>> frame 6 >>>>>>>>> ( io_loop_handler_run_internal) and run >>>>>>>>> >>>>>>>>> p errno >>>>>>>>> p ret >>>>>>>>> p *ioloop >>>>>>>>> p *ctx >>>>>>>>> p *events >>>>>>>>> >>>>>>>>> Sorry but the crash doesn't make enough sense yet to me, we need to >>>>>>>>> determine what the invalid parameter is. >>>>>>>>> >>>>>>>>>> Larry Rosenman http://www.lerctr.org/~ler >>>>>>>>>> Phone: +1 214-642-9640 (c) E-Mail: larryrtx at gmail.com >>>>>>>>>> US Mail: 17716 Limpia Crk, Round Rock, TX 78664-7281 >>>>>>>> -- >>>>>>>> Larry Rosenman http://www.lerctr.org/~ler >>>>>>>> Phone: +1 214-642-9640 (c) E-Mail: larryrtx at gmail.com >>>>>>>> US Mail: 17716 Limpia Crk, Round Rock, TX 78664-7281 >>>>>>>> >>>>>>> -- >>>>>>> Larry Rosenman http://www.lerctr.org/~ler >>>>>>> Phone: +1 214-642-9640 (c) E-Mail: larryrtx at gmail.com >>>>>>> US Mail: 17716 Limpia Crk, Round Rock, TX 78664-7281 >>>>> -- >>>>> Larry Rosenman http://www.lerctr.org/~ler >>>>> Phone: +1 214-642-9640 (c) E-Mail: larryrtx at gmail.com >>>>> US Mail: 17716 Limpia Crk, Round Rock, TX 78664-7281 > >