Thanks for mySql For Squat vs Solr, Solr does not reach Squat by very far in terms of results : If I setup Solr, and search (via the search in Roundbube or Evolution) for a keyword or part of the keyword, the results are complete non sense. The diference between "search in full body" and "search in fields" does not even work. Solr with Dovecot seems very early beta isnt'it ? On 2018-12-04 15:57, Aki Tuomi wrote:> On 04 December 2018 at 16:46 Joan Moreau via dovecot <dovecot at dovecot.org> wrote: > > Hi > > How to solve this ? > > So many similar segfaults > > Thank you > > On 2018-11-30 06:11, Joan Moreau wrote: > > ANother (very very long) example : > > # gdb /usr/libexec/dovecot/indexer-worker core.indexer-worker.0.3a33f56105e043de802a7dfcee265a07.21017.1543533424000000 > GNU gdb (GDB) 8.2 > Copyright (C) 2018 Free Software Foundation, Inc. > License GPLv3+: GNU GPL version 3 or later <http://gnu.org/licenses/gpl.html> > This is free software: you are free to change and redistribute it. > There is NO WARRANTY, to the extent permitted by law. > Type "show copying" and "show warranty" for details. > This GDB was configured as "x86_64-pc-linux-gnu". > Type "show configuration" for configuration details. > For bug reporting instructions, please see: > <http://www.gnu.org/software/gdb/bugs/>. > Find the GDB manual and other documentation resources online at: > <http://www.gnu.org/software/gdb/documentation/>. > > For help, type "help". > Type "apropos word" to search for commands related to "word"... > Reading symbols from /usr/libexec/dovecot/indexer-worker...done. > [New LWP 21017] > [Thread debugging using libthread_db enabled] > Using host libthread_db library "/usr/lib/libthread_db.so.1". > Core was generated by `dovecot/indexer-worker'. > Program terminated with signal SIGSEGV, Segmentation fault. > #0 0x00007f768b62b13e in file_lock_do (fd=18, path=0x564540376790 "/data/mail/grosjo.net/admin/mailboxes/QoS/dbox-Mails/dovecot.index.search", lock_type=0, > lock_method=FILE_LOCK_METHOD_FCNTL, timeout_secs=60, error_r=0x7fff045010b0) at file-lock.c:173 > 173 { > (gdb) bt full > #0 0x00007f768b62b13e in file_lock_do (fd=18, path=0x564540376790 "/data/mail/grosjo.net/admin/mailboxes/QoS/dbox-Mails/dovecot.index.search", lock_type=0, > lock_method=FILE_LOCK_METHOD_FCNTL, timeout_secs=60, error_r=0x7fff045010b0) at file-lock.c:173 > lock_type_str = <optimized out> > started = <optimized out> > ret = <optimized out> > __func__ = "file_lock_do" > #1 0x00007f768b62b5b6 in file_wait_lock_error (fd=18, path=0x564540376790 "/data/mail/grosjo.net/admin/mailboxes/QoS/dbox-Mails/dovecot.index.search", lock_type=0, > lock_method=FILE_LOCK_METHOD_FCNTL, timeout_secs=<optimized out>, lock_r=0x7fff04501118, error_r=0x7fff045010b0) at file-lock.c:318 > lock = <optimized out> > ret = <optimized out> > #2 0x00007f768b62b660 in file_wait_lock (fd=<optimized out>, path=<optimized out>, lock_type=lock_type at entry=0, lock_method=<optimized out>, timeout_secs=timeout_secs at entry=60, > lock_r=lock_r at entry=0x7fff04501118) at file-lock.c:303 > error = 0x564540376490 "" > ret = <optimized out> > #3 0x00007f768a976c87 in squat_trie_lock (trie=0x564540376490, lock_type=0, file_lock_r=0x7fff04501118, dotlock_r=0x7fff04501120) at squat-trie.c:294 > ret = <optimized out> > dotlock_r = 0x7fff04501120 > file_lock_r = 0x7fff04501118 > trie = 0x564540376490 > ret = <optimized out> > __func__ = "squat_trie_lock" > lock_type = 0 > ret = <optimized out> > __func__ = "squat_trie_lock" > #4 0x00007f768a978627 in squat_trie_map (trie=0x564540376490, building=<optimized out>) at squat-trie.c:1487 > file_lock = 0x0 > dotlock = 0x0 > changed = <optimized out> > ret = <optimized out> > #5 0x00007f768a97b19d in squat_uidlist_map_header (uidlist=0x5645403767f0) at squat-uidlist.c:378 > No locals. > #6 squat_uidlist_map (uidlist=0x5645403767f0) at squat-uidlist.c:477 > mmap_hdr = <optimized out> > ret = <optimized out> > #7 0x00007f768a97b432 in squat_uidlist_open (uidlist=0x5645403767f0) at squat-uidlist.c:546 > No locals. > #8 0x00007f768a97b5aa in squat_uidlist_refresh (uidlist=<optimized out>) at squat-uidlist.c:569 > No locals. > #9 0x00007f768a9787c2 in squat_trie_map (trie=0x564540376490, building=<optimized out>) at squat-trie.c:1526 > file_lock = 0x56454210c850 > dotlock = 0x0 > changed = <optimized out> > ret = <optimized out> > #10 0x00007f768a97b19d in squat_uidlist_map_header (uidlist=0x5645403767f0) at squat-uidlist.c:378 > No locals. > #11 squat_uidlist_map (uidlist=0x5645403767f0) at squat-uidlist.c:477 > mmap_hdr = <optimized out> > ret = <optimized out> > #12 0x00007f768a97b432 in squat_uidlist_open (uidlist=0x5645403767f0) at squat-uidlist.c:546 > No locals. > #13 0x00007f768a97b5aa in squat_uidlist_refresh (uidlist=<optimized out>) at squat-uidlist.c:569 > No locals. > #14 0x00007f768a9787c2 in squat_trie_map (trie=0x564540376490, building=<optimized out>) at squat-trie.c:1526 > file_lock = 0x56454210c7b0 > dotlock = 0x0 > changed = <optimized out> > ret = <optimized out> > #15 0x00007f768a97b19d in squat_uidlist_map_header (uidlist=0x5645403767f0) at squat-uidlist.c:378 > No locals. > #16 squat_uidlist_map (uidlist=0x5645403767f0) at squat-uidlist.c:477 > mmap_hdr = <optimized out> > ret = <optimized out> > #17 0x00007f768a97b432 in squat_uidlist_open (uidlist=0x5645403767f0) at squat-uidlist.c:546 > No locals. > #18 0x00007f768a97b5aa in squat_uidlist_refresh (uidlist=<optimized out>) at squat-uidlist.c:569 > No locals. > #19 0x00007f768a9787c2 in squat_trie_map (trie=0x564540376490, building=<optimized out>) at squat-trie.c:1526 > file_lock = 0x56454210c710 > dotlock = 0x0 > changed = <optimized out> > ret = <optimized out> > #20 0x00007f768a97b19d in squat_uidlist_map_header (uidlist=0x5645403767f0) at squat-uidlist.c:378 > No locals. > #21 squat_uidlist_map (uidlist=0x5645403767f0) at squat-uidlist.c:477 > mmap_hdr = <optimized out> > ret = <optimized out> > #22 0x00007f768a97b432 in squat_uidlist_open (uidlist=0x5645403767f0) at squat-uidlist.c:546 > No locals. > #23 0x00007f768a97b5aa in squat_uidlist_refresh (uidlist=<optimized out>) at squat-uidlist.c:569 > No locals. > #24 0x00007f768a9787c2 in squat_trie_map (trie=0x564540376490, building=<optimized out>) at squat-trie.c:1526 > file_lock = 0x56454210c670 > dotlock = 0x0 > changed = <optimized out> > ret = <optimized out> > #25 0x00007f768a97b19d in squat_uidlist_map_header (uidlist=0x5645403767f0) at squat-uidlist.c:378 > No locals. > #26 squat_uidlist_map (uidlist=0x5645403767f0) at squat-uidlist.c:477 > mmap_hdr = <optimized out> > ret = <optimized out> > #27 0x00007f768a97b432 in squat_uidlist_open (uidlist=0x5645403767f0) at squat-uidlist.c:546 > No locals. > #28 0x00007f768a97b5aa in squat_uidlist_refresh (uidlist=<optimized out>) at squat-uidlist.c:569 > No locals. > #29 0x00007f768a9787c2 in squat_trie_map (trie=0x564540376490, building=<optimized out>) at squat-trie.c:1526 > file_lock = 0x56454210c5d0 > dotlock = 0x0 > changed = <optimized out> > ret = <optimized out> > #30 0x00007f768a97b19d in squat_uidlist_map_header (uidlist=0x5645403767f0) at squat-uidlist.c:378 > No locals. > #31 squat_uidlist_map (uidlist=0x5645403767f0) at squat-uidlist.c:477 > mmap_hdr = <optimized out> > ret = <optimized out> > #32 0x00007f768a97b432 in squat_uidlist_open (uidlist=0x5645403767f0) at squat-uidlist.c:546 > No locals. > #33 0x00007f768a97b5aa in squat_uidlist_refresh (uidlist=<optimized out>) at squat-uidlist.c:569 > No locals. > #34 0x00007f768a9787c2 in squat_trie_map (trie=0x564540376490, building=<optimized out>) at squat-trie.c:1526 > file_lock = 0x56454210c530 > dotlock = 0x0 > changed = <optimized out> > ret = <optimized out> > #35 0x00007f768a97b19d in squat_uidlist_map_header (uidlist=0x5645403767f0) at squat-uidlist.c:378 > No locals. > #36 squat_uidlist_map (uidlist=0x5645403767f0) at squat-uidlist.c:477 > mmap_hdr = <optimized out> > ret = <optimized out> > #37 0x00007f768a97b432 in squat_uidlist_open (uidlist=0x5645403767f0) at squat-uidlist.c:546 > No locals. > #38 0x00007f768a97b5aa in squat_uidlist_refresh (uidlist=<optimized out>) at squat-uidlist.c:569 > No locals. > #39 0x00007f768a9787c2 in squat_trie_map (trie=0x564540376490, building=<optimized out>) at squat-trie.c:1526 > file_lock = 0x56454210c490 > dotlock = 0x0 > changed = <optimized out> > ret = <optimized out> > #40 0x00007f768a97b19d in squat_uidlist_map_header (uidlist=0x5645403767f0) at squat-uidlist.c:378 > No locals. > #41 squat_uidlist_map (uidlist=0x5645403767f0) at squat-uidlist.c:477 > mmap_hdr = <optimized out> > ret = <optimized out> > #42 0x00007f768a97b432 in squat_uidlist_open (uidlist=0x5645403767f0) at squat-uidlist.c:546 > No locals. > #43 0x00007f768a97b5aa in squat_uidlist_refresh (uidlist=<optimized out>) at squat-uidlist.c:569 > No locals. > #44 0x00007f768a9787c2 in squat_trie_map (trie=0x564540376490, building=<optimized out>) at squat-trie.c:1526 > file_lock = 0x56454210c3f0 > dotlock = 0x0 > changed = <optimized out> > ret = <optimized out> > #45 0x00007f768a97b19d in squat_uidlist_map_header (uidlist=0x5645403767f0) at squat-uidlist.c:378 > No locals. > #46 squat_uidlist_map (uidlist=0x5645403767f0) at squat-uidlist.c:477 > mmap_hdr = <optimized out> > ret = <optimized out> > #47 0x00007f768a97b432 in squat_uidlist_open (uidlist=0x5645403767f0) at squat-uidlist.c:546 > No locals. > #48 0x00007f768a97b5aa in squat_uidlist_refresh (uidlist=<optimized out>) at squat-uidlist.c:569 > No locals. > #49 0x00007f768a9787c2 in squat_trie_map (trie=0x564540376490, building=<optimized out>) at squat-trie.c:1526 > file_lock = 0x56454210c350 > dotlock = 0x0 > changed = <optimized out> > ret = <optimized out> > #50 0x00007f768a97b19d in squat_uidlist_map_header (uidlist=0x5645403767f0) at squat-uidlist.c:378 > #51 squat_uidlist_map (uidlist=0x5645403767f0) at squat-uidlist.c:477 > mmap_hdr = <optimized out> > ret = <optimized out> > #52 0x00007f768a97b432 in squat_uidlist_open (uidlist=0x5645403767f0) at squat-uidlist.c:546 > No locals. > #53 0x00007f768a97b5aa in squat_uidlist_refresh (uidlist=<optimized out>) at squat-uidlist.c:569 > No locals. > #54 0x00007f768a9787c2 in squat_trie_map (trie=0x564540376490, building=<optimized out>) at squat-trie.c:1526 > file_lock = 0x56454210c2b0 > dotlock = 0x0 > changed = <optimized out> > ret = <optimized out> > #55 0x00007f768a97b19d in squat_uidlist_map_header (uidlist=0x5645403767f0) at squat-uidlist.c:378 > No locals. > #56 squat_uidlist_map (uidlist=0x5645403767f0) at squat-uidlist.c:477 > mmap_hdr = <optimized out> > ret = <optimized out> > #57 0x00007f768a97b432 in squat_uidlist_open (uidlist=0x5645403767f0) at squat-uidlist.c:546 > No locals. > #58 0x00007f768a97b5aa in squat_uidlist_refresh (uidlist=<optimized out>) at squat-uidlist.c:569 > No locals. > #59 0x00007f768a9787c2 in squat_trie_map (trie=0x564540376490, building=<optimized out>) at squat-trie.c:1526 > file_lock = 0x56454210c210 > dotlock = 0x0 > changed = <optimized out> > ret = <optimized out> > #60 0x00007f768a97b19d in squat_uidlist_map_header (uidlist=0x5645403767f0) at squat-uidlist.c:378 > No locals. > #61 squat_uidlist_map (uidlist=0x5645403767f0) at squat-uidlist.c:477 > mmap_hdr = <optimized out> > ret = <optimized out> > #62 0x00007f768a97b432 in squat_uidlist_open (uidlist=0x5645403767f0) at squat-uidlist.c:546 > No locals. > #63 0x00007f768a97b5aa in squat_uidlist_refresh (uidlist=<optimized out>) at squat-uidlist.c:569 > No locals. > #64 0x00007f768a9787c2 in squat_trie_map (trie=0x564540376490, building=<optimized out>) at squat-trie.c:1526 > file_lock = 0x56454210c170 > dotlock = 0x0 > changed = <optimized out> > ret = <optimized out> > #65 0x00007f768a97b19d in squat_uidlist_map_header (uidlist=0x5645403767f0) at squat-uidlist.c:378 > No locals. > #66 squat_uidlist_map (uidlist=0x5645403767f0) at squat-uidlist.c:477 > mmap_hdr = <optimized out> > ret = <optimized out> > #67 0x00007f768a97b432 in squat_uidlist_open (uidlist=0x5645403767f0) at squat-uidlist.c:546 > No locals. > #68 0x00007f768a97b5aa in squat_uidlist_refresh (uidlist=<optimized out>) at squat-uidlist.c:569 > No locals. > #69 0x00007f768a9787c2 in squat_trie_map (trie=0x564540376490, building=<optimized out>) at squat-trie.c:1526 > file_lock = 0x56454210c0d0 > dotlock = 0x0 > changed = <optimized out> > ret = <optimized out> > #70 0x00007f768a97b19d in squat_uidlist_map_header (uidlist=0x5645403767f0) at squat-uidlist.c:378 > No locals. > #71 squat_uidlist_map (uidlist=0x5645403767f0) at squat-uidlist.c:477 > mmap_hdr = <optimized out> > ret = <optimized out> > #72 0x00007f768a97b432 in squat_uidlist_open (uidlist=0x5645403767f0) at squat-uidlist.c:546 > No locals. > #73 0x00007f768a97b5aa in squat_uidlist_refresh (uidlist=<optimized out>) at squat-uidlist.c:569 > No locals. > #74 0x00007f768a9787c2 in squat_trie_map (trie=0x564540376490, building=<optimized out>) at squat-trie.c:1526 > file_lock = 0x56454210c030 > dotlock = 0x0 > changed = <optimized out> > ret = <optimized out> > #75 0x00007f768a97b19d in squat_uidlist_map_header (uidlist=0x5645403767f0) at squat-uidlist.c:378 > No locals. > #76 squat_uidlist_map (uidlist=0x5645403767f0) at squat-uidlist.c:477 > mmap_hdr = <optimized out> > ret = <optimized out> > #77 0x00007f768a97b432 in squat_uidlist_open (uidlist=0x5645403767f0) at squat-uidlist.c:546 > No locals. > #78 0x00007f768a97b5aa in squat_uidlist_refresh (uidlist=<optimized out>) at squat-uidlist.c:569 > No locals. > #79 0x00007f768a9787c2 in squat_trie_map (trie=0x564540376490, building=<optimized out>) at squat-trie.c:1526 > file_lock = 0x56454210bf90 > dotlock = 0x0 > changed = <optimized out> > ret = <optimized out> > #80 0x00007f768a97b19d in squat_uidlist_map_header (uidlist=0x5645403767f0) at squat-uidlist.c:378 > No locals. > #81 squat_uidlist_map (uidlist=0x5645403767f0) at squat-uidlist.c:477 > mmap_hdr = <optimized out> > ret = <optimized out> > #82 0x00007f768a97b432 in squat_uidlist_open (uidlist=0x5645403767f0) at squat-uidlist.c:546 > No locals. > #83 0x00007f768a97b5aa in squat_uidlist_refresh (uidlist=<optimized out>) at squat-uidlist.c:569 > No locals. > #84 0x00007f768a9787c2 in squat_trie_map (trie=0x564540376490, building=<optimized out>) at squat-trie.c:1526 > file_lock = 0x56454210bef0 > dotlock = 0x0 > changed = <optimized out> > ret = <optimized out> > #85 0x00007f768a97b19d in squat_uidlist_map_header (uidlist=0x5645403767f0) at squat-uidlist.c:378 > No locals. > #86 squat_uidlist_map (uidlist=0x5645403767f0) at squat-uidlist.c:477 > mmap_hdr = <optimized out> > ret = <optimized out> > #87 0x00007f768a97b432 in squat_uidlist_open (uidlist=0x5645403767f0) at squat-uidlist.c:546 > No locals. > #88 0x00007f768a97b5aa in squat_uidlist_refresh (uidlist=<optimized out>) at squat-uidlist.c:569 > No locals. > #89 0x00007f768a9787c2 in squat_trie_map (trie=0x564540376490, building=<optimized out>) at squat-trie.c:1526 > file_lock = 0x56454210be50 > dotlock = 0x0 > changed = <optimized out> > ret = <optimized out> > #90 0x00007f768a97b19d in squat_uidlist_map_header (uidlist=0x5645403767f0) at squat-uidlist.c:378 > No locals. > #91 squat_uidlist_map (uidlist=0x5645403767f0) at squat-uidlist.c:477 > mmap_hdr = <optimized out> > ret = <optimized out> > #92 0x00007f768a97b432 in squat_uidlist_open (uidlist=0x5645403767f0) at squat-uidlist.c:546 > No locals. > #93 0x00007f768a97b5aa in squat_uidlist_refresh (uidlist=<optimized out>) at squat-uidlist.c:569 > No locals. > #94 0x00007f768a9787c2 in squat_trie_map (trie=0x564540376490, building=<optimized out>) at squat-trie.c:1526 > file_lock = 0x56454210bdb0 > dotlock = 0x0 > changed = <optimized out> > ret = <optimized out> > #95 0x00007f768a97b19d in squat_uidlist_map_header (uidlist=0x5645403767f0) at squat-uidlist.c:378 > No locals. > #96 squat_uidlist_map (uidlist=0x5645403767f0) at squat-uidlist.c:477 > mmap_hdr = <optimized out> > ret = <optimized out> > #97 0x00007f768a97b432 in squat_uidlist_open (uidlist=0x5645403767f0) at squat-uidlist.c:546 > No locals. > #98 0x00007f768a97b5aa in squat_uidlist_refresh (uidlist=<optimized out>) at squat-uidlist.c:569 > No locals. > #99 0x00007f768a9787c2 in squat_trie_map (trie=0x564540376490, building=<optimized out>) at squat-trie.c:1526 > file_lock = 0x56454210bd10 > dotlock = 0x0 > changed = <optimized out> > ret = <optimized out> > #100 0x00007f768a97b19d in squat_uidlist_map_header (uidlist=0x5645403767f0) at squat-uidlist.c:378 > No locals. > #101 squat_uidlist_map (uidlist=0x5645403767f0) at squat-uidlist.c:477 > mmap_hdr = <optimized out> > ret = <optimized out> > #102 0x00007f768a97b432 in squat_uidlist_open (uidlist=0x5645403767f0) at squat-uidlist.c:546 > No locals. > #103 0x00007f768a97b5aa in squat_uidlist_refresh (uidlist=<optimized out>) at squat-uidlist.c:569 > No locals. > #104 0x00007f768a9787c2 in squat_trie_map (trie=0x564540376490, building=<optimized out>) at squat-trie.c:1526 > file_lock = 0x56454210bc70 > dotlock = 0x0 > changed = <optimized out> > ret = <optimized out> > #105 0x00007f768a97b19d in squat_uidlist_map_header (uidlist=0x5645403767f0) at squat-uidlist.c:378 > No locals. > #106 squat_uidlist_map (uidlist=0x5645403767f0) at squat-uidlist.c:477 > mmap_hdr = <optimized out> > ret = <optimized out> > #107 0x00007f768a97b432 in squat_uidlist_open (uidlist=0x5645403767f0) at squat-uidlist.c:546 > No locals. > #108 0x00007f768a97b5aa in squat_uidlist_refresh (uidlist=<optimized out>) at squat-uidlist.c:569 > No locals. > #109 0x00007f768a9787c2 in squat_trie_map (trie=0x564540376490, building=<optimized out>) at squat-trie.c:1526 > file_lock = 0x56454210bbd0 > dotlock = 0x0 > changed = <optimized out> > ret = <optimized out> > #110 0x00007f768a97b19d in squat_uidlist_map_header (uidlist=0x5645403767f0) at squat-uidlist.c:378 > No locals. > #111 squat_uidlist_map (uidlist=0x5645403767f0) at squat-uidlist.c:477 > mmap_hdr = <optimized out> > ret = <optimized out> > #112 0x00007f768a97b432 in squat_uidlist_open (uidlist=0x5645403767f0) at squat-uidlist.c:546 > No locals. > #113 0x00007f768a97b5aa in squat_uidlist_refresh (uidlist=<optimized out>) at squat-uidlist.c:569 > No locals. > #114 0x00007f768a9787c2 in squat_trie_map (trie=0x564540376490, building=<optimized out>) at squat-trie.c:1526 > file_lock = 0x56454210bb30 > dotlock = 0x0 > changed = <optimized out> > ret = <optimized out> > #115 0x00007f768a97b19d in squat_uidlist_map_header (uidlist=0x5645403767f0) at squat-uidlist.c:378 > No locals. > #116 squat_uidlist_map (uidlist=0x5645403767f0) at squat-uidlist.c:477 > mmap_hdr = <optimized out> > ret = <optimized out> > #117 0x00007f768a97b432 in squat_uidlist_open (uidlist=0x5645403767f0) at squat-uidlist.c:546 > No locals. > #118 0x00007f768a97b5aa in squat_uidlist_refresh (uidlist=<optimized out>) at squat-uidlist.c:569 > No locals. > #119 0x00007f768a9787c2 in squat_trie_map (trie=0x564540376490, building=<optimized out>) at squat-trie.c:1526 > file_lock = 0x56454210ba90 > dotlock = 0x0 > changed = <optimized out> > ret = <optimized out> > #120 0x00007f768a97b19d in squat_uidlist_map_header (uidlist=0x5645403767f0) at squat-uidlist.c:378 > No locals. > #121 squat_uidlist_map (uidlist=0x5645403767f0) at squat-uidlist.c:477 > mmap_hdr = <optimized out> > ret = <optimized out> > #122 0x00007f768a97b432 in squat_uidlist_open (uidlist=0x5645403767f0) at squat-uidlist.c:546 > No locals. > #123 0x00007f768a97b5aa in squat_uidlist_refresh (uidlist=<optimized out>) at squat-uidlist.c:569 > No locals. > #124 0x00007f768a9787c2 in squat_trie_map (trie=0x564540376490, building=<optimized out>) at squat-trie.c:1526 > file_lock = 0x56454210b9f0 > dotlock = 0x0 > changed = <optimized out> > > (continues for ages) > > On 2018-11-29 19:36, Joan Moreau wrote: > > finally managed to locate the dump > > here the output: > > # gdb /usr/libexec/dovecot/auth /var/lib/systemd/coredump/core.auth.0.3a33f56105e043de802a7dfcee265a07.28130.1543516118000000 > GNU gdb (GDB) 8.2 > (gdb) bt full > #0 0x00007f739c35cd7f in raise () from /usr/lib/libc.so.6 > No symbol table info available. > #1 0x00007f739c347672 in abort () from /usr/lib/libc.so.6 > No symbol table info available. > #2 0x00007f739c39f878 in __libc_message () from /usr/lib/libc.so.6 > No symbol table info available. > #3 0x00007f739c3a618a in malloc_printerr () from /usr/lib/libc.so.6 > No symbol table info available. > #4 0x00007f739c3a7b27 in _int_free () from /usr/lib/libc.so.6 > No symbol table info available. > #5 0x00007f739cc33585 in mysql_close (mysql=0x5636af7abdc0) at /usr/src/mariadb-10.3.11/libmariadb/libmariadb/mariadb_lib.c:1939 > mysql = 0x5636af7abdc0 > p = <optimized out> > p = <optimized out> > #6 0x00005636aef08f7c in driver_sqlpool_disconnect (_db=0x5636af7aaf30) at driver-sqlpool.c:590 > conn__foreach_end = 0x5636af7ab570 > db = 0x5636af7aaf30 > conn = 0x5636af7ab560 > #7 0x00005636aeefed65 in db_sql_unref (_conn=0x5636af7b0020) at db-sql.c:128 > conn = 0x5636af7ae388 > #8 0x00005636aeef7e15 in userdb_deinit (userdb=0x5636af7afff8) at userdb.c:191 > idx = 0 > __func__ = "userdb_deinit" > #9 0x00005636aeede209 in auth_deinit (auth=0x5636af7afd58) at auth.c:335 > passdb = <optimized out> > userdb = 0x5636af7aff18 > passdb = <optimized out> > userdb = <optimized out> > #10 auths_deinit () at auth.c:433 > auth__foreach_end = 0x5636af7ae2f8 > auth = 0x5636af7ae2f0 > #11 0x00005636aeedcf65 in main_deinit () at main.c:270 > l = <optimized out> > l = <optimized out> > l_end = <optimized out> > #12 main (argc=<optimized out>, argv=<optimized out>) at main.c:401 > c = <optimized out>On 27.11.2018 8.39, Joan Moreau wrote: Thank you Aki here the requested data (below) Please not as well that we have numerous subfolders (>50) and pretty big mailbox sizes (>20G) Bug appears mostly in auth process and index-worker dovecot -n : # 2.4.devel (de42b54aa): /etc/dovecot/dovecot.conf # Pigeonhole version 0.6.devel (65909cfa) # OS: Linux 4.19.4-arch1-1-ARCH x86_64 ext4 # Hostname: gjserver base_dir = /run/dovecot default_login_user = dovecot default_vsz_limit = 16 G disable_plaintext_auth = no listen = * log_path = /var/log/mail/dovecot.log mail_gid = mail mail_location = mdbox:/data/mail/%d/%n:ALT=/data/mail/archives/%d/%n mail_plugins = fts fts_squat mail_uid = mailusers managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate mime foreverypart extracttext mdbox_rotate_size = 24 M (...) passdb { args = /etc/dovecot/dovecot-sql.conf driver = sql } (the rest default values) fts squat was already deprecated in 2.2, and it's considered obsolete in 2.3. We hopefully get around removing it from 2.4, but you should move away from it to Solr. The MySQL crash has been fixed in master, see https://github.com/dovecot/core/commit/3c5101ffdd2a8115e03ed7180d53578765dea4c9.patch Aki -------------- next part -------------- An HTML attachment was scrubbed... URL: <https://dovecot.org/pipermail/dovecot/attachments/20181204/5b277eef/attachment-0001.html>
We don't consider it as "very early beta". We consider it production ready. It is bit more work to set up though. Aki> On 04 December 2018 at 17:16 Joan Moreau <jom at grosjo.net> wrote: > > > Thanks for mySql > > For Squat vs Solr, Solr does not reach Squat by very far in terms of > results : If I setup Solr, and search (via the search in Roundbube or > Evolution) for a keyword or part of the keyword, the results are > complete non sense. The diference between "search in full body" and > "search in fields" does not even work. > > Solr with Dovecot seems very early beta isnt'it ? > > On 2018-12-04 15:57, Aki Tuomi wrote: > > > On 04 December 2018 at 16:46 Joan Moreau via dovecot <dovecot at dovecot.org> wrote: > > > > Hi > > > > How to solve this ? > > > > So many similar segfaults > > > > Thank you > > > > On 2018-11-30 06:11, Joan Moreau wrote: > > > > ANother (very very long) example : > > > > # gdb /usr/libexec/dovecot/indexer-worker core.indexer-worker.0.3a33f56105e043de802a7dfcee265a07.21017.1543533424000000 > > GNU gdb (GDB) 8.2 > > Copyright (C) 2018 Free Software Foundation, Inc. > > License GPLv3+: GNU GPL version 3 or later <http://gnu.org/licenses/gpl.html> > > This is free software: you are free to change and redistribute it. > > There is NO WARRANTY, to the extent permitted by law. > > Type "show copying" and "show warranty" for details. > > This GDB was configured as "x86_64-pc-linux-gnu". > > Type "show configuration" for configuration details. > > For bug reporting instructions, please see: > > <http://www.gnu.org/software/gdb/bugs/>. > > Find the GDB manual and other documentation resources online at: > > <http://www.gnu.org/software/gdb/documentation/>. > > > > For help, type "help". > > Type "apropos word" to search for commands related to "word"... > > Reading symbols from /usr/libexec/dovecot/indexer-worker...done. > > [New LWP 21017] > > [Thread debugging using libthread_db enabled] > > Using host libthread_db library "/usr/lib/libthread_db.so.1". > > Core was generated by `dovecot/indexer-worker'. > > Program terminated with signal SIGSEGV, Segmentation fault. > > #0 0x00007f768b62b13e in file_lock_do (fd=18, path=0x564540376790 "/data/mail/grosjo.net/admin/mailboxes/QoS/dbox-Mails/dovecot.index.search", lock_type=0, > > lock_method=FILE_LOCK_METHOD_FCNTL, timeout_secs=60, error_r=0x7fff045010b0) at file-lock.c:173 > > 173 { > > (gdb) bt full > > #0 0x00007f768b62b13e in file_lock_do (fd=18, path=0x564540376790 "/data/mail/grosjo.net/admin/mailboxes/QoS/dbox-Mails/dovecot.index.search", lock_type=0, > > lock_method=FILE_LOCK_METHOD_FCNTL, timeout_secs=60, error_r=0x7fff045010b0) at file-lock.c:173 > > lock_type_str = <optimized out> > > started = <optimized out> > > ret = <optimized out> > > __func__ = "file_lock_do" > > #1 0x00007f768b62b5b6 in file_wait_lock_error (fd=18, path=0x564540376790 "/data/mail/grosjo.net/admin/mailboxes/QoS/dbox-Mails/dovecot.index.search", lock_type=0, > > lock_method=FILE_LOCK_METHOD_FCNTL, timeout_secs=<optimized out>, lock_r=0x7fff04501118, error_r=0x7fff045010b0) at file-lock.c:318 > > lock = <optimized out> > > ret = <optimized out> > > #2 0x00007f768b62b660 in file_wait_lock (fd=<optimized out>, path=<optimized out>, lock_type=lock_type at entry=0, lock_method=<optimized out>, timeout_secs=timeout_secs at entry=60, > > lock_r=lock_r at entry=0x7fff04501118) at file-lock.c:303 > > error = 0x564540376490 "" > > ret = <optimized out> > > #3 0x00007f768a976c87 in squat_trie_lock (trie=0x564540376490, lock_type=0, file_lock_r=0x7fff04501118, dotlock_r=0x7fff04501120) at squat-trie.c:294 > > ret = <optimized out> > > dotlock_r = 0x7fff04501120 > > file_lock_r = 0x7fff04501118 > > trie = 0x564540376490 > > ret = <optimized out> > > __func__ = "squat_trie_lock" > > lock_type = 0 > > ret = <optimized out> > > __func__ = "squat_trie_lock" > > #4 0x00007f768a978627 in squat_trie_map (trie=0x564540376490, building=<optimized out>) at squat-trie.c:1487 > > file_lock = 0x0 > > dotlock = 0x0 > > changed = <optimized out> > > ret = <optimized out> > > #5 0x00007f768a97b19d in squat_uidlist_map_header (uidlist=0x5645403767f0) at squat-uidlist.c:378 > > No locals. > > #6 squat_uidlist_map (uidlist=0x5645403767f0) at squat-uidlist.c:477 > > mmap_hdr = <optimized out> > > ret = <optimized out> > > #7 0x00007f768a97b432 in squat_uidlist_open (uidlist=0x5645403767f0) at squat-uidlist.c:546 > > No locals. > > #8 0x00007f768a97b5aa in squat_uidlist_refresh (uidlist=<optimized out>) at squat-uidlist.c:569 > > No locals. > > #9 0x00007f768a9787c2 in squat_trie_map (trie=0x564540376490, building=<optimized out>) at squat-trie.c:1526 > > file_lock = 0x56454210c850 > > dotlock = 0x0 > > changed = <optimized out> > > ret = <optimized out> > > #10 0x00007f768a97b19d in squat_uidlist_map_header (uidlist=0x5645403767f0) at squat-uidlist.c:378 > > No locals. > > #11 squat_uidlist_map (uidlist=0x5645403767f0) at squat-uidlist.c:477 > > mmap_hdr = <optimized out> > > ret = <optimized out> > > #12 0x00007f768a97b432 in squat_uidlist_open (uidlist=0x5645403767f0) at squat-uidlist.c:546 > > No locals. > > #13 0x00007f768a97b5aa in squat_uidlist_refresh (uidlist=<optimized out>) at squat-uidlist.c:569 > > No locals. > > #14 0x00007f768a9787c2 in squat_trie_map (trie=0x564540376490, building=<optimized out>) at squat-trie.c:1526 > > file_lock = 0x56454210c7b0 > > dotlock = 0x0 > > changed = <optimized out> > > ret = <optimized out> > > #15 0x00007f768a97b19d in squat_uidlist_map_header (uidlist=0x5645403767f0) at squat-uidlist.c:378 > > No locals. > > #16 squat_uidlist_map (uidlist=0x5645403767f0) at squat-uidlist.c:477 > > mmap_hdr = <optimized out> > > ret = <optimized out> > > #17 0x00007f768a97b432 in squat_uidlist_open (uidlist=0x5645403767f0) at squat-uidlist.c:546 > > No locals. > > #18 0x00007f768a97b5aa in squat_uidlist_refresh (uidlist=<optimized out>) at squat-uidlist.c:569 > > No locals. > > #19 0x00007f768a9787c2 in squat_trie_map (trie=0x564540376490, building=<optimized out>) at squat-trie.c:1526 > > file_lock = 0x56454210c710 > > dotlock = 0x0 > > changed = <optimized out> > > ret = <optimized out> > > #20 0x00007f768a97b19d in squat_uidlist_map_header (uidlist=0x5645403767f0) at squat-uidlist.c:378 > > No locals. > > #21 squat_uidlist_map (uidlist=0x5645403767f0) at squat-uidlist.c:477 > > mmap_hdr = <optimized out> > > ret = <optimized out> > > #22 0x00007f768a97b432 in squat_uidlist_open (uidlist=0x5645403767f0) at squat-uidlist.c:546 > > No locals. > > #23 0x00007f768a97b5aa in squat_uidlist_refresh (uidlist=<optimized out>) at squat-uidlist.c:569 > > No locals. > > #24 0x00007f768a9787c2 in squat_trie_map (trie=0x564540376490, building=<optimized out>) at squat-trie.c:1526 > > file_lock = 0x56454210c670 > > dotlock = 0x0 > > changed = <optimized out> > > ret = <optimized out> > > #25 0x00007f768a97b19d in squat_uidlist_map_header (uidlist=0x5645403767f0) at squat-uidlist.c:378 > > No locals. > > #26 squat_uidlist_map (uidlist=0x5645403767f0) at squat-uidlist.c:477 > > mmap_hdr = <optimized out> > > ret = <optimized out> > > #27 0x00007f768a97b432 in squat_uidlist_open (uidlist=0x5645403767f0) at squat-uidlist.c:546 > > No locals. > > #28 0x00007f768a97b5aa in squat_uidlist_refresh (uidlist=<optimized out>) at squat-uidlist.c:569 > > No locals. > > #29 0x00007f768a9787c2 in squat_trie_map (trie=0x564540376490, building=<optimized out>) at squat-trie.c:1526 > > file_lock = 0x56454210c5d0 > > dotlock = 0x0 > > changed = <optimized out> > > ret = <optimized out> > > #30 0x00007f768a97b19d in squat_uidlist_map_header (uidlist=0x5645403767f0) at squat-uidlist.c:378 > > No locals. > > #31 squat_uidlist_map (uidlist=0x5645403767f0) at squat-uidlist.c:477 > > mmap_hdr = <optimized out> > > ret = <optimized out> > > #32 0x00007f768a97b432 in squat_uidlist_open (uidlist=0x5645403767f0) at squat-uidlist.c:546 > > No locals. > > #33 0x00007f768a97b5aa in squat_uidlist_refresh (uidlist=<optimized out>) at squat-uidlist.c:569 > > No locals. > > #34 0x00007f768a9787c2 in squat_trie_map (trie=0x564540376490, building=<optimized out>) at squat-trie.c:1526 > > file_lock = 0x56454210c530 > > dotlock = 0x0 > > changed = <optimized out> > > ret = <optimized out> > > #35 0x00007f768a97b19d in squat_uidlist_map_header (uidlist=0x5645403767f0) at squat-uidlist.c:378 > > No locals. > > #36 squat_uidlist_map (uidlist=0x5645403767f0) at squat-uidlist.c:477 > > mmap_hdr = <optimized out> > > ret = <optimized out> > > #37 0x00007f768a97b432 in squat_uidlist_open (uidlist=0x5645403767f0) at squat-uidlist.c:546 > > No locals. > > #38 0x00007f768a97b5aa in squat_uidlist_refresh (uidlist=<optimized out>) at squat-uidlist.c:569 > > No locals. > > #39 0x00007f768a9787c2 in squat_trie_map (trie=0x564540376490, building=<optimized out>) at squat-trie.c:1526 > > file_lock = 0x56454210c490 > > dotlock = 0x0 > > changed = <optimized out> > > ret = <optimized out> > > #40 0x00007f768a97b19d in squat_uidlist_map_header (uidlist=0x5645403767f0) at squat-uidlist.c:378 > > No locals. > > #41 squat_uidlist_map (uidlist=0x5645403767f0) at squat-uidlist.c:477 > > mmap_hdr = <optimized out> > > ret = <optimized out> > > #42 0x00007f768a97b432 in squat_uidlist_open (uidlist=0x5645403767f0) at squat-uidlist.c:546 > > No locals. > > #43 0x00007f768a97b5aa in squat_uidlist_refresh (uidlist=<optimized out>) at squat-uidlist.c:569 > > No locals. > > #44 0x00007f768a9787c2 in squat_trie_map (trie=0x564540376490, building=<optimized out>) at squat-trie.c:1526 > > file_lock = 0x56454210c3f0 > > dotlock = 0x0 > > changed = <optimized out> > > ret = <optimized out> > > #45 0x00007f768a97b19d in squat_uidlist_map_header (uidlist=0x5645403767f0) at squat-uidlist.c:378 > > No locals. > > #46 squat_uidlist_map (uidlist=0x5645403767f0) at squat-uidlist.c:477 > > mmap_hdr = <optimized out> > > ret = <optimized out> > > #47 0x00007f768a97b432 in squat_uidlist_open (uidlist=0x5645403767f0) at squat-uidlist.c:546 > > No locals. > > #48 0x00007f768a97b5aa in squat_uidlist_refresh (uidlist=<optimized out>) at squat-uidlist.c:569 > > No locals. > > #49 0x00007f768a9787c2 in squat_trie_map (trie=0x564540376490, building=<optimized out>) at squat-trie.c:1526 > > file_lock = 0x56454210c350 > > dotlock = 0x0 > > changed = <optimized out> > > ret = <optimized out> > > #50 0x00007f768a97b19d in squat_uidlist_map_header (uidlist=0x5645403767f0) at squat-uidlist.c:378 > > #51 squat_uidlist_map (uidlist=0x5645403767f0) at squat-uidlist.c:477 > > mmap_hdr = <optimized out> > > ret = <optimized out> > > #52 0x00007f768a97b432 in squat_uidlist_open (uidlist=0x5645403767f0) at squat-uidlist.c:546 > > No locals. > > #53 0x00007f768a97b5aa in squat_uidlist_refresh (uidlist=<optimized out>) at squat-uidlist.c:569 > > No locals. > > #54 0x00007f768a9787c2 in squat_trie_map (trie=0x564540376490, building=<optimized out>) at squat-trie.c:1526 > > file_lock = 0x56454210c2b0 > > dotlock = 0x0 > > changed = <optimized out> > > ret = <optimized out> > > #55 0x00007f768a97b19d in squat_uidlist_map_header (uidlist=0x5645403767f0) at squat-uidlist.c:378 > > No locals. > > #56 squat_uidlist_map (uidlist=0x5645403767f0) at squat-uidlist.c:477 > > mmap_hdr = <optimized out> > > ret = <optimized out> > > #57 0x00007f768a97b432 in squat_uidlist_open (uidlist=0x5645403767f0) at squat-uidlist.c:546 > > No locals. > > #58 0x00007f768a97b5aa in squat_uidlist_refresh (uidlist=<optimized out>) at squat-uidlist.c:569 > > No locals. > > #59 0x00007f768a9787c2 in squat_trie_map (trie=0x564540376490, building=<optimized out>) at squat-trie.c:1526 > > file_lock = 0x56454210c210 > > dotlock = 0x0 > > changed = <optimized out> > > ret = <optimized out> > > #60 0x00007f768a97b19d in squat_uidlist_map_header (uidlist=0x5645403767f0) at squat-uidlist.c:378 > > No locals. > > #61 squat_uidlist_map (uidlist=0x5645403767f0) at squat-uidlist.c:477 > > mmap_hdr = <optimized out> > > ret = <optimized out> > > #62 0x00007f768a97b432 in squat_uidlist_open (uidlist=0x5645403767f0) at squat-uidlist.c:546 > > No locals. > > #63 0x00007f768a97b5aa in squat_uidlist_refresh (uidlist=<optimized out>) at squat-uidlist.c:569 > > No locals. > > #64 0x00007f768a9787c2 in squat_trie_map (trie=0x564540376490, building=<optimized out>) at squat-trie.c:1526 > > file_lock = 0x56454210c170 > > dotlock = 0x0 > > changed = <optimized out> > > ret = <optimized out> > > #65 0x00007f768a97b19d in squat_uidlist_map_header (uidlist=0x5645403767f0) at squat-uidlist.c:378 > > No locals. > > #66 squat_uidlist_map (uidlist=0x5645403767f0) at squat-uidlist.c:477 > > mmap_hdr = <optimized out> > > ret = <optimized out> > > #67 0x00007f768a97b432 in squat_uidlist_open (uidlist=0x5645403767f0) at squat-uidlist.c:546 > > No locals. > > #68 0x00007f768a97b5aa in squat_uidlist_refresh (uidlist=<optimized out>) at squat-uidlist.c:569 > > No locals. > > #69 0x00007f768a9787c2 in squat_trie_map (trie=0x564540376490, building=<optimized out>) at squat-trie.c:1526 > > file_lock = 0x56454210c0d0 > > dotlock = 0x0 > > changed = <optimized out> > > ret = <optimized out> > > #70 0x00007f768a97b19d in squat_uidlist_map_header (uidlist=0x5645403767f0) at squat-uidlist.c:378 > > No locals. > > #71 squat_uidlist_map (uidlist=0x5645403767f0) at squat-uidlist.c:477 > > mmap_hdr = <optimized out> > > ret = <optimized out> > > #72 0x00007f768a97b432 in squat_uidlist_open (uidlist=0x5645403767f0) at squat-uidlist.c:546 > > No locals. > > #73 0x00007f768a97b5aa in squat_uidlist_refresh (uidlist=<optimized out>) at squat-uidlist.c:569 > > No locals. > > #74 0x00007f768a9787c2 in squat_trie_map (trie=0x564540376490, building=<optimized out>) at squat-trie.c:1526 > > file_lock = 0x56454210c030 > > dotlock = 0x0 > > changed = <optimized out> > > ret = <optimized out> > > #75 0x00007f768a97b19d in squat_uidlist_map_header (uidlist=0x5645403767f0) at squat-uidlist.c:378 > > No locals. > > #76 squat_uidlist_map (uidlist=0x5645403767f0) at squat-uidlist.c:477 > > mmap_hdr = <optimized out> > > ret = <optimized out> > > #77 0x00007f768a97b432 in squat_uidlist_open (uidlist=0x5645403767f0) at squat-uidlist.c:546 > > No locals. > > #78 0x00007f768a97b5aa in squat_uidlist_refresh (uidlist=<optimized out>) at squat-uidlist.c:569 > > No locals. > > #79 0x00007f768a9787c2 in squat_trie_map (trie=0x564540376490, building=<optimized out>) at squat-trie.c:1526 > > file_lock = 0x56454210bf90 > > dotlock = 0x0 > > changed = <optimized out> > > ret = <optimized out> > > #80 0x00007f768a97b19d in squat_uidlist_map_header (uidlist=0x5645403767f0) at squat-uidlist.c:378 > > No locals. > > #81 squat_uidlist_map (uidlist=0x5645403767f0) at squat-uidlist.c:477 > > mmap_hdr = <optimized out> > > ret = <optimized out> > > #82 0x00007f768a97b432 in squat_uidlist_open (uidlist=0x5645403767f0) at squat-uidlist.c:546 > > No locals. > > #83 0x00007f768a97b5aa in squat_uidlist_refresh (uidlist=<optimized out>) at squat-uidlist.c:569 > > No locals. > > #84 0x00007f768a9787c2 in squat_trie_map (trie=0x564540376490, building=<optimized out>) at squat-trie.c:1526 > > file_lock = 0x56454210bef0 > > dotlock = 0x0 > > changed = <optimized out> > > ret = <optimized out> > > #85 0x00007f768a97b19d in squat_uidlist_map_header (uidlist=0x5645403767f0) at squat-uidlist.c:378 > > No locals. > > #86 squat_uidlist_map (uidlist=0x5645403767f0) at squat-uidlist.c:477 > > mmap_hdr = <optimized out> > > ret = <optimized out> > > #87 0x00007f768a97b432 in squat_uidlist_open (uidlist=0x5645403767f0) at squat-uidlist.c:546 > > No locals. > > #88 0x00007f768a97b5aa in squat_uidlist_refresh (uidlist=<optimized out>) at squat-uidlist.c:569 > > No locals. > > #89 0x00007f768a9787c2 in squat_trie_map (trie=0x564540376490, building=<optimized out>) at squat-trie.c:1526 > > file_lock = 0x56454210be50 > > dotlock = 0x0 > > changed = <optimized out> > > ret = <optimized out> > > #90 0x00007f768a97b19d in squat_uidlist_map_header (uidlist=0x5645403767f0) at squat-uidlist.c:378 > > No locals. > > #91 squat_uidlist_map (uidlist=0x5645403767f0) at squat-uidlist.c:477 > > mmap_hdr = <optimized out> > > ret = <optimized out> > > #92 0x00007f768a97b432 in squat_uidlist_open (uidlist=0x5645403767f0) at squat-uidlist.c:546 > > No locals. > > #93 0x00007f768a97b5aa in squat_uidlist_refresh (uidlist=<optimized out>) at squat-uidlist.c:569 > > No locals. > > #94 0x00007f768a9787c2 in squat_trie_map (trie=0x564540376490, building=<optimized out>) at squat-trie.c:1526 > > file_lock = 0x56454210bdb0 > > dotlock = 0x0 > > changed = <optimized out> > > ret = <optimized out> > > #95 0x00007f768a97b19d in squat_uidlist_map_header (uidlist=0x5645403767f0) at squat-uidlist.c:378 > > No locals. > > #96 squat_uidlist_map (uidlist=0x5645403767f0) at squat-uidlist.c:477 > > mmap_hdr = <optimized out> > > ret = <optimized out> > > #97 0x00007f768a97b432 in squat_uidlist_open (uidlist=0x5645403767f0) at squat-uidlist.c:546 > > No locals. > > #98 0x00007f768a97b5aa in squat_uidlist_refresh (uidlist=<optimized out>) at squat-uidlist.c:569 > > No locals. > > #99 0x00007f768a9787c2 in squat_trie_map (trie=0x564540376490, building=<optimized out>) at squat-trie.c:1526 > > file_lock = 0x56454210bd10 > > dotlock = 0x0 > > changed = <optimized out> > > ret = <optimized out> > > #100 0x00007f768a97b19d in squat_uidlist_map_header (uidlist=0x5645403767f0) at squat-uidlist.c:378 > > No locals. > > #101 squat_uidlist_map (uidlist=0x5645403767f0) at squat-uidlist.c:477 > > mmap_hdr = <optimized out> > > ret = <optimized out> > > #102 0x00007f768a97b432 in squat_uidlist_open (uidlist=0x5645403767f0) at squat-uidlist.c:546 > > No locals. > > #103 0x00007f768a97b5aa in squat_uidlist_refresh (uidlist=<optimized out>) at squat-uidlist.c:569 > > No locals. > > #104 0x00007f768a9787c2 in squat_trie_map (trie=0x564540376490, building=<optimized out>) at squat-trie.c:1526 > > file_lock = 0x56454210bc70 > > dotlock = 0x0 > > changed = <optimized out> > > ret = <optimized out> > > #105 0x00007f768a97b19d in squat_uidlist_map_header (uidlist=0x5645403767f0) at squat-uidlist.c:378 > > No locals. > > #106 squat_uidlist_map (uidlist=0x5645403767f0) at squat-uidlist.c:477 > > mmap_hdr = <optimized out> > > ret = <optimized out> > > #107 0x00007f768a97b432 in squat_uidlist_open (uidlist=0x5645403767f0) at squat-uidlist.c:546 > > No locals. > > #108 0x00007f768a97b5aa in squat_uidlist_refresh (uidlist=<optimized out>) at squat-uidlist.c:569 > > No locals. > > #109 0x00007f768a9787c2 in squat_trie_map (trie=0x564540376490, building=<optimized out>) at squat-trie.c:1526 > > file_lock = 0x56454210bbd0 > > dotlock = 0x0 > > changed = <optimized out> > > ret = <optimized out> > > #110 0x00007f768a97b19d in squat_uidlist_map_header (uidlist=0x5645403767f0) at squat-uidlist.c:378 > > No locals. > > #111 squat_uidlist_map (uidlist=0x5645403767f0) at squat-uidlist.c:477 > > mmap_hdr = <optimized out> > > ret = <optimized out> > > #112 0x00007f768a97b432 in squat_uidlist_open (uidlist=0x5645403767f0) at squat-uidlist.c:546 > > No locals. > > #113 0x00007f768a97b5aa in squat_uidlist_refresh (uidlist=<optimized out>) at squat-uidlist.c:569 > > No locals. > > #114 0x00007f768a9787c2 in squat_trie_map (trie=0x564540376490, building=<optimized out>) at squat-trie.c:1526 > > file_lock = 0x56454210bb30 > > dotlock = 0x0 > > changed = <optimized out> > > ret = <optimized out> > > #115 0x00007f768a97b19d in squat_uidlist_map_header (uidlist=0x5645403767f0) at squat-uidlist.c:378 > > No locals. > > #116 squat_uidlist_map (uidlist=0x5645403767f0) at squat-uidlist.c:477 > > mmap_hdr = <optimized out> > > ret = <optimized out> > > #117 0x00007f768a97b432 in squat_uidlist_open (uidlist=0x5645403767f0) at squat-uidlist.c:546 > > No locals. > > #118 0x00007f768a97b5aa in squat_uidlist_refresh (uidlist=<optimized out>) at squat-uidlist.c:569 > > No locals. > > #119 0x00007f768a9787c2 in squat_trie_map (trie=0x564540376490, building=<optimized out>) at squat-trie.c:1526 > > file_lock = 0x56454210ba90 > > dotlock = 0x0 > > changed = <optimized out> > > ret = <optimized out> > > #120 0x00007f768a97b19d in squat_uidlist_map_header (uidlist=0x5645403767f0) at squat-uidlist.c:378 > > No locals. > > #121 squat_uidlist_map (uidlist=0x5645403767f0) at squat-uidlist.c:477 > > mmap_hdr = <optimized out> > > ret = <optimized out> > > #122 0x00007f768a97b432 in squat_uidlist_open (uidlist=0x5645403767f0) at squat-uidlist.c:546 > > No locals. > > #123 0x00007f768a97b5aa in squat_uidlist_refresh (uidlist=<optimized out>) at squat-uidlist.c:569 > > No locals. > > #124 0x00007f768a9787c2 in squat_trie_map (trie=0x564540376490, building=<optimized out>) at squat-trie.c:1526 > > file_lock = 0x56454210b9f0 > > dotlock = 0x0 > > changed = <optimized out> > > > > (continues for ages) > > > > On 2018-11-29 19:36, Joan Moreau wrote: > > > > finally managed to locate the dump > > > > here the output: > > > > # gdb /usr/libexec/dovecot/auth /var/lib/systemd/coredump/core.auth.0.3a33f56105e043de802a7dfcee265a07.28130.1543516118000000 > > GNU gdb (GDB) 8.2 > > (gdb) bt full > > #0 0x00007f739c35cd7f in raise () from /usr/lib/libc.so.6 > > No symbol table info available. > > #1 0x00007f739c347672 in abort () from /usr/lib/libc.so.6 > > No symbol table info available. > > #2 0x00007f739c39f878 in __libc_message () from /usr/lib/libc.so.6 > > No symbol table info available. > > #3 0x00007f739c3a618a in malloc_printerr () from /usr/lib/libc.so.6 > > No symbol table info available. > > #4 0x00007f739c3a7b27 in _int_free () from /usr/lib/libc.so.6 > > No symbol table info available. > > #5 0x00007f739cc33585 in mysql_close (mysql=0x5636af7abdc0) at /usr/src/mariadb-10.3.11/libmariadb/libmariadb/mariadb_lib.c:1939 > > mysql = 0x5636af7abdc0 > > p = <optimized out> > > p = <optimized out> > > #6 0x00005636aef08f7c in driver_sqlpool_disconnect (_db=0x5636af7aaf30) at driver-sqlpool.c:590 > > conn__foreach_end = 0x5636af7ab570 > > db = 0x5636af7aaf30 > > conn = 0x5636af7ab560 > > #7 0x00005636aeefed65 in db_sql_unref (_conn=0x5636af7b0020) at db-sql.c:128 > > conn = 0x5636af7ae388 > > #8 0x00005636aeef7e15 in userdb_deinit (userdb=0x5636af7afff8) at userdb.c:191 > > idx = 0 > > __func__ = "userdb_deinit" > > #9 0x00005636aeede209 in auth_deinit (auth=0x5636af7afd58) at auth.c:335 > > passdb = <optimized out> > > userdb = 0x5636af7aff18 > > passdb = <optimized out> > > userdb = <optimized out> > > #10 auths_deinit () at auth.c:433 > > auth__foreach_end = 0x5636af7ae2f8 > > auth = 0x5636af7ae2f0 > > #11 0x00005636aeedcf65 in main_deinit () at main.c:270 > > l = <optimized out> > > l = <optimized out> > > l_end = <optimized out> > > #12 main (argc=<optimized out>, argv=<optimized out>) at main.c:401 > > c = <optimized out> > > On 27.11.2018 8.39, Joan Moreau wrote: > > Thank you Aki > > here the requested data (below) > > Please not as well that we have numerous subfolders (>50) and pretty big > mailbox sizes (>20G) > > Bug appears mostly in auth process and index-worker > > dovecot -n : > > # 2.4.devel (de42b54aa): /etc/dovecot/dovecot.conf > # Pigeonhole version 0.6.devel (65909cfa) > # OS: Linux 4.19.4-arch1-1-ARCH x86_64 ext4 > # Hostname: gjserver > base_dir = /run/dovecot > default_login_user = dovecot > default_vsz_limit = 16 G > disable_plaintext_auth = no > listen = * > log_path = /var/log/mail/dovecot.log > mail_gid = mail > mail_location = mdbox:/data/mail/%d/%n:ALT=/data/mail/archives/%d/%n > mail_plugins = fts fts_squat > mail_uid = mailusers > managesieve_notify_capability = mailto > managesieve_sieve_capability = fileinto reject envelope > encoded-character vacation subaddress comparator-i;ascii-numeric > relational regex imap4flags copy include variables body enotify > environment mailbox date index ihave duplicate mime foreverypart > extracttext > mdbox_rotate_size = 24 M > > (...) > > passdb { > args = /etc/dovecot/dovecot-sql.conf > driver = sql > } > (the rest default values) > fts squat was already deprecated in 2.2, and it's considered obsolete in > 2.3. We hopefully get around removing it from 2.4, but you should move > away from it to Solr. > > The MySQL crash has been fixed in master, see > https://github.com/dovecot/core/commit/3c5101ffdd2a8115e03ed7180d53578765dea4c9.patch > > Aki
So far, not getting any results with Solr. Squat however exactly meet the need. On 2018-12-04 16:18, Aki Tuomi wrote:> We don't consider it as "very early beta". We consider it production ready. It is bit more work to set up though. > > Aki > > On 04 December 2018 at 17:16 Joan Moreau <jom at grosjo.net> wrote: > > Thanks for mySql > > For Squat vs Solr, Solr does not reach Squat by very far in terms of > results : If I setup Solr, and search (via the search in Roundbube or > Evolution) for a keyword or part of the keyword, the results are > complete non sense. The diference between "search in full body" and > "search in fields" does not even work. > > Solr with Dovecot seems very early beta isnt'it ? > > On 2018-12-04 15:57, Aki Tuomi wrote: > > On 04 December 2018 at 16:46 Joan Moreau via dovecot <dovecot at dovecot.org> wrote: > > Hi > > How to solve this ? > > So many similar segfaults > > Thank you > > On 2018-11-30 06:11, Joan Moreau wrote: > > ANother (very very long) example : > > # gdb /usr/libexec/dovecot/indexer-worker core.indexer-worker.0.3a33f56105e043de802a7dfcee265a07.21017.1543533424000000 > GNU gdb (GDB) 8.2 > Copyright (C) 2018 Free Software Foundation, Inc. > License GPLv3+: GNU GPL version 3 or later <http://gnu.org/licenses/gpl.html> > This is free software: you are free to change and redistribute it. > There is NO WARRANTY, to the extent permitted by law. > Type "show copying" and "show warranty" for details. > This GDB was configured as "x86_64-pc-linux-gnu". > Type "show configuration" for configuration details. > For bug reporting instructions, please see: > <http://www.gnu.org/software/gdb/bugs/>. > Find the GDB manual and other documentation resources online at: > <http://www.gnu.org/software/gdb/documentation/>. > > For help, type "help". > Type "apropos word" to search for commands related to "word"... > Reading symbols from /usr/libexec/dovecot/indexer-worker...done. > [New LWP 21017] > [Thread debugging using libthread_db enabled] > Using host libthread_db library "/usr/lib/libthread_db.so.1". > Core was generated by `dovecot/indexer-worker'. > Program terminated with signal SIGSEGV, Segmentation fault. > #0 0x00007f768b62b13e in file_lock_do (fd=18, path=0x564540376790 "/data/mail/grosjo.net/admin/mailboxes/QoS/dbox-Mails/dovecot.index.search", lock_type=0, > lock_method=FILE_LOCK_METHOD_FCNTL, timeout_secs=60, error_r=0x7fff045010b0) at file-lock.c:173 > 173 { > (gdb) bt full > #0 0x00007f768b62b13e in file_lock_do (fd=18, path=0x564540376790 "/data/mail/grosjo.net/admin/mailboxes/QoS/dbox-Mails/dovecot.index.search", lock_type=0, > lock_method=FILE_LOCK_METHOD_FCNTL, timeout_secs=60, error_r=0x7fff045010b0) at file-lock.c:173 > lock_type_str = <optimized out> > started = <optimized out> > ret = <optimized out> > __func__ = "file_lock_do" > #1 0x00007f768b62b5b6 in file_wait_lock_error (fd=18, path=0x564540376790 "/data/mail/grosjo.net/admin/mailboxes/QoS/dbox-Mails/dovecot.index.search", lock_type=0, > lock_method=FILE_LOCK_METHOD_FCNTL, timeout_secs=<optimized out>, lock_r=0x7fff04501118, error_r=0x7fff045010b0) at file-lock.c:318 > lock = <optimized out> > ret = <optimized out> > #2 0x00007f768b62b660 in file_wait_lock (fd=<optimized out>, path=<optimized out>, lock_type=lock_type at entry=0, lock_method=<optimized out>, timeout_secs=timeout_secs at entry=60, > lock_r=lock_r at entry=0x7fff04501118) at file-lock.c:303 > error = 0x564540376490 "" > ret = <optimized out> > #3 0x00007f768a976c87 in squat_trie_lock (trie=0x564540376490, lock_type=0, file_lock_r=0x7fff04501118, dotlock_r=0x7fff04501120) at squat-trie.c:294 > ret = <optimized out> > dotlock_r = 0x7fff04501120 > file_lock_r = 0x7fff04501118 > trie = 0x564540376490 > ret = <optimized out> > __func__ = "squat_trie_lock" > lock_type = 0 > ret = <optimized out> > __func__ = "squat_trie_lock" > #4 0x00007f768a978627 in squat_trie_map (trie=0x564540376490, building=<optimized out>) at squat-trie.c:1487 > file_lock = 0x0 > dotlock = 0x0 > changed = <optimized out> > ret = <optimized out> > #5 0x00007f768a97b19d in squat_uidlist_map_header (uidlist=0x5645403767f0) at squat-uidlist.c:378 > No locals. > #6 squat_uidlist_map (uidlist=0x5645403767f0) at squat-uidlist.c:477 > mmap_hdr = <optimized out> > ret = <optimized out> > #7 0x00007f768a97b432 in squat_uidlist_open (uidlist=0x5645403767f0) at squat-uidlist.c:546 > No locals. > #8 0x00007f768a97b5aa in squat_uidlist_refresh (uidlist=<optimized out>) at squat-uidlist.c:569 > No locals. > #9 0x00007f768a9787c2 in squat_trie_map (trie=0x564540376490, building=<optimized out>) at squat-trie.c:1526 > file_lock = 0x56454210c850 > dotlock = 0x0 > changed = <optimized out> > ret = <optimized out> > #10 0x00007f768a97b19d in squat_uidlist_map_header (uidlist=0x5645403767f0) at squat-uidlist.c:378 > No locals. > #11 squat_uidlist_map (uidlist=0x5645403767f0) at squat-uidlist.c:477 > mmap_hdr = <optimized out> > ret = <optimized out> > #12 0x00007f768a97b432 in squat_uidlist_open (uidlist=0x5645403767f0) at squat-uidlist.c:546 > No locals. > #13 0x00007f768a97b5aa in squat_uidlist_refresh (uidlist=<optimized out>) at squat-uidlist.c:569 > No locals. > #14 0x00007f768a9787c2 in squat_trie_map (trie=0x564540376490, building=<optimized out>) at squat-trie.c:1526 > file_lock = 0x56454210c7b0 > dotlock = 0x0 > changed = <optimized out> > ret = <optimized out> > #15 0x00007f768a97b19d in squat_uidlist_map_header (uidlist=0x5645403767f0) at squat-uidlist.c:378 > No locals. > #16 squat_uidlist_map (uidlist=0x5645403767f0) at squat-uidlist.c:477 > mmap_hdr = <optimized out> > ret = <optimized out> > #17 0x00007f768a97b432 in squat_uidlist_open (uidlist=0x5645403767f0) at squat-uidlist.c:546 > No locals. > #18 0x00007f768a97b5aa in squat_uidlist_refresh (uidlist=<optimized out>) at squat-uidlist.c:569 > No locals. > #19 0x00007f768a9787c2 in squat_trie_map (trie=0x564540376490, building=<optimized out>) at squat-trie.c:1526 > file_lock = 0x56454210c710 > dotlock = 0x0 > changed = <optimized out> > ret = <optimized out> > #20 0x00007f768a97b19d in squat_uidlist_map_header (uidlist=0x5645403767f0) at squat-uidlist.c:378 > No locals. > #21 squat_uidlist_map (uidlist=0x5645403767f0) at squat-uidlist.c:477 > mmap_hdr = <optimized out> > ret = <optimized out> > #22 0x00007f768a97b432 in squat_uidlist_open (uidlist=0x5645403767f0) at squat-uidlist.c:546 > No locals. > #23 0x00007f768a97b5aa in squat_uidlist_refresh (uidlist=<optimized out>) at squat-uidlist.c:569 > No locals. > #24 0x00007f768a9787c2 in squat_trie_map (trie=0x564540376490, building=<optimized out>) at squat-trie.c:1526 > file_lock = 0x56454210c670 > dotlock = 0x0 > changed = <optimized out> > ret = <optimized out> > #25 0x00007f768a97b19d in squat_uidlist_map_header (uidlist=0x5645403767f0) at squat-uidlist.c:378 > No locals. > #26 squat_uidlist_map (uidlist=0x5645403767f0) at squat-uidlist.c:477 > mmap_hdr = <optimized out> > ret = <optimized out> > #27 0x00007f768a97b432 in squat_uidlist_open (uidlist=0x5645403767f0) at squat-uidlist.c:546 > No locals. > #28 0x00007f768a97b5aa in squat_uidlist_refresh (uidlist=<optimized out>) at squat-uidlist.c:569 > No locals. > #29 0x00007f768a9787c2 in squat_trie_map (trie=0x564540376490, building=<optimized out>) at squat-trie.c:1526 > file_lock = 0x56454210c5d0 > dotlock = 0x0 > changed = <optimized out> > ret = <optimized out> > #30 0x00007f768a97b19d in squat_uidlist_map_header (uidlist=0x5645403767f0) at squat-uidlist.c:378 > No locals. > #31 squat_uidlist_map (uidlist=0x5645403767f0) at squat-uidlist.c:477 > mmap_hdr = <optimized out> > ret = <optimized out> > #32 0x00007f768a97b432 in squat_uidlist_open (uidlist=0x5645403767f0) at squat-uidlist.c:546 > No locals. > #33 0x00007f768a97b5aa in squat_uidlist_refresh (uidlist=<optimized out>) at squat-uidlist.c:569 > No locals. > #34 0x00007f768a9787c2 in squat_trie_map (trie=0x564540376490, building=<optimized out>) at squat-trie.c:1526 > file_lock = 0x56454210c530 > dotlock = 0x0 > changed = <optimized out> > ret = <optimized out> > #35 0x00007f768a97b19d in squat_uidlist_map_header (uidlist=0x5645403767f0) at squat-uidlist.c:378 > No locals. > #36 squat_uidlist_map (uidlist=0x5645403767f0) at squat-uidlist.c:477 > mmap_hdr = <optimized out> > ret = <optimized out> > #37 0x00007f768a97b432 in squat_uidlist_open (uidlist=0x5645403767f0) at squat-uidlist.c:546 > No locals. > #38 0x00007f768a97b5aa in squat_uidlist_refresh (uidlist=<optimized out>) at squat-uidlist.c:569 > No locals. > #39 0x00007f768a9787c2 in squat_trie_map (trie=0x564540376490, building=<optimized out>) at squat-trie.c:1526 > file_lock = 0x56454210c490 > dotlock = 0x0 > changed = <optimized out> > ret = <optimized out> > #40 0x00007f768a97b19d in squat_uidlist_map_header (uidlist=0x5645403767f0) at squat-uidlist.c:378 > No locals. > #41 squat_uidlist_map (uidlist=0x5645403767f0) at squat-uidlist.c:477 > mmap_hdr = <optimized out> > ret = <optimized out> > #42 0x00007f768a97b432 in squat_uidlist_open (uidlist=0x5645403767f0) at squat-uidlist.c:546 > No locals. > #43 0x00007f768a97b5aa in squat_uidlist_refresh (uidlist=<optimized out>) at squat-uidlist.c:569 > No locals. > #44 0x00007f768a9787c2 in squat_trie_map (trie=0x564540376490, building=<optimized out>) at squat-trie.c:1526 > file_lock = 0x56454210c3f0 > dotlock = 0x0 > changed = <optimized out> > ret = <optimized out> > #45 0x00007f768a97b19d in squat_uidlist_map_header (uidlist=0x5645403767f0) at squat-uidlist.c:378 > No locals. > #46 squat_uidlist_map (uidlist=0x5645403767f0) at squat-uidlist.c:477 > mmap_hdr = <optimized out> > ret = <optimized out> > #47 0x00007f768a97b432 in squat_uidlist_open (uidlist=0x5645403767f0) at squat-uidlist.c:546 > No locals. > #48 0x00007f768a97b5aa in squat_uidlist_refresh (uidlist=<optimized out>) at squat-uidlist.c:569 > No locals. > #49 0x00007f768a9787c2 in squat_trie_map (trie=0x564540376490, building=<optimized out>) at squat-trie.c:1526 > file_lock = 0x56454210c350 > dotlock = 0x0 > changed = <optimized out> > ret = <optimized out> > #50 0x00007f768a97b19d in squat_uidlist_map_header (uidlist=0x5645403767f0) at squat-uidlist.c:378 > #51 squat_uidlist_map (uidlist=0x5645403767f0) at squat-uidlist.c:477 > mmap_hdr = <optimized out> > ret = <optimized out> > #52 0x00007f768a97b432 in squat_uidlist_open (uidlist=0x5645403767f0) at squat-uidlist.c:546 > No locals. > #53 0x00007f768a97b5aa in squat_uidlist_refresh (uidlist=<optimized out>) at squat-uidlist.c:569 > No locals. > #54 0x00007f768a9787c2 in squat_trie_map (trie=0x564540376490, building=<optimized out>) at squat-trie.c:1526 > file_lock = 0x56454210c2b0 > dotlock = 0x0 > changed = <optimized out> > ret = <optimized out> > #55 0x00007f768a97b19d in squat_uidlist_map_header (uidlist=0x5645403767f0) at squat-uidlist.c:378 > No locals. > #56 squat_uidlist_map (uidlist=0x5645403767f0) at squat-uidlist.c:477 > mmap_hdr = <optimized out> > ret = <optimized out> > #57 0x00007f768a97b432 in squat_uidlist_open (uidlist=0x5645403767f0) at squat-uidlist.c:546 > No locals. > #58 0x00007f768a97b5aa in squat_uidlist_refresh (uidlist=<optimized out>) at squat-uidlist.c:569 > No locals. > #59 0x00007f768a9787c2 in squat_trie_map (trie=0x564540376490, building=<optimized out>) at squat-trie.c:1526 > file_lock = 0x56454210c210 > dotlock = 0x0 > changed = <optimized out> > ret = <optimized out> > #60 0x00007f768a97b19d in squat_uidlist_map_header (uidlist=0x5645403767f0) at squat-uidlist.c:378 > No locals. > #61 squat_uidlist_map (uidlist=0x5645403767f0) at squat-uidlist.c:477 > mmap_hdr = <optimized out> > ret = <optimized out> > #62 0x00007f768a97b432 in squat_uidlist_open (uidlist=0x5645403767f0) at squat-uidlist.c:546 > No locals. > #63 0x00007f768a97b5aa in squat_uidlist_refresh (uidlist=<optimized out>) at squat-uidlist.c:569 > No locals. > #64 0x00007f768a9787c2 in squat_trie_map (trie=0x564540376490, building=<optimized out>) at squat-trie.c:1526 > file_lock = 0x56454210c170 > dotlock = 0x0 > changed = <optimized out> > ret = <optimized out> > #65 0x00007f768a97b19d in squat_uidlist_map_header (uidlist=0x5645403767f0) at squat-uidlist.c:378 > No locals. > #66 squat_uidlist_map (uidlist=0x5645403767f0) at squat-uidlist.c:477 > mmap_hdr = <optimized out> > ret = <optimized out> > #67 0x00007f768a97b432 in squat_uidlist_open (uidlist=0x5645403767f0) at squat-uidlist.c:546 > No locals. > #68 0x00007f768a97b5aa in squat_uidlist_refresh (uidlist=<optimized out>) at squat-uidlist.c:569 > No locals. > #69 0x00007f768a9787c2 in squat_trie_map (trie=0x564540376490, building=<optimized out>) at squat-trie.c:1526 > file_lock = 0x56454210c0d0 > dotlock = 0x0 > changed = <optimized out> > ret = <optimized out> > #70 0x00007f768a97b19d in squat_uidlist_map_header (uidlist=0x5645403767f0) at squat-uidlist.c:378 > No locals. > #71 squat_uidlist_map (uidlist=0x5645403767f0) at squat-uidlist.c:477 > mmap_hdr = <optimized out> > ret = <optimized out> > #72 0x00007f768a97b432 in squat_uidlist_open (uidlist=0x5645403767f0) at squat-uidlist.c:546 > No locals. > #73 0x00007f768a97b5aa in squat_uidlist_refresh (uidlist=<optimized out>) at squat-uidlist.c:569 > No locals. > #74 0x00007f768a9787c2 in squat_trie_map (trie=0x564540376490, building=<optimized out>) at squat-trie.c:1526 > file_lock = 0x56454210c030 > dotlock = 0x0 > changed = <optimized out> > ret = <optimized out> > #75 0x00007f768a97b19d in squat_uidlist_map_header (uidlist=0x5645403767f0) at squat-uidlist.c:378 > No locals. > #76 squat_uidlist_map (uidlist=0x5645403767f0) at squat-uidlist.c:477 > mmap_hdr = <optimized out> > ret = <optimized out> > #77 0x00007f768a97b432 in squat_uidlist_open (uidlist=0x5645403767f0) at squat-uidlist.c:546 > No locals. > #78 0x00007f768a97b5aa in squat_uidlist_refresh (uidlist=<optimized out>) at squat-uidlist.c:569 > No locals. > #79 0x00007f768a9787c2 in squat_trie_map (trie=0x564540376490, building=<optimized out>) at squat-trie.c:1526 > file_lock = 0x56454210bf90 > dotlock = 0x0 > changed = <optimized out> > ret = <optimized out> > #80 0x00007f768a97b19d in squat_uidlist_map_header (uidlist=0x5645403767f0) at squat-uidlist.c:378 > No locals. > #81 squat_uidlist_map (uidlist=0x5645403767f0) at squat-uidlist.c:477 > mmap_hdr = <optimized out> > ret = <optimized out> > #82 0x00007f768a97b432 in squat_uidlist_open (uidlist=0x5645403767f0) at squat-uidlist.c:546 > No locals. > #83 0x00007f768a97b5aa in squat_uidlist_refresh (uidlist=<optimized out>) at squat-uidlist.c:569 > No locals. > #84 0x00007f768a9787c2 in squat_trie_map (trie=0x564540376490, building=<optimized out>) at squat-trie.c:1526 > file_lock = 0x56454210bef0 > dotlock = 0x0 > changed = <optimized out> > ret = <optimized out> > #85 0x00007f768a97b19d in squat_uidlist_map_header (uidlist=0x5645403767f0) at squat-uidlist.c:378 > No locals. > #86 squat_uidlist_map (uidlist=0x5645403767f0) at squat-uidlist.c:477 > mmap_hdr = <optimized out> > ret = <optimized out> > #87 0x00007f768a97b432 in squat_uidlist_open (uidlist=0x5645403767f0) at squat-uidlist.c:546 > No locals. > #88 0x00007f768a97b5aa in squat_uidlist_refresh (uidlist=<optimized out>) at squat-uidlist.c:569 > No locals. > #89 0x00007f768a9787c2 in squat_trie_map (trie=0x564540376490, building=<optimized out>) at squat-trie.c:1526 > file_lock = 0x56454210be50 > dotlock = 0x0 > changed = <optimized out> > ret = <optimized out> > #90 0x00007f768a97b19d in squat_uidlist_map_header (uidlist=0x5645403767f0) at squat-uidlist.c:378 > No locals. > #91 squat_uidlist_map (uidlist=0x5645403767f0) at squat-uidlist.c:477 > mmap_hdr = <optimized out> > ret = <optimized out> > #92 0x00007f768a97b432 in squat_uidlist_open (uidlist=0x5645403767f0) at squat-uidlist.c:546 > No locals. > #93 0x00007f768a97b5aa in squat_uidlist_refresh (uidlist=<optimized out>) at squat-uidlist.c:569 > No locals. > #94 0x00007f768a9787c2 in squat_trie_map (trie=0x564540376490, building=<optimized out>) at squat-trie.c:1526 > file_lock = 0x56454210bdb0 > dotlock = 0x0 > changed = <optimized out> > ret = <optimized out> > #95 0x00007f768a97b19d in squat_uidlist_map_header (uidlist=0x5645403767f0) at squat-uidlist.c:378 > No locals. > #96 squat_uidlist_map (uidlist=0x5645403767f0) at squat-uidlist.c:477 > mmap_hdr = <optimized out> > ret = <optimized out> > #97 0x00007f768a97b432 in squat_uidlist_open (uidlist=0x5645403767f0) at squat-uidlist.c:546 > No locals. > #98 0x00007f768a97b5aa in squat_uidlist_refresh (uidlist=<optimized out>) at squat-uidlist.c:569 > No locals. > #99 0x00007f768a9787c2 in squat_trie_map (trie=0x564540376490, building=<optimized out>) at squat-trie.c:1526 > file_lock = 0x56454210bd10 > dotlock = 0x0 > changed = <optimized out> > ret = <optimized out> > #100 0x00007f768a97b19d in squat_uidlist_map_header (uidlist=0x5645403767f0) at squat-uidlist.c:378 > No locals. > #101 squat_uidlist_map (uidlist=0x5645403767f0) at squat-uidlist.c:477 > mmap_hdr = <optimized out> > ret = <optimized out> > #102 0x00007f768a97b432 in squat_uidlist_open (uidlist=0x5645403767f0) at squat-uidlist.c:546 > No locals. > #103 0x00007f768a97b5aa in squat_uidlist_refresh (uidlist=<optimized out>) at squat-uidlist.c:569 > No locals. > #104 0x00007f768a9787c2 in squat_trie_map (trie=0x564540376490, building=<optimized out>) at squat-trie.c:1526 > file_lock = 0x56454210bc70 > dotlock = 0x0 > changed = <optimized out> > ret = <optimized out> > #105 0x00007f768a97b19d in squat_uidlist_map_header (uidlist=0x5645403767f0) at squat-uidlist.c:378 > No locals. > #106 squat_uidlist_map (uidlist=0x5645403767f0) at squat-uidlist.c:477 > mmap_hdr = <optimized out> > ret = <optimized out> > #107 0x00007f768a97b432 in squat_uidlist_open (uidlist=0x5645403767f0) at squat-uidlist.c:546 > No locals. > #108 0x00007f768a97b5aa in squat_uidlist_refresh (uidlist=<optimized out>) at squat-uidlist.c:569 > No locals. > #109 0x00007f768a9787c2 in squat_trie_map (trie=0x564540376490, building=<optimized out>) at squat-trie.c:1526 > file_lock = 0x56454210bbd0 > dotlock = 0x0 > changed = <optimized out> > ret = <optimized out> > #110 0x00007f768a97b19d in squat_uidlist_map_header (uidlist=0x5645403767f0) at squat-uidlist.c:378 > No locals. > #111 squat_uidlist_map (uidlist=0x5645403767f0) at squat-uidlist.c:477 > mmap_hdr = <optimized out> > ret = <optimized out> > #112 0x00007f768a97b432 in squat_uidlist_open (uidlist=0x5645403767f0) at squat-uidlist.c:546 > No locals. > #113 0x00007f768a97b5aa in squat_uidlist_refresh (uidlist=<optimized out>) at squat-uidlist.c:569 > No locals. > #114 0x00007f768a9787c2 in squat_trie_map (trie=0x564540376490, building=<optimized out>) at squat-trie.c:1526 > file_lock = 0x56454210bb30 > dotlock = 0x0 > changed = <optimized out> > ret = <optimized out> > #115 0x00007f768a97b19d in squat_uidlist_map_header (uidlist=0x5645403767f0) at squat-uidlist.c:378 > No locals. > #116 squat_uidlist_map (uidlist=0x5645403767f0) at squat-uidlist.c:477 > mmap_hdr = <optimized out> > ret = <optimized out> > #117 0x00007f768a97b432 in squat_uidlist_open (uidlist=0x5645403767f0) at squat-uidlist.c:546 > No locals. > #118 0x00007f768a97b5aa in squat_uidlist_refresh (uidlist=<optimized out>) at squat-uidlist.c:569 > No locals. > #119 0x00007f768a9787c2 in squat_trie_map (trie=0x564540376490, building=<optimized out>) at squat-trie.c:1526 > file_lock = 0x56454210ba90 > dotlock = 0x0 > changed = <optimized out> > ret = <optimized out> > #120 0x00007f768a97b19d in squat_uidlist_map_header (uidlist=0x5645403767f0) at squat-uidlist.c:378 > No locals. > #121 squat_uidlist_map (uidlist=0x5645403767f0) at squat-uidlist.c:477 > mmap_hdr = <optimized out> > ret = <optimized out> > #122 0x00007f768a97b432 in squat_uidlist_open (uidlist=0x5645403767f0) at squat-uidlist.c:546 > No locals. > #123 0x00007f768a97b5aa in squat_uidlist_refresh (uidlist=<optimized out>) at squat-uidlist.c:569 > No locals. > #124 0x00007f768a9787c2 in squat_trie_map (trie=0x564540376490, building=<optimized out>) at squat-trie.c:1526 > file_lock = 0x56454210b9f0 > dotlock = 0x0 > changed = <optimized out> > > (continues for ages) > > On 2018-11-29 19:36, Joan Moreau wrote: > > finally managed to locate the dump > > here the output: > > # gdb /usr/libexec/dovecot/auth /var/lib/systemd/coredump/core.auth.0.3a33f56105e043de802a7dfcee265a07.28130.1543516118000000 > GNU gdb (GDB) 8.2 > (gdb) bt full > #0 0x00007f739c35cd7f in raise () from /usr/lib/libc.so.6 > No symbol table info available. > #1 0x00007f739c347672 in abort () from /usr/lib/libc.so.6 > No symbol table info available. > #2 0x00007f739c39f878 in __libc_message () from /usr/lib/libc.so.6 > No symbol table info available. > #3 0x00007f739c3a618a in malloc_printerr () from /usr/lib/libc.so.6 > No symbol table info available. > #4 0x00007f739c3a7b27 in _int_free () from /usr/lib/libc.so.6 > No symbol table info available. > #5 0x00007f739cc33585 in mysql_close (mysql=0x5636af7abdc0) at /usr/src/mariadb-10.3.11/libmariadb/libmariadb/mariadb_lib.c:1939 > mysql = 0x5636af7abdc0 > p = <optimized out> > p = <optimized out> > #6 0x00005636aef08f7c in driver_sqlpool_disconnect (_db=0x5636af7aaf30) at driver-sqlpool.c:590 > conn__foreach_end = 0x5636af7ab570 > db = 0x5636af7aaf30 > conn = 0x5636af7ab560 > #7 0x00005636aeefed65 in db_sql_unref (_conn=0x5636af7b0020) at db-sql.c:128 > conn = 0x5636af7ae388 > #8 0x00005636aeef7e15 in userdb_deinit (userdb=0x5636af7afff8) at userdb.c:191 > idx = 0 > __func__ = "userdb_deinit" > #9 0x00005636aeede209 in auth_deinit (auth=0x5636af7afd58) at auth.c:335 > passdb = <optimized out> > userdb = 0x5636af7aff18 > passdb = <optimized out> > userdb = <optimized out> > #10 auths_deinit () at auth.c:433 > auth__foreach_end = 0x5636af7ae2f8 > auth = 0x5636af7ae2f0 > #11 0x00005636aeedcf65 in main_deinit () at main.c:270 > l = <optimized out> > l = <optimized out> > l_end = <optimized out> > #12 main (argc=<optimized out>, argv=<optimized out>) at main.c:401 > c = <optimized out> > On 27.11.2018 8.39, Joan Moreau wrote: > > Thank you Aki > > here the requested data (below) > > Please not as well that we have numerous subfolders (>50) and pretty big > mailbox sizes (>20G) > > Bug appears mostly in auth process and index-worker > > dovecot -n : > > # 2.4.devel (de42b54aa): /etc/dovecot/dovecot.conf > # Pigeonhole version 0.6.devel (65909cfa) > # OS: Linux 4.19.4-arch1-1-ARCH x86_64 ext4 > # Hostname: gjserver > base_dir = /run/dovecot > default_login_user = dovecot > default_vsz_limit = 16 G > disable_plaintext_auth = no > listen = * > log_path = /var/log/mail/dovecot.log > mail_gid = mail > mail_location = mdbox:/data/mail/%d/%n:ALT=/data/mail/archives/%d/%n > mail_plugins = fts fts_squat > mail_uid = mailusers > managesieve_notify_capability = mailto > managesieve_sieve_capability = fileinto reject envelope > encoded-character vacation subaddress comparator-i;ascii-numeric > relational regex imap4flags copy include variables body enotify > environment mailbox date index ihave duplicate mime foreverypart > extracttext > mdbox_rotate_size = 24 M > > (...) > > passdb { > args = /etc/dovecot/dovecot-sql.conf > driver = sql > } > (the rest default values) > fts squat was already deprecated in 2.2, and it's considered obsolete in > 2.3. We hopefully get around removing it from 2.4, but you should move > away from it to Solr. > > The MySQL crash has been fixed in master, see > https://github.com/dovecot/core/commit/3c5101ffdd2a8115e03ed7180d53578765dea4c9.patch > > Aki-------------- next part -------------- An HTML attachment was scrubbed... URL: <https://dovecot.org/pipermail/dovecot/attachments/20181204/9410a124/attachment-0001.html>
> On December 4, 2018 at 8:18 AM Aki Tuomi <aki.tuomi at open-xchange.com> wrote: > > We don't consider it as "very early beta". We consider it production ready. It is bit more work to set up though.FWIW, Squat has been deprecated since 2.0, so none of this should come as a surprise. https://wiki.dovecot.org/Plugins/FTS> Aki > > > On 04 December 2018 at 17:16 Joan Moreau <jom at grosjo.net> wrote: > > > > > > Thanks for mySql > > > > For Squat vs Solr, Solr does not reach Squat by very far in terms of > > results : If I setup Solr, and search (via the search in Roundbube or > > Evolution) for a keyword or part of the keyword, the results are > > complete non sense. The diference between "search in full body" and > > "search in fields" does not even work. > > > > Solr with Dovecot seems very early beta isnt'it ? > > > > On 2018-12-04 15:57, Aki Tuomi wrote: > > > > > On 04 December 2018 at 16:46 Joan Moreau via dovecot <dovecot at dovecot.org> wrote: > > > > > > Hi > > > > > > How to solve this ? > > > > > > So many similar segfaults > > > > > > Thank you > > > > > > On 2018-11-30 06:11, Joan Moreau wrote: > > > > > > ANother (very very long) example : > > > > > > # gdb /usr/libexec/dovecot/indexer-worker core.indexer-worker.0.3a33f56105e043de802a7dfcee265a07.21017.1543533424000000 > > > GNU gdb (GDB) 8.2 > > > Copyright (C) 2018 Free Software Foundation, Inc. > > > License GPLv3+: GNU GPL version 3 or later <http://gnu.org/licenses/gpl.html> > > > This is free software: you are free to change and redistribute it. > > > There is NO WARRANTY, to the extent permitted by law. > > > Type "show copying" and "show warranty" for details. > > > This GDB was configured as "x86_64-pc-linux-gnu". > > > Type "show configuration" for configuration details. > > > For bug reporting instructions, please see: > > > <http://www.gnu.org/software/gdb/bugs/>. > > > Find the GDB manual and other documentation resources online at: > > > <http://www.gnu.org/software/gdb/documentation/>. > > > > > > For help, type "help". > > > Type "apropos word" to search for commands related to "word"... > > > Reading symbols from /usr/libexec/dovecot/indexer-worker...done. > > > [New LWP 21017] > > > [Thread debugging using libthread_db enabled] > > > Using host libthread_db library "/usr/lib/libthread_db.so.1". > > > Core was generated by `dovecot/indexer-worker'. > > > Program terminated with signal SIGSEGV, Segmentation fault. > > > #0 0x00007f768b62b13e in file_lock_do (fd=18, path=0x564540376790 "/data/mail/grosjo.net/admin/mailboxes/QoS/dbox-Mails/dovecot.index.search", lock_type=0, > > > lock_method=FILE_LOCK_METHOD_FCNTL, timeout_secs=60, error_r=0x7fff045010b0) at file-lock.c:173 > > > 173 { > > > (gdb) bt full > > > #0 0x00007f768b62b13e in file_lock_do (fd=18, path=0x564540376790 "/data/mail/grosjo.net/admin/mailboxes/QoS/dbox-Mails/dovecot.index.search", lock_type=0, > > > lock_method=FILE_LOCK_METHOD_FCNTL, timeout_secs=60, error_r=0x7fff045010b0) at file-lock.c:173 > > > lock_type_str = <optimized out> > > > started = <optimized out> > > > ret = <optimized out> > > > __func__ = "file_lock_do" > > > #1 0x00007f768b62b5b6 in file_wait_lock_error (fd=18, path=0x564540376790 "/data/mail/grosjo.net/admin/mailboxes/QoS/dbox-Mails/dovecot.index.search", lock_type=0, > > > lock_method=FILE_LOCK_METHOD_FCNTL, timeout_secs=<optimized out>, lock_r=0x7fff04501118, error_r=0x7fff045010b0) at file-lock.c:318 > > > lock = <optimized out> > > > ret = <optimized out> > > > #2 0x00007f768b62b660 in file_wait_lock (fd=<optimized out>, path=<optimized out>, lock_type=lock_type at entry=0, lock_method=<optimized out>, timeout_secs=timeout_secs at entry=60, > > > lock_r=lock_r at entry=0x7fff04501118) at file-lock.c:303 > > > error = 0x564540376490 "" > > > ret = <optimized out> > > > #3 0x00007f768a976c87 in squat_trie_lock (trie=0x564540376490, lock_type=0, file_lock_r=0x7fff04501118, dotlock_r=0x7fff04501120) at squat-trie.c:294 > > > ret = <optimized out> > > > dotlock_r = 0x7fff04501120 > > > file_lock_r = 0x7fff04501118 > > > trie = 0x564540376490 > > > ret = <optimized out> > > > __func__ = "squat_trie_lock" > > > lock_type = 0 > > > ret = <optimized out> > > > __func__ = "squat_trie_lock" > > > #4 0x00007f768a978627 in squat_trie_map (trie=0x564540376490, building=<optimized out>) at squat-trie.c:1487 > > > file_lock = 0x0 > > > dotlock = 0x0 > > > changed = <optimized out> > > > ret = <optimized out> > > > #5 0x00007f768a97b19d in squat_uidlist_map_header (uidlist=0x5645403767f0) at squat-uidlist.c:378 > > > No locals. > > > #6 squat_uidlist_map (uidlist=0x5645403767f0) at squat-uidlist.c:477 > > > mmap_hdr = <optimized out> > > > ret = <optimized out> > > > #7 0x00007f768a97b432 in squat_uidlist_open (uidlist=0x5645403767f0) at squat-uidlist.c:546 > > > No locals. > > > #8 0x00007f768a97b5aa in squat_uidlist_refresh (uidlist=<optimized out>) at squat-uidlist.c:569 > > > No locals. > > > #9 0x00007f768a9787c2 in squat_trie_map (trie=0x564540376490, building=<optimized out>) at squat-trie.c:1526 > > > file_lock = 0x56454210c850 > > > dotlock = 0x0 > > > changed = <optimized out> > > > ret = <optimized out> > > > #10 0x00007f768a97b19d in squat_uidlist_map_header (uidlist=0x5645403767f0) at squat-uidlist.c:378 > > > No locals. > > > #11 squat_uidlist_map (uidlist=0x5645403767f0) at squat-uidlist.c:477 > > > mmap_hdr = <optimized out> > > > ret = <optimized out> > > > #12 0x00007f768a97b432 in squat_uidlist_open (uidlist=0x5645403767f0) at squat-uidlist.c:546 > > > No locals. > > > #13 0x00007f768a97b5aa in squat_uidlist_refresh (uidlist=<optimized out>) at squat-uidlist.c:569 > > > No locals. > > > #14 0x00007f768a9787c2 in squat_trie_map (trie=0x564540376490, building=<optimized out>) at squat-trie.c:1526 > > > file_lock = 0x56454210c7b0 > > > dotlock = 0x0 > > > changed = <optimized out> > > > ret = <optimized out> > > > #15 0x00007f768a97b19d in squat_uidlist_map_header (uidlist=0x5645403767f0) at squat-uidlist.c:378 > > > No locals. > > > #16 squat_uidlist_map (uidlist=0x5645403767f0) at squat-uidlist.c:477 > > > mmap_hdr = <optimized out> > > > ret = <optimized out> > > > #17 0x00007f768a97b432 in squat_uidlist_open (uidlist=0x5645403767f0) at squat-uidlist.c:546 > > > No locals. > > > #18 0x00007f768a97b5aa in squat_uidlist_refresh (uidlist=<optimized out>) at squat-uidlist.c:569 > > > No locals. > > > #19 0x00007f768a9787c2 in squat_trie_map (trie=0x564540376490, building=<optimized out>) at squat-trie.c:1526 > > > file_lock = 0x56454210c710 > > > dotlock = 0x0 > > > changed = <optimized out> > > > ret = <optimized out> > > > #20 0x00007f768a97b19d in squat_uidlist_map_header (uidlist=0x5645403767f0) at squat-uidlist.c:378 > > > No locals. > > > #21 squat_uidlist_map (uidlist=0x5645403767f0) at squat-uidlist.c:477 > > > mmap_hdr = <optimized out> > > > ret = <optimized out> > > > #22 0x00007f768a97b432 in squat_uidlist_open (uidlist=0x5645403767f0) at squat-uidlist.c:546 > > > No locals. > > > #23 0x00007f768a97b5aa in squat_uidlist_refresh (uidlist=<optimized out>) at squat-uidlist.c:569 > > > No locals. > > > #24 0x00007f768a9787c2 in squat_trie_map (trie=0x564540376490, building=<optimized out>) at squat-trie.c:1526 > > > file_lock = 0x56454210c670 > > > dotlock = 0x0 > > > changed = <optimized out> > > > ret = <optimized out> > > > #25 0x00007f768a97b19d in squat_uidlist_map_header (uidlist=0x5645403767f0) at squat-uidlist.c:378 > > > No locals. > > > #26 squat_uidlist_map (uidlist=0x5645403767f0) at squat-uidlist.c:477 > > > mmap_hdr = <optimized out> > > > ret = <optimized out> > > > #27 0x00007f768a97b432 in squat_uidlist_open (uidlist=0x5645403767f0) at squat-uidlist.c:546 > > > No locals. > > > #28 0x00007f768a97b5aa in squat_uidlist_refresh (uidlist=<optimized out>) at squat-uidlist.c:569 > > > No locals. > > > #29 0x00007f768a9787c2 in squat_trie_map (trie=0x564540376490, building=<optimized out>) at squat-trie.c:1526 > > > file_lock = 0x56454210c5d0 > > > dotlock = 0x0 > > > changed = <optimized out> > > > ret = <optimized out> > > > #30 0x00007f768a97b19d in squat_uidlist_map_header (uidlist=0x5645403767f0) at squat-uidlist.c:378 > > > No locals. > > > #31 squat_uidlist_map (uidlist=0x5645403767f0) at squat-uidlist.c:477 > > > mmap_hdr = <optimized out> > > > ret = <optimized out> > > > #32 0x00007f768a97b432 in squat_uidlist_open (uidlist=0x5645403767f0) at squat-uidlist.c:546 > > > No locals. > > > #33 0x00007f768a97b5aa in squat_uidlist_refresh (uidlist=<optimized out>) at squat-uidlist.c:569 > > > No locals. > > > #34 0x00007f768a9787c2 in squat_trie_map (trie=0x564540376490, building=<optimized out>) at squat-trie.c:1526 > > > file_lock = 0x56454210c530 > > > dotlock = 0x0 > > > changed = <optimized out> > > > ret = <optimized out> > > > #35 0x00007f768a97b19d in squat_uidlist_map_header (uidlist=0x5645403767f0) at squat-uidlist.c:378 > > > No locals. > > > #36 squat_uidlist_map (uidlist=0x5645403767f0) at squat-uidlist.c:477 > > > mmap_hdr = <optimized out> > > > ret = <optimized out> > > > #37 0x00007f768a97b432 in squat_uidlist_open (uidlist=0x5645403767f0) at squat-uidlist.c:546 > > > No locals. > > > #38 0x00007f768a97b5aa in squat_uidlist_refresh (uidlist=<optimized out>) at squat-uidlist.c:569 > > > No locals. > > > #39 0x00007f768a9787c2 in squat_trie_map (trie=0x564540376490, building=<optimized out>) at squat-trie.c:1526 > > > file_lock = 0x56454210c490 > > > dotlock = 0x0 > > > changed = <optimized out> > > > ret = <optimized out> > > > #40 0x00007f768a97b19d in squat_uidlist_map_header (uidlist=0x5645403767f0) at squat-uidlist.c:378 > > > No locals. > > > #41 squat_uidlist_map (uidlist=0x5645403767f0) at squat-uidlist.c:477 > > > mmap_hdr = <optimized out> > > > ret = <optimized out> > > > #42 0x00007f768a97b432 in squat_uidlist_open (uidlist=0x5645403767f0) at squat-uidlist.c:546 > > > No locals. > > > #43 0x00007f768a97b5aa in squat_uidlist_refresh (uidlist=<optimized out>) at squat-uidlist.c:569 > > > No locals. > > > #44 0x00007f768a9787c2 in squat_trie_map (trie=0x564540376490, building=<optimized out>) at squat-trie.c:1526 > > > file_lock = 0x56454210c3f0 > > > dotlock = 0x0 > > > changed = <optimized out> > > > ret = <optimized out> > > > #45 0x00007f768a97b19d in squat_uidlist_map_header (uidlist=0x5645403767f0) at squat-uidlist.c:378 > > > No locals. > > > #46 squat_uidlist_map (uidlist=0x5645403767f0) at squat-uidlist.c:477 > > > mmap_hdr = <optimized out> > > > ret = <optimized out> > > > #47 0x00007f768a97b432 in squat_uidlist_open (uidlist=0x5645403767f0) at squat-uidlist.c:546 > > > No locals. > > > #48 0x00007f768a97b5aa in squat_uidlist_refresh (uidlist=<optimized out>) at squat-uidlist.c:569 > > > No locals. > > > #49 0x00007f768a9787c2 in squat_trie_map (trie=0x564540376490, building=<optimized out>) at squat-trie.c:1526 > > > file_lock = 0x56454210c350 > > > dotlock = 0x0 > > > changed = <optimized out> > > > ret = <optimized out> > > > #50 0x00007f768a97b19d in squat_uidlist_map_header (uidlist=0x5645403767f0) at squat-uidlist.c:378 > > > #51 squat_uidlist_map (uidlist=0x5645403767f0) at squat-uidlist.c:477 > > > mmap_hdr = <optimized out> > > > ret = <optimized out> > > > #52 0x00007f768a97b432 in squat_uidlist_open (uidlist=0x5645403767f0) at squat-uidlist.c:546 > > > No locals. > > > #53 0x00007f768a97b5aa in squat_uidlist_refresh (uidlist=<optimized out>) at squat-uidlist.c:569 > > > No locals. > > > #54 0x00007f768a9787c2 in squat_trie_map (trie=0x564540376490, building=<optimized out>) at squat-trie.c:1526 > > > file_lock = 0x56454210c2b0 > > > dotlock = 0x0 > > > changed = <optimized out> > > > ret = <optimized out> > > > #55 0x00007f768a97b19d in squat_uidlist_map_header (uidlist=0x5645403767f0) at squat-uidlist.c:378 > > > No locals. > > > #56 squat_uidlist_map (uidlist=0x5645403767f0) at squat-uidlist.c:477 > > > mmap_hdr = <optimized out> > > > ret = <optimized out> > > > #57 0x00007f768a97b432 in squat_uidlist_open (uidlist=0x5645403767f0) at squat-uidlist.c:546 > > > No locals. > > > #58 0x00007f768a97b5aa in squat_uidlist_refresh (uidlist=<optimized out>) at squat-uidlist.c:569 > > > No locals. > > > #59 0x00007f768a9787c2 in squat_trie_map (trie=0x564540376490, building=<optimized out>) at squat-trie.c:1526 > > > file_lock = 0x56454210c210 > > > dotlock = 0x0 > > > changed = <optimized out> > > > ret = <optimized out> > > > #60 0x00007f768a97b19d in squat_uidlist_map_header (uidlist=0x5645403767f0) at squat-uidlist.c:378 > > > No locals. > > > #61 squat_uidlist_map (uidlist=0x5645403767f0) at squat-uidlist.c:477 > > > mmap_hdr = <optimized out> > > > ret = <optimized out> > > > #62 0x00007f768a97b432 in squat_uidlist_open (uidlist=0x5645403767f0) at squat-uidlist.c:546 > > > No locals. > > > #63 0x00007f768a97b5aa in squat_uidlist_refresh (uidlist=<optimized out>) at squat-uidlist.c:569 > > > No locals. > > > #64 0x00007f768a9787c2 in squat_trie_map (trie=0x564540376490, building=<optimized out>) at squat-trie.c:1526 > > > file_lock = 0x56454210c170 > > > dotlock = 0x0 > > > changed = <optimized out> > > > ret = <optimized out> > > > #65 0x00007f768a97b19d in squat_uidlist_map_header (uidlist=0x5645403767f0) at squat-uidlist.c:378 > > > No locals. > > > #66 squat_uidlist_map (uidlist=0x5645403767f0) at squat-uidlist.c:477 > > > mmap_hdr = <optimized out> > > > ret = <optimized out> > > > #67 0x00007f768a97b432 in squat_uidlist_open (uidlist=0x5645403767f0) at squat-uidlist.c:546 > > > No locals. > > > #68 0x00007f768a97b5aa in squat_uidlist_refresh (uidlist=<optimized out>) at squat-uidlist.c:569 > > > No locals. > > > #69 0x00007f768a9787c2 in squat_trie_map (trie=0x564540376490, building=<optimized out>) at squat-trie.c:1526 > > > file_lock = 0x56454210c0d0 > > > dotlock = 0x0 > > > changed = <optimized out> > > > ret = <optimized out> > > > #70 0x00007f768a97b19d in squat_uidlist_map_header (uidlist=0x5645403767f0) at squat-uidlist.c:378 > > > No locals. > > > #71 squat_uidlist_map (uidlist=0x5645403767f0) at squat-uidlist.c:477 > > > mmap_hdr = <optimized out> > > > ret = <optimized out> > > > #72 0x00007f768a97b432 in squat_uidlist_open (uidlist=0x5645403767f0) at squat-uidlist.c:546 > > > No locals. > > > #73 0x00007f768a97b5aa in squat_uidlist_refresh (uidlist=<optimized out>) at squat-uidlist.c:569 > > > No locals. > > > #74 0x00007f768a9787c2 in squat_trie_map (trie=0x564540376490, building=<optimized out>) at squat-trie.c:1526 > > > file_lock = 0x56454210c030 > > > dotlock = 0x0 > > > changed = <optimized out> > > > ret = <optimized out> > > > #75 0x00007f768a97b19d in squat_uidlist_map_header (uidlist=0x5645403767f0) at squat-uidlist.c:378 > > > No locals. > > > #76 squat_uidlist_map (uidlist=0x5645403767f0) at squat-uidlist.c:477 > > > mmap_hdr = <optimized out> > > > ret = <optimized out> > > > #77 0x00007f768a97b432 in squat_uidlist_open (uidlist=0x5645403767f0) at squat-uidlist.c:546 > > > No locals. > > > #78 0x00007f768a97b5aa in squat_uidlist_refresh (uidlist=<optimized out>) at squat-uidlist.c:569 > > > No locals. > > > #79 0x00007f768a9787c2 in squat_trie_map (trie=0x564540376490, building=<optimized out>) at squat-trie.c:1526 > > > file_lock = 0x56454210bf90 > > > dotlock = 0x0 > > > changed = <optimized out> > > > ret = <optimized out> > > > #80 0x00007f768a97b19d in squat_uidlist_map_header (uidlist=0x5645403767f0) at squat-uidlist.c:378 > > > No locals. > > > #81 squat_uidlist_map (uidlist=0x5645403767f0) at squat-uidlist.c:477 > > > mmap_hdr = <optimized out> > > > ret = <optimized out> > > > #82 0x00007f768a97b432 in squat_uidlist_open (uidlist=0x5645403767f0) at squat-uidlist.c:546 > > > No locals. > > > #83 0x00007f768a97b5aa in squat_uidlist_refresh (uidlist=<optimized out>) at squat-uidlist.c:569 > > > No locals. > > > #84 0x00007f768a9787c2 in squat_trie_map (trie=0x564540376490, building=<optimized out>) at squat-trie.c:1526 > > > file_lock = 0x56454210bef0 > > > dotlock = 0x0 > > > changed = <optimized out> > > > ret = <optimized out> > > > #85 0x00007f768a97b19d in squat_uidlist_map_header (uidlist=0x5645403767f0) at squat-uidlist.c:378 > > > No locals. > > > #86 squat_uidlist_map (uidlist=0x5645403767f0) at squat-uidlist.c:477 > > > mmap_hdr = <optimized out> > > > ret = <optimized out> > > > #87 0x00007f768a97b432 in squat_uidlist_open (uidlist=0x5645403767f0) at squat-uidlist.c:546 > > > No locals. > > > #88 0x00007f768a97b5aa in squat_uidlist_refresh (uidlist=<optimized out>) at squat-uidlist.c:569 > > > No locals. > > > #89 0x00007f768a9787c2 in squat_trie_map (trie=0x564540376490, building=<optimized out>) at squat-trie.c:1526 > > > file_lock = 0x56454210be50 > > > dotlock = 0x0 > > > changed = <optimized out> > > > ret = <optimized out> > > > #90 0x00007f768a97b19d in squat_uidlist_map_header (uidlist=0x5645403767f0) at squat-uidlist.c:378 > > > No locals. > > > #91 squat_uidlist_map (uidlist=0x5645403767f0) at squat-uidlist.c:477 > > > mmap_hdr = <optimized out> > > > ret = <optimized out> > > > #92 0x00007f768a97b432 in squat_uidlist_open (uidlist=0x5645403767f0) at squat-uidlist.c:546 > > > No locals. > > > #93 0x00007f768a97b5aa in squat_uidlist_refresh (uidlist=<optimized out>) at squat-uidlist.c:569 > > > No locals. > > > #94 0x00007f768a9787c2 in squat_trie_map (trie=0x564540376490, building=<optimized out>) at squat-trie.c:1526 > > > file_lock = 0x56454210bdb0 > > > dotlock = 0x0 > > > changed = <optimized out> > > > ret = <optimized out> > > > #95 0x00007f768a97b19d in squat_uidlist_map_header (uidlist=0x5645403767f0) at squat-uidlist.c:378 > > > No locals. > > > #96 squat_uidlist_map (uidlist=0x5645403767f0) at squat-uidlist.c:477 > > > mmap_hdr = <optimized out> > > > ret = <optimized out> > > > #97 0x00007f768a97b432 in squat_uidlist_open (uidlist=0x5645403767f0) at squat-uidlist.c:546 > > > No locals. > > > #98 0x00007f768a97b5aa in squat_uidlist_refresh (uidlist=<optimized out>) at squat-uidlist.c:569 > > > No locals. > > > #99 0x00007f768a9787c2 in squat_trie_map (trie=0x564540376490, building=<optimized out>) at squat-trie.c:1526 > > > file_lock = 0x56454210bd10 > > > dotlock = 0x0 > > > changed = <optimized out> > > > ret = <optimized out> > > > #100 0x00007f768a97b19d in squat_uidlist_map_header (uidlist=0x5645403767f0) at squat-uidlist.c:378 > > > No locals. > > > #101 squat_uidlist_map (uidlist=0x5645403767f0) at squat-uidlist.c:477 > > > mmap_hdr = <optimized out> > > > ret = <optimized out> > > > #102 0x00007f768a97b432 in squat_uidlist_open (uidlist=0x5645403767f0) at squat-uidlist.c:546 > > > No locals. > > > #103 0x00007f768a97b5aa in squat_uidlist_refresh (uidlist=<optimized out>) at squat-uidlist.c:569 > > > No locals. > > > #104 0x00007f768a9787c2 in squat_trie_map (trie=0x564540376490, building=<optimized out>) at squat-trie.c:1526 > > > file_lock = 0x56454210bc70 > > > dotlock = 0x0 > > > changed = <optimized out> > > > ret = <optimized out> > > > #105 0x00007f768a97b19d in squat_uidlist_map_header (uidlist=0x5645403767f0) at squat-uidlist.c:378 > > > No locals. > > > #106 squat_uidlist_map (uidlist=0x5645403767f0) at squat-uidlist.c:477 > > > mmap_hdr = <optimized out> > > > ret = <optimized out> > > > #107 0x00007f768a97b432 in squat_uidlist_open (uidlist=0x5645403767f0) at squat-uidlist.c:546 > > > No locals. > > > #108 0x00007f768a97b5aa in squat_uidlist_refresh (uidlist=<optimized out>) at squat-uidlist.c:569 > > > No locals. > > > #109 0x00007f768a9787c2 in squat_trie_map (trie=0x564540376490, building=<optimized out>) at squat-trie.c:1526 > > > file_lock = 0x56454210bbd0 > > > dotlock = 0x0 > > > changed = <optimized out> > > > ret = <optimized out> > > > #110 0x00007f768a97b19d in squat_uidlist_map_header (uidlist=0x5645403767f0) at squat-uidlist.c:378 > > > No locals. > > > #111 squat_uidlist_map (uidlist=0x5645403767f0) at squat-uidlist.c:477 > > > mmap_hdr = <optimized out> > > > ret = <optimized out> > > > #112 0x00007f768a97b432 in squat_uidlist_open (uidlist=0x5645403767f0) at squat-uidlist.c:546 > > > No locals. > > > #113 0x00007f768a97b5aa in squat_uidlist_refresh (uidlist=<optimized out>) at squat-uidlist.c:569 > > > No locals. > > > #114 0x00007f768a9787c2 in squat_trie_map (trie=0x564540376490, building=<optimized out>) at squat-trie.c:1526 > > > file_lock = 0x56454210bb30 > > > dotlock = 0x0 > > > changed = <optimized out> > > > ret = <optimized out> > > > #115 0x00007f768a97b19d in squat_uidlist_map_header (uidlist=0x5645403767f0) at squat-uidlist.c:378 > > > No locals. > > > #116 squat_uidlist_map (uidlist=0x5645403767f0) at squat-uidlist.c:477 > > > mmap_hdr = <optimized out> > > > ret = <optimized out> > > > #117 0x00007f768a97b432 in squat_uidlist_open (uidlist=0x5645403767f0) at squat-uidlist.c:546 > > > No locals. > > > #118 0x00007f768a97b5aa in squat_uidlist_refresh (uidlist=<optimized out>) at squat-uidlist.c:569 > > > No locals. > > > #119 0x00007f768a9787c2 in squat_trie_map (trie=0x564540376490, building=<optimized out>) at squat-trie.c:1526 > > > file_lock = 0x56454210ba90 > > > dotlock = 0x0 > > > changed = <optimized out> > > > ret = <optimized out> > > > #120 0x00007f768a97b19d in squat_uidlist_map_header (uidlist=0x5645403767f0) at squat-uidlist.c:378 > > > No locals. > > > #121 squat_uidlist_map (uidlist=0x5645403767f0) at squat-uidlist.c:477 > > > mmap_hdr = <optimized out> > > > ret = <optimized out> > > > #122 0x00007f768a97b432 in squat_uidlist_open (uidlist=0x5645403767f0) at squat-uidlist.c:546 > > > No locals. > > > #123 0x00007f768a97b5aa in squat_uidlist_refresh (uidlist=<optimized out>) at squat-uidlist.c:569 > > > No locals. > > > #124 0x00007f768a9787c2 in squat_trie_map (trie=0x564540376490, building=<optimized out>) at squat-trie.c:1526 > > > file_lock = 0x56454210b9f0 > > > dotlock = 0x0 > > > changed = <optimized out> > > > > > > (continues for ages) > > > > > > On 2018-11-29 19:36, Joan Moreau wrote: > > > > > > finally managed to locate the dump > > > > > > here the output: > > > > > > # gdb /usr/libexec/dovecot/auth /var/lib/systemd/coredump/core.auth.0.3a33f56105e043de802a7dfcee265a07.28130.1543516118000000 > > > GNU gdb (GDB) 8.2 > > > (gdb) bt full > > > #0 0x00007f739c35cd7f in raise () from /usr/lib/libc.so.6 > > > No symbol table info available. > > > #1 0x00007f739c347672 in abort () from /usr/lib/libc.so.6 > > > No symbol table info available. > > > #2 0x00007f739c39f878 in __libc_message () from /usr/lib/libc.so.6 > > > No symbol table info available. > > > #3 0x00007f739c3a618a in malloc_printerr () from /usr/lib/libc.so.6 > > > No symbol table info available. > > > #4 0x00007f739c3a7b27 in _int_free () from /usr/lib/libc.so.6 > > > No symbol table info available. > > > #5 0x00007f739cc33585 in mysql_close (mysql=0x5636af7abdc0) at /usr/src/mariadb-10.3.11/libmariadb/libmariadb/mariadb_lib.c:1939 > > > mysql = 0x5636af7abdc0 > > > p = <optimized out> > > > p = <optimized out> > > > #6 0x00005636aef08f7c in driver_sqlpool_disconnect (_db=0x5636af7aaf30) at driver-sqlpool.c:590 > > > conn__foreach_end = 0x5636af7ab570 > > > db = 0x5636af7aaf30 > > > conn = 0x5636af7ab560 > > > #7 0x00005636aeefed65 in db_sql_unref (_conn=0x5636af7b0020) at db-sql.c:128 > > > conn = 0x5636af7ae388 > > > #8 0x00005636aeef7e15 in userdb_deinit (userdb=0x5636af7afff8) at userdb.c:191 > > > idx = 0 > > > __func__ = "userdb_deinit" > > > #9 0x00005636aeede209 in auth_deinit (auth=0x5636af7afd58) at auth.c:335 > > > passdb = <optimized out> > > > userdb = 0x5636af7aff18 > > > passdb = <optimized out> > > > userdb = <optimized out> > > > #10 auths_deinit () at auth.c:433 > > > auth__foreach_end = 0x5636af7ae2f8 > > > auth = 0x5636af7ae2f0 > > > #11 0x00005636aeedcf65 in main_deinit () at main.c:270 > > > l = <optimized out> > > > l = <optimized out> > > > l_end = <optimized out> > > > #12 main (argc=<optimized out>, argv=<optimized out>) at main.c:401 > > > c = <optimized out> > > > > On 27.11.2018 8.39, Joan Moreau wrote: > > > > Thank you Aki > > > > here the requested data (below) > > > > Please not as well that we have numerous subfolders (>50) and pretty big > > mailbox sizes (>20G) > > > > Bug appears mostly in auth process and index-worker > > > > dovecot -n : > > > > # 2.4.devel (de42b54aa): /etc/dovecot/dovecot.conf > > # Pigeonhole version 0.6.devel (65909cfa) > > # OS: Linux 4.19.4-arch1-1-ARCH x86_64 ext4 > > # Hostname: gjserver > > base_dir = /run/dovecot > > default_login_user = dovecot > > default_vsz_limit = 16 G > > disable_plaintext_auth = no > > listen = * > > log_path = /var/log/mail/dovecot.log > > mail_gid = mail > > mail_location = mdbox:/data/mail/%d/%n:ALT=/data/mail/archives/%d/%n > > mail_plugins = fts fts_squat > > mail_uid = mailusers > > managesieve_notify_capability = mailto > > managesieve_sieve_capability = fileinto reject envelope > > encoded-character vacation subaddress comparator-i;ascii-numeric > > relational regex imap4flags copy include variables body enotify > > environment mailbox date index ihave duplicate mime foreverypart > > extracttext > > mdbox_rotate_size = 24 M > > > > (...) > > > > passdb { > > args = /etc/dovecot/dovecot-sql.conf > > driver = sql > > } > > (the rest default values) > > fts squat was already deprecated in 2.2, and it's considered obsolete in > > 2.3. We hopefully get around removing it from 2.4, but you should move > > away from it to Solr. > > > > The MySQL crash has been fixed in master, see > > https://github.com/dovecot/core/commit/3c5101ffdd2a8115e03ed7180d53578765dea4c9.patch > > > > Aki