On Apr 7, 2017, at 11:17 AM, Aki Tuomi <aki.tuomi at dovecot.fi> wrote:>> On April 7, 2017 at 6:00 PM "Daniel J. Luke" <dluke at geeklair.net> wrote: >> On Apr 7, 2017, at 3:01 AM, Aki Tuomi <aki.tuomi at dovecot.fi> wrote: >>>> On April 7, 2017 at 9:38 AM Timo Sirainen <tss at iki.fi> wrote: >>>> On 7 Apr 2017, at 2.25, Daniel J. Luke <dluke at geeklair.net> wrote: >>>>> >>>>> On Apr 6, 2017, at 1:33 PM, Timo Sirainen <tss at iki.fi> wrote: >>>>>> Planning to release v2.2.29 on Monday. Please find and report any bugs before that. >>>>> >>>>> I'm seeing still seeing the assert that started showing up for me with 2.2.28 (https://www.dovecot.org/pipermail/dovecot/2017-February/107250.html) >>>>> >>>>> Below I generate it using doveadm with dovecot 2.2.29rc1 (output slightly cleaned up so the backtrace is easier to read) >>>>> >>>>> % sudo doveadm index -A \* >>>>> doveadm(dluke): Panic: file mailbox-list.c: line 1159 (mailbox_list_try_mkdir_root): assertion failed: (strncmp(root_dir, path, strlen(root_dir)) == 0) >>>> >>>> This is with mbox? I thought this had been happening already a long time.. Or if not mbox, what's your doveconf -n? >> >> this is mbox & lucene >> >>> for mbox and lucene, there is a workaround, which is to create directory under the INDEXES directory called lucene-indexes. >>> >>> This way the directory creation is not attempted, this is a known bug, but just hasn't been fixed yet. >> >> That directory already exists. >> >> mail_location = mbox:~/Mail/:INBOX=~/.mbox >> >> % ls -l ~/Mail/.imap/lucene-indexes/ >> total 429344 >> -rw------- 1 dluke dluke 209M Apr 6 11:12 _30ms.cfs >> -rw------- 1 dluke dluke 1.0M Apr 7 08:10 _30rt.cfs >> -rw------- 1 dluke dluke 7.2K Apr 7 08:10 _30ru.cfs >> -rw------- 1 dluke dluke 6.3K Apr 7 08:11 _30rv.cfs >> -rw------- 1 dluke dluke 7.6K Apr 7 08:11 _30rw.cfs >> -rw------- 1 dluke dluke 3.8K Apr 7 10:57 _30rx.cfs >> -rw------- 1 dluke dluke 3.8K Apr 7 10:58 _30ry.cfs >> -rw------- 1 dluke dluke 3.8K Apr 7 10:58 _30rz.cfs >> -rw------- 1 dluke dluke 2.3K Apr 7 10:58 dovecot-expunges.log >> -rw------- 1 dluke dluke 20B Apr 7 10:58 segments.gen >> -rw------- 1 dluke dluke 244B Apr 7 10:58 segments_6214 >> >> When running 2.2.27 this doesn't happen. > > Can you try moving it one folder up, so that it's not under .imap?Sure, that fixes that, but I end up with lots of log messages like: 2017-04-07 11:43:53.958590-0400 localhost log[5770]: (libdovecot.0.dylib) indexer-worker(dluke): Error: Syncing mailbox lucene-indexes/_0.cfs failed: Mailbox isn't a valid mbox file (and the lucene-indexes "folder" appears in Mail.app, which is going to confuse some of my users) -- Daniel J. Luke
> On April 7, 2017 at 6:48 PM "Daniel J. Luke" <dluke at geeklair.net> wrote: > > > On Apr 7, 2017, at 11:17 AM, Aki Tuomi <aki.tuomi at dovecot.fi> wrote: > >> On April 7, 2017 at 6:00 PM "Daniel J. Luke" <dluke at geeklair.net> wrote: > >> On Apr 7, 2017, at 3:01 AM, Aki Tuomi <aki.tuomi at dovecot.fi> wrote: > >>>> On April 7, 2017 at 9:38 AM Timo Sirainen <tss at iki.fi> wrote: > >>>> On 7 Apr 2017, at 2.25, Daniel J. Luke <dluke at geeklair.net> wrote: > >>>>> > >>>>> On Apr 6, 2017, at 1:33 PM, Timo Sirainen <tss at iki.fi> wrote: > >>>>>> Planning to release v2.2.29 on Monday. Please find and report any bugs before that. > >>>>> > >>>>> I'm seeing still seeing the assert that started showing up for me with 2.2.28 (https://www.dovecot.org/pipermail/dovecot/2017-February/107250.html) > >>>>> > >>>>> Below I generate it using doveadm with dovecot 2.2.29rc1 (output slightly cleaned up so the backtrace is easier to read) > >>>>> > >>>>> % sudo doveadm index -A \* > >>>>> doveadm(dluke): Panic: file mailbox-list.c: line 1159 (mailbox_list_try_mkdir_root): assertion failed: (strncmp(root_dir, path, strlen(root_dir)) == 0) > >>>> > >>>> This is with mbox? I thought this had been happening already a long time.. Or if not mbox, what's your doveconf -n? > >> > >> this is mbox & lucene > >> > >>> for mbox and lucene, there is a workaround, which is to create directory under the INDEXES directory called lucene-indexes. > >>> > >>> This way the directory creation is not attempted, this is a known bug, but just hasn't been fixed yet. > >> > >> That directory already exists. > >> > >> mail_location = mbox:~/Mail/:INBOX=~/.mbox > >> > >> % ls -l ~/Mail/.imap/lucene-indexes/ > >> total 429344 > >> -rw------- 1 dluke dluke 209M Apr 6 11:12 _30ms.cfs > >> -rw------- 1 dluke dluke 1.0M Apr 7 08:10 _30rt.cfs > >> -rw------- 1 dluke dluke 7.2K Apr 7 08:10 _30ru.cfs > >> -rw------- 1 dluke dluke 6.3K Apr 7 08:11 _30rv.cfs > >> -rw------- 1 dluke dluke 7.6K Apr 7 08:11 _30rw.cfs > >> -rw------- 1 dluke dluke 3.8K Apr 7 10:57 _30rx.cfs > >> -rw------- 1 dluke dluke 3.8K Apr 7 10:58 _30ry.cfs > >> -rw------- 1 dluke dluke 3.8K Apr 7 10:58 _30rz.cfs > >> -rw------- 1 dluke dluke 2.3K Apr 7 10:58 dovecot-expunges.log > >> -rw------- 1 dluke dluke 20B Apr 7 10:58 segments.gen > >> -rw------- 1 dluke dluke 244B Apr 7 10:58 segments_6214 > >> > >> When running 2.2.27 this doesn't happen. > > > > Can you try moving it one folder up, so that it's not under .imap? > > Sure, that fixes that, but I end up with lots of log messages like: > > 2017-04-07 11:43:53.958590-0400 localhost log[5770]: (libdovecot.0.dylib) indexer-worker(dluke): Error: Syncing mailbox lucene-indexes/_0.cfs failed: Mailbox isn't a valid mbox file > > (and the lucene-indexes "folder" appears in Mail.app, which is going to confuse some of my users) > > -- > Daniel J. LukeJust wanted to factor in the bug. So.. as workaround, you *could* move indexes to separate directory, using INDEXES= parameter. And move the lucene-indexes to this folder. But thank you, this helps a bit. Aki
On Apr 7, 2017, at 11:54 AM, Aki Tuomi <aki.tuomi at dovecot.fi> wrote:> So.. as workaround, you *could* move indexes to separate directory, using INDEXES= parameter. And move the lucene-indexes to this folder. But thank you, this helps a bit.I'm happy to do anything else to test if you'd like. I did go ahead and set INDEXES and can confirm that this does work around the bug. -- Daniel J. Luke
> On April 7, 2017 at 6:54 PM Aki Tuomi <aki.tuomi at dovecot.fi> wrote: > > > > > On April 7, 2017 at 6:48 PM "Daniel J. Luke" <dluke at geeklair.net> wrote: > > > > > > On Apr 7, 2017, at 11:17 AM, Aki Tuomi <aki.tuomi at dovecot.fi> wrote: > > >> On April 7, 2017 at 6:00 PM "Daniel J. Luke" <dluke at geeklair.net> wrote: > > >> On Apr 7, 2017, at 3:01 AM, Aki Tuomi <aki.tuomi at dovecot.fi> wrote: > > >>>> On April 7, 2017 at 9:38 AM Timo Sirainen <tss at iki.fi> wrote: > > >>>> On 7 Apr 2017, at 2.25, Daniel J. Luke <dluke at geeklair.net> wrote: > > >>>>> > > >>>>> On Apr 6, 2017, at 1:33 PM, Timo Sirainen <tss at iki.fi> wrote: > > >>>>>> Planning to release v2.2.29 on Monday. Please find and report any bugs before that. > > >>>>> > > >>>>> I'm seeing still seeing the assert that started showing up for me with 2.2.28 (https://www.dovecot.org/pipermail/dovecot/2017-February/107250.html) > > >>>>> > > >>>>> Below I generate it using doveadm with dovecot 2.2.29rc1 (output slightly cleaned up so the backtrace is easier to read) > > >>>>> > > >>>>> % sudo doveadm index -A \* > > >>>>> doveadm(dluke): Panic: file mailbox-list.c: line 1159 (mailbox_list_try_mkdir_root): assertion failed: (strncmp(root_dir, path, strlen(root_dir)) == 0) > > >>>> > > >>>> This is with mbox? I thought this had been happening already a long time.. Or if not mbox, what's your doveconf -n? > > >> > > >> this is mbox & lucene > > >> > > >>> for mbox and lucene, there is a workaround, which is to create directory under the INDEXES directory called lucene-indexes. > > >>> > > >>> This way the directory creation is not attempted, this is a known bug, but just hasn't been fixed yet. > > >> > > >> That directory already exists. > > >> > > >> mail_location = mbox:~/Mail/:INBOX=~/.mbox > > >> > > >> % ls -l ~/Mail/.imap/lucene-indexes/ > > >> total 429344 > > >> -rw------- 1 dluke dluke 209M Apr 6 11:12 _30ms.cfs > > >> -rw------- 1 dluke dluke 1.0M Apr 7 08:10 _30rt.cfs > > >> -rw------- 1 dluke dluke 7.2K Apr 7 08:10 _30ru.cfs > > >> -rw------- 1 dluke dluke 6.3K Apr 7 08:11 _30rv.cfs > > >> -rw------- 1 dluke dluke 7.6K Apr 7 08:11 _30rw.cfs > > >> -rw------- 1 dluke dluke 3.8K Apr 7 10:57 _30rx.cfs > > >> -rw------- 1 dluke dluke 3.8K Apr 7 10:58 _30ry.cfs > > >> -rw------- 1 dluke dluke 3.8K Apr 7 10:58 _30rz.cfs > > >> -rw------- 1 dluke dluke 2.3K Apr 7 10:58 dovecot-expunges.log > > >> -rw------- 1 dluke dluke 20B Apr 7 10:58 segments.gen > > >> -rw------- 1 dluke dluke 244B Apr 7 10:58 segments_6214 > > >> > > >> When running 2.2.27 this doesn't happen. > > > > > > Can you try moving it one folder up, so that it's not under .imap? > > > > Sure, that fixes that, but I end up with lots of log messages like: > > > > 2017-04-07 11:43:53.958590-0400 localhost log[5770]: (libdovecot.0.dylib) indexer-worker(dluke): Error: Syncing mailbox lucene-indexes/_0.cfs failed: Mailbox isn't a valid mbox file > > > > (and the lucene-indexes "folder" appears in Mail.app, which is going to confuse some of my users) > > > > -- > > Daniel J. Luke > > Just wanted to factor in the bug. > > So.. as workaround, you *could* move indexes to separate directory, using INDEXES= parameter. And move the lucene-indexes to this folder. But thank you, this helps a bit. > > AkiHi Daniel, https://github.com/dovecot/core/compare/c42ec3f%5E...2bc82f0.patch we believe this fixes your issue. Aki