dovecot - Apr 2015 - Dovecot 2.2.16: disappearing messages, mismatched summaries, duplicated messages, excessive full re-downloads

Edgar, thanks for the help!

-------- Original Message --------
Subject: Re: Dovecot 2.2.16: disappearing messages, mismatched summaries,
duplicated messages, excessive full re-downloads
From: Edgar Pettijohn III <edgar at pettijohn-web.com>
To: David Gessel <gessel at blackrosetech.com>
Date: Sat Apr 18 2015 16:30:07 GMT+0300 (Arabic Standard Time)
> 
> On Apr 18, 2015, at 8:00 AM, David Gessel wrote:
> 
>>
>>
>> -------- Original Message --------
>> Subject: Re: Dovecot 2.2.16: disappearing messages, mismatched
summaries, duplicated messages, excessive full re-downloads
>> From: Timo Sirainen <tss at iki.fi>
>> To: David Gessel <gessel at blackrosetech.com>
>> Date: Sat Apr 18 2015 15:48:28 GMT+0300 (Arabic Standard Time)
>>
>>> No. My best guess is that (your) ZFS+FreeBSD is simply not behaving
the way Dovecot wants filesystems to behave (readdir() sometimes skipping over
files). I don't have any other suggestion than trying a different filesystem
or OS. I haven't heard ZFS having these problems before though.
>>
>>
>> Or migrating to sdbox.  Absent any further suggestions, that will be my
next step.  My commitment to Maildir is far lower than my commitment to
FreeBSD/ZFS.  It is just a historical preference coming from a decade+ of
courier IMAP.
> 
> 
> 
> What is the output for:
> 
> # zpool status
> 
> perhaps you have a hardware issue?
> 
All good - quite reliable hardware:  IBM x3655 dual AMD quad core, 40GB of ECC
RAM, 8x IBM 2.5" SAS on battery-backed ServeRAID, RAID 6 and (somewhat
pointlessly) ZFS2.  All IBM server diagnostics check, full RAM check run without
errors, no ECC corrections reported, no uncorrectable errors reported.



 # zpool status
  pool: bootpool
 state: ONLINE
  scan: none requested
config:

        NAME        STATE     READ WRITE CKSUM
        bootpool    ONLINE       0     0     0
          aacd0s1a  ONLINE       0     0     0

errors: No known data errors

  pool: zroot
 state: ONLINE
  scan: none requested
config:

        NAME            STATE     READ WRITE CKSUM
        zroot           ONLINE       0     0     0
          aacd0s1d.eli  ONLINE       0     0     0

errors: No known data errors

On Apr 18, 2015, at 9:09 AM, David Gessel wrote:
> Edgar, thanks for the help!
> 
> -------- Original Message --------
> Subject: Re: Dovecot 2.2.16: disappearing messages, mismatched summaries,
duplicated messages, excessive full re-downloads
> From: Edgar Pettijohn III <edgar at pettijohn-web.com>
> To: David Gessel <gessel at blackrosetech.com>
> Date: Sat Apr 18 2015 16:30:07 GMT+0300 (Arabic Standard Time)
> 
>> 
>> On Apr 18, 2015, at 8:00 AM, David Gessel wrote:
>> 
>>> 
>>> 
>>> -------- Original Message --------
>>> Subject: Re: Dovecot 2.2.16: disappearing messages, mismatched
summaries, duplicated messages, excessive full re-downloads
>>> From: Timo Sirainen <tss at iki.fi>
>>> To: David Gessel <gessel at blackrosetech.com>
>>> Date: Sat Apr 18 2015 15:48:28 GMT+0300 (Arabic Standard Time)
>>> 
>>>> No. My best guess is that (your) ZFS+FreeBSD is simply not
behaving the way Dovecot wants filesystems to behave (readdir() sometimes
skipping over files). I don't have any other suggestion than trying a
different filesystem or OS. I haven't heard ZFS having these problems before
though.
>>> 
>>> 
>>> Or migrating to sdbox.  Absent any further suggestions, that will
be my next step.  My commitment to Maildir is far lower than my commitment to
FreeBSD/ZFS.  It is just a historical preference coming from a decade+ of
courier IMAP.
>> 
>> 
>> 
>> What is the output for:
>> 
>> # zpool status
>> 
>> perhaps you have a hardware issue?
>> 
> 
> All good - quite reliable hardware:  IBM x3655 dual AMD quad core, 40GB of
ECC RAM, 8x IBM 2.5" SAS on battery-backed ServeRAID, RAID 6 and (somewhat
pointlessly) ZFS2.  All IBM server diagnostics check, full RAM check run without
errors, no ECC corrections reported, no uncorrectable errors reported.
> 
> 
> 
> # zpool status
>  pool: bootpool
> state: ONLINE
>  scan: none requested
> config:
> 
>        NAME        STATE     READ WRITE CKSUM
>        bootpool    ONLINE       0     0     0
>          aacd0s1a  ONLINE       0     0     0
> 
> errors: No known data errors
> 
>  pool: zroot
> state: ONLINE
>  scan: none requested
> config:
> 
>        NAME            STATE     READ WRITE CKSUM
>        zroot           ONLINE       0     0     0
>          aacd0s1d.eli  ONLINE       0     0     0
> 
> errors: No known data errors

are you using compression? If so which.

-------- Original Message --------
Subject: Re: Dovecot 2.2.16: disappearing messages, mismatched summaries,
duplicated messages, excessive full re-downloads
From: Edgar Pettijohn III <edgar at pettijohn-web.com>
To: David Gessel <gessel at blackrosetech.com>
Date: Sat Apr 18 2015 17:20:30 GMT+0300 (Arabic Standard Time)
> 
> On Apr 18, 2015, at 9:09 AM, David Gessel wrote:
> 
>> Edgar, thanks for the help!
>>
>> -------- Original Message --------
>> Subject: Re: Dovecot 2.2.16: disappearing messages, mismatched
summaries, duplicated messages, excessive full re-downloads
>> From: Edgar Pettijohn III <edgar at pettijohn-web.com>
>> To: David Gessel <gessel at blackrosetech.com>
>> Date: Sat Apr 18 2015 16:30:07 GMT+0300 (Arabic Standard Time)
>>
>>>
>>> On Apr 18, 2015, at 8:00 AM, David Gessel wrote:
>>>
>>>>
>>>>
>>>> -------- Original Message --------
>>>> Subject: Re: Dovecot 2.2.16: disappearing messages, mismatched
summaries, duplicated messages, excessive full re-downloads
>>>> From: Timo Sirainen <tss at iki.fi>
>>>> To: David Gessel <gessel at blackrosetech.com>
>>>> Date: Sat Apr 18 2015 15:48:28 GMT+0300 (Arabic Standard Time)
>>>>
>>>>> No. My best guess is that (your) ZFS+FreeBSD is simply not
behaving the way Dovecot wants filesystems to behave (readdir() sometimes
skipping over files). I don't have any other suggestion than trying a
different filesystem or OS. I haven't heard ZFS having these problems before
though.
>>>>
>>>>
>>>> Or migrating to sdbox.  Absent any further suggestions, that
will be my next step.  My commitment to Maildir is far lower than my commitment
to FreeBSD/ZFS.  It is just a historical preference coming from a decade+ of
courier IMAP.
>>>
>>>
>>>
>>> What is the output for:
>>>
>>> # zpool status
>>>
>>> perhaps you have a hardware issue?
>>>
>>
>> All good - quite reliable hardware:  IBM x3655 dual AMD quad core, 40GB
of ECC RAM, 8x IBM 2.5" SAS on battery-backed ServeRAID, RAID 6 and
(somewhat pointlessly) ZFS2.  All IBM server diagnostics check, full RAM check
run without errors, no ECC corrections reported, no uncorrectable errors
reported.
>>
>>
>>
>> # zpool status
>>  pool: bootpool
>> state: ONLINE
>>  scan: none requested
>> config:
>>
>>        NAME        STATE     READ WRITE CKSUM
>>        bootpool    ONLINE       0     0     0
>>          aacd0s1a  ONLINE       0     0     0
>>
>> errors: No known data errors
>>
>>  pool: zroot
>> state: ONLINE
>>  scan: none requested
>> config:
>>
>>        NAME            STATE     READ WRITE CKSUM
>>        zroot           ONLINE       0     0     0
>>          aacd0s1d.eli  ONLINE       0     0     0
>>
>> errors: No known data errors
> 
> 
> are you using compression? If so which.
> 

Yes, lz4.