dovecot - Oct 2020 - Dovecot replication not picking up new mail in maildir

On 26/10/2020 19:25, John Fawcett wrote:
> On 25/10/2020 17:19, jayare~dcml at videocoding.org wrote:
>> I've got a basic dovecot master-master replication setup between
two
>> servers (imap1 and imap2). Actions such as deleting messages or moving
>> them between folders are replicated correctly and quickly.
>>
>> However, when new mail is delivered by postfix, replication does not
>> occur until something else triggers it, such as one of the delete/move
>> actions mentioned earlier. A search suggested this may be due to the
>> notify plugin, but I don't see any issue with the settings. Output
of
>> doveconf -n:
>
> Hi
>
> is there any error in the log?
>
> Can you show some evidence or an example? ie some email delivery in the
> master but not on the slave?
>
> Can you be sure to check both new and cur subdirectories on master and
> slave?
>
> John
There's precisely nothing in the log.  The new mail arrives on the master,
and it is as though dovecot completely ignores it for the purposes of
replication.

However, I think I have solved the problem by enabling LMTP and forcing postfix
to go through that rather than writing to the maildir directly.  Perhaps LMTP is
required for replication and I just didn't realize it.  End result is (I
think) it is working properly.

J

-------------- next part --------------
An HTML attachment was scrubbed...
URL:
<https://dovecot.org/pipermail/dovecot/attachments/20201027/ed876654/attachment.html>

> On 27/10/2020 14:49 Justin Ridge <jayare-dcml at outlook.com> wrote:
> 
> 
> On 26/10/2020 19:25, John Fawcett wrote:
> > On 25/10/2020 17:19, jayare~dcml at videocoding.org wrote:
> >> I've got a basic dovecot master-master replication setup
between two
> >> servers (imap1 and imap2). Actions such as deleting messages or
moving
> >> them between folders are replicated correctly and quickly.
> >>
> >> However, when new mail is delivered by postfix, replication does
not
> >> occur until something else triggers it, such as one of the
delete/move
> >> actions mentioned earlier. A search suggested this may be due to
the
> >> notify plugin, but I don't see any issue with the settings.
Output of
> >> doveconf -n:
> >
> > Hi
> >
> > is there any error in the log?
> >
> > Can you show some evidence or an example? ie some email delivery in
the
> > master but not on the slave?
> >
> > Can you be sure to check both new and cur subdirectories on master and
> > slave?
> >
> > John
> 
>  There's precisely nothing in the log. The new mail arrives on the
master, and it is as though dovecot completely ignores it for the purposes of
replication.
> 
> 
> However, I think I have solved the problem by enabling LMTP and forcing
postfix to go through that rather than writing to the maildir directly. Perhaps
LMTP is required for replication and I just didn't realize it. End result is
(I think) it is working properly.
> 
> 
> J
> 
>

> On 27/10/2020 14:49 Justin Ridge <jayare-dcml at outlook.com> wrote:
> 
> 
> On 26/10/2020 19:25, John Fawcett wrote:
> > On 25/10/2020 17:19, jayare~dcml at videocoding.org wrote:
> >> I've got a basic dovecot master-master replication setup
between two
> >> servers (imap1 and imap2). Actions such as deleting messages or
moving
> >> them between folders are replicated correctly and quickly.
> >>
> >> However, when new mail is delivered by postfix, replication does
not
> >> occur until something else triggers it, such as one of the
delete/move
> >> actions mentioned earlier. A search suggested this may be due to
the
> >> notify plugin, but I don't see any issue with the settings.
Output of
> >> doveconf -n:
> >
> > Hi
> >
> > is there any error in the log?
> >
> > Can you show some evidence or an example? ie some email delivery in
the
> > master but not on the slave?
> >
> > Can you be sure to check both new and cur subdirectories on master and
> > slave?
> >
> > John
> 
>  There's precisely nothing in the log. The new mail arrives on the
master, and it is as though dovecot completely ignores it for the purposes of
replication.
> 
> 
> However, I think I have solved the problem by enabling LMTP and forcing
postfix to go through that rather than writing to the maildir directly. Perhaps
LMTP is required for replication and I just didn't realize it. End result is
(I think) it is working properly.
> 
> 
> J
> 
>
Sorry for empty mail, butterfingers...

Anyways, since replication is triggered by "replication" plugin, you
need to involve either dovecot-lda or lmtp to the delivery process. Dovecot
*will not* pick up replication need if you just drop files into the maildir as
nothing will trigger dovecot code.

Aki

On 10/27/2020 7:56 AM, Aki Tuomi wrote:
> 
>> On 27/10/2020 14:49 jayare-dcml at outlook.com wrote:
>>
>>
>> On 26/10/2020 19:25, John Fawcett wrote:
>>> On 25/10/2020 17:19, jayare~dcml at videocoding.org wrote:
>>>> I've got a basic dovecot master-master replication setup
between two
>>>> servers (imap1 and imap2). Actions such as deleting messages or
moving
>>>> them between folders are replicated correctly and quickly.
>>>>
>>>> However, when new mail is delivered by postfix, replication
does not
>>>> occur until something else triggers it, such as one of the
delete/move
>>>> actions mentioned earlier. A search suggested this may be due
to the
>>>> notify plugin, but I don't see any issue with the settings.
Output of
>>>> doveconf -n:
>>>
>>> Hi
>>>
>>> is there any error in the log?
>>>
>>> Can you show some evidence or an example? ie some email delivery in
the
>>> master but not on the slave?
>>>
>>> Can you be sure to check both new and cur subdirectories on master
and
>>> slave?
>>>
>>> John
>>
>>   There's precisely nothing in the log. The new mail arrives on the
master, and it is as though dovecot completely ignores it for the purposes of
replication.
>>
>>
>> However, I think I have solved the problem by enabling LMTP and forcing
postfix to go through that rather than writing to the maildir directly. Perhaps
LMTP is required for replication and I just didn't realize it. End result is
(I think) it is working properly.
>>
>>
>> J
>>
>>
> 
> Sorry for empty mail, butterfingers...
> 
> Anyways, since replication is triggered by "replication" plugin,
you need to involve either dovecot-lda or lmtp to the delivery process. Dovecot
*will not* pick up replication need if you just drop files into the maildir as
nothing will trigger dovecot code.
> 
> Aki
> 
Thanks for confirming.  Seems to be working OK using LMTP now.