thr3ads.net - dovecot - replication dropped imap flags [Nov 2018]

If this information is useful, please help other people find it:
Share via:

Patrick Cernko

2018-Nov-26 15:26 UTC

replication dropped imap flags

Hi list,

I think, I found a bug in the replication setup, that drops (custom) 
flags like Thunderbird labels. I have set up a simple 2 node setup to 
reproduce and explain it:

Host adove.mpi-klsb.mpg.de and bdove.mpi-klsb.mpg.de (doveconf -n 
attached) have dovecot-imapd (from repo.dovecot.org) installed on an 
ext4 filesystem. They only have one account "test" via 
/etc/dovecot/userdb ("test:testpassword:::Test User::/bin/bash:").
It's
mailbox contains one message, that is flagged with "$label1":

doveadm -f flow fetch -u test 'guid flags' ALL
guid=d1516a2b5c08fc5b541d00005a350039 flags=\Recent $label1

Now I simulate a node reinstall on adove by uninstalling dovecot, 
removing all remnants, reinstalling and configuring it again:

apt purge dovecot-core dovecot-imapd
rm -rf /var/vmail /var/lib/dovecot /etc/dovecot
apt install dovecot-imapd
# disable system auth
: > /etc/dovecot/conf.d/auth-system.conf.ext
# create /var/vmail
install -d -o nobody -g nogroup -m 700 /var/vmail
# create userdb
echo 'test:testpassword:::Test User::/bin/bash:' >
/etc/dovecot/userdb
# create /etc/dovecot/local.conf
# not described here, the resulting doveconf -n is attached!
service dovecot restart


When I check the flags of the mail of user test now, the "$label1" is 
disapeared on both machines, even after "doveadm replicator replicate -f 
test":

doveadm -f flow fetch -u test 'guid flags' ALL
guid=d1516a2b5c08fc5b541d00005a350039 flags=\Recent


Any hints what I am doing wrong here or is this really a bug?

Best,
-- 
Patrick Cernko <pcernko at mpi-klsb.mpg.de> +49 681 9325 5815
Joint Administration: Information Services and Technology
Max-Planck-Institute fuer Informatik & Softwaresysteme
-------------- next part --------------
# 2.3.4 (0ecbaf23d): /etc/dovecot/dovecot.conf
# OS: Linux 4.14.65.1.amd64-smp x86_64 Debian 9.6 
# Hostname: bdove.mpi-klsb.mpg.de
doveadm_password = # hidden, use -P to show it
doveadm_port = 12345
listen = *
mail_gid = nogroup
mail_home = /var/vmail/%u
mail_location = mdbox:~/mdbox
mail_plugins = notify replication
mail_uid = nobody
namespace inbox {
  inbox = yes
  location = 
  mailbox Drafts {
    special_use = \Drafts
  }
  mailbox Junk {
    special_use = \Junk
  }
  mailbox Sent {
    special_use = \Sent
  }
  mailbox "Sent Messages" {
    special_use = \Sent
  }
  mailbox Trash {
    special_use = \Trash
  }
  prefix = 
}
passdb {
  args = /etc/dovecot/userdb
  driver = passwd-file
}
plugin {
  mail_replica = tcp:adove.mpi-klsb.mpg.de
}
protocols = " imap"
service aggregator {
  fifo_listener replication-notify-fifo {
    mode = 0666
  }
  unix_listener replication-notify {
    mode = 0666
  }
}
service doveadm {
  inet_listener doveadm-server {
    port = 12345
  }
}
service replicator {
  process_min_avail = 1
  unix_listener replicator-doveadm {
    mode = 0666
  }
}
ssl = no
userdb {
  args = /etc/dovecot/userdb
  driver = passwd-file
}
-------------- next part --------------
# 2.3.4 (0ecbaf23d): /etc/dovecot/dovecot.conf
# OS: Linux 4.14.65.1.amd64-smp x86_64 Debian 9.6 
# Hostname: adove.mpi-klsb.mpg.de
doveadm_password = # hidden, use -P to show it
doveadm_port = 12345
listen = *
mail_gid = nogroup
mail_home = /var/vmail/%u
mail_location = mdbox:~/mdbox
mail_plugins = notify replication
mail_uid = nobody
namespace inbox {
  inbox = yes
  location = 
  mailbox Drafts {
    special_use = \Drafts
  }
  mailbox Junk {
    special_use = \Junk
  }
  mailbox Sent {
    special_use = \Sent
  }
  mailbox "Sent Messages" {
    special_use = \Sent
  }
  mailbox Trash {
    special_use = \Trash
  }
  prefix = 
}
passdb {
  args = /etc/dovecot/userdb
  driver = passwd-file
}
plugin {
  mail_replica = tcp:bdove.mpi-klsb.mpg.de
}
protocols = " imap"
service aggregator {
  fifo_listener replication-notify-fifo {
    mode = 0666
  }
  unix_listener replication-notify {
    mode = 0666
  }
}
service doveadm {
  inet_listener doveadm-server {
    port = 12345
  }
}
service replicator {
  process_min_avail = 1
  unix_listener replicator-doveadm {
    mode = 0666
  }
}
ssl = no
userdb {
  args = /etc/dovecot/userdb
  driver = passwd-file
}
-------------- next part --------------
A non-text attachment was scrubbed...
Name: smime.p7s
Type: application/pkcs7-signature
Size: 5090 bytes
Desc: S/MIME Cryptographic Signature
URL:
<https://dovecot.org/pipermail/dovecot/attachments/20181126/be10f7b7/attachment.p7s>

Patrick Cernko

2018-Dec-10 14:25 UTC

head link

replication dropped imap flags

Hi list, hi devs,

On 26.11.18 16:26, Patrick Cernko wrote:> Hi list,
> 
> I think, I found a bug in the replication setup, that drops (custom) 
> flags like Thunderbird labels. I have set up a simple 2 node setup to 
> reproduce and explain it:
> 
> Host adove.mpi-klsb.mpg.de and bdove.mpi-klsb.mpg.de (doveconf -n 
> attached) have dovecot-imapd (from repo.dovecot.org) installed on an 
> ext4 filesystem. They only have one account "test" via 
> /etc/dovecot/userdb ("test:testpassword:::Test
User::/bin/bash:"). It's
> mailbox contains one message, that is flagged with "$label1":
> 
> doveadm -f flow fetch -u test 'guid flags' ALL
> guid=d1516a2b5c08fc5b541d00005a350039 flags=\Recent $label1
> 
> Now I simulate a node reinstall on adove by uninstalling dovecot, 
> removing all remnants, reinstalling and configuring it again:
> 
> apt purge dovecot-core dovecot-imapd
> rm -rf /var/vmail /var/lib/dovecot /etc/dovecot
> apt install dovecot-imapd
> # disable system auth
> : > /etc/dovecot/conf.d/auth-system.conf.ext
> # create /var/vmail
> install -d -o nobody -g nogroup -m 700 /var/vmail
> # create userdb
> echo 'test:testpassword:::Test User::/bin/bash:' >
/etc/dovecot/userdb
> # create /etc/dovecot/local.conf
> # not described here, the resulting doveconf -n is attached!
> service dovecot restart
> 
> 
> When I check the flags of the mail of user test now, the
"$label1" is
> disapeared on both machines, even after "doveadm replicator replicate
-f
> test":
> 
> doveadm -f flow fetch -u test 'guid flags' ALL
> guid=d1516a2b5c08fc5b541d00005a350039 flags=\Recent
> 
> 
> Any hints what I am doing wrong here or is this really a bug?
> 
it's been 2 weeks now, since my bug(?) report without any 
reactions/answers. I wonder if anyone is working on this already or if 
my report got lost or if I did something wrong on my side.

Regards,
-- 
Patrick Cernko <pcernko at mpi-klsb.mpg.de> +49 681 9325 5815
Joint Administration: Information Services and Technology
Max-Planck-Institute fuer Informatik & Softwaresysteme

-------------- next part --------------
A non-text attachment was scrubbed...
Name: smime.p7s
Type: application/pkcs7-signature
Size: 5090 bytes
Desc: S/MIME Cryptographic Signature
URL:
<https://dovecot.org/pipermail/dovecot/attachments/20181210/78042ff4/attachment.p7s>

Patrick Cernko

2019-Mar-14 13:54 UTC

head link

replication dropped imap flags

Update:

The patch "dsync: Fix importing keywords with MAIL_TRANSACTION_SYNC flag 
set" mentioned in the mail from Timo Sirainen on 2019-03-12 22:31 on 
this list seems to fix this issue.

Regards,
-- 
Patrick Cernko <pcernko at mpi-klsb.mpg.de> +49 681 9325 5815
Joint Administration: Information Services and Technology
Max-Planck-Institute fuer Informatik & Softwaresysteme

-------------- next part --------------
A non-text attachment was scrubbed...
Name: smime.p7s
Type: application/pkcs7-signature
Size: 5324 bytes
Desc: S/MIME Cryptographic Signature
URL:
<https://dovecot.org/pipermail/dovecot/attachments/20190314/cc185437/attachment-0001.p7s>

Possibly Parallel Threads

Search for more possibly parallel threads

dovecot - Nov 2018 - replication dropped imap flags

replication dropped imap flags

replication dropped imap flags

replication dropped imap flags

Possibly Parallel Threads