dovecot - Dec 2019 - Can't see a specific mail in thunderbird but with mobile mail client

Hi,

did not notice that you have imap_zlib enabled for protocol imap, can you
disable that temporarily and re-record the rawlog.

Sami

> On 4 Dec 2019, at 11.22, J. Echter via dovecot <dovecot at
dovecot.org> wrote:
> 
> Hi,
> 
> i did but it seems to contain garbage to me.
> 
> here's the .in file:
> 
> 1575450806.299222 2 COMPRESS DEFLATE
> 1575450806.300114 2V?tQ?P?K?MURP
> 1575450806.300114
?(?KI-J?,J^A??R??3???,3^K=#=#%M^.^@^@^@^@??2Q(N?IM.QP??s??P??^B^@^@^@??2U^H^E^Z??Z???`h???????^^^LT
> 1575450806.304341
^@^@^@??2^C^Z????^E^@^@^@??r??^C?^@^@^@^@??2W???/??^B^@^@^@???@Rnafibi??^G^@^@^@??d??^N?
^XE_?^[u??????H?k???qh?gS??^@????&???{sr?^?-?&"?b?eT?3??^V?^$
> 1575450825.607399 ?e*??}Bm??k
> jl??_?^D?^]z?tH??r?u}?p$?(??^N?F^O{|???q?
^L?8<"???^D4??q@???5=^?^C^@^@??24
??^HG??^@^@^@^@??24??^P^@^@^@????^P^@^@^@??24R(?LQ(.?/J???
>
???_~?Wi^6P^S^@^@^@??24?j^B^@^@^@???h^B^@^@^@??24??+^@^@^@??24E??^L9`^A^@^@^@??2??^F^@^@^@???h^C^@^@^@??2?E^G^@^@^@??2?^O^Tm^@^@^@^@??2?^P3+
ej`0T?^E^@^@^@??2^?^WKB?^$
> ?
> 
> ^P^F^@^@^@^@??2?(^W     ^Y`iff`?0^@^@^@^@??2?(9
^X`dfdhb?0^@^@^@^@??2?@O?^VX^R1^@^@^@??2?%+^@^@^@^@???$+^@^@^@^@????%+^@^@^@^@????HV???
> 1575451333.497661 ^@^@^@????HVX^Z?3Y^A^@^@^@????HV^D??^@^@^@^@???0A^OJK,A  
^@^@^@???0?^F%^@^@^@??
> 
> 
> Am 04.12.19 um 09:49 schrieb Sami Ketola via dovecot:
>> Hi,
>> 
>> please record IMAP rawlog from the client session to see what the
client requests and what dovecot responds.
>> 
>> https://wiki2.dovecot.org/Debugging/Rawlog
<https://wiki2.dovecot.org/Debugging/Rawlog>
>> 
>> Sami
>> 
>> 
>>> On 4 Dec 2019, at 10.44, J. Echter via dovecot <dovecot at
dovecot.org <mailto:dovecot at dovecot.org>> wrote:
>>> 
>>> 
>>> Am 03.12.19 um 12:32 schrieb J. Echter via dovecot:
>>>> Hi,
>>>> 
>>>> i've seen a strange behaviour in our system (centos 7,
dovecot 2.2.36
>>>> (1f10bfa63) today.
>>>> 
>>>> We got a mail and it got delivered.
>>>> 
>>>> Dec  3 07:56:25 mail postfix/lmtp[4013]: 915B0CEF4C2:
to=<user at domain>,
>>>> relay=mail[private/dovecot-lmtp], delay=1.5,
delays=1.3/0.03/0.02/0.19,
>>>> dsn=2.0.0, status=sent (250 2.0.0 <user at domain>
AOhCNBgH5l2vDwAAtnFApQ:2
>>>> Saved)
>>>> Dec  3 07:56:25 mail dovecot: lmtp(user at domain):
>>>> AOhCNBgH5l2vDwAAtnFApQ:2: sieve:
>>>> msgid=<289913405.81.1575356173625.JavaMail.SYSTEM at
EUWS0716>: stored mail
>>>> into mailbox 'INBOX'
>>>> 
>>>> I also see this mail on the filesystem in the users cur dir:
>>>> 
>>>> -rw-r--r--.  1 vmail vmail  448818  3. Dez 07:56
>>>> 1575356184.M937345P4015.mail,S=611100,W=619338:2,Sae
>>>> 
>>>> But i don't see this single mail in thunderbird and not in
sogo
>>>> (http://www.sogo.nu <http://www.sogo.nu/>), but i can see
it in the mobile mail client.
>>>> 
>>>> Does anyone have a suggfestion what may be wrong here?
>>>> 
>>>> I paste my dovecot -n output here:
>>>> 
>>>> # 2.2.36 (1f10bfa63): /etc/dovecot/dovecot.conf
>>>> # Pigeonhole version 0.4.24 (124e06aa)
>>>> # OS: Linux 3.10.0-1062.4.3.el7.x86_64 x86_64 CentOS Linux
release
>>>> 7.7.1908 (Core) xfs
>>>> # Hostname: mail.workgroup.local
>>>> auth_master_user_separator = *
>>>> auth_verbose = yes
>>>> base_dir = /var/run/dovecot/
>>>> default_vsz_limit = 2 G
>>>> imap_id_log = *
>>>> imap_id_send = *
>>>> log_timestamp = "%Y-%m-%d %H:%M:%S "
>>>> login_log_format_elements = user=<%u> method=%m rip=%r
lip=%l mpid=%e %c %k
>>>> mail_gid = 5000
>>>> mail_home = /DATEN/vmail/%Ld/%Ln
>>>> mail_location = maildir:/DATEN/vmail/%Ld/%Ln/mail/
>>>> mail_plugins = " zlib fts fts_solr mail_log notify"
>>>> mail_uid = 5000
>>>> managesieve_notify_capability = mailto
>>>> managesieve_sieve_capability = fileinto reject envelope
>>>> encoded-character vacation subaddress
comparator-i;ascii-numeric
>>>> relational regex imap4flags copy include variables body enotify
>>>> environment mailbox date ihave
>>>> namespace inbox {
>>>>   inbox = yes
>>>>   location >>>>   mailbox Archive {
>>>>     auto = no
>>>>     special_use = \Archive
>>>>   }
>>>>   mailbox Archives {
>>>>     auto = subscribe
>>>>     special_use = \Archive
>>>>   }
>>>>   mailbox Drafts {
>>>>     auto = subscribe
>>>>     special_use = \Drafts
>>>>   }
>>>>   mailbox Junk {
>>>>     auto = subscribe
>>>>     special_use = \Junk
>>>>   }
>>>>   mailbox Sent {
>>>>     auto = subscribe
>>>>     special_use = \Sent
>>>>   }
>>>>   mailbox "Sent Messages" {
>>>>     special_use = \Sent
>>>>   }
>>>>   mailbox Spam {
>>>>     auto = no
>>>>     special_use = \Junk
>>>>   }
>>>>   mailbox Trash {
>>>>     auto = subscribe
>>>>     special_use = \Trash
>>>>   }
>>>>   prefix >>>> }
>>>> passdb {
>>>>   args = /etc/dovecot/passwd.masterusers
>>>>   driver = passwd-file
>>>>   master = yes
>>>> }
>>>> passdb {
>>>>   args = /etc/dovecot/dovecot-ldap.conf
>>>>   driver = ldap
>>>> }
>>>> plugin {
>>>>   fts = solr
>>>>   fts_autoindex = yes
>>>>   fts_solr = break-imap-search
url=http://localhost:8983/solr/dovecot/
<http://localhost:8983/solr/dovecot/>
>>>>   imapsieve_mailbox1_before =
file:/etc/dovecot/sieve/learn-spam.sieve
<file:///etc/dovecot/sieve/learn-spam.sieve>
>>>>   imapsieve_mailbox1_causes = COPY
>>>>   imapsieve_mailbox1_name = Junk
>>>>   imapsieve_mailbox2_before =
file:/etc/dovecot/sieve/learn-ham.sieve
<file:///etc/dovecot/sieve/learn-ham.sieve>
>>>>   imapsieve_mailbox2_causes = COPY
>>>>   imapsieve_mailbox2_from = Junk
>>>>   imapsieve_mailbox2_name = *
>>>>   mail_log_events = delete undelete expunge copy mailbox_delete
>>>> mailbox_rename
>>>>   mail_log_fields = uid box msgid size
>>>>   mailbox_alias_new = Sent Messages
>>>>   mailbox_alias_new2 = Sent Items
>>>>   mailbox_alias_new3 = Deleted Messages
>>>>   mailbox_alias_new4 = Papierkorb
>>>>   mailbox_alias_new5 = Spam
>>>>   mailbox_alias_old = Sent
>>>>   mailbox_alias_old2 = Sent
>>>>   mailbox_alias_old3 = Trash
>>>>   mailbox_alias_old4 = Trash
>>>>   mailbox_alias_old5 = Junk
>>>>   mailbox_list_index = yes
>>>>   recipient_delimiter = +
>>>>   sieve = /DATEN/vmail/%Ld/%Ln/.dovecot.sieve
>>>>   sieve_after = /etc/dovecot/sieve-after
>>>>   sieve_global_extensions = +vnd.dovecot.pipe
>>>>   sieve_pipe_bin_dir = /usr/bin
>>>>   sieve_plugins = sieve_imapsieve sieve_extprograms
>>>>   zlib_save = gz
>>>>   zlib_save_level = 6
>>>> }
>>>> protocols = sieve imap lmtp
>>>> service auth {
>>>>   unix_listener /var/spool/postfix/private/auth {
>>>>     group = postfix
>>>>     mode = 0660
>>>>     user = postfix
>>>>   }
>>>>   unix_listener auth-userdb {
>>>>     group = vmail
>>>>     mode = 0660
>>>>     user = vmail
>>>>   }
>>>>   user = root
>>>> }
>>>> service imap-login {
>>>>   chroot = login
>>>>   executable = /usr/libexec/dovecot/imap-login
>>>>   inet_listener imap {
>>>>     port = 0
>>>>   }
>>>>   process_min_avail = 4
>>>>   user = dovecot
>>>> }
>>>> service imap {
>>>>   executable = /usr/libexec/dovecot/imap
>>>> }
>>>> service lmtp {
>>>>   unix_listener /var/spool/postfix/private/dovecot-lmtp {
>>>>     group = postfix
>>>>     mode = 0600
>>>>     user = postfix
>>>>   }
>>>> }
>>>> service managesieve-login {
>>>>   chroot = login
>>>>   user = dovecot
>>>> }
>>>> service pop3-login {
>>>>   chroot = login
>>>>   user = dovecot
>>>> }
>>>> ssl = required
>>>> ssl_cert = </etc/pki/tls/certs/server.crt
>>>> ssl_key =  # hidden, use -P to show it
>>>> userdb {
>>>>   args = /etc/dovecot/dovecot-ldap.conf
>>>>   driver = ldap
>>>> }
>>>> valid_chroot_dirs = /var/spool/vmail
>>>> protocol lda {
>>>>   mail_plugins = sieve
>>>>   postmaster_address = postmaster
>>>> }
>>>> protocol imap {
>>>>   mail_plugins = " zlib fts fts_solr mail_log notify
imap_zlib imap_sieve"
>>>> }
>>>> protocol lmtp {
>>>>   mail_plugins = " zlib fts fts_solr mail_log notify quota
sieve"
>>>>   postmaster_address = postmaster at domain
>>>> }
>>>> 
>>>> Thanks for any hints.
>>>> 
>>>> Greetings
>>>> 
>>>> Juergen
>>>> 
>>> Hi,
>>> 
>>> i'd like to be a bit more specific on the mobile client, the
mobile
>>> client which is working is the samsung integrated "Mail"
client.
>>>
https://play.google.com/store/apps/details?id=com.samsung.android.email.provider&hl=en
<https://play.google.com/store/apps/details?id=com.samsung.android.email.provider&hl=en>
>>> 
>>> With K9-Mail it doesn't work either.
>>> 
>> 
-------------- next part --------------
An HTML attachment was scrubbed...
URL:
<https://dovecot.org/pipermail/dovecot/attachments/20191204/5ba081ee/attachment-0001.html>

On 04 Dec 2019, at 02:36, Sami Ketola <sami.ketola at dovecot.fi>
wrote:
> did not notice that you have imap_zlib enabled for protocol imap, can you
disable that temporarily and re-record the rawlog.
Is it possible that is the source of the issue? It seems like when I tried to
test that it did not work with a lot of clients, but I might be thinking of
something else.


-- 
A Clean House Is A Sign Of A Misspent Life

Hi,

sorry for the delay.

I disabled compression on the server , decompressed the mails and
re-created the index.

All is working normally for now.

I hope this was the problem.

Thanks to all for helping!

Am 04.12.19 um 15:40 schrieb @lbutlr via dovecot:
> On 04 Dec 2019, at 02:36, Sami Ketola <sami.ketola at dovecot.fi>
wrote:
>> did not notice that you have imap_zlib enabled for protocol imap, can
you disable that temporarily and re-record the rawlog.
> Is it possible that is the source of the issue? It seems like when I tried
to test that it did not work with a lot of clients, but I might be thinking of
something else.
>
>