dovecot - Dec 2016 - doveadm-server uses 100% cpu and never finishes, dsync backup also never finishes

Hi Guys,

I have a quite interesting problem.

I have two servers that replicate to each-other. Suddenly one of the accounts is
starting to eat a very large amount of disk space on, what basically is the
replica for this account. doveadm-server seems to hang and keeps on filling the
disk.
I came across this message in the logs:

Dec  8 07:36:40 <server> dovecot: dsync-server(<account>): Fatal:
pool_system_malloc(6291528): Out of memory
Dec  8 07:36:40 <server> dovecot: dsync-server(<account>): Fatal:
master: service(doveadm): child 883 returned error 83 (Out of memory (service
doveadm { vsz_limit=256 MB }, you may need to increase it) - set
DEBUG_OUTOFMEM=1 environment to get core dump)

I?ve increased the vsz_limit to 5G so it has stopped complaining. Only? the
process never seems to finish. I?ve tried to export the mailbox using dsync:
dsync -Dv backup -u 'xxxxx' sdbox:/tmp/patrick_export/
However this process never finishes either. It looks like it stays in one of the
mailboxes and keeps on trying to copy messages.

Format of the mailbox is sdbox
Version of dovecot on all servers: 2.2.9

Any pointers for solving this problem?

Kind regards,

Patrick

--
Patrick van Zweden



-------------- next part --------------
A non-text attachment was scrubbed...
Name: signature.asc
Type: application/pgp-signature
Size: 842 bytes
Desc: Message signed with OpenPGP using GPGMail
URL:
<http://dovecot.org/pipermail/dovecot/attachments/20161208/75e89a5d/attachment.sig>

Hi All,

Problem solved, turned out the index files were the problem in one mailbox.
Deleting them solved the problem

Patrick
--
Patrick van Zweden



> On 08 Dec 2016, at 21:28, Patrick van Zweden <patrick at soverin.net>
wrote:
> 
> Hi Guys,
> 
> I have a quite interesting problem.
> 
> I have two servers that replicate to each-other. Suddenly one of the
accounts is starting to eat a very large amount of disk space on, what basically
is the replica for this account. doveadm-server seems to hang and keeps on
filling the disk.
> I came across this message in the logs:
> 
> Dec  8 07:36:40 <server> dovecot: dsync-server(<account>):
Fatal: pool_system_malloc(6291528): Out of memory
> Dec  8 07:36:40 <server> dovecot: dsync-server(<account>):
Fatal: master: service(doveadm): child 883 returned error 83 (Out of memory
(service doveadm { vsz_limit=256 MB }, you may need to increase it) - set
DEBUG_OUTOFMEM=1 environment to get core dump)
> 
> I?ve increased the vsz_limit to 5G so it has stopped complaining. Only? the
process never seems to finish. I?ve tried to export the mailbox using dsync:
> dsync -Dv backup -u 'xxxxx' sdbox:/tmp/patrick_export/
> However this process never finishes either. It looks like it stays in one
of the mailboxes and keeps on trying to copy messages.
> 
> Format of the mailbox is sdbox
> Version of dovecot on all servers: 2.2.9
> 
> Any pointers for solving this problem?
> 
> Kind regards,
> 
> Patrick
> 
> --
> Patrick van Zweden
> 
> 
> 
-------------- next part --------------
A non-text attachment was scrubbed...
Name: signature.asc
Type: application/pgp-signature
Size: 842 bytes
Desc: Message signed with OpenPGP using GPGMail
URL:
<http://dovecot.org/pipermail/dovecot/attachments/20161209/753b7fe2/attachment.sig>