AW: replicator: Panic: data stack: Out of memory

Thomas Tsiakalakis
2020-06-23T09:25:14Z

I managed to convince the System that I really want a core dump



Thomas Tsiakalakis

Team Applikationsbetrieb
GDV Dienstleistungs-GmbH
Tel: +49(40)33449-4318
Fax:
E-Mail: Thomas.Tsiakalakis at gdv-dl.de<mailto:Thomas.Tsiakalakis at
gdv-dl.de>



GDV Dienstleistungs-GmbH
Glockengie?erwall 1
D-20095 Hamburg
www.gdv-dl.de<http://www.gdv-dl.de>

Niederlassungen:

Wilhelmstra?e 43 / 43 G
10117 Berlin

Frankenstra?e 18
20097 Hamburg

Sitz und Registergericht: Hamburg
HRB 145291
USt.-IdNr : DE 205183123

Gesch?ftsf?hrer:
Dr. Jens Bartenwerfer
Fred di Giuseppe Chiachiarella

Aufsichtsratsvorsitzender: Werner Schmidt

------------------------------------------------------------------
Diese E-Mail und alle Anh?nge enthalten vertrauliche und/oder rechtlich
gesch?tzte Informationen. Wenn Sie nicht der richtige Adressat sind oder diese
E-Mail irrt?mlich erhalten haben, informieren Sie bitte sofort den Absender und
vernichten Sie diese E-Mail. Das unerlaubte Kopieren sowie die unbefugte
Weitergabe der E-Mail ist nicht gestattet.

This e-mail and any attached files may contain confidential and/or privileged
information. If you are not the intended recipient (or have received this e-mail
in error) please notify the sender immediately and destroy this e-mail. Any
unauthorised copying, disclosure or distribution of the material in this e-mail
is strictly forbidden.

Von: Thomas Tsiakalakis
Gesendet: Donnerstag, 18. Juni 2020 16:26
An: 'dovecot at dovecot.org' <dovecot at dovecot.org>
Betreff: replicator: Panic: data stack: Out of memory

Hi,

I have set up 2 SLES 15 Hosts with dovecot and replication. Everything seems to
work fine but every time a message is delivered, I get an out of memory error in
the logs. The Replication itself seems to work fine though.

I increased default_vsz_limit to 512M but  the only thing that changed was that
dovecot was trying to allocate 1073741864 bytes instead of 268435496

As I said, I?m running SLES 15 SP1 and Dovecot 2.3.10 (0da0eff44) (both Hosts
have the same version)

Each Host currently has 8GB of Memory.
# free -h
              total        used        free      shared  buff/cache   available
Mem:          7.8Gi       278Mi       7.3Gi        47Mi       183Mi       7.2Gi
Swap:         4.0Gi          0B       4.0Gi

# journalctl -f
Jun 18 15:55:48 mail1 postfix/pickup[3457]: 18533C009C8: uid=0 from=<root>
Jun 18 15:55:48 mail1 postfix/cleanup[3669]: 18533C009C8:
message-id=<20200618135548.18533C009C8 at mail1>
Jun 18 15:55:48 mail1 postfix/qmgr[3458]: 18533C009C8: from=<root at
mail1>, size=431, nrcpt=1 (queue active)
Jun 18 15:55:48 mail1 dovecot[1833]: lmtp(3673): Connect from local
Jun 18 15:55:48 mail1 dovecot[1833]: replicator: Panic: data stack: Out of
memory when allocating 268435496 bytes
Jun 18 15:55:48 mail1 dovecot[1833]: replicator: Error: Raw backtrace:
/usr/lib64/dovecot/libdovecot.so.0(backtrace_append+0x42) [0x7f8346d6d262] ->
/usr/lib64/dovecot/libdovecot.so.0(backtrace_get+0x1e) [0x7f8346d6d37e] ->
/usr/lib64/dovecot/libdovecot.so.0(+0xebcee) [0x7f8346d77cee] ->
/usr/lib64/dovecot/libdovecot.so.0(+0xebd91) [0x7f8346d77d91] ->
/usr/lib64/dovecot/libdovecot.so.0(i_fatal+0) [0x7f8346cd1f8b] ->
/usr/lib64/dovecot/libdovecot.so.0(t_pop_last_unsafe+0) [0x7f8346d73660] ->
/usr/lib64/dovecot/libdovecot.so.0(+0xe7a50) [0x7f8346d73a50] ->
/usr/lib64/dovecot/libdovecot.so.0(+0x10eb58) [0x7f8346d9ab58] ->
/usr/lib64/dovecot/libdovecot.so.0(+0xe3ac5) [0x7f8346d6fac5] ->
/usr/lib64/dovecot/libdovecot.so.0(buffer_write+0xf2) [0x7f8346d6fdb2] ->
dovecot/replicator(replicator_queue_push+0xde) [0x5648989a5cde] ->
dovecot/replicator(+0x5464) [0x5648989a5464] -> dovecot/replicator(+0x4a0b)
[0x5648989a4a0b] -> dovecot/replicator(+0x4c02) [0x5648989a4c02] ->
/usr/lib64/dovecot/libdovecot.so.0(io_loop_call_io+0x69) [0x7f8346d90c99] ->
/usr/lib64/dovecot/libdovecot.so.0(io_loop_handler_run_internal+0x134)
[0x7f8346d92574] ->
/usr/lib64/dovecot/libdovecot.so.0(io_loop_handler_run+0x4c) [0x7f8346d90d9c]
-> /usr/lib64/dovecot/libdovecot.so.0(io_loop_run+0x38) [0x7f8346d90fc8]
-> /usr/lib64/dovecot/libdovecot.so.0(master_service_run+0x13)
[0x7f8346d01873] -> dovecot/replicator(main+0x1a0) [0x5648989a3cb0] ->
/lib64/libc.so.6(__libc_start_main+0xea) [0x7f83468f534a] ->
dovecot/replicator(_start+0x2a) [0x5648989a3d5a]
Jun 18 15:55:48 mail1 dovecot[1833]: lmtp(test at
example.com)<3673><q5sLCGRy615ZDgAATn/NZw>: Warning:
replication(test at example.com): Sync failure:
Jun 18 15:55:48 mail1 dovecot[1833]: lmtp(test at
example.com)<3673><q5sLCGRy615ZDgAATn/NZw>: Warning:
replication(test at example.com): Remote sent invalid input: -
Jun 18 15:55:48 mail1 dovecot[1833]: lmtp(test at
example.com)<3673><q5sLCGRy615ZDgAATn/NZw>:
msgid=<20200618135548.18533C009C8 at mail1>: saved mail to INBOX
Jun 18 15:55:48 mail1 dovecot[1833]: lmtp(3673): Disconnect from local: Client
has quit the connection (state=READY)
Jun 18 15:55:48 mail1 postfix/lmtp[3672]: 18533C009C8: to=<test at
example.com>, orig_to=<test at domain.com>,
relay=mail1[private/dovecot-lmtp], delay=0.17, delays=0.02/0.01/0.02/0.13,
dsn=2.0.0, status=sent (250 2.0.0 <test at example.com>
q5sLCGRy615ZDgAATn/NZw Saved)
Jun 18 15:55:48 mail1 postfix/qmgr[3458]: 18533C009C8: removed
Jun 18 15:55:48 mail1 dovecot[1833]: replicator: Fatal: master:
service(replicator): child 2948 killed with signal 6 (core not dumped -
https://dovecot.org/bugreport.html#coredumps - set /proc/sys/fs/suid_dumpable to
2)
-------------- next part --------------
An HTML attachment was scrubbed...
URL:
<https://dovecot.org/pipermail/dovecot/attachments/20200623/7015cad8/attachment-0001.html>
-------------- next part --------------
A non-text attachment was scrubbed...
Name:
core.replicator.0.6290aeded3a342fd9d7889bdf2551340.15427.1592487177000000.lz4
Type: application/octet-stream
Size: 432412 bytes
Desc:
core.replicator.0.6290aeded3a342fd9d7889bdf2551340.15427.1592487177000000.lz4
URL:
<https://dovecot.org/pipermail/dovecot/attachments/20200623/7015cad8/attachment-0001.obj>