dovecot - Feb 2010 - Dovecot 2.0.beta3: Child killed with signal 11

Hi,

I'm seeing these after the latest Mercurial updates:

==> /var/log/dovecot.info <=Feb 28 16:07:00 spectre dovecot: master:
service(lmtp): child 17322 killed with signal 11 (core dumps disabled)


Regards
Thomas

On Sun, 2010-02-28 at 16:09 +0100, Thomas Leuxner wrote:
> Feb 28 16:07:00 spectre dovecot: master: service(lmtp): child 17322 killed
with signal 11 (core dumps disabled)
Could you get gdb backtrace? http://dovecot.org/bugreport.html

If you have trouble getting a core, an easy way should be to attach to
existing lmtp process:

1. telnet localhost <lmtp port>
quit
2. gdb -p `pidof lmtp`
cont
3. make it crash
4. gdb: bt full

-------------- next part --------------
A non-text attachment was scrubbed...
Name: signature.asc
Type: application/pgp-signature
Size: 198 bytes
Desc: This is a digitally signed message part
URL:
<http://dovecot.org/pipermail/dovecot/attachments/20100228/9e7829f7/attachment-0002.bin>

> If you have trouble getting a core, an easy way should be to attach to
> existing lmtp process:
> 
> 1. telnet localhost <lmtp port>
> quit
> 2. gdb -p `pidof lmtp`
> cont
> 3. make it crash
> 4. gdb: bt full
Not sure I'm doing this correctly. Core Dumps seem to be disabled in my
vanilla Kernel. Running 'gdb' also seems not to produce the result
wanted. As long as GDB is attached it does not crash the 'lmtp' process,
only when I quit the debugger.

Feb 28 16:51:18 spectre dovecot: lmtp(17782): Disconnect from 188.138.0.199:
Client quit

[16:50] root spectre:~# gdb -p 17782
GNU gdb 6.8-debian
Copyright (C) 2008 Free Software Foundation, Inc.
License GPLv3+: GNU GPL version 3 or later
<http://gnu.org/licenses/gpl.html>
This is free software: you are free to change and redistribute it.
There is NO WARRANTY, to the extent permitted by law.  Type "show
copying"
and "show warranty" for details.
This GDB was configured as "x86_64-linux-gnu".
Attaching to process 17782
Reading symbols from /usr/lib/dovecot/lmtp...(no debugging symbols
found)...done.
Reading symbols from /usr/lib/dovecot/libdovecot-storage.so.0...(no debugging
symbols found)...done.
Loaded symbols for /usr/lib/dovecot/libdovecot-storage.so.0
Reading symbols from /usr/lib/dovecot/libdovecot.so.0...(no debugging symbols
found)...done.
Loaded symbols for /usr/lib/dovecot/libdovecot.so.0
Reading symbols from /lib/libdl.so.2...(no debugging symbols found)...done.
Loaded symbols for /lib/libdl.so.2
Reading symbols from /lib/librt.so.1...(no debugging symbols found)...done.
Loaded symbols for /lib/librt.so.1
Reading symbols from /lib/libc.so.6...(no debugging symbols found)...done.
Loaded symbols for /lib/libc.so.6
Reading symbols from /lib/ld-linux-x86-64.so.2...
(no debugging symbols found)...done.
Loaded symbols for /lib64/ld-linux-x86-64.so.2
Reading symbols from /lib/libpthread.so.0...(no debugging symbols found)...done.
[Thread debugging using libthread_db enabled]
[New Thread 0x7f30067dd6e0 (LWP 17782)]
Loaded symbols for /lib/libpthread.so.0
Reading symbols from /lib/libnss_files.so.2...(no debugging symbols
found)...done.
Loaded symbols for /lib/libnss_files.so.2
Reading symbols from /usr/lib/dovecot/modules/lib10_quota_plugin.so...(no
debugging symbols found)...done.
Loaded symbols for /usr/lib/dovecot/modules/lib10_quota_plugin.so
Reading symbols from /usr/lib/dovecot/modules/lib90_sieve_plugin.so...(no
debugging symbols found)...done.
Loaded symbols for /usr/lib/dovecot/modules/lib90_sieve_plugin.so
Reading symbols from /usr/lib/dovecot/libdovecot-sieve.so.0...(no debugging
symbols found)...done.
Loaded symbols for /usr/lib/dovecot/libdovecot-sieve.so.0

(no debugging symbols found)
0x00007f3005a07b23 in epoll_wait () from /lib/libc.so.6
(gdb) cont
Continuing.

Program received signal SIGINT, Interrupt.
[Switching to Thread 0x7f30067dd6e0 (LWP 17782)]
0x00007f3005a07b23 in epoll_wait () from /lib/libc.so.6

(gdb) bt full
#0  0x00007f3005a07b23 in epoll_wait () from /lib/libc.so.6
No symbol table info available.
#1  0x00007f30060d9abb in io_loop_handler_run () from
/usr/lib/dovecot/libdovecot.so.0
No symbol table info available.
#2  0x00007f30060d8ca8 in io_loop_run () from /usr/lib/dovecot/libdovecot.so.0
No symbol table info available.
#3  0x00007f30060c8eb3 in master_service_run () from
/usr/lib/dovecot/libdovecot.so.0
No symbol table info available.
#4  0x0000000000405b02 in main ()
No symbol table info available.

==> /var/log/dovecot.info <=Feb 28 16:58:30 spectre dovecot: master:
service(lmtp): child 17782 killed with signal 11 (core not dumped)

Timo Sirainen <tss at iki.fi> wrote:
> On Sun, 2010-02-28 at 16:09 +0100, Thomas Leuxner wrote:
>> Feb 28 16:07:00 spectre dovecot: master: service(lmtp): child 17322
kille> d with signal 11 (core dumps disabled)
> Could you get gdb backtrace? http://dovecot.org/bugreport.html
For the record, I see those too. I use Stephan Bosch's Debian packages.
The issue has not been there with 2:2.0.beta3-0~auto+4
(hg 10807:ba19f3c077a8), but has appeared with 2:2.0.beta3-0~auto+6 (hg
10815:1a888e13bf7f). 

#0  0x00007f525ef3dc93 in epoll_wait () from /lib/libc.so.6
No symbol table info available.
#1  0x00007f525f85e07a in io_loop_handler_run (ioloop=0x18495d0)
    at ioloop-epoll.c:175
        ctx = 0x18497e0
        event = <value optimized out>
        list = <value optimized out>
        io = <value optimized out>
        tv = {tv_sec = 2147483, tv_usec = 0}
        t_id = 2
        msecs = 2147483647
        ret = 1
        i = <value optimized out>
        call = <value optimized out>
#2  0x00007f525f85d268 in io_loop_run (ioloop=0x18495d0) at ioloop.c:350
No locals.
#3  0x00007f525f84d9d3 in master_service_run (service=0x18494b0, 
    callback=0x1849850) at master-service.c:478
No locals.


I also see a signal 11 in pop3 on disconnect, backtrace:

(gdb) bt full
#0  hash_table_destroy (_table=0x6ec7f0) at hash.c:110
        table = 0x0
#1  0x00007f82b770b9d4 in settings_parser_deinit (_ctx=<value optimized
out>)
    at settings-parser.c:231
        ctx = 0x6ec7c8
#2  0x00007f82b7727681 in master_service_settings_cache_deinit (
    _cache=<value optimized out>) at master-service-settings-cache.c:93
        cache = 0x6ddaf8
        entry = 0x0
        next = 0x0


And managesieve segfaults immediately at TCP connect, but I have not
managed to get a backtrace yet (it always says "core not dumped"
regardless of ulimit -c setting. I also added -D to the executable, but
no core file yet)

Feb 28 17:18:07 mail dovecot: master: service(managesieve-login): child
1168 killed with signal 11 (core not dumped)

Bernhard

Hopefully useful now...

GNU gdb 6.8-debian
Copyright (C) 2008 Free Software Foundation, Inc.
License GPLv3+: GNU GPL version 3 or later
<http://gnu.org/licenses/gpl.html>
This is free software: you are free to change and redistribute it.
There is NO WARRANTY, to the extent permitted by law.  Type "show
copying"
and "show warranty" for details.
This GDB was configured as "x86_64-linux-gnu"...
(no debugging symbols found)

warning: Can't read pathname for load map: Input/output error.
Reading symbols from /usr/lib/dovecot/libdovecot-storage.so.0...(no debugging
symbols found)...done.
Loaded symbols for /usr/lib/dovecot/libdovecot-storage.so.0
Reading symbols from /usr/lib/dovecot/libdovecot.so.0...(no debugging symbols
found)...done.
Loaded symbols for /usr/lib/dovecot/libdovecot.so.0
Reading symbols from /lib/libdl.so.2...(no debugging symbols found)...done.
Loaded symbols for /lib/libdl.so.2
Reading symbols from /lib/librt.so.1...(no debugging symbols found)...done.
Loaded symbols for /lib/librt.so.1
Reading symbols from /lib/libc.so.6...(no debugging symbols found)...done.
Loaded symbols for /lib/libc.so.6
Reading symbols from /lib/ld-linux-x86-64.so.2...(no debugging symbols
found)...done.
Loaded symbols for /lib64/ld-linux-x86-64.so.2
Reading symbols from /lib/libpthread.so.0...
(no debugging symbols found)...done.
Loaded symbols for /lib/libpthread.so.0
Reading symbols from /usr/lib/dovecot/modules/lib01_acl_plugin.so...(no
debugging symbols found)...done.
Loaded symbols for /usr/lib/dovecot/modules/lib01_acl_plugin.so
Reading symbols from /usr/lib/dovecot/modules/lib02_imap_acl_plugin.so...(no
debugging symbols found)...done.
Loaded symbols for /usr/lib/dovecot/modules/lib02_imap_acl_plugin.so
Reading symbols from /usr/lib/dovecot/modules/lib10_quota_plugin.so...(no
debugging symbols found)...done.
Loaded symbols for /usr/lib/dovecot/modules/lib10_quota_plugin.so
Reading symbols from /usr/lib/dovecot/modules/lib11_imap_quota_plugin.so...(no
debugging symbols found)...done.
Loaded symbols for /usr/lib/dovecot/modules/lib11_imap_quota_plugin.so
Reading symbols from /usr/lib/dovecot/modules/lib20_fts_plugin.so...(no
debugging symbols found)...done.
Loaded symbols for /usr/lib/dovecot/modules/lib20_fts_plugin.so
Reading symbols from /usr/lib/dovecot/modules/lib21_fts_squat_plugin.so...
(no debugging symbols found)...done.
Loaded symbols for /usr/lib/dovecot/modules/lib21_fts_squat_plugin.so
(no debugging symbols found)
Core was generated by `dovecot/imap'.
Program terminated with signal 11, Segmentation fault.
[New process 17997]
#0  0x00007f256d8c86ee in hash_table_destroy () from
/usr/lib/dovecot/libdovecot.so.0
(gdb) bt full
#0  0x00007f256d8c86ee in hash_table_destroy () from
/usr/lib/dovecot/libdovecot.so.0
No symbol table info available.
#1  0x00007f256d8a54c4 in settings_parser_deinit () from
/usr/lib/dovecot/libdovecot.so.0
No symbol table info available.
#2  0x00007f256d8c0bbc in master_service_settings_cache_deinit () from
/usr/lib/dovecot/libdovecot.so.0
No symbol table info available.
#3  0x00007f256db33709 in mail_storage_service_deinit () from
/usr/lib/dovecot/libdovecot-storage.so.0
No symbol table info available.
#4  0x0000000000418629 in main ()
No symbol table info available.

Feb 28 17:15:22 spectre dovecot: master: service(imap): child 17997 killed with
signal 11 (core dumped)