thr3ads.net - dovecot - Panic: file mail-index-util.c: line 10 (mail_index_uint32_to_offset): assertion failed: (offset

If this information is useful, please help other people find it:
Share via:

Ralf Hildebrandt

2019-May-24 10:37 UTC

Panic: file mail-index-util.c: line 10 (mail_index_uint32_to_offset): assertion failed: (offset < 0x40000000)

I'm encountering a crash which this command:

% doveadm import -u restore at backup.invalid mdbox:/home/copymail2/mdbox
'' mailbox INBOX header X-Spam Yes SAVEDBEFORE 2019-05-23

doveadm(restore at backup.invalid): Panic: file mail-index-util.c: line 10
(mail_index_uint32_to_offset): assertion failed: (offset < 0x40000000)
doveadm(restore at backup.invalid): Error: Raw backtrace:
/usr/lib/dovecot/libdovecot.so.0(+0xd9f9e) [0x7fbc52ba7f9e] ->
/usr/lib/dovecot/libdovecot.so.0(+0xd9fe1) [0x7fbc52ba7fe1] ->
/usr/lib/dovecot/libdovecot.so.0(i_fatal+0) [0x7fbc52b0cc54] ->
/usr/lib/dovecot/libdovecot-storage.so.0(mail_index_uint32_to_offset+0x78)[0x7fbc52f525e8]
->
/usr/lib/dovecot/libdovecot-storage.so.0(mail_cache_add+0x83b)[0x7fbc52f3ac2b]
->
/usr/lib/dovecot/libdovecot-storage.so.0(index_mail_parse_header+0x449)[0x7fbc52f1c969]
->
/usr/lib/dovecot/libdovecot.so.0(+0xb6af9) [0x7fbc52b84af9] ->
/usr/lib/dovecot/libdovecot.so.0(i_stream_read_memarea+0x7a) [0x7fbc52bb531a]
->
/usr/lib/dovecot/libdovecot.so.0(i_stream_read+0x2f) [0x7fbc52bb565f] ->
/usr/lib/dovecot/libdovecot.so.0(i_stream_read_data+0x3d)[0x7fbc52bb604d] ->
/usr/lib/dovecot/libdovecot.so.0(message_parse_header_next+0x68)[0x7fbc52b8b3f8]
->
/usr/lib/dovecot/libdovecot.so.0(message_parse_header+0x52)[0x7fbc52b8bdd2]
->
/usr/lib/dovecot/libdovecot-storage.so.0(+0xcadae) [0x7fbc52f26dae] ->
/usr/lib/dovecot/libdovecot-storage.so.0(+0xcc0ac) [0x7fbc52f280ac] ->
/usr/lib/dovecot/libdovecot-storage.so.0(index_storage_search_next_nonblock+0x11d)[0x7fbc52f288bd]
->
/usr/lib/dovecot/libdovecot-storage.so.0(mailbox_search_next_nonblock+0x28)[0x7fbc52ea92e8]
->
/usr/lib/dovecot/libdovecot-storage.so.0(mailbox_search_next+0x3d)[0x7fbc52ea934d]
->
doveadm(+0x31443) [0x5635b4760443] -> 
doveadm(+0x2bdb1) [0x5635b475adb1] ->
doveadm(+0x2caf9) [0x5635b475baf9] ->
doveadm(doveadm_cmd_ver2_to_mail_cmd_wrapper+0x20e) [0x5635b475c9ce] -> 
doveadm(doveadm_cmd_run_ver2+0x55e) [0x5635b476db7e] ->
doveadm(doveadm_cmd_try_run_ver2+0x37) [0x5635b476dbd7] ->
doveadm(main+0x1d1) [0x5635b474aec1] ->
/lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xe7)
[0x7fbc5210fb97] -> doveadm(_start+0x2a) [0x5635b474b39a]


Version info:

ii  dovecot-core  2:2.3.6-2~bionic      amd64        secure POP3/IMAP server -
core files
ii  dovecot-dbg   2:2.3.6-2~bionic      amd64        secure POP3/IMAP server -
debug symbols
ii  dovecot-imapd 2:2.3.6-2~bionic      amd64        secure POP3/IMAP server -
IMAP daemon
ii  dovecot-lmtpd 2:2.3.6-2~bionic      amd64        secure POP3/IMAP server -
LMTP server

Backtrace:

Program received signal SIGABRT, Aborted.
__GI_raise (sig=sig at entry=6) at ../sysdeps/unix/sysv/linux/raise.c:51
51../sysdeps/unix/sysv/linux/raise.c: No such file or directory.
(gdb) bt
#0  __GI_raise (sig=sig at entry=6) at ../sysdeps/unix/sysv/linux/raise.c:51
#1  0x00007ffff68fa801 in __GI_abort () at abort.c:79
#2  0x00007ffff7373f51 in default_fatal_finish (status=0, type=LOG_TYPE_PANIC)
at failures.c:459
#3  fatal_handler_real (ctx=<optimized out>, format=<optimized out>,
args=<optimized out>) at failures.c:471
#4  0x00007ffff7373fe1 in default_fatal_handler (ctx=<optimized out>,
format=<optimized out>, args=<optimized out>) at failures.c:479
#5  0x00007ffff72d8c54 in i_panic (format=format at entry=0x7ffff772e440
"file %s: line %d (%s): assertion failed: (%s)") at failures.c:523
#6  0x00007ffff771e5e8 in mail_index_uint32_to_offset (offset=<optimized
out>) at mail-index-util.c:10
#7  0x00007ffff7706c2b in mail_cache_header_fields_write (ctx=0x55555583d960,
buffer=<optimized out>, buffer=<optimized out>) at
mail-cache-transaction.c:609
#8  mail_cache_header_add_field (field_idx=15, ctx=0x55555583d960) at
mail-cache-transaction.c:690
#9  mail_cache_add (ctx=0x55555583d960, seq=1, field_idx=field_idx at entry=15,
data=0x7ffff773ba56, data_size=0) at mail-cache-transaction.c:739
#10 0x00007ffff76eafdc in index_mail_cache_add_idx (mail=mail at
entry=0x55555583e2f8, field_idx=field_idx at entry=15, data=data at
entry=0x7ffff773ba56, data_size=data_size at entry=0) at index-mail.c:621
#11 0x00007ffff76e8969 in index_mail_parse_header_finish (mail=<optimized
out>) at index-mail-headers.c:132
#12 index_mail_parse_header (part=<optimized out>, hdr=<optimized
out>, mail=<optimized out>) at index-mail-headers.c:312
#13 0x00007ffff7350af9 in read_header (mstream=0x55555584b7f0) at
istream-header-filter.c:357
#14 i_stream_header_filter_read (stream=0x55555584b7f0) at
istream-header-filter.c:447
#15 0x00007ffff738131a in i_stream_read_memarea (stream=stream at
entry=0x55555584b870) at istream.c:313
#16 0x00007ffff738165f in i_stream_read (stream=stream at entry=0x55555584b870)
at istream.c:271
#17 0x00007ffff738204d in i_stream_read_data (stream=0x55555584b870,
data_r=data_r at entry=0x7fffffffdbe8, size_r=size_r at entry=0x7fffffffdbf0,
threshold=threshold at entry=1) at istream.c:745
#18 0x00007ffff73573f8 in i_stream_read_bytes (wanted=2, size_r=0x7fffffffdbf0,
data_r=0x7fffffffdbe8, stream=<optimized out>) at
../../src/lib/istream.h:217
#19 message_parse_header_next (ctx=0x55555584ca70, hdr_r=hdr_r at
entry=0x7fffffffdc50) at message-header-parser.c:85
#20 0x00007ffff7357dd2 in message_parse_header (input=<optimized out>,
hdr_size=hdr_size at entry=0x0,flags=flags at
entry=MESSAGE_HEADER_PARSER_FLAG_CLEAN_ONELINE,
    callback=callback at entry=0x7ffff76f2310 <search_header>,
context=context at entry=0x7fffffffdcc0) at message-header-parser.c:392
#21 0x00007ffff76f2dae in search_arg_match_text (ctx=0x55555583dd20,
args=0x555555809690) at index-search.c:760
#22 search_match_once (ctx=0x55555583dd20) at index-search.c:1400
#23 0x00007ffff76f40ac in search_match_next (ctx=0x55555583dd20) at
index-search.c:1507
#24 search_more_with_mail (mail=<optimized out>, ctx=0x55555583dd20) at
index-search.c:1624
#25 search_more_with_prefetching (mail_r=<optimized out>,
ctx=<optimized out>) at index-search.c:1706
#26 search_more (ctx=ctx at entry=0x55555583dd20, mail_r=mail_r at
entry=0x7fffffffddf0) at index-search.c:1780
#27 0x00007ffff76f48bd in
index_storage_search_next_nonblock(_ctx=0x55555583dd20, mail_r=0x7fffffffdec0,
tryagain_r=0x7fffffffde57) at index-search.c:1808
#28 0x00007ffff76752e8 in mailbox_search_next_nonblock (ctx=0x55555583dd20,
mail_r=0x7fffffffdec0, tryagain_r=<optimized out>) at mail-storage.c:2141
#29 0x00007ffff767534d in mailbox_search_next (ctx=0x55555583dd20, mail_r=mail_r
at entry=0x7fffffffdec0) at mail-storage.c:2126
#30 0x0000555555586682 in doveadm_mail_iter_next (iter=<optimized out>,
mail_r=mail_r at entry=0x7fffffffdec0) at doveadm-mail-iter.c:160
#31 0x0000555555585443 in cmd_import_box (search_args=<optimized out>,
info=0x555555832118, dest_user=<optimized out>, ctx=0x555555807d78) at
doveadm-mail-import.c:142
#32 cmd_import_run (_ctx=0x555555807d78, user=0x55555581c688) at
doveadm-mail-import.c:202
#33 0x000055555557fdb1 in doveadm_mail_next_user (ctx=ctx at
entry=0x555555807d78, error_r=error_r at entry=0x7fffffffe0a0) at
doveadm-mail.c:462
#34 0x0000555555580a0b in doveadm_mail_single_user (ctx=ctx at
entry=0x555555807d78, error_r=error_r at entry=0x7fffffffe0a0) at
doveadm-mail.c:492
#35 0x0000555555580af9 in doveadm_mail_cmd_exec (ctx=ctx at
entry=0x555555807d78, wildcard_user=wildcard_user at entry=0x0) at
doveadm-mail.c:653
#36 0x00005555555819ce in doveadm_cmd_ver2_to_mail_cmd_wrapper
(cctx=<optimized out>) at doveadm-mail.c:1144
#37 0x0000555555592b7e in doveadm_cmd_run_ver2 (argc=12, argv=0x5555557f5ae8,
cctx=cctx at entry=0x7fffffffe290) at doveadm-cmd.c:574
#38 0x0000555555592bd7 in doveadm_cmd_try_run_ver2 (cmd_name=<optimized
out>, argc=<optimized out>, argv=<optimized out>,
cctx=0x7fffffffe290) at doveadm-cmd.c:496
#39 0x000055555556fec1 in main (argc=<optimized out>, argv=<optimized
out>) at doveadm.c:391

-- 
Ralf Hildebrandt
  Gesch?ftsbereich IT | Abteilung Netzwerk
  Charit? - Universit?tsmedizin Berlin
  Campus Benjamin Franklin
  Hindenburgdamm 30 | D-12203 Berlin
  Tel. +49 30 450 570 155 | Fax: +49 30 450 570 962
  ralf.hildebrandt at charite.de | https://www.charite.de

Aki Tuomi

2019-May-24 11:39 UTC

head link

Panic: file mail-index-util.c: line 10 (mail_index_uint32_to_offset): assertion failed: (offset < 0x40000000)

Known issue when folder cache is too big. Try rm -rf dovecot.index.cache
for the folder.

Aki


On 24.5.2019 13.37, Ralf Hildebrandt via dovecot wrote:> I'm encountering a crash which this command:
>
> % doveadm import -u restore at backup.invalid mdbox:/home/copymail2/mdbox
'' mailbox INBOX header X-Spam Yes SAVEDBEFORE 2019-05-23
>
> doveadm(restore at backup.invalid): Panic: file mail-index-util.c: line 10
(mail_index_uint32_to_offset): assertion failed: (offset < 0x40000000)
> doveadm(restore at backup.invalid): Error: Raw backtrace:
> /usr/lib/dovecot/libdovecot.so.0(+0xd9f9e) [0x7fbc52ba7f9e] ->
> /usr/lib/dovecot/libdovecot.so.0(+0xd9fe1) [0x7fbc52ba7fe1] ->
> /usr/lib/dovecot/libdovecot.so.0(i_fatal+0) [0x7fbc52b0cc54] ->
>
/usr/lib/dovecot/libdovecot-storage.so.0(mail_index_uint32_to_offset+0x78)[0x7fbc52f525e8]
->
>
/usr/lib/dovecot/libdovecot-storage.so.0(mail_cache_add+0x83b)[0x7fbc52f3ac2b]
->
>
/usr/lib/dovecot/libdovecot-storage.so.0(index_mail_parse_header+0x449)[0x7fbc52f1c969]
->
> /usr/lib/dovecot/libdovecot.so.0(+0xb6af9) [0x7fbc52b84af9] ->
> /usr/lib/dovecot/libdovecot.so.0(i_stream_read_memarea+0x7a)
[0x7fbc52bb531a] ->
> /usr/lib/dovecot/libdovecot.so.0(i_stream_read+0x2f) [0x7fbc52bb565f] ->
> /usr/lib/dovecot/libdovecot.so.0(i_stream_read_data+0x3d)[0x7fbc52bb604d]
->
>
/usr/lib/dovecot/libdovecot.so.0(message_parse_header_next+0x68)[0x7fbc52b8b3f8]
->
> /usr/lib/dovecot/libdovecot.so.0(message_parse_header+0x52)[0x7fbc52b8bdd2]
->
> /usr/lib/dovecot/libdovecot-storage.so.0(+0xcadae) [0x7fbc52f26dae] ->
> /usr/lib/dovecot/libdovecot-storage.so.0(+0xcc0ac) [0x7fbc52f280ac] ->
>
/usr/lib/dovecot/libdovecot-storage.so.0(index_storage_search_next_nonblock+0x11d)[0x7fbc52f288bd]
->
>
/usr/lib/dovecot/libdovecot-storage.so.0(mailbox_search_next_nonblock+0x28)[0x7fbc52ea92e8]
->
>
/usr/lib/dovecot/libdovecot-storage.so.0(mailbox_search_next+0x3d)[0x7fbc52ea934d]
->
> doveadm(+0x31443) [0x5635b4760443] -> 
> doveadm(+0x2bdb1) [0x5635b475adb1] ->
> doveadm(+0x2caf9) [0x5635b475baf9] ->
> doveadm(doveadm_cmd_ver2_to_mail_cmd_wrapper+0x20e) [0x5635b475c9ce] -> 
> doveadm(doveadm_cmd_run_ver2+0x55e) [0x5635b476db7e] ->
> doveadm(doveadm_cmd_try_run_ver2+0x37) [0x5635b476dbd7] ->
> doveadm(main+0x1d1) [0x5635b474aec1] ->
/lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xe7)
> [0x7fbc5210fb97] -> doveadm(_start+0x2a) [0x5635b474b39a]
>
>
> Version info:
>
> ii  dovecot-core  2:2.3.6-2~bionic      amd64        secure POP3/IMAP
server - core files
> ii  dovecot-dbg   2:2.3.6-2~bionic      amd64        secure POP3/IMAP
server - debug symbols
> ii  dovecot-imapd 2:2.3.6-2~bionic      amd64        secure POP3/IMAP
server - IMAP daemon
> ii  dovecot-lmtpd 2:2.3.6-2~bionic      amd64        secure POP3/IMAP
server - LMTP server
>
> Backtrace:
>
> Program received signal SIGABRT, Aborted.
> __GI_raise (sig=sig at entry=6) at ../sysdeps/unix/sysv/linux/raise.c:51
> 51../sysdeps/unix/sysv/linux/raise.c: No such file or directory.
> (gdb) bt
> #0  __GI_raise (sig=sig at entry=6) at
../sysdeps/unix/sysv/linux/raise.c:51
> #1  0x00007ffff68fa801 in __GI_abort () at abort.c:79
> #2  0x00007ffff7373f51 in default_fatal_finish (status=0,
type=LOG_TYPE_PANIC) at failures.c:459
> #3  fatal_handler_real (ctx=<optimized out>, format=<optimized
out>, args=<optimized out>) at failures.c:471
> #4  0x00007ffff7373fe1 in default_fatal_handler (ctx=<optimized out>,
format=<optimized out>, args=<optimized out>) at failures.c:479
> #5  0x00007ffff72d8c54 in i_panic (format=format at entry=0x7ffff772e440
"file %s: line %d (%s): assertion failed: (%s)") at failures.c:523
> #6  0x00007ffff771e5e8 in mail_index_uint32_to_offset (offset=<optimized
out>) at mail-index-util.c:10
> #7  0x00007ffff7706c2b in mail_cache_header_fields_write
(ctx=0x55555583d960, buffer=<optimized out>, buffer=<optimized out>)
at mail-cache-transaction.c:609
> #8  mail_cache_header_add_field (field_idx=15, ctx=0x55555583d960) at
mail-cache-transaction.c:690
> #9  mail_cache_add (ctx=0x55555583d960, seq=1, field_idx=field_idx at
entry=15, data=0x7ffff773ba56, data_size=0) at mail-cache-transaction.c:739
> #10 0x00007ffff76eafdc in index_mail_cache_add_idx (mail=mail at
entry=0x55555583e2f8, field_idx=field_idx at entry=15, data=data at
entry=0x7ffff773ba56, data_size=data_size at entry=0) at index-mail.c:621
> #11 0x00007ffff76e8969 in index_mail_parse_header_finish
(mail=<optimized out>) at index-mail-headers.c:132
> #12 index_mail_parse_header (part=<optimized out>, hdr=<optimized
out>, mail=<optimized out>) at index-mail-headers.c:312
> #13 0x00007ffff7350af9 in read_header (mstream=0x55555584b7f0) at
istream-header-filter.c:357
> #14 i_stream_header_filter_read (stream=0x55555584b7f0) at
istream-header-filter.c:447
> #15 0x00007ffff738131a in i_stream_read_memarea (stream=stream at
entry=0x55555584b870) at istream.c:313
> #16 0x00007ffff738165f in i_stream_read (stream=stream at
entry=0x55555584b870) at istream.c:271
> #17 0x00007ffff738204d in i_stream_read_data (stream=0x55555584b870,
data_r=data_r at entry=0x7fffffffdbe8, size_r=size_r at entry=0x7fffffffdbf0,
threshold=threshold at entry=1) at istream.c:745
> #18 0x00007ffff73573f8 in i_stream_read_bytes (wanted=2,
size_r=0x7fffffffdbf0, data_r=0x7fffffffdbe8, stream=<optimized out>) at
../../src/lib/istream.h:217
> #19 message_parse_header_next (ctx=0x55555584ca70, hdr_r=hdr_r at
entry=0x7fffffffdc50) at message-header-parser.c:85
> #20 0x00007ffff7357dd2 in message_parse_header (input=<optimized
out>, hdr_size=hdr_size at entry=0x0,flags=flags at
entry=MESSAGE_HEADER_PARSER_FLAG_CLEAN_ONELINE,
>     callback=callback at entry=0x7ffff76f2310 <search_header>,
context=context at entry=0x7fffffffdcc0) at message-header-parser.c:392
> #21 0x00007ffff76f2dae in search_arg_match_text (ctx=0x55555583dd20,
args=0x555555809690) at index-search.c:760
> #22 search_match_once (ctx=0x55555583dd20) at index-search.c:1400
> #23 0x00007ffff76f40ac in search_match_next (ctx=0x55555583dd20) at
index-search.c:1507
> #24 search_more_with_mail (mail=<optimized out>, ctx=0x55555583dd20)
at index-search.c:1624
> #25 search_more_with_prefetching (mail_r=<optimized out>,
ctx=<optimized out>) at index-search.c:1706
> #26 search_more (ctx=ctx at entry=0x55555583dd20, mail_r=mail_r at
entry=0x7fffffffddf0) at index-search.c:1780
> #27 0x00007ffff76f48bd in
index_storage_search_next_nonblock(_ctx=0x55555583dd20, mail_r=0x7fffffffdec0,
tryagain_r=0x7fffffffde57) at index-search.c:1808
> #28 0x00007ffff76752e8 in mailbox_search_next_nonblock (ctx=0x55555583dd20,
mail_r=0x7fffffffdec0, tryagain_r=<optimized out>) at mail-storage.c:2141
> #29 0x00007ffff767534d in mailbox_search_next (ctx=0x55555583dd20,
mail_r=mail_r at entry=0x7fffffffdec0) at mail-storage.c:2126
> #30 0x0000555555586682 in doveadm_mail_iter_next (iter=<optimized
out>, mail_r=mail_r at entry=0x7fffffffdec0) at doveadm-mail-iter.c:160
> #31 0x0000555555585443 in cmd_import_box (search_args=<optimized
out>, info=0x555555832118, dest_user=<optimized out>,
ctx=0x555555807d78) at doveadm-mail-import.c:142
> #32 cmd_import_run (_ctx=0x555555807d78, user=0x55555581c688) at
doveadm-mail-import.c:202
> #33 0x000055555557fdb1 in doveadm_mail_next_user (ctx=ctx at
entry=0x555555807d78, error_r=error_r at entry=0x7fffffffe0a0) at
doveadm-mail.c:462
> #34 0x0000555555580a0b in doveadm_mail_single_user (ctx=ctx at
entry=0x555555807d78, error_r=error_r at entry=0x7fffffffe0a0) at
doveadm-mail.c:492
> #35 0x0000555555580af9 in doveadm_mail_cmd_exec (ctx=ctx at
entry=0x555555807d78, wildcard_user=wildcard_user at entry=0x0) at
doveadm-mail.c:653
> #36 0x00005555555819ce in doveadm_cmd_ver2_to_mail_cmd_wrapper
(cctx=<optimized out>) at doveadm-mail.c:1144
> #37 0x0000555555592b7e in doveadm_cmd_run_ver2 (argc=12,
argv=0x5555557f5ae8, cctx=cctx at entry=0x7fffffffe290) at doveadm-cmd.c:574
> #38 0x0000555555592bd7 in doveadm_cmd_try_run_ver2 (cmd_name=<optimized
out>, argc=<optimized out>, argv=<optimized out>,
cctx=0x7fffffffe290) at doveadm-cmd.c:496
> #39 0x000055555556fec1 in main (argc=<optimized out>,
argv=<optimized out>) at doveadm.c:391
>

Ralf Hildebrandt

2019-May-24 12:38 UTC

head link

[ext] Re: Panic: file mail-index-util.c: line 10 (mail_index_uint32_to_offset): assertion failed: (offset < 0x40000000)

* Aki Tuomi via dovecot <dovecot at dovecot.org>:> Known issue when folder cache is too big. Try rm -rf dovecot.index.cache
> for the folder.
-rw------- 1 mail mail 1746959712 May 24 14:37 dovecot.index.cache

yes, it is quite big :) 1.746.959.712

-- 
Ralf Hildebrandt
  Gesch?ftsbereich IT | Abteilung Netzwerk
  Charit? - Universit?tsmedizin Berlin
  Campus Benjamin Franklin
  Hindenburgdamm 30 | D-12203 Berlin
  Tel. +49 30 450 570 155 | Fax: +49 30 450 570 962
  ralf.hildebrandt at charite.de | https://www.charite.de

Apparently Analagous Threads

Search for more maybe matching threads

dovecot - May 2019 - Panic: file mail-index-util.c: line 10 (mail_index_uint32_to_offset): assertion failed: (offset < 0x40000000)

Panic: file mail-index-util.c: line 10 (mail_index_uint32_to_offset): assertion failed: (offset < 0x40000000)

Panic: file mail-index-util.c: line 10 (mail_index_uint32_to_offset): assertion failed: (offset < 0x40000000)

[ext] Re: Panic: file mail-index-util.c: line 10 (mail_index_uint32_to_offset): assertion failed: (offset < 0x40000000)

Apparently Analagous Threads