search for: charset_to_utf8

-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA512 Hi, I have seen the following assertion fails on my own mail server (indexer-worker): Panic: file charset-iconv.c: line 132 (charset_to_utf8): assertion failed: (*src_size - pos <= CHARSET_MAX_PENDING_BUF_SIZE) However, when charset_to_utf8_try returns FALSE (e.g. iconv() got EINVAL or EILSEQ), the for loop in charset_to_utf8 may end earlier, and there may be additional pending characters, and the assertion doesn't seem always h...

I've been seeing this same error as well now: Fatal: master: service(indexer-worker): child 20979 killed with signal 6 (core not dumped - set service indexer-worker { drop_priv_before_exec=yes }) Panic: file charset-iconv.c: line 132 (charset_to_utf8): assertion failed: (*src_size - pos <= CHARSET_MAX_PENDING_BUF_SIZE) It's only shown up on one particular user, and after tracking down the message(s) that caused it I found out that there were two identical messages with the same exact MD5/SHA hashes from our storage server in 2012 or so....

...> -----BEGIN PGP SIGNED MESSAGE----- > Hash: SHA512 > > Hi, > > On 5/15/15 10:58, Xin Li wrote: >> Hi, >> >> I have seen the following assertion fails on my own mail server >> (indexer-worker): >> >> Panic: file charset-iconv.c: line 132 (charset_to_utf8): assertion >> failed: (*src_size - pos <= CHARSET_MAX_PENDING_BUF_SIZE) > > I've managed to narrow down the issue to one mail, and can reliably > trigger the assertion with 'doveadm index -u user INBOX' with only that > email. Can you send me some mail that trig...

-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA512 Hi, On 5/15/15 10:58, Xin Li wrote: > Hi, > > I have seen the following assertion fails on my own mail server > (indexer-worker): > > Panic: file charset-iconv.c: line 132 (charset_to_utf8): assertion > failed: (*src_size - pos <= CHARSET_MAX_PENDING_BUF_SIZE) I've managed to narrow down the issue to one mail, and can reliably trigger the assertion with 'doveadm index -u user INBOX' with only that email. Maybe we should reset the iconv descriptor after each full...

...> > I've been seeing this same error as well now: > > > > Fatal: master: service(indexer-worker): child 20979 killed with > > signal 6 (core not dumped - set service indexer-worker { > > drop_priv_before_exec=yes }) Panic: file charset-iconv.c: line 132 > > (charset_to_utf8): assertion failed: (*src_size - pos <= > > CHARSET_MAX_PENDING_BUF_SIZE) > > Quick question -- Are you using FreeBSD (10.0+)? > > Cheers, > - -- > Xin LI <delphij at delphij.net> https://www.delphij.net/ > FreeBSD - The Power to Serve! Live free or...

On 05/22/15 13:18, Cassidy Larson wrote: > We're using FreeBSD 10.1 I see. Yes that's the same problem I have seen. There is a behavioral difference (I think it's a FreeBSD bug) between FreeBSD's iconv(3) and GNU implementation, and there is arguably a bug with Dovecot that iconv(3) state should be reset for each multipart part. The two together would trigger the problem

Hi, I have a mailbox where indexing fails with the following error: # /opt/dovecot2/bin/doveadm -c /tmp/dovecot.conf -o mail_location=/tmp/skesselring index '*' doveadm(root): Panic: file charset-iconv.c: line 132 (charset_to_utf8): assertion failed: (*src_size - pos <= CHARSET_MAX_PENDING_BUF_SIZE) doveadm(root): Error: Raw backtrace: /opt/dovecot2/lib/dovecot/libdovecot.so.0(+0x7c13f) [0x7f1b7376f13f] -> /opt/dovecot2/lib/dovecot/libdovecot.so.0(default_fatal_handler+0x2a) [0x7f1b7376f21a] -> /opt/dovecot2/lib/dov...

Hi, while searching through the message bodies in a real folder I got a coredump. I used the master user for this operation. dovecot.index* files have been removed before I started this operation. This looks a bit different to my previous report. Coredump: Program terminated with signal 6, Aborted. [New process 1628] #0 0x00002b5e82a8ced5 in raise () from /lib/libc.so.6 #0 0x00002b5e82a8ced5

On 07/29/2015 04:02 PM, mihaiush wrote: > Hi, > > I have a mailbox where indexing fails with the following error: > > # /opt/dovecot2/bin/doveadm -c /tmp/dovecot.conf -o > mail_location=/tmp/skesselring index '*' > doveadm(root): Panic: file charset-iconv.c: line 132 (charset_to_utf8): > assertion failed: (*src_size - pos <= CHARSET_MAX_PENDING_BUF_SIZE) Is it possible for you to send the broken mail to me? Otherwise it would be pretty difficult to figure out how to fix this. Also applying this patch would make it a bit clearer where the problem is: http://hg.dovecot.or...

Having some problems compiling on AIX 5.3 with IBM vac version 8. Programs that I had problems building: test-mail test-imap test-index To fix the undefined symbols problem: ld: 0711-317 ERROR: Undefined symbol: .charset_to_utf8_end ld: 0711-317 ERROR: Undefined symbol: .charset_to_utf8_begin ld: 0711-317 ERROR: Undefined symbol: .charset_to_utf8 ld: 0711-317 ERROR: Undefined symbol: .charset_is_utf8 ld: 0711-317 ERROR: Undefined symbol: .charset_to_utf8_str ld: 0711-317 ERROR: Undefined symbol: .message_header_decode_utf...

...d > In file included from /opt/RDGgcc3/lib/gcc-lib/sparc-sun-solaris2.8/3.3.2/include/sys/types.h:29, > from restrict-access.c:4: > /usr/include/sys/feature_tests.h:96:1: warning: this is the location of the previous definition Solaris 10 > charset-utf8.c: In function `charset_to_utf8': > charset-utf8.c:73: warning: implicit declaration of function `buffer_append' Solaris 8 and SuSE Enterprise Linux 9 (x86-64 gcc 3.3.3) > mail-index-map.c: In function `mail_index_map_ext_hdr_check': > mail-index-map.c:171: warning: comparison between signed and unsigned &gt...

Hi Timo, since I've upgraded to 2.1.8, solr indexer doesnt work correctly. I see a lot of these errors in logs: Fatal: master: service(indexer-worker): child 9582 returned error 83 (Out of memory (service indexer-worker { vsz_limit=256 MB }, you may need to increase it)) I've tried to set vsz_limit to a lot more, (around 4096 MB) but same problem occurs. thank for your help ! Regards

...overflow_arg_area = 0x7fffffffbe80, reg_save_area = 0x7fffffffbdc0}} #4 0x00000000004a826a in buffer_set_used_size (_buf=0x64e740, used_size=18446744073709543512) at buffer.c:288 buf = (struct real_buffer *) 0x64e740 __PRETTY_FUNCTION__ = "buffer_set_used_size" #5 0x00000000004a6fd9 in charset_to_utf8_try (t=0x60e2b0, src=0xd5b000 "\n??????\n\n\n???? ????????????????????\n?????????????????????????\n?????????????????????????\n????????????????????\n\n \n?? ??????????????????????\n?????????????????????????\n?????????????????????????\n?????"..., src_size=0x7fffffffdf30, dest=0x64e740,...