Marc Schiffbauer
2012-Dec-31 03:23 UTC
[Dovecot] 2.1.12: Panic: file solr-connection.c: line 547 (solr_connection_post_more)
Hi all,
I am having a problem indexing one of my mailboxes using the solr fts backend in
dovecot 2.1.12
For many mailboxes it works just fine, but on one mailbox I currently always get
a panic.
solr setup:
Java: icedtea 6.1.11.5
Solr: 3.6.2 running in tomcat 7.0.32
Command to reproduce error: doveadm index -u my at user badmailbox
I already noticed that there have been some solr backend fixes just before
2.1.21 release...
Is this another bug in the backend? Any idea?
IMO relevant logs line parts:
java.io.CharConversionException: Invalid UTF-8 start byte 0xf8 (at char #483989,
byte #532382)
complete dovecot log:
doveadm(my at user): Error: fts_solr: Invalid XML input at 85:198: mismatched
tag (near: <html><head><title>Apache Tomcat/7.0.32-gentoo -
Error report</title><style><!--H1
{font-family:Tahoma,Arial,sans-serif;color:wh)
doveadm(my at user): Panic: file solr-connection.c: line 547
(solr_connection_post_more): assertion failed: (maxfd >= 0)
doveadm(my at user): Error: Raw backtrace:
/usr/lib64/dovecot/libdovecot.so.0(+0x4bcdb) [0x34fbd53ecdb] ->
/usr/lib64/dovecot/libdovecot.so.0(default_fatal_handler+0x3a) [0x34fbd53edb8]
-> /usr/lib64/dovecot/libdovecot.so.0(i_fatal+0) [0x34fbd50eeac] ->
/usr/lib64/dovecot/lib21_fts_solr_plugin.so(solr_connection_post_more+0x2a4)
[0x34fbba81072] -> /usr/lib64/dovecot/lib21_fts_solr_plugin.so(+0x40a5)
[0x34fbba7d0a5] ->
/usr/lib64/dovecot/lib20_fts_plugin.so(fts_build_mail+0x462) [0x34fbbc8d6dc]
-> /usr/lib64/dovecot/lib20_fts_plugin.so(+0xd8c2) [0x34fbbc928c2] ->
doveadm(+0x17a30) [0x264ecb7a30] -> doveadm(+0x13a45) [0x264ecb3a45] ->
doveadm(+0x14762) [0x264ecb4762] -> doveadm(doveadm_mail_try_run+0x173)
[0x264ecb4cfd] -> doveadm(main+0x3e9) [0x264ecbd0d5] ->
/lib64/libc.so.6(__libc_start_main+0xfd) [0x34fbd16a48d] -> doveadm(+0x13809)
[0x264ecb3809]
Aborted
complete java exception:
Dec 31, 2012 4:12:58 AM org.apache.solr.core.SolrCore execute
INFO: [] webapp=/solr-web path=/update params={} status=500 QTime=118
Dec 31, 2012 4:12:58 AM org.apache.solr.common.SolrException log
SEVERE: java.lang.RuntimeException: [was class java.io.CharConversionException]
Invalid UTF-8 start byte 0xf8 (at char #483989, byte #532382)
at
com.ctc.wstx.util.ExceptionUtil.throwRuntimeException(ExceptionUtil.java:18)
at com.ctc.wstx.sr.StreamScanner.throwLazyError(StreamScanner.java:731)
at
com.ctc.wstx.sr.BasicStreamReader.safeFinishToken(BasicStreamReader.java:3657)
at com.ctc.wstx.sr.BasicStreamReader.getText(BasicStreamReader.java:809)
at org.apache.solr.handler.XMLLoader.readDoc(XMLLoader.java:315)
at org.apache.solr.handler.XMLLoader.processUpdate(XMLLoader.java:156)
at org.apache.solr.handler.XMLLoader.load(XMLLoader.java:79)
at
org.apache.solr.handler.ContentStreamHandlerBase.handleRequestBody(ContentStreamHandlerBase.java:58)
at
org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:129)
at org.apache.solr.core.SolrCore.execute(SolrCore.java:1376)
at
org.apache.solr.servlet.SolrDispatchFilter.execute(SolrDispatchFilter.java:365)
at
org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:260)
at
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(Unknown Source)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(Unknown
Source)
at org.apache.catalina.core.StandardWrapperValve.invoke(Unknown Source)
at org.apache.catalina.core.StandardContextValve.invoke(Unknown Source)
at org.apache.catalina.authenticator.AuthenticatorBase.invoke(Unknown
Source)
at org.apache.catalina.core.StandardHostValve.invoke(Unknown Source)
at org.apache.catalina.valves.ErrorReportValve.invoke(Unknown Source)
at org.apache.catalina.valves.AccessLogValve.invoke(Unknown Source)
at org.apache.catalina.core.StandardEngineValve.invoke(Unknown Source)
at org.apache.catalina.connector.CoyoteAdapter.service(Unknown Source)
at org.apache.coyote.http11.AbstractHttp11Processor.process(Unknown
Source)
at
org.apache.coyote.AbstractProtocol$AbstractConnectionHandler.process(Unknown
Source)
at org.apache.tomcat.util.net.JIoEndpoint$SocketProcessor.run(Unknown
Source)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:679)
Caused by: java.io.CharConversionException: Invalid UTF-8 start byte 0xf8 (at
char #483989, byte #532382)
at com.ctc.wstx.io.UTF8Reader.reportInvalidInitial(UTF8Reader.java:302)
at com.ctc.wstx.io.UTF8Reader.read(UTF8Reader.java:188)
at com.ctc.wstx.io.ReaderSource.readInto(ReaderSource.java:84)
at
com.ctc.wstx.io.BranchingReaderSource.readInto(BranchingReaderSource.java:57)
at com.ctc.wstx.sr.StreamScanner.loadMore(StreamScanner.java:992)
at
com.ctc.wstx.sr.BasicStreamReader.readTextSecondary(BasicStreamReader.java:4628)
at
com.ctc.wstx.sr.BasicStreamReader.readCoalescedText(BasicStreamReader.java:4126)
at
com.ctc.wstx.sr.BasicStreamReader.finishToken(BasicStreamReader.java:3701)
at
com.ctc.wstx.sr.BasicStreamReader.safeFinishToken(BasicStreamReader.java:3649)
... 25 more
TIA
-Marc
--
[*] sys4 AG
http://sys4.de, +49 (89) 30 90 46 64
Franziskanerstra?e 15, 81669 M?nchen
Sitz der Gesellschaft: M?nchen, Amtsgericht M?nchen: HRB 199263
Vorstand: Patrick Ben Koetter, Axel von der Ohe, Marc Schiffbauer
Aufsichtsratsvorsitzender: Joerg Heidrich
-------------- next part --------------
A non-text attachment was scrubbed...
Name: signature.asc
Type: application/pgp-signature
Size: 190 bytes
Desc: This is a digitally signed message part.
URL:
<http://dovecot.org/pipermail/dovecot/attachments/20121231/996c10c2/attachment-0004.bin>
Christian Rößner
2013-Jan-02 14:16 UTC
[Dovecot] 2.1.12: Panic: file solr-connection.c: line 547 (solr_connection_post_more)
> solr setup: > Java: icedtea 6.1.11.5 > Solr: 3.6.2 running in tomcat 7.0.32I am running solr on Tomcat 6.> complete dovecot log: > doveadm(my at user): Error: fts_solr: Invalid XML input at 85:198: mismatched tag (near: <html><head><title>Apache Tomcat/7.0.32-gentoo - Error report</title><style><!--H1 {font-family:Tahoma,Arial,sans-serif;color:wh)Looks strange :) Did you investigate this XML thing?> complete java exception: > Dec 31, 2012 4:12:58 AM org.apache.solr.core.SolrCore execute > INFO: [] webapp=/solr-web path=/update params={} status=500 QTime=118status 500. Internal server error? Do you have entries in Apache error.log? -- -Christian R??ner -- [*] sys4 AG Franziskanerstra?e 15 Telefon +49 89 3090 4664 81669 M?nchen Telefax +49 89 3090 4666 Sitz der Gesellschaft: M?nchen, Amtsgericht M?nchen: HRB 199263 Vorstand: Patrick Ben Koetter, Axel von der Ohe, Marc Schiffbauer Aufsichtsratsvorsitzender: Joerg Heidrich
Timo Sirainen
2013-Jan-04 03:21 UTC
[Dovecot] 2.1.12: Panic: file solr-connection.c: line 547 (solr_connection_post_more)
On 31.12.2012, at 5.23, Marc Schiffbauer <m at sys4.de> wrote:> I am having a problem indexing one of my mailboxes using the solr fts backend in dovecot 2.1.12 > For many mailboxes it works just fine, but on one mailbox I currently always get a panic...> SEVERE: java.lang.RuntimeException: [was class java.io.CharConversionException] Invalid UTF-8 start byte 0xf8 (at char #483989, byte #532382)Looks like the same issue I was trying to debug with the other guy also, but I couldn't figure out how that happens. Dovecot shouldn't be sending such data to Solr. Can you record the TCP traffic between Dovecot and Solr when this happens, and send it to me?
Timo Sirainen
2013-Jan-04 21:26 UTC
[Dovecot] 2.1.12: Panic: file solr-connection.c: line 547 (solr_connection_post_more)
On Mon, 2012-12-31 at 04:23 +0100, Marc Schiffbauer wrote:> IMO relevant logs line parts: > java.io.CharConversionException: Invalid UTF-8 start byte 0xf8 (at char #483989, byte #532382)Fixed: http://hg.dovecot.org/dovecot-2.1/rev/7be4709aab5e
Hiromi Kimura
2013-Jan-07 08:25 UTC
[Dovecot] 2.1.12: Panic: file solr-connection.c: line 547 (solr_connection_post_more)
Quote: Timo Sirainen <tss at iki.fi>?> On Mon, 2012-12-31 at 04:23 +0100, Marc Schiffbauer wrote: > >> IMO relevant logs line parts: >> java.io.CharConversionException: Invalid UTF-8 start byte 0xf8 (at >> char #483989, byte #532382) > > Fixed: http://hg.dovecot.org/dovecot-2.1/rev/7be4709aab5eI have another problem with same error. dovecot-2.1.12 + patch (01550514f189,172295f5a78b,339e654f371e,7be4709aab5e) Solr-3.6.0 + Jetty-6.1 # doveadm index -u hiromi badmbox doveadm(hiromi): Error: fts_solr: Indexing failed: 400 Invalid UTF-8 start byte 0xf8 (at char #1681, byte #-1) SEVERE: org.apache.solr.common.SolrException: Invalid UTF-8 start byte 0xf8 (at char #1681, byte #-1) at org.apache.solr.handler.XMLLoader.load(XMLLoader.java:81) at org.apache.solr.handler.ContentStreamHandlerBase.handleRequestBody(ContentStreamHandlerBase.java:58) ... Caused by: java.io.CharConversionException: Invalid UTF-8 start byte 0xf8 (at char #1681, byte #-1) at com.ctc.wstx.io.UTF8Reader.reportInvalidInitial(UTF8Reader.java:302) at com.ctc.wstx.io.UTF8Reader.read(UTF8Reader.java:188) ... Timo, I will send captured data by personal mail. -=-=-=-=- Hiromi KIMURA http://www.tac.tsukuba.ac.jp/~hiromi/ PGP Fingerprint16 = 2A 27 2E 46 9E 75 4E 3D E3 FD 5A DC 2A AA 3A 2E
Hiromi Kimura
2013-Feb-26 01:10 UTC
[Dovecot] 2.1.12: Panic: file solr-connection.c: line 547 (solr_connection_post_more)
This bug was fixed ! http://hg.dovecot.org/dovecot-2.1/rev/fa9387588430 Thanks Timo. Quote: Hiromi Kimura <hiromi at tac.tsukuba.ac.jp>?> Quote: Timo Sirainen <tss at iki.fi>? >> On Mon, 2012-12-31 at 04:23 +0100, Marc Schiffbauer wrote: >> >>> IMO relevant logs line parts: >>> java.io.CharConversionException: Invalid UTF-8 start byte 0xf8 (at >>> char #483989, byte #532382) >> >> Fixed: http://hg.dovecot.org/dovecot-2.1/rev/7be4709aab5e > > I have another problem with same error. > dovecot-2.1.12 + patch (01550514f189,172295f5a78b,339e654f371e,7be4709aab5e) > Solr-3.6.0 + Jetty-6.1 > > # doveadm index -u hiromi badmbox > doveadm(hiromi): Error: fts_solr: Indexing failed: 400 Invalid UTF-8 > start byte 0xf8 (at char #1681, byte #-1) > > SEVERE: org.apache.solr.common.SolrException: Invalid UTF-8 start > byte 0xf8 (at char #1681, byte #-1) > at org.apache.solr.handler.XMLLoader.load(XMLLoader.java:81) > at > org.apache.solr.handler.ContentStreamHandlerBase.handleRequestBody(ContentStreamHandlerBase.java:58) > ... > Caused by: java.io.CharConversionException: Invalid UTF-8 start byte > 0xf8 (at char #1681, byte #-1) > at > com.ctc.wstx.io.UTF8Reader.reportInvalidInitial(UTF8Reader.java:302) > at com.ctc.wstx.io.UTF8Reader.read(UTF8Reader.java:188) > ... > > Timo, I will send captured data by personal mail. > -=-=-=-=- > Hiromi KIMURA http://www.tac.tsukuba.ac.jp/~hiromi/ > PGP Fingerprint16 = 2A 27 2E 46 9E 75 4E 3D E3 FD 5A DC 2A AA 3A 2E >-=-=-=-=- Hiromi KIMURA http://www.tac.tsukuba.ac.jp/~hiromi/ PGP Fingerprint16 = 2A 27 2E 46 9E 75 4E 3D E3 FD 5A DC 2A AA 3A 2E